Victoria Lin

The development of large language models (LLMs) has expanded to multi-modal systems capable of processing text, images, an...

Large-scale generative language models such as GPT-3 are competitive few-shot learners. While these models are known to be...

Retrieval-augmented language models (RALMs) improve performance by accessing long-tail and up-to-date knowledge from exter...

We introduce MoMa, a novel modality-aware mixture-of-experts (MoE) architecture designed for pre-training mixed-modal, ear...

Large language models (LLMs) often hallucinate and lack the ability to provide attribution for their generations. Semi-par...

Large language models, which are often trained for hundreds of thousands of compute days, have shown remarkable capabiliti...