Luke Zettlemoyer
RESEARCH MANAGER | SEATTLE, UNITED STATES
Luke Zettlemoyer is a research manager and site lead for FAIR Seattle. He is also a Professor in the Allen School of Computer Science & Engineering at the University of Washington. His research is in empirical computational semantics, where the goal is to build models that recover representations of the meaning of natural language text. Recent work has focused on language modeling pretraining, multi-lingual NLP, semantic parsing, question answering, and information extraction. Luke's honors include a PECASE Award and being named an Allen Distinguished Investigator, along with more than ten paper awards at top NLP venues. He was a postdoctoral researcher at the University of Edinburgh and received his Ph.D. from MIT.
Research Areas
Luke's Publications
May 04, 2026
NLP
Compute Optimal Tokenization
Sachin Mehta, Alisa Liu, Margaret Li, Artidoro Pagnoni, Gargi Ghosh, Luke Zettlemoyer, Mike Lewis, Srini Iyer, Tomasz Limisiewicz
May 04, 2026
April 25, 2025
RESEARCH
NLP
ReasonIR: Training Retrievers for Reasoning Tasks
Qiao Rui, Varsha Kishore, Niklas Muennighoff, Daniela Rus, Bryan Kian Hsiang Low, Sewon Min, Pang Wei Koh, Luke Zettlemoyer, Rulin Shao, Scott Yih, Victoria Lin
April 25, 2025
December 12, 2024
NLP
Byte Latent Transformer: Patches Scale Better Than Tokens
Margaret Li, Chunting Zhou, Ari Holtzman, Srini Iyer, Artidoro Pagnoni, Benjamin Muller, Gargi Ghosh, Jason Weston, John Nguyen, Lili Yu, Luke Zettlemoyer, Mike Lewis, Pedro Rodriguez, Ram Pasunuru
December 12, 2024
December 11, 2024
NLP
COMPUTER VISION
Meta CLIP 1.2
Saining Xie, Hu Xu, Bernie Huang, Ching-Feng Yeh, Christine Jou, Christoph Feichtenhofer, Daniel Li (FAIR), Ellen Tan, Gargi Ghosh, Jacob Kahn, Kim Hazelwood, Luke Zettlemoyer, Omer Levy, Philippe Brunet, Ramya Raghavendra, Scott Yih
December 11, 2024
September 05, 2024
CONVERSATIONAL AI
NLP
Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model
Chunting Zhou, Arun Babu, Jacob Kahn, Kushal Tirumala, Leonid Shamis, Lili Yu, Luke Zettlemoyer, Michihiro Yasunaga, Omer Levy, Xuezhe Ma
September 05, 2024
August 01, 2024
NLP
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants
Lucas Bandarkar, Davis Liang, Mikel Artetxe, Benjamin Muller, Abhinandan Krishnan, Don Husa, Luke Zettlemoyer, Madian Khabsa, Naman Goyal, Satya Narayan Shukla
August 01, 2024
April 22, 2024
NLP
Text Quality-Based Pruning for Efficient Training of Language Models
Vasu Sharma *, Armen Aghajanyan, Bernie Huang, Daniel Li (FAIR), Gargi Ghosh, Hu Xu, Karthik Padthe *, Kushal Tirumala, Luke Zettlemoyer, Newsha Ardalani, Russ Howes
April 22, 2024
February 22, 2024
NLP
Toolformer: Language Models Can Teach Themselves to Use Tools
Jane Yu, Eric Hambro, Luke Zettlemoyer, Maria Lomeli, Nicola Cancedda, Roberta Raileanu, Roberto Dessì, Thomas Scialom, Timo Schick
February 22, 2024
December 04, 2023
NLP
PATHFINDER: Guided Search over Multi-Step Reasoning Paths
Olga Golovneva, Asli Celikyilmaz, Luke Zettlemoyer, Maryam Fazel-Zarandi, Ram Pasunuru, Sean O'Brien, Tianlu Wang
December 04, 2023
November 17, 2023
NLP
FactScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
Scott Yih, Luke Zettlemoyer, Mike Lewis, Hannaneh Hajishirzi, Kalpesh Krishna, Mohit Iyyer, Pang Wei Koh, Sewon Min, Xinxi Lyu
November 17, 2023
October 27, 2023
CONVERSATIONAL AI
NLP
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models
Davis Liang, Yuning Mao, Hila Gonen, Luke Zettlemoyer, Madian Khabsa, Marjan Ghazvininejad, Naman Goyal, Rui Hou
October 27, 2023
September 03, 2023
NLP
COMPUTER VISION
Retrieval-Augmented Multimodal Language Modeling
Jure Leskovec, Percy Liang, Scott Yih, Armen Aghajanyan, Luke Zettlemoyer, Michihiro Yasunaga, Mike Lewis, Rich James, Weijia Shi
September 03, 2023
July 14, 2023
NLP
COMPUTER VISION
Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning
Armen Aghajanyan, Adam Polyak, Arun Babu, Asli Celikyilmaz, Benjamin Miller, Binh Tang, Bowen Shi, Brian Karrer, Candace Ross, Daniel Li (FAIR), Gargi Ghosh, Jacob Xu, Lili Yu, Luke Zettlemoyer, Maryam Fazel-Zarandi, Olga Golovneva, Ram Pasunuru, Russ Howes, Shelly Sheynin, Tianlu Wang, Uriel Singer, Vasu Sharma, Yaniv Taigman
July 14, 2023
November 16, 2022
RESEARCH
NLP
Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models
Kushal Tirumala, Aram H. Markosyan, Armen Aghajanyan, Luke Zettlemoyer
November 16, 2022
June 25, 2022
Quantifying Adaptability in Pre-trained Language Models with 500 Tasks
Jane Yu, Alon Halevy, Luke Zettlemoyer, Madian Khabsa, Belinda Li, Jacob Andreas
June 25, 2022
December 03, 2021
Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignment
Sida Wang, Haoyue Shi, Luke Zettlemoyer
December 03, 2021
October 26, 2021
NLP
Luna: Linear Unified Nested Attention
Xuezhe Ma, Xiang Kong, Chunting Zhou, Jonathan May, Sinong Wang, Hao Ma, Luke Zettlemoyer
October 26, 2021
December 06, 2020
RESEARCH
NLP
Pre-training via Paraphrasing
Michael Lewis, Armen Aghajanyan, Gargi Ghosh, Luke Zettlemoyer, Marjan Ghazvininejad, Sida Wang
December 06, 2020
November 16, 2020
RESEARCH
NLP
Scalable Zero-shot Entity Linking with Dense Entity Retrieval
Ledell Wu, Fabio Petroni, Luke Zettlemoyer, Sebastian Riedel, Martin Josifoski
November 16, 2020
July 15, 2020
RESEARCH
ML APPLICATIONS
Aligned Cross Entropy for Non-Autoregressive Machine Translation
Marjan Ghazvininejad, Luke Zettlemoyer, Omer Levy, Vladimir Karpukhin
July 15, 2020
July 09, 2020
NLP
ML APPLICATIONS
Emerging Cross-lingual Structure in Pretrained Language Models
Shijie Wu, Haoran Li, Luke Zettlemoyer, Shijie Wu, Ves Stoyanov
July 09, 2020
July 06, 2020
RESEARCH
NLP
Simple and Effective Retrieve-Edit-Rerank Text Generation
Marjan Ghazvininejad, Luke Zettlemoyer, Nabil Hossain
July 06, 2020
June 25, 2020
NLP
Moving Down the Long Tail of Word Sense Disambiguation with Gloss Informed Bi-encoders
Terra Blevins, Luke Zettlemoyer
June 25, 2020
March 02, 2020
RESEARCH
ML APPLICATIONS
Generalization through Memorization: Nearest Neighbor Language Models
Mike Lewis, Luke Zettlemoyer, Omer Levy, Dan Jurafsky, Urvashi Khandelwal
March 02, 2020
November 02, 2019
RESEARCH
NLP
Mask-Predict: Parallel Decoding of Conditional Masked Language Models
Marjan Ghazvininejad, Luke Zettlemoyer, Omer Levy, Yinhan Liu
November 02, 2019
October 23, 2019
RESEARCH
SPEECH & AUDIO
Cloze-driven Pretraining of Self-attention Networks
Michael Auli, Alexei Baevski, Luke Zettlemoyer, Sergey Edunov, Yinhan Liu
October 23, 2019
October 18, 2019
RESEARCH
SPEECH & AUDIO
A Discrete Hard EM Approach for Weakly Supervised Question Answering
Luke Zettlemoyer, Danqi Chen, Hanna Hajishirzi, Sweon Min
October 18, 2019
Our approach
Latest news
Foundational models
Meta © 2026