Madian Khabsa
RESEARCH SCIENTIST | SEATTLE, UNITED STATES
Madian Khabsa is a research scientist at Facebook AI Research (FAIR), where he works to improve machine learning, natural language processing, and multimodal understanding. Prior to Facebook, Madian worked to improve Siri at Apple. He has a Ph.D. in computer science and engineering from Pennsylvania State University.
Research Areas
Madian's Publications
August 01, 2024
NLP
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants
Lucas Bandarkar, Davis Liang, Mikel Artetxe, Benjamin Muller, Abhinandan Krishnan, Don Husa, Luke Zettlemoyer, Madian Khabsa, Naman Goyal, Satya Narayan Shukla
August 01, 2024
April 05, 2024
CONVERSATIONAL AI
NLP
MART: Improving LLM Safety with Multi-round Automatic Red-Teaming
Suyu Ge, Jiawei Han, Yuning Mao, Chunting Zhou, Madian Khabsa, Qifan Wang, Rui Hou, Yi-Chia Wang
April 05, 2024
December 07, 2023
CONVERSATIONAL AI
NLP
Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations
Hakan Inan, Davide Testuggine, Jianfeng Chi, Kartikeya Upasani, Krithika Iyer, Madian Khabsa, Rashi Rungta, Yuning Mao
December 07, 2023
November 28, 2023
NLP
ROAST: Robustifying Language Models via Adversarial Perturbation with Selective Training
Jaehyung Kim, Davis Liang, Pascale Fung, Fuli Feng, Lifu Huang, Yuning Mao, Hanchao Yu, Madian Khabsa, Qifan Wang, Rui Hou
November 28, 2023
October 27, 2023
CONVERSATIONAL AI
NLP
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models
Davis Liang, Yuning Mao, Hila Gonen, Luke Zettlemoyer, Madian Khabsa, Marjan Ghazvininejad, Naman Goyal, Rui Hou
October 27, 2023
September 27, 2023
NLP
Effective Long-Context Scaling of Foundation Models
Sinong Wang, Angela Fan, Barlas Oguz, Han Fang, Hao Ma, Hejia Zhang, Igor Molybog, Karthik Abinav Sankararaman, Kshitiz Malik, Louis Martin, Madian Khabsa, Mike Lewis, Praj Bhargava, Rashi Rungta, Rui Hou, Sergey Edunov, Sharan Narang, Shruti Bhosale, Wenhan Xiong, Yashar Mehdad, Jingyu Liu
September 27, 2023
July 18, 2023
CONVERSATIONAL AI
NLP
Llama 2: Open Foundation and Fine-Tuned Chat Models
Moya Chen, Marie-Anne Lachaux, Thibaut Lavril, Hugo Touvron, Adina Williams, Alan Schelten, Amjad Almahairi, Andrew Kuan, Andrew Poulton, Angela Fan, Anthony Hartshorn, Artem Korenev, Aurelien Rodriguez, Binh Tang, Brian Fuller, Cristian Canton Ferrer, Cynthia Gao, Dan Bikel, David Esiobu, Diana Liskovich, Xiaoqing Ellen Tan, Eric Michael Smith, Guillem Cucurull, Hakan Inan, Igor Molybog, Iliyan Zarov, Isabel Kloumann, Puxin Xu, Jenya Lee, Jeremy Fu, Jeremy Reizenstein, Jude Fernandes, Kalyan Saladi, Kevin Stone, Louis Martin, Lukas Blecher, Madian Khabsa, Marcin Kardas, Melanie Kambadur, Naman Goyal, Nikolay Bashlykov, Peter Albert, Praj Bhargava, Punit Singh Koura, Pushkar Mishra, Ranjan Subramanian, Rashi Rungta, Robert Stojnic, Ross Taylor, Ruan Silva, Rui Hou, Saghar Hosseini, Sergey Edunov, Sharan Narang, Shruti Bhosale, Soumya Batra, Thomas Scialom, Todor Mihaylov, Vedanuj Goswami, Viktor Kerkez, Wenyin Fu, Xavier Martinet, Yasmine Babaei, Yinghai Lu, Yixin Nie, Yuchen Zhang, Yuning Mao, Zheng Yan
July 18, 2023
June 25, 2022
Quantifying Adaptability in Pre-trained Language Models with 500 Tasks
Jane Yu, Alon Halevy, Luke Zettlemoyer, Madian Khabsa, Belinda Li, Jacob Andreas
June 25, 2022
May 22, 2022
UNIPELT: A Unified Framework for Parameter-Efficient Language Model Tuning
Madian Khabsa, Amjad Almahairi, Hao Ma, Lambert Mathias, Rui Hou, Scott Yih, Yuning Mao, Jiawei Han
May 22, 2022
June 25, 2020
NLP
Language Models as Fact Checkers?
Madian Khabsa, Belinda Li, Hao Ma, Scott Yih, Sinong Wang, Nayeon Lee
June 25, 2020
July 19, 2019
RESEARCH
NLP
Keeping Notes: Conditional Natural Language Generation with a Scratchpad Mechanism
Madian Khabsa, Claire Cardie, Michele Banko, Ryan Y. Benmalek, Suma Desu
July 19, 2019
Our approach
Latest news
Foundational models
Meta © 2026