Madian Khabsa

RESEARCH SCIENTIST | SEATTLE, UNITED STATES

Madian Khabsa is a research scientist at Facebook AI Research (FAIR), where he works to improve machine learning, natural language processing, and multimodal understanding. Prior to Facebook, Madian worked to improve Siri at Apple. He has a Ph.D. in computer science and engineering from Pennsylvania State University.

Madian's Publications

August 01, 2024

NLP

The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants

Lucas Bandarkar, Davis Liang, Benjamin Muller, Mikel Artetxe, Satya Narayan Shukla, Don Husa, Naman Goyal, Abhinandan Krishnan, Luke Zettlemoyer, Madian Khabsa

August 01, 2024

April 05, 2024

CONVERSATIONAL AI

NLP

MART: Improving LLM Safety with Multi-round Automatic Red-Teaming

Suyu Ge, Chunting Zhou, Rui Hou, Madian Khabsa, Yi-Chia Wang, Qifan Wang, Jiawei Han, Yuning Mao

April 05, 2024

December 07, 2023

CONVERSATIONAL AI

NLP

Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations

Hakan Inan, Kartikeya Upasani, Jianfeng Chi, Rashi Rungta, Krithika Iyer, Yuning Mao, Davide Testuggine, Madian Khabsa

December 07, 2023

November 28, 2023

NLP

ROAST: Robustifying Language Models via Adversarial Perturbation with Selective Training

Jaehyung Kim, Yuning Mao, Rui Hou, Hanchao Yu, Davis Liang, Pascale Fung, Qifan Wang, Fuli Feng, Lifu Huang, Madian Khabsa

November 28, 2023

October 27, 2023

CONVERSATIONAL AI

NLP

XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models

Davis Liang, Hila Gonen, Yuning Mao, Rui Hou, Naman Goyal, Marjan Ghazvininejad, Luke Zettlemoyer, Madian Khabsa

October 27, 2023

September 27, 2023

NLP

Effective Long-Context Scaling of Foundation Models

Wenhan Xiong, Igor Molybog, Hejia Zhang, Praj Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang, Hao Ma, Jingyu Liu

September 27, 2023

July 18, 2023

CONVERSATIONAL AI

NLP

Llama 2: Open Foundation and Fine-Tuned Chat Models

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Praj Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Andrew Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurelien Rodriguez, Robert Stojnic, Sergey Edunov, Thomas Scialom

July 18, 2023

June 25, 2022

Quantifying Adaptability in Pre-trained Language Models with 500 Tasks

Jane Yu, Alon Halevy, Luke Zettlemoyer, Madian Khabsa, Belinda Li, Jacob Andreas

June 25, 2022

May 22, 2022

UNIPELT: A Unified Framework for Parameter-Efficient Language Model Tuning

Madian Khabsa, Amjad Almahairi, Hao Ma, Lambert Mathias, Rui Hou, Scott Yih, Yuning Mao, Jiawei Han

May 22, 2022

June 25, 2020

NLP

Language Models as Fact Checkers?

Madian Khabsa, Belinda Li, Hao Ma, Scott Yih, Sinong Wang, Nayeon Lee

June 25, 2020

July 19, 2019

RESEARCH

NLP

Keeping Notes: Conditional Natural Language Generation with a Scratchpad Mechanism

Madian Khabsa, Claire Cardie, Michele Banko, Ryan Y. Benmalek, Suma Desu

July 19, 2019