Sergey Edunov

RESEARCH ENGINEERING MANAGER | MENLO PARK, UNITED STATES

Sergey is a Research Engineering Manager at Facebook AI Research. He works on natural language processing and speech. Previously he worked on distributed graph analytics and was a part of the Apache Giraph team. He earned a MS degree in Physics in 2005 in the Moscow Institute of Physics and Technology.

Sergey's Publications

September 27, 2023

NLP

Effective Long-Context Scaling of Foundation Models

Sinong Wang, Angela Fan, Barlas Oguz, Han Fang, Hao Ma, Hejia Zhang, Igor Molybog, Karthik Abinav Sankararaman, Kshitiz Malik, Louis Martin, Madian Khabsa, Mike Lewis, Praj Bhargava, Rashi Rungta, Rui Hou, Sergey Edunov, Sharan Narang, Shruti Bhosale, Wenhan Xiong, Yashar Mehdad, Jingyu Liu

September 27, 2023

July 18, 2023

CONVERSATIONAL AI

NLP

Llama 2: Open Foundation and Fine-Tuned Chat Models

Moya Chen, Marie-Anne Lachaux, Thibaut Lavril, Hugo Touvron, Adina Williams, Alan Schelten, Amjad Almahairi, Andrew Kuan, Andrew Poulton, Angela Fan, Anthony Hartshorn, Artem Korenev, Aurelien Rodriguez, Binh Tang, Brian Fuller, Cristian Canton Ferrer, Cynthia Gao, Dan Bikel, David Esiobu, Diana Liskovich, Xiaoqing Ellen Tan, Eric Michael Smith, Guillem Cucurull, Hakan Inan, Igor Molybog, Iliyan Zarov, Isabel Kloumann, Puxin Xu, Jenya Lee, Jeremy Fu, Jeremy Reizenstein, Jude Fernandes, Kalyan Saladi, Kevin Stone, Louis Martin, Lukas Blecher, Madian Khabsa, Marcin Kardas, Melanie Kambadur, Naman Goyal, Nikolay Bashlykov, Peter Albert, Praj Bhargava, Punit Singh Koura, Pushkar Mishra, Ranjan Subramanian, Rashi Rungta, Robert Stojnic, Ross Taylor, Ruan Silva, Rui Hou, Saghar Hosseini, Sergey Edunov, Sharan Narang, Shruti Bhosale, Soumya Batra, Thomas Scialom, Todor Mihaylov, Vedanuj Goswami, Viktor Kerkez, Wenyin Fu, Xavier Martinet, Yasmine Babaei, Yinghai Lu, Yixin Nie, Yuchen Zhang, Yuning Mao, Zheng Yan

July 18, 2023

July 06, 2022

No Language Left Behind: Scaling Human-Centered Machine Translation

Shannon Spruit, Chau Tran, Marta Costa-jussa, Al Youngblood, Alex Mourachko, Angela Fan, Anna Sun, Bapi Akula, Christophe Ropers, Cynthia Gao, Daniel Licht, Dirk Rowe, Elahe Kalbassi, Francisco Guzmán, Gabriel Mejia Gonzalez, Guillaume Wenzek, Holger Schwenk, James Cross, Janice Lam, Jean Maillard, Jeff Wang (PM - AI), John Hoffman, Kae Hansanti, Kaushik Ram Sadagopan, Kenneth Heafield, Kevin Heffernan, Loic Barrault, Maha Elbayad, Necip Fazil Ayan, Onur Çelebi, Philipp Koehn, Pierre Andrews, Safiyyah Saleem, Semarley Jarrett, Sergey Edunov, Shruti Bhosale, Skyler Wang, Vedanuj Goswami

July 06, 2022

November 18, 2020

RESEARCH

NLP

Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling

Michael Auli, Sergey Edunov, Shruti Bhosale, Kyra Yee

November 18, 2020

October 23, 2019

RESEARCH

SPEECH & AUDIO

Cloze-driven Pretraining of Self-attention Networks

Michael Auli, Alexei Baevski, Luke Zettlemoyer, Sergey Edunov, Yinhan Liu

October 23, 2019

May 27, 2019

RESEARCH

SPEECH & AUDIO

fairseq: A Fast, Extensible Toolkit for Sequence Modeling

Michael Auli, Alexei Baevski, Angela Fan, Myle Ott, Nathan Ng, Sam Gross, Sergey Edunov, David Grangier

May 27, 2019

October 31, 2018

RESEARCH

SPEECH & AUDIO

Understanding Back-Translation at Scale

Michael Auli, Myle Ott, Sergey Edunov, David Grangier

October 31, 2018

October 30, 2018

RESEARCH

Scaling Neural Machine Translation

Michael Auli, Myle Ott, Sergey Edunov, David Grangier

October 30, 2018