Sergey Edunov
RESEARCH ENGINEERING MANAGER | MENLO PARK, UNITED STATES
Sergey is a Research Engineering Manager at Facebook AI Research. He works on natural language processing and speech. Previously he worked on distributed graph analytics and was a part of the Apache Giraph team. He earned a MS degree in Physics in 2005 in the Moscow Institute of Physics and Technology.
Sergey's Publications
September 27, 2023
NLP
Effective Long-Context Scaling of Foundation Models
Wenhan Xiong, Igor Molybog, Hejia Zhang, Praj Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang, Hao Ma, Jingyu Liu
September 27, 2023
July 18, 2023
CONVERSATIONAL AI
NLP
Llama 2: Open Foundation and Fine-Tuned Chat Models
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Praj Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Andrew Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurelien Rodriguez, Robert Stojnic, Sergey Edunov, Thomas Scialom
July 18, 2023
July 06, 2022
No Language Left Behind: Scaling Human-Centered Machine Translation
Marta Costa-jussa, James Cross, Onur Çelebi, Maha Elbayad, Kenneth Heafield, Kevin Heffernan, Elahe Kalbassi, Janice Lam, Daniel Licht, Jean Maillard, Anna Sun, Skyler Wang, Guillaume Wenzek, Al Youngblood, Bapi Akula, Loic Barrault, Gabriel Mejia Gonzalez, Kae Hansanti, John Hoffman, Semarley Jarrett, Kaushik Ram Sadagopan, Dirk Rowe, Shannon Spruit, Chau Tran, Pierre Andrews, Necip Fazil Ayan, Shruti Bhosale, Sergey Edunov, Angela Fan, Cynthia Gao, Vedanuj Goswami, Francisco Guzmán, Philipp Koehn, Alex Mourachko, Christophe Ropers, Safiyyah Saleem, Holger Schwenk, Jeff Wang (PM - AI)
July 06, 2022
November 18, 2020
RESEARCH
NLP
Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling
Michael Auli, Sergey Edunov, Shruti Bhosale, Kyra Yee
November 18, 2020
October 23, 2019
RESEARCH
SPEECH & AUDIO
Cloze-driven Pretraining of Self-attention Networks
Michael Auli, Alexei Baevski, Luke Zettlemoyer, Sergey Edunov, Yinhan Liu
October 23, 2019
May 27, 2019
RESEARCH
SPEECH & AUDIO
fairseq: A Fast, Extensible Toolkit for Sequence Modeling
Michael Auli, Alexei Baevski, Angela Fan, Myle Ott, Nathan Ng, Sam Gross, Sergey Edunov, David Grangier
May 27, 2019
October 31, 2018
RESEARCH
SPEECH & AUDIO
Understanding Back-Translation at Scale
Michael Auli, Myle Ott, Sergey Edunov, David Grangier
October 31, 2018
October 30, 2018
October 30, 2018
Foundational models
Latest news
Foundational models
Meta © 2024