RESEARCH

SPEECH & AUDIO

fairseq: A Fast, Extensible Toolkit for Sequence Modeling

May 27, 2019

Abstract

fairseq is an open-source sequence modeling toolkit that allows researchers and developers to train custom models for translation, summarization, language modeling, and other text generation tasks. The toolkit is based on PyTorch and supports distributed training across multiple GPUs and machines. We also support fast mixed-precision training and inference on modern GPUs. A demo video can be found here: https://www.youtube.com/watch?v=OtgDdWtHvto.

Download the Paper

AUTHORS

Written by

Michael Auli

Alexei Baevski

Angela Fan

Myle Ott

Nathan Ng

Sam Gross

Sergey Edunov

David Grangier

Publisher

NAACL system track

Related Publications

September 24, 2026

REINFORCEMENT LEARNING

RESEARCH

MaD-RL: Matching Distributions for Calibrating LLMs with Reinforcement Learning

Sourabh Kulkarni, Ksheeraj Sai Vepuri, Basar Demir, Jason Bohrer, Emily Shen, Jianfa Chen, Nan Jiang, Ankit Jain, Harihar Subramanyam, Mannat Singh, Chirag Nagpal

September 24, 2026

September 06, 2026

SPEECH & AUDIO

Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis

Min-Jae Hwang, Sho Inoue, Bokai Yu, David Kant, Dongmin Hyun, Dorian Desblancs, Gregory Antonovsky, Oleg Repin, Zehai Tu, Juan Pino, Wei-Ning Hsu

September 06, 2026

July 17, 2026

CONVERSATIONAL AI

REINFORCEMENT LEARNING

Learning to Reason by Analogy via Retrieval-Augmented Reinforcement Fine-Tuning

Zilin Xiao, Qi Ma, Jason Chen, Xintao Chen, Avinash Atreya, Hanjie Chen, Vicente Ordonez

July 17, 2026

July 13, 2026

AR/VR

RESEARCH

S-EMBER: A Large-Scale Benchmark for Streaming Egocentric Memory Retrieval

Xiaodong Wang, Xuanyi Zhao, Pedro Rodriguez, Devendra Singh Sachan, Barlas Oguz, Seungwhan Moon, Shang-Wen Li, Gargi Ghosh, Xin Dong, Wen-Tau Yih

July 13, 2026

Help Us Pioneer The Future of AI

We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.