Research
Conversational AI
Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog
December 4, 2018
Abstract
One of the first steps in the utterance interpretation pipeline of many task-oriented conversational AI systems is to identify user intents and the corresponding slots. Neural sequence labeling models have achieved very high accuracy on these tasks when trained on large amounts of training data. However, collecting this data is very time-consuming and therefore it is unfeasible to collect large amounts of data for many languages. For this reason, it is desirable to make use of existing data in a high-resource language to train models in low-resource languages. In this paper, we investigate the performance of three different methods for cross-lingual transfer learning, namely (1) translating the training data, (2) using cross-lingual pre-trained embeddings, and (3) a novel method of using a multilingual machine translation encoder as contextual word representations. We find that given several hundred training examples in the the target language, the latter two methods outperform translating the training data. Further, in very low-resource settings, we find that multilingual contextual word representations give better results than using cross-lingual static embeddings. We release the new dataset and plan to release our implementation of the NLU models in the near future.
Related Publications
February 26, 2026
Conversational AI
Learning Personalized Agents from Human Feedback
Kaiqu Liang, Xianjun Yang, Shaoliang Nie, Jaime Fernández Fisac, Shuyan Zhou, Julia Kruk, Lijuan Liu, Michael Zhang, Saghar Hosseini, Shengjie Bi, Shengyi Qian
February 26, 2026
September 24, 2025
Conversational AI
Reinforcement Learni9ng
Compute as Teacher: Turning Inference Compute Into Reference-Free Supervision
Dulhan Jayalath, Suchin Gururangan, Cheng Zhang, Alan Schelten, Anirudh Goyal, Parag Jain, Shashwat Goel, Thomas Simon Foster
September 24, 2025
June 27, 2025
Human & Machine Intelligence
Conversational AI
Seamless Interaction: Dyadic Audiovisual Motion Modeling and Large-Scale Dataset
Morteza Behrooz, Ning Dong, Jeff Girard, Vasu Sharma, Jan Zikes, Akinniyi Akinyemi, Alex Shcherbyna, Alexander Richard, Alice Rakotoarison, Amia Oberai, Anastasis Stathopoulos, Anna Sun, Antony D'Avirro, Arina Turkatenko, Benjamin Peloquin, Bo Wan, Brandon Han, Carleigh Wood, Chao Wang, Chen Zhang, Christophe Ropers, Christopher Klaiber, Cynthia Gao, Dejan Kovachev, Denise Hernandez, Evonne Ng, Fabian Prada, Fabio Maria Carlucci, Guangyao Ma, Hang Li, Hirofumi Inaguma, Hongyu Gong, Jason Zheng, Jeff Wang, Jie Shen, Jiemin Zhang, Jing Ma, Joe Chuang, Jon Daly, Jovan Popovic, Joy Chen, Juan Pino, Julia Buffalini, Zhiyuan Yao, Junming Chen, Kam-Woh Ng, Kathryn Alvero, Louis-Philippe Morency, Lucas Mantovani, Mark Duppenthaler, Martin Gleize, Martin Ma, Mary Williamson, Michael Zollhoefer, Moneish Kumar, Omid Poursaeed, Paden Tomasello, Pavel Litvin, Pavlo Zhyzheria, Praveen Chowdary, Qingyao Jia, Raj Janardhan, Rongjie Huang, Safiyyah Saleem, Sagar Miglani, Sahir Gomez, Sen He, Shiyang Cheng, Somya Jain, Sreyas Mohan, Srivathsan Govindarajan, Tao Xiang, Tu Anh Nguyen, Tuan Tran, Vasu Agrawal, Wei Liu, Xinyue Zhang, Xutai Ma, Yilei Li, Yilin Yang, Yordan Hristov, Zhang Chen
June 27, 2025
April 17, 2025
Human & Machine Intelligence
Conversational AI
Collaborative Reasoner: Self-improving Social Agents with Synthetic Conversations
Ansong Ni, Asli Celikyilmaz, Daniel Li (FAIR), Dong Wang, Gargi Ghosh, Ramya Raghavendra, Ruta Desai, Xinjie Lei, Yang Li
April 17, 2025
December 13, 2019
Conversational AI
NLP
Lead2Gold: Towards exploiting the full potential of noisy transcriptions for speech recognition | Facebook AI Research
Adrien Dufraux, Emmanuel Dupoux, Awni Hannun, Armelle Brun, Matthijs Douze
December 13, 2019
December 04, 2018
Conversational AI
NLP
Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog | Facebook AI Research
Sebastian Schuster, Sonal Gupta, Rushin Shah, Mike Lewis
December 04, 2018
July 28, 2019
NLP
Conversational AI
What makes a good conversation? How controllable attributes affect human judgments | Facebook AI Research
Abigail See, Stephen Roller, Douwe Kiela, Jason Weston
July 28, 2019
November 05, 2019
NLP
Conversational AI
Memory Grounded Conversational Reasoning | Facebook AI Research
Shane Moon, Pararth Shah, Anuj Kumar, Rajen Subba
November 05, 2019
Help Us Pioneer The Future of AI
We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.
Our approach
Latest news
Foundational models
Meta © 2026