Research
Conversational AI
Explore-Exploit: A Framework for Interactive and Online Learning
December 3, 2018
Abstract
Interactive user interfaces need to continuously evolve based on the interactions that a user has (or does not have) with the system. This may require constant exploration of various options that the system may have for the user and obtaining signals of user preferences on those. However, such an exploration, especially when the set of available options itself can change frequently, can lead to suboptimal user experiences. We present Explore-Exploit: a framework designed to collect and utilize user feedback in an interactive and online setting that minimizes regressions in end-user experience. This framework provides a suite of online learning operators for various tasks such as personalization ranking, candidate selection and active learning. We demonstrate how to integrate this framework with run-time services to leverage online and interactive machine learning out-of-the-box. We also present results demonstrating the efficiencies that can be achieved using the Explore-Exploit framework.
AUTHORS
Research Topics
Related Publications
February 26, 2026
Conversational AI
Learning Personalized Agents from Human Feedback
Kaiqu Liang, Xianjun Yang, Shaoliang Nie, Jaime Fernández Fisac, Shuyan Zhou, Julia Kruk, Lijuan Liu, Michael Zhang, Saghar Hosseini, Shengjie Bi, Shengyi Qian
February 26, 2026
September 24, 2025
Conversational AI
Reinforcement Learni9ng
Compute as Teacher: Turning Inference Compute Into Reference-Free Supervision
Dulhan Jayalath, Suchin Gururangan, Cheng Zhang, Alan Schelten, Anirudh Goyal, Parag Jain, Shashwat Goel, Thomas Simon Foster
September 24, 2025
June 27, 2025
Human & Machine Intelligence
Conversational AI
Seamless Interaction: Dyadic Audiovisual Motion Modeling and Large-Scale Dataset
Morteza Behrooz, Ning Dong, Jeff Girard, Vasu Sharma, Jan Zikes, Akinniyi Akinyemi, Alex Shcherbyna, Alexander Richard, Alice Rakotoarison, Amia Oberai, Anastasis Stathopoulos, Anna Sun, Antony D'Avirro, Arina Turkatenko, Benjamin Peloquin, Bo Wan, Brandon Han, Carleigh Wood, Chao Wang, Chen Zhang, Christophe Ropers, Christopher Klaiber, Cynthia Gao, Dejan Kovachev, Denise Hernandez, Evonne Ng, Fabian Prada, Fabio Maria Carlucci, Guangyao Ma, Hang Li, Hirofumi Inaguma, Hongyu Gong, Jason Zheng, Jeff Wang, Jie Shen, Jiemin Zhang, Jing Ma, Joe Chuang, Jon Daly, Jovan Popovic, Joy Chen, Juan Pino, Julia Buffalini, Zhiyuan Yao, Junming Chen, Kam-Woh Ng, Kathryn Alvero, Louis-Philippe Morency, Lucas Mantovani, Mark Duppenthaler, Martin Gleize, Martin Ma, Mary Williamson, Michael Zollhoefer, Moneish Kumar, Omid Poursaeed, Paden Tomasello, Pavel Litvin, Pavlo Zhyzheria, Praveen Chowdary, Qingyao Jia, Raj Janardhan, Rongjie Huang, Safiyyah Saleem, Sagar Miglani, Sahir Gomez, Sen He, Shiyang Cheng, Somya Jain, Sreyas Mohan, Srivathsan Govindarajan, Tao Xiang, Tu Anh Nguyen, Tuan Tran, Vasu Agrawal, Wei Liu, Xinyue Zhang, Xutai Ma, Yilei Li, Yilin Yang, Yordan Hristov, Zhang Chen
June 27, 2025
April 17, 2025
Human & Machine Intelligence
Conversational AI
Collaborative Reasoner: Self-improving Social Agents with Synthetic Conversations
Ansong Ni, Asli Celikyilmaz, Daniel Li (FAIR), Dong Wang, Gargi Ghosh, Ramya Raghavendra, Ruta Desai, Xinjie Lei, Yang Li
April 17, 2025
December 13, 2019
Conversational AI
NLP
Lead2Gold: Towards exploiting the full potential of noisy transcriptions for speech recognition | Facebook AI Research
Adrien Dufraux, Emmanuel Dupoux, Awni Hannun, Armelle Brun, Matthijs Douze
December 13, 2019
December 04, 2018
Conversational AI
NLP
Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog | Facebook AI Research
Sebastian Schuster, Sonal Gupta, Rushin Shah, Mike Lewis
December 04, 2018
July 28, 2019
NLP
Conversational AI
What makes a good conversation? How controllable attributes affect human judgments | Facebook AI Research
Abigail See, Stephen Roller, Douwe Kiela, Jason Weston
July 28, 2019
November 05, 2019
NLP
Conversational AI
Memory Grounded Conversational Reasoning | Facebook AI Research
Shane Moon, Pararth Shah, Anuj Kumar, Rajen Subba
November 05, 2019
Help Us Pioneer The Future of AI
We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.
Our approach
Latest news
Foundational models
Meta © 2026