ML Applications

Embedding-based Retrieval in Facebook Search

August 22, 2020

Abstract

Search in social networks such as Facebook poses different challenges than in classical web search: besides the query text, it is important to take into account the searcher’s context to provide relevant results. Their social graph is an integral part of this context and is a unique aspect of Facebook search. While embedding-based retrieval (EBR) has been applied in web search engines for years, Facebook search was still mainly based on a Boolean matching model. In this paper, we discuss the techniques for applying EBR to a Facebook Search system. We introduce the unified embedding framework developed to model semantic embeddings for personalized search, and the system to serve embedding-based retrieval in a typical search system based on an inverted index. We discuss various tricks and experiences on end-to-end optimization of the whole system, including ANN parameter tuning and full-stack optimization. Finally, we present our progress on two selected advanced topics about modeling. We evaluated EBR on verticals for Facebook Search with significant metrics gains observed in online A/B experiments. We believe this paper will provide useful insights and experiences to help people on developing embedding-based retrieval systems in search engines.

Download the Paper

AUTHORS

Written by

Jui-Ting Huang

Ashish Sharma

Shuying Sun

Li Xia

David Zhang

Philip Pronin

Janani Padmanabhan

Giuseppe Ottaviano

Linjun Yang

Publisher

Knowledge Discovery and Data Mining (KDD)

Related Publications

November 30, 2020

Human & Machine Intelligence

Measuring Systematic Generalization in Neural Symbolic Reasoning with Transformers

Koustuv Sinha, Christopher Pal, Nicolas Gontier, Siva Reddy

November 30, 2020

December 03, 2018

Human & Machine Intelligence

Forward Modeling for Partial Observation Strategy Games - A StarCraft Defogger

Gabriel Synnaeve, Daniel Gant, Jonas Gehring, Nicolas Carion, Nicolas Usunier, Vasil Khalidov, Vegard Mella, Zeming Lin

December 03, 2018

December 03, 2018

Human & Machine Intelligence

Speech & Audio

Forward Modeling for Partial Observation Strategy Games | Facebook AI Research

Gabriel Synnaeve, Zeming Lin, Jonas Gehring, Dan Gant, Vegard Mella, Vasil Khalidov, Nicolas Carion, Nicolas Usunier

December 03, 2018

April 24, 2017

Human & Machine Intelligence

Computer Vision

Episodic Exploration for Deep Deterministic Policies for StarCraft Micro-Management | Facebook AI Research

Nicolas Usunier, Gabriel Synnaeve, Zeming Lin, Soumith Chintala

April 24, 2017

May 06, 2019

Human & Machine Intelligence

Hierarchical RL Using an Ensemble of Proprioceptive Periodic Policies | Facebook AI Research

Kenneth Marino, Abhinav Gupta, Rob Fergus, Arthur Szlam

May 06, 2019

July 03, 2019

NLP

Speech & Audio

Linguistic generalization and compositionality in modern artificial neural networks | Facebook AI Research

Marco Baroni

July 03, 2019

Help Us Pioneer The Future of AI

We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.