Research

Ranking & Recommendations

Multi-Perspective Relevance Matching with Hierarchical ConvNets for Social Media Search

May 3, 2019

Abstract

Despite substantial interest in applications of neural networks to information retrieval, neural ranking models have mostly been applied to “standard” ad hoc retrieval tasks over web pages and newswire articles. This paper proposes MP-HCNN (Multi-Perspective Hierarchical Convolutional Neural Network), a novel neural ranking model specifically designed for ranking short social media posts. We identify document length, informal language, and heterogeneous relevance signals as features that distinguish documents in our domain, and present a model specifically designed with these characteristics in mind. Our model uses hierarchical convolutional layers to learn latent semantic soft-match relevance signals at the character, word, and phrase levels. A pooling-based similarity measurement layer integrates evidence from multiple types of matches between the query, the social media post, as well as URLs contained in the post. Extensive experiments using Twitter data from the TREC Microblog Tracks 2011–2014 show that our model significantly outperforms prior feature-based as well as existing neural ranking models. To our best knowledge, this paper presents the first substantial work tackling search over social media posts using neural ranking models. Our code and data are publicly available.1

Download the Paper

Related Publications

October 16, 2019

Conversational AI

Lead2Gold: Towards exploiting the full potential of noisy transcriptions for speech recognition

Awni Hannun, Adrien Dufraux, Matthijs Douze, Armelle Brun, Emmanuel Vincent

October 16, 2019

July 27, 2019

Conversational AI

Learning from Dialogue after Deployment: Feed Yourself, Chatbot!

Pierre-Emmanuel Mazaré, Antoine Bordes, Jason Weston, Braden Hancock

July 27, 2019

June 03, 2019

Conversational AI

GEOMetrics: Exploiting Geometric Structure for Graph-Encoded Objects

Adriana Romero Soriano, Dave Meger, Edward Smith, Scott Fujimoto

June 03, 2019

May 29, 2019

Conversational AI

What makes a good conversation? How controllable attributes affect human judgments

Douwe Kiela, Abi See, Jason Weston, Stephen Roller

May 29, 2019

December 04, 2018

Conversational AI

NLP

Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog | Facebook AI Research

Sebastian Schuster, Sonal Gupta, Rushin Shah, Mike Lewis

December 04, 2018

December 13, 2019

Conversational AI

NLP

Lead2Gold: Towards exploiting the full potential of noisy transcriptions for speech recognition | Facebook AI Research

Adrien Dufraux, Emmanuel Dupoux, Awni Hannun, Armelle Brun, Matthijs Douze

December 13, 2019

July 28, 2019

NLP

Conversational AI

What makes a good conversation? How controllable attributes affect human judgments | Facebook AI Research

Abigail See, Stephen Roller, Douwe Kiela, Jason Weston

July 28, 2019

November 05, 2019

NLP

Conversational AI

Memory Grounded Conversational Reasoning | Facebook AI Research

Shane Moon, Pararth Shah, Anuj Kumar, Rajen Subba

November 05, 2019

Help Us Pioneer The Future of AI

We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.