Research
NLP
#TagSpace: Semantic Embeddings from Hashtags
September 4, 2014
Abstract
We describe a convolutional neural network that learns feature representations for short textual posts using hashtags as a supervised signal. The proposed approach is trained on up to 5.5 billion words predicting 100,000 possible hashtags. As well as strong performance on the hashtag prediction task itself, we show that its learned representation of text (ignoring the hashtag labels) is useful for other tasks as well.
To that end, we present results on a document recommendation task, where it also outperforms a number of baselines.
AUTHORS
Related Publications
February 06, 2025
NLP
Brain-to-Text Decoding: A Non-invasive Approach via Typing
Jarod Levy, Mingfang (Lucy) Zhang, Svetlana Pinet, Jérémy Rapin, Hubert Jacob Banville, Stéphane d'Ascoli, Jean Remi King
February 06, 2025
February 06, 2025
NLP
From Thought to Action: How a Hierarchy of Neural Dynamics Supports Language Production
Mingfang (Lucy) Zhang, Jarod Levy, Stéphane d'Ascoli, Jérémy Rapin, F.-Xavier Alario, Pierre Bourdillon, Svetlana Pinet, Jean Remi King
February 06, 2025
November 16, 2022
NLP
Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models
Kushal Tirumala, Aram H. Markosyan, Armen Aghajanyan, Luke Zettlemoyer
November 16, 2022
October 31, 2022
NLP
Autoregressive Search Engines: Generating Substrings as Document Identifiers
Fabio Petroni, Giuseppe Ottaviano, Michele Bevilacqua, Patrick Lewis, Scott Yih, Sebastian Riedel
October 31, 2022
November 01, 2018
NLP
Computer Vision
Non-Adversarial Unsupervised Word Translation | Facebook AI Research
Yedid Hoshen, Lior Wolf
November 01, 2018
December 02, 2018
NLP
Computer Vision
One-Shot Unsupervised Cross Domain Translation | Facebook AI Research
Sagie Benaim, Lior Wolf
December 02, 2018
June 30, 2019
NLP
Variational Training for Large-Scale Noisy-OR Bayesian Networks | Facebook AI Research
Geng Ji, Dehua Cheng, Huazhong Ning, Changhe Yuan, Hanning Zhou, Liang Xiong, Erik B. Sudderth
June 30, 2019
June 26, 2020
NLP
Computer Vision
ShadowSync: Performing Synchronization in the Background for Highly Scalable Distributed Training
Qinqing Zheng, Bor-Yiing Su, Jiyan Yang, Alisson Azzolini, Qiang Wu, Ou Jin, Shri Karandikar, Hagay Lupesko, Liang Xiong, Eric Zhou
June 26, 2020
Help Us Pioneer The Future of AI
We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.
Foundational models
Our approach
Latest news
Foundational models
Meta © 2025