Research
NLP
Enriching Word Vectors with Subword Information
July 31, 2017
Abstract
Continuous word representations, trained on large unlabeled corpora are useful for many natural language processing tasks. Popular models that learn such representations ignore the morphology of words, by assigning a distinct vector to each word. This is a limitation, especially for languages with large vocabularies and many rare words. In this paper, we propose a new approach based on the skipgram model, where each word is represented as a bag of character n-grams.
AUTHORS
Related Publications
November 16, 2022
NLP
Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models
Kushal Tirumala, Aram H. Markosyan, Armen Aghajanyan, Luke Zettlemoyer
November 16, 2022
October 31, 2022
NLP
Autoregressive Search Engines: Generating Substrings as Document Identifiers
Fabio Petroni, Giuseppe Ottaviano, Michele Bevilacqua, Patrick Lewis, Scott Yih, Sebastian Riedel
October 31, 2022
December 06, 2020
NLP
Pre-training via Paraphrasing
Michael Lewis, Armen Aghajanyan, Gargi Ghosh, Luke Zettlemoyer, Marjan Ghazvininejad, Sida Wang
December 06, 2020
November 30, 2020
NLP
Where Are You? Localization from Embodied Dialog
Dhruv Batra, Devi Parikh, Meera Hahn, Jacob Krantz, James Rehg, Peter Anderson, Stefan Lee
November 30, 2020
April 30, 2018
NLP
Speech & Audio
Identifying Analogies Across Domains | Facebook AI Research
Yedid Hoshen, Lior Wolf
April 30, 2018
November 01, 2018
NLP
Computer Vision
Non-Adversarial Unsupervised Word Translation | Facebook AI Research
Yedid Hoshen, Lior Wolf
November 01, 2018
December 02, 2018
NLP
Computer Vision
One-Shot Unsupervised Cross Domain Translation | Facebook AI Research
Sagie Benaim, Lior Wolf
December 02, 2018
June 30, 2019
NLP
Variational Training for Large-Scale Noisy-OR Bayesian Networks | Facebook AI Research
Geng Ji, Dehua Cheng, Huazhong Ning, Changhe Yuan, Hanning Zhou, Liang Xiong, Erik B. Sudderth
June 30, 2019
Help Us Pioneer The Future of AI
We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.
Foundational models
Latest news
Foundational models
Meta © 2024