TOOLS
PyText
PyText is a deep-learning based NLP modeling framework built on PyTorch. PyText addresses the often-conflicting requirements between enabling rapid experimentation for NLP models and serving these models at scale. It achieves this by providing simple and extensible interfaces and abstractions for the different model components, and by using PyTorch to export models for inference via the optimized Caffe2 execution engine. PyText is used at Facebook to iterate quickly on new modeling ideas and then seamlessly deploy them at scale.
Production-ready state-of-the-art NLP models
PyText allows researchers and engineers to use efficient distributed training to train custom models for different NLP tasks on their own datasets and then export them to Caffe2 via ONNX. Examples of the tasks that are currently supported in PyText include:
Document classification
Sequence tagging
Semantic parsing
Multi-task learning
Easily extensible to support new models & tasks
PyText is designed and built to be easily extensible to support new tasks and use-cases, and allows the reuse of prebuilt components from other tasks.
Get Started
1
Install PyText pip install pytext-nlp
2
Learn how to write a model in PyText, train and evaluate it against a benchmark and deploy the model at scale in AWS
3
Follow an in-depth tutorial on how to create a new task and model in PyText
4
Review the PyText documentation to familiarize yourself with its different components and abstractions
Foundational models
Latest news
Foundational models
Meta © 2024