Rohan Varma

SOFTWARE ENGINEER | MENLO PARK, UNITED STATES

Rohan is an engineer on the PyTorch team in Facebook AI, where he primarily works on distributed training for ranking, recommendation, and content understanding use cases. His research interests lie in exploring various hybrid parallelism techniques to enable efficient training of large-scale models and developing efficient algorithms for cross-machine communication.

Research Areas

Rohan's Work

Rohan's Publications

August 31, 2020

SYSTEMS RESEARCH

PyTorch Distributed: Experiences on Accelerating Data Parallel Training

Shen Li, Brian Vaughan, Jeff Smith (FRL), Omkar Salpekar, Pritam Damania, Rohan Varma, Soumith Chintala, Teng Li, Yanli Zhao, Adam Paszke, Pieter Noordhuis

August 31, 2020