Rohan Varma

Menlo Park, United States

Rohan is an engineer on the PyTorch team in Facebook AI, where he primarily works on distributed training for ranking, recommendation, and content understanding use cases. His research interests lie in exploring various hybrid parallelism techniques to enable efficient training of large-scale models and developing efficient algorithms for cross-machine communication.

Rohan's Work

Rohan's Publications

August 31, 2020

Systems Research

PyTorch Distributed: Experiences on Accelerating Data Parallel Training

Shen li, Yanli Zao, Rohan Varma, Omkar Salpekar, Pieter Noordhuis, Teng Li, Adam Paszke, Jeff Smith, Brian Vaughan, Pritam Damania, Soumith Chintala

August 31, 2020