Rohan is an engineer on the PyTorch team in Facebook AI, where he primarily works on distributed training for ranking, recommendation, and content understanding use cases. His research interests lie in exploring various hybrid parallelism techniques to enable efficient training of large-scale models and developing efficient algorithms for cross-machine communication.
August 31, 2020
Shen Li, Brian Vaughan, Jeff Smith (FRL), Omkar Salpekar, Pritam Damania, Rohan Varma, Soumith Chintala, Teng Li, Yanli Zhao, Adam Paszke, Pieter Noordhuis
August 31, 2020
Foundational models
Latest news
Foundational models