Ruta Desai
RESEARCH SCIENTIST | REDMOND, UNITED STATES
Ruta Desai is a Research Scientist at Meta Reality Labs Research in Redmond. At Reality Labs, her research focuses on leveraging representation learning, planning, and reinforcement learning techniques — combined with an embodied AI framing — for developing Augmented Reality (AR) assistance models that can extend their users' capabilities. Prior to joining Meta, she obtained a PhD at the Carnegie Mellon University -- where she focused on human-AI collaborative and mixed-initiative systems for designing and programming robots.
Research Areas
Ruta's Publications
April 17, 2025
HUMAN & MACHINE INTELLIGENCE
CONVERSATIONAL AI
Collaborative Reasoner: Self-improving Social Agents with Synthetic Conversations
Ansong Ni, Asli Celikyilmaz, Daniel Li (FAIR), Dong Wang, Gargi Ghosh, Ramya Raghavendra, Ruta Desai, Xinjie Lei, Yang Li
April 17, 2025
October 31, 2024
ROBOTICS
PARTNR: A Benchmark for Planning and Reasoning in Embodied Multi-agent Tasks
Gunjan Chhablani, Roozbeh Mottaghi, Akshara Rai, Alexander William Clegg, Daniel Tran, Eric Undersander, Ishita Prasad, Jacob Krantz, Jimmy Yang, Joanne Truong, John Turner, Matthew Chang, Michal Hlavac, Mikael Dallaire Cote, Priyam Parashar, Ram Ramrakhya, Ruta Desai, Siddharth Patki, Vladimir Karashchuk, Xavi Puig
October 31, 2024
March 12, 2024
ROBOTICS
Habitat 3.0: A Co-Habitat for Humans, Avatars and Robots
Andrew Szot, Ruslan Partsey, Vladimír Vondruš, Zsolt Kira, Roozbeh Mottaghi, Akshara Rai, Alexander William Clegg, Devendra Singh Chaplot, Dhruv Batra, Eric Undersander, Jimmy Yang, Jitendra Malik, Mikael Dallaire Cote, Mrinal Kalakrishnan, Oleksandr Maksymets, Ruta Desai, Theo Gervet, Tiffany Min, Unnat Jain, Vincent-Pierre Berges, Xavi Puig
March 12, 2024
November 10, 2023
COMPUTER VISION
EgoEnv: Human-centric environment representations from egocentric video
Santhosh Kumar Ramakrishnan, Tushar Nagarajan, James Hillis, Kristen Grauman, Ruta Desai
November 10, 2023
September 19, 2023
COMPUTER VISION
EgoTV: Egocentric Task Verification from Natural Language Task Descriptions
Ruta Desai, Akshara Rai, Brian Chen, Nitin Kamra, Rishi Hazra
September 19, 2023
August 25, 2023
COMPUTER VISION
Pretrained Language Models as Visual Planners for Human Assistance
Dhruvesh Patel, Ruta Desai, Hamid Eghbalzadeh, Michael Louis Iuzzolino, Nitin Kamra, Unnat Jain
August 25, 2023
Our approach
Latest news
Foundational models
Meta © 2026