A future of learning in AR, while being guided by an AI-assistant
With Ego How-To, your AR coach could track your progress, answer your questions, assess your technique and provide real-time feedback to improve your outcomes. You could learn at your own pace and in any environment.
Advancing foundational research
Overcoming challenges of video learning and multimodal perception
To achieve our vision, our research requires key advances in first-person ("egocentric") video understanding:
A future where AI enables new ways to learn skills in AR/MR
We are experiencing an unprecedented convergence of AI capabilities and the availability of AR/MR. By addressing core technical challenges, our research is motivated to benefit people all over the world who want to learn something new every day. Our goal is to make high quality expert guidance more accessible and learning more equitable.
Ego-Exo4D is an initiative that aims to advance AI understanding of human skill by building the first of its kind video dataset and benchmark suite in collaboration with the Ego4D university consortium.Learn more