Computer Vision

Ego4D: Around the World in 3,000 Hours of Egocentric Video

October 14, 2021


We introduce Ego4D, a massive-scale egocentric video dataset and benchmark suite. It offers 3,025 hours of dailylife activity video spanning hundreds of scenarios (household, outdoor, workplace, leisure, etc.) captured by 855 unique camera wearers from 74 worldwide locations and 9 different countries. The approach to collection is designed to uphold rigorous privacy and ethics standards with consenting participants and robust de-identification procedures where relevant. Ego4D dramatically expands the volume of diverse egocentric video footage publicly available to the research community. Portions of the video are accompanied by audio, 3D meshes of the environment, eye gaze, stereo, and/or synchronized videos from multiple egocentric cameras at the same event. Furthermore, we present a host of new benchmark challenges centered around understanding the first-person visual experience in the past (querying an episodic memory), present (analyzing hand-object manipulation, audio-visual conversation, and social interactions), and future (forecasting activities). By publicly sharing this massive annotated dataset and benchmark suite, we aim to push the frontier of first-person perception.
Project Page:

Download the Paper


Written by

Kristen Grauman

Andrew Westbury

Eugene Byrne

Zachary Chavis

Antonino Furnari

Rohit Girdhar

Jackson Hamburger

Hao Jiang

Miao Liu

Xingyu Liu

Miguel Martin

Tushar Nagarajan

Ilija Radosavovic

Santhosh Ramakrishnan

Fiona Ryan

Jayant Sharma

Michael Wray

Mengmeng Xu

Eric Zhongcong Xu

Chen Zhao

Siddhant Bansal

Dhruv Batra

Vincent Cartillier

Sean Crane

Tien Do

Akshay Erapall

Christoph Feichtenhofer

Adriano Fragomeni

Qichen Fu

Christian Fuegen

Abrham Gebreselasie

Cristina Gonzalez

James Hillis

Xuhua Huang

Yifei Huang

Wenqi Jia

Weslie Khoo

Jachym Kolar

Satwik Kottur

Anurag Kumar

Federico Landini

Chao Li

Zhenqiang Li

Karttikeya Mangalam

Raghava Modhugu

Jonathan Munro

Tullie Murrell

Takumi Nishiyasu

Will Price

Paola Ruiz Puentes

Merey Ramazanova

Leda Sari

Kiran Somasundaram

Audrey Southerland

Yusuke Sugano

Ruijie Tao

Minh Vo

Yuchen Wang

Xindi Wu

Takuma Yagi

Yunyi Zhu

Pablo Arbelaez

David Crandall

Dima Damen

Giovanni Maria Farinella

Bernard Ghanem

Vamsi Krishna Ithapu

C. V. Jawahar

Hanbyul Joo

Kris Kitani

Haizhou Li

Richard Newcombe

Aude Oliva

Hyun Soo Park

James M. Rehg

Yoichi Sato

Jianbo Shi

Mike Zheng Shou

Antonio Torralba

Lorenzo Torresani

Mingfei Yan

Jitendra Malik



Research Topics

Computer Vision


Related Publications

November 10, 2022

Computer Vision

Learning State-Aware Visual Representations from Audible Interactions

Unnat Jain, Abhinav Gupta, Himangi Mittal, Pedro Morgado

November 10, 2022

November 06, 2022

Computer Vision

Neural Basis Models for Interpretability

Filip Radenovic, Abhimanyu Dubey, Dhruv Mahajan

November 06, 2022

October 25, 2022

Theseus: A Library for Differentiable Nonlinear Optimization

Mustafa Mukadam, Austin Wang, Brandon Amos, Daniel DeTone, Jing Dong, Joe Ortiz, Luis Pineda, Maurizio Monge, Ricky Chen, Shobha Venkataraman, Stuart Anderson, Taosha Fan, Paloma Sodhi

October 25, 2022

October 22, 2022

Computer Vision

Time-rEversed diffusioN tEnsor Transformer: A new TENET of Few-Shot Object Detection

Naila Murray, Lei Wang, Piotr Koniusz, Shan Zhang

October 22, 2022

April 30, 2018

Computer Vision

NAM – Unsupervised Cross-Domain Image Mapping without Cycles or GANs | Facebook AI Research

Yedid Hoshen, Lior Wolf

April 30, 2018

December 11, 2019

Speech & Audio

Computer Vision

Hyper-Graph-Network Decoders for Block Codes | Facebook AI Research

Eliya Nachmani, Lior Wolf

December 11, 2019

April 30, 2018


Speech & Audio

Identifying Analogies Across Domains | Facebook AI Research

Yedid Hoshen, Lior Wolf

April 30, 2018

November 01, 2018


Computer Vision

Non-Adversarial Unsupervised Word Translation | Facebook AI Research

Yedid Hoshen, Lior Wolf

November 01, 2018

Help Us Pioneer The Future of AI

We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.