Our latest AI advancements

The north star goal of our Perception research teams is to enable general AI systems to perceive the visual world to inform action, communication and generation. To achieve this goal, we're developing next generation perception models capable of understanding images and videos not as pixels, but as a capture of visual entities like people, objects, activities and their spatial and temporal relationships.

We advance AI capabilities in expressive communication, social interaction and use of language. Through foundational research in natural language processing and multimodal AI, we develop systems that enable more natural, meaningful interactions between humans and machines.

We advance the fundamental capabilities needed for AI to understand and act within the physical and digital world. From robots that can move around and interact with objects, to helping accomplish household tasks, to wearable glasses that understand the real and digital world, we hope to unlock a wide variety of future agents that help humans do more throughout all aspects of their lives.

Our research focuses on aligning models and decisions with human intent and societal interests through deeper fundamental understanding and enhanced steerability and efficiency of AI models. The pillar is at the forefront of research on AI for science and AI for society.

We conduct fundamental research in pre-training methods and new architectural paradigms that enable foundational models to learn and reason with agility and efficiency across novel downstream challenges. Our work expands the frontier of approaches such as world models, non-autoregressive architectures and memory-augmented models to unlock new capabilities in adaptive intelligence.