Hi, I'm Danijar! I build artificial intelligence that autonomously understands and interacts with the world.
I’m a Senior Research Scientist at Google DeepMind in San Francisco, where I lead the World Models team.
I received my PhD from the University of Toronto with Jimmy Ba as a Vanier Scholar, was a visiting student at UC Berkeley with Pieter Abbeel, and interned at Google Brain for 6 years. I completed my MRes at UCL and the Gatsby Unit with Tim Lillicrap and Karl Friston.
Contact: mail AT danijar.com
Research
My research aims at discovering the computational principles of human thinking and replicating them to build useful artificial intelligence. I approach this challenge by designing unsupervised algorithms that learn through interaction with complex environments, going beyond narrow task-specific agents.
The key questions I’m currently focusing on are:
-
World Models Learning large models from video to develop a general understanding of the world and enable planning by imagining future outcomes of potential actions.
Key papers: Dreamer, DreamerV2, DreamerV3, DayDreamer, PlaNet, TECO, Dynalang -
Temporal Abstraction While humans plan at an abstract level, control algorithms are still limited by exploring, planing, and assigning credit at the level of primitive actions.
Key papers: Director, LSP, ClockworkVAE -
Agent Objectives Now that we understand the space of agent objectives, we need to find scalable implementations of exploration, empowerment, and skill discovery.
Key papers: APD, Plan2Explore, LEXA, VIPER
This talk gives a technical overview of my research from a few years ago.
Featured Media
See YouTube for more videos.
-
Learning to Walk in the Real World in 1 Hour
-
Unsupervised Intelligent Agents Technical Talk
-
Interview in Daily Mail
-
Interview in MIT Technology Review
-
Lab Spotlight in Tech Crunch
-
LEXA Paper Overview
-
Open-Endedness Panel
-
Talk RL Podcast
-
Introducing Director
-
Introducing DreamerV2
-
Introducing Dreamer
-
Introducing Plan2Explore
Highlighted Work
See Google Scholar for more publications.
-
Learning to Model the World with Language
ICML 2024 (oral)
-
Evaluating Long-Term Memory in 3D Mazes
ICLR 2023
-
Deep Hierarchical Planning from Pixels
NeurIPS 2022
-
Discovering and Achieving Goals via World Models
NeurIPS 2021 (26%), URL 2021 (oral), SSL 2021 (oral)
-
Benchmarking the Spectrum of Agent Capabilities
ICLR 2022, DRLW 2021 (oral)
-
Clockwork Variational Autoencoders
NeurIPS 2021 (26%)
-
Latent Skill Planning for Exploration and Transfer
ICLR 2021 (28%)
-
Mastering Atari with Discrete World Models
ICLR 2021 (28%)
-
Planning to Explore via Self-Supervised World Models
ICML 2020 (22%)
-
Dream to Control: Learning Behaviors by Latent Imagination
ICLR 2020 (oral, 4%), DRLW 2019 (oral)
-
A Deep Learning Framework for Neuroscience
Nature Neuroscience
-
Noise Contrastive Priors for Functional Uncertainty
UAI 2019 (26%)
-
Learning Latent Dynamics for Planning from Pixels
ICML 2019 (23%)
-
Sample-Efficient Reinforcement Learning with Stochastic Ensemble Value Expansion
NeurIPS 2018 (oral, 0.6%)
-
Sim-to-Real: Learning Agile Locomotion For Quadruped Robots
RSS 2018 (31%)
Short Biography
Danijar Hafner is a Research Scientist at Google Brain, where he leads the World Models team. He received his PhD from the University of Toronto with Jimmy Ba as a Vanier Scholar, was a visiting student at UC Berkeley with Pieter Abbeel, and interned at Google Brain for 6 years. He completed his MRes UCL and the Gatsby Unit with Tim Lillicrap and Karl Friston. Danijar’s research aims at building generally intelligent machines that autonomously understand and interact with the world. Towards this goal, he focuses on scaling up world models, unsupervised objectives, and deep reinforcement learning.