Alan Yu

I'm a recent graduate of MIT, where I did my MEng ('25) at LIDS advised by Luca Carlone. Before that, I did my B.S. in Artificial Intelligence ('24), where I was fortunate to work with Ge Yang, Phillip Isola, and John Leonard at CSAIL. I do research in robot learning and am particularly interested in foundation models, generative-AI + simulation, and evaluation.

In my free time I enjoy swimming and attempting to play the guitar.

Email  /  Google Scholar  /  X  /  Github / LinkedIn

profile photo

Recent Updates

(more)
May '25 Completed my MEng at MIT, where my thesis was on Articulated 3D Scene Graphs from Egocentric Vision.
Nov '24 LucidSim was featured in MIT News, MIT Technology Review, and New Scientist!
Nov '24 Presented our work on Learning Visual Parkour from Generated Images at CoRL 2024.

Research

LucidSim Preview
LucidSim: Learning Visual Parkour from Generated Images
Alan Yu*, Ge Yang*, Ran Choi, Yajvan Ravan, John Leonard, Phillip Isola
Conference on Robot Learning (CoRL) 2024
website / arXiv / code / video / news video / news

We use generative models as a realistic and diverse data source by augmenting classical physics simulators. We demonstrate that robots trained this way can accomplish highly dynamic tasks like parkour without requiring depth.

Distilled Feature Fields Enable Few-Shot Language-Guided Manipulation
William Shen*, Ge Yang*, Alan Yu, Jansen Wong, Leslie Pack Kaelbling, Phillip Isola
Conference on Robot Learning (CoRL) 2023 (Best paper award)
website / arXiv / code / video / news

We distill features from 2D foundation models into 3D feature fields, and enable few-shot language-guided manipulation that generalizes across object poses, shapes, appearances and categories.

Teaching

TA for Robotics: Science and Systems (6.4200), Spring 2024 + 2025.


Website template from Jon Barron; profile picture courtesy of Mike Grimmett.