Logo 2
Vision and Autonomy Intelligence Lab
UrbanVerse: Scaling Urban Simulation by Watching City-Tour Videos
From Seeing to Experiencing: Scaling Navigation Foundation Models with Reinforcement Learning
Joint Optimization for 4D Human-Scene Reconstruction in the Wild
SceneStreamer: Continuous Scenario Generation as Next Token Group Prediction
Towards Autonomous Micromobility through Scalable Urban Simulation
Vid2Sim: Realistic and Interactive Simulation from Video for Urban Navigation
Dreamland: Controllable World Creation with Simulator and Generative Models
Predictive Preference Learning from Human Interventions

News

Mar 11, 2026 MIMIC was accepted to ICRA 2026.
Mar 11, 2026 AURA and GroupDiff were accepted to CVPR 2026.
Jan 26, 2026 JOSH, S2E, UrbanVerse and SceneStreamer were accepted to ICLR 2026.
Dec 17, 2025 Joe Lin won the 2025–2026 CRA Outstanding Undergraduate Researcher Award Honorable Mention.
Dec 16, 2025 Our lab is honored to receive an NVIDIA Academic Grant to Advance Physical AI for Micromobility. Excited to build our urban simulation with RTX PRO 6000, Jetson Orin, and Ominiverse.
Oct 23, 2025 Wayne Wu won the 2025 Chancellor’s Award for Postdoctoral Research at UCLA.
Sep 18, 2025 PPL (Spotlight), Adv-BMT, and AutoVLA were accepted to NeurIPS 2025.
Aug 20, 2025 Honglin He won the Amazon Trainium Fellowship.
Aug 20, 2025 Sicheng Mo won the Amazon AI Fellowship.
Jul 05, 2025 We released code for Urban-Sim, the newest simulator for embodied AI research in urban micromobility.
Jun 25, 2025 X-Fusion and ST-Occ were accepted to ICCV 2025.
Jun 11, 2025 We co-organized Workshop on Populating Empty Cities and Workshop on Real-to-Sim: Bridging the Gap between Neural Rendering and Robot Learning at CVPR 2025.
Jun 11, 2025 Prof. Zhou gave talks at Synthetic Data for Computer Vision Workshop, AVA: Accessbility, Vision, and Autonomy Workshop, 4th Workshop on Uncertainty Quantification for Computer Vision at CVPR 2025.
May 01, 2025 AIM was accepted to ICML 2025.
Apr 05, 2025 Zhenghao Peng won the Dissertation Year Award (DYA) at UCLA.
Mar 25, 2025 Jordan Lin named 2024–2025 CRA Outstanding Undergraduate Researcher Award Finalist.
Feb 26, 2025 Urban-Sim (Highlight), Vid2Sim, and MetaVQA were accepted to CVPR 2025.
Jan 23, 2025 Prof. Zhou won the 2025 ONR Young Investigator Award.
Jun 14, 2024 Zhenghao Peng won the Amazon Fellowship.
Jun 12, 2024 We co-organized Workshop on Populating Empty Cities at CVPR 2024.
Jun 12, 2024 Prof. Zhou gave talks at Workshop on Autonomous Driving (WAD) and Workshop on Robot Visual Perception in Human Crowded Environment at CVPR 2024.
Feb 13, 2024 Prof. Zhou won the NSF CAREER Award.

Selected Publications

  1. ICRA
    Learning Sidewalk Autopilot from Multi-Scale Imitation with Corrective Behavior Expansion
    Honglin He, Yukai Ma, Brad Squicciarini, Wayne Wu, and Bolei Zhou
    In International Conference on Robotics and Automation, 2026
  2. CVPR
    AURA: Multi-modal Shared Autonomy for Urban Navigation
    Yukai Ma, Honglin He, Selina Song, Wayne Wu, and Bolei Zhou
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026
  3. CVPR
    Group Diffusion: Enhancing Image Generation by Unlocking Cross-Sample Collaboration
    Sicheng Mo, Thao Nguyen, Richard Zhang, Nicholas Kolkin, Siddharth Srinivasan Iyer, Eli Shechtman, Krishna Kumar Singh, Yong Jae Lee, Bolei Zhou, and Yuheng Li
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026
    PDF Website
  4. CVPR
    AnimaMimic: Imitating 3D Animation from Video Priors
    Tianyi Xie, Yunuo Chen, Yaowei Guo, Yin Yang, Bolei Zhou, Demetri Terzopoulos, Ying Jiang, and Chenfanfu Jiang
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026
    PDF Website
  5. HRI
    DiSCo: Diffusion Sequence Copilots for Shared Autonomy
    Andy Wang, Xu Yan, Brandon McMahan, Michael Zhou, Yuyang Yuan, Johannes Y. Lee, Ali Shreif, Matthew Li, Zhenghao Peng, Bolei Zhou, Yuchen Cui, and Jonathan C. Kao
    In Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction, 2026
    PDF Website
  6. ICLR
    UrbanVerse: Scaling Urban Simulation by Watching City-Tour Videos
    Mingxuan Liu, Honglin He, Elisa Ricci, Wayne Wu, and Bolei Zhou
    In International Conference on Learning Representation, 2026
    PDF Website
  7. ICLR
    From Seeing to Experiencing: Scaling Navigation Foundation Models with Reinforcement Learning
    Honglin He, Yukai Ma, Brad Squicciarini, Wayne Wu, and Bolei Zhou
    In International Conference on Learning Representation, 2026
    PDF Website
  8. ICLR
    Joint Optimization for 4D Human-Scene Reconstruction in the Wild
    Zhizheng Liu, Joe Lin, Wayne Wu, and Bolei Zhou
    In International Conference on Learning Representation, 2026
    PDF Website
  9. ICLR
    SceneStreamer: Continuous Scenario Generation as Next Token Group Prediction
    Zhenghao Peng, Yuxin Liu, and Bolei Zhou
    In International Conference on Learning Representation, 2026
    PDF Website
  10. NeurIPS Spotlight
    Predictive Preference Learning from Human Interventions
    Haoyuan Cai, Zhenghao Peng, and Bolei Zhou
    In Advances in Neural Information Processing Systems, 2025
    PDF Website
  11. NeurIPS
    Adv-BMT: Bidirectional Motion Transformer for Safety-Critical Traffic Scenario Generation
    Yuxin Liu, Zhenghao Peng, Xuanhao Cui, and Bolei Zhou
    In Advances in Neural Information Processing Systems, 2025
    PDF Website
  12. NeurIPS
    AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning
    Zewei Zhou, Tianhui Cai, Seth Z Zhao, Yun Zhang, Zhiyu Huang, Bolei Zhou, and Jiaqi Ma
    In Advances in Neural Information Processing Systems, 2025
    PDF Website
  13. ICCV
    X-Fusion: Introducing New Modality to Frozen Large Language Models
    Sicheng Mo, Thao Nguyen, Xun Huang, Siddharth Srinivasan Iyer, Yijun Li, Yuchen Liu, Abhishek Tandon, Eli Shechtman, Krishna Kumar Singh, Yong Jae Lee, Bolei Zhou, and Yuheng Li
    In International Conference on Computer Vision, 2025
    PDF Website
  14. ICCV
    Occupancy Learning with Spatiotemporal Memory
    Ziyang Leng, Jiawei Yang, Wenlong Yi, and Bolei Zhou
    In International Conference on Computer Vision, 2025
    PDF Website
  15. ICCV
    V2XPnP: Vehicle-to-Everything Spatio-Temporal Fusion for Multi-Agent Perception and Prediction
    Zewei Zhou, Hao Xiang, Zhaoliang Zheng, Seth Z Zhao, Mingyue Lei, Yun Zhang, Tianhui Cai, Xinyi Liu, Johnson Liu, Maheswari Bajji, Xin Xia, Zhiyu Huang, Bolei Zhou, and Jiaqi Ma
    In International Conference on Computer Vision, 2025
    PDF Website
  16. ICCV
    TurboTrain: Towards Efficient and Balanced Multi-Task Learning for Multi-Agent Perception and Prediction
    Zewei Zhou*, Seth Z. Zhao*, Tianhui Cai, Zhiyu Huang, Bolei Zhou, and Jiaqi Ma
    In International Conference on Computer Vision, 2025
    PDF Website
  17. ICCV
    Verbalized Representation Learning for Interpretable Few-Shot Generalization
    Cheng-Fu Yang, Da Yin, Wenbo Hu, Heng Ji, Nanyun Peng, Bolei Zhou, and Kai-Wei Chang
    In International Conference on Computer Vision, 2025
    PDF
  18. ICML
    WOMD-Reasoning: A Large-Scale Dataset for Interaction Reasoning in Driving
    Yiheng Li, Cunxin Fan, Chongjian Ge, Zhihao Zhao, Chenran Li, Chenfeng Xu, Huaxiu Yao, Masayoshi Tomizuka, Bolei Zhou, Chen Tang, Mingyu Ding, and Wei Zhan
    In International Conference on Machine Learning, 2025
    PDF Website
  19. ICML
    AIM: Robot-Gated Interactive Imitation Learning with Adaptive Intervention Mechanism
    Haoyuan Cai, Zhenghao Peng, and Bolei Zhou
    In International Conference on Machine Learning, 2025
    PDF Website
  20. CVPR Highlight
    Towards Autonomous Micromobility through Scalable Urban Simulation
    Wayne Wu*, Honglin He*, Chaoyuan Zhang, Jack He, Seth Z. Zhao, Ran Gong, Quanyi Li, and Bolei Zhou
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025
    PDF Website
  21. CVPR
    Vid2Sim: Realistic and Interactive Simulation from Video for Urban Navigation
    Ziyang Xie, Zhizheng Liu, Zhenghao Peng, Wayne Wu, and Bolei Zhou
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025
    PDF Website
  22. CVPR
    Embodied Scene Understanding for Vision Language Models via MetaVQA
    Weizhen Wang, Chenda Duan, Zhenghao Peng, Yuxin Liu, and Bolei Zhou
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025
    PDF Website
  23. ICRA
    Data-Efficient Learning from Human Interventions for Mobile Robots
    Zhenghao Peng, Zhizheng Liu, and Bolei Zhou
    In International Conference on Robotics and Automation, 2025
    PDF Website
  24. ICLR Spotlight
    MetaUrban: An Embodied AI Simulation Platform for Urban Micromobility
    Wayne Wu, Honglin He, Jack He, Yiran Wang, Chenda Duan, Zhizheng Liu, Quanyi Li, and Bolei Zhou
    International Conference on Learning Representations, 2025
    PDF Website
  25. ICLR
    Learning to Generate Diverse Pedestrian Movements from Web Videos with Noisy Labels
    Zhizheng Liu, Joe Lin, Wayne Wu, and Bolei Zhou
    International Conference on Learning Representations, 2025
    PDF Website
  26. Nature
    Experiment-free Exoskeleton Assistance via Learning in Simulation
    Shuzhen Luo, Menghan Jiang, Sainan Zhang, Junxi Zhu, Shuangyue Yu, Israel Dominguez Silva, Tian Wang, Elliott Rouse, Bolei Zhou, Hyunwoo Yuk, Xianlian Zhou, and Hao Su
    Nature, 2024
    PDF Video Website