Foundation models and generative AI

In Week 13, we turn to foundation models in robotics. Building on adaptation methods and world modeling, we discuss how perception and action can be unified within foundation model frameworks. We will examine architectures that integrate vision, control, and dynamics, and hear a guest lecture from Hang Zhao, Assistant Professor at Tsinghua University on multi-modal machine learning, autonomous driving and robot learning.

Due to travels, the first hour of this week's lecture will be canceled. The guest lecture will be streamed in PO 01.