Foundation models and generative AI

In week, we will focus on foundation models, reinforcement learning, and reasoning. Building on ideas from test-time training and world models, we will discuss how foundation models can be used to learn policies, plan through simulation, and support structured reasoning about actions and outcomes. This lecture bridges the gap between predictive modeling and decision-making, setting the stage for agentic systems in the following week.