Foundation models and generative AI

This week, we will first recap the chapter on generative AI and its role in foundation models. We then begin a new chapter on the building blocks, architectures, and design principles of foundation models. This lecture will provide the groundwork for the coming weeks, where we will study the core architectures in language and vision, before turning to applications in biology, chemistry, and the earth sciences.

Important! Assignment 1 is due on Wednesday, October 8, at 23:59 via gNoto. See instructions in Week 4.

This Week's TA: Abdülkadir Gökce