UvA Foundation Models Course


MSc in Artificial Intelligence for the University of Amsterdam.

Find Out More

About


Foundation models are a revolutionary class of AI models that provides impressive abilities to generate content (text, images, sound, videos, protein structures, and more), and to do so by interactive prompts in a seemingly creative manner. These foundation models are often autoregressive, self-supervised, multimodal, transformer-based models that are pre-trained on large volumes of data, typically collected from the web. They already form the basis of all state-of-the-art systems in computer vision and natural language processing across a wide range of tasks and have shown impressive few-shot learning abilities. The perceived intelligence and adaptability of models like ChatGPT, Stable Diffusion, Flamingo, and GPT4 impress, but their aptitude to produce inaccurate, misleading, or false information (and present it confidently and convincingly) makes them unsuitable for any task of importance and poses serious societal concerns.

In this course we consider fundamental algorithmic questions concerning the multimodal learning and reasoning abilities of foundation models, as well as the ethical, legal, and social aspects of their deployment in society. Topics include, but are not limited to, the theory of foundation models, how foundation models appear to give rise to emergent behavior that was not observed during training, how the hallucination problem (as the lack of factual basis is referred to) arises and whether it can be mitigated by learning to retrieve and reference information from trusted sources, how to ensure foundation model objectives are aligned with their operators’ intentions, and how a more decentralized, compositional, and incremental approach to training and serving foundation models might reduce their data and compute hunger.

The course is research focused, with lectures on state-of-the-art advancements, reading and presenting of recent papers, and as final course deliverable a research-team project where students may study their own foundation model topic that should result in a research paper that is submitted to an academic venue.

This course is taught in the MSc program in Artificial Intelligence of the University of Amsterdam by Professor Cees Snoek. Teaching assistants are Mina Ghadimi Atigh, Leonard Bereska, Aritra Bhowmik, Mohammad Mahdi Derakhshani, Yingjun Du, John Gkountouras, Tejaswi Kasarla, Ivona Najdenkoska, Kien Nguyen, Samuele Papa, Mohammadreza Salehi, Christina Sartzetaki, Riccardo Valperga, Pengwan Yang. Senior Teaching Assistant for the course is Pieter Pierrot.





Mina Ghadimi Atigh Leonard Bereska Aritra Bhowmik Mohammad Mahdi Derakhshani

Yingjun Du John Gkountouras Tejaswi Kasarla Ivona Najdenkoska

Kien Nguyen Samuele Papa Mohammadreza Salehi Christina Sartzetaki

Riccardo Valperga Pengwan Yang

Lectures


Week 1

Lecturer: Cees Snoek
Date: April 1, 2025

This lecture introduces the course and reviews the basics behind Transformers and their application to NLP and Vision.

Documents:

Lecture recordings:

No recordings.

Lecturer:
Date: April 4, 2025

Documents:

Lecture recordings:

No recordings.

Week 2

Lecturer:
Date: April 8, 2025

Documents:

Lecture recordings:

No recordings.

Lecturer:
Date: April 11, 2025

Documents:

Lecture recordings:

No recordings.

Week 3

Lecturer:
Date: April 15, 2025

Documents:

Lecture recordings:

No recordings.

Week 4

Lecturer:
Date: April 22, 2025

Documents:

Lecture recordings:

No recordings.

Lecturer:
Date: April 25, 2025

Documents:

Lecture recordings:

No recordings.

Week 6

Lecturer:
Date: May 6, 2025

Documents:

Lecture recordings:

No recordings.

Lecturer:
Date: May 9, 2025

Documents:

No documents.

Lecture recordings:

No recordings.

Week 7

Lecturer:
Date: May 13, 2025

Documents:

Lecture recordings:

No recordings.

Lecturer:
Date: May 16, 2025

Documents:

Lecture recordings:

No recordings.

Week 8

Lecturer:
Date: May 20, 2025

Documents:

Lecture recordings:

No recordings.

Lecturer:
Date: May 23, 2025

Documents:

No documents.

Lecture recordings:

No recordings.

Week 9

Lecturer: Course staff
Date: May 27, 2025

Documents:

No documents.

Lecture recordings:

No recordings.

Contact us!


If you have any questions or recommendations for the website or the course, you can always drop us a line! The knowledge should be free, so feel also free to use any of the material provided here (but please be so kind to cite us).