You are here: Home Teaching SS 2022 Advanced Deep Learning

Advanced Deep Learning

Deep learning techniques are constantly evolving and are nowadays recognized as the state-of-the-art solution in many tasks. This course will provide a clear understanding of advanced deep learning techniques and modern architectures.


Time: TBD
First meeting on TBD.
Location: This course will be in presence if the COVID situation allows for it.
Requirements: Basic knowledge of Deep Learning. Ideally you have the required background equivalent to have taken the Fundamentals in Deep Learning course which we offer every winter semester.
Learning Platform: ILIAS

Course Overview

The course will be taught in english and will follow a flipped classroom approach.

Every week there will be:
- a video lecture
- an exercise sheet
- a flipped classroom session (virtual/in-person, TBD)

At the end, there will be a project and an oral exam.

Exercises must be completed in groups and must be submitted a week (+ 1 day) after their release. Your submissions will be graded and you will receive weekly feedback. Your final grade will be solely based on the oral examination and project, however, a passing grade for the exercises is a prerequisite for passing the course.

Online course: All material will be made available online and course participation will not require in-person presence.
On-site exam: The oral exam will take place in-person.

Course Schedule

The following are the dates for the flipped classroom sessions:

27.04.2022 – Week 1: Basics of Deep Learning (Recap)
04.05.2022 – Week 2: Graph Neural Networks
11.05.2022 – Week 3: Multidimensional Deep Learning
18.05.2022 – Week 4: Transformers and Attention
25.05.2022 – Week 5: Metric Learning
01.06.2022 – Week 6: Cross-modal Learning
08.06.2022 – Week 7: Transfer Learning and Domain adaptation
15.06.2022 – Week 8: Self-Supervised Learning
22.06.2022 – Week 9: Multitask and Meta-Learning
29.06.2022 – Week 10: Continual Learning
06.07.2022 – Week 11: Responsible Innovation in AI
27.07.2022 – Project deadline

The course material (lecture video, slides, exercise sheet) for “Week N” will be made available a week before the flipped classroom session for “Week N”. For example, the material for Week 1 will be available on TBD and solutions to the exercises must be submitted latest TBD at 23:59. We will be using Zoom and the meeting link can be found on ILIAS in the “Flipped Classroom” folder.

In the first session (TBD) you will get additional information about the course and get the opportunity to ask general questions (and form groups!) While there is no need to prepare for this first session, we encourage you to already think about forming teams. The last flipped classroom session is held on TBD.


If you have a question, please post it in the ILIAS forum (so everyone can benefit from the answer). Alternatively, you can also email