You are here: Home Teaching SS 2020 Seminar: Self-Supervised Learning

Seminar: Self-Supervised Learning

Self-supervised learning is an exciting new paradigm that aims to learn representations from data without explicit supervision. Self-supervised learning has emerged as an alternative to classical supervised learning methods that strongly rely on large labeled datasets for training. Creating datasets with sufficient annotated examples is a challenging task, and the process of labeling data is often arduous, expensive, and sometimes even infeasible. Self-supervised learning mitigates this problem by first learning a pretext task exploiting some property of the data and then using the learned semantically rich representations for fine-tuning on the target task. Here's a recent post that explains this in more detail. In this seminar, we will study a selection of state-of-the-art works that propose self-supervised approaches for perception, state-estimation, and control.



Seminar: Online via Zoom, Meeting ID: 939 8825 4440, Password: !SSL2020!
Places: Max. 12 students

Beginning: Friday, May 15, 2020, 14.00-16.00
Introduction via Zoom and allocation of seminar topics via email
Introductory lecture slides can be downloaded here

Requirements: Basic knowledge of deep learning or reinforcement learning.

Remarks: Due to the Corona crisis, the entire seminar will be held online.
Topics will be assigned for the seminar via a preference voting. If there are more interested students than places, places will be assigned based on priority suggestions of the HisInOne system and motivation (tested by asking for a short summary of the preferred paper). The date of registration is irrelevant. In particular, we want to avoid that students grab a topic and then leave the seminar. Please have a coarse look at all available papers to make an informed decision before you commit.


  • Enroll through HISinOne, the course number is 11LE13-7314-M. Registration period for the seminars in HisInOne are from 11.05.2020 00:00 to 20.05.2020 12:00.
  • Attend the introductory session on Friday, May 15, 2020, 14.00-16.00, via Zoom, Meeting ID: 939 8825 4440, Password: !SSL2020!
  • Students should select three papers out of the list in preference order and fill the information in this form
  • Places will be assigned based on priority suggestions of HisInOne and motivation of the student by May 24, 2020.
  • Students are requested to prepare a 20 minutes talk, write an abstract and a summary.
  • The Seminar will be held as a virtual "Blockseminar" in the last week of July.
  • The details of the presentation and the slides should be discussed with the supervisor two weeks before the presentation.
  • The abstract should be two pages long and is due June 29, 2020.
  • The summary is due two weeks after the presentation and should be seven pages long at maximum (latex, a4wide, 11pt) not counting the bibliography and figures. Significantly longer summaries will not be accepted.
  • The final grade is based on the oral presentation, the written abstract, the summary, and participation in the blockseminar.


  1. SuperPoint: Self-Supervised Interest Point Detection and Description
    Supervisor:Dr. Daniele Cattaneo
  2. GANVO: Unsupervised Deep Monocular Visual Odometry and Depth Estimation with Generative Adversarial Networks
    Supervisor:Dr. Daniele Cattaneo
  3. SelFlow: Self-Supervised Learning of Optical Flow
    Supervisor:Dr. Daniele Cattaneo
  4. A Simple Framework for Contrastive Learning of Visual Representations
    Supervisor:Daniel Honerkamp
  5. Grasp2Vec: Learning Object Representations from Self-Supervised Grasping
    Supervisor:Daniel Honerkamp
  6. Visual Reinforcement Learning with Imagined Goals
    Supervisor:Daniel Honerkamp
  7. Improving Semantic Segmentation through Spatio-Temporal Consistency Learned from Videos
    Supervisor:Juana Valeria Hurtado
  8. VideoBERT: A Joint Model for Video and Language Representation Learning
    Supervisor:Juana Valeria Hurtado
  9. Self-Supervised Scene De-occlusion
    Supervisor:Juana Valeria Hurtado
  10. Imitation from Observation: Learning to Imitate Behaviors from Raw Video via Context Translation
    Supervisor:Dr. Tim Welschehold
  11. Unsupervised Perceptual Rewards for Imitation Learning
    Supervisor:Dr. Tim Welschehold
  12. Time-Contrastive Networks: Self-Supervised Learning from Video
    Supervisor:Dr. Tim Welschehold

What to put into the summary?

Some questions that should be discussed are the following:

  • What is the paper's main contribution and why is it important?
  • How does it relate to other techniques in the literature?
  • What are strong and what are weak points about the paper?
  • What would be interesting follow-up work? Any possible improvements in the methods? Any further interesting applications?