Deep Learning: From Mathematical Foundations
Winter Term 2019/20
(Main) Seminar (2 h)
Notice for bachelor/master students of mathematics: This is a »Hauptseminar« in the sense of these study programs.
20/1/2020: An additional session has been added in the updated schedule.
07/11/2019: The updated schedule is online.
19/07/2019: The list of assigned topics is online.
19/07/2019: The slides of the introductory meeting are online.
17/07/2019: Registration for the seminar is closed. There are no more places left.
15/07/2019: The list of topics is now online.
15/07/2019: The opponent requirement has been removed.
11/07/2019: Registration for the seminar is possible from Friday, July 12, 2019, 18:00.
Introductory meeting (mandatory):
The registration period is over.
Regular meetings during the winter term 2019/20:
Contents: During the last few years, deep learning rapidly rose to the forefront of research in computer science. In particular, it has significantly changed the area of image processing and computer vision. While it is already a well-established concept for tasks like segmentation, object recognition and many similar semantically challenging topics, it is now also becoming increasingly relevant for image compression. Simultaneously, the focus is shifting from purely using deep neural networks as a tool to understanding the underlying mathematical concepts. In this seminar, we discuss a series of recent publications that range from mathematical foundations of deep learning to state-of-the-art compression with neural networks.
Prerequisites: The seminar is for advanced bachelor or master students in Visual Computing, Mathematics, or Computer Science. Basic knowledge of linear algebra, probability theory, and numerics is required (e.g. MfI I-III). Elementary knowledge in machine learning and image compression is strongly recommended.
Language: The publications discussed in this seminar are written in English, and English is the language of presentation.
The registration for this course was open
from Friday, July 12, 2019, 6 pm
Since the number of talks is limited, we ask for your understanding that participants will be considered strictly in the order of registration – no exceptions.
Regular attendance: You must attend all seminar meetings, except for provable important reasons (medical certificate).
Talk duration is 30 min, plus 15 min for discussion.
Please do not deviate from this time schedule.
Write-up: The write-up has to be handed in three weeks after the lecture period ends. The deadline is Friday, February 28, 2020, 23:59 The write-up should summarise your talk and has to consist of 5 pages per speaker. Electronic submission is preferred. File format for electronic submissions is PDF – text processor files (like .doc) are not acceptable. Do not forget to hand in your write-up: Participants who do not submit a write-up cannot obtain the certificate for the seminar. The write-up must be e-mailed to your advisor.
Plagiarism: Adhere to the standards of scientific referencing and avoid plagiarism: Quotations and copied material (such as images) must be clearly marked as such, and a bibliography is required. Otherwise the seminar counts as failed.
Mandatory consultation: Talk preparation has to be presented to your seminar supervisor no later than one week before the talk is given. It is your responsibility to approach your advisor timely and make your appointment.
No-shows: No-shows are unfair to your fellow students: Some talks are based on previous talks, and your seminar place might have prevented the participation of another student. Thus, in case you do not appear to your scheduled talk (except for reasons beyond your control), we reserve the right to exclude you from future seminars of our group.
Participation in discussions: The discussions after the presentations are a vital part of this seminar. This means that the audience (i.e. all participants) poses questions and tries to find positive and negative aspects of the proposed idea. This participation is part of your final grade.
Being on time: To avoid disturbing or interrupting the speaker, all participants have to be in the seminar room on time. Participants that turn out to be regularly late must expect a negative influence on their grade.
Here are the slides from the introductory meeting. They contain important information for preparing a good talk.
The subsequently linked document provides guidelines for the creation of your write-up. Make sure to consider them during the preparation of your final report.
We will discuss the following research papers.