Foundations of Mathematics
Winter Semester 2022/23
Nicolas Faroß
Tue 16-18, Fr 12-14; B32, HS 0.03
First class: 25.10.2022
Exam date: 10.02.2023
This class is a newly designed introductory course to mathematics for computational linguists. It is used in two study programs:
The goal is to equip students with the mathematical background that is necessary to understand neural networks in technical detail and not be scared of the formulas in current research papers. The course covers the fundamentals of linear algebra (vector spaces, linear transformations, matrices and matrix arithmetic, dot products and angles) and calculus (derivatives, computing derivatives, limits, integrals, gradients). These will culminate in an explanation of the backpropagation algorithm.
The course will be in English.
Für wen ist diese Vorlesung? Die Vorlesung ist eine Pflichtveranstaltung im BSc Computerlinguistik (Studienordnung von 2020). Wir empfehlen dringend, sie im dritten Semester zu belegen, damit Sie im vierten Semester die Vorlesung “Neural Networks: Implementation and Application” (Klakow) absolvieren können und dann die volle Auswahl unter den Seminaren haben, die Kenntnisse zu neuronalen Netzen voraussetzen.
Die Vorlesung und ihre Materialien sind auf Englisch, weil sie erstmals im WS 2020/21 für die Master-Studierenden gehalten wurde. Wenn Sie möchten, können Sie dabei helfen, die Kursmaterialien auf Deutsch zu übersetzen; melden Sie sich bei Interesse gerne bei mir.
Sie können Fragen im Kurs gerne auf Deutsch stellen. Ich werde sie dann typischerweise auf Englisch beantworten.
Who should take this course? The course is meant to provide students who did not take college-level classes on linear algebra and calculus in their first degree with the basics of these fields. Such students should treat this course as mandatory for the MSc LST/LCT, even if the study regulations don’t say it explicitly.
By contrast, students who have taken such classes in their first degrees (e.g. students with a BSc in mathematics or computer science) should not take this class. It would be a waste of your time, and we strongly encourage you to take other classes where you will learn something new.
Online learning platform. We will use the computer science CMS for this course. There you can find materials and news regarding the lectures. So please register as soon as you can. Once you have registered, you will also have access to a forum, where you can ask questions or discuss the content of the course.
Structure of the course. We will use an inverted classroom setting, in which you do all your studying in your own time, and we meet twice a week to work through exercises together and discuss any questions you might have.
We will make heavy use of the fantastic Youtube channel 3Blue1Brown, in particular its playlists on the Essence of Linear Algebra and Essence of Calculus. Feel free to start watching these videos right now. I will also assign reading to cover the same topics, in order to add some more depth and familiarize you with reading mathematical texts.
Prerequisites. The course does not assume any prior knowledge beyond high-school math. We will occasionally explore Python libraries for linear algebra and calculus; for these exercises, some basic familiarity for working with Python will be useful.
Grading. This class is worth 6 credit points, which translates into 180 hours of work. Please schedule your semester accordingly.
Your grade for the course will be determined in a final written exam at the end of the semester (10.02.2023). You will have to be physically present in Saarbrücken for this exam.
Because of the flipped classroom format, it is extremely important to me that you participate actively in the interactive sessions.