Unit 0: Language modelling

Published

January 21, 2025

Language modelling is about predicting which word comes next in a sequence of words – a seemingly simple task that nevertheless serves as a cornerstone for generating and understanding human language through computers. In this unit, you will learn about two types of language models: \(n\)-gram models and neural models.

Section Title Materials
0.1 Introduction to language modelling slides
0.2 N-gram language models slides
0.3 Statistical bigram model notebook
0.4 Linear layers slides
0.5 Neural bigram model notebook