Unit 0: Language modelling
Language modelling is about predicting which word comes next in a sequence of words – a seemingly simple task that nevertheless serves as a cornerstone for generating and understanding human language through computers. In this unit, you will learn about two types of language models: \(n\)-gram models and neural models, with a focus on models based on recurrent neural networks.
Lectures
Deadline for the quizzes: 2025-03-05
| Section | Title | Video | Slides | Quiz |
|---|---|---|---|---|
| 0.1 | Introduction to language modelling | video | slides | quiz |
| 0.2 | N-gram language models | video | slides | quiz |
| 0.3 | Neural language models | video | slides | quiz |
| 0.4 | Recurrent neural networks (RNNs) | video | slides | quiz |
| 0.5 | The LSTM architecture | video | slides | quiz |
| 0.6 | RNN language models | video | slides | quiz |
Lab
There is no lab for this unit.