Materials from this interactive book are used throughout the Natural Language Processing course at the Department of Computer Science, University of Copenhagen. The official course description can be found here. Materials covered each week are listed below. The course schedule and materials are tentative and subject to minor changes. Most reading material is from Speech and Language Processing by Jurafsky & Martin.
| Week | Reading (before lecture) | Lecture (Tuesday) | Lab (Friday & Monday) | Lab notebook |
|---|---|---|---|---|
| 36 |
Chapter 2 up to end of 2.5 Chapter 4 up to end of 4.5 Chapter 5 up to end of 5.6 | 3. Sep. 2024: Course Logistics (slides) Introduction to NLP (slides) Tokenisation & Sentence Splitting (notes, slides, exercises) Text Classification (slides) | 6. & 9. Sep. 2024: Jupyter notebook setup, introduction to Colab Introduction to PyTorch Project group arrangements Questions about the course project | lab 1 |
| 37 |
Chapter 3 up to end of 3.5 Chapter 6 up to end of 6.4 Chapter 7 up to end of 7.5 | 10. Sep. 2024: Language Modelling (slides) Word Embeddings (slides) | 13. & 16. Sep. 2024: Word representations and sentiment classification Project help | lab 2 |
| 38 |
Chapter 7 up to end of 7.6 Chapter 8 up to end of 8.7 | 17. Sep. 2024: Recurrent Neural Networks (slides) Neural Language Models (slides) | 20. & 23. Sep. 2024: Error analysis and explainability Project help | lab 3 |
| 39 |
Chapter 17 up to end of 17.3 Chapter 19 up to end of 19.2 | 24. Sep. 2024: Sequence Labelling (slides, notes) Parsing (slides) | 27. & 30. Sep. 2024: Sequence labelling and beam search Project help | lab 4 |
| 40 |
Chapter 8 up to end of 8.8 Chapter 9 up to end of 9.2 Chapter 10 up to end of 10.2 Chapter 11 | 1. Oct. 2024: Attention (slides) Transformers (slides) | 4. & 7. Oct. 2024: Language Models with Transformers and RNNs Project help | lab 5 |
| 41 |
Chapter 14 Chapter 20 | 8. Oct. 2024: Information Extraction (slides) Question Answering (slides) | 11. & 21. Oct. 2024: In-depth look at Transformers and Multilingual QA Project help | lab 6 |
| 43 |
Chapter 12 Chapter 13 | 22. Oct. 2024: Machine Translation (slides) Transfer Learning (slides) | 25. & 28. Oct. 2024: Project help. | |
| 44 | Belinkov and Glass, 2019 | 29. Oct. 2024: Interpretability (slides) | 1. Nov. 2024: Project help. |
The easiest way to view the course content is via the static nbviewer. To be able to make changes to the book and render it dynamically, see the installation instructions.