A walkthrough
- A rudimentary understanding of NLP (what was discussed in class is more than enough)
- Familiarity with the pytorch API
- Conceptual understanding of object-oriented programming
We will be using a small subset of the . Much of the implementation of the actual training and validation functions are pre-configured. There are two separate jupyter notebook files - one that is more "assignment" focused and one that is
This tutorial would not be possible without Yu-Hsiang Huang's wonderful pytorch implementation of Attention is all you need, on which much of my code is based.