Running downstream tasks
In this section, we will jump into some transformer cars and drive them around a bit to see what they do. There are many models and tasks. We will run a few of them in this section. We will be going through variants of these models during our journey in the book. Once you understand the process of running a few tasks, you will quickly understand all of them. After all, the human baseline for all these tasks is us!
A downstream task is a fine-tuned transformer task that inherits the model and parameters from a pretrained transformer model.
A downstream task is thus the perspective of a pretrained model running fine-tuned tasks. That means, depending on the model, a task is downstream if it was not used to fully pretrain the model. In this section, we will consider all the tasks downstream since we did not pretrain them.
Models will evolve, as will databases, benchmark methods, accuracy measurement methods, and leaderboard criteria. However, the...
