Use the fastai (https://www.fast.ai/)framework to implement transfer learning for text classification.
The language model was trained on a corpus named Wikitext-103.(https://openreview.net/pdf?id=Byj72udxe)
If you want to know some detailed information, please refer to Jeremy Howard’s paper.(https://arxiv.org/abs/1801.06146v5)
fasiai 1.0.30 pytroch 1.0.0
https://www.anaconda.com/download/#linux
fasiai Github https://github.com/fastai/fastai
（Note: It is highly recommended to use the conda method to install.）
The tutorial below the official github course folder is fastai version is 0.7. I am using the address of the corresponding tutorial for 1.0.0 should be:
https://github.com/fastai/course-v3
video:
https://www.usfca.edu/data-institute/certificates/deep-learning-part-two