cpt

CPT原论文：CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation
GitHub项目：fastnlp/CPT: CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation

需要安装CPT官方项目里要求的环境（transformers不能太新，否则会报bug）：

• pytorch==1.8.1
• transformers==4.4.1

其他所需包我用的版本：

• datasets==2.12.0
• rouge==1.0.1

checkpoint下载地址（我自己用的是large版）：

• https://huggingface.co/fnlp/cpt-base
• https://huggingface.co/fnlp/cpt-large