Code for adapting X-MOD on our pre-training corpus. The corpus itself is not released. Dependencies See requirements.txt Data preprocessing See data_preprocessing/prepare_data.ipynb Training See training_scripts/swissbert_new_vocab.sh