support languages other than English

[jeswan]

Issue by ssabzzz
Thursday Jun 25, 2020 at 14:13 GMT
Originally opened as nyu-mll/jiant#1098

---

I want to use a multilingual BERT model which apparently is not an option in jiant. (my test dataset is not in english)

Is there a way to achieve this right now?

[jeswan]

Comment by sleepinyourhat
Thursday Jun 25, 2020 at 14:23 GMT

---

I believe there aren't any firm obstacles to setting up XLM-R support or non-English tasks. This isn't trivial, but if you can identify all of the RoBERTa-specific code, you should be able to set up a parallel code path for XLM-R.

Alternately, we're finishing up the initial draft/beta release of jiant 2, which will be public in about two weeks. That will have a somewhat different interface, but it will almost certainly support XLM-R from the start.