when I run your code in train status, 70 mins / epoch, but it cost 30 mins to get 1/5976 in the reference status , what should I do to speed up it? I have 5976 passage to be predicted.
my inference command:
python predict.py --include-package numnet --archive_file ./out/model.tar.gz --input_file ./data/temp.for_infer.json --output_file ./predictions.json
result:
0%| | 1/5976 [19:01<1895:20:52, 1141.97s/it]
when I run your code in train status, 70 mins / epoch, but it cost 30 mins to get 1/5976 in the reference status , what should I do to speed up it? I have 5976 passage to be predicted.
my inference command:
python predict.py --include-package numnet --archive_file ./out/model.tar.gz --input_file ./data/temp.for_infer.json --output_file ./predictions.jsonresult:
0%| | 1/5976 [19:01<1895:20:52, 1141.97s/it]