[Feature] JMTEB v2 #92
Closed
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
関連する Issue / PR
N/A
PR をマージした後の挙動の変化
jmteb.jsonnetを更新し,更新版JMTEBを回せるようにしました。JMTEBの更新履歴はhttps://huggingface.co/datasets/sbintuitions/JMTEB/blob/main/UPDATES.md をご参照ください。
今回は
Leaderboardを後ほど更新します。
挙動の変更を達成するために行ったこと
src/jmteb/configs/tasksにデータセットの追加・削除src/jmteb/configs/jmteb.jsonnetの変更動作確認