Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

llm eval #535

Merged
merged 13 commits into from
Apr 10, 2024
Merged

llm eval #535

merged 13 commits into from
Apr 10, 2024

Conversation

zsw256
Copy link
Collaborator

@zsw256 zsw256 commented Mar 11, 2024

Adding codes for llm eval using lm_eval.
Some codes in other projects are changed due to different versions of dependencies(transformers, especially).

@xiezipeng-ML
Copy link
Contributor

调整一下格式: bash dev/linter.sh

@xiezipeng-ML
Copy link
Contributor

evalharness.py,这个名字改改eval_harness之类的

@zsw256 zsw256 requested a review from oneflow-ci-bot April 10, 2024 02:38
@xiezipeng-ML xiezipeng-ML requested review from oneflow-ci-bot and removed request for oneflow-ci-bot April 10, 2024 03:02
@zsw256 zsw256 requested review from oneflow-ci-bot and removed request for oneflow-ci-bot April 10, 2024 07:09
@zsw256 zsw256 requested review from oneflow-ci-bot and removed request for oneflow-ci-bot April 10, 2024 07:13
@zsw256 zsw256 requested review from oneflow-ci-bot and removed request for oneflow-ci-bot April 10, 2024 07:18
@zsw256 zsw256 requested review from oneflow-ci-bot and removed request for oneflow-ci-bot April 10, 2024 07:31
@zsw256 zsw256 merged commit 544cb3a into Oneflow-Inc:main Apr 10, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants