Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Speculative: Add support for automatic early stopping of poor runs #1055

Open
jeswan opened this issue Sep 17, 2020 · 0 comments
Open

Speculative: Add support for automatic early stopping of poor runs #1055

jeswan opened this issue Sep 17, 2020 · 0 comments
Labels
feature-request low-priority Only if you're bored. Ask Sam/Ian/Alex before starting.

Comments

@jeswan
Copy link
Contributor

jeswan commented Sep 17, 2020

Issue by sleepinyourhat
Thursday Apr 09, 2020 at 21:08 GMT
Originally opened as nyu-mll/jiant#1055

Inspired by: https://arxiv.org/abs/2002.06305

Minimally: End training if a certain target accuracy isn't reached by some (early-ish) number of steps. This can be set manually to automatically catch jobs that fail due to a poor random seed.

Ideally: Integrate with some kind of experiment manager for hyperparameter tuning, so as to kill jobs that perform well below average early in tuning.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature-request low-priority Only if you're bored. Ask Sam/Ian/Alex before starting.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jeswan