Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Average Callback #20617

Open
Alexis-IMBERT opened this issue Mar 5, 2025 · 0 comments · May be fixed by #20618
Open

Add Average Callback #20617

Alexis-IMBERT opened this issue Mar 5, 2025 · 0 comments · May be fixed by #20618
Labels
feature Is an improvement or enhancement needs triage Waiting to be triaged by maintainers

Comments

@Alexis-IMBERT
Copy link

Alexis-IMBERT commented Mar 5, 2025

Description & Motivation

Create a callback to allow creating an average (smoothing) of a logged metrics and log it.
Why directly in lightning ? This feature could be useful for Early Stopping, Now in some training the loss (for example) is very unstable and you could get an exceptional minimum, but because it's very unstable, it's not the best epochs to stop.

Get an log average feature could smooth the loss (for example again) and allow better EarlyStopping, so better training

Pitch

Create Callback class that get in parameter : the metrics to smooth, the name of the smoothed metric and the callable function to use to smooth the metric, the window, (how many previous values to consider).
The callable function could be mean by default and window set to 5 by default.

Alternatives

No response

Additional context

No response

cc @lantiga @Borda

@Alexis-IMBERT Alexis-IMBERT added feature Is an improvement or enhancement needs triage Waiting to be triaged by maintainers labels Mar 5, 2025
@Alexis-IMBERT Alexis-IMBERT linked a pull request Mar 5, 2025 that will close this issue
11 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature Is an improvement or enhancement needs triage Waiting to be triaged by maintainers
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant