File tree Expand file tree Collapse file tree 2 files changed +7
-1
lines changed Expand file tree Collapse file tree 2 files changed +7
-1
lines changed Original file line number Diff line number Diff line change 11# vitals (development version)
22
3+ * The default ` accuracy() ` metric will now report a score of 0 rather than
4+ ` NaN ` when all scores are 0.
5+
36* Fixed bug where non-default grading systems in model-graded evals would
47 result in scores being wiped during logging (#139 ).
58
Original file line number Diff line number Diff line change @@ -700,7 +700,10 @@ Task <- R6::R6Class(
700700 if (any(is.na(numeric_scores ))) {
701701 return ()
702702 }
703- numeric_scores <- numeric_scores / max(numeric_scores , na.rm = TRUE )
703+ max_score <- max(numeric_scores , na.rm = TRUE )
704+ if (is.finite(max_score ) && max_score > 0 ) {
705+ numeric_scores <- numeric_scores / max_score
706+ }
704707 private $ metric_results <-
705708 list2(
706709 accuracy = logged(accuracy )(numeric_scores )
You can’t perform that action at this time.
0 commit comments