-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Description
def classify_item(item, metrics):
chart_type = item["type"]["image"]
task_type = item["type"]["task"]
if item["type"]["QA"] == 'Acc+':
accp = accuracy_plus(item["conversation"])
cor = confuse_rate(item["conversation"])
acc = accuracy_vanilla(item["conversation"])
err = not accp and not cor
update_yes_no(metrics, 'all', accp, cor, acc, err)
for group_key, group_values in metric_group.items():
if chart_type in group_values:
metric_category = 'regular' if group_key in {'line', 'bar', 'pie'} else 'extra'
update_yes_no(metrics, group_key, accp, cor, acc, err)
update_yes_no(metrics, metric_category, accp, cor, acc, err)
There are overlaps of types in metric_group. The number of regular + extra is not equal to all.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels