Skip to content

Add predictions trained router by cnn#115

Closed
YangY-Z wants to merge 1 commit into
RouteWorks:mainfrom
YangY-Z:codex/sub10-trained-router-full
Closed

Add predictions trained router by cnn#115
YangY-Z wants to merge 1 commit into
RouteWorks:mainfrom
YangY-Z:codex/sub10-trained-router-full

Conversation

@YangY-Z

@YangY-Z YangY-Z commented May 29, 2026

Copy link
Copy Markdown
Contributor

No description provided.

@YangY-Z YangY-Z force-pushed the codex/sub10-trained-router-full branch from b7a1088 to 75dece0 Compare May 29, 2026 03:33
@YangY-Z

YangY-Z commented May 29, 2026

Copy link
Copy Markdown
Contributor Author

/evaluate

@YangY-Z YangY-Z force-pushed the codex/sub10-trained-router-full branch from 75dece0 to 77f1ca4 Compare May 29, 2026 03:50
@YangY-Z

YangY-Z commented May 29, 2026

Copy link
Copy Markdown
Contributor Author

/evaluate

@YangY-Z YangY-Z closed this May 29, 2026
@github-actions

Copy link
Copy Markdown

Router Evaluation Results

Router: sub10-trained-router
Dataset Split: full

RouterArena Metrics

Metric Value
RouterArena Score 0.7327
Accuracy 72.28%
Total Cost $0.185571
Avg Cost per Query $0.000022
Avg Cost per 1K Queries $0.0221
Number of Queries 8400
Robustness Score 0.4929

Optimality Metrics

Metric Value
Opt.Sel (Optimal Selection) 0.3575
Opt.Cost (Cost Efficiency) 0.4340
Opt.Acc (Accuracy vs Optimal) 0.9331

Evaluation completed by RouterArena automated workflow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant