Add Sqwish Router submission#94
Conversation
|
/evaluate |
Router Evaluation ResultsRouter: RouterArena Metrics
Optimality Metrics
Evaluation completed by RouterArena automated workflow |
# Conflicts: # model_cost/model_cost.json
|
/evaluate |
Router Evaluation ResultsRouter: RouterArena Metrics
Optimality Metrics
Evaluation completed by RouterArena automated workflow |
|
/evaluate |
Router Evaluation ResultsRouter: RouterArena Metrics
Optimality Metrics
Evaluation completed by RouterArena automated workflow |
|
I will re-run the evaluation due to the recent update in #97. |
Sqwish Router (PR #94) achieves Acc-Cost Arena 75.27, taking the top spot ahead of Weave Router (74.61). Optimality metrics are from the fixed code in PR #97 (Opt.Sel 7.41, Opt.Cost 25.10, Opt.Acc 90.47). Co-authored-by: yl231 <yl231@users.noreply.github.com> Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
Hi @namitha-sqwish, I'll add the Sqwish Router to the leaderboard. Could you confirm a couple of details for me: 1) Is it open-source? 2) Is there a link you'd like me to reference? |
|
Hi @yl231 , Thank you. 1. Sqwish-router is closed source. 2. This is our company website - https://www.sqwish.ai/ - we are putting out a technical report and router playground soon - so maybe you can link that in the submission. Thanks! |
Add Sqwish Router submission.
Includes the router config, full prediction file, and robustness prediction file.