@@ -37,23 +37,22 @@ For more details, please see our [website](https://routeworks.github.io/leaderbo
3737
3838| Rank | Router | Affiliation | Acc-Cost Arena | Accuracy | Cost/1K Queries | Optimal Selection | Optimal Cost | Optimal Accuracy | Latency | Robustness |
3939| ------| --------------------| -----------------------------| --------| ----------| ---------| -----------------| --------------| ----------------| ---------| ------------|
40- | 🥇 | [ Weave Router] ( https://workweave.dev )   ; [[ Code]] ( https://github.com/workweave/router ) | 🎓  ; Weave | 76.09 | 79.32 | $0.61 | 5.60 | 17.19 | 89.21 | — | 79.76 |
41- | 🥈 | [ Sqwish Router] ( ) | | 75.27 | 76.40 | $0.18 | 7.41 | 25.10 | 90.47 | — | 100.00 |
42- | 🥉 | [ R2-Router] ( https://arxiv.org/abs/2602.02823/ ) | 🎓  ; UCF | 71.60 | 71.23 | $0.06 | 24.51 | 48.70 | 99.85 | — | 45.71 |
43- | 4 | [ Auto Router] ( ) | | 70.05 | 70.17 | $0.12 | 37.58 | 40.02 | 86.04 | — | 49.52 |
44- | 5 | [ vLLM‑SR] ( https://vllm-semantic-router.com/ )   ; [[ Code]] ( https://github.com/vllm-project/semantic-router )   ; [[ HF]] ( https://huggingface.co/llm-semantic-router ) | 🎓  ; vLLM SR Team | 67.23 | 66.53 | $0.06 | 84.66 | 90.71 | 89.24 | — | 90.95 |
45- | 6 | [ MIRT‑BERT] ( https://arxiv.org/pdf/2506.01048 )   ; [[ Code]] ( https://github.com/Mercidaiha/IRT-Router ) | 🎓  ; USTC | 66.89 | 66.88 | $0.15 | 3.44 | 19.62 | 78.18 | 27.03 | 61.19 |
46- | 7 | [ Azure-Model-Router] ( https://ai.azure.com/catalog/models/model-router )   ; [[ Web]] ( https://learn.microsoft.com/en-us/azure/ai-foundry/openai/concepts/model-router ) | 💼  ; Microsoft | 66.66 | 68.09 | $0.54 | 22.52 | 46.32 | 81.96 | — | 54.07 |
47- | 8 | [ NIRT‑BERT] ( https://arxiv.org/pdf/2506.01048 )   ; [[ Code]] ( https://github.com/Mercidaiha/IRT-Router ) | 🎓  ; USTC | 66.12 | 66.34 | $0.21 | 3.83 | 14.04 | 77.88 | 10.42 | 49.29 |
48- | 9 | [ GPT‑5] ( https://openai.com/index/introducing-gpt-5/ ) | 💼  ; OpenAI | 64.32 | 73.96 | $10.02 | — | — | — | — | — |
49- | 10 | [ CARROT] ( https://arxiv.org/abs/2502.03261 )   ; [[ Code]] ( https://github.com/somerstep/CARROT )   ; [[ HF]] ( https://huggingface.co/CARROT-LLM-Routing ) | 🎓  ; UMich | 63.87 | 67.21 | $2.06 | 2.68 | 6.77 | 78.63 | 1.50 | 89.05 |
50- | 11 | [ Chayan] ( https://huggingface.co/adaptive-classifier/chayan )   ; [[ HF]] ( https://huggingface.co/adaptive-classifier/chayan ) | 🎓  ; Adaptive  ; Classifier | 63.83 | 64.89 | $0.56 | 43.03 | 43.75 | 88.74 | — | — |
51- | 12 | [ RouterBench‑MLP] ( https://arxiv.org/pdf/2403.12031 )   ; [[ Code]] ( https://github.com/withmartian/routerbench )   ; [[ HF]] ( https://huggingface.co/datasets/withmartian/routerbench ) | 🎓  ; Martian | 57.56 | 61.62 | $4.83 | 13.39 | 24.45 | 83.32 | 90.91 | 80.00 |
52- | 13 | [ NotDiamond] ( https://www.notdiamond.ai/ ) | 💼  ; NotDiamond | 57.29 | 60.83 | $4.10 | 1.55 | 2.14 | 76.81 | — | 55.91 |
53- | 14 | [ GraphRouter] ( https://arxiv.org/abs/2410.03834 )   ; [[ Code]] ( https://github.com/ulab-uiuc/GraphRouter ) | 🎓  ; UIUC | 57.22 | 57.00 | $0.34 | 4.73 | 38.33 | 74.25 | 2.70 | 94.29 |
54- | 15 | [ RouterBench‑KNN] ( https://arxiv.org/pdf/2403.12031 )   ; [[ Code]] ( https://github.com/withmartian/routerbench )   ; [[ HF]] ( https://huggingface.co/datasets/withmartian/routerbench ) | 🎓  ; Martian | 55.48 | 58.69 | $4.27 | 13.09 | 25.49 | 78.77 | 1.33 | 83.33 |
55- | 16 | [ RouteLLM] ( https://arxiv.org/abs/2406.18665 )   ; [[ Code]] ( https://github.com/lm-sys/RouteLLM )   ; [[ HF]] ( https://huggingface.co/routellm ) | 🎓  ; Berkeley | 48.07 | 47.04 | $0.27 | 99.72 | 99.63 | 68.76 | 0.40 | 100.00 |
56- | 17 | [ RouterDC] ( https://arxiv.org/abs/2409.19886 )   ; [[ Code]] ( https://github.com/shuhao02/RouterDC ) | 🎓  ; SUSTech | 33.75 | 32.01 | $0.07 | 39.84 | 73.00 | 49.05 | 10.75 | 85.24 |
40+ | 🥇 | [ Sqwish Router] ( ) | | 75.27 | 76.40 | $0.18 | 7.41 | 25.10 | 90.47 | — | 100.00 |
41+ | 🥈 | [ R2-Router] ( https://arxiv.org/abs/2602.02823/ ) | 🎓  ; UCF | 71.60 | 71.23 | $0.06 | 24.51 | 48.70 | 99.85 | — | 45.71 |
42+ | 🥉 | [ Auto Router] ( ) | | 70.05 | 70.17 | $0.12 | 37.58 | 40.02 | 86.04 | — | 49.52 |
43+ | 4 | [ vLLM‑SR] ( https://vllm-semantic-router.com/ )   ; [[ Code]] ( https://github.com/vllm-project/semantic-router )   ; [[ HF]] ( https://huggingface.co/llm-semantic-router ) | 🎓  ; vLLM SR Team | 67.23 | 66.53 | $0.06 | 84.66 | 90.71 | 89.24 | — | 90.95 |
44+ | 5 | [ MIRT‑BERT] ( https://arxiv.org/pdf/2506.01048 )   ; [[ Code]] ( https://github.com/Mercidaiha/IRT-Router ) | 🎓  ; USTC | 66.89 | 66.88 | $0.15 | 3.44 | 19.62 | 78.18 | 27.03 | 61.19 |
45+ | 6 | [ Azure-Model-Router] ( https://ai.azure.com/catalog/models/model-router )   ; [[ Web]] ( https://learn.microsoft.com/en-us/azure/ai-foundry/openai/concepts/model-router ) | 💼  ; Microsoft | 66.66 | 68.09 | $0.54 | 22.52 | 46.32 | 81.96 | — | 54.07 |
46+ | 7 | [ NIRT‑BERT] ( https://arxiv.org/pdf/2506.01048 )   ; [[ Code]] ( https://github.com/Mercidaiha/IRT-Router ) | 🎓  ; USTC | 66.12 | 66.34 | $0.21 | 3.83 | 14.04 | 77.88 | 10.42 | 49.29 |
47+ | 8 | [ GPT‑5] ( https://openai.com/index/introducing-gpt-5/ ) | 💼  ; OpenAI | 64.32 | 73.96 | $10.02 | — | — | — | — | — |
48+ | 9 | [ CARROT] ( https://arxiv.org/abs/2502.03261 )   ; [[ Code]] ( https://github.com/somerstep/CARROT )   ; [[ HF]] ( https://huggingface.co/CARROT-LLM-Routing ) | 🎓  ; UMich | 63.87 | 67.21 | $2.06 | 2.68 | 6.77 | 78.63 | 1.50 | 89.05 |
49+ | 10 | [ Chayan] ( https://huggingface.co/adaptive-classifier/chayan )   ; [[ HF]] ( https://huggingface.co/adaptive-classifier/chayan ) | 🎓  ; Adaptive  ; Classifier | 63.83 | 64.89 | $0.56 | 43.03 | 43.75 | 88.74 | — | — |
50+ | 11 | [ RouterBench‑MLP] ( https://arxiv.org/pdf/2403.12031 )   ; [[ Code]] ( https://github.com/withmartian/routerbench )   ; [[ HF]] ( https://huggingface.co/datasets/withmartian/routerbench ) | 🎓  ; Martian | 57.56 | 61.62 | $4.83 | 13.39 | 24.45 | 83.32 | 90.91 | 80.00 |
51+ | 12 | [ NotDiamond] ( https://www.notdiamond.ai/ ) | 💼  ; NotDiamond | 57.29 | 60.83 | $4.10 | 1.55 | 2.14 | 76.81 | — | 55.91 |
52+ | 13 | [ GraphRouter] ( https://arxiv.org/abs/2410.03834 )   ; [[ Code]] ( https://github.com/ulab-uiuc/GraphRouter ) | 🎓  ; UIUC | 57.22 | 57.00 | $0.34 | 4.73 | 38.33 | 74.25 | 2.70 | 94.29 |
53+ | 14 | [ RouterBench‑KNN] ( https://arxiv.org/pdf/2403.12031 )   ; [[ Code]] ( https://github.com/withmartian/routerbench )   ; [[ HF]] ( https://huggingface.co/datasets/withmartian/routerbench ) | 🎓  ; Martian | 55.48 | 58.69 | $4.27 | 13.09 | 25.49 | 78.77 | 1.33 | 83.33 |
54+ | 15 | [ RouteLLM] ( https://arxiv.org/abs/2406.18665 )   ; [[ Code]] ( https://github.com/lm-sys/RouteLLM )   ; [[ HF]] ( https://huggingface.co/routellm ) | 🎓  ; Berkeley | 48.07 | 47.04 | $0.27 | 99.72 | 99.63 | 68.76 | 0.40 | 100.00 |
55+ | 16 | [ RouterDC] ( https://arxiv.org/abs/2409.19886 )   ; [[ Code]] ( https://github.com/shuhao02/RouterDC ) | 🎓  ; SUSTech | 33.75 | 32.01 | $0.07 | 39.84 | 73.00 | 49.05 | 10.75 | 85.24 |
5756
5857🎓 Open-source 💼 Closed-source
5958
0 commit comments