Adding MCP Servers supports to Arcade Evals#689

Merged

jottakka merged 56 commits intomainfrom

francisco/updating-arcade-evails

Jan 7, 2026

Commits on Nov 5, 2025

Add --failed-only and --output flags to evals command
Francisco Liberal
committed
Add tests for display_eval_results with --failed-only and --output flags
Francisco Liberal
committed
Add additional test cases for better coverage of display_eval_results
Francisco Liberal
committed
Extract filtering logic to testable function and add tests
Francisco Liberal
committed

Commits on Nov 14, 2025

Merge branch 'main' into francisco/arcade-cli/updating-evals-to-show-only-failed
jottakka
authored

Commits on Nov 17, 2025

Merge branch 'main' into francisco/arcade-cli/updating-evals-to-show-only-failed
Francisco Liberal
committed

Commits on Nov 18, 2025

Adding MCP Servers supports to Arcade Evals
Francisco Liberal
committed

Commits on Nov 20, 2025

Updating loading from mcp server
Francisco Liberal
committed

Commits on Nov 26, 2025

Merge branch 'main' into francisco/updating-arcade-evails
Francisco Liberal
committed
Updating to accept headers
Francisco Liberal
committed
fixing linting
Francisco Liberal
committed

Commits on Nov 28, 2025

Merge branch 'main' into francisco/arcade-cli/updating-evals-to-show-only-failed
Francisco Liberal
committed
added session support for the http loader
torresmateo
committed
removed debug print
torresmateo
committed
handled unsupported protocol for http tool loader
torresmateo
committed
Open API issue
Francisco Liberal
committed
Updating strict mode
Francisco Liberal
committed
Updating strict mode
Francisco Liberal
committed

Commits on Dec 9, 2025

Merge branch 'main' into francisco/arcade-cli/updating-evals-to-show-only-failed
Francisco Liberal
committed
Merge branch 'main' into francisco/updating-arcade-evails
Francisco Liberal
committed
Merge branch 'francisco/arcade-cli/updating-evals-to-show-only-failed' into francisco/updating-arcade-evails
Francisco Liberal
committed

Commits on Dec 13, 2025

Merge branch 'main' into francisco/updating-arcade-evails
Francisco Liberal
committed

Commits on Dec 15, 2025

Merge branch 'main' into francisco/updating-arcade-evails
Francisco Liberal
committed

Commits on Dec 16, 2025

Merge branch 'main' into francisco/updating-arcade-evails
Francisco Liberal
committed
updating eval suit to contain all tool sources
Francisco Liberal
committed
Adding anthropic support
Francisco Liberal
committed

Commits on Dec 17, 2025

Commits on Dec 18, 2025

Commits on Dec 19, 2025

Adding compare mode
jottakka
committed

Commits on Dec 23, 2025

Updating evals for multiple models/providers/tracks
jottakka
committed

Commits on Dec 24, 2025

removing self implemented loader and adding flag to override arcade url
jottakka
committed

Commits on Dec 25, 2025

Commits on Dec 29, 2025

adressing some changes after code review
jottakka
committed

Commits on Jan 4, 2026

updating after erics review
jottakka
committed

Commits on Jan 5, 2026

Commits on Jan 7, 2026