Skip to content

DOC/TEST: add agentic model-selection workflow example#404

Open
biru-codeastromer wants to merge 1 commit into
sktime:mainfrom
biru-codeastromer:docs/agentic-model-selection-example
Open

DOC/TEST: add agentic model-selection workflow example#404
biru-codeastromer wants to merge 1 commit into
sktime:mainfrom
biru-codeastromer:docs/agentic-model-selection-example

Conversation

@biru-codeastromer
Copy link
Copy Markdown
Contributor

Summary

This PR adds a runnable agentic model-selection workflow example using the current MCP tool surface, plus a smoke test to keep it working.

Closes #403.

Why

The repo already exposes the primitives needed for a simple agent loop — discovery, description, instantiation, evaluation, forecasting, and code export — but it did not yet ship a concrete example that ties them together into a truthful end-to-end workflow.

What this adds

  • examples/07_agentic_model_selection.py
    • discovers forecasting candidates
    • inspects capabilities
    • instantiates and evaluates multiple candidates
    • ranks them by mean MAPE
    • selects a winner
    • generates a forecast
    • exports reproducible code
  • tests/test_agentic_workflow_example.py
    • smoke-tests the workflow so the example stays aligned with current runtime behavior

Verification

  • .venv/bin/ruff check examples/07_agentic_model_selection.py tests/test_agentic_workflow_example.py
  • .venv/bin/ruff format --check examples/07_agentic_model_selection.py tests/test_agentic_workflow_example.py
  • .venv/bin/python examples/07_agentic_model_selection.py
  • .venv/bin/pytest tests/test_agentic_workflow_example.py -q
  • .venv/bin/pytest -q

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[DOC/TEST] add runnable agentic model-selection workflow example using existing MCP tools

1 participant