Skip to content

[Feature] Smart Auto-Routing (Simple vs Strong Models) #891

Description

@akramcodez

Description

Implement a cascading model strategy that auto-routes trivial or tool-only turns (simple reads, formatting checks) to a small/fast/cheap model, escalating to the user's "main" strong model only when task complexity warrants it.

Use Case

Saves cost and reduces latency on easy tasks (like view_file) without sacrificing quality on hard reasoning tasks.

Proposed Solution

Create source/ai-sdk-client/smart-router.ts with a classifier based on prompt length, code-block count, etc. Add a /smartroute command to toggle this behavior.

Alternatives Considered

Forcing users to manually swap models (which creates friction).

Additional Context

  • I have searched existing issues to ensure this is not a duplicate
  • This feature aligns with the project's goals (local-first AI assistance)

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions