Skip to content

Enable model switching #47

@remlaps

Description

@remlaps

Update Thoth to be able to switch between LLM models when network disruptions or other challenges are encountered. Example cases:

  1. Gemini Pro is returning 503 errors, so switch automatically to using Gemini Flash.
  2. A free API key has reached its quota, so auto-switch to use a paid API key.
  3. Gemini is totally unreachable, so switch over to using ArliAI models (or vice versa).

Metadata

Metadata

Assignees

Labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions