Skip to content

Implement cost tracking and monitoring via LiteLLM#206

Open
HamzaSardar wants to merge 1 commit intodevelopfrom
gov/cost-tracking-via-litellm
Open

Implement cost tracking and monitoring via LiteLLM#206
HamzaSardar wants to merge 1 commit intodevelopfrom
gov/cost-tracking-via-litellm

Conversation

@HamzaSardar
Copy link
Copy Markdown

@HamzaSardar HamzaSardar commented Apr 7, 2026

  • Add Postgres to docker-compose.yaml with named volume (managed by docker). Connection has a service_healthy check condition.
  • Add litellm config with master key (currently placeholder) and point it to the db url.
  • settings.py: add litellm_url and litellm_master_key to agensettings
  • agent.py: build client with base_url pointing to the litellm anthropic endpoint, and pass it as the provider to anthropicmodel so anthropic queries pass through litellm.

@HamzaSardar HamzaSardar changed the base branch from main to develop April 7, 2026 14:49
@HamzaSardar HamzaSardar requested a review from osw282 April 7, 2026 14:50
@HamzaSardar HamzaSardar self-assigned this Apr 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant