Skip to content

Configurable LLM#5

Draft
Simon-Stone wants to merge 16 commits intocrvernon:mainfrom
Simon-Stone:configurable_llm
Draft

Configurable LLM#5
Simon-Stone wants to merge 16 commits intocrvernon:mainfrom
Simon-Stone:configurable_llm

Conversation

@Simon-Stone
Copy link

Work in progress to close issue #4

The approach is to switch from OpenAI's Python SDK to the LangChain framework. LangChain, through its various extensions, has support for a virtually all model providers (Anthropic, Google, HuggingFace, Ollama, OpenAI, ...). To specify which models to use, I suggest a config file in the TOML format (see config.toml).

This is a draft pull request intended to show that I am working on this. It's already functional, but once we have tested and tweaked it more thoroughly, I will mark it for review. I would greatly appreciate if you would consider reviewing and eventually merging it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants