Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: add Chainlit frontend #33

Merged
merged 13 commits into from
Oct 21, 2024
Merged

feat: add Chainlit frontend #33

merged 13 commits into from
Oct 21, 2024

Conversation

lsorber
Copy link
Member

@lsorber lsorber commented Oct 18, 2024 •
edited
Loading

Changes:

  • Add a Typer CLI
  • Add a Chainlit frontend
  • Add async_rag
  • Add support for async streaming to the llama-cpp-python LiteLLM integration
  • Improve max contexts logic for RAG
  • Improve speed by reducing lru_cache misses by excluding the reranker from comparison
  • Make RAG system prompt configurable
raglite-chainlit.mov

@lsorber lsorber self-assigned this Oct 18, 2024
@lsorber lsorber merged commit 156e124 into main Oct 21, 2024
2 checks passed
@lsorber lsorber deleted the ls-chainlit branch October 21, 2024 15:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@lsorber lsorber

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@lsorber