A framework for using local LLMs (Qwen2.5-coder 7B) that are fine-tuned using RL to generate, debug, and optimize code solutions through iterative refinement.
-
Updated
Feb 23, 2025 - Python
#
local-llm-integration
Here are 9 public repositories matching this topic...
🤖 An Intelligent Chatbot: Powered by the locally hosted Ollama 3.2 LLM 🧠 and ChromaDB 🗂️, this chatbot offers semantic search 🔍, session-aware responses 🗨️, and an interactive Streamlit interface 🎨 for seamless user interaction. 🚀
interactive-ui local-llm-integration chromadb-integration semantic-sear session-aware-responses dynamic-interaction
-
Updated
Dec 12, 2024 - Python
The C# client for LM Studio.
ai csharp dotnet language-models llm local-llm ai-client lm-studio lmstudio offline-ai openai-compatible-api local-llms self-hosted-ai local-llm-integration llm-client
-
Updated
Feb 8, 2025 - C#
An AI-powered assistant for Superteam Vietnam to streamline knowledge management, member discovery, and content generation across Telegram and Twitter, while ensuring privacy with local LLM deployment.
twitter-bot telegram-bot ai-agents weaviate fastapi llm chromadb retrieval-augmented-generation superteam-earn local-llm-integration
-
Updated
Feb 10, 2025 - Python
🚀 A powerful Flutter-based AI chat application that lets you run LLMs directly on your mobile device or connect to local model servers. Features offline model execution, Ollama/LLMStudio integration, and a beautiful modern UI. Privacy-focused, cross-platform, and fully open source.
self-hosted flutter flutter-desktop flutter-mobile llm local-llm llm-inference ollama llm-framework ollama-ui ollama-interface ollama-gui ollama-app ollama-api local-llm-integration
-
Updated
Feb 16, 2025 - Dart
AI-powered Bash terminal built with Python, Tkinter, tkterm, using local LLM through LMStudio for natural language command generation; features whitelist/blacklist management, intuitive interface.
python nlp shell bash terminal ai tkinter llm tkterm local-llm local-ai lmstudio local-llm-integration
-
Updated
Dec 31, 2024 - Python
**Ask CLI** is a command-line tool for interacting with a local LLM (Large Language Model) server. It allows you to send queries and receive concise command-line responses.
linux bash automation command-line command-line-tool cli-tool ask-cli openai-api llms openai-api-chatbot local-llm command-line-assistant local-llm-integration bash-assistant
-
Updated
Dec 22, 2024 - Python
Privacy-First Local AI Chat for VS Code which is also Beautiful
-
Updated
Feb 4, 2025 - TypeScript
An AI-powered system for extracting cancer-related information from patient Electronic Health Record (EHR) notes
information-retrieval transformers pipelines torch accelerate nlp-machine-learning pro optimum nltk-python sentence-transformers requests-library-python prompt-engineering bitsandbytes local-llm-integration
-
Updated
Feb 23, 2025 - Jupyter Notebook
Improve this page
Add a description, image, and links to the local-llm-integration topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the local-llm-integration topic, visit your repo's landing page and select "manage topics."