-
Notifications
You must be signed in to change notification settings - Fork 318
Add LLM Hub blog post #3311
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Add LLM Hub blog post #3311
Changes from 1 commit
Commits
Show all changes
9 commits
Select commit
Hold shift + click to select a range
6731b19
Add LLM Hub blog post
arash77 7e020e6
Update content/news/2025-09-02-llm-hub/index.md
arash77 c63e76d
Update content/news/2025-09-02-llm-hub/index.md
arash77 ef4cfac
Refactor LLM Hub blog post
arash77 523514f
Update LLM Hub content for clarity and accessibility
arash77 3f43aef
Merge branch 'master' into add-llm-hub-news
bgruening 393876b
Apply suggestions from code review
arash77 4130b44
Update content/news/2025-09-02-llm-hub/index.md
arash77 59898d4
Update and rename index.md to index.md
bgruening File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,144 @@ | ||
| --- | ||
| title: 'LLM Hub: Accessible Large Language Models for Everyone' | ||
| date: '2025-09-02' | ||
| tease: "Access powerful Large Language Models in Galaxy without API keys" | ||
| hide_tease: false | ||
| authors: Arash Kadkhodaei | ||
| subsites: [global, eu, us, freiburg] | ||
| tags: [tool, AI, LLM] | ||
| --- | ||
|
|
||
| ## LLM Hub: Accessible Large Language Models for Everyone | ||
|
|
||
| Large Language Models (LLMs) have revolutionized how we process and analyze text data, offering powerful capabilities for tasks ranging from content generation to complex reasoning. However, accessing these models often requires API keys, payment setups, and technical expertise that can be barriers for many researchers. Today, we're excited to introduce [LLM Hub](https://usegalaxy.eu/?tool_id=llm_hub) on Galaxy Europe - a tool that makes powerful AI models accessible to everyone without the need for personal API keys or payment information. | ||
arash77 marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| ## What Makes LLM Hub Different? | ||
|
|
||
| Unlike traditional LLM access methods that require users to: | ||
| - Create accounts with AI providers | ||
| - Set up payment methods | ||
| - Manage API keys | ||
| - Handle rate limits and costs | ||
|
|
||
| LLM Hub provides **direct access** to a diverse collection of state-of-the-art language models through Galaxy's familiar interface. This represents a significant step forward in democratizing AI access for the research community. | ||
arash77 marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| ## Available Models | ||
|
|
||
| LLM Hub offers access to a carefully curated selection of models, each optimized for different use cases. These models are currently hosted at the University of Freiburg and represent our initial offering. | ||
| This collection may expand in the future with additional models from various providers. | ||
arash77 marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| ### Text Models | ||
|
|
||
| | Model | Provider | Description | | ||
| |-------|----------|-------------| | ||
| | **GPT-OSS-120B** | OpenAI | Best suited for complex tasks, deep reasoning, and detailed outputs | | ||
| | **GPT-OSS-20B** | OpenAI | Smooth for straightforward Q&A or text generation, efficient on small servers | | ||
| | **Qwen3-30B-A3B** | Alibaba Cloud | Strong all-rounder for technical tasks, coding, and long structured outputs | | ||
| | **DeepSeek-R1-0528-Qwen3-8B** | DeepSeek | Fast and efficient for general reasoning and straightforward problem-solving | | ||
| | **Meta-Llama-3.1-8B-Instruct** | Meta AI | Lightweight and responsive, suitable for simpler tasks and fast prompt execution | | ||
| | **Mistral-Small-3.2-24B** | Mistral AI | Balanced accuracy and speed, good for drafting documents and structured outputs | | ||
| | **Magistral-Small** | Mistral AI | Quick and lightweight text generation, best when speed and cost matter most | | ||
|
|
||
| ### Multimodal Models | ||
|
|
||
| | Model | Provider | Description | | ||
| |-------|----------|-------------| | ||
| | **Gemma-3-12B** | Google DeepMind | Handles text + images, great for describing photos, diagrams, or screenshots | | ||
arash77 marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
| | **Qwen2.5-VL-7B** | Alibaba Cloud | Budget-friendly image understanding, extract info from charts, UIs, or screenshots | | ||
arash77 marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| ### Image Models | ||
|
|
||
| | Model | Provider | Description | | ||
| |-------|----------|-------------| | ||
| | **NuMarkdown-8B-Thinking** | NuMind | Advanced OCR and document understanding, excels at extracting structured data from scanned images | | ||
|
|
||
| ## Key Features | ||
|
|
||
| ### Multiple Input Types | ||
| LLM Hub supports various input formats depending on the model type: | ||
| - **Text files** (TXT, HTML, JSON) for text-based analysis | ||
| - **Images** (JPG, PNG, GIF, TIFF, BMP) for visual understanding | ||
| - **Combined inputs** for multimodal analysis | ||
|
|
||
| ### Workflow Integration | ||
| As with all Galaxy tools, LLM Hub seamlessly integrates into larger analytical workflows. You can: | ||
| - Process data with other Galaxy tools before LLM analysis | ||
| - Use LLM outputs as inputs for downstream analysis | ||
| - Create reproducible workflows combining traditional data processing with AI capabilities | ||
| - Share complete analytical pipelines with colleagues | ||
|
|
||
| ### Use Cases | ||
|
|
||
| The versatility of LLM Hub makes it suitable for numerous research applications: | ||
|
|
||
| **Text Analysis & Processing:** | ||
| - Summarize research papers or documents | ||
| - Extract key information from unstructured text | ||
| - Translate content between languages | ||
| - Perform sentiment analysis on social media data | ||
| - Generate structured data from free-form text | ||
|
|
||
| **Image & Document Analysis:** | ||
| - Extract text from scanned documents (OCR) | ||
arash77 marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
| - Analyze charts, graphs, and diagrams | ||
arash77 marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
| - Describe scientific images or experimental results | ||
| - Process screenshots of interfaces or applications | ||
|
|
||
| **Research & Development:** | ||
| - Generate code snippets for data analysis | ||
| - Create documentation and explanations | ||
| - Brainstorm research ideas and approaches | ||
| - Draft grant proposals or research summaries | ||
arash77 marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| **Educational Applications:** | ||
| - Create learning materials and explanations | ||
| - Generate quiz questions from course content | ||
| - Provide detailed explanations of complex concepts | ||
| - Assist with academic writing and editing | ||
|
|
||
| ## Getting Started | ||
|
|
||
| Using LLM Hub is straightforward: | ||
|
|
||
| 1. **Navigate to Galaxy Europe** and search for "LLM Hub" in the tool panel | ||
arash77 marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
| 2. **Select your model type** based on your input data (text, image, or multimodal) | ||
| 3. **Choose the appropriate model** for your task complexity and requirements | ||
| 4. **Upload your context data** (optional) - this can be text files, images, or both | ||
| 5. **Enter your prompt** describing the task you want the LLM to perform | ||
| 6. **Run the tool** and receive your results in Markdown format | ||
|
|
||
| The tool's intelligent interface guides you through the selection process, ensuring you choose the right model for your specific needs. | ||
|
|
||
| ## Technical Implementation | ||
|
|
||
| LLM Hub leverages LiteLLM proxy technology to provide seamless access to multiple AI providers through a unified interface. This architecture ensures: | ||
| - **Reliability**: Automatic failover and retry mechanisms | ||
| - **Performance**: Optimized routing to the best available endpoints | ||
| - **Scalability**: Dynamic load balancing across multiple providers | ||
| - **Consistency**: Standardized API interface regardless of the underlying model | ||
|
|
||
| The tool is built with robust error handling and provides clear feedback when models are temporarily unavailable or experiencing high demand. | ||
|
|
||
| ## Privacy and Data Security | ||
|
|
||
| Your data privacy is paramount. LLM Hub: | ||
| - Processes data through secure, encrypted connections | ||
| - Does not store user inputs or outputs permanently | ||
| - Operates within Galaxy's established security framework | ||
| - Complies with European data protection standards | ||
arash77 marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| ## Looking Forward | ||
|
|
||
| LLM Hub represents just the beginning of Galaxy's AI integration journey. Future developments will include: | ||
| - Additional model providers and specialized models | ||
| - Enhanced multimodal capabilities | ||
| - Custom fine-tuning options for domain-specific tasks | ||
| - Advanced workflow templates for common use cases | ||
|
|
||
| ## Try It Now | ||
|
|
||
| LLM Hub is available immediately on [Galaxy Europe](https://usegalaxy.eu). Whether you're analyzing research data, processing documents, or exploring the capabilities of modern AI, LLM Hub provides the tools you need without the traditional barriers to entry. | ||
|
|
||
| <a href="https://usegalaxy.eu/root?tool_id=llm_hub"><button type="button" class="btn btn-success">Try LLM Hub on Galaxy Europe!</button></a> | ||
|
|
||
| Experience the power of large language models integrated into your scientific workflows - no API keys required, no payment setup needed, just powerful AI capabilities at your fingertips. | ||
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.