Skip to content
Merged
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
144 changes: 144 additions & 0 deletions content/news/2025-09-02-llm-hub/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,144 @@
---
title: 'LLM Hub: Accessible Large Language Models for Everyone'
date: '2025-09-02'
tease: "Access powerful Large Language Models in Galaxy without API keys"
hide_tease: false
authors: Arash Kadkhodaei
subsites: [global, eu, us, freiburg]
tags: [tool, AI, LLM]
---

## LLM Hub: Accessible Large Language Models for Everyone

Large Language Models (LLMs) have revolutionized how we process and analyze text data, offering powerful capabilities for tasks ranging from content generation to complex reasoning. However, accessing these models often requires API keys, payment setups, and technical expertise that can be barriers for many researchers. Today, we're excited to introduce [LLM Hub](https://usegalaxy.eu/?tool_id=llm_hub) on Galaxy Europe - a tool that makes powerful AI models accessible to everyone without the need for personal API keys or payment information.

## What Makes LLM Hub Different?

Unlike traditional LLM access methods that require users to:
- Create accounts with AI providers
- Set up payment methods
- Manage API keys
- Handle rate limits and costs

LLM Hub provides **direct access** to a diverse collection of state-of-the-art language models through Galaxy's familiar interface. This represents a significant step forward in democratizing AI access for the research community.

## Available Models

LLM Hub offers access to a carefully curated selection of models, each optimized for different use cases. These models are currently hosted at the University of Freiburg and represent our initial offering.
This collection may expand in the future with additional models from various providers.

### Text Models

| Model | Provider | Description |
|-------|----------|-------------|
| **GPT-OSS-120B** | OpenAI | Best suited for complex tasks, deep reasoning, and detailed outputs |
| **GPT-OSS-20B** | OpenAI | Smooth for straightforward Q&A or text generation, efficient on small servers |
| **Qwen3-30B-A3B** | Alibaba Cloud | Strong all-rounder for technical tasks, coding, and long structured outputs |
| **DeepSeek-R1-0528-Qwen3-8B** | DeepSeek | Fast and efficient for general reasoning and straightforward problem-solving |
| **Meta-Llama-3.1-8B-Instruct** | Meta AI | Lightweight and responsive, suitable for simpler tasks and fast prompt execution |
| **Mistral-Small-3.2-24B** | Mistral AI | Balanced accuracy and speed, good for drafting documents and structured outputs |
| **Magistral-Small** | Mistral AI | Quick and lightweight text generation, best when speed and cost matter most |

### Multimodal Models

| Model | Provider | Description |
|-------|----------|-------------|
| **Gemma-3-12B** | Google DeepMind | Handles text + images, great for describing photos, diagrams, or screenshots |
| **Qwen2.5-VL-7B** | Alibaba Cloud | Budget-friendly image understanding, extract info from charts, UIs, or screenshots |

### Image Models

| Model | Provider | Description |
|-------|----------|-------------|
| **NuMarkdown-8B-Thinking** | NuMind | Advanced OCR and document understanding, excels at extracting structured data from scanned images |

## Key Features

### Multiple Input Types
LLM Hub supports various input formats depending on the model type:
- **Text files** (TXT, HTML, JSON) for text-based analysis
- **Images** (JPG, PNG, GIF, TIFF, BMP) for visual understanding
- **Combined inputs** for multimodal analysis

### Workflow Integration
As with all Galaxy tools, LLM Hub seamlessly integrates into larger analytical workflows. You can:
- Process data with other Galaxy tools before LLM analysis
- Use LLM outputs as inputs for downstream analysis
- Create reproducible workflows combining traditional data processing with AI capabilities
- Share complete analytical pipelines with colleagues

### Use Cases

The versatility of LLM Hub makes it suitable for numerous research applications:

**Text Analysis & Processing:**
- Summarize research papers or documents
- Extract key information from unstructured text
- Translate content between languages
- Perform sentiment analysis on social media data
- Generate structured data from free-form text

**Image & Document Analysis:**
- Extract text from scanned documents (OCR)
- Analyze charts, graphs, and diagrams
- Describe scientific images or experimental results
- Process screenshots of interfaces or applications

**Research & Development:**
- Generate code snippets for data analysis
- Create documentation and explanations
- Brainstorm research ideas and approaches
- Draft grant proposals or research summaries

**Educational Applications:**
- Create learning materials and explanations
- Generate quiz questions from course content
- Provide detailed explanations of complex concepts
- Assist with academic writing and editing

## Getting Started

Using LLM Hub is straightforward:

1. **Navigate to Galaxy Europe** and search for "LLM Hub" in the tool panel
2. **Select your model type** based on your input data (text, image, or multimodal)
3. **Choose the appropriate model** for your task complexity and requirements
4. **Upload your context data** (optional) - this can be text files, images, or both
5. **Enter your prompt** describing the task you want the LLM to perform
6. **Run the tool** and receive your results in Markdown format

The tool's intelligent interface guides you through the selection process, ensuring you choose the right model for your specific needs.

## Technical Implementation

LLM Hub leverages LiteLLM proxy technology to provide seamless access to multiple AI providers through a unified interface. This architecture ensures:
- **Reliability**: Automatic failover and retry mechanisms
- **Performance**: Optimized routing to the best available endpoints
- **Scalability**: Dynamic load balancing across multiple providers
- **Consistency**: Standardized API interface regardless of the underlying model

The tool is built with robust error handling and provides clear feedback when models are temporarily unavailable or experiencing high demand.

## Privacy and Data Security

Your data privacy is paramount. LLM Hub:
- Processes data through secure, encrypted connections
- Does not store user inputs or outputs permanently
- Operates within Galaxy's established security framework
- Complies with European data protection standards

## Looking Forward

LLM Hub represents just the beginning of Galaxy's AI integration journey. Future developments will include:
- Additional model providers and specialized models
- Enhanced multimodal capabilities
- Custom fine-tuning options for domain-specific tasks
- Advanced workflow templates for common use cases

## Try It Now

LLM Hub is available immediately on [Galaxy Europe](https://usegalaxy.eu). Whether you're analyzing research data, processing documents, or exploring the capabilities of modern AI, LLM Hub provides the tools you need without the traditional barriers to entry.

<a href="https://usegalaxy.eu/root?tool_id=llm_hub"><button type="button" class="btn btn-success">Try LLM Hub on Galaxy Europe!</button></a>

Experience the power of large language models integrated into your scientific workflows - no API keys required, no payment setup needed, just powerful AI capabilities at your fingertips.
Loading