Skip to content

feat(providers): add SambaNova as an OpenAI-compatible provider - #2

Open
snova-kwasia wants to merge 2 commits into
mainfrom
feat/sambanova-provider
Open

feat(providers): add SambaNova as an OpenAI-compatible provider#2
snova-kwasia wants to merge 2 commits into
mainfrom
feat/sambanova-provider

Conversation

@snova-kwasia

@snova-kwasia snova-kwasia commented Jul 31, 2026

Copy link
Copy Markdown
Owner

Why

OpenWorker should support SambaNova as a first-class model provider, enabling users to leverage SambaNova's fast inference for open-weight models like Llama 3.3 70B, Qwen Coder, and DeepSeek V3.

Root cause

SambaNova was not in the provider registry. Users wanting to use SambaNova models had no way to configure them through the UI.

Fix

Added SambaNova as an OpenAI-compatible provider by:

  • registry.py: Added a ProviderDescriptor via the existing _compat() helper with the SambaNova API endpoint (https://api.sambanova.ai/v1) and SAMBANOVA_API_KEY env var support
  • matrix.py: Added 4 curated model entries: Llama 3.3 70B, Qwen 2.5 Coder 32B, Llama 3.2 11B Vision, and DeepSeek V3 — with correct capability flags (vision model gets vision=True)
  • capabilities.py: Updated the capability heuristics to handle Llama-prefixed model names
  • logos.ts + sambanova.svg: Added the Sambanova logo to the provider gallery
  • ProviderSetup.tsx: Added the API key help link to cloud.sambanova.ai

Tests

  • ✅ Verified get_descriptor('sambanova') returns name, title, and needs_key=True
  • ✅ Verified matrix entries resolve with correct labels and capabilities
  • ✅ TypeScript compilation passes cleanly (tsc --noEmit with no errors)
  • ✅ 916 existing tests pass; 8 failures are pre-existing unrelated to this change (fake_slack, bedrock, web_search)

Confidence

High. The implementation follows the exact same pattern as all other OpenAI-compatible vendors (Together, Fireworks, OpenRouter, DeepSeek, etc.) using the _compat() helper. The changes are isolated to provider files and the GUI component wiring.

- Add SambanovaProvider via _compat() helper with OpenAI-compatible endpoint
- Add 4 curated model entries (Llama 3.3 70B, Qwen 2.5 Coder, Llama 3.2 Vision, DeepSeek V3)
- Update capabilities heuristics to handle Llama-prefixed model names
- Add Sambanova logo SVG and wire up in GUI provider gallery
- Add API key help link in ProviderSetup.tsx
@snova-kwasia
snova-kwasia marked this pull request as ready for review August 4, 2026 05:45
Models verified via GET /models endpoint:
- DeepSeek-V3.1 (131072 ctx)
- DeepSeek-V3.2 (32768 ctx)
- Meta-Llama-3.3-70B-Instruct (131072 ctx)
- MiniMax-M2.7 (196608 ctx)
- gemma-4-31B-it (131072 ctx)
- gpt-oss-120b (131072 ctx)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant