BentoML

All

106 repositories

helm-charts
Public
0•0•0•0•Updated Dec 31, 2024Dec 31, 2024
yatai-image-builder
Public
🐳 Build OCI images for Bentos in k8s
docker docker-image container container-image kubernetes k8s
Go
•10•15•4•7•Updated Dec 31, 2024Dec 31, 2024
comfy-pack
Public
A comprehensive toolkit for reliably locking, packing and deploying environments for ComfyUI workflows.
ai-art comfyui genai comfyui-manager comfyui-workflow comfyui-nodes comfyui-api
Python
•
Apache License 2.0
•9•74•3•1•Updated Dec 31, 2024Dec 31, 2024
BentoVLLM
Public
Self-host LLMs with vLLM and BentoML
Python
•12•79•4•2•Updated Dec 31, 2024Dec 31, 2024
openllm-models
Public
Python
•9•20•1•1•Updated Dec 27, 2024Dec 27, 2024
BentoML
Public
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
python machine-learning deep-learning model-serving multimodal mlops ml-engineering ai-inference llm generative-ai
Python
•
Apache License 2.0
•798•7.2k•152•10•Updated Dec 27, 2024Dec 27, 2024
kantoku
Public
A Process & Socket Manager built with zmq
Python
•
Other
•257•0•0•0•Updated Dec 26, 2024Dec 26, 2024
BentoXGBoost
Public
Python
•0•0•0•0•Updated Dec 26, 2024Dec 26, 2024
BentoGradio
Public
Python
•0•0•0•0•Updated Dec 26, 2024Dec 26, 2024
BentoMLflow
Public
Python
•0•0•0•0•Updated Dec 26, 2024Dec 26, 2024
BentoLMDeploy
Public
Self-host LLMs with LMDeploy and BentoML
Python
•2•17•1•0•Updated Dec 25, 2024Dec 25, 2024
BentoBLIP
Public
how to build an image captioning application on top of a BLIP model with BentoML
Python
•2•3•0•2•Updated Dec 24, 2024Dec 24, 2024
OpenLLM
Public
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
llama mistral fine-tuning mlops bentoml vicuna llm model-inference llmops llm-serving
Python
•
Apache License 2.0
•654•10k•19•0•Updated Dec 24, 2024Dec 24, 2024
BentoSGLang
Public
Python
•1•1•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoCLIP
Public
building a CLIP application using BentoML
Python
•2•8•0•2•Updated Dec 23, 2024Dec 23, 2024
BentoSentenceTransformers
Public
how to build a sentence embedding application using BentoML
Python
•2•6•0•1•Updated Dec 23, 2024Dec 23, 2024
BentoWhisperX
Public
Python
•5•11•0•8•Updated Dec 23, 2024Dec 23, 2024
BentoXTTS
Public
how to build an text-to-speech application using BentoML
Python
•2•5•1•3•Updated Dec 23, 2024Dec 23, 2024
BentoFunctionCalling
Public
Python
•1•5•0•1•Updated Dec 23, 2024Dec 23, 2024
BentoTGI
Public
Python
•1•1•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoMLCLLM
Public
Python
•1•2•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoTRTLLM
Public
Python
•1•9•2•0•Updated Dec 23, 2024Dec 23, 2024
BentoDiffusion
Public
BentoDiffusion: A collection of diffusion models served with BentoML
kubernetes ai lora model-serving fine-tuning diffusion-models stable-diffusion
Python
•
Apache License 2.0
•25•342•9•1•Updated Dec 23, 2024Dec 23, 2024
BentoMoirai
Public
Python
•0•2•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoColPali
Public
Python
•0•10•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoResnet
Public
Python
•2•3•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoYolo
Public
BentoML service of YOLO v8
Python
•
Apache License 2.0
•1•6•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoMoshi
Public
Python
•
Apache License 2.0
•1•1•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoBark
Public
Python
•0•4•0•1•Updated Dec 23, 2024Dec 23, 2024
BentoXTTSStreaming
Public
xtts with streaming endpoint
Python
•0•2•0•0•Updated Dec 23, 2024Dec 23, 2024