Skip to content

Add RayService extra dependency example #4362

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Blaze-DSP wants to merge 2 commits into
base: master
Choose a base branch
from
Open

Add RayService extra dependency example #4362

Changes from 1 commit
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
0654d28
RayService Extra Dependencies
Jan 11, 2026
8401525
quoting and example config updates
Jan 12, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
78 changes: 78 additions & 0 deletions ray-operator/config/samples/ray-serve.extra-dependency.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,78 @@
apiVersion: ray.io/v1
kind: RayService
metadata:
name: ray-serve-extra-dependency
spec:
serveConfigV2: |
applications:
- name: app
import_path: image_processor:app
route_prefix: "/"
# Application-specific dependencies via runtime_env
# These packages are only installed for this specific application
runtime_env:
pip:
- pandas>=2.0.0
- scikit-learn>=1.3.0
rayClusterConfig:
rayVersion: "2.53.0"
headGroupSpec:
rayStartParams:
num-cpus: "0"
dashboard-host: "0.0.0.0"
template:
spec:
containers:
- name: ray-head
image: rayproject/ray:2.53.0-py312-cu129-aarch64
ports:
- containerPort: 8000
name: serve
protocol: TCP
- containerPort: 8080
name: metrics
protocol: TCP
- containerPort: 6379
name: gcs
protocol: TCP
- containerPort: 8265
name: dashboard
protocol: TCP
- containerPort: 10001
name: client
protocol: TCP
resources:
limits:
cpu: 2
memory: 4Gi
requests:
cpu: 2
memory: 4Gi
Copy link
Contributor

@JiangJiaWei1103 JiangJiaWei1103 Jan 12, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for contributing. Would you mind standardizing the double quoting style? You can refer to #4339 and #4359.

Copy link
Contributor Author

@Blaze-DSP Blaze-DSP Jan 12, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done. Plus the example config has been updated, since there were issues with prv one

workerGroupSpecs:
- groupName: worker-group
replicas: 1
minReplicas: 1
maxReplicas: 2
rayStartParams: {}
template:
spec:
containers:
- name: ray-worker
image: rayproject/ray:2.53.0-py312-cu129-aarch64
# Shared dependencies via args
# System packages and pip packages installed here are accessible
# to ALL applications in this RayService
args:
- |
sudo apt-get update && \
sudo apt-get install -y --no-install-recommends \
ffmpeg libsm6 libxext6 && \
sudo rm -rf /var/lib/apt/lists/* && \
pip install opencv-python-headless pillow
resources:
limits:
cpu: 4
memory: 8Gi
requests:
cpu: 4
memory: 8Gi
Loading