feat(AMD): support AMD GPUs (ROCm/HIP)#354

Open

RixinLiu wants to merge 8 commits into

mainfrom

amd-support-port

Commits on Jun 2, 2026

feat: support AMD GPUs (ROCm/HIP) via gpu_vmm abstraction

RixinLiu
and
claude
committed
feat(amd): accept hip device strings in sglang/vllm integration

RixinLiu
and
claude
committed

Commits on Jun 3, 2026

fix(amd): default to non-contiguous KV layout on ROCm

RixinLiu
and
claude
committed
test(amd): add e2e KV-cache elasticity-under-load test

RixinLiu
and
claude
committed
fix(sglang): version detection + refactored leak check (SGLang 0.4.9-0.5.12)

RixinLiu
and
claude
committed
style(test): annotate globals in test_elastic_serving for mypy

RixinLiu
and
claude
committed
fix(amd): address PR review comments

RixinLiu
and
claude
committed
fix(amd): normalize hip device strings to cuda before torch/c10 use

RixinLiu
and
claude
committed