feat(kv-offload): in-process pegaflow KV-cache offload on Qwen3-4B#316

Merged

xiaguan merged 7 commits into

mainfrom

feat/pegaflow-kv-offload-qwen3

Jun 9, 2026

Commits on Jun 9, 2026

feat(kv-offload): add in-process pegaflow KV offload connector

xiaguan
and
claude
committed
feat(qwen3): wire async KV offload into the executor and scheduler

xiaguan
and
claude
committed
docs(runtime): document the pegaflow KV-offload integration

xiaguan
and
claude
committed
fix(qwen3): close two prefetch-lifecycle holes flagged in review

xiaguan
and
claude
committed
feat(server): expose KV offload + no-prefix-cache flags for L2 benchmarking

xiaguan
and
claude
committed
fix(qwen3): skip KV prefetch for echo requests

xiaguan
and
claude
committed
fix(qwen3): honor KV-offload flags on the LoRA startup path

xiaguan
and
claude
committed