feat(lora): add native Qwen3 dense and MoE policy runtime - #488

Merged

xsuler merged 29 commits into

inclusionAI:mainfrom

indevn:codex/qwen-lora-pr-replay-v1

Aug 27, 2026

Commits on Aug 26, 2026

feat(lora): add native Qwen3 policy runtime
indevn
committed
3e36909
test(lora): cover Qwen3 train-rollout PEFT loop
indevn
committed
74636b9
feat(lora): reuse actor base for reference scoring
indevn
committed
3c18f93
fix(lora): tighten reference replay boundaries
indevn
committed
914edf4
fix(runtime): preserve autograd across role onload
indevn
committed
53df820
test(lora): cover two-step PPO DPO reference view
indevn
committed
4dc1cab
feat(lora): sync adapters to independent rollout engines
indevn
committed
7c1048f
test(lora): model authoritative replicated publisher
indevn
committed
f0c3fd5
test(lora): cover independent rollout adapter sync
indevn
committed
e408343
feat(lora): support replicated KV adapters
indevn
committed
39c97d2
test(runtime): report sequence parallel train metric
indevn
committed
83a135c
feat(lora): add Bailing Tiny V3 native targets
indevn
committed
6d625e3
style(lora): order Bailing test imports
indevn
committed
2865aad
docs(lora): generalize target option help
indevn
committed
1367b9c
fix(attention): trim padded native decode values
indevn
committed
234f9ac
feat(lora): complete Bailing native adapter contracts
indevn
committed
c632796
fix(lora): correct replicated norm and base metadata
indevn
committed
a56409f
test(serve): capture adapter base reference
indevn
committed
26e5cf2
fix(peft): expose stable base model reference
indevn
committed
2b239cb
style(tests): format Bailing LoRA coverage
indevn
committed
c99a405
perf(lora): optimize Bailing routed rollout

indevn
authored and
xsuler
committed
c20e871
perf(lora): offload merged Bailing expert train weights

indevn
authored and
xsuler
committed
cef13f4
perf(lora): optimize Bailing KDA A projections

indevn
authored and
xsuler
committed
afb3657
test: stub CUDA linear in KDA packing oracle

indevn
authored and
xsuler
committed
cc15059
fix(lora): align rebased tests with CUDA backend API

indevn
authored and
xsuler
committed
3f7e336
docs(lora): document native adapter workflows
xsuler
committed
bbc59ef
test(lora): isolate optional CPU dependencies
xsuler
committed
0bb83fe

Commits on Aug 27, 2026

test(lora): stub Triton CPU imports
xsuler
committed
ec24a68
test(lora): complete CPU kernel stubs
xsuler
committed
5cb320f

Navigation Menu

Uh oh!

feat(lora): add native Qwen3 dense and MoE policy runtime - #488

feat(lora): add native Qwen3 dense and MoE policy runtime#488
xsuler merged 29 commits into
inclusionAI:mainfrom
indevn:codex/qwen-lora-pr-replay-v1

Commits on Aug 26, 2026

feat(lora): add native Qwen3 policy runtime

test(lora): cover Qwen3 train-rollout PEFT loop

feat(lora): reuse actor base for reference scoring

fix(lora): tighten reference replay boundaries

fix(runtime): preserve autograd across role onload

test(lora): cover two-step PPO DPO reference view

feat(lora): sync adapters to independent rollout engines

test(lora): model authoritative replicated publisher

test(lora): cover independent rollout adapter sync

feat(lora): support replicated KV adapters

test(runtime): report sequence parallel train metric

feat(lora): add Bailing Tiny V3 native targets

style(lora): order Bailing test imports

docs(lora): generalize target option help

fix(attention): trim padded native decode values

feat(lora): complete Bailing native adapter contracts

fix(lora): correct replicated norm and base metadata

test(serve): capture adapter base reference

fix(peft): expose stable base model reference

style(tests): format Bailing LoRA coverage

perf(lora): optimize Bailing routed rollout

perf(lora): offload merged Bailing expert train weights

perf(lora): optimize Bailing KDA A projections

test: stub CUDA linear in KDA packing oracle

fix(lora): align rebased tests with CUDA backend API

docs(lora): document native adapter workflows

test(lora): isolate optional CPU dependencies

Commits on Aug 27, 2026

test(lora): stub Triton CPU imports

test(lora): complete CPU kernel stubs