Feat/low bit ep#1336

Draft

JiaoliangYu wants to merge 13 commits into

ROCm:jly/low-bit-epfrom

JiaoliangYu:feat/mori-fp8-dispatch-clean

Commits on Jun 17, 2026

feat: env-gated per-rank CPU/NUMA pinning for workers

JiaoliangYu
and
claude
committed
cpu affinity
JiaoliangYu
committed
Merge pull request #1250 from JiaoliangYu/feat/cpu-affinity-per-rank
JiaoliangYu
authored
resolve confict
JiaoliangYu
committed
ci: lock GPU clock to 2400MHz (determinism) during benchmarks

JiaoliangYu
and
claude
committed
sync base from container 0926941f (moe.py + mori_prepare_finalize.py)
JiaoliangYu
committed
feat: env-gated MXFP8 fp8 dispatch (MORI_FP8_DISPATCH)
JiaoliangYu
committed

Commits on Jun 24, 2026

feat: env-gated MXFP8 fp8 dispatch (MORI_FP8_DISPATCH), sync EP path only
JiaoliangYu
committed
exp: env-gated balanced round-robin routing (MORI_FORCE_BALANCED_ROUTING)
JiaoliangYu
committed
exp: fp8 cast-dispatch (MORI_FP8_DISPATCH_CAST) - measure dispatch kernel, cast back to bf16 for GEMM
JiaoliangYu
committed
exp: gate fp8 dispatch on env only (DSv4 quant_dtype=None so is_fp8 False)
JiaoliangYu
committed
exp: adapt async/TBO fp8 dispatch to MXFP8 per_1x32+e8m0 (EP+TBO support)
JiaoliangYu
committed
Merge branch 'feat/mori-fp8-dispatch' into feat/mori-fp8-dispatch-clean
JiaoliangYu
committed