feat: Support Linear Cross Entropy fuse kernel#1322

Open

TaoZex wants to merge 34 commits into

areal-project:mainfrom

Commits on May 8, 2026

feat(engine): LinearCrossEntropy
bingyechen
committed
fix(kernel): continus
bingyechen
committed
test(linear_cross_entropy): add test for tp > 1
bingyechen
committed
test(linear_cross_entropy): log test
bingyechen
committed
refactor(test): remove useless test code
bingyechen
committed
perf: NVTX
bingyechen
committed
feat(config): add use_fused_linear_ce config
bingyechen
committed
fix(utils): network
bingyechen
committed
feat(profiling):nsys flush
bingyechen
committed
fix(engine): fix
bingyechen
committed
feat(profiler): torch profile
bingyechen
committed
fix(sequence_parallel): fix sp
bingyechen
committed
fix(engine): dtype
bingyechen
committed
fix(engine): dtype again
bingyechen
committed

Commits on May 9, 2026

test(linear_cross_entropy): fix test
bingyechen
committed
perf(benchmark): benchmark
bingyechen
committed
refactor(fsdp): remove useless
bingyechen
committed
refactor: remove test profile
bingyechen
committed
refactor(kernel): fix
bingyechen
committed

Commits on May 10, 2026

fix(kernel): fix code
bingyechen
committed
refactor(kernel): fix
bingyechen
committed
refactor(kernel): remove useless
bingyechen
committed
refactor(kernel): comment
bingyechen
committed
docs(kernels): fix
bingyechen
committed
feat(test): fix
bingyechen
committed
fix(engine): fix
bingyechen
committed
fix(megatron): fix vocab
bingyechen
committed
feat(engine): fix conflict
bingyechen
committed
Merge branch 'main' into lm
TaoZex
authored
Merge branch 'main' into lm
TaoZex
authored
feat: precommit fix
root
committed

Commits on May 14, 2026