feat: MLA absorption for DeepSeek V2/V3 — fuse low-rank Q/K/V into standard dense tensors#96

Merged

chrishayuk merged 5 commits into

chrishayuk:mainfrom

mvkorobkov:main

May 24, 2026

Commits on May 14, 2026

feat(gqa): add gqa_attention_asym for MLA-absorbed asymmetric head dims
Mykhailo Korobkov
committed

Commits on May 23, 2026

fix(gguf): map deepseek_v4/deepseekv4 arch string to DeepSeekV4Arch
Mykhailo Korobkov
committed
feat(mla): add qk_nope/rope/v_head_dim fields for DS-V3 MLA absorption
Mykhailo Korobkov
committed
feat(vindex): MLA absorption — fuse DS-V3 low-rank Q/K/V into dense weight matrices
Mykhailo Korobkov
committed

Commits on May 24, 2026

feat(vindex): wire MLA absorption into f32 weight writer

Mykhailo Korobkov
authored and
chrishayuk
committed