Q4_K/Q6_K-direct CPU prefill + no-shims weights-immutability + kquant de-dup#171

Merged

chrishayuk merged 37 commits into

mainfrom

feat/quant-ternary-a8

Jun 21, 2026

Commits on Jun 20, 2026

refactor(compute): source attn/ffn tag→format mapping from from_registry_tag
chrishayuk
committed
feat(bitnet): W1.58·A8 ternary matvec (scalar + NEON), run BitNet forward on it
chrishayuk
committed
feat(models): recognise bitnet architecture explicitly
chrishayuk
committed
docs(roadmap): BitNet b1.58 integration hardening + G1–G4 follow-ups
chrishayuk
committed
feat(compute): add I2_S ternary QuantFormat + ternary_matvec dispatch (G1)
chrishayuk
committed
docs(roadmap): revise G2–G4 after scoping (G1 done; G2/G4 blocked; G3 falsified)
chrishayuk
committed
docs(roadmap): productization plan P-A/P-B/P-C for BitNet (decision: productize)
chrishayuk
committed
feat(cli): serve BitNet vindexes from `larql run` (P-A, CLI half)
chrishayuk
committed
docs(roadmap): P-A CLI behaviour-verified + B1 chosen with quant-path caveat
chrishayuk
committed
docs(roadmap): grounded P-B(B1a) execution stages anchored on ensure_attn_tensors_dequantised
chrishayuk
committed
docs(roadmap): lock P-B.1 scratch home = engine (concurrency evidence), not RwLock-in-ModelWeights
chrishayuk
committed
feat(models): engine-owned dequant resolver (WeightsView/DequantScratch) — P-B.1 foundation
chrishayuk
committed
refactor(models): WeightsView supports dense (no-scratch) callers — Copy + dense()/with_scratch()/From
chrishayuk
committed
refactor(forward): run_attention_with_kv_backend takes WeightsView; callers wrap dense() — P-B.1 Stage 1
chrishayuk
committed
refactor(ffn): dense_ffn_forward takes WeightsView; WeightFfn/BackendFfn wrap dense() internally — P-B.1 Stage 2a
chrishayuk
committed
docs(roadmap): P-B.1 signature stages done; Stage 2b loud-break design + entry conditions
chrishayuk
committed
refactor(forward): run_attention_block_decode_step_backend takes WeightsView — P-B.1 Stage 2b-pre
chrishayuk
committed
docs(roadmap): Stage 2b-pre done (3 readers + oracle); reader-family finding + loud-break safety
chrishayuk
committed
refactor(forward): convert the full attention-reader family to WeightsView — P-B.1 Stage 2b-pre2
chrishayuk
committed
refactor(vindex): relocate Q4K dequant to engine-local scratch — P-B.1 Stage 2b
chrishayuk
committed
docs(roadmap): P-B.1 done — attention-reader family converted + dequant relocated, oracle byte-identical
chrishayuk
committed
docs(roadmap): scope P-B.1b no-shims sweep + the two-kquant_forward finding (WIP stashed)
chrishayuk
committed
docs(roadmap): no-shims sweep convergence data (28→45→67 diverging) — staged refactor
chrishayuk
committed

Commits on Jun 21, 2026