[executorch][cuda] fuse gate/up MLP projections #20482

Merged

Gasoonjia merged 3 commits into

mainfrom

gemma4_31b-cuda-decode-speedup

Jun 25, 2026

Commits on Jun 24, 2026

[gemma4_31b][cuda] Export Gemma4-31B @128k under 32 GB
Gasoonjia
committed

Commits on Jun 25, 2026

Fix TurboQuant KV zeroed by low-mem export (993cff58ae): _is_kv_buffer only frees genuinely all-zero kv_cache.* buffers (count_nonzero==0); preserves TQ4 centroids/boundaries/rotation/rotation_T
Gasoonjia
committed
[executorch][cuda] gemma4_31b: fuse gate/up MLP projections (default-on)
Gasoonjia
committed