Skip to content

gemma4_31b (MLX): don't allocate a second KV-cache copy for single-session runs#20560

Open
metascroy wants to merge 1 commit into
mainfrom
fix-mem-perf-regression
Open

gemma4_31b (MLX): don't allocate a second KV-cache copy for single-session runs#20560
metascroy wants to merge 1 commit into
mainfrom
fix-mem-perf-regression

Commits

Commits on Jun 27, 2026