Skip to content

Enable compact sliding-window attention for Gemma 3 and Gemma 4 variants - #496

Draft
ani300 wants to merge 5 commits into
torch-spyre:mainfrom
ani300:gemma4-swa-op
Draft

Enable compact sliding-window attention for Gemma 3 and Gemma 4 variants#496
ani300 wants to merge 5 commits into
torch-spyre:mainfrom
ani300:gemma4-swa-op

Commits

Commits on Sep 10, 2026