Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
17a9d33
[INITIAL] Submit reviewed MLX foundation, GGUF empty-context fix, DFl…
mergennachin Nov 20, 2026
7f19a62
[INITIAL] Submit reviewed MLX foundation, GGUF empty-context fix, DFl…
mergennachin Nov 20, 2026
7d151c0
[INITIAL] Submit reviewed MLX foundation, GGUF empty-context fix, DFl…
mergennachin Nov 20, 2026
c5ea2a2
[INITIAL] Submit reviewed MLX foundation, GGUF empty-context fix, DFl…
mergennachin Nov 20, 2026
5af9907
[INITIAL] Update
mergennachin Nov 20, 2026
a0865d8
[UPDATE] Address DFlash2 review feedback and add routing regression c…
mergennachin Nov 20, 2026
c856627
[UPDATE] Address DFlash2 review feedback and add routing regression c…
mergennachin Nov 20, 2026
a785e4e
[UPDATE] Fix CI lint, preserve MLX runtime exports in shared builds a…
mergennachin Nov 20, 2026
d96c545
[UPDATE] Fix CI lint, preserve MLX runtime exports in shared builds a…
mergennachin Nov 20, 2026
aa11aaa
[UPDATE] Fix CI lint, preserve MLX runtime exports in shared builds a…
mergennachin Nov 20, 2026
c81c667
[UPDATE] Fix CI lint, preserve MLX runtime exports in shared builds a…
mergennachin Nov 20, 2026
e22879b
[UPDATE] Fix CI lint, preserve MLX runtime exports in shared builds a…
mergennachin Nov 20, 2026
5bca98d
[UPDATE] Rebase the open stack after its foundation merged and save t…
mergennachin Nov 21, 2026
d5deba0
[UPDATE] Rebase the open stack after its foundation merged and save t…
mergennachin Nov 21, 2026
8815e5e
[UPDATE] Rebase the open stack after its foundation merged and save t…
mergennachin Nov 21, 2026
089cb37
[INITIAL] Rebase the open stack after its foundation merged and save …
mergennachin Nov 21, 2026
737b243
[UPDATE] Address the three review comments on #25336: package dflash2…
mergennachin Nov 21, 2026
8b1f12e
[UPDATE] Address the three review comments on #25336: package dflash2…
mergennachin Nov 21, 2026
29ab624
[UPDATE] Address the three review comments on #25336: package dflash2…
mergennachin Nov 21, 2026
fc68946
[UPDATE] Update
mergennachin Nov 21, 2026
704bbb4
[UPDATE] Update
mergennachin Nov 21, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 14 additions & 0 deletions backends/mlx/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -91,6 +91,20 @@ lists, graph dumps, per-node support decisions, and serialization details:
ET_MLX_DEBUG=1 python -m executorch.backends.mlx.examples.llm.export_llm_hf ...
```

### Experimental decode fusions

`ET_MLX_FUSE_GATES=1` experimentally fuses FP16 SwiGLU and sigmoid gating while
retaining native MLX matmuls and FP16 rounding boundaries. It supports strided
inputs; shared activation outputs and broadcasting retain their existing paths.

Additional opt-in fusions are `ET_MLX_FUSE_ROPE=1` (FP32 rotation around FP16
activations), `ET_MLX_FUSE_NORM_ADD=1` (FP16 RMSNorm and residual addition), and
`ET_MLX_FUSE_SOFT_CAP=1` (FP32 logit soft cap). Muse Glimmer's MLX DFlash export
also accepts `ET_MLX_SHARE_ROPE_PHASE=1` to share identical RoPE phase calculations.
These preserve the native quantized matmuls and remain disabled by default.
See the [saved M5 measurements](benchmarks/native_decode_fusions.md) for results
and validation limits.

---

## Directory Layout
Expand Down
Loading
Loading