Deepseek Engram optimization.#1147

Open

LiJunscs wants to merge 16 commits intoflagos-ai:mainfrom

LiJunscs:deepseek_related

Commits on Mar 13, 2026

Commits on Mar 16, 2026

[train]: fix: fix some corner case of engram.
LiJunscs
committed

Commits on Mar 17, 2026

Merge branch 'main' into deepseek_related
zhaoyinglia
authored

Commits on Mar 21, 2026

[train]: fix: fix the bug of engram loss when embedding with a new optimizer.
LiJunscs
committed
Merge remote-tracking branch 'origin/deepseek_related' into optimize_engram
LiJunscs
committed

Commits on Mar 24, 2026

[train]: fix: fix bug of log param norm of engram.
LiJunscs
committed

Commits on Mar 30, 2026

[train]: feat: update the offload logic of engram, allow both parallel and offload to be enabled simultaneously.
LiJunscs
committed