Skip to content

Commit 5def5d7

Browse files
authored
Merge pull request #307 from kozistr/release/v3.3.0
[Release] v3.3.0
2 parents aee5fc4 + ccd683d commit 5def5d7

File tree

2 files changed

+8
-8
lines changed

2 files changed

+8
-8
lines changed

docs/changelogs/v3.3.0.md

+8
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,14 @@
1414
* Improve the stability of `ADOPT` optimizer. (#294)
1515
* [Note](https://github.com/iShohei220/adopt?tab=readme-ov-file#update-on-nov-22-2024)
1616
* Support a new projection type `random` for `GaLoreProjector`. (#294)
17+
* Implement `DeMo` optimizer. (#300, #301)
18+
* [Decoupled Momentum Optimization](https://arxiv.org/abs/2411.19870)
19+
* Implement `Muon` optimizer. (#302)
20+
* [MomentUm Orthogonalized by Newton-schulz](https://github.com/KellerJordan/Muon)
21+
* Implement `ScheduleFreeRAdam` optimizer. (#304)
22+
* Implement `LaProp` optimizer. (#304)
23+
* [Separating Momentum and Adaptivity in Adam](https://arxiv.org/abs/2002.04839)
24+
* Support `Cautious` variant to `LaProp`, `AdamP`, `Adopt` optimizers. (#304).
1725

1826
### Refactor
1927

docs/changelogs/v3.3.1.md

-8
Original file line numberDiff line numberDiff line change
@@ -2,11 +2,3 @@
22

33
### Feature
44

5-
* Implement `DeMo` optimizer. (#300, #301)
6-
* [Decoupled Momentum Optimization](https://arxiv.org/abs/2411.19870)
7-
* Implement `Muon` optimizer. (#302)
8-
* [MomentUm Orthogonalized by Newton-schulz](https://github.com/KellerJordan/Muon)
9-
* Implement `ScheduleFreeRAdam` optimizer. (#304)
10-
* Implement `LaProp` optimizer. (#304)
11-
* [Separating Momentum and Adaptivity in Adam](https://arxiv.org/abs/2002.04839)
12-
* Support `Cautious` variant to `LaProp`, `AdamP`, `Adopt` optimizers. (#304).

0 commit comments

Comments
 (0)