Announcing release v6.0.0
This release supports SN9's first multimodal competition.
Changes
-
Introducing the TTS competition starting with the E2TTS model from Microsoft. Activation block
5_177_981. -
Starting from the TTS activation block:
-- The TTS competition will be allocated 55% of the total emissions.
-- The 14B competition will take 30% of the emissions.
-- The remaining 15% of emissions will be allocated to the 3B competition. -
Some adjustments to epsilon decay rates and bounds starting from block
5_177_981. You can check the new values here:
https://github.com/macrocosm-os/pretraining/blob/8f1aff278c06402d2abb7fe36def9426c41b8ea6/constants/__init__.py#L152-L191
NOTES TO VALIDATORS
-Please also make sure to rerun pip install to ensure updated dependencies.
python -m pip install -e