Version v0.1.11rc3 Release Today!

[ver217]

What's Changed

Release

• [release] update version ([release] update version #1931) by ver217

Tutorial

• [tutorial] polish README and OPT files ([tutorial] polish README and OPT files #1930) by binmakeswell
• [tutorial] add synthetic dataset for opt ([tutorial] add synthetic dataset for opt #1924) by ver217
• [tutorial] updated hybrid parallel readme ([tutorial] updated hybrid parallel readme #1928) by Frank Lee
• [tutorial] added synthetic data for sequence parallel ([tutorial] added synthetic data for sequence parallel #1927) by Frank Lee
• [tutorial] removed huggingface model warning ([tutorial] removed huggingface model warning #1925) by Frank Lee
• Hotfix/tutorial readme index (Hotfix/tutorial readme index #1922) by Frank Lee
• [tutorial] modify hands-on of auto activation checkpoint ([tutorial] modify hands-on of auto activation checkpoint #1920) by Boyuan Yao
• [tutorial] added synthetic data for hybrid parallel ([tutorial] added synthetic data for hybrid parallel #1921) by Frank Lee
• [tutorial] added synthetic data for hybrid parallel ([tutorial] added synthetic data for hybrid parallel #1919) by Frank Lee
• [tutorial] added synthetic dataset for auto parallel demo ([tutorial] added synthetic dataset for auto parallel demo #1918) by Frank Lee
• [tutorial] updated auto parallel demo with latest data path ([tutorial] updated auto parallel demo with latest data path #1917) by Frank Lee
• [tutorial] added data script and updated readme ([tutorial] added data script and updated readme #1916) by Frank Lee
• [tutorial] add cifar10 for diffusion ([tutorial] add cifar10 for diffusion #1907) by binmakeswell
• [tutorial] removed duplicated tutorials ([tutorial] removed duplicated tutorials #1904) by Frank Lee
• [tutorial] edited hands-on practices ([tutorial] edited hands-on practices #1899) by BoxiangW

Example

• [example] update auto_parallel img path ([example] update auto_parallel img path #1910) by binmakeswell
• [example] add cifar10 dadaset for diffusion ([example] add cifar10 dadaset for diffusion #1902) by Fazzie-Maqianli
• [example] migrate diffusion and auto_parallel hands-on ([example] migrate diffusion and auto_parallel hands-on #1871) by binmakeswell
• [example] initialize tutorial ([example] initialize tutorial #1865) by binmakeswell
• Merge pull request [example] polish diffusion readme #1842 from feifeibear/jiarui/polish by Fazzie-Maqianli
• [example] polish diffusion readme by jiaruifang

Sc

• [SC] add GPT example for auto checkpoint ([SC] add GPT example for auto checkpoint #1889) by Boyuan Yao
• [sc] add examples for auto checkpoint. ([sc] add examples for auto checkpoint. #1880) by Super Daniel

Nfc

• [NFC] polish colossalai/amp/naive_amp/init.py code style ([NFC] polish colossalai/amp/naive_amp/__init__.py code style #1905) by Junming Wu
• [NFC] remove redundant dependency ([NFC] remove redundant dependency #1869) by binmakeswell
• [NFC] polish .github/workflows/scripts/build_colossalai_wheel.py code style ([NFC] polish .github/workflows/scripts/build_colossalai_wheel.py code… #1856) by yuxuan-lou
• [NFC] polish .github/workflows/scripts/generate_release_draft.py code style ([NFC] polish generate_release_draft.py code #1855) by Ofey Chan
• [NFC] polish workflows code style ([NFC] polish workflows code style #1854) by Kai Wang (Victor Kai)
• [NFC] polish colossalai/amp/apex_amp/init.py code style ([NFC] polish colossalai/amp/apex_amp/__init__.py code style #1853) by LuGY
• [NFC] polish .readthedocs.yaml code style ([NFC] polish .readthedocs.yaml code style #1852) by nuszzh
• [NFC] polish <.github/workflows/release_nightly.yml> code style ([NFC] polish .github/workflows/release_nightly.yml code style #1851) by RichardoLuo
• [NFC] polish amp.naive_amp.grad_scaler code style by zbian
• [NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py code style ([NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_hand… #1845) by HELSON
• [NFC] polish ./colossalai/amp/torch_amp/init.py code style ([NFC] polish ./colossalai/amp/torch_amp/__init__.py code style #1836) by Genghan Zhang
• [NFC] polish .github/workflows/build.yml code style ([NFC] polish .github/workflows/build.yml code style #1837) by xyupeng
• [NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py code style ([NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_hand… #1829) by Sze-qq
• [NFC] polish colossalai/amp/torch_amp/_grad_scaler.py code style ([NFC] polish colossalai/amp/torch_amp/_grad_scaler.py code style #1823) by Ziyue Jiang
• [NFC] polish .github/workflows/release_docker.yml code style by Maruyama_Aya
• [NFC] polish .github/workflows/submodule.yml code style ([NFC] polish .github/workflows/submodule.yml code style #1822) by shenggan
• [NFC] polish .github/workflows/draft_github_release_post.yml code style ([NFC] polish .github/workflows/draft_github_release_post.yml code style #1820) by Arsmart1
• [NFC] polish colossalai/amp/naive_amp/_fp16_optimizer.py code style ([NFC] polish colossalai/amp/naive_amp/_fp16_optimizer.py code style #1819) by Fazzie-Maqianli
• [NFC] polish colossalai/amp/naive_amp/_utils.py code style ([NFC] polish colossalai/amp/naive_amp/_utils.py code style #1816) by CsRic
• [NFC] polish .github/workflows/build_gpu_8.yml code style ([NFC] polish .github/workflows/build_gpu_8.yml code style #1813) by Zangwei Zheng
• [NFC] polish MANIFEST.in code style ([NFC] polish MANIFEST.in code style #1814) by Zirui Zhu
• [NFC] polish strategies_constructor.py code style ([NFC] polish strategies_constructor.py code style #1806) by binmakeswell

Doc

• [doc] add news ([doc] add news #1901) by binmakeswell

Zero

• [zero] migrate zero1&2 ([zero] migrate zero1&2  #1878) by HELSON

Autoparallel

• [autoparallel] user-friendly API for CheckpointSolver. ([autoparallel] user-friendly API for CheckpointSolver. #1879) by Super Daniel
• [autoparallel] fix linear logical convert issue ([autoparallel] fix linear logical convert issue #1857) by YuliangLiu0306

Fx

• [fx] metainfo_trace as an API. ([fx] metainfo_trace as an API. #1873) by Super Daniel

Hotfix

• [hotfix] pass test_complete_workflow ([hotfix] pass test_complete_workflow #1877) by Jiarui Fang

Inference

• [inference] overlap comm and compute in Linear1D_Row when stream_chunk_num > 1 ([inference] overlap comm and compute in Linear1D_Row when stream_chunk_num > 1 #1876) by Jiarui Fang
• [inference] streaming Linear 1D Row inference ([inference] streaming Linear 1D Row inference #1874) by Jiarui Fang

Amp

• [amp] add torch amp test ([amp] add torch amp test #1860) by xcnick

Diffusion

• [diffusion] fix package conflicts ([diffusion] fix package conflicts #1875) by HELSON

Utils

• [utils] fixed lazy init context ([utils] fixed lazy init context #1867) by Frank Lee
• [utils] remove lazy_memory_allocate from ColoInitContext ([utils] remove lazy_memory_allocate from ColoInitContext #1844) by Jiarui Fang

Full Changelog: v0.1.11rc3...v0.1.11rc2

---

This discussion was created from the release Version v0.1.11rc3 Release Today!.

[mosesojero]

Update

[JoeTorrey]

New to this but would like to know and learn more about it very interested

[noradeebabe]

Good

[noradeebabe]

Ok