|
| 1 | +--- |
| 2 | +slug: release-sb-v0.11 |
| 3 | +title: Releasing SuperBench v0.11 |
| 4 | +author: Peng Cheng |
| 5 | +author_title: SuperBench Team |
| 6 | +author_url: https://github.com/cp5555 |
| 7 | +author_image_url: https://github.com/cp5555.png |
| 8 | +tags: [superbench, announcement, release] |
| 9 | +--- |
| 10 | + |
| 11 | +We are very happy to announce that **SuperBench 0.11.0 version** is officially released today! |
| 12 | + |
| 13 | +You can install and try superbench by following [Getting Started Tutorial](https://microsoft.github.io/superbenchmark/docs/getting-started/installation). |
| 14 | + |
| 15 | +## SuperBench 0.11.0 Release Notes |
| 16 | + |
| 17 | +### SuperBench Improvements |
| 18 | + |
| 19 | +- Add CUDA 12.4 dockerfile. |
| 20 | +- Upgrade nccl version to v2.23.4 and install ucx v1.16.0 in cuda 12.4 dockefile. |
| 21 | +- Fix MSCCL build error in CUDA12.4 docker build pipeline. |
| 22 | +- Add ROCm6.2 dockerfile. |
| 23 | +- Update hpcx link in cuda11.1 dockerfile to fix docker build failure. |
| 24 | +- Improve document (Fix metrics name and typos in user tutorial, add BibTeX in README and repo). |
| 25 | +- Limit protobuf version to be 3.20.x to fix onnxruntime dependency error. |
| 26 | +- Update omegaconf version to 2.3.0 and fix issues caused by omegaconf version update. |
| 27 | +- Fix MSCCL build error in CUDA12.4 docker build pipeline. |
| 28 | +- Update Docker Exec Command for Persistent HPCX Environment. |
| 29 | +- Fix cuda 12.2 dockerfile LD_LIBRARY_PATH issue. |
| 30 | +- Use types-setuptools to replace types-pkg_resources. |
| 31 | +- Add configuration for NDv5 H100 and AMD MI300x. |
| 32 | + |
| 33 | +### Micro-benchmark Improvements |
| 34 | + |
| 35 | +- Add hipblasLt tuning to dist-inference cpp implementation. |
| 36 | +- Add support for NVIDIA L4/L40/L40s GPUs in gemm-flops. |
| 37 | +- Upgrade mlc to v3.11. |
| 38 | + |
| 39 | +## Model-benchmark Improvements |
| 40 | + |
| 41 | +- Support FP8 transformer model training in ROCm6.2 dockerfile. |
| 42 | + |
| 43 | +### Result Analysis |
| 44 | +- Fix bug of failure test and warning of pandas in data diagnosis. |
0 commit comments