Add PCCL-based DDP communication hook#4

Open

keshprad wants to merge 8 commits into

axonn-ai:pccl-ddpfrom

keshprad:pccl-ddp

Commits on Dec 9, 2024

fix: ensure non-zero learning rate during warmup at iteration 0
devin-ai-integration[bot]
committed
Merge pull request #578 from devin-open-source/devin/1733728337-fix-warmup-lr
karpathy
authored

Commits on Aug 28, 2025

Commits on Aug 29, 2025

updated scripts to use newer environment
keshprad
committed

Commits on Sep 20, 2025

updated experiment using 1.3B model and node-local NVMe storage for frontier scaling support
keshprad
committed

Commits on Sep 21, 2025

use bucket_cap_mb as parameter
keshprad
committed

Commits on Feb 19, 2026

Merge branch 'pccl-ddp' into pccl-ddp
keshprad
authored