A100

[slamdunk1002]

Hello, thank you for your excellent work.
When I use mjlab for training Tracking on the A100, the speed is extremely slow. In the same environment, it takes only 4.0 seconds for me to complete the iteration on the 4070TI, but it takes 20 seconds on the A100. Is this normal?

[slamdunk1002]

A100：
Collection time: 22.542s
Learning time: 0.150s
4070TI：
Collection time: 3.565s
Learning time: 0.302s

[kevinzakka]

This seems abnormal. Did you get any [WARNING] CUDA Graphs disabled: mempool disabled / driver X.Y < 12.4 warnings? That would explain it.