Visualization Rastrigin AccSGD AdaBelief AdaBound AdaDelta AdaFactor AdaGC AdaHessian Adai Adalite Adam AdaMax AdamG AdamMini AdaMod AdamP AdamS AdamW Adan AdaNorm AdaPNM AdaShift AdaSmooth AdaTAM AdEMAMix ADOPT AggMo Aida AliG Amos APOLLO ApolloDQN ASGD AvaGrad BSAM CAME DAdaptAdaGrad DAdaptAdam DAdaptAdan DAdaptLion DAdaptSGD DiffGrad EXAdam FAdam FOCUS Fromage FTRL GaLore Grams Gravity GrokFastAdamW Kate Kron Lamb LaProp LARS Lion MADGRAD MARS MSVAG Nero NovoGrad PAdam PID PNM Prodigy QHAdam QHM RAdam Ranger Ranger21 Ranger25 ScalableShampoo ScheduleFreeAdamW ScheduleFreeRAdam ScheduleFreeSGD SCION SGD SGDP SGDSaI SGDW Shampoo SignSGD SimplifiedAdEMAMix SM3 SOAP SophiaH SPAM SRMM StableAdamW StableSPAM SWATS TAM Tiger Yogi Rosenbrock AccSGD AdaBelief AdaBound AdaDelta AdaFactor AdaGC AdaHessian Adai Adalite Adam AdaMax AdamG AdamMini AdaMod AdamP AdamS AdamW Adan AdaNorm AdaPNM AdaShift AdaSmooth AdaTAM AdEMAMix ADOPT AggMo Aida AliG Amos APOLLO ApolloDQN ASGD AvaGrad BSAM CAME DAdaptAdaGrad DAdaptAdam DAdaptAdan DAdaptLion DAdaptSGD DiffGrad EXAdam FAdam FOCUS Fromage FTRL GaLore Grams Gravity GrokFastAdamW Kate Kron Lamb LaProp LARS Lion MADGRAD MARS MSVAG Nero NovoGrad PAdam PID PNM Prodigy QHAdam QHM RAdam Ranger Ranger21 Ranger25 ScalableShampoo ScheduleFreeAdamW ScheduleFreeRAdam ScheduleFreeSGD SCION SGD SGDP SGDSaI SGDW Shampoo SignSGD SimplifiedAdEMAMix SM3 SOAP SophiaH SPAM SRMM StableAdamW StableSPAM SWATS TAM Tiger Yogi
