optimizer & lr scheduler & loss function collections in PyTorch
deep-learning sam optimizer pytorch ranger muon loss-functions lookahead scion learning-rate-scheduling radam diffgrad gradient-centralization adamp adabelief madgrad adan adai ademamix
-
Updated
Jan 3, 2026 - Python