Yogi Optimizer | 2024 |
Yogi won't replace Adam everywhere, but it's an excellent tool to keep in your optimizer toolbox – especially when gradients get wild.
Developed by researchers at Google and Stanford, Yogi modifies Adam's adaptive learning rate mechanism to make it more robust to noisy gradients. yogi optimizer
Try it on your next unstable training run. You might be surprised. 🚀 Yogi won't replace Adam everywhere, but it's an
Enter (You Only Gradient Once).