Ranger - a synergistic optimizer using RAdam (Rectified Adam) and LookAhead in one codebase
conda install conda-forge::pytorch-ranger