New Deep Learning Optimizer, Ranger: Synergistic combination of RAdam + LookAhead for the best of…

Source: Deep Learning on Medium

A new paper in part by the famed deep learning researcher Geoffrey Hinton introduces the LookAhead optimizer(“LookAhead optimizer: k steps…

Continue reading on Medium »