Groups
Category
Level
Lion (Evolved Sign Momentum) is a first-order, sign-based optimizer discovered through automated program search.
Gradient descent updates parameters by stepping opposite the gradient: x_{t+1} = x_t - \eta \nabla f(x_t).