📚TheoryIntermediate
Implicit Bias of Gradient Descent
In underdetermined linear systems (more variables than equations), gradient descent started at zero converges to the minimum Euclidean norm solution without any explicit regularizer.
#implicit bias#gradient descent#minimum norm+12