Concepts4
📚TheoryAdvanced
Calculus of Variations
Calculus of variations optimizes functionals—numbers produced by whole functions—rather than ordinary functions of numbers.
#calculus of variations#euler–lagrange#functional derivative+12
📚TheoryIntermediate
Convex Optimization
Convex optimization studies minimizing convex functions over convex sets, where every local minimum is guaranteed to be a global minimum.
#convex optimization#convex function#convex set+12
📚TheoryIntermediate
Optimization Theory
Optimization theory studies how to choose variables to minimize or maximize an objective while respecting constraints.
#optimization#convex optimization#gradient descent+12
📚TheoryIntermediate
Gradient Descent Convergence Theory
Gradient descent updates parameters by stepping opposite the gradient: x_{t+1} = x_t - \eta \nabla f(x_t).
#gradient descent#convergence rate#l-smooth+12