Groups
Category
Natural gradient scales the ordinary gradient by the inverse Fisher information matrix to account for the geometry of probability distributions.
Lie groups model continuous symmetries like rotations and rigid-body motions, combining algebra (group law) and calculus (smooth manifolds).