Groups
Category
Orthogonal (real) and unitary (complex) matrices are length- and angle-preserving transformations, like perfect rotations and reflections.
A loss landscape is the โterrainโ of a modelโs loss as you move through parameter space; valleys are good solutions and peaks are bad ones.