Groups
Equivariance means that applying a transformation before a function is the same as applying a corresponding transformation after the function.
Group theory gives a precise language for symmetries, and neural networks can exploit these symmetries to learn faster and generalize better.