Groups
Low-rank approximation replaces a big matrix with one that has far fewer degrees of freedom while preserving most of its action.
Matrix norms measure the size of a matrix in different but related ways, with Frobenius treating entries like a big vector, spectral measuring the strongest stretch, and nuclear summing all singular values.