Groups
Category
Spectral analysis studies the distribution of eigenvalues and singular values of neural network weight matrices during training.
The Wigner Semicircle Law says that the histogram of eigenvalues of large random symmetric matrices converges to a semicircle-shaped curve.