Visualizing the Loss Landscape of Neural Nets
IntermediateHao Li, Zheng Xu et al.Dec 28arXiv
Training a neural network is like finding the lowest spot in a giant, bumpy landscape called the loss landscape.
#loss landscape visualization#filter normalization#sharpness flatness