Groups
Category
A loss landscape is the “terrain” of a model’s loss as you move through parameter space; valleys are good solutions and peaks are bad ones.
Weight initialization sets the starting values of neural network parameters so signals and gradients neither explode nor vanish as they pass through layers.