Groups
Category
The WakeโSleep algorithm trains a pair of models: a generative model that explains how data are produced and a recognition model that guesses hidden causes from observed data.
Natural gradient scales the ordinary gradient by the inverse Fisher information matrix to account for the geometry of probability distributions.