Concepts2

Groups

Variational Dropout & Bayesian Deep Learning

Dropout can be interpreted as variational inference in a Bayesian neural network, where applying random masks approximates sampling from a posterior over weights.

#bayesian neural networks#variational inference#dropout+12

📚TheoryAdvanced

Variational Inference Theory

Variational Inference (VI) replaces an intractable posterior with a simpler distribution and optimizes it by minimizing KL divergence, which is equivalent to maximizing the ELBO.