Concepts2

Groups

Variational Dropout & Bayesian Deep Learning

Dropout can be interpreted as variational inference in a Bayesian neural network, where applying random masks approximates sampling from a posterior over weights.

#bayesian neural networks#variational inference#dropout+12

📚TheoryIntermediate

Mean Field Variational Family

Mean field variational family assumes the joint posterior over latent variables factorizes into independent pieces q(z) = ∏ q_i(z_i).

#mean field