Concepts2
📚TheoryIntermediate
Matrix Calculus
Matrix calculus extends ordinary calculus to functions whose inputs and outputs are vectors and matrices, letting you compute gradients, Jacobians, and Hessians systematically.
#matrix calculus#gradient#jacobian+12
📚TheoryIntermediate
Mutual Information
Mutual Information (MI) measures how much knowing one random variable reduces uncertainty about another.
#mutual information#entropy#kl divergence+12