Concepts2
📚TheoryIntermediate
Probability Distributions
Probability distributions describe how random outcomes are spread across possible values and let us compute probabilities, expectations, and uncertainties.
#probability distributions#pmf#pdf+12
📚TheoryIntermediate
Shannon Entropy
Shannon entropy quantifies the average uncertainty or information content of a random variable in bits when using base-2 logarithms.
#shannon entropy#information gain#mutual information+12