Concepts2
📚TheoryAdvanced
PAC-Bayes Theory
PAC-Bayes provides high-probability generalization bounds for randomized predictors by comparing a data-dependent posterior Q to a fixed, data-independent prior P through KL(Q||P).
#pac-bayes#generalization bound#kl divergence+12
📚TheoryAdvanced
VC Dimension
VC dimension measures how many distinct labelings a hypothesis class can realize on any set of points of a given size.
#vc dimension#vapnik chervonenkis#shattering+12