๐ŸŽ“How I Study AIHISA
๐Ÿ“–Read
๐Ÿ“„Papers๐Ÿ“ฐBlogs๐ŸŽฌCourses
๐Ÿ’กLearn
๐Ÿ›ค๏ธPaths๐Ÿ“šTopics๐Ÿ’กConcepts๐ŸŽดShorts
๐ŸŽฏPractice
๐Ÿ“Daily Log๐ŸŽฏPrompts๐Ÿง Review
SearchSettings
How I Study AI - Learn AI Papers & Lectures the Easy Way

Concepts95

Groups

๐Ÿ“Linear Algebra15๐Ÿ“ˆCalculus & Differentiation10๐ŸŽฏOptimization14๐ŸŽฒProbability Theory12๐Ÿ“ŠStatistics for ML9๐Ÿ“กInformation Theory10๐Ÿ”บConvex Optimization7๐Ÿ”ขNumerical Methods6๐Ÿ•ธGraph Theory for Deep Learning6๐Ÿ”ตTopology for ML5๐ŸŒDifferential Geometry6โˆžMeasure Theory & Functional Analysis6๐ŸŽฐRandom Matrix Theory5๐ŸŒŠFourier Analysis & Signal Processing9๐ŸŽฐSampling & Monte Carlo Methods10๐Ÿง Deep Learning Theory12๐Ÿ›ก๏ธRegularization Theory11๐Ÿ‘๏ธAttention & Transformer Theory10๐ŸŽจGenerative Model Theory11๐Ÿ”ฎRepresentation Learning10๐ŸŽฎReinforcement Learning Mathematics9๐Ÿ”„Variational Methods8๐Ÿ“‰Loss Functions & Objectives10โฑ๏ธSequence & Temporal Models8๐Ÿ’ŽGeometric Deep Learning8

Category

๐Ÿ”ทAllโˆ‘Mathโš™๏ธAlgo๐Ÿ—‚๏ธDS๐Ÿ“šTheory

Level

AllBeginnerIntermediate
๐Ÿ“šTheoryIntermediate

Eigenvalue Decomposition

Eigenvalue decomposition rewrites a square matrix as a change of basis that reveals how it stretches and rotates space.

#eigenvalue decomposition#spectral theorem#power iteration+12
๐Ÿ“šTheoryIntermediate

Optimization Theory

Optimization theory studies how to choose variables to minimize or maximize an objective while respecting constraints.

#optimization
45678
Advanced
#convex optimization
#gradient descent
+12
๐Ÿ“šTheoryIntermediate

Linear Algebra Theory

Linear algebra studies vectors, linear combinations, and transformations that preserve addition and scalar multiplication.

#linear algebra#vector space#basis+12
๐Ÿ“šTheoryIntermediate

Gradient Descent Convergence Theory

Gradient descent updates parameters by stepping opposite the gradient: x_{t+1} = x_t - \eta \nabla f(x_t).

#gradient descent#convergence rate#l-smooth+12
๐Ÿ“šTheoryIntermediate

Central Limit Theorem

The Central Limit Theorem (CLT) says that the sum or average of many independent, identically distributed variables with finite variance becomes approximately normal (Gaussian).

#central limit theorem#berry-esseen#lindeberg+12
๐Ÿ“šTheoryIntermediate

Probability Distributions

Probability distributions describe how random outcomes are spread across possible values and let us compute probabilities, expectations, and uncertainties.

#probability distributions#pmf#pdf+12
๐Ÿ“šTheoryIntermediate

Probability Theory

Probability theory formalizes uncertainty using a sample space, events, and a probability measure that obeys clear axioms.

#probability measure#random variable#expectation+12
๐Ÿ“šTheoryIntermediate

Mutual Information

Mutual Information (MI) measures how much knowing one random variable reduces uncertainty about another.

#mutual information#entropy#kl divergence+12
๐Ÿ“šTheoryIntermediate

KL Divergence (Kullback-Leibler Divergence)

Kullbackโ€“Leibler (KL) divergence measures how one probability distribution P devotes probability mass differently from a reference distribution Q.

#kl divergence#kullback-leibler#cross-entropy+12
๐Ÿ“šTheoryIntermediate

Shannon Entropy

Shannon entropy quantifies the average uncertainty or information content of a random variable in bits when using base-2 logarithms.

#shannon entropy#information gain#mutual information+12
๐Ÿ“šTheoryIntermediate

Information Theory

Information theory quantifies uncertainty and information using measures like entropy, cross-entropy, KL divergence, and mutual information.

#entropy#cross-entropy#kl divergence+12