Concepts3

Contrastive learning learns representations by pulling together positive pairs and pushing apart negatives using a softmax-based objective.

Attention computes a weighted sum of values V where the weights come from how similar queries Q are to keys K.

Edit distance (Levenshtein distance) measures the minimum number of inserts, deletes, and replaces needed to turn one string into another.