Groups
Rényi entropy generalizes Shannon entropy by measuring uncertainty with a tunable emphasis on common versus rare outcomes.
Cross-entropy measures how well a proposed distribution Q predicts outcomes actually generated by a true distribution P.