Perplexity

Calculation of entropy that calculates how ‘suprised’ a model is by a text. Calculated from the likelihood so is a more interpretable form

Algorithm