Perplexity
A measure of how "confused" a language model is about the next token — lower is better.
Computed from cross-entropy loss. GPT-2 had perplexity ~30 on Wikipedia; GPT-4 down to ~2-3. A classic LM metric but says little about instruction following. Not to be confused with Perplexity.ai (the search engine).