Mathematics
Sufficiency and the Factorization Theorem
Quick fact
A sufficient statistic can compress a dataset to a single number (or small set) without losing any information about the parameter—the Fisher information is exactly preserved.
Why this is interesting
If you had to summarize a dataset without losing any information about a key unknown, could you do it with a single number? Sometimes you can—a number that captures everything needed about the parameter.