Precision vs Recall: Which Mistake Can You Live With?
A classifier is wrong two different ways: flag something real as bad, or miss the bad thing entirely. Precision and recall score those two mistakes separately, and you can't maximize both at once — the threshold trades one off against the other.
Precision asks: of everything you flagged, how much was actually right? Recall asks: of everything that was actually right, how much did you catch? Raising the decision threshold trades recall for precision and vice versa — which one to prioritize depends on the cost of each mistake, not on chasing overall accuracy.
Transcript
Your spam filter just flagged a hundred emails. There are two ways it can be wrong — and they're not the same mistake. Flag a real email you needed, or miss actual spam — two mistakes, one dial between them. So which one should you actually fear?
Precision asks one thing: of everything you FLAGGED as spam, how much actually was? It's your false-alarm score. High precision means you rarely cry wolf — when the filter says 'spam,' you can trust it, and real emails stay safe.
Recall asks the opposite: of all the REAL spam out there, how much did you actually CATCH? It's your miss score. High recall means almost nothing slips through — but notice, it says nothing about how many good emails you wrongly flagged.
And here's the catch: you can't max both. They're two ends of one dial — your threshold for calling something spam. Turn suspicion up and you catch more spam, but trash more real mail. Turn it down and you spare real mail, but miss more spam.
So which one matters more? It depends entirely on the cost of each mistake. A cancer screen wants recall — never miss a real case, even with false alarms. A 'delete forever' filter wants precision — never kill a real email, even if some spam gets through. The F1 score balances the two.
So stop chasing raw accuracy. Ask the only question that matters: is it worse to MISS one, or to raise a FALSE alarm? It comes down to that one honest question — which mistake can you live with? Set the dial, and own the trade-off.