A 99.55% Accurate Disease Detector That Finds No Cases

EasyClassical ML

Reported in interviews at Picnic

Problem statement

You evaluate a disease detector on 100,000 people, exactly 450 of whom have the disease. Its accuracy is exactly 99.55%, yet it does not correctly identify a single person who has the disease.

Which of the following statements about this model is true?

Show hint

What does a model that labels everyone as healthy score on accuracy when the disease is this rare?

Relevant roles: ML Engineer, Applied Scientist and Data Scientist.

Related free problems