A 99.55% Accurate Disease Detector That Finds No Cases
Problem statement
You evaluate a disease detector on 100,000 people, exactly 450 of whom have the disease. Its accuracy is exactly 99.55%, yet it does not correctly identify a single person who has the disease.
Which of the following statements about this model is true?
Show hint
What does a model that labels everyone as healthy score on accuracy when the disease is this rare?
Relevant roles: ML Engineer, Applied Scientist and Data Scientist.