Debugging a Patient-Message Triage Classifier

Reported in interviews at Ro Co

Problem statement

How would you debug a telehealth message-routing service under a tight deadline? There are no labeled examples, and callers depend on its existing response fields. Vague messages receive clearly wrong categories with negative confidence, and those results go straight to callers.

Investigate the service, repair confidence and handle urgent messages.

Show hint

Before judging accuracy, list what must be true of every response the service returns, whatever the message.

Relevant roles: ML Engineer, AI Engineer, LLM Engineer and Applied Scientist.

Related free problems