RAG Assistant That Turns Support Policies into Step-by-Step Procedures

HardLLMs & GenAI

Reported in interviews at Airbnb

Problem statement

How would you build a policy assistant that gives support agents reliable procedures? Policies have versions, effective dates, scope restrictions, access controls and linked exceptions. The assistant advises a human who makes account changes, and every proposed step must be supported by the applicable policies.

Design retrieval and grounded procedure generation, then diagnose missing prerequisites.

Show hint

Ask what makes a policy sentence safe to act on, beyond the sentence itself.

Relevant roles: ML Engineer, AI Engineer, LLM Engineer and Gen AI Engineer.

Related free problems