Transformer Fundamentals and Shipping an LLM Help-Desk Assistant

HardLLMs & GenAI

Reported in interviews at Microsoft

Problem statement

How would you replace a help desk's ticket-routing LSTM with a transformer assistant that answers employee questions? Answers must use company documents, arrive quickly, and stay within a limited hosting budget. Some HR, compensation and legal documents are restricted to particular employee groups.

Compare model architectures, design the assistant within budget, and diagnose a privacy failure.

Show hint

For the transformer question, ask what an RNN must do one step at a time.

Relevant roles: ML Engineer, AI Engineer, LLM Engineer and Applied Scientist.

Related free problems