Transformer Fundamentals and Shipping an LLM Help-Desk Assistant
Problem statement
How would you replace a help desk's ticket-routing LSTM with a transformer assistant that answers employee questions? Answers must use company documents, arrive quickly, and stay within a limited hosting budget. Some HR, compensation and legal documents are restricted to particular employee groups.
Compare model architectures, design the assistant within budget, and diagnose a privacy failure.
Show hint
For the transformer question, ask what an RNN must do one step at a time.
Relevant roles: ML Engineer, AI Engineer, LLM Engineer and Applied Scientist.