Serving Infrastructure for a Delivery-App Recommendation Feed
Problem statement
How would you serve a personalized food-delivery home page under heavy traffic and a tight response deadline? Separate candidate and ranking services depend on feature, embedding and item stores that may fail. Results must reflect current address and availability quickly, and either region must carry all traffic if its peer fails.
Design serving and data paths, then handle cache correctness, failover capacity and slow dependencies.
Show hint
For each thing you might cache, ask what the right answer depends on and how quickly each of those inputs changes.
Relevant roles: ML Engineer, MLOps Engineer and AI Engineer.