Optimal Experiment Design for Comparing Two Coins

Reported in interviews at Citadel

Problem statement

How would you decide which of two coins has the higher chance of heads? Both probabilities are unknown, and you have 100 total flips to divide between them. Explain the allocation, the statistical test, and when adapting the allocation during the experiment could help.

Show hint

What quantity summarizes how uncertain the estimated difference between the two coins will be, and how does it depend on each coin's flip count?

Relevant roles: Data Scientist, Applied Scientist and Research Scientist.

Related free problems