Optimal Experiment Design for Comparing Two Coins
Problem statement
How would you decide which of two coins has the higher chance of heads? Both probabilities are unknown, and you have 100 total flips to divide between them. Explain the allocation, the statistical test, and when adapting the allocation during the experiment could help.
Show hint
What quantity summarizes how uncertain the estimated difference between the two coins will be, and how does it depend on each coin's flip count?
Relevant roles: Data Scientist, Applied Scientist and Research Scientist.
Related free problems
- Identifying the Biased Coin From Limited FlipsStatistics & InferenceMedium