AdvancedNumeric answer
You adjust an experiment’s outcome using each user’s pre-experiment value of the same metric (CUPED). The pre-period value correlates with the outcome. By what factor is the variance of the treatment-effect estimate multiplied?
Answer with a number. Fractions, powers and expressions like 23/6 or C(52,5) are read correctly in practice.
The worked solution is in Premium
The answer, the full working and the one idea to take away – for this and all 1,322 questions in the bank. Answer it in practice and your working is marked, with a known mistake named when you make one.
More statistics and inference questions
- An analyst checks an A/B test every day and stops the first time p < 0.05.Applied
- An A/B test compares a 10% baseline conversion with a hoped-for 11%.Applied
- An A/B test has 10,000 users per arm and a 5% baseline conversion rate.Advanced
- You have 100 observations and a standard error of 0.4.Foundation
- A sample of 36 observations has mean 0.8 and standard deviation 3.Foundation
- You observe 8 successes in 20 trials.Foundation