Statistics and inference
Twenty signals at five per cent, part 3 of 3
Twenty signals at five per cent · Part 3 of 3
A researcher tests 20 candidate signals, each with its own test at the 5% level. The tests are independent, and in truth none of the signals has any predictive power.
The researcher switches to a Bonferroni correction to hold the family-wise error rate at 5%. What is the exact probability of at least one false positive now, to four decimal places?
Answer with a number. Fractions, powers and expressions like 23/6 or C(52,5) are read correctly in practice.
The worked solution is in Premium
The answer, the full working and the one idea to take away – for this and all 1,322 questions in the bank. Answer it in practice and your working is marked, with a known mistake named when you make one.
Report an issue with this question
Learn the method
More statistics and inference questions
- A test returns p = 0.03. What does that mean?Applied · Premium
- Five tests give p-values 0.001,0.008,0.012,0.04,0.2.Applied · Premium
- You backtest 100 independent strategies, none with any edge, and call one a…Applied · Premium
- Ten p-values in a row, part 2 of 3Applied · Premium
- You have screened 5,000 candidate features and want to hand a shortlist to a…Advanced · Premium
- Twenty independent tests are run at the 5% level, all nulls true.Advanced · Premium