Statistics and inference
Ten p-values in a row, part 3 of 3
AdvancedMultiple choice
Ten p-values in a row · Part 3 of 3
You test ten candidate signals and sort the p-values: 0.001, 0.008, 0.016, 0.018, 0.024, 0.041, 0.19, 0.27, 0.48 and 0.77. Each part asks what a different rule does with the same list at a 5% level.
What does the Benjamini–Hochberg procedure guarantee about those five discoveries?
- AThe probability that any of the five is false is at most 5%
- BOn average, at most 5% of the rejected hypotheses are false
- CEach of the five signals individually has at most a 5% chance of being noise
- DAt least 95% of the genuine signals among the ten have been found
The worked solution is in Premium
The answer, the full working and the one idea to take away – for this and all 1,322 questions in the bank. Answer it in practice and your working is marked, with a known mistake named when you make one.
Report an issue with this question
Learn the method
More statistics and inference questions
- You backtest 100 independent strategies, none with any edge, and call one a…Applied · Premium
- Twenty signals at five per cent, part 2 of 3Applied · Premium
- You have screened 5,000 candidate features and want to hand a shortlist to a…Advanced · Premium
- Twenty independent tests are run at the 5% level, all nulls true.Advanced · Premium
- Twenty signals at five per cent, part 3 of 3Advanced · Premium
- You test 50 signals and want the family-wise error rate at 5%.Foundation · Premium