AdvancedMultiple choice
Ten p-values in a row · Part 3 of 3
You test ten candidate signals and sort the p-values: 0.001, 0.008, 0.016, 0.018, 0.024, 0.041, 0.19, 0.27, 0.48 and 0.77. Each part asks what a different rule does with the same list at a 5% level.
What does the Benjamini–Hochberg procedure guarantee about those five discoveries?
- AThe probability that any of the five is false is at most 5%
- BOn average, at most 5% of the rejected hypotheses are false
- CEach of the five signals individually has at most a 5% chance of being noise
- DAt least 95% of the genuine signals among the ten have been found
The worked solution is in Premium
The answer, the full working and the one idea to take away – for this and all 1,322 questions in the bank. Answer it in practice and your working is marked, with a known mistake named when you make one.
Learn the method
More statistics and inference questions
- You test 50 signals and want the family-wise error rate at 5%.Foundation
- Twenty signals at five per cent, part 1 of 3Foundation
- You test 200 signals with no edge at the 5% level.Applied
- A test returns p = 0.03. What does that mean?Applied
- Five tests give p-values 0.001,0.008,0.012,0.04,0.2.Applied
- You backtest 100 independent strategies, none with any edge, and call one a…Applied