AppliedNumeric answer

You backtest $100$ independent strategies, none with any edge, and call one a discovery if its $t$ -statistic exceeds $2$ (a one-sided probability of $2.275\%$ ). What is the probability that at least one qualifies? Give three decimals.

Answer with a number. Fractions, powers and expressions like 23/6 or C(52,5) are read correctly in practice.

The worked solution is in Premium

The answer, the full working and the one idea to take away – for this and all 1,322 questions in the bank. Answer it in practice and your working is marked, with a known mistake named when you make one.

Start the 7-day free trial Practise it with Premium

Learn the method

p-values, p-hacking and the multiple-testing problem

Reported in interviews at

Citadel, Two Sigma, AQR

You backtest 100100100 independent strategies, none with any edge, and call one a discovery if its ttt-statistic exceeds 222 (a one-sided probability of 2.275%2.275\%2.275%). What is the probability that at least one qualifies? Give three decimals.

More statistics and inference questions

You backtest $100$ independent strategies, none with any edge, and call one a discovery if its $t$ -statistic exceeds $2$ (a one-sided probability of $2.275\%$ ). What is the probability that at least one qualifies? Give three decimals.