AppliedNumeric answer
Bias and variance of nearest neighbours · Part 2 of 3
Data follow with independent noise of variance 4. A -nearest-neighbour regressor predicts at a point by averaging the values of its nearest training points.
What is the expected squared error when that prediction is compared with a fresh observation at ?
Answer with a number. Fractions, powers and expressions like 23/6 or C(52,5) are read correctly in practice.
The worked solution is in Premium
The answer, the full working and the one idea to take away – for this and all 1,322 questions in the bank. Answer it in practice and your working is marked, with a known mistake named when you make one.
Learn the method
More machine learning questions
- You deepen your trees from depth 3 to depth 12. What happens to bias and variance?Foundation
- A model’s predictions at a point have bias 0.3 and variance 0.2, and the…Foundation
- As you train longer, training error keeps falling while validation error starts rising.Foundation
- In a ten-dimensional unit cube, what fraction of the volume lies within 0.1 of some face?Applied
- Data are uniform in the unit hypercube in 10 dimensions.Applied
- A regularised linear model beats your tuned gradient-boosting ensemble out of sample.Advanced