FoundationMultiple choice
As you train longer, training error keeps falling while validation error starts rising. What is happening, and what is the standard response?
- AUnderfitting; add more features and train for longer still
- BOverfitting; stop early or regularise
- CA data leak; validation error should always fall with training error
- DNormal convergence; keep going until training error is zero
The worked solution is in Premium
The answer, the full working and the one idea to take away – for this and all 1,322 questions in the bank. Answer it in practice and your working is marked, with a known mistake named when you make one.
Learn the method
More machine learning questions
- You deepen your trees from depth 3 to depth 12. What happens to bias and variance?Foundation
- A model’s predictions at a point have bias 0.3 and variance 0.2, and the…Foundation
- Bias and variance of nearest neighbours, part 1 of 3Foundation
- In a ten-dimensional unit cube, what fraction of the volume lies within 0.1 of some face?Applied
- Data are uniform in the unit hypercube in 10 dimensions.Applied
- Bias and variance of nearest neighbours, part 2 of 3Applied