Machine learning
As you train longer, training error keeps falling while validation error starts rising.
FoundationMultiple choice
As you train longer, training error keeps falling while validation error starts rising. What is happening, and what is the standard response?
- AUnderfitting; add more features and train for longer still
- BOverfitting; stop early or regularise
- CA data leak; validation error should always fall with training error
- DNormal convergence; keep going until training error is zero
The worked solution is in Premium
The answer, the full working and the one idea to take away – for this and all 1,322 questions in the bank. Answer it in practice and your working is marked, with a known mistake named when you make one.
Report an issue with this question
Learn the method
More machine learning questions
- Bias and variance of nearest neighbours, part 1 of 3Foundation · Premium
- In a ten-dimensional unit cube, what fraction of the volume lies within 0.1 of some face?Applied · Premium
- Data are uniform in the unit hypercube in 10 dimensions.Applied · Premium
- Bias and variance of nearest neighbours, part 2 of 3Applied · Premium
- A regularised linear model beats your tuned gradient-boosting ensemble out of sample.Advanced · Premium
- Bias and variance of nearest neighbours, part 3 of 3Advanced · Premium