overfitting
Everything on Ground Truth tagged “overfitting” — 2 items.
The bias-variance tradeoff: why a model can fail by being too simple or too clever Lesson
Every model's error splits into two opposing parts -- bias, from being too rigid to capture the pattern, and variance, from being so flexible it memorizes noise. Reducing one usually raises the other, and the whole craft of machine learning is finding where their sum is smallest.
Regularization: why deliberately handicapping a model makes it better Lesson
Regularization is the family of techniques that make a model perform worse on its training data in order to make it perform better on data it has never seen, with dropout and weight decay the two that shaped modern deep learning.