Memorizing vs Learning
Memorizing vs Learning: Overfitting and Underfitting, Seeing It: Validation and Learning Curves.
Updated
- Overfitting and Underfitting (Journeyman): A model that memorizes its training rows scores almost perfectly on them and much worse on rows it never saw (overfitting), a model too simple for the pattern scores low on both (underfitting), and putting the training score beside the test score is how you tell them apart.
- Seeing It: Validation and Learning Curves (Freelancer): A validation curve draws a model's training score and validation score for each value of one setting, such as a tree's max_depth, so you can see where underfitting ends and overfitting begins, and a learning curve draws the same two scores for more and more training rows, to show whether more data would help.