VC Dimension

How much of the training data can a model memorize instead of learning!
Lower VC-Dimension -> The model is less powerful -> It's less memorizing, more recognizing patterns -> The model generalizes better
Higher VC-Dimension -> The model is more powerful -> It can memorize many configurations -> It can easily overfit with few data points

Powered by Forestry.md