Ensemble Learning Algorithm Complexity and Occam's Razor - MachineLearningMastery.com

Occam’s razor suggests that in machine learning, we should prefer simpler models with fewer coefficients over complex models like ensembles. Taken at face value, the razor is a heuristic that...

By · · 1 min read
Ensemble Learning Algorithm Complexity and Occam's Razor - MachineLearningMastery.com

Source: MachineLearningMastery.com

Occam’s razor suggests that in machine learning, we should prefer simpler models with fewer coefficients over complex models like ensembles. Taken at face value, the razor is a heuristic that suggests more complex hypotheses make more assumptions that, in turn, will make them too narrow and not generalize well. In machine learning, it suggests complex […]