Bias Variance Tradeoff

Data Skeptic

• Episode: Bias Variance Tradeoff
• Website: Data Skeptic
• Feed URL: https://dataskeptic.com/api/blog/rss
• Published: 2015-11-13 01:00

A discussion of the expected number of cars at a stoplight frames today's discussion of the bias variance tradeoff. The central ideal of this concept relates to model complexity. A very simple model will likely generalize well from training to testing data, but will have a very high variance since it's simplicity can prevent it from capturing the relationship between the covariates and the output. As a model grows more and more complex, it may capture more of the underlying data but the risk that it overfits the training data and therefore does not generalize (is biased) increases. The tradeoff between minimizing variance and minimizing bias is an ongoing challenge for data scientists, and an important discussion for skeptics around how much we should trust mod