Tag: ridge-regression
-
Interaction of Feature Size and Regularization
In this post we’re going to explore how estimated feature size is affected by regularization. The intuition is that the shrinkage applied by regularization will mean low amplitude features get (even more) swamped by additive noise. This is because the estimated values will be more affected by the additive noise, and will not generalize. So…