EasyDeepLearn

Why does Ridge regression give more stable coefficients than OLS?

medium

Answer

  • Ridge solves (XT  X  +  λ  I)(X^{T}\;X\; + \;\lambda\;I) w  =  XTw\; = \;X^{T} y instead of XTX^{T} X w  =  XTw\; = \;X^{T} y.
  • Adding lambda I to the diagonal keeps the matrix invertible even when features are collinear or when p > n, and shrinks coefficients toward zero proportionally to their scale.
  • The shrinkage introduces bias but drastically reduces variance — often a favourable tradeoff for prediction.
  • Ridge does not zero-out coefficients, it just makes them small and stable.
Check yourself — multiple choice
  • Ridge makes XTX^{T} X singular
  • It adds lambda·I to XTX^{T} X, stabilizing the inverse and shrinking coefficients
  • Ridge produces sparse coefficients
  • Ridge is only used for classification

Ridge stabilizes the inverse via +λI and shrinks coefficients smoothly.

#regularization#linear-models

Practise Supervised Learning

215 interview questions in this topic.

Related questions