Can be negative? What does that mean?
mediumAnswer
- Yes. compares your model's residual sum of squares to that of a constant-mean baseline.
- A negative on a test set means your model is worse than predicting the mean everywhere — usually a sign of severe overfitting or distribution shift.
- On the training set with intercept, is always in ; the negative case only appears on held-out data or intercept-free fits.
Check yourself — multiple choice
- No, is always between 0 and 1
- Yes; negative test means the model is worse than predicting the mean
- Negative means the correlation is negative
- Negative is a bug in scikit-learn
On held-out data, can go below 0 — the model is worse than the mean baseline.
#linear-regression#metrics-regression
Practise Supervised Learning
215 interview questions in this topic.
Related questions
- Adding a feature raised R^2. Does that mean the model improved?
- When is quantile regression more useful than mean (OLS) regression?
- Why does OLS have a closed-form solution but logistic regression doesn't?
- What are the classical assumptions of linear regression?
- How do you interpret a coefficient in a multiple linear regression?
- What is VIF and when do you worry about multicollinearity?