RMSE vs MAE — how do you pick?
easyAnswer
- RMSE = sqrt() — same units as y, penalizes large errors quadratically.
- Use when big errors are disproportionately bad (financial forecasting, energy grids) or when errors are approximately Gaussian.
- — robust to outliers, more interpretable ('average error is X units'), the L1 relative of RMSE.
- RMSE ≥ MAE always; the gap grows with error variance.
- If a few large errors would dominate, prefer MAE (or Huber).
Check yourself — multiple choice
- RMSE is always smaller than MAE
- RMSE penalizes large errors more; MAE is robust to outliers and easier to explain
- Both are identical
- MAE is only for classification
RMSE = quadratic (large errors bite); MAE = L1 (robust). RMSE ≥ MAE always.
#metrics-regression
Practise Supervised Learning
215 interview questions in this topic.
Related questions
- Adding a feature raised R^2. Does that mean the model improved?
- Can R^2 be negative? What does that mean?
- When is quantile regression more useful than mean (OLS) regression?
- What criterion does a regression tree use to choose splits?
- What is Huber loss and why is it a compromise between MAE and MSE?
- What are the pitfalls of MAPE (Mean Absolute Percentage Error)?