EasyDeepLearn

Why is logistic regression called a linear model if it uses a sigmoid?

medium

Answer

  • The decision boundary is linear in the input features because the model is linear in the log-odds: logit(p)  =  wT\mathrm{logit}(p)\; = \;w^{T} x + b.
  • The sigmoid only maps that linear score into [0, 1] for a probability.
  • So the model is linear in parameters and features; only the link function is nonlinear.
Check yourself — multiple choice
  • It is nonlinear because of the sigmoid
  • It is linear in the log-odds
  • It is a tree-based model
  • It uses only one feature at a time

Logistic regression is linear in log-odds; the decision boundary is a hyperplane.

#linear-models#classification

Practise Supervised Learning

215 interview questions in this topic.

Related questions