EasyDeepLearn

Kernel Density Estimation — mechanism.

medium

Answer

  • Non-parametric density estimator: p̂(x)  =  (1/(nhd))(x)\; = \;(1 / (\mathrm{nh}^{d})) Σ K((x    xi)/h)K((x\; - \;x_{i}) / h).
  • K = kernel (Gaussian typical). h = bandwidth (critical hyperparameter).
  • Uses: visualization (smoothed histogram), density-based anomaly detection, generative sampling.
  • Scales poorly to high d (curse of dimensionality — need exponentially more data).
  • Use cross-validation or Silverman's rule for h.
Check yourself — multiple choice
  • Random
  • (x)  =  (1/nhd)(x)\; = \;(1 / \mathrm{nh}^{d}) Σ K((xxi)/h)K((x - x_{i}) / h); non-parametric; bandwidth h tuned via CV / Silverman; poor in high dim (curse of dim)
  • Same as GMM
  • Not real

KDE: non-parametric density; bandwidth h critical; curse of dim.

#density#anomaly-detection

Practise Unsupervised Learning

214 interview questions in this topic.

Related questions