Kernel Density Estimation — mechanism.
mediumAnswer
- Non-parametric density estimator: p̂ Σ .
- K = kernel (Gaussian typical). h = bandwidth (critical hyperparameter).
- Uses: visualization (smoothed histogram), density-based anomaly detection, generative sampling.
- Scales poorly to high d (curse of dimensionality — need exponentially more data).
- Use cross-validation or Silverman's rule for h.
Check yourself — multiple choice
- Random
- p̂ Σ ; non-parametric; bandwidth h tuned via CV / Silverman; poor in high dim (curse of dim)
- Same as GMM
- Not real
KDE: non-parametric density; bandwidth h critical; curse of dim.
#density#anomaly-detection
Practise Unsupervised Learning
214 interview questions in this topic.
Related questions
- Local Outlier Factor (LOF) — how does it work?
- Elliptic envelope / robust Mahalanobis distance — when to use?
- What are the main approaches to anomaly detection?
- Gaussian Mixture Model vs k-means — what's the difference?
- HDBSCAN — how does it improve on DBSCAN?
- OPTICS — what does it produce and how do you use it?