What is data drift and how do you detect it?
easyAnswer
- Data drift is a change in the input feature distribution P(X) over time compared to training data.
- Detect it with statistical tests per feature (KS test for numeric, chi-square for categorical), Population Stability Index (PSI > 0.2 = significant drift), or distance measures (JS divergence, Wasserstein).
- Monitor drift in production dashboards and alert when thresholds are crossed.
- Drift does not always hurt performance — measure impact on output and label if available.
Check yourself — multiple choice
- Data drift is a change in
- Data drift is a change in the input distribution P(X)
- PSI values below 0.01 indicate strong drift
- KS test is used for images only
Data drift = change in P(X). Change in is concept drift.
#monitoring#data-quality
Practise MLOps & Data Quality
215 interview questions in this topic.
Related questions
- How is concept drift different from data drift?
- What is schema drift and how do you detect it?
- What is label drift and why does it matter?
- How is Population Stability Index (PSI) computed and interpreted?
- Why prefer Jensen-Shannon Divergence over KL for drift?
- What is Maximum Mean Discrepancy (MMD) for drift detection?