Why monitor per-slice performance?

medium

Answer

$Overall accuracy can hide subgroup regressions.$
$Monitor per (country, device, user tier, time of day, product category).$
$Identify: (1) systematic bias (accuracy drops in minority group).$
$(2) local drift (feature shift in one region).$
$(3) failure modes (specific product types).$
$Alert on per-slice metric drop > X% even when overall stable.$
$Complementary: fairness metrics per protected group.$
$Tools: Fiddler AI, Arize, WhyLabs.$

Check yourself — multiple choice

Random
Overall accuracy hides subgroup regressions; monitor per (country/device/tier/time/category); alert on per-slice drop even when overall stable; fairness per protected group; Fiddler/Arize/WhyLabs
Only overall
Not real

Slice monitoring: per subgroup metrics; catches hidden regressions.

#monitoring#safety

Practise MLOps & Data Quality

215 interview questions in this topic.

Read the lesson Flashcards Take the quiz

Related questions