What is Canary Analysis (Kayenta / Flagger)?

hard

Answer

$Automated statistical comparison between canary + baseline metrics during progressive rollout.$
$Netflix Kayenta: (1) fetch metrics for canary + baseline over rollout window.$
$(2) run Mann-Whitney U or similar test per metric.$
$(3) assign score per metric + weighted total.$
$(4) promote if above threshold; rollback if below.$
$Removes human bias.$
$Modern: Argo Rollouts + Prometheus queries + web hooks.$
$Enables auto-rollout with confidence.$

Check yourself — multiple choice

Random
Automated stat compare canary vs baseline (Netflix Kayenta): fetch metrics + Mann-Whitney per metric + weighted score + promote/rollback threshold; removes human bias; Argo Rollouts + Prometheus + webhooks
Just eyeball
Not real

Canary analysis: automated stat compare (Kayenta / Argo).

#deployment#monitoring

Practise MLOps & Data Quality

215 interview questions in this topic.

Read the lesson Flashcards Take the quiz

Related questions