EasyDeepLearn

Bonferroni correction — how does it work?

medium

Answer

  • For k independent tests at family-wise error rate α: use αadjusted  =  α  /  k{\alpha}_{\mathrm{adjusted}}\; = \;{\alpha}\; / \;k per test.
  • Guarantees P(any false rejection) ≤ α under independence, ≤ α always (union bound).
  • Very conservative — loses power quickly as k grows.
  • Use for a small number of confirmatory tests (< 20).
  • Holm's step-down variant is uniformly more powerful with the same guarantee.
Check yourself — multiple choice
  • αadj  =  α{\alpha}_{\mathrm{adj}}\; = \;{\alpha}
  • αadj  =  α/k{\alpha}_{\mathrm{adj}}\; = \;{\alpha} / k → family-wise error ≤ α; conservative — power decays quickly; Holm improves it
  • Increases power
  • Only for one test

Bonferroni: α/k; safe but low-power; Holm dominates uniformly.

#hypothesis-testing#multiple-testing

Practise Statistics Fundamentals

215 interview questions in this topic.

Related questions