EasyDeepLearn

What is a hierarchical Bayesian model?

hard

Answer

  • Multi-level model: parameters θj{\theta}_{j} vary across groups j and are themselves drawn from a shared 'population' distribution θj{\theta}_{j} ~ N(μ,  τ2)N({\mu}, \;{\tau}^{2}).
  • Partial pooling: group estimates borrow strength from each other via the shared prior — automatic shrinkage.
  • Uses: hospital effects, per-user models, radon by county (Gelman's classic example).
  • Solves the 'estimate 10,000 individual users' problem: no-pool overfits, full-pool ignores individuality, partial-pool balances them.
Check yourself — multiple choice
  • Only fixed effects
  • Multi-level: θj{\theta}_{j} ~ shared population (θj    N(μ,  τ2))({\theta}_{j}\; \sim \;N({\mu}, \;{\tau}^{2})); partial pooling → shrinkage; solves 'no-pool overfits vs full-pool ignores individuality'
  • Same as OLS
  • Random

Hierarchical: partial pooling via shared prior; balances no-pool / full-pool.

#bayesian#mixed-effects

Practise Statistics Fundamentals

215 interview questions in this topic.

Related questions