EasyDeepLearn

Define conditional probability and prove Bayes' rule from it.

easy

Answer

  • P(A    B)  =  P(A    B)  /  P(B)P(A\; \mid \;B)\; = \;P(A\;\;B)\; / \;P(B) when P(B) > 0.
  • Symmetrically, P(B    A)  =  P(A    B)  /  P(A)P(B\; \mid \;A)\; = \;P(A\;\;B)\; / \;P(A)P(A    B)  =  P(BA)    P(A)P(A\;\;B)\; = \;P(B \mid A)\; \cdot \;P(A).
  • Substitute back: P(A    B)  =  P(B    A)    P(A)  /  P(B)P(A\; \mid \;B)\; = \;P(B\; \mid \;A)\; \cdot \;P(A)\; / \;P(B).
  • This is Bayes' rule — a direct consequence of the conditional-probability definition, not a separate axiom.
Check yourself — multiple choice
  • P(AB)  =  P(A)P(A \mid B)\; = \;P(A)
  • P(AB)  =  P(A    B)/P(B)P(A \mid B)\; = \;P(A\;\;B) / P(B); Bayes follows by symmetry: P(AB)  =  P(BA)P(A \mid B)\; = \;P(B \mid A)P(A)/P(B)
  • Conditional prob doesn't exist
  • P(AB)  =  P(B)/P(A)P(A \mid B)\; = \;P(B) / P(A)

Bayes = direct consequence of the definition of conditional probability.

#probability#bayesian

Practise Statistics Fundamentals

215 interview questions in this topic.

Related questions