Reasoning under uncertainty

Probability, Bayes' rule and belief updates, Bayesian networks with enumeration and d-separation, and hidden Markov models with filtering and the Viterbi algorithm.

About 5 hours of study

Learning objectives

Lessons

  1. 1

    Probability and Bayes' rule Intermediate

    Reason with uncertainty. Use random variables, joint distributions, marginal and conditional probabilities, and Bayes' rule to update beliefs from evidence, as in medical tests and robot localization.

  2. 2

    Bayesian networks Advanced

    Represent a large joint distribution compactly as a graph of causes and effects with small conditional probability tables. Compute any probability by enumeration, and read independence from the graph with d-separation.

  3. 3

    Hidden Markov models Advanced

    Track a hidden state that changes over time from noisy observations. Use a transition model and a sensor model to predict, to filter with the forward algorithm, and to find the most likely sequence of states with the Viterbi algorithm.

Module practice

Module quiz

1. How is P(A | B) defined?
2. What does each node of a Bayesian network store?
3. Why does a positive test for a rare condition often mean the person is healthy?
4. In A → B ← C, what happens when B is observed?
5. What are the two steps of HMM filtering?
6. How does the Viterbi algorithm differ from filtering?

‹ Constraints and logicDecisions and learning from reward ›