Reasoning under uncertainty
Probability, Bayes' rule and belief updates, Bayesian networks with enumeration and d-separation, and hidden Markov models with filtering and the Viterbi algorithm.
About 5 hours of study
Learning objectives
- Apply Bayes' rule and normalization
- Answer queries in Bayesian networks
- Filter and decode hidden Markov models
Lessons
- 1
Probability and Bayes' rule Intermediate
Reason with uncertainty. Use random variables, joint distributions, marginal and conditional probabilities, and Bayes' rule to update beliefs from evidence, as in medical tests and robot localization.
- 2
Bayesian networks Advanced
Represent a large joint distribution compactly as a graph of causes and effects with small conditional probability tables. Compute any probability by enumeration, and read independence from the graph with d-separation.
- 3
Hidden Markov models Advanced
Track a hidden state that changes over time from noisy observations. Use a transition model and a sensor model to predict, to filter with the forward algorithm, and to find the most likely sequence of states with the Viterbi algorithm.
Module practice
- AI: Apply Bayes' ruleEasy
- AI: Answer questions from a joint distributionMedium
- AI: Where is the robot?Hard
- AI: Probability of a complete situationEasy
- AI: Inference by enumerationMedium
- AI: Independence from the graphHard
- AI: Predict a Markov chainEasy
- AI: The forward algorithmMedium
- AI: The Viterbi algorithmHard