Opening Markov Chains
Markov Chains
- Length
- 47 min
- Level
- Undergraduate
- Recorded
- Harvard University2013
Chapter 1 of 7: Before the lecture
Builds Markov chains from the transition matrix , reading every -step probability from the power .
Markov chains are stochastic processes in which the future depends on the past only through the present state. Blitzstein starts from i.i.d. sequences and states the Markov property as conditional independence of past and future given the present. He then defines the transition matrix , with rows summing to one, and shows that multiplying a row vector of probabilities by gives the distribution one step ahead. Powers of the matrix give multi-step transition probabilities, read from the entry of . Along the way he contrasts natural models with Markov Chain Monte Carlo and recounts Markov's study of vowel-consonant sequences. The session in STAT 110 ends by defining stationary distributions through and assumes conditional probability and basic matrix multiplication.
Markov chains are stochastic processes in which the future depends on the past only through the present state. Blitzstein starts from i.i.d. sequences and states the Markov property as conditional independence of past and future given the present. He then defines the transition matrix , with rows summing to one, and shows that multiplying a row vector of probabilities by gives the distribution one step ahead. Powers of the matrix give multi-step transition probabilities, read from the entry of . Along the way he contrasts natural models with Markov Chain Monte Carlo and recounts Markov's study of vowel-consonant sequences. The session in STAT 110 ends by defining stationary distributions through and assumes conditional probability and basic matrix multiplication.

This lecture
Lecture 30 of 34 of Probability.
Choose a node to see how it connects to this lecture. What comes before is on the leftat the top. What comes after is on the rightat the bottom. The ring is what it teaches. People and places are above. Other lectures and books are below.
Press a chosen node again to open it.
Your comment is kept while you sign up.Sign in