Skip to content

PRO TIP Block youtube.com at the DNS level — Pi-hole, NextDNS or your hosts file — but allow youtube-nocookie.com and i.ytimg.com. These tutorials keep playing; the rabbit hole does not.

Learning without distractions

Intro to Markov Chains & Transition Diagrams

184.2K views on YouTube

Markov Chains or Markov Processes are an extremely powerful tool from probability and statistics. They represent a statistical process that happens over and over again, where we try to predict the future state of a system. A markov process is one where the probability of the future ONLY depends on the present state, and ignores the past entirely. This might seem like a big restriction, but what we gain is a lot of power in our computations. We will see how to come up with transition diagram to describe the probabilities of shifting between different states, and then do an example where we use a tree diagram to compute the probabilities two stages into the future. We finish with an example looking at bull and bear weeks in the stock market.

Coming Soon: The follow up video covers using a Transition Matrix to easily compute probabilities multiple states in the future.

0:00 Markov Example
2:04 Definition
3:02 Non-Markov Example
4:06 Transition Diagram
5:27 Stock Market Example

COURSE PLAYLISTS:
►CALCULUS I: https://www.youtube.com/playlist?list=PLHXZ9OQGMqxfT9RMcReZ4WcoVILP4k6-m
► CALCULUS II: https://www.youtube.com/playlist?list=PLHXZ9OQGMqxc4ySKTIW19TLrT91Ik9M4n
►MULTIVARIABLE CALCULUS (Calc III): https://www.youtube.com/playlist?list=PLHXZ9OQGMqxc_CvEy7xBKRQr6I214QJcd
►DIFFERENTIAL EQUATIONS (Calc IV): https://www.youtube.com/watch?v=xeeM3TT4Zgg&list=PLHXZ9OQGMqxcJXnLr08cyNaup4RDsbAl1
►DISCRETE MATH: https://www.youtube.com/playlist?list=PLHXZ9OQGMqxersk8fUxiUMSIx0DBqsKZS
►LINEAR ALGEBRA: https://www.youtube.com/playlist?list=PLHXZ9OQGMqxfUl0tcqPNTJsb7R6BqSLo6

OTHER PLAYLISTS:
► Learning Math Series

►Cool Math Series:

BECOME A MEMBER:
►Join: https://www.youtube.com/channel/UC9rTsvTxJnx1DNrDA3Rqa6A/join
Special thanks to Imaginary Fan members Frank Dearr & Cameron Lowes for supporting this video.

MATH BOOKS & MERCH I LOVE:
► My Amazon Affiliate Shop: https://www.amazon.com/shop/treforbazett

SOCIALS:
►Twitter (math based): http://twitter.com/treforbazett
►Instagram (photography based): http://instagram.com/treforphotography