Markov property in discrete time

Sequence of random variables

If the process is nonnegative integer-valued, then

where

the state space of the process (chain).

Previous slide

Next slide

Back to first slide

View graphic version