Josef Honerkamp: Stochastic dynamical systems. VCH 1993.

20901 Azaria Paz: Introduction to probabilistic automata.
Academic Press 1971, 230p.