7.45. Let Xn be an irreducible recurrent Markov chain of period d≥ 2. Let P be its transition probability matrix and Pd its d-step transition matrix. Show that the state space is a union of d disjoint sets Eo,... Ed-1 such that (a) Each E is an equivalence class for Pd. (b) If Xo Є Eo, then X₁ = E₁, X2 Є E3,...,Xd-1 € Ed-1 and Xd Є Eo.

Advanced Engineering Mathematics
10th Edition
ISBN:9780470458365
Author:Erwin Kreyszig
Publisher:Erwin Kreyszig
Chapter2: Second-order Linear Odes
Section: Chapter Questions
Problem 1RQ
Question
7.45. Let Xn be an irreducible recurrent Markov chain of period d≥ 2. Let P be
its transition probability matrix and Pd its d-step transition matrix. Show that the
state space is a union of d disjoint sets Eo,... Ed-1 such that
(a) Each E is an equivalence class for Pd.
(b) If Xo Є Eo, then X₁ = E₁, X2 Є E3,...,Xd-1 € Ed-1 and Xd Є Eo.
Transcribed Image Text:7.45. Let Xn be an irreducible recurrent Markov chain of period d≥ 2. Let P be its transition probability matrix and Pd its d-step transition matrix. Show that the state space is a union of d disjoint sets Eo,... Ed-1 such that (a) Each E is an equivalence class for Pd. (b) If Xo Є Eo, then X₁ = E₁, X2 Є E3,...,Xd-1 € Ed-1 and Xd Є Eo.
Expert Solution
trending now

Trending now

This is a popular solution!

steps

Step by step

Solved in 2 steps with 4 images

Blurred answer
Recommended textbooks for you
Advanced Engineering Mathematics
Advanced Engineering Mathematics
Advanced Math
ISBN:
9780470458365
Author:
Erwin Kreyszig
Publisher:
Wiley, John & Sons, Incorporated
Numerical Methods for Engineers
Numerical Methods for Engineers
Advanced Math
ISBN:
9780073397924
Author:
Steven C. Chapra Dr., Raymond P. Canale
Publisher:
McGraw-Hill Education
Introductory Mathematics for Engineering Applicat…
Introductory Mathematics for Engineering Applicat…
Advanced Math
ISBN:
9781118141809
Author:
Nathan Klingbeil
Publisher:
WILEY
Mathematics For Machine Technology
Mathematics For Machine Technology
Advanced Math
ISBN:
9781337798310
Author:
Peterson, John.
Publisher:
Cengage Learning,
Basic Technical Mathematics
Basic Technical Mathematics
Advanced Math
ISBN:
9780134437705
Author:
Washington
Publisher:
PEARSON
Topology
Topology
Advanced Math
ISBN:
9780134689517
Author:
Munkres, James R.
Publisher:
Pearson,