Jump to content

Markov chain question


Recommended Posts

Hello all, I have a question on determine the transition probabilities for the following Markov chain. I’m not sure how to proceed. For the first part I crossed off the impossible probabilities but how do I calculate the  others? Thank for your time




Link to comment
Share on other sites

21 hours ago, jpl99 said:

how do I calculate the  others?

Hello. A quick hint to get you started: There seems to be one "obvious" transition where Pij = 1, can you figure out which transition that is? From there you may be able to find out how to reason about the remaining transitions. If not, I can give some more hints once you show where you get stuck.

Hope this helps.

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.