Département de Mathématiques et de Génie Industriel, École Polytechnique, C.P. 6079, Succursale Centre-ville, Montréal, QC, H3C 3A7, Canada
Copyright © 2009 Mario Lefebvre and Jean-Luc Guilbault. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
A Markov chain with state space and transition probabilities depending on the current state is studied. The chain can be
considered as a discrete Ornstein-Uhlenbeck process. The probability that the process hits before 0 is computed explicitly. Similarly, the
probability that the process hits before is computed in the case when the state space is and the transition probabilities are not necessarily the same when is positive and is negative.