Refine
Has Fulltext
- yes (3)
Document Type
- Preprint (3) (remove)
Keywords
- Markov processes (1)
- compound Poisson processes (1)
- coupling (1)
- dynamical system representation (1)
- jump processes (1)
- monotone random (1)
- monotonicity conditions (1)
- partial ordering (1)
- reciprocal processes (1)
- stochastic bridges (1)
Institute
- Institut für Mathematik (3)
- Extern (1)
We formalize and analyze the notions of monotonicity and complete monotonicity for Markov Chains in continuous-time, taking values in a finite partially ordered set. Similarly to what happens in discrete-time, the two notions are not equivalent. However, we show that there are partially ordered sets for which monotonicity and complete monotonicity coincide in continuoustime but not in discrete-time.
We consider a class of ergodic Hamilton-Jacobi-Bellman (HJB) equations, related to large time asymptotics of non-smooth multiplicative functional of difusion processes. Under suitable ergodicity assumptions on the underlying difusion, we show existence of these asymptotics, and that they solve the related HJB equation in the viscosity sense.
Processes having the same bridges as a given reference Markov process constitute its reciprocal class. In this paper we study the reciprocal class of compound Poisson processes whose jumps belong to a finite set A in R^d. We propose a characterization of the reciprocal class as the unique set of probability measures on which a family of time and space transformations induces the same density, expressed in terms of the reciprocal invariants. The geometry of A plays a crucial role in the design of the transformations, and we use tools from discrete geometry to obtain an optimal characterization. We deduce explicit conditions for two Markov jump processes to belong to the same class. Finally, we provide a natural interpretation of the invariants as short-time asymptotics for the probability that the reference process makes a cycle around its current state.