• Aucun résultat trouvé

Markov chains approximation of jump-diffusion stochastic master equations

N/A
N/A
Protected

Academic year: 2022

Partager "Markov chains approximation of jump-diffusion stochastic master equations"

Copied!
25
0
0

Texte intégral

(1)

www.imstat.org/aihp 2010, Vol. 46, No. 4, 924–948

DOI:10.1214/09-AIHP330

© Association des Publications de l’Institut Henri Poincaré, 2010

Markov chains approximation of jump–diffusion stochastic master equations

Clément Pellegrini

Institut C. Jordan, Université C. Bernard, Lyon 1, 21, av Claude Bernard, 69622 Villeurbanne Cedex, France. E-mail:pelleg@math.univ-lyon1.fr Received 28 May 2009; revised 1 July 2009; accepted 16 July 2009

Abstract. Quantum trajectoriesare solutions of stochastic differential equations obtained when describing the random phenomena associated to quantum continuous measurement of open quantum system. These equations, also calledBelavkin equationsor Stochastic Master equations, are usually of two different types: diffusive and of Poisson-type. In this article, we consider more advanced models in which jump–diffusion equations appear. These equations are obtained as a continuous time limit of martingale problems associated to classical Markov chains which describe quantum trajectories in a discrete time model. The results of this article goes much beyond those of [Ann. Probab.36(2008) 2332–2353] and [Existence, uniqueness and approximation for stochastic Schrödinger equation: The Poisson case (2007)]. The probabilistic techniques, used here, are completely different in order to merge these two radically different situations: diffusion and Poisson-type quantum trajectories.

Résumé. Les trajectoires quantiquessont des solutions d’équations différentielles stochastiques décrivant des phénomènes aléa- toires associés aux prinicpes de mesure (quantique) des systèmes quantiques ouverts. Ces équations, également appeléeséquations de Belavkinouéquations maîtresses stochastiquessont habituellement de deux types: soit diffusif soit de type saut. Dans cet ar- ticle, nous considérons des modèles plus avancés où des équations de type saut-diffusion apparaissent. Ces équations sont obtenues comme solutions de problèmes de martingales. Ces problèmes de martingales sont obtenus comme limites continus (en temps) à partir de chaînes de Markov classiques décrivant des trajectoires quantiques pour des modèles à temps discret. Les résultats de cet article généralisent ceux de [Ann. Probab.36(2008) 2332–2353] et [Existence, uniqueness and approximation for stochastic Schrödinger equation: The Poisson case (2007)]. Ici, les techniques probabilistes utilisés sont complétement différentes afin de pouvoir mixer les deux types d’évolutions: diffusives et poissoniennes.

MSC:60F99; 60G99; 60H10

Keywords:Stochastic master equations; Quantum trajectory; Jump–diffusion stochastic differential equation; Stochastic convergence; Markov generators; Martingale problem

Introduction

In quantum mechanics, an active line of research makes an important use ofQuantum Trajectorytheory with wide applications inQuantum Optics or in Quantum Information theory (cf. [4,6,16,17,22]). A quantum trajectory is a solution of a stochastic differential equation which describes the random evolution of a quantum system undergoing continuous measurement. These equations are calledStochastic Master equationsorBelavkin equations[2–4,10,12, 14].

More precisely, these equations describe situations where the measurement isindirect. The physical setup is the one of an interaction between a small system (atom) and a continuous field (environment). By performing a continuous time quantum measurement on the field, after the interaction, we get a partial information of the evolution of the small system without destroying it. This partial information is governed by stochastic differential equations (Belavkin equations). In the literature, two characteristic equations are usually described as follows:

(2)

1. One is described by a diffusive equation dρt=L(ρt)dt+

ρtC+t−Tr ρt

C+C ρt

dWt, (1)

whereWt describes a one-dimensional Brownian motion.

2. The other is given by a stochastic differential equation driven by a counting process dρt=L(ρt)dt+

J(ρt)

Tr[Jt)]−ρt

dN˜t−Tr J(ρt)

dt

, (2)

whereN˜tis a counting process with stochastic intensityt

0Tr[Js)]ds.

The solutions of these equations are calledcontinuous quantum trajectories, they are valued in the set of states of the small system (astateordensity matrix is a positive trace class operator with trace one). Such models describe essentially the interaction between a two-level atom and a spin chain [29,30]. More complicated models, with higher degree of liberty, are in general mixing of these two types, that is, they are driven by both a diffusive and a jump process (jump–diffusion model) . . . .

Even in the cases(1)and(2), Belavkin equations pose tedious problems in terms of physical and mathematical justifications. First rigorous results are due to Davies [19] which has described the evolution of a two-level atom under- going a continuous measurement. Heuristic rules can be used to obtain classical Belavkin equations (1) and (2). There exists different ways to justify these models. In [3,9,11,14],Quantum Filteringtheory is used to obtain stochastic master equations. Such an approach needs high analytic technologies (Von Neumann algebra, conditional expectation in operator algebra) and is based on the quantum stochastic calculus formalism. In [4,5,7,27], jump–diffusion or multi- diffusions models are considered. In these papers, an approach based on classical stochastic differential equations and the notion ofa posteriori stateis used.

Recently, an intuitive approach based on a discrete time model has been used in [29,30] to justify Eqs(1)and(2).

The discrete model is calledQuantum Repeated Measurementsand is based on the setup ofQuantum Repeated Inter- actions. In this context, instead of considering an interaction with a continuous field, the environment is represented as an infinite chain of identical and independent quantum system. Each piece of the chain interacts with the small system during a time interval of lengthτ. After each interaction, a quantum measurement of an observable of the field is performed. From the point of view of the small system, according to the laws of quantum mechanics, each result of an observation gives rise to a random modification of its reference state. The evolution of the state of the small system can be described by classical Markov chains called discrete quantum trajectories. In [29,30], the discrete quantum trajectories are then expressed as solutions of discrete stochastic differential equations which are approximations of Eqs (1)and(2). Next, by using techniques related to convergence of stochastic differential equations, it has been shown that the solutions of(1)and(2)can be obtained as continuous limit from discrete quantum trajectories (when τ goes to zero). However, the techniques used in [29] and [30] are very different and incompatible (for(1)an abstract result of Kurtz and Protter [28] is used whereas for(2)a random coupling method and a comparison with an Euler scheme is employed). Therefore, such methods can not be adapted in situations of mixing of Brownian evolution and jump evolution.

In this article, in order to prove a similar convergence result for jump–diffusion stochastic master equations, we adopt an approach based onMarkov Chain Approximationtheory. We proceed as follows. As the discrete quantum trajectories are Markov chains, we can naturally define their discrete Markov generators which depend on the time parameterτ. The limit,τ goes to zero, of these generators gives rise to infinitesimal generators. These one are then naturally linked with generalmartingale problemsin probability theory [23,25]. Next, we show that such martingale problems are solved by solution of particular jump–diffusion stochastic differential equations, which model contin- uous time measurement theory. Finally, this approach and these models are physically justified by proving that the solutions of these SDEs can be obtained as continuous time limits (in distribution) of discrete quantum trajectories.

This way, for finite-dimensional systems, we get a general description of jump–diffusion stochastic master equations.

This article is organized as follows.

Section1is devoted to the description of the discrete model of quantum repeated measurements. We remind the presentation of discrete quantum trajectories developed in [29]. Next, we shall focus on the dependence onτ for these Markov chains and we introduce asymptotic assumptions in order to come into the question of convergence.

(3)

In Section2, we present the Markov chain approximation technique. We compute the Markov generators of discrete quantum trajectories and we investigate the limits of these one. Therefore, we obtain infinitesimal generators linked to general martingale problems. We show how to solve these problems in terms of jump–diffusion stochastic differential equations.

Finally in Section3, we show that discrete quantum trajectories converge in distribution to the solutions of sto- chastic differentials equations described in Section2. This way, the stochastic models of jump–diffusion equations in continuous quantum measurement theory are then justified as limit models of the concrete physical procedure of quantum repeated measurements.

1. Discrete quantum trajectories

1.1. Quantum repeated measurements

In this section, we remind the model of quantum repeated measurements and the description of discrete quantum trajectories in terms of Markov chains [29]. As it is mentioned in theIntroduction, the physical setup is the one a small system in contact with an infinite chain of quantum systems [1] (each piece of the chain is supposed to be independent and identical).

Mathematically, the small system is represented by a finite-dimensional Hilbert spaceH0equipped with an initial stateρ0. The set of states ofH0is denoted byS. The chain is represented by the countable tensor productT Φ =

k1Hk, whereHk=H, for allk(His also a finite-dimensional Hilbert space and each copy is equipped with the same reference stateβ). The model of quantum repeated measurements is described as follows. Each copyHk ofH interacts, one after the other, withH0during a time τ. After each interaction, a measurement is performed on the piece of the chain which has just interacted. The sequence of measurements involves random modifications of the state ofH0. These modifications are described by a random sequence of states ofH0denoted byk)which is called adiscrete quantum trajectory. Here, we remind the definition and the Markov property of the sequence(ρk)(see [29]

for a complete details).

In order to define the sequencek), we present the description of the first interaction and the first measurement (this allows namely to define the transitions ofk)in terms of Markov chain). A single interaction betweenH0and a copy ofHis described by a total HamiltonianHtotacting on the coupling systemH0H. Its general form is given by

Htot=H0I+IH+Hint,

where the operatorsH0andHare the free Hamiltonian of each system. The operatorHintrepresents the Hamiltonian of interaction. This defines the unitary-operator

U=eiτ Htot.

The evolution of states ofH0H, in the Schrödinger picture, is given by ρUρU.

After this first interaction, a second copy ofHinteracts withH0in the same fashion and so on. Usually the whole procedure is described by the state spaceΓ =H0T Φ and a sequence of unitary operators(Uk). More precisely, the operatorUk describes thekth interaction betweenH0andHk, it acts asUonH0Hkand it acts as the identity operator on the other copies ofH. Hence, the result of thekfirst interactions is described by the operators(Vk)where Vk=UkUk1· · ·U1, for allk >0 (this is the usual setup of quantum repeated interactions [1]).

We do not need all the details of the setup of quantum repeated interactions in order to describe the discrete quantum trajectoryk). We just need to describe the transition probabilities which state the Markov character. To this end, we describe the procedure of measurement after the first interaction. Before the interaction the initial state onH0His ρ0β and after the first interaction, the state onH0His given byμ1=U (ρ0β)U.

Now, we shall describe the measurement procedure of an observable ofH. LetAbe any observable onH, with spectral decompositionA=p

j=0λjPj. According to the laws of quantum mechanics, the result of the measurement

(4)

of A is random. In an explicit way, the accessible data are its eigenvalues, and the observation of λj obeys the probability law

P[to observeλj] =Tr[μ1Pj], j∈ {0, . . . , p}.

Besides, if we have observed the eigenvalue λj, the wave packet reductionprinciple imposes that the state after measurement becomes

˜

ρ1(j )=IPjμ1IPj

Tr[μ1IPj] .

As a consequence, depending on the result of the observation, this defines the new reference state of the system H0H.

In our context, we are only interested in the reduced state of the small systemH0. This state is given by taking a partial trace onH0(see the below definition–theorem). IfHis any Hilbert space, we denote by TrH[W]the trace of a trace-class operatorW onH.

Definition–Theorem 1. LetHandK be two Hilbert spaces.Ifαis a state on a tensor productHK,then there exists a unique stateηonHwhich is characterized by the property

TrH[ηX] =TrH⊗K

α(XI )

for allXB(H).This unique stateηis called the partial trace ofαonHwith respect toK.

Letαbe a state onΓ, we denote byE0(α)the partial trace ofαonH0with respect toH. Hence, we define ρ1(j )=E0

ρ˜1(j )

(3) for allj =0, . . . , p.The stateρ1(·)is a random state which is the new reference state ofH0after the first interaction and the first measurement. More precisely, each stateρ1(j )appears with probability Tr[μ1IPj]. This describes the transitions betweenρ0and the possible statesρ1(j ),j=0, . . . , p. Now, we can consider a second copy of(H, β) which interacts with(H0, ρ1)and after the same procedure, we get a new random stateρ2onH0. Recursively, we describe a random sequencek)whose the Markov property is expressed in the following theorem.

Theorem 1. There exists a probability space(Ω,F, P )such that the quantum trajectory(ρk)is a Markov chain with values in the set of states onH0.Ifρk=χk,thenρk+1takes one of the values

E0

(IPi)U (χkβ)U(IPi) Tr[U (χkβ)U(IPi)]

, i=0, . . . , p, with probabilityTr[U (χkβ)U(IPi)].

As the operator U depends explicitly on the time parameter τ, it is worth noticing that the Markov chaink) depends onτ. In the following, we putτ=1/n. In this way, we write the unitary operatorU (n)(with dependence inn) and we define

ρn(t)=ρ[nt] (4)

for allt >0. This defines a sequence of processesn(t))and we aim to show next that this sequence of processes con- verges in distribution, whenngoes to infinity. As announced in theIntroduction, such a convergence is obtained from the convergence of generators of Markov chains. The following section is then devoted to present these generators for quantum trajectories.

(5)

1.2. Discrete Markov generators

LetAbe an observable and letn(t))be the process defined from the quantum trajectory describing the successive measurements ofA. In this section, we investigate the explicit computation of the Markov generatorAnof the process n(t))(we will make no distinctions between the infinitesimal generators of the Markov chainsk)and the process n(t))generated by this Markov chain). For instance, let us introduce some notations.

We work withH0=CK+1. The set of operators onH0is identified withRP forP =2(K+1)2(we do not need to give any particular identification). We setE=RP and the set of statesS becomes then a compact subset ofE, since a state is a positive operator with trace 1. For all statesρS, we define

L(n)i (ρ)=E0

(IPi)U (n)(ρβ)U(n)(IPi) Tr[U (n)(ρβ)U(n)(IPi)]

,

(5) pi(ρ)=Tr

U (n)(ρβ)U(n)IPi

, i=0, . . . , p.

Here, we suppose implicitly thatL(n)i (ρ)=0 ifpi(ρ)=0. The operatorsL(n)i (ρ)represent the transition states of the Markov chains described in Theorem1; the termspi(ρ)are the associated probabilities. The Markov generators of n(t))are then expressed as follows.

Definition 1. Let(ρn(t)) be the process obtained from the repeated measurements of an observableAof the form A=p

i=0λiPi.Let us defineP(n)the probability measure which satisfies P(n)

ρn(0)=ρ0

=1, (6)

P(n)

ρn(s)=ρk, k/ns < (k+1)/n

=1, (7)

P(n)

ρk+1Γ/M(n)k

=Πnk,Γ), (8)

whereΠn(ρ,·)is the transition function of the Markov chain(ρk)given by Πn(ρ,Γ)=

p i=0

pi(ρ)δL(n)

i (ρ)(Γ) (9)

for all Borel subsetsΓB(RP)andM(n)k =σ{ρi, ik}.

For all statesρSand all functionsfCc2(E)(i.e.C2with compact support),we define Anf (ρ)=n f (μ)f (ρ)

Πn(ρ,dμ)

=n p

i=0

f

L(n)i (ρ)

f (ρ)

pi(ρ). (10)

The operatorAnis called theMarkov generatorof the Markov chain(ρk)(or of the processn(t))).

The complete description of generatorsAnneeds the explicit expression ofL(n)i (ρ), for allρand alli∈ {0, . . . , p}.

To this end, we need to compute the partial trace operationE0on the tensor productH0H. A judicious choice of basis for the tensor product allows to simplify the computations. Let0, . . . , ΩK)be any orthonormal basis ofH0

and(X0, . . . , XN)a one ofH. For the tensor product, we choose the basis

B=0X0, . . . , ΩKX0, Ω0X1, . . . , ΩKX1, . . . , Ω0XN, . . . , ΩKXN).

In this basis, any(N+1)(K+1)×(N+1)(K+1)matrixMonH0Hcan be written by blocks as a(N+1)× (N+1)matrixM=(Mij)0i,jN, whereMij are operators onH0. The following easy result justifies the choice of this basis.

(6)

Proposition 1. LetW be a state acting onH0H.IfW =(Wij)0i,jN,is the expression ofW in the basisB, where the coefficientsWij are operators onH0,then the partial trace with respect toHis given by the formula

E0[W] = N i=0

Wii.

Now, we are in the position to compute L(n)i (ρ), for all statesρ and alli∈ {0, . . . , p}. We choose the reference stateβofHto be the orthogonal projector onCX0, that is, with physical notationsβ= |X0 X0|.This state is called the ground state (or vacuum state) in quantum physics. From general result of G.N.S representation inCalgebra, it is worth noticing that it is not a restriction. Indeed, such a representation allows to identify any quantum system(H, β) with another system of the form(K,|X0 X0|), whereX0is the first vector of an orthonormal basis of a particular Hilbert spaceK(see [26] for details).

The unitary operatorU (n)is described by blocks asU (n)=(Uij(n))0i,jN, where the coefficientsUij are(K+ 1)×(K +1)matrices acting onH0. Fori∈ {0, . . . , p}, we denotePi =(pkli )0k,lN, the eigen-projectors of the observable A. Hence, the non-normalized states E0[IPiU (n)(ρβ)U (n)IPi]and the probabilities pi(ρ) satisfy

E0

IPiU (n)(ρβ)U (n)IPi

=

0k,lN

pkli Uk0(n)ρUl0(n),

(11) pi(ρ)=

0k,lN

piklTr

Uk0(n)ρUl0(n) .

By observing thatL(n)i (ρ)=E0[IPiU (n)(ρβ)U (n)IPi]/pi(ρ), for alli∈ {0, . . . , p}, we get the explicit expression of the generatorAn. The next step is to consider the limit ofAn, whenngoes to infinity. Such limits need appropriate asymptotic assumptions for the coefficientsUij(n). This is the topic of the following section.

1.3. Asymptotic assumptions

The choice of the asymptotic expression ofU (n)=(Uij(n))are based on the works of Attal–Pautrat in [1]. They have namely shown that the operator process defined for allt >0 by

V[nt]=U[nt](n)· · ·U1(n),

which describes the quantum repeated interactions, strongly converges (in operator sense) to a process(V˜t)satisfying a Quantum Langevin equation. Moreover, this convergence is non-trivial, only if the coefficientsUij(n)are scaled appropriately. When translated in our context, this expresses that there exist operatorsLij such that we have for all (i, j )∈ {0, . . . , N}2

nlim→∞nεij

Uij(n)δijI

=Lij, (12)

whereεij=120i+δ0j). As the expression(11)ofL(n)i (ρ)only involves the first column ofU (n), we only keep the following asymptotic expressions

U00(n)=I+1 nL00+o

1 n

and Ui0(n)= 1

nLi0+o 1

n

fori >0.

Another fact, which will be important in the computation of limit generators, is the following result (cf. [1]).

Proposition 2. In order thatU=(Uij)is an unitary-operator,there exists a self-adjoint operatorH0such that L00= −

iH0+1

2 N i=1

Li0Li0

.

(7)

Furthermore we have for allρS Tr

L00ρ+ρL00+

1kN

Lk0ρLk0

=0,

becauseTr[U (n)ρU(n)] =1,for alln.

We can now apply these considerations to give the asymptotic expression of non-normalized states and probabilities given by the expression(11). For the non-normalized states, we have

E0

IPiU (n)(ρβ)U (n)IPi

=pi00ρ+ 1

n

1kN

pk0i Lk0ρ+p0ki ρLk0

+1 n

p00i

L00ρ+ρL00

+

1k,lN

pkli Lk0ρLl0

+o 1

n

. (13)

Moreover, aspi(ρ)=Tr[E0[IPiU (n)(ρβ)U (n)IPi]], we get pi(ρ)=pi00+ 1

nTr

1kN

pik0Lk0ρ+pi0kρLk0

+1 nTr

pi00

L00ρ+ρL00

+

1k,lN

piklLk0ρLl0

+o 1

n

. (14)

The asymptotic expression ofL(n)i (ρ)then follows from(13)and(14). Depending on the fact thatpi00is equal to zero or not, we consider three cases:

1. Ifpi00=0, thenp0ki =0, for allk >0 and we have L(n)i (ρ)=

1k,lNpkli Lk0ρLl0+o(1) Tr[

1k,lNpkli Lk0ρLl0+o(1)]1Tr[

1k,lNpkliLk0ρLl0]=0+o(1). (15) 1. Ifpi00=1, then we have

L(n)i (ρ)=ρ+1 n

L00ρ+ρL00

+

1k,lN

piklLk0ρLl0

−1 nTr

L00ρ+ρL00

+

1k,lN

pkli Lk0ρLl0

ρ+o 1

n

. (16)

1. Ifpi00∈ {/ 0,1}, then we have

L(n)i (ρ)=ρ+ 1

n 1

p00i

1kN

pik0Lk0ρ+p0ki ρLk0

− 1 pi00Tr

1kN

pik0Lk0ρ+p0ki ρLk0

×ρ

(8)

+1 n

1 p00i

pi00

L00ρ+ρL00

+

1k,lN

pkli Lk0ρLl0

+ 1 (pi00)2Tr

1kN

pk0i Lk0ρ+p0ki ρLk02

×ρ

− 1 p00i Tr

p00i

L00ρ+ρL00

+

1k,lN

pkli Lk0ρLl0

×ρ

− 1 (pi00)2

1kN

pk0i Lk0ρ+pi0kρLk0

×Tr

1kN

pik0Lk0ρ+p0ki ρLk0

+o 1

n

. (17)

It is worth noticing that all the o are uniform inρsinceSis a compact set.

The next section is dedicated to the convergence ofAnand the presentation of the continuous models.

2. Jump–diffusion models of quantum measurement

In this section, we show that the limit (n→ ∞) of generatorsAngives rise to explicit infinitesimal generators. We interpret these generators as Markov generators of continuous time processes associated with martingale problems.

Besides, we show that these processes are solution of jump–diffusion stochastic differential equations which are a generalization of the Belavkin equations(1)and(2)presented in theIntroduction.

In our framework, the notion of martingale problem is expressed as follows (see [18,20,23,25] for complete refer- ences). We still consider the identification of the set of states as a compact subset ofE=RP. LetΠ be a transition kernel onE, leta(·)=(aij(·))be a measurable mapping onEwith values in the set of positive semi-definite symmet- ricP ×P matrices and letb(·)=(bi(·))be a measurable function fromEtoE. Letf be anyC2c(E)and letρE.

In this article, we consider infinitesimal generatorsAof the form Af (ρ)=

P i=1

bi(ρ)∂f (ρ)

∂ρi +1 2

P i,j=1

aij(ρ)∂f (ρ)

∂ρi∂ρj

+

E

f (ρ+μ)f (ρ)P i=1

μi

∂f (ρ)

∂ρi

Π (ρ,dμ). (18)

The notion of martingale problem associated with such generators is expressed as follows.

Definition 2. Letρ0E.We say that a measurable stochastic process(ρt)on some probability space(Ω,F, P )is a solution of the martingale problem for(A, ρ0),if for allfCc2(E),

Mft =f (ρt)f (ρ0)t

0

Af (ρs)ds, t≥0, (19)

is a martingale with respect toFtρ=σ (ρs, st ).

It is worth noticing that we must also define a probability space(Ω,F, P )to make explicit a solution of a problem of martingale.

In the following section, we show that the Markov generators of discrete quantum trajectories converges to infini- tesimal generators of the form(18).

(9)

2.1. Limit infinitesimal generators

Before expressing the theorem which gives the limit infinitesimal generators ofAn, we define particular functions onSwhich appear in the limit. For alliand all statesρS, set

gi(ρ)= 1k,lNpkli Lk0ρLl0 Tr[

1k,lNpkli Lk0ρLl0]−ρ

,

vi(ρ)=Tr

1k,lN

piklLk0ρLl0

,

(20) hi(ρ)= 1

p00i 1kN

pik0Lk0ρ+p0ki ρLk0

−Tr

1kN

pk0i Lk0ρ+pi0kρLk0 ρ

,

L(ρ)=L00ρ+ρL00+

1kN

Lk0ρLk0.

The next theorem concerning the limit generators follows from Eqs (15)–(17) described in Section1. In this theo- rem, the termDρf denotes the first differential inρof a functionfCc2(E)andDρ2f the second differential.

Theorem 2. LetAbe an observable with spectral decompositionA=p

i=0λiPi,wherePi=(pkli )0k,lN are its eigen-projectors.Up to permutation of eigen-projectors,we can suppose thatp000=0.We define the sets

I=

i∈ {1, . . . , p}/pi00=0

and J= {1, . . . , p} \I.

Let(ρnJ(t))be the corresponding quantum trajectory obtained from the measurement ofAand letAJn be its infinites- imal generator(cf.Definition1).The limit generatorsAJ ofAJn exist and are described as follows:

1. IfI= {1, . . . , p},that is,p000=1andJ=∅,we have for allfCc2(E)

nlim→∞sup

ρ∈S

AJnf (ρ)AJf (ρ)=0, (21)

whereAJ satisfies AJf (ρ)=Dρf

L(ρ) +

E

f ρ+μ

f (ρ)Dρf (μ)

Π (ρ,dμ), (22)

the transition kernelΠ being defined asΠ (ρ,dμ)=p

i=1vi(ρ)δgi(ρ)(dμ).

2. IfI= {1, . . . , p},that is,p000=1andJ=∅,we have for allfCc2(E)

nlim→∞sup

ρ∈S

AJnf (ρ)AJf (ρ)=0, (23)

whereAJ satisfies AJf (ρ)=Dρf

L(ρ) +1

2

iJ∪{0}

Dρ2f

hi(ρ), hi(ρ)

(24) +

E

f (ρ+μ)f (ρ)Dρf (μ)

Π (ρ,dμ), the transition kernelΠ being defined asΠ (ρ,dμ)=

iIvi(ρ)δgi(ρ)(dμ).

(10)

Proof. Recall thatS is the set of states and it is a compact subset ofE. For anyi∈ {0, . . . , p}and for anyρS, let us compute limn→∞AJnf (ρ). To this aim, we use the asymptotic results of Section1(Eqs (15)–(17)). There are three different types of limit to consider:

1. Supposepi00=0, we have,

nlim→∞n f

L(n)i (ρ)

f (ρ) pi(ρ)

=

f 1k,lNpkli Lk0ρLl0 Tr[

1k,lNpkli Lk0ρLl0]

f (ρ)

Tr

1k,lN

pkli Lk0ρLl0

for allρS. This defines a uniformly continuous function onSsincefCc2andSis compact. As a consequence, the asymptotic concerning this case (and the fact that all the o are uniform onScf. Section1) implies the uniform convergence.

2. Supposepi00=1, by using the Taylor formula of order one, we have

nlim→∞n f

L(n)i (ρ)

f (ρ) pi(ρ)

=Dρf

L00ρ+ρL00

+

1k,lN

piklLk0ρLl0

−Tr

L00ρ+ρL00

+

1k,lN

piklLk0ρLl0

ρ

.

To obtain the uniform result, we use the asymptotic expressions of Section1and the uniform continuity ofDf onS.

3. Supposepi00∈ {0,/ 1}. By applying the Taylor formula of order two, we get the convergence

i/p00i ∈{/0,1} nlim→∞n

f

L(n)i (ρ)

f (ρ) pi(ρ)

=

i/p00i ∈{/0,1}

Dρf

p00i

L00ρ+ρL00

+

1k,lN

pkli Lk0ρLl0

−Tr

p00i

L00ρ+ρL00

+

1k,lN

pkli Lk0ρLl0

ρ

+ 1 2pi00D2ρf

1kN

pk0i Lk0ρ+pi0kρLk0

−Tr

1kN

pik0Lk0ρ+p0ki ρLk0 ρ

+

1kN

pik0Lk0ρ+pi0kρLk0

−Tr

1kN

pk0i Lk0ρ+pi0kρLk0 ρ

. (25)

This last equality needs further explanation. In the Taylor formula, terms of the form Gi(ρ)= 1

nDρf

1kN

pk0i Lk0ρ+pi0kρLk0

−Tr

1kN

pik0Lk0ρ+p0ki ρLk0 ρ

appear for each i such that pi00 ∈ {0,/ 1}. We have

i/p00i ∈{/0,1}Gi(ρ) = 0, since

i/pi00∈{/0,1}pk0i =

i/p00i ∈{/0,1}pi0k =p

i=0p0k=p

i=0pk0=0, for all k >0 (indeed we have p

i=0Pi =I). Furthermore, this convergence is uniform for the same reasons as previously.

(11)

The different cases of the theorem follows from these three limits. The first case of Proposition2follows from the first two limits described above, the second case follows from the first and the third limits above. Before to describe this in details, we have to notice that

p i=0

1k,lN

piklLk0ρLl0=

1kN

Lk0ρLk0

sincep

i=0Pi=I. Moreover, we have Tr[L(ρ)] =Tr[L00ρ+ρL00+

1kNLk0ρLk0] =0 (see Proposition2).

By using these facts, in the casep00i =0, the limit can be written as

E

f (ρ+μ)f (ρ)Dρf (μ)

vi(ρ)δgi(ρ)(dμ)+Dρf gi(ρ)

vi(ρ).

Besides, we have Dρf

gi(ρ)

vi(ρ)=Dρf

1k,lN

pkli Lk0ρLl0−Tr

1k,lN

piklLk0ρLl0

ρ

.

Hence, it implies the first case of Theorem2, that is forI= {1, . . . , p}, we get indeed AJf(ρ)=Dρf

L(ρ) +

E

f (ρ+μ)f (ρ)Dρf (μ)

Π (ρ,dμ).

A similar reasoning gives the expression of the infinitesimal generator in the second case, whereI = {1, . . . , p}

and the proposition is proved.

It is worth noticing that the generatorsAJ are generators of type(18), it suffices to expand the differential terms Dρf andDρ2f in terms of partial derivatives ∂ρ∂f

j and ∂ρ2f

i∂ρj. In the next section, we present the continuous time stochastic models.

2.2. Solutions of martingale problems

In all this section, we consider an observableAwith spectral decomposition

A=

iI

λiPi+

jJ0

λjPj, (26)

whereI andJ are the subsets of{1, . . . , p}defined in Theorem2. LetAJ be the associated limit generator and let ρ0be a state. In order to solve the martingale problem for(AJ, ρ0), by Definition2, we have to define a probability space(Ω,F, P )and a stochastic processtJ)such that the process

Mft =f ρtJ

f (ρ0)t

0

AJf ρsJ

ds (27)

is a martingale for the natural filtration oftJ). In a usual way, such martingale problems are solved in terms of stochastic differential equations [18,21].

Concerning the suitable probability space, let us consider(Ω,F, P )a probability space which supports a(p+1)- dimensional Brownian motion W =(W0, . . . , Wp) andp independent Poisson point processes(Ni)1ip on R2, independent of the Brownian motion.

As there are two types of limit generators in Theorem2, we define two types of stochastic differential equations in the following way. Letρ0be an initial deterministic state:

Références

Documents relatifs

We now proceed to a special case that (i) encompasses a number of well-known examples, including context-free string rewriting, and (ii) leads to PTIME computability, by reducing

Unité de recherche INRIA Rennes : IRISA, Campus universitaire de Beaulieu - 35042 Rennes Cedex (France) Unité de recherche INRIA Rhône-Alpes : 655, avenue de l’Europe -

The first general result of optimal stopping theory for stochastic processes was obtained in discrete time by Snell [14] who characterized the value function of an optimal

For the error bound (3.5) associated with the Markov Chain approximation, the term E β,Time is similar to the Euler case, since it does not depend on the chosen discretization

By using Markov Chain Approximation Theory (using notion of infinitesimal generators for Markov processes), stochastic models for Continual Quantum Measurement Theory can be

Keywords: Inhomogeneous continuous time Markov chain, Runge-Kutta methods, uniformization, Monte Carlo simulation,

ثﺤﺒﻟﺎﺒ فﯿرﻌﺘﻟا.. مﺎﻌﻟا لﺨدﻤﻟا 1 - ﺎﻛﺸإ ثﺤﺒﻟا ﺔﯿﻟ ﺔﯿﻋﺎﻤﺘﺠﻻا تﻼﻛﺸﻤﻟا ﺔﻤوﺎﻘﻤﻟ ﻊﻤﺘﺠﻤﻟا ﺎﻬﻛﻠﻤﯿ ﻲﺘﻟا ﺔﺤﻠﺴﻷا لﻀﻓأ دﺤأ دﻌﯿ ﻲﻀﺎﯿرﻟا ﻲﻨدﺒﻟا طﺎﺸﻨﻟا نإ

Subsequently, these forecasted breakage patterns are used to schedule the renewal of water mains in an economically efficient manner, while considering the various associated