A NNALES DE LA FACULTÉ DES SCIENCES DE T OULOUSE
P IERRE D EL M ORAL
L AURENT M ICLO
On the stability of nonlinear Feynman-Kac semigroups
Annales de la faculté des sciences de Toulouse 6
esérie, tome 11, n
o2 (2002), p. 135-175
<http://www.numdam.org/item?id=AFST_2002_6_11_2_135_0>
© Université Paul Sabatier, 2002, tous droits réservés.
L’accès aux archives de la revue « Annales de la faculté des sciences de Toulouse » (http://picard.ups-tlse.fr/~annales/) implique l’accord avec les conditions générales d’utilisation (http://www.numdam.org/conditions).
Toute utilisation commerciale ou impression systématique est constitu- tive d’une infraction pénale. Toute copie ou impression de ce fichier doit contenir la présente mention de copyright.
Article numérisé dans le cadre du programme Numérisation de documents anciens mathématiques
http://www.numdam.org/
- 135 -
On the stability of nonlinear Feynman-Kac semigroups(*)
PIERRE DEL
MORAL,
LAURENT MICLO (1)e-mail: delmoral@math.ups-tlse.fr, miclo@math.ups-tlse.fr
Annales de la Faculte des Sciences de Toulouse Vol. XI, n° 2, 2002 pp. 135-175
RÉSUMÉ. - On s’intéresse aux proprietes de stabilite de certains semi- groupes non-lineaires, de type Feynman-Kac renormalises, agissant sur l’ensemble des probabilites d’un espace mesure donne. Cette etude se
base notamment sur l’utilisation du coefficient ergodique de Dobrushin dans l’esprit d’articles precedents de A. Guionnet et de l’un des auteurs.
La seconde partie de ce travail porte sur des applications des resultats obtenus. Tout d’abord nous donnons des criteres assurant qu’une particule sous-markovienne conditionnee a ne pas mourir oublie exponentiellement
vite sa condition initiale. Nous analysons egalement des proprietes de sta-
bilite d’une classe de processus interagissant par le biais de leur intensite de sauts. Enfin, nous etudions des proprietes de stabilite d’equations de filtrage non-lineaire dont les signaux sont des diffusions generales, en exa-
minant le comportement asymptotique de leur solutions robustes.
ABSTRACT. - The stability properties of a class of nonlinear Feynman-
Kac semigroups in distribution space is discussed. This study is based on
the use of semigroup techniques and Dobrushin’s ergodic coefficient in the spirit of previous articles by A. Guionnet and one of the authors.
The second part of this paper is devoted to the applications of these re-
sults. First we give conditions underwhich a killed Markov particle condi-
tioned by non-extinction forgets exponentially fast its initial condition.
We also analyze the stability properties of a class of interacting processes in which the interaction goes through jumps. Finally we investigate the asymptotic stability properties of the nonlinear filtering equation associa- ted to a general Markov signal with continuous paths and we examine the limiting behavior of its robust version.
~ * ~ Reçu le 7 fevrier 2001, accepte le 6 novembre 2002
(1) Laboratoire de Statistique et Probabilites, UMR 5583, CNRS et Universite Paul Sabatier, 118 route de Narbonne, 31062 Toulouse Cedex 4, France.
1. Introduction
Let X =
(Xt)tEI
be a Markov process with time space I = or I = N andtaking
values in a measurable space(E, ~).
Let Z = s,t bea collection of
multiplicative
boundedpositive
functions such that for anys x t,
is a rt)-measurable
random variable.Starting
from the
pair (X, Z)
one associate a nonlinearsemigroup 03A6 = {03A6s,t
:0
s
t~
on the setM 1 (E)
of allprobability
measures on Eby setting
for anydistribution p
EM1 (E)
and for any bounded and £-measurable functionwhere denotes the Markov process X on
starting
with initial distribution tc. The paper concerns the
large
time behavior and thestability properties
of nonlinearFeynman-Kac semigroups
03A6. A concisestatement of one of our main results is the
following.
THEOREM 1.1. -
If
the transitionsemigroup of
X issufficiently mixing
and Z is
sufficiently regular
then there exists some 03B3 > 0 such thatfor
any t ~ Iwhere the supremum is taken over all
pair
distributions and is the total variation norm.This result will be reformulated in more details later in the paper, where in
particular
we shallspecify
severalmixing
andregularity
conditions un-derwhich the
semigroup 03A6
isasymptotically
stable. Ourexpressions
for theexponential
rates(2)
will also be constructive.To motivate our work and to
get
a flavor of our results let uspresent already
and in more details aparticular
situation which can be handled inour framework. Let I =
R+
and Z begiven by
where X is a
time-homogeneous
Markov process withsemigroup
and is a collection of measurable functions with bounded
oscillations,
that is forany t ~ I
COROLLARY 1 .2. - 1.
If
the oscillations areintegrable
in the sense thatthen
for
any p >1,
u > 0 and t > p.u theLyapunov exponent
~ygiven
in
(2) satisfies
with
2.
If
the oscillations areuniformly
bounded in the sense thatand
if
thesemigroup ~Pt
;satisfies
thefollowing mixing type
condition
for
some constants 0 a, b oo, thenfor
any p >1,
u > 0 andt > p.u the
Lyapunov exponent
~ygiven
in(2) satisfies
As announced and
strictly speaking
the latter is not acorollary
of Theo-rem 1.1 but rather a consequence of our constructive
approach.
Theprecise description
of Theorem 1.1 will begiven
in section 3.The discrete time version of Theorem 1.1 and
Corollary
1.2 was firstobtained
by
A. Guionnet and one of the authors in[6].
Ourobjective
is toextend this
study
to continuous timesemigroups.
For aprecise
discussion onthe
origins
of thisproblem
the reader is referred to the introduction of[6].
To motivate our work let us
present
what is new herecomparative
withthe
previous
chain ofpublished
papers.In the first
place
and up to ourknowledge,
the unified treatment ofcontinuous and discrete time space with
general multiplicative
functions Zpresented
here has never been covered in the literature. In contrast to pre-viously
referenced papers ourapproach
is contextfree,
itssimply
relies onsemigroup techniques
and Dobrushin’sergodic
coefficient and it isapplica-
ble to a
large
class ofFeynman-Kac type semigroups.
In addition the newintegrability
condition(3)
on the oscillations of V allows us to weaken themixing type
condition(4) usually
made in the literature.In the second
part
of this paper we discuss theapplications
of the aboveresults. First we show how our framework can be used to
study
thelimiting
behavior of the distribution of a Markov killed
particle.
We also indicate how theprevious stability properties
can be used tostudy
theasymptotic
behavior of a class of
genetic type interacting
processes with continuous time space. In this connection ourapproach complements
thestudy
of thestability properties
of McKean-Vlasov diffusions of Tamura[19]
to a classof
interacting
processes in which the interaction goesthrough jumps.
Inaddition,
as noticed in[8],
thesemigroup 03A6
can be associated to asimple generalized
andspatially homogeneous
Boltzmannequation.
Therefore ourresults also
complements
the convergenceanalysis
for Maxwellian molecules of Carlen[2]
and Carlen and al.[3]
to a classequations
withFeynman-Kac representations.
Finally
weinvestigate
thestability properties
of thefiltering equation
forgeneral
Markovsignals
with continuouspaths.
We alsoprovide explicit
cal-culations and conditions underwhich the robust version of the
filtering
equa- tion isasymptotically
stable. To ourknowledge
theasymptotic stability properties
of the robustfiltering equation
have not been coveredby
theliterature on the
subject.
The structure of the paper is as follows: In a
preliminary
section 2 wegive precise
definitions of the mainobjects
used in this work. We also discusssome structural
properties
of thesemigroup ~
in distribution space and wecharacterize the uniform
stability
of ~ in terms of the Dobrushin’sergodic
coefficient associated to a
suitably
chosensemigroup
on E. Theprecise description
of Theorem 1.1 is stated andproved
in section 3 . Weexplain
how these results relate to the discrete time space situation treated in
[6].
In section 4 we derive several
easily
verifiable conditions on thepair (Z, X)
underwhich the
semigroup ~
isasymptotically
stable. We alsogive explicit
and useful estimates of the
Liapunov exponent
for continuous and discrete time spacesemigroups.
Section 5 is devoted to theapplications
of thegeneral
results to the
analysis
of thestability
of killed Markovparticles, interacting
processes and nonlinear
filtering equations.
2.
Description
of the models and statement of some results LetM(E)
be the space of all finite andsigned
measurable measures on(E, ~)
with the total variation normwhere the supremum and the infimum is taken over all subsets A E ~*. We also recall that any transition function
T(x, dz)
on Egenerates
twointegral operations.
The first oneacting
on the setB(E)
of bounded £-measurable functionsf :
E -~ II~ and the second one on the setM(E)
of finite measuresIf we write
Mo (E)
thesubspace of M(E)
of measures ~c such that~c(E) _
0 then any Markov transition
T(x, dz)
on E can beregarded
as anoperator
T :Mo (E) - Mo (E)
and its norm isgiven by
The
quantity j3(T)
is a measure of contraction of the total variation distance ofprobability
measures inducedby
T. It can also be defined aswhere the
quantity a(T)
isusually
called the Dobrushin’sergodic
coefficient of T and it is definedby
where the infimum is taken over all x, z E E and all resolutions of E into
pairs
ofnon-intersecting
subsets ; and m ~ 1(see
forinstance [10]).
To describe our
underlying
stochasticmodel,
let begiven
a process X =(Xt)tEI taking
values in the measurable space(E, ~)
and definedon some set S~. In
particular,
noassumption
is made on theregularity
otthe
trajectories,
since it will not beimportant
for ourgeneral
considera-tions
(but
in thepractice
of continuoustime,
such aproperty
can be usefulto
get
the existence ofregular
conditional distributions or to check themeasurability
conditionspresented
below and that is one of the reasonwhy
it will be convenient in section 5 to return to atopological setting).
For any s E I and t E I U
~-~-oo~ verifying s x t,
let(respectively
denote the
03C3-algebra generated
on SZby
themappings Xr,
for alls r x t
(resp.
s rt).
We will also write F := Toput
a(non necessarily time-homogeneous) regular
Markovian structure on thisframework,
let begiven,
forany t E I
and x EE,
aprobability
onthe mesurable space
(SZ,
We make thehypothesis
that it is indeed mesurable in x EE,
in the sense that for any bounded measurablemapping
G : :
(E~t, ~®It) -~ R,
the function E 3 x - is mea-surable,
where of courseIt :_ ~s
EI : s > t~.
Our mainassumption
isthat
(SZ, (Xt)tEI,
is Markovian. Thisjust
meansthat for any x E E and any bounded measurable
mapping
G :
(EIt, , ~~It)
~ R,IEt,Xt [G(X)]
is a version of the conditionalexpecta-
tion If ~u is an "initial"
probability
distribution onE,
we define for any s E Ithen with the above
notations,
for any t > s,[G(X)]
is also a versionof the conditional
expectation
As
usual,
we associate to the abovesetting
atime-inhomogeneous
transitionsemigroup
P = ; st~ acting
onB(E) by
Now let Z =
t~
be a collection of stochasticmultiplicative
functions
satisfying
thefollowing
set of conditions. For anyr x t,
.
Zs,t
is aFs,t--measurable positive
and bounded random variable..
Zs,s
= 1 andZs,t
=Zs,r Zr,t
To see that the
mappings ~
defined in(1)
form asemigroup
we firstnotice that where
Then we use the
multiplicative properties
of Z and the Markovproperty
of X to check that H =~.~Is~t ; s t~
is a well definedsemigroup
onB(E).
From these observations one concludes that ~ is a well defined
semigroup
on
Mi(E).
To see this lastclaim, by
thesemigroup property
ofH,
we noticethat for any 5 ~
By
definition of and we obtainfrom which we conclude that ~ is a
semigroup.
Beforepresenting
somestructural
properties
of theFeynman-Kac
distributions(1)
let us fix someof the
terminology
used in thesequel.
Thesemigroup 03A6
onM1(E)
is saidto be
asymptotically
stable if it satisfies thefollowing property
When the rate of convergence is
exponential
in the sense that there existssome s E I
and I
> 0 such that forany t > s
~ is said to be
exponentially asymptotically
stable.Our
analysis
will be based on thefollowing
lemma. It says that the non- linearmapping
is thecomposite mapping
of a nonlinear transformation and a linearsemigroup
in distribution space.LEMMA 2.1. - For any s t and ,u E
M1 (E)
we have thefollowing decomposition
where the
mapping
:M1(E)
-~M1(E)
isdefined by
and = ; s r
t~, t E I,
is a collectionof
linearsemigroups
defined for
anyf
EB(E)
and ~c EM1(E)
and s r tby
Proof.
Since gt,t = = 1decomposition (7)
is trivial. Let uscheck that for any fixed time
parameter t
EI,
is a linearsemigroup.
For any 0 s u r t and f ~ B(E) we clearly have that
Since
Hu,r(gr,t)
= = = 9u,t one concludes thatThe end of the
proof
is nowstraightforward.
DRemark 2.2. -
By
construction andusing
the Afarkovproperty of
X it is easy to see that the transition kernels
I~~t~ (x, dz),
s r t maylikewise be
defined by setting
The
asymptotic stability properties
of 03A6 can be characterized in terms of the Dobrushin’sergodic
coefficient of the linearsemigroups ~.K~t>
;PROPOSITION 2.3. - For any s t and ~c, v E we have that
where the supremum is taken over all distributions ~C, v E
M1(E).
Proof.
- Theinequality (8)
is asimple
consequence of(5)
and thedecomposition (7) given
in Lemma 2.1. Let us prove(9).
Since for anyx ~ E and s t
it follows that
The reverse
inequality
is a consequence of(8)
and theproof
of(9)
is nowcompleted.
DA crucial
practical advantage
of(9)
is that itgives
a first connection be- tween thestability properties
of the nonlinearsemigroup 03A6
and theergodic
coefficients associated to a collection of linear
semigroup
We end this
preliminary
sectionby noting
that thesemigroup ~
may havecompletely
different kinds oflong
time behavior. Forinstance,
if themultiplicative
functions Z are trivial in the sense thatZs,t
=1,
forany s x t
thenIn this case the
asymptotic stability properties
of 03A6 are reduced to thatof P and
At the
opposite
if thesemigroup
P is trivial in the sense thatPs,t
=I d,
for any s t then
In this situation
,C3{I~~~t )
= 1 and one cannotexpect
to obtain uniformstability properties. Indeed
if I = and the functions Z aregiven
for anys t by
then can be rewritten as follows
It is then
easily
seen that tends as t --~ oo and in narrow senseto the restriction of p to the subset
where the essential infimum is understood over ~c.
3. An
Asymptotic Stability
TheoremThe results
developed
in this section are a morecomplete
form of those in[6].
Next condition on themultiplicative
functions Z ispivotal.
(Z)
There exists a timeto E I
and apositive
function ~ : :7~
3(t, u)
t2014~( o,1 ~ ,
such that forany t > to,
any x EE,
any u E I and allmappings f, 9 E B(E) taking only positive values,
with the convention
zt (0)
= 1.In
particular,
if the conditionalexpectation
=y]
admits aregular
version in y EE,
then condition(,~)
isimplied by
thevalidity
ofthe
following bounds,
forany t > to,
any x,y, y’ E E
and any u EI B ~0~,
(if
E is atopological
space, anequivalence
even holds under certain conti-nuity
andstrong mixing assumptions).
The above
hypothesis
allows to extend themethodology developed
in[6]
to
analyze
the contractionproperties
of thesemigroups
with the col- lection ofprobability
transitions =r~
definedby
Next for u E I
and s t ~ I,
we denoteby Iu ( s, r)
the discrete subset of I definedby
with the
integer part
of a G I~.Condition
(,~)
is notreally
restrictive and it is alsoeasily
verifiable.For instance let us suppose that I = and Z is
given by
thefollowing
exponentials
. -’-for some
nonnegative,
bounded and measurable function V : . I x E 3(r, x)
~vr (x)
E In this situation onegets
the bounds(10)
withwhere for any
rEI, osc(Vr)
denotes the oscillation of the functionV.
We also notice that in discrete time
settings (10)
isalways
satisfied foru = 1. More
precisely
assume that I = N and = for any tEN. In thissettings
forany tEN
the random variable EI~~
have
necessarily
the formfor some
positive function gt
on E. Since forany tEN
and x, y E E wehave that
then
(10)
with = 1.PROPOSITION 3.1. -
If (Z)
issatisfied for
someto
E I or more gener-ally if (10)
issatisfied for
some u E I -~0~
and any t >to
then we have thatProof.
- On the basis of the definition of Hgiven
at thebeginning
ofsection 2 it is easy to establish that for any
f E ,~(E),
x EE,
s r tUnder our
assumptions
thisclearly implies
that for anynonnegative
function
f
EB(E)
andIf we combine the above
inequality
with(6)
we see that theergodic
pro-perties
of can be related to that of the transitionsS’~t~
Nloreprecisely
This
implies
that for anyTaking
into account thatit is
easily
seen that( 14)
is a consequence of(16).
DIn view of the
previous proposition
we see that the set of Markov tran-sitions
plays
apivotal
role in thestudy
of thestability properties
of ~. In order to obtain some useful estimate we will use thefollowing assumption.
(S)
There exists sometl
E I and v E I -{0~
such that for anys + v x t /,’ "
for some
nonnegative
constants ES(v)
E[0, 1]
which do notdepend
on theparameter
t.THEOREM 3.2. - Assume that condition
(S)
holdsfor
some constants.
If (Z)
issatisfied for
someto tl (or
moregenerally if (10)
issatisfied for
u = v and any t >t1)
then we havefor
anyt1
s r tTherefore
thefollowing
setof implications
holds.Proof. By Proposition 3.1, (17) iinplies (18).
On the otherhand,
ifwe use the
inequalities
then
(19)
and(20)
areeasily
checked. To prove{21),
wesimply
notice thatas soon as ~ +
v)
with1/p
+1/g
= 1. Thiscompletes
theproof
of thetheorem. D
Next we return to the discrete time space.
Suppose
we have I = N and= for
any t ~ N.
In this situation(15)
and(13) imply
thatfor any s ~
1,B 1,B
Since is a linear
semigroup
thisyields
that for any sFrom
(13)
we can also check that the functions{9s,t
:0 s t~ satisfy
the backward recursions
In the discrete time case we find that for any s x
Therefore if
(S)
holds v = 1 then we see that(18), (19), (20)
and(21)
hold true for v = 1 if we
replace ~T.,.t ( 1 ) by
.4. Lower Bounds for Dobrushin’s Coefficient
The
assumption (S)
holds for instance if thesemigroup P
issufficiently mixing and/or
if Z is a collection ofsufficiently regular
functions. In this section wepresent
a series of conditions on thepair (P, Z)
for whichexplicit
and useful lower bounds of
type (17)
may be obtained. Theseestimating techniques
will be basedessentially
on theproperties
of Dobrushin’sergodic
coefficient. We will also formulate several corollaries of Theorem 3.2.
PROPOSITION 4.1. - Assume that the
multiplicative function
Z and thesemigroup
Psatisfy
thefollowing
condition(ZP)
There exists sometl
E I such thatThen condition
(S)
holds withfor
anytl
s s + v tIn
addition, if inft~I
’Yt :=03B3 > 0 then~’roof.
-By
a directcomputation
zue have for anynonnegative
test functionf
: E -~R+
and for anythus
Therefore the desired bounds are a consequence of
(6).
0The
following special
case is worthrecording.
Let I = and Z begiven by
and V : : x E E -
V(x)
E and v aregiven.
In this situationone can check that
This also
yields
the boundsfrom which one concludes that
~ v E 7 -
{0} :
: ‘dt C T a(Pt,t+v )
> 0 =====~ ~ isasymptotically
stable.In
addition,
if X istime-homogeneous
then(21)
and(23) yields
thatThis
simple approach
works in moregeneral
situations. Asimple
corol-lary
ofProposition
4.1 and Theorem 3.2 is thefollowing
COROLLARY 4.2. -
Suppose
that I = and themultiplicative func-
tion Z is
given by
where V :
: (t, .r)
E x J? t2014~ measurablefunction
such thatThen the
following implication
holdfor
any u > 0In addition
if
we havethen
for
any t > p u and p, q > 1 such that + = 1Furthermore
if
:=tx(u)
> 0for
some u > 0 thenfor
any p > 1 and T > pv and +1 /q
= 1 we have thatProof. -
Under ourassumptions,
theinequality (14) implies
that forUsing
thisinequality
the threeimplications
arestraightforward.
The lastassertion is a clear consequence of
(9).
DThis
special
caseapart, Proposition
4.1only
describes some consequence of the lower bound condition but does not indicate when thisproperty
holds. In the further
development
wegive separate
conditions on Z and P which suffice to check(ZP).
Before weproceed
we next examine anadditional sufficient condition for
(S)
in terms of themixing properties
of P.PROPOSITION 4.3. - Assume that the
semigroup
Psatisfies
thefollow- ing
condition.(P)
There exists sometl
and v E I such thatfor
any t >tl
for
somepositive
constant E~(v)
> 0 and somereference probability
measureE
M1(E).
. Then condition(S)
holds withProof.
- Under(P)
and for anynonnegative
test functionf
weclearly
have for any
Again using (6)
one concludes thatand the
proof
iscompleted.
DUsing (ZP)
or(P)
one can obtain lower bounds for theergodic
coefficient of the transitionprobability
functions To see the connections between these two conditions it is convenient tostrengthen
condition(~).
(Z)’
For anyt, u
E I there exists a constant E{o,1~
such thatAs we shall this in the
foregoing development
this condition is met in manyinteresting applications.
We start
by noting
that ==~(Z)
and(24)
=~( 10) .
In the same wayone can also check that
Zt ( u)
for any(u, t)
EI2
but the functionzt : u E I zt
(u)
E(0, 1] usually
fails to be lower bounded. Moreprecisely
for
any t E I
weusually
have thatlimu~~ zt (u)
= 0 so that(ZP).
Next
proposition
shows that +(P)
~(ZP).
PROPOSITION 4.4. - Assume that condition is
satisfied for
somefunction
z. Then thefollowing
assertions holdProof.
- Theproof
of(25)
is a clear consequence of the definition of To prove(26)
we assume that(P)
is satisfied for some v E I andt 1
E I. Since forany u
vone obtain the lower bound
from which one concludes that
This ends the
proof
of(26).
DLet us now
investigate
another consequence of the later results. Assume that I = and themultiplicative
functions Z aregiven by
where V : E -
R+
is a measurable function on E with bounded oscillationosc(V)
oo. As we havealready
noticed in(12)
condition(.~)
and thelower bound
(10)
hold withIf X is a
sufficiently regular
diffusion on acompact
manifold E then themixing type
condition(P)
holds withfor some constants 0
A,
B oo and for the uniform Riemannian measure on the manifold. In thisspecific situation, using (21)
Theorem3.2,
oneconcludes that for any u E
I, p >
1and t >
p.uSummarizing
it canfinally
be seen thatCOROLLARY 4.5. - Assume that I = and Z is
given by (27)
andthe
semigroup of
Xsatisfies
condition(P)
withEt (u)
=E(u) given by (28).
Then
for
anyp >
1 and u > 0 and T > p u we have thatwith
The best bound in term
of
the constantsA,
Bandosc(V)
is obtainedfor
The last
Feynman-Kac
model which we aregoing
to discuss will be the discrete time case. Nextproposition
is a useful reformulation of the above results in thesesettings.
PROPOSITION 4.6. - Assume that I = N and =
for
any so that the random variables ; can be
defined by (1 ~~ for
some measurablepositive functions
g :=~gt
; . In thissituation holds
if,
andonly if,
gsatisfies
thefollowing
conditionfor
somenonnegative
constants~at
; . In addition we have that. Condition
(Z)
and thecorresponding
lower bounds(10)
hold with.
If (P)
holdsfor
v =1, tl
= 0 andfor
some constantEt{1)
:= Et > 0then we have ;’ ,. "
and
therefore
o
If (P)
issatisfied for
some(v, tl )
EI2
and somepositive function
E :
(s, v)
E I x E ~ E then(ZP)
holds withand
(s)
is alsosatisfied
withIf (P)
issatisfied for
some v E I andtl
= 0 then we have thatand also
. Condition
(ZP)
holdsif
the series~t log
a.t converge, that iso
If inft
at := a > 0 and(P)
holdsfor
some v E I and tl = 0 andinft Et (v)
:=~(?;)
> 0 thenfor
anyp >
1 p.vProof.
- Theequivalence (29)
~ is clear. To prove that(Z)
andthe bounds
(10)
hold with(30)
it suffices to note thatThe three
implications
are a consequence of(22).
Theproof
of(34)
is an-other consequence of
(22)
and the fact that for any0 ~
m + v t andx, y E E
Indeed, (37) implies
that for anynonnegative
test functionf
and therefore
from which
(34)
is a clear consequence of(22).
If we combine( 18)
and(30)
one obtain
(33),
that isUnder our
assumptions
thisimplies
thatfrom which the end of
proof
of(36)
isstraightforward.
D5.
Applications
As we said in the introduction the
analysis
ofFeynman-Kac semigroups
as those studied in this work has motivations
coming
from nonlinear esti- mation such as nonlinearfiltering
and numerical functionoptimization
butalso from
physics
andbiology.
Next wepresent
severalgeneric examples
ofmultiplicative
functions Z andsemigroup
Ptogether
with some commentsconcerning
their derivations. Unless otherwisestated,
we assume from nowon that I = that E is a Polish space and that the
underlying probability
space
(0, F)
is the canonical set of allcadlag trajectories,
endowed with the classical Skorokhodtopology
and its Borelian 03C3-field. Moregenerally,
onecould work with
progressively
measurable Markov processes, but we don’t want to deal here with this kind of extensions(cf. [9]).
.5.1. Markov killed
particle
Let us start from a remark that the distributions of a random
particle
killed at a
given
rate and conditionedby
non-extinction can be describedby
aFeynman-Kac
nonlinearsemigroup.
Moreprecisely
let us suppose that X and V aretemporally homogeneous
and that V : E - R- is agiven nonpositive
measurable function. Let us write0~
thesemigroup
of X. .
By
themultiplicative property,
the transitions0~
defined for any measurable test function
f by setting
form a
semigroup
which is sub-Markovian in the sense that(x, E)
1for some x’s and t’s. The
semigroups
and P are related one anotherby
the relations
To turn the sub-Markovian
semigroup {P(v)t; t 0}
into the Markoviancase we
adjoin classically
to the statespace E
acemetery point
denotedby
A and we define a Markovian
semigroup 0~ by setting
for any measurable subset A E ~If
~X~~’~ ; t > 0~
denotes thecorresponding
Nlarkov process on E U~~~
then we have for any measurable subset A E ~
where =
inf ~t
> 0 =~~
is the life-time ofX w>
. The asymp- toticstability
resultsdeveloped
inprevious
sectionsgive
several conditionsunderwhich a killed
particle
as definedpreviously
and conditionedby
non-extension
forgets exponentially
fast its initialposition.
COROLLARY 5.1. -
If
the nonlinearsemigroup
~ isasymptotically
sta-ble and
(2)
holdsfor
some -y > 0 thenfor
any t > 0 we have that5.2.
Stability
ofinteracting
processesIn measure valued process and
genetic algorithm theory,
theFeynman-
Kac
semigroup (1)
describes the evolution in time of thelimiting
process ofNloran-type interacting particle systems (see [8]).
Moreprecisely,
let usassume that
. the Nlarkov
process X
is associated to a collection ofgenerators
with domain D CCb (E) .
. the
multiplicative
functions Z are definedby
where V : :
(r, x)
E I x E HYT (x)
E is a bounded measurable functionIn this
specific example
the nonlinearsemigroup 03A6 represents
the evo- lution in time of the solution of the nonlinear andM1 (E)-valued
processdefined
by
.j
where r~ E is a
pregenerator
on E defined on a suitable domainby
The above measure valued evolution
equations
can beregarded
as thelimiting
process associated to a sequence ofinteracting particle systems.
More
precisely, starting
from thefamily
ofpre-generators {/~ ;
;t > 0, r~
Ewe associate an
N-particles system
which is a
time-inhomogeneous
Markov process on theproduct
spaceE~,
N > 1,
whosegenerator
acts onfunctions 4 belonging
to agood
domainby
where the notation
,C~2~
have been used instead of when it acts on the i-th variable of~(xl,
..., xN)
and~x
is the Dirac measure on x E E. From(40)
we notice that in these schemes the interaction betweenparticles
isexpressed through jumps.
To our
knowledge
the earliest work on thesubject
of thelong
time beha-vior of nonlinear
semigroup
associated tointeracting
processes was that of Tamura[19].
In the latter the author studied the convergence of distribu- tions ofMcKean-Vlasov type (in
which the interaction goesthrough drifts)
but he didn’t look to the situation as here where interaction goes
through jumps.
Relatedgenetic-type
schemes for the numericalsolving
ofFeynman-
Kac formula in discrete time
settings
can be found in and[6, 7, 8].
In
physics (1)
can also beregarded
as asimple generalized
andspatially homogeneous
Boltzmannequation (cf. [15]).
Thelong
time behavior of the Boltzmannequation
for Maxwellian molecules is studied in several papers underspecific assumptions
on the collision kerneland/or
on the initial data(see
for instance[2, 3]
and referencestherein).
Our
Feynman-Kac
model does not fit into theseparticular
Maxwellian orMc-Kean Vlasov
settings.
The methoddeveloped
in this papercomplements
in some sense the work of Tamura and the papers on the convergence to
equilibrium
of Boltzmann’stype equations. Although
ourapproach strongly
depends
on theFeynman-Kac representation
of(39)
it exhibits and under- lines someprecise
links between themixing properties
of the firstexplorating
generators Lt
and theasymptotic stability
of(39).
As a
guide
to their usage next we examine how theprevious stability properties
can be used to obtain uniform estimates for theparticle
approx-imating
models(41).
To do this we need to recall some estimatespresented
in
[8].
Let~r~t ; t > 0~
be theparticle density profiles
associated to theN-particle system
=( (~t , ...
and definedby
By Proposition
3.2.5p.100
and the calculationsgiven p.103
in[8]
if thefunction V is
uniformly
bounded in the sense thatthen we have for any f E ,t3(E),
for some finite constant
V
> 0 whichonly depends on ~ ~ V ~ ~ .
Now suppose theFeynman-Kac semigroup 03A6
isexponentially asymptotically
stable in thesense that for some finite constants
To > 0, ~y
> 0 and for anyT > To
Then
using
thedecomposition
and from
(43)
and(44)
we find that for any t >0, T > To
andN >
1It follows that for any
T > To
This
implies
that for any 1 such thatwe have the uniform estimate with
respect
to the timeparameter
5.3. Nonlinear
filtering
In nonlinear
filtering settings,
thesemigroup q. represents
the evolution in time of conditional distributions of asignal
process withrespect
to itsnoisy
observations. In thesesettings
and if I =R+
theFeynman-Kac
for-mula
(1)
is a weak solution of the so called Kushner-Stratonovitchequation (see
for instance[14]).
If I = N theFeynman-Kac semigroup (1)
can alsobe used to model continuous time
filtering problems
with discrete time ob- servations or moreclassically
discrete time nonlinearfiltering problems (see
for instance
[6]
and[7]).
.5.3.1.
Description
of thefiltering
modelLet the
signal
S =~,S’t ; t
E be an E-valued Markov processwith continuous
paths.
We suppose S is seenthrough
anRd-valued
processY =
{Yt ; t
Esatisfying
thefollowing
where h : E ~
Rd
is asufficiently regular
function and V = Eis a d-dimensional Wiener process,
independent
of5,
and a is an invertibled x d-matrix. We further assume that the transition
semigroup Q = ~Qt ; t >
0~
of S is associated to apregenerator
L : :,~1. -~ Cb (E)
whereA
is asuitably
chosen
algebra A
ECb (E) .
We also make theassumption
that for any x E E there exists aunique probability
measureI~x
onQi = G(IIg+, E)
such thatSo
o- b~
and for allf
EA
the processis a