A NNALES DE L ’I. H. P., SECTION C
L. C. E VANS H. I SHII
A PDE approach to some asymptotic problems concerning random differential equations with small noise intensities
Annales de l’I. H. P., section C, tome 2, n
o1 (1985), p. 1-20
<http://www.numdam.org/item?id=AIHPC_1985__2_1_1_0>
© Gauthier-Villars, 1985, tous droits réservés.
L’accès aux archives de la revue « Annales de l’I. H. P., section C » (http://www.elsevier.com/locate/anihpc) implique l’accord avec les condi- tions générales d’utilisation (http://www.numdam.org/conditions). Toute uti- lisation commerciale ou impression systématique est constitutive d’une infraction pénale. Toute copie ou impression de ce fichier doit conte- nir la présente mention de copyright.
Article numérisé dans le cadre du programme Numérisation de documents anciens mathématiques
http://www.numdam.org/
A PDE approach to
someasymptotic problems concerning random differential equations
with small noise intensities
L. C. EVANS
(*)
H. ISHIIDepartment of Mathematics, University of Maryland, College Park, MD 20742 USA
Department of Mathematics, Chuo University, Tokyo 112 Japan
Vol. 2, n° 1, 1985, p. 1-20. Analyse non linéaire
ABSTRACT. - We illustrate the effectiveness of
viscosity
solutionmethods for Hamilton-Jacobi PDE
by demonstrating
a newapproach
to a method of W.
Fleming ( [10 ], [ll ])
forproving WKB-type
represen- tations. Wepresent
newproofs
of threeexamples,
dueoriginally
to Ventcel-Freidlin, Varadhan,
andFleming.
RESUME. - On
etudie,
par une methode issue de la théorie desequa-
tions aux derivees
partielles,
certainsproblemes asymptotiques
concernantles
equations
differentiellesstochastiques, quand
l’intensité du bruit tendvers zero. La méthode
employee
est celle des solutions de viscosite pour lesequations
deHamilton-Jacobi.
Cecipermet
uneapproche
nouvelle de la methode deFleming ( [10 ], [.~ 1 ])
pour etablir desrepresentations
dutype
WKB. On donne des demonstrations nouvelles de troisexemples,
dus aVentcel-Freidlin,
Varadhan etFleming.
0 . INTRODUCTION
The
study
ofnonlinear,
first-order PDE of Hamilton-Jacobitype
hasrecently
been facilitated with theintroduction, by
M. G. Crandall and (*) Supported in part by NSF grant MCS-8301265 and the Alfred P. Sloan Foun- dation.2 L. C. EVANS AND H. ISHII
P. L. Lions
[6 ],
of the new notion of weak or so-called «viscosity »
solutionsof such PDE. This
concept,
reformulated inpart by
Crandall-Evans- Lions[5 ],
introduces abody
of new,simple,
andfairly
flexibletechniques
for
investigating
variousquestions, principally
theproblems
ofuniqueness
of weak solutions. These ideas have been
applied
to controltheory
in[2 ] [4]
[16],
etc. and to gametheory
in[3 ] [8 ] [17].
Our purpose in this paper is to
expound
another class ofapplications by illustrating
in some detail the usefulness of these new methods instudying
various
asymptotic problems concerning
random differentialequations
with small noise intensities. We
present
here newproofs
of three related convergence theorems ofWKB-type ;
these various results are dueoriginally
to Ventcel-Freidlin
[19],
Varadhan[18], Fleming [9] ] [10 ],
and Fried-man
[12],
among others. Moreprecisely, given
a differentialequation subject
to random disturbances of « size » e, we consider somesample path
functionaluE,
which should be very small as e -~0,
andtry
to estimate how fast it goes to zero. We look for arepresentation
of the formwhere I is to be determined. Our
technique
forproving (0.1)
and calcu-lating
I consists ingiving
newjustification-by viscosity
solution methods -to anapproach
of W.Fleming [10 (and
Holland[13 ]).
The basicplan
is this :
STEP 1 : Make the
logarithmic change
of unknownand find a PDE that vt solves.
>
STEP 2: Obtain
estimates, independent ofc,
on vt and its first derivatives.STEP 3 : Show that for some
subsequence 8k
-~0,
vEk converges to a func- tion v, which solves a certain first-order PDE.STEP 4:
Interpret
this PDE as thedynamic programming equation
ofa deterministic control
theory problem,
and then show that v = I is the associated value function.In
carrying
outStep
3 andespecially Step
4 wemake
essential use ofthe
properties
ofviscosity
solutionsand,
mostimportantly,
of the repre- sentation formulas forviscosity
solutions of certain PDE(see
the appen-dix, § 4).
There are several
advantages
of ourprocedures
over theoriginal proofs
in
[1 Q J [12 J [18 J [19 ].
First andprincipally,
wepresent
a unifiedapproach
to
questions
therefore attachedby
rather different methods. We haveAnnales de l’Institut Henri Poincaré - Analyse non linéaire
taken some
pains
in thee-xposition (§ 1-3)
toemphasize
the similarities among our solutions of the threeproblems
studied.Secondly
our tech-niques
are almosttotally analytic
and are muchsimpler
than the pro- babilisticproofs
in[12] ] [19 ]. Roughly speaking
wereplace
the difficult Ventcel-Freidlin estimatesby
the not-so-difficult PDE estimatesrequired
for
Step
2 above.Fleming
in[1 D similarly
circumvents the need for the Ventcel-Freidlinbounds,
but hisproofs require
aninterpretation
of v~as the value of a certain stochastic control
theory problem.
Thiscompli-
cation we avoid
by carrying
outStep
3 aboveusing viscosity
solutionmethods;
we then needonly
deterministic controltheory
to discover aformula for v = I. It should be noted that we do encounter some difficulties in
implementing Step
4above,
because of the(infinite) boundary layers
which occur in
examples 2, 3,
but these can be handledby fairly
obviousapproximation procedures.
The
three applications
mentioned above concern theasymptotic
behaviorof exit times
(§ 1),
theprobability
ofexiting through
agiven portion
of theboundary (§ 2),
and theprobability
ofremaining
in agiven
set for agiven
time
(§ 3).
Theappendix (§ 4)
collects facts aboutrepresentation formulas,
from control
theory,
ofviscosity
solutions of various PDE. We will not recall here the definitions and basicproperties
ofviscosity solutions, referring
the reader instead to[5 ].
Below are certain
standing hypothesis
which are assumed to holdthroughout
the paper. We aregiven mappings b :
(~n -~ and c :Rn ~
MM x n,
and then define where n(resp.
Snn)
is the space of all
(resp.
allsymmetric) n
x n matrices. We supposeWe assume further
(A)~ there 1
exists a0! ~ ~ real
number 8 for all > 0x, j
such thatExamples
1-3 concern diffusions within aregion
Q. Werequire
that(A)3
Q c (~n is open andbounded,
with smoothboundary
Hypotheses (A)1-(A)3
takentogether
form condition(A).
Let us note herethat we have made no
attempt
to discover minimalassumptions
underwhich our methods still
hold;
inparticular
it is clearusing
obviousapproxi-
mations that we
really
needonly
assume b to theLipschitz.
Finally,
it is convenient to introduce certain notational conventions4 L. C. EVANS AND H. ISHII
to the Sobolev space
( [o, oo ) ; ~n)
and inparticular
to beabsolutely
continuous on
compact
subsets of[0, oo)
and so differentiable a. e. Given such anx( ~ ),
we define for a. e. s > 0where =
a-l
is the inverse matrix of a. For anyx( ~ )
as above withx(t)
= weget
and
where the infimum of the
empty
set is + oo. These are the first exit times from Q andQ, respectively,
after time t.Lastly,
we letWs(s
>0)
denote astandard n-dimensional Wiener process.
We also note here that our
techniques
extend without excessivedifficulty
to cover various other
WKB-type
estimates. Forexample
we have inunpublished
workgiven
newproofs
of. theasymptotics
for fundamental solutions due to Varadhan[18, § 4 ]
and Friedman[12, Chap. 14, § 5 ] ; however,
ourtechniques
are not self-containedand,
liketheirs, require
some hard estimates of Aronson
[1]..
Finally
let usexplicitly
remark that ourpresentation throughout
isfairly
terse, both to moderate thelength
of the paper and to avoid excessiverepetition
of routine facts fromPDE,
controltheory,
andprobability.
In
particular
agood understanding
of[5 ] [10 ]
andparts
of[14 is
more-or-less a
prerequisite.
1 EXAMPLE 1: ASYMPTOTIC BEHAVIOR OF
We
begin
with afairly simple example, inspired by
Varadhan[18, § 3 ].
Fix e >
0,
x EQ,
and consider the Ito stochastic differentialequation
Let
ii
be the exit time from Q and set for fixed À > 0According
to standardtheory ut
is smooth in Q and solves the PDEAnnales de l’Institut Henri Poincaré-Analyse non linéaire
Denote
by
dist(x,
the distance from x to aS~ in the Riemannian metric determinedby a -1( ~ ) ;
thatis,
Set
THEOREM 1.1. -
(Varadhan [18 ]).
We haveuniformly
on Q.We
present
below a newproof
of thisresult, following
thegeneral
schemeoutlined
in §
0. To thisend,
we setAn easy calculation then reveals
LEMMA 1.2. - There exists a constant
C, independent
of E, such thatProof
- Tosimplify
notation we omit thesuperscript
«8 ».An easy
argument using
barriersgives
We propose next to
estimate Du|
in Qby studying
theauxiliary
functionShould z attain its maximum at some
point
xo EQ,
then at xoand
6 L. C. EVANS AND H. ISHII
Thus
here we used
(1 . 9).
Therefore
However
Hence
LEMMA 1. 3. - The function I E and is the
viscosity
solution ofProof.
A calculation showsConsider now the control
problem
ofminimizing
where
for each control
a( ~ )
EL ~ {o,
oo ; The value functionAnnales de l’lnstitut Henri Poincaré-Analyse non linéaire
is then a
viscosity
solution of thedynamic programming
PDEsee
[7~] ]
for details. Howeverand so J is a
viscosity
solution of(1.11). Finally,
note from(1.14)
thatI(x) = J(x).
DProof of
Theorem 1.1. Inview
of Lemma 1. 2 there is asequence
8k -~ 0 and a function v E such that vEk -~ v
uniformly
on S~.From
( 1. 7)E
it follows that v is aviscosity
solution ofHowever,
aviscosity
solution of(1.15)
isunique:
cf. Crandall-Lions[6, Proposition
III .2 ]. Consequently, v
= I = dist(x, by
Lemma 1. 3.a 2. EXAMPLE 2: ASYMPTOTIC PROBABILITY
OF EXITING THROUGH A GIVEN SUBSET OF SQ This next
application
of our methods is based onFleming [10 ].
Fixe >
0, x
E Q. We turn our attention to the Ito random differentialequation
Suppose Q
is connected and assume also r c aS~ is agiven smooth, nonempty, relatively
open subset of theboundary.
Now set
the
probability
that asample path
of the solution of(2 .1)t
will first exit Qthrough
the « window » r. Then ut is smooth on and8 L. C. EVANS AND H. ISHII
Finally
we define for x E QFollowing Fleming [l0 ],
we introduce thisstrong hypothesis
on the vectorfield
b( ~ ) :
j -’v
Condition
(B)
says that itrequires
an infiniteamount
of energy to resistthe flow determined
by b( ~ )
andstay always
within Q. In theappendix (§ 4)
we derive certain consequences of
(B)
which areemployed
below.THEOREM 2.1
(Fleming [l~ ]).
- Assume in addition tohypotheses
listed before that
b(’)
satisfies condition(B).
Thenuniformly
oncompact
subsets of Q u r.Applications
may be found in[1 Q ] [72] ] and ~19 ].
We
begin
theproof
of(2.5) by setting
a
straightforward
calculationusing (2.3)E gives
LEMMA 2 . 2. - For each Q’ r there exists a constant
C(Q’), independent
of E, such thatProof
- Tosimplify
notation wedrop
thesuperscript
« £ ».Choose
any Q" r and set r" = n r. A barrier
argument
showsConsider now the
auxiliary
functionAnnales de l’Institut Henri Poincaré - Analyse non linéaire
where (
is a smooth cutoff function withsupport
in D". Should z attain its maximum at somepoint
x0 ~0,
then at xoand
Furthermore
and so
(2.10) gives
LEMMA 2. 3. - The function I E and is a
viscosity
solution ofProof
It is routine to establish that I isuniformly Lipschitz
onQ,
I = 0 on r.
To see I
solves .(2.11)
in theviscosity
sense consider the controlproblem
of
minimizing
where
for all controls
a( - )
such thatx(ix)
E r if ix ~. Then10 L. C. EVANS AND H. ISHII
is a
viscosity
solution ofBut notice I =
J ;
so that(2.14)
becomes(2.11).
D LEMMA 2 . 4. - For each x ~ 03A9 ~ 0393Proof
Denote theright
hand side of(2 .15) by I(x). Clearly I(x) I(x), I=I=OonI-’.
Fix x e
Q,
6 >0,
and then choose anabsolutely
continuous functionx( ~ )
so that
for some constant T
independent of a;
such anx( ~ )
existsowing
to Lemma 4.2in the
appendix.
Since aSZ is smooth there exists a smooth
function § :
Rsatisfying
Note then that for 6 > 0
sufficiently small,
the curve lies inQ,
withExtend for t so that E r and
Proofof
Theorem 2 .1.According
to Lemma 2 . 2 there exist a sequence ek -~ 0 and a function v Er)
such that --~ vuniformly
oncompact
subsets of Q u r. From(2. 7)E
we see v to be aviscosity
solution ofAnnales de l’lnstitut Henri Poincaré - Analyse non linéaire
This PDE
implies I Dv _
C in all of Q(cf.
Crandall-Lions[6, § 1.4])
and thus v E that
is,
v has aunique, Lipschitz
extension to ~2.Next,
becauseb( . )
satisfies(B)
we know from Theorem 4 .1 in the appen- dix that _ ~But
then,
since v = 0 onr,
.We must prove the
opposite inequality,
and for this willexploit
thesecond
boundary
condition in(2 . 7)E .
Let us therefore choose somesmooth,
open
Q,
with asmooth, relatively
open subset r’ such that(2 . 23)
0 dist(00’, aS~) ~ j3
and dist(x, r’) /3,
dist(x’, r) (3
for each x E
r,
x’ Er’,
and some number/3
> 0.Choose ~, > 0 and define
where ix
is the exit time from Q’. ThenI~,
isLipschitz
and_
in the
viscosity
sense .Now for
sufficiently
small y > 0 the usual convolutionI~, _-- I~ *
py is defined in Q. Furthermoreaccording
to(2.23)
whereas Jensen’s
inequality implies
Fix a constant M such that
Now consider the
solution v~03BB
of the PDE12 L. C. EVANS AND H. ISHII
As v1
>0,
the maximumprinciple
and(2.7)E imply
But then the maximum
principle
and(2.26)-(2.28) give
Let e = Ek -~ 0 and y ~
0,
in thatorder,
to findThus for
Hence Lemma 4.2 from the
appendix (§ 4) implies
where
But I =
I
inQ, according
to Lemma 2.4. DRemark. For this
proof
we borrowed some ideas from P. L. Lions[14,
§6.i]. 0
_
3. EXAMPLE 3:
ASYMPTOTIC
PROBABILITY OF REMAINING IN QFOR A GIVEN AMOUNT OF TIME
The
following application gives
a newapproach
to certain results of Ventcel and Freidlin[19 ].
Fix s >
0,
xE Q,
T > 0. For each 0 t T we consider the stochastic differentialequation
Define
Q
= Q x(0, T).
Set
the
probability
that asample path
of the solution of(3. l)g
will remainAnnales de l’Institut Henri Poincaré - Analyse non linéaire
within Q at least until time T. Then uE is smooth in
n {
t =T }
andsolves the PDE
Next define
THEOREM 3.1.
(cf.
Ventcel-Freidlin[19]).
- We haveuniformly
for 0 t T and x incompact
subsets of Q.We
begin
theproof by setting
and
calculating
LEMMA 3-. 2. -
i )
For each Q’ c c Q there exists a constantC(Q’), independent
of 8, such thatii) Furthermore,
for each Q’ ~ ~ 03A9 and each 0 a 1 there existsa constant
C(oc, Q’), independent
of 8, such thatProof
- First we setw(x, t)
= T -t).
Then14 L. C. EVANS AND H. ISHII
a)
Estimateof
We may assume
B(0, R)
c Q. Defineand calculate
provided
,u =J1(R)
is chosensufficiently large.
As z >0,
and z = + 00on
a8{o, R),
we haveand
consequently
Finally,
cover anygiven
Of withfinitely
many ballssuch that
R~)
cQ,
andapply (3.11).
B ~7 b)
Estimateof |Dve|.
It is clear from
(3.2)
that t ’-~t )
isnondecreasing.
Hence~c~
>0,
~t 0,
and soConsequently
which estimate in turn
implies
With this in hand we may use the method
explained
in theproof
ofLemma 2 . 2 to derive the
requisite
boundon ) Dw ~ .
Annales de l’Institut Henri Poincaré - Analyse non linéaire
c)
Estimateof
Hölder norm.In view of the
preceding
w isLipschitz
in x onQ’,
and so we needonly
estimate the Holder constant in t.
Let us assume 0 E Q’ c c Q" c c Q. Define
then
Since
w, f E L 00,
standardparabolic
estimatesgive
and
consequently
LEMMA 3 . 3. - The function I ~ and is a
viscosity
solution ofProo, f.
Theproof
is similar to that for Lemma 2 . 3. © LEMMA 3 . 4. - For eachProof
- It suffices to proveH 1 ((o, T) ; Q)
is dense inH 1 ((o, T); S~j,
and this in turn is a consequence of methods used in the
proof
of Lemma 2 . 4.’
D
Proof of
Theorem 3 .1.According
to Lemma 3 . 2 there exist Ek -~ 0 and a function v such that v~k -~v uniformly
for o ~ t T andx in compact
subsets ofQ. Furthermore
(3 . 7jE implies v
is aviscosity
solution of16 L. C. EVANS AND H. ISHII
Since Lemma 3.2
gives
the boundfor each Q’ c c
Q,
we have also(cf.
Crandall-Lions[6,
Thm.1.15])
and thus v E
C°~1(Q’)
for eachQ’
z Q’ x(0, T),
Q’ c c Q. Now in viewof the
representation
formulas forviscosity
solutions of(3.16) (cf.
Theo-rem
4 . 4)
we have for 0 tT,
x E S2’ c cQ,
where
ix
=))
is the first exit time from SZ’ after time t. But thenv(x, t ) inf {1 ~ 2 T ~ x(s) - b(x(s))~ 2ds |x(t)
= x, x{s)
E Q’ for t s _ T .
This holds for all S~’ c c SZ and thus
We now prove
the opposite inequality by utilizing
the secondboundary
condition in
(3 . 7)£ .
Let us therefore choose somesmooth,
open ~‘ ~ ~Q,
fix ~, >0,
and setAccording
to Lemma3. 3, I~,
E and solvesin the
viscosity
sense ; hereQ ~,
= S~’ x( - ~,,
T +~.).
For
sufficiently
small y > 0 the usual convolutionIx --- I~, ~
py is defined inQ,
withFurthermore Jensen’s
inequality implies
Annales de l’Institut Henri Poincaré - Analyse non linéaire
But then
(3. 7)E
and the maximumprinciple give
Let 8 = 8k --~
0,
y -~0, ~, -~ 0,
in thatorder,
to findwhere
Therefore
for
But I =
I
inQ, according
to Lemma 3.4.D
’
’
4. APPENDIX: REPRESENTATION
FORMULAS
FOR VISCOSITY SOLUTIONSOF CERTAIN FIRST-ORDER PDE A. The
equation - (Dv)T aDv -
b . Dv = 0.For this subsection we assume in addition to the
standing hypothesis (A) (see § 0)
that the vector fieldb( . )
satisfies condition(B) (see § 2).
THEOREM 4.1. - Assume
(B)
holds and that v E is aviscosity
solution of
Then for each x E Q
18 L. C. EVANS AND H. ISHII
LEMMA 4.2. - There exist a >
0,
T > 0 such thatif S > T and
x( - )
EH 1 ( [0, S ] ; Q).
Proof
If not, there would existSm >_ m
andxm( ~ )
EH~( [0, Sm ]); ~)
such that
Consequently
Set
then
z,~( ~ )
EH ~ ( [0, m ] ; ~2)
andHence there exist mk oo and
z( . )
E[0, oo) ; Q)
such thatuniformly
oncompact
subsets of[0, oo)
andThis is a contradiction to
(B). D
Remark. Cf.
Fleming [10,
Lemma3 .1 ~. Q
REMARK 4.3. - A
simple
consequence of this lemma is thatgiven
any A >
0,
there existTo, Ao
> 0 such thatProofof
Theorem 4 .1. We can rewrite the firstequation
in(4 .1)
to readAnnales de l’Institut Henri Poincaré - Analyse non linéaire
for
any 03BB
> 0.According
to the results of P. L. Lions[16] ]
and Evans-Ishii
[7] we
therefore haveUsing
Remark 4 . 3 we see that therefore if ~. > 0 issufficiently
smallfor some constant
To, independent of
À. From this follows(4.2). D
The
following proposition
does notrequire
condition(B).
THEOREM 4.4. - Assume v E is a
viscosity
solution ofThen for each
(x, t )
EQ
where ~x =
zx(x( ~ ))
is the first exit time from Q after time t.This is a consequence of results of P. L. Lions
[15 ] [16].
REFERENCES
[1] D. G. ARONSON, The fundamental solution of a linear parabolic equation contai- ning a small parameter, Ill. J. Math., t. 3, 1959, p. 580-619.
[2] G. BARLES, Thèse de 3e cycle, Univ. Paris IX, Dauphine, Paris, 1983.
[3] E. N. BARRON, L. C. EVANS, and R. JENSEN, Viscosity solutions of Isaacs’ equa- tions and differential games with Lipschitz controls, to appear in J. Diff. Eq.
[4] I. CAPUZZO DOLCETTA and L. C. EVANS, Optimal switching for ordinary diffe-
rential equations, to appear in SIAM J. Control and Op., t. 22, 1984, p. 143- 161.
[5] M. G. GRANDALL, L. C. EVANS, and P. L. LIONS, Some properties of viscosity
20 L. C. EVANS AND H. ISHII
[6] M. G. CRANDALL and P. L. LIONS, Viscosity solutions of Hamilton-Jacobi equa- tions, Trans. AMS, t. 277, 1983, p. 1-42.
[7] L. C. EVANS, and H. ISHII, Differential games and nonlinear first-order PDE on bounded domains, to appear in Manuscripta Math.
[8] L. C. EVANS and P. E. SOUGANIDIS, Differential games and representation for-
mulas for solutions of Hamilton-Jacobi-Isaacs equations, to appear in Indiana U. Math. J.
[9] W. H. FLEMING, Inclusion probability and optimal stochastic control, IRIA Semi-
nars Review, 1977.
[10] W. H. FLEMING, Exit probabilities and optimal stochastic control, Appl. Math.
Op., t. 4, 1978, p. 329-346.
[11] W. H. FLEMING, Logarithmic transformations and stochastic control, in Advances
in Filtering and Stochastic Control (ed. by Fleming and Gorostiza), Springer,
New York, 1983.
[12] A. FRIEDMAN, Stochastic Differential Equations and Applications, Vol. II, Academic Press, New York, 1976.
[13] C. J. HOLLAND, A minimum principle for the principal eigenvalue of second
order linear elliptic equations with natural boundary conditions, Comm. Pure Appl. Math., t. 31, 1978, p. 509-519.
[14] P. L. LIONS, Generalized Solutions of Hamilton-Jacobi Equations, Pitman, Boston, 1982.
[15] P. L. LIONS, Existence results for first-order Hamilton-Jacobi equations, to appear.
[16] P. L. LIONS, Optimal control of diffusion processes and Hamilton-Jacobi-Bellman
equations I-III, to appear in Comm. PDE.
[17] P. E. SOUGANIDIS, Thesis, U. of Wisconsin, 1983.
[18] S. R. S. VARADHAN, On the behavior of the fundamental solution of the heat
equation with variable coefficients, Comm. Pure Appl. Math., t. 20, 1967, p. 431-455.
[19] A. D. VENTCEL and M. I. FREIDLIN, On small random perturbations of dynami-
cal systems, Russian Math. Surveys, t. 25, 1970, p. 1-56.
(Manuscrit reçu le 11 janvier 1984) (revise le 20 aout 1984)
Annales de l’Institut Henri Poincaré - Analyse non linéaire