arXiv:0904.2342v1 [math.CA] 15 Apr 2009

arXiv:0904.2342v1 [math.CA] 15 Apr 2009

for nonexpansive operators in Banah spaes

Guillaume Vigeral

EquipeCombinatoireetOptimisation,CNRSFRE3232,UniversitéP.et M.Curie,Paris6,UFR929

175rueduChevaleret,75013Paris,Frane

guillaumevigeralgmail.om

November 16, 2018

Abstrat

We onsider some disrete and ontinuous dynamis in a Banah spae involv-

ing a non expansive operator J ^{and a} orresponding family of stritly ontrat- ing operators Φ(λ, x) := λJ(^1−λ_λ x) ^for λ ∈]0,1]^{. Our motivation omes from the}

study of two-player zero-sum repeated games, where the value of then^-stagegame

(resp. the value of the λ^{-disounted game) satises the relation} v_n = Φ(¹_n, v_n−1)

(resp. vλ = Φ(λ, vλ)^{) where} J ^{is the Shapley operator of the game. We study the}

evolution equation u^′(t) = J(u(t))−u(t) ^{as well as assoiated Eulerian shemes,}

establishinganewexponentialformulaandaKobayashi-likeinequalityforsuhtra-

jetories. We prove that the solution of the non-autonomous evolution equation

u^′(t) = Φ(λ(t), u(t))−u(t) ^{has the same asymptoti behavior (even when it di-}

verges) as the sequene v_n ^{(resp. as the family} v_λ^{) when} λ(t) = 1/t ^{(resp. when} λ(t) ^{onverges slowly enough to 0).}

1 Introdution

The topi of the asymptoti behaviorof trajetories dened through nonexpansive map-

pings in Banah spaes arise in numerous domains suh as nonlinear semigroups the-

ory [3,6,7,12,13,17,21℄, game theory [15,19,20,2426℄ as well as in disrete events

systems [911℄.

Given anonexpansive funtion

J

^{froma Banahspae}

X

^{to itself,evolution equation}

U

^′

(t) = J(U (t)) − U (t)

^(1.1)

is apartiular ase of the widely-studied

U

^′

(t) ∈ − A(U(t))

for a maximal monotone operator

A

^{. Typially, the study of the asymptotis for suh}

evolutionequationanditsEulerianandproximaldisretizationshasbeenmadeinHilbert

[15,21℄. Anotherusual assumption is the non emptiness of the set

A

⁻¹

(0)

^.

Ontheotherhand,intheframeworkoftwo-personzero-sumgamesrepeatedindisrete

time, the values

v

n ^and

v

λ ^{of the}

n

^{-stage (resp.}

λ

-disounted) gamesatisfy respetively:

v

n

= J

ⁿ

(0) n = Φ

1 n , v

n−1

(1.2)

v

λ

= Φ(λ, v

λ

)

^(1.3)

where

J

^{is the so-alled Shapley operator of the game and}

Φ(λ, x) := λJ

^1−λ_λ

x

. This

operator

J

^isnonexpansivefortheuniformnorm,hene

A = I − J

^{isamaximalmonotone}

operator in the sense of [12℄. However two unusual fats appears in the study of the

asymptotis of those values: rst

A

⁻¹

(0)

^{, the set of xed points of}

J

^{, is generallyempty.}

Anotherdiultyliesinthelakofsmoothnessofthe unitball

B

^k·k∞^{,whihmightindue}

osillationsof the disrete trajetories dened above [15℄.

The purpose of this paper is to investigate the relation between several disrete and

ontinuous dynamis in Banah spaes. Beause our motivation omes from this game-

theoreti framework, we neithermakeany geometrial assumptionson the unit ball, nor

supposenon emptinessof

A

⁻¹

(0)

^{. Inontinuous time,dynamisthatwe willonsider are}

(1.1) as wellas non autonomousevolutionequations of the form

u

^′

(t) = Φ(λ(t), u(t)) − u(t)

^(1.4)

for some parametrizations

λ

^{. We establish that the quantities dened in (1.2) and (1.3)}

behave asymptotiallyasthe solutions of thesevarious evolution equations. Surprisingly

this is true not only when there is onvergene; even when they osillate we prove that

disreteand ontinuous trajetories remainasymptotiallylose.

Setion 2 is devoted to denitions and basi results. In Setion 3 we study the re-

lation between the solution

U

^{of evolution equation (1.1) and related Eulerian shemes,}

establishing in partiular that

k v

n

−

^U(n)n

k

^{onverges to 0. In the proess we prove that}

some lassial results (e.g. exponential formula [7℄, Kobayashi inequality [13℄) involving

the proximal trajetories for a maximal monotone operator

A

^{have an Eulerian expliit}

ounterpartinthease

A = I − J

^{. InSetion4weonsiderthe nonautonomousequation}

(1.4). Weshow that for

λ(t) =

¹_t ^{the solution behave} asymptotially asthe sequene

v

n^,

and that when

λ

^{onvergesslowlyenoughto 0the solutionbehave} asymptotiallyasthe family

v

λ^.

2 Disrete time model

2.1 Nonexpansive operators

Let

(X, k · k )

^{be aBanah spae, and}

J

^a nonexpansivemapping from

X

^{into itself:}

k J(x) − J(y) k ≤ k x − y k ∀ (x, y ) ∈ X

²

.

Wedene, for

n ∈ N

and

λ ∈ ]0, 1]

^,

V

n

= J (V

n−1

) = J

ⁿ

(0)

^(2.1)

V

λ

= J ((1 − λ)V

λ

)

^(2.2)

Notie that

V

λ ^{is well-dened beause}

J ((1 − λ) · )

^{is stritly ontrating, hene has a}

unique xed point.

Example 2.1 For any

c ∈ R

, the mapping

J

^from

R

to itself dened by

J (x) = x + c

^is

nonexpansive. In that ase,

V

n

= nc

^and

V

λ

=

_λ^c.

Thesequantities beingunbounded ingeneral(seeabove), we alsointrodue theirnormal-

ized versions

v

n

= V

n

n

^(2.3)

v

λ

= λV

λ ^(2.4)

In the previous example, one gets

v

n

= v

λ

= c

^{for all}

n

^and

λ

^{. In general it is easy to}

prove that these normalized quantities are bounded:

Lemma 2.2 For any

n ∈ N

and

λ ∈ ]0, 1]

^,

k v

n

k ≤ k J (0) k

^(2.5)

k v

λ

k ≤ k J (0) k .

^(2.6)

Proof. Sine

J

^{is non expansive,}

k V

n

− V

n−1

k = k J(V

n−1

) − J (V

n−2

) k ≤ k V

n−1

− V

n−2

k .

By indutionthis impliesthat

k V

n

k ≤ n k V

₁

k = n k J(0) k .

On the otherhand, again using the fat that

J

^{is non expansive,}

k V

λ

k − k J(0) k ≤ k V

λ

− J(0) k

= k J ((1 − λ)V

λ

) − J(0) k

≤ (1 − λ) k V

λ

k

and so

k v

λ

k = λ k V

λ

k ≤ k J (0) k .

To underline the linkbetween the families

{ v

n

}

^{n∈N and}

{ v

λ

}

^{λ∈]0,1] itis alsoofinterest}

tointrodue the familyof stritly ontrating operators

Φ(λ, · )

^,

λ ∈ ]0, 1]

^{,dened by}

Φ(λ, x) = λJ

1 − λ λ x

.

^(2.7)

The funtion

Φ(λ, · )

^{an be seen as a perturbed reession funtion of}

J

^{: beause of the}

nonexpansiveness of

J

^,

λ→0

lim Φ(λ, x) = lim

λ→0

λJ x λ

= lim

t→+∞

J (tx)

t

^(2.8)

whihis the denition of the reession funtionof

J

^[23℄.

The quantities

v

n ^and

v

λ ^{then satisfy the relations}

v

n

= Φ 1

n , v

n−1

; v

0

= 0

^(2.9)

v

λ

= Φ(λ, v

λ

)

^(2.10)

Notie that sine

Φ(λ, · )

^{is stritly ontrating,any sequene}

w

n

∈ X

^satisfying

w

n

= Φ(λ, w

n−1

)

^(2.11)

onverges strongly to

v

λ ^as

n

^{goes to}

+ ∞

^.

2.2 Shapley operators

Animportantappliation,whihis our mainmotivation,isobtained inthe frameworkof

zero-sumtwoplayerrepeatedgames[25℄. Forexampletakethesimplease ofastohasti

game with a nite state spae

Ω

^{, ompat movesets}

U

^and

V

^{for player1 and 2 respe-}

tively, payo

g

^from

U × V × Ω

^to

R

, and transition probability

ρ

^from

U × V × Ω

^to

∆(Ω)

^{(the set of} probabilities on

Ω

^{). Let}

S = ∆

f

(U )

^(resp.

T = ∆

f

(V )

^{) the sets of}

probabilitiesonU(resp. V)withnitesupport; westilldenoteby

g

^and

ρ

^themultilinear extensions from

U × V

^to

S × T

^{of the} orrespondingfuntions.

The game isplayed asfollow: aninitialstage

ω

1

∈ Ω

^{isgiven, known by eah player.}

At eah stage

m

^{, knowing past history and urrent state}

ω

m^{, player 1 (resp. player 2)}

hooses

σ ∈ S

^(resp.

τ ∈ T

^{). A move}

a

m ^{of player 1 (resp.}

b

m ^{of player 2) is drawn}

aordingly to

σ

^(resp.

τ

^{). Thepayo}

g

m ^atstage

m

^{is then}

g(a

m

, b

m

, ω

m

)

^and

ω

m+1^{, the}

state atstage

m + 1

^{, is drawn aordingly to}

ρ(a

m

, b

m

, ω

m

)

^.

There are several ways of evaluating apayo for a given innite history:

−

¹n

P

n

m=1

g

m ^{isthe payo of the}

n −

^{stage game}

− λ P

+∞

m=1

(1 − λ)

ⁱ⁻¹

g

m ^{is the payo of the}

λ −

^{disounted game.}

For a given initial state

ω

^{, we denote the values of those games by}

v

n

(ω)

^and

v

λ

(ω)

respetively;

v

n ^and

v

λ ^{are thus funtionsfrom}

Ω

^into

R

.

Let

F = { f : Ω −→ R }

^{; the Shapley operator}

J

^from

F

^{to itself is then dened by}

f → J(f)

^{, where}

J(f)

^{is the funtion from}

Ω

^to

R

satisfying

J(f )(ω) = max

σ∈∆(U)

min

τ∈∆(V)

(

g (σ, τ, ω) + X

ω^′∈Ω

f (w

^′

)ρ(ω

^′

| σ, τ, ω) )

(2.12)

= min

τ∈∆(V)

max

σ∈∆(U)

(

g (σ, τ, ω) + X

ω^′∈Ω

f (w

^′

)ρ(ω

^′

| σ, τ, ω) )

(2.13)

Then

J

^is nonexpansive on

F

^{endowed with the uniform norm. The value}

v

n ^{of the}

n

^{-stage game (resp. the value}

v

λ ^{of the}

λ

^{-disounted game)satises relation (2.9) (resp.}

(2.10)).

Thisreursivestrutureholdsinawidelassofzero-sumrepeatedgamesandthestudy

of the asymptoti behavior of

v

n ^(resp.

v

λ^{) as}

n

^{tends to}

+ ∞

^{(resp. as}

λ

^{tends to 0) is}

a major topi in game theory (see [25℄ for example). Convergene of both

v

n ^and

v

λ ^(as

well asequality of the limits) has been obtained for dierent lass of games, forexample

absorbing games [14℄, reursive games [8℄, games with inomplete information [2℄, nite

stohasti games [4℄[5℄, and Markov Chain Games with inomplete information[22℄.

Even in the simple ase of a nite stohasti game where the spae

F

^{on whih}

J

is dened is

R

ⁿ, the Shapley operator

J

^{is only} nonexpansive for the uniform norm

ℓ

^∞.

In the ase of a general Shapley operator

J

^{, the Banah spae (whih may be innite}

dimensional)onwhih

J

^isnonexpansiveisalwaysasetofboundedrealfuntions(dened onaset

Ω

^{ofstates)endowedwiththeuniformnorm. Asshownin[11℄and[15℄,thislakof}

geometrialsmoothnessimplies that the families

v

n ^and

v

λ ^{may not onverge. They may}

also onverge to two dierent limits [16℄. However the goal of the so alled "Operator

Approah" (see [24℄ and [26℄) is to infer, from spei properties in the framework of

games, onvergene of both

v

n ^and

v

λ ^{aswell asequality of their limits.}

Aloselyrelatedappliation,intheframeworkofdisreteeventsystems,istheproblem

of existene of the yle-timeof a topialmapping [9℄[10℄.

2.3 Assoiated evolution equations

In the urrent paper we investigate a slightly dierent diretion : the aim is to show

that the sequene

v

n ^{and the family}

v

λ ^{dened in equations (2.9) and (2.10) behave}

asymptotially as the solutions of ertain ontinuous-time evolution equations. This is

interesting for at least three reasons: rst, this implies that proving the onvergene of

v

n ^or

v

λ ^{redues to study the asymptoti of the solution of some evolution equation.}

Seond, even if the denitions (2.9) of

v

n ^{and (2.10) of}

v

λ ^{may seem dissimilar sine one}

is reursive and the other is a xed point equation, we will see that the orresponding

equationsinontinuoustimeareofthesamekind,heneitgivesaninsightontheequality

lim v

n

= lim v

λ^{, satised for a wide lass of games. Third, we will prove in the proess}

some results of interest intheir own right.

Notie that equation (2.1) an alsobe writtenas a diereneequation

(V

n+1

− V

n

) = J (V

n

) − V

n ^(2.14)

whihan beviewed asa disreteversion of the evolutionequation

U

^′

(t) = J (U (t)) − U (t).

^(2.15)

Similarly,equations (2.9) and (2.11) an beonsidered as disreteversions of

u

^′

(t) = Φ 1

t + 1 , u(t)

− u(t)

^(2.16)

u

^′

(t) = Φ(λ, u(t)) − u(t)

^(2.17)

respetively. Notie that while (2.17) isautonomous, (2.16) isnot.

The asymptoti relation between solutions of (2.15) and (2.1) will be disussed in

setion3. InthatsetionwewillaalsoprovesomeresultsaboutEulerianshemesrelated

to(2.15),whihhave aninterpretationintermsof gameswith unertainduration[19,20℄

in the ase of a ShapleyOperator.

Insetion4,wewillstudytheasymptotibehaviorofsolutionsofthenon-autonomous

evolution equation

u

^′

(t) = Φ(λ(t), u(t)) − u(t)

^(2.18)

for sometime-dependentparametrizations

λ(t)

^{, whih inpartiular willoverboth ases}

ofequations(2.16)and(2.17). Wewillrstprovethatwhen

λ(t) =

¹_t ^{thesolutionof(2.18)}

has the same asymptotibehavior,as

t

^goesto

+ ∞

^{, asthe sequene}

v

n ^as

n

^{goes to}

+ ∞

^.

We will then examine the ase where the parametrization

λ(t)

^{onverges slowly enough}

to 0, establishing that the solution of (2.18) has then the same asymptoti behavior as

the family

v

λ ^as

λ

^{goes to 0. Finally, using our results in ontinuous time, we will study}

other dynamis in disrete time generalizing (2.9) and (2.11). Similarly to setion 3, in

the ase of a Shapley operator these dynamis have an interpretation in terms of games

with unertain duration.

3 Dynamial system related to the operator

J

Letusdenote

A = I − J

^{;the operator}

A

^is

m

^{-aretive,meaningthat forany}

λ > 0

^both

propertiesare satised:

(i) k x − y + λA(x) − λA(y) k ≥ k x − y k

^forall

(x, y) ∈ X

^2.

(ii) I + λA

^{is surjetive.}

Thisimpliesthat

A

^{ismaximalmonotone[12℄. Reallthattheanalogousinontinuous}

time of equation(2.1) dening

V

n ^{isevolution equation(2.15), whih an alsobe written}

as

U

^′

(t) = − A(U(t))

^(3.1)

with initial ondition

U (0) = U

₀^{, the} Cauhy-Lipshitz theorem ensuring the existene and uniqueness of suh a solution.

Example 3.1 Following example 2.1, suppose

J(x) = x + c

^{. Then one has}

A(x) = − c

^,

so

U(t) = U

0

+ ct

^.

Thissimpleexampleshowsthat,asindisretetimewherethetruesequenetoonsider

is not

V

n ^{but the normalized}

v

n^{, we are not expeting onvergene of}

U(t)

^{but rather of}

the normalized quantity

U(t)

t ^{. This is a onsequene of the fat that we do not assume}

non emptiness of

A

⁻¹

(0)

^.

(3.1). For every

x

₀

∈ X

^{and any sequene}

{ λ

n

}

^{in [0,1℄1 the expliit Eulerian sheme is}

dened by

x

n

− x

n−1

= − λ

n

Ax

n−1 ^(3.2)

that is

x

n

= Y

1

i=n

[I − λ

i

A]

!

(x

0

).

^(3.3)

Notie that hoosing

x

0

= 0

^and

λ

n

= 1

^{for all}

n

^{leads to the denition (2.1) of}

V

n^.

Other disrete trajetories are impliitproximal shemes (rst introdued when

A =

∂f

^{in[18℄) whihsatisfy:}

x

n

− x

_n−1

= − λ

n

Ax

n

that is

x

n

= Y

1

i=n

[I + λ

i

A]

⁻¹

! (x

0

).

In both ases wedenote

σ

n

= X

n

i=1

λ

i ^(3.4)

τ

n

= X

n

i=1

λ

²_i

.

^(3.5)

Usuallyproximalshemessharebetterasymptotiproperties(takethesimpleexample

where

A

^{is a rotationin}

R

² and

λ

n

∈ / ℓ

^{2: then the proximal sheme will onverge to the}

xedpointoftherotation,whiletheEulerianonewilldiverge). HoweverEulerianshemes

havetheremarkablefeaturethattheyanbeomputedexpliitly,andtheyarisenaturally

in the game-theoreti framework:

Example 3.2 When

J

^{istheShapleyoperator ofastohastigame}

Γ

^,

x

n ^denedby(3.2)

is the non-normalized value of the following

n −

^{stage game: states, ations, payo and}

transition are as in

Γ

^{, but at stage 1 there is a} probability

1 − λ

n ^{that the game goes on}

to stage 2 without any payo or transition. Similarly at stage 2, there is no payo nor

transition with probability

1 − λ

n−1^{, and at stage}

n

^with probability

1 − λ

1^{. In that ase}

σ

n ^and

τ

n ^{have a nie} interpretation: the expeted number of stages really played is

σ

n^,

and the variane is

σ

n

− τ

n^{. It is also worthwile to notie that suh games are partiular}

ases of stohastigames with unertainduration [19,20℄.

For this reason wewillstudy exlusivelyEulerian shemes, inthe ase of anoperator

A = I − J

^{. Resultsofthissetionwillbeofthreekind: rstwestudy therelativebehavior}

1

Usually these shemes are dened for any sequene of positive steps, but here, sine we need the

operatorsI−λnA^{tobenonexpansive,wehavetoassumethatthe}λn ^liein[0,1]

ofontinuousand disretedynamiswhen timegoestoinnity. Givenasequene

λ

n

∈ / ℓ

¹

one investigates the asymptoti relation between

U (σ

n

)

^{and the n-th term}

x

n ^{of the}

Eulerian sheme dened in (3.2). This is done rst in the speial ase of

V

n ^(Corollary

3.8) and then in general(Corollary 3.13).

Wealsoonsiderthe aseof axed time

t

^{. Inthat aseone utsthe interval}

[0, t]

^ina

nite number

m

^{of intervalsof length}

λ

i^{. Thesesteps denean expliit sheme by (3.2),}

heneanapproximatetrajetorybylinearinterpolation. Oneexpets suhatrajetoryto

beasymptotiallylosertotheontinuoustrajetorydenedby(3.1)asthedisretization

of the intervalbeomesner. This isproved rst inthe ase where

λ

i

=

_m^{t for}

1 ≤ i ≤ m

(Proposition3.10), and then generalized inProposition 3.14.

In the proess we prove that two lassial results, involving proximal shemes and

holding for any maximal monotone operator, have an Eulerian ounterpart when

A

^is

of the form

I − J

^{: we establish a new} exponential formula in Proposition 3.10 and a Kobayashi-likeinequality inProposition 3.11.

3.1 Asymptoti study of the trajetory dened by equation (3.1)

Thestudy oftheasymptotibehaviorofthesolutionofequation(2.15)ingeneralBanah

spaes has started in the early 70's, in partiular the main result of this subsetion,

Corollary 3.8 relating

v

n ^and U(n)

n ^{, is already known (see [17℄ and [3℄). Here we prove it}

in a dierent way, similar to the rst hapter of [6℄, establishing during the proof some

inequalitiesthat willbehelpful in the remainingof the paper.

Letus begin by proving several useful lemmas:

Lemma 3.3 Let

f

^{be a ontinuous funtion from}

[a, b] ⊂ R

to

R

suh that for every

t ∈ [a, b]

f (t) ≤ M + Z

t

a

[g(s) + β(s)f (s)]ds

for some ontinuous funtion

g

^{and some} non-negative measurable funtion

β

^{suh that}

R

b

a

β(s)ds < + ∞

^.

Then

f

^satises

f(t) ≤ e

^Ratβ(s)ds

M + Z

t

a

g (s)e

^{−Rasβ(r)dr}

ds

for all

t ∈ [a, b]

^.

Proof. Dene

α(t) = M + R

t

a

g(s)ds

^{. Sine}

f (t) ≤ α(t) + R

t

a

β(s)f(s)ds

^{, Gronwall's}

inequality([27℄ p. 15) implies that

f(t) ≤ α(t) + e

^Ratβ(s)ds

· Z

t

a

α(s)β(s)e

^{−Rasβ(r)dr}

ds.

Integrating by part the last integralgives

f (t) ≤ α(t) + e

^Ratβ(s)ds

·

α(0) − α(t)e

^{−Ratβ(s)ds}

+ Z

t

a

α

^′

(s)e

^{−Rasβ(r)dr}

ds

= e

^Ratβ(s)ds

M + Z

t

a

g(s)e

^{−Rasβ(r)dr}

ds

.

In the remaining of the paper we will repeatedly use the following onsequene of

Lemma 3.3:

Proposition 3.4 If

y : [a, b] ⊂ R → X

^{is an absolutely ontinuous funtion satisfying}

for every

t ∈ [a, b]

k y(t) + y

^′

(t) k ≤ (1 − γ(t)) k y(t) k + h(t)

where

γ

^{is a ontinuous funtion from}

[a, b]

^to

[ −∞ , 1]

^and

h

^{is a ontinuous funtion}

from

[a, b]

^to

R

, then

y

^satises

k y(t) k ≤ e

^{−Ratγ(s)ds}

k y(a) k + Z

t

a

h(s)e

^Rasγ(r)dr

ds

for all

t ∈ [a, b]

^.

Proof.

z(t) = y(t)e

^{t satises}

k z

^′

(t) k ≤ (1 − γ(t)) k z(t) k + h(t)e

^{t,heneforevery}

t ∈ [a, b]

k z(t) k ≤ k z(a) k +

Z

t a

z

^′

(s)ds

≤ k z(a) k + Z

t

a

k z

^′

(s) k ds

≤ k z(a) k + Z

t

a

h(s)e

^s

+ (1 − γ(s)) k z(s) k .

Applying Lemma 3.3to

k z k

^{thus gives}

k z(t) k ≤ e

^{Rat1−γ(s)ds}

k z(a) k + Z

t

a

h(s)e

^s

e

^{−Ras1−γ(r)dr}

ds

.

Multiplying eah side by

e

^{−t impliesthe result.}

We nowuse this tehnial result to ompare two solutionsof (2.15):

Proposition 3.5 If both

U

^and

V

^{satisfy (2.15), then}

k U(t) − V (t) k

^is non-inreasing.

Proof. Dene

f = U − V

^{whih satises}

k f(t) + f

^′

(t) k = k J (U (t)) − J(V (t)) k ≤ k U (t) − V (t) k = k f (t) k .

Apply the preeding proposition to

γ ≡ 0

^and

f

^.