HAL Id: hal-02433395
https://hal.umontpellier.fr/hal-02433395
Preprint submitted on 9 Jan 2020
HAL
is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from
L’archive ouverte pluridisciplinaire
HAL, estdestinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de
Fishery Management in a Regime Switching Environment: Utility Based Approach
Gaston Clément Nyassoke Titi, Jules Sadefo-Kamdem, Louis Fono
To cite this version:
Gaston Clément Nyassoke Titi, Jules Sadefo-Kamdem, Louis Fono. Fishery Management in a Regime
Switching Environment: Utility Based Approach. 2020. �hal-02433395�
Fishery Management in a Regime Switching Environment: Utility Based Approach
NYASSOKE TITI Gaston Cl´ementa, SADEFO KAMDEM Julesb, Louis Aim´e FONOc
aLaboratoire de Math´ematiques - Universit´e de Douala Email: [email protected]
bMRE EA 7491 - Universit´e de Montpellier et DFR SJE - Universit´e de la Guyane
Email: [email protected]
cLaboratoire de Math´ematiques - Universit´e de Douala BP 24157 Douala, Email: [email protected]
Abstract
In this paper we study the problem of optimal fishing for regime switching, which may be regarded as sequential optimal problem with changes of regimes.
The growth dynamics of a given fish species is described by the differential stochastic logistic model in which we take into account two states: prior or during floods and after. The resulting dynamic programming principle leads to a system of variational inequalities, by means of viscosity solutions approach, we prove the existence and uniqueness of the value functions. Then numerical approximation is used to answer the question: what is the optimal fishing effort for a sustainable fishery?
Keywords: : regime switching, floods, crra utility, logistic growth, mean-reverting prices, viscosity solution, Howard’s algorithm .
1 Introduction
The simplest population model commonly used in fisheries is the logistic growth model extended to include catch:
dB
dt =rB(1− B
K)−C (1)
where B is the biomass of the stock, r is the intrinsic rate of growth, K(the
2
carrying capacity) is the biomass the stock would tend toward if unfished, and C is the catch rate.
4
The catch C is constant in quota management. Normally the catch is as- sumed to be proportional to fishing effort and to stock size, which results in the model proposed by (1) :
dB
dt =rB(1− B
K)−qEB (2)
whereEis the fishing effort andqis a parameter describing the efficiency of the fishing gear
6
However, the environment is subject to significant random fluctuations that affect the population per capita natural growth rate. The effect of these fluc- tuations can be approximated by a white noiseσ(t), where(t) is a standard white noise andσ >0 measures the strength of environmental fluctuations see (2). Therefore, the above ODE Eq. (2) must be updated to the stochastic differential equation (SDE) which can be written in the standard format:
dB(t) =rB(t)(1−B(t)
K )dt−qE(t)B(t)dt+σB(t)dW(t) (3) whereW(t) is a standard Wiener process. We will assume thatr−qE > σ2/2, otherwise the population will rendered extinct (see (3) ).
8
Environmentally driven long-term changes in fish populations, which can play a major role in determining how such populations respond to fishing pres-
10
sure, are rapidly being recognized as a critical problem in fisheries science ((4)).
The life cycle of African fish species of river is closely related to the seasons
12
- reproduction almost always occurring just prior to, or during, floods ((5), (6), (7), (8)).
14
Floods appear to be essential for the completion of their reproductive cycle for most species: the absence of floods due to the drought in the Sahel has
16
caused a decline in fish reproduction in the central Niger Delta, the Senegal River and Lake Chad (Stauch, personal communication).
18
There is some evidence that flood intensity acts in favor of reproduction, as it has been observed that the structured age class related to the high floods in
20
the Kafu were more varied ((9)).
In our study we consider only two seasons: the dry season with intensive
22
fishing and reduced reproduction, the flood period with reduced fishing and intensive reproduction.
24
A regime switching model provides an alternate approach to capturing non- constant drift and volatility terms for the stochastic process followed by the
26
biomass of fish. Therefore, the above SDE Eq. (3) must be updated to the another stochastic differential equation that captures the regime swithing :
28
dB(t) =rα(t)B(t)(1−B(t)
K )dt−qEα(t)(t)B(t)dt+σα(t)B(t)dW(t) (4) whereα(t) refer to regimes and there are 2 regimes, i.e,α(t)∈ {1,2}
Certainly, there is some evidence that uncertainty in price parameters leads
30
to changes in the optimal policy ((10)), and the number of studies that in- clude uncertainty in both the biological stock dynamics and the price dynamics
32
is steadily increasing. The models in (11) have considered stochastic mean- reverting prices and when compared with the typical geometric Brownian mo-
34
tion model, a mean-reverting price better reflect basic, microeconomic ideas about supply behavior (see (12)).
36
Let the instantaneous profit from the harvest of the stock biomassπ(Bt, ht) be given as:
π(Bt, ht) =Ptht−c(Bt, ht) (5) where, ht denotes the volume of harvest, Bt the stock of the resource, c(Bt, ht) is the cost function, both at time t and Pt the mean-reverting (ac- tual or spot) price of the harvest at the time of decision making. This can be
modeled by the following process:
dPt=θ(¯p0−p¯1h−Pt)dt+σPdWP(t) (6) The parameters are positve constants,θis the reversion speed, ¯p0is a maximum price, ¯p1is the slope of the inverse demand curve andσP is the volatility of the
38
spot price (see (11)).
Many works set the problem, in the infinite horizon time, as follows:
maxht
Z +∞
0
e−βtπ(Bt, ht)dt (7)
Previous work finds, almost without exception, that all fishers are risk-averse
40
((13), (14), and (15)). Under an expected-utility theory (EUT) specification of choice under uncertainty, we assume a constant relative risk-aversion (CRRA)
42
utility function defined asU(x) = x1−γ
1−γ wherexsignifies the lottery prize and γis the CRRA coefficient to be estimated: withγ= 0 denoting risk neutrality,
44
γ >0 indicating risk aversion, andγ <0 denoting risk loving ((16)).
In recent years, further emphasis has been put on developing models for op-
46
timal management of these stochastic natural resources ((17); (18); (19)). Al- though the number of studies in bioeconomic modeling that include the stochas-
48
tic dynamics are increasing, they are still not adequate.
The time horizon also plays a crucial role in optimal policies and the usual
50
infinite horizon framework problem requires the existence of linear growth con- ditions on drift part of the logistic process for our solution to hold, raising the
52
question of whether another solution may exist or not. In this paper, we consider the finite time horizon T with utility on both profit and remaining biomass.
54
The outline of this paper is as follows. In Section II we formulate a stochastic optimal control problem. Section III the optimal strategies to the utility maxi-
56
mization problem are derived. In Section IV we present examples to illustrate the results. Finally, in section V we end with some summarizing comments.
58
2 Mathematical model
2.1 Stochastic logistic growth model
60
Throughout this paper we let (Ω,F,{Ft}t≥0,P) be a complete probability space with a filtration{Ft}t≥0satisfying the usual conditions (i.e. it is increas-
62
ing and right continuous whileF0contains all P-null sets). LetW(t) andWP(t), t≥0, be scalar independant Brownian motions defined on this probability space.
64
After specifying a stochastic model for biological growth that we use in this paper. The valuation of the biomass can be described in terms of the following
66
variables:
t is time,t∈[0;T] and T is finite-horizon of time.
68
α(t) is a right-continuous-time Markov chain, Ft-adapted with finite state space S = {1; 2} and generator Q = (qij) ∈ R2×R2 such that qij ≥ 0
70
for i 6= j and P2
j=1qij = 0. We assume that the Markov chain α(.) is independent of the Brownian motionsWP(.) andW(.)
72
B(t) stock of fish biomass at time t. Whith initial conditionB(0)>0 rα(t) intrinsic rate of growth in regimeα(t)
74
Eα(t) is the fishing effort which depends on the current regimeα(t) σα(t) is volatility in regimeα(t). In any timerα(t)−qE > σα(t)2 /2
76
We set an SDE under regime switching of the form:
dB(t) =f(t, B(t), α(t))dt+g(t, B(t), α(t))dW(t) (8) ont≥0 with initial valueB(0) =b∈]0;K[, where
f :R+×R+× S →R and g:R+×R+× S →R (9) This equation can be regarded as the result of the following 2 equations:
dB(t) =f(t, B(t), i)dt+g(t, B(t), i)dW(t); i= 1,2 (10)
switching from one to the other according to the movement of the Markov chain.
Recalling that
f(t, B(t), i) =riB(t)(1−B(t)
K )−qEi(t)B(t) and g(t, B(t), i) =σiB(t) (11) B(t) is an unknown stochastic process, that is, the solution to Eq.(8) satisfying the initial conditionB(0) =b such that 0< b < K. The logical requirement is thatB(t) must be positive. The resulting stochastic differential equation does not satisfy the standard assumptions for existence and uniqueness of solutions, namely, linear growth and the Lipschitz condition. Nevertheless, for any positive initial condition, the solution exists and is unique under a hypothesis that both f and g satisfy the local Lipschitz condition and in any timerα(t)−qE > σ2α(t)/2.
The solution of this equation is.(For more details see Appendix A ) Bt,i= Kexp[(ri−qE−(1/2)σ2i)t+σiWt]
h
(K/B0) +riRt
0exp[(ri−qE−(1/2)σi2)s+σiWs]dsi i= 1,2.
(12) 2.2 The Mean- reverting spot price
78
The version of the Ornstein-Uhlenbeck (OU) process we employ here is de- scribed by
dPt=θ(¯p0−p¯1h−Pt)dt+σPdWP(t) (13) where the parameters are positve constants, θ is the reversion speed, ¯p0 is a maximum price, ¯p1 is the slope of the inverse demand curve and σp is the volatility of the spot price. Note that the mean (or long-term) price ¯p0−p¯1h may depend upon the harvest level. WP(t) is standardized Brownian motion as before. Its solution for an initial conditionP(0) =pis
Pt=pe−θt+ (¯p0−p¯1h)(1−e−θt) +σ Z t
0
e−θ(t−s)dWs (14) One of the most convenient properties is that
Pt∼N
¯
p0−p¯1h+ (p+ ¯p0−p¯1h)e−θt,σ2
2θ(1−e−2θt)
(15)
2.3 The optimization problem
The cost of harvest per unit time is assumed to depend on effort and to have a quadratic form given by
c(Bt, Et) = (c1+c2E(t))E(t) (16) wherec1, c2 >0 are constants. The quadratic cost structure incorporates the
80
case where the fishermen need to use less efficient vessels and fishing technologies or pay higher overtime wages to implement an extraordinary high effort (see
82
(20), (21)).
By substituting the values in equation 5, the profit function can be rear- ranged as:
π(Bt, Pt, E) = (qBtPt−c1−c2E(t))E(t) (17) where,c1 andc2are positive parameters.
84
For a timetin the horizon [0, T], we define a performance criterion for each i∈ S as:
Vi(t, bt, pt) =Ebt,pt,i
"
Z T t
e−β(s−t)π(Bs, Ps, Es, i)1−γ
1−γ ds+e−β(T−t)Vi(BT)
#
(18)
=Ebt,pt,i
"
Z T t
e−β(s−t)l(s, Bs, Ps, Es, i)ds+e−β(T−t)m(T, BT)
#
(19) We will start the optimization at timet = 0. Letb0 =b, p0 =p withb, p ∈ ]0; +∞], we have
Vi(0, b, p) =Eb,p,i
"
Z T 0
e−βsπ(Bs, Ps, Es, i)1−γ
1−γ ds+e−βTVi(BT)
#
(20)
=Eb,p,i
"
Z T 0
e−βsl(s, Bs, Ps, Es, i)ds+e−βTm(T, BT)
#
(21) Here Eb,p,i is the conditional expectation given B(0) = b, P(0) = p and
86
α(0) =iunder P, where T is the finite time horizon β >0 is a discount factor.
We say that the control processE(t) is admissible if the following tree con-
88
ditions are satisfied:
1. the SDE (4) for the state processB(t) has a unique strong solution;
90
2. the SDE (6) for the state processP(t) has a unique strong solution;
3. Eb,p,i
RT
0 |e−βtπ(Bt, Pt, Et, i)1−γ
1−γ |dt+|e−βTV(BT)|
<∞.
92
WriteAfor the set of admissible controls. The number of tools, gears, hours, vessels and manpower is finite and limited, so we require the setAin which the
94
controls take values to be bounded. The stochastic control problem is to find an optimal controlE∗∈ Ai such that:
96
vi(b, p) = sup
E∈Ai
Vi(b, p) (22)
3 Main results
The Hamilton-Jacobi-Bellman equations associated with this problem is a variational inequality involving, at least heuristically, a nonlinear second order parabolic differential equations :
∂vi
∂t(t, bt, pt) + sup
E∈Ai
−βvi(t, bt, pt) +π(Bt, Pt, Et)1−γ
1−γ +Lvi(t, bt, pt)
= 0, (23)
vi(T, bt, pt) =κγB1−γT
1−γ f or i∈ {0; 1}; κ >0 (24) whereL is an operator defined by:
Lvi(t, B, P) =θ(¯p0−p¯1qEB−P)∂vi
∂p(t, B, P) +f(B, Ei)∂vi
∂b(t, B, P) +1
2σ2P∂2vi
∂p2(t, B, P) +1
2g2(B, E)∂2vi
∂b2 (t, B, P) +qij(vj(t, B, P)−vi(t, B, P)) (25) As it is well-known, there is not in general a smooth solution of the equation (23) hence we find the solution in the viscosity sense, as introduced by (22), in
subsection 3.2. Recall thatEf ree∗ is the optimal solution of equation 23. The optimal harvest ruleE∗(t) can be described as follows
E∗(t) =
0 ifEfree∗ (t)<0
Efree∗ (t) if 0≤Efree∗ (t)≤Emax
Emax if Efree∗ (t)> Emax
(26)
In addition to these, we know that the fishery is valueless if the stock goes
98
extinct and therefore add the conditionVi(0, Pt) = 0, which must hold for all Ptand i.
100
3.1 On the regularity of value functions
In this section, we study the growth and continuity properties of the value functions.
We shall make the following assumptions: there existρ > 0 such that for all s, t∈[0;T], b, b0 ∈R+, p, p0∈R+and E∈ A
|l(t, b, p, E)−l(s, b0, p0, E)|+|m(b, p)−m(b0, p0)| ≤ρ[|t−s|+|b−b0|+|p−p0|]
(27) and the global linear growth conditions:
|l(t, b, p, E)|+|m(b, p)| ≤ρ[1 +|b|+|p|] (28) Lemma 3.1. Let (27) and (28) hold. For any k ∈ [0; 2] there exists C = C(k;K;T)>0 such that for all h, t∈[0;T],b, p, bt, pt∈R+:
E|Bht,bt|k ≤C(1 +|bt|k); E|Pht,pt|k ≤C(1 +|pt|k) (29)
E|Bht,bt−bt|k≤C(1 +|bt|k)hk2; E|Pht,pt−pt|k≤C(1 +|pt|k)hk2 (30)
E|Bht,bt−Bt,b
0 t
h |k ≤C|bt−b0t|2; E|Pht,pt−Pt,p
0 t
h |k ≤C|pt−p0t|2 (31)
E sup
0≤s≤h
|Bht,bt|k
≤C(1 +|bt|k)hk2; E sup
0≤s≤h
|Pht,pt|k
≤C(1 +|pt|k)hk2 (32)
Proof 3.1. See Appendix B
102
Proposition 3.1. For any i∈ S, the value function denoted byvi(s, b, p)sat- isfies a linear growth condition and is also Lipschitz in (b, p) uniformly in t.
There exists a constantC >0, such that 0≤vi(s, bs, ps)≤C(1 +|bs|+|ps|),
∀(s, bs, ps)∈[0;T]×R+×R+ (33)
|vi(s, bs, ps)−vi(s, b0s, p0s)| ≤C(|bs−b0s|+|ps−p0s|),
∀s∈[0;T], bs, b0s∈R+, ps, p0s∈R+ (34) Proof 3.2. We first show that v is Lipschitz in (b, p), uniformly in t and its linear growth condition.
vi(s, bs, ps) = sup
E∈A
E
"
Z T s
e−β(u−s)l(i, u, Bus,bs, Pus,ps, Eu)du+e−β(T−s)m(BTs,bs, PTs,ps)
#
(35) 1. Using elementary inequality|supA−supB| ≤sup|A−B|, Lipschitz con-
dition (27) onl ;m and from estimate (3.1), with k=1,
|vi(s, bs, ps)−vi(s, b0s, p0s)|
≤ sup
E∈Ai
E
Z T s
e−β(u−s)
l(i, u, Bus,bs, Pus,ps, Eu)−l(i, u, Bus,b0s, Ps,p
0
u s, Eu) du
+e−β(T−s)
m(Bs,bT s, PTs,ps)−m(Bs,b
0 s
T , Ps,p
0 s
T )
≤ sup
E∈Ai
E Z T
s
l(i, u, Bus,bs, Pus,ps, Eu)−l(i, u, Bs,b
0
u s, Ps,p
0
u s, Eu)
du +
m(Bs,bT s, PTs,ps)−m(Bs,b
0 s
T , Ps,p
0 s
T )
≤ sup
E∈Ai
E Z T
s
|Bus,bs−Bs,bu 0s|+|Pus,ps−Pus,p0s| du+
|BTs,bs−BTs,b0s|+|PTs,ps−PTs,p0s|
≤ sup
E∈Ai
Z T s
E
|Bus,bs−Bs,bu 0s|+E|Pus,ps−Pus,p0s| du+
E|Bs,bT s−BTs,b0s|+E|PTs,ps−PTs,p0s|
|vi(s, bs, ps)−vi(s, b0s, p0s)| ≤C
|bs−b0s|+|ps−p0s| (36) 2. from linear growth condition (28) on l ;m and from estimate (3.1), with
k=1,
|vi(s, bs, ps)| ≤ sup
E∈Ai
E
"
Z T s
l(i, u, Bus,bs, Pus,ps, Eu) du+
m(BTs,bs, PTs,ps)
#
(37)
|vi(s, bs, ps)| ≤ρ sup
E∈Ai
E
"
Z T s
1 +|Bus,bs|+|Pus,ps| du+
1 +|Bs,bT s|+|PT|
#
(38)
|vi(s, bs, ps)| ≤ρ sup
E∈Ai
"
Z T s
1 + E|Bus,bs|+ E|Pus,ps| du+
1 + E|BTs,bs|+ E|PTs,ps|
#
(39)
|vi(s, bs, ps)| ≤C(1 +|bs|+|ps|) (40) Proposition 3.2. Under assumptions (49) and (28) the value function v ∈ C0([0;T]×R+×R+). More precisely, there exists a constant C >0 such that
for allt, s∈[0;T], bt, bs∈R+, pt, ps∈R+,
|vi(t, bt, pt)−vi(s, bs, ps)| ≤Ch
(1 +|bt|+|pt|)|s−t|12 +|bt−bs|+|pt−ps|i (41) Proof 3.3. Let 0≤t < s≤T. To prove continuity property in time t, we use the dynamic programming principle.
vi(t, b, p) = sup
E∈Ai
E
"
Z T t
e−β(u−t)l(i, u, But,bt, Put,pt, Eu)du+e−β(T−t)m(Bt,bT t, PTt,pt)
#
(42)
= sup
E∈Ai
E Z s
t
e−β(u−t)l(i, u, But,bt, Put,pt, Eu)du+e−β(s−t)v(s, Bst,bt, Pst,bt, i)
(43)
= sup
E∈Ai
E Z s−t
o
e−βul(i, t+u, Bt+ut,bt, Pt+ut,pt, Et+u)du+e−β(s−t)v(s, Bs−tt,bt, Ps−tt,pt, i)
(44)
0≤vi(t, bt, pt)−vi(s, bs, ps) = sup
E∈Ai
E Z s−t
0
e−β(u)l(i, u, But,bt, Put,pt, Eu)du +e−β(s−t)
v(s, Bs−tt,bt, Ps−tt,bt, i)−v(s, bs, ps, i) +
e−β(s−t)−1
v(s, bs, ps, i)
(45) Applying linear growth condition (27) onl, noting that0≤1−e−β(s−t)≤β(s−t)
andv satisfies (3.1) , we deduce that:
|vi(t, bt, pt)−vi(s, bs, ps)|
≤ sup
E∈Ai
E Z s−t
0
l(i, u, But,bt, Put,pt, Eu) du+
e−β(s−t) v(s, Bt,bs−tt, Ps−tt,bt, i)−v(s, bs, ps, i) +
e−β(s−t)−1
v(s, bs, ps, i)
≤(s−t)12
Z s−t 0
sup
E∈Ai
E
l(i, u, Bt,bu t, pt,pu t, Eu)
2du 12
+ sup
E∈Ai
E
e−β(s−t)
v(s, Bs−tt,bt, Ps−tt,pt, i)−v(s, bs, ps, i) + sup
E∈Ai
E
e−β(s−t)−1
v(s, bs, ps, i)
≤(s−t)12
Z s−t 0
ρ2 sup
E∈Ai
1 + E|But,bt|+ E|pt,pu t|2 du
12
+ sup
E∈Ai
E
v(s, Bs−tt,bt, Ps−tt,pt, i)−v(s, bs, ps, i) +β|s−t|sup
E∈A
E|v(s, bs, ps, i)|
≤ |s−t|12
Z s−t 0
ρ sup
E∈Ai
1 + E|But,bt|+ E|Put,pt| du
+ sup
E∈Ai
E
v(s, Bt,bs−tt, Ps−tt,pt, i)−v(s, bs, ps, i) +β|s−t| sup
E∈Ai
E
v(s, bs, ps, i)
≤C0
|s−t|12 Z s−t
0
(1 + E|But,bt|+ E|Put,pt|)du+ (|bt−bs|+|pt−ps|) +β(1 +|bs|+|ps|)|s−t|
≤Ch
(1 +|bt|+|pt|)|s−t|12 +|bt−bs|+|pt−ps|i (46) 3.2 Existence of viscosity solution
In this section we will first define what we mean by viscosity solutions. Then
104
we will prove that the value function is a viscosity solution.
From the optimization problem (23), we derive the Bellman equations as follows:
∂vi
∂t(t, B, P) + sup
E∈Ai
−βvi(t, B, P) +π1−γ
1−γ+θ(¯p0−p¯1qEB−P)∂vi
∂p(t, B, P) +h
riB 1−B
K
−qEBi∂vi
∂b(t, B, P) +1 2σP2∂2vi
∂p2(t, B, P) +1
2σ2B2∂2vi
∂b2(t, B, P) +qij(vj(t, B, P)−vi(t, B, P))
= 0 (47)
The corresponding Hamiltonian has the following form:
H
i, s, B, P, ui,∂ui
∂s,∂ui
∂b,∂ui
∂p,∂2ui
∂b2 ,∂2ui
∂p2
=∂ui
∂s(s, B, P)+ sup
E∈Ai
−βui(s, B, P)+π(Bs, Ps, Es)1−γ
1−γ +Lui(s, B, P)
= 0 (48) We have the following systems:
H
i, s, B, P, ui,∂ui
∂s,∂ui
∂b ,∂ui
∂p,∂2ui
∂b2 ,∂2ui
∂p2
= 0 f or (i, s, B, P)∈ S ×[0;Ti]×R+×R+
ui(T, B,) =κγ B
1−γ T
1−γ f or i, j∈ {0; 1} κ >0.
(49) we recall that
π(Bs, Ps, Es) = (qBsPs−c1−c2E(s))E(s) (50) In order to study the possibility of existence and uniqueness of a solution of
106
(49), we use a notion of viscosity solution introduced by (22).
108
Let denote the set of measurable functions on [0;T]×R+×R+ with polyno- mial growth of degreeq≥0 as,
Cq([0;T]×R+×R+)
={φ: [0;T]×R+×R+,measurable| ∃C >0,|φ(t, b, p)| ≤C(1 +|b|q+|p|q)}.
(51) Definition 3.1. We say thatui∈ C0([0;T]×R+×R+)is called
i. a viscosity subsolution of (49) if for any i∈ S,ui(T, b, p)≤κγ b
1−γ T
1−γ, for all b ∈ R+, p∈ R+ and for all functions φ ∈ C1,2,2([0;T]×R+×R+)∩ C2([0;T]×R+×R+)and(¯t,¯b,p)¯ such thatui−φattains its local maximum at(¯t,¯b,p),¯
H
i,¯t,¯b,p, φ(¯¯ t,¯b,p),¯ ∂φ(¯t,¯b,p)¯
∂s ,∂φ(¯t,¯b,p)¯
∂b ,∂φ(¯t,¯b,p)¯
∂p ,∂2φ(¯t,¯b,p)¯
∂b2 ,∂2φ(¯t,¯b,p)¯
∂p2
≥0 (52)
ii. a viscosity supersolution of (49) if for anyi∈ S,ui(T, b, p)≥κγ b
1−γ T
1−γ, for all b∈R+,p∈R+ and if for all functionsφ∈ C1,2,2([0;T]×R+×R+)∩ C2([0;T]×R+×R+)and(t, b, p)such thatui−φattains its local minimum at(t, b, p),
H i, t, b, p, φ(t, b, p),∂φ(t, b, p)
∂s ,∂φ(t, b, p)
∂b ,∂φ(t, b, p)
∂p ,∂2φ(t, b, p)
∂b2 ,∂2φ(t, b, p)
∂p2
!
≤0 (53)
iii. a viscosity solution of (49) if it is both a viscosity sub- and a supersolution
110
of equation (49)
Theorem 3.1. Under assumptions (27), the value function v is a viscosity
112
solution of (47).
Proof 3.4. We establish the viscosity super- and sub-solution properties, re-
114
spectively in the following two steps.
Step 1. vi(t, bt, pt),i= 1; 2 is a viscosity super-solution of (47).
We already know that v ∈ C0([0;T] ×R+ ×R+). We first note that vi(T, b, p) = κγ B
1−γ T
1−γ so, the boundary condition at time t = T is clearly satisfied. Let (s, bs, ps)∈[0;T]×R+×R+, i∈ S and φ∈ C1,2,2([0;T]× R+×R+)∩ C2([0;T]×R+×R+) such that vi(., ., .)−φ(., ., .)has a local minimum at (s, bs, ps). Let N(bs, ps) a neighborhood of (s, bs, ps) where vi(., ., .)−φ(., ., .) take its minimum, we introduce a new test-function ψ as follows:
ψ(., ., ., j) =
φ(., ., .) + [vi(s, bs, ps)−φ(s, bs, ps)], ifj=i vi(., ., .), if j6=i.
(54)
This helps us to suppose without any loss of generality that this minimum
116
is equal to 0.
Let τα be the first jump time of α(t) = α(t)bs,ps,i
, i.e. τα = min{t ≥ s : α(t)6= i}. Then τα > s, a.s. Let θs ∈ (s, τα) be such that the state
(Btbs,i, Ptps,i)starts at(bs, ps)and stays inN(bs, ps)fors≤t≤θs. Apply- ing the generalized Itˆo’s formula to the switching processe−βtψ(t, Bt, Pt, α(t)), taking integral fromt=stot=θs∧h, whereh >0is a positive constant, and then taking expectation we have
Ebs,ps,i
e−βθs∧hψ(θs∧h, Bθs∧h, Pθs∧h, α(θs∧h))
=ψ(s, Bs, Ps, i)+Ebs,ps,i
"
Z θs∧h s
e−βt
−βψ(t, Bt, Pt, α(t))+∂ψ(t, Bt, Pt, α(t))
∂t +h
riBt
1−Bt
K
−qEBt
i∂ψ(t, Bt, Pt, α(t))
∂b +θ(¯p0−¯p1qEBt−Pt)∂ψ(t, Bt, Pt, α(t))
∂p +1
2σ2Bt2∂2ψ(t, Bt, Pt, α(t))
∂b2 +1
2σP2∂2ψ(t, Bt, Pt, α(t))
∂p2 +qα(t)j(ψ(t, Bt, Pt, j)−ψ(t, Bt, Pt, α(t)))
dt
#
; α(t)6=j (55)
From hypothesis, for anyt∈[s, θs∧h]
vi(t, Btbs, Ptps)≥φ(t, Bbts, Ptps)+vi(s, bs, ps)−φ(s, bs, ps)≥ψ(t, Btbs, Ptps, i) (56) Recalling that(Bsbs, Psps) = (bs, ps)and using Equations (54) and (56), we have
Ebs,ps,i
e−βθs∧hψ(θs∧h, Bθs∧h, Pθs∧h, α(θs∧h))
≥ +vi(s, bs, ps) + Ebs,ps,i
"
Z θs∧h s
e−βt
−βvi(t, Bt, Pt) +∂ψ(t, Bt, Pt, α(t))
∂t +h
riBt 1−Bt
K
−qEBti∂ψ(t, Bt, Pt, α(t))
∂b +θ(¯p0−¯p1qEBt−Pt)∂ψ(t, Bt, Pt, α(t))
∂p +1
2σ2Bt2∂2ψ(t, Bt, Pt, α(t))
∂b2 +1
2σP2∂2ψ(t, Bt, Pt, α(t))
∂p2 +qij(vj(t, Bt, Pt)−vi(t, Bt, Pt))
dt
# (57)
By Bellman’s principle
ψ(s, bs, ps, i) =vi(s, bs, ps) = sup
E∈Ai
Ebs,ps,i
Z θs∧h s
e−βtl(i, t, Bts,bs, Pts,ps, Et)dt +e−β(θs∧h)vi(θs∧h, Bθs,bs
s∧h, Pθs,ps
s∧h)
≥ sup
E∈Ai
Ebs,ps,i
Z θs∧h s
e−βtl(i, t, Bts,bs, Pts,ps, Et)dt +e−β(θs∧h)ψ(θs∧h, Bθs,bs
s∧h, Pθs,ps
s∧h, i)
(58) Settingτ = E(θs∧h)combining (57) and (58) and multiplying both sides by1/(τ−s)>0 , we obtain
sup
E∈Ai
Ebs,ps,i
"
1 τ−s
Z θs∧h s
e−βt
βvi(t, Bt, Pt)−∂ψ(t, Bt, Pt, α(t))
∂t
−h riBt
1−Bt K
−qEBti∂ψ(t, Bt, Pt, α(t))
∂b −θ(¯p0−¯p1qEBt−Pt)∂ψ(t, Bt, Pt, α(t))
∂p
−1
2σ2Bt2∂2ψ(t, Bt, Pt, α(t))
∂b2 −1
2σP2∂2ψ(t, Bt, Pt, α(t))
∂p2
−qij[vj(t, Bt, Pt)−vi(t, Bt, Pt)]−l(i, t, Bs,bt s, Pts,ps, Et)
dt
#
≥0 (59) letting τ ↓ s and using the dominated convergence theorem, it turns out that
e−βs
"
−∂ψ(s, bs, ps, i)
∂t + inf
E∈Ai
βvi(s, bs, ps)−
h ribs
1−bs
K
−qEbs
i∂ψ(s, bs, ps, i)
∂b −θ(¯p0−p¯1qEbs−ps)∂ψ(s, bs, ps, i)
∂p
−1
2σ2b2s∂2ψ(s, bs, ps, i)
∂b2 −1
2σP2∂2ψ(s, bs, ps, i)
∂p2
−qij[vj(s, bs, ps)−vi(s, bs, ps)]−l(i, s, bs, ps, Es) #
≥0 (60) This shows that the value functionvi(t, bt, pt),i= 1; 2satisfies the viscos-
118
ity super-solution property (53).
Step 2. vi(t, bt, pt),i= 1; 2 is a viscosity sub-solution of (47).
We argue by contradiction. Assume that there exist an i0 ∈ S, a point
(s, bs, ps)∈ [0;T]×R∗+×R∗+ and a testing function φi0 ∈ C1,2,2([0;T]× R∗+×R∗+)∩ C2([0;T]×R∗+×R∗+)such thatvi0(., ., .)−φi0(., ., .)has a local maximum at(s, bs, ps)in a bounded neighborhoodN(bs, ps),vi0(s, bs, ps) = φi0(s, bs, ps), and
min
"
−∂φi0(s, bs, ps)
∂t + inf
E∈Ai0
βvi0(s, bs, ps)−
h ri0bs
1−bs K
−qEbsi∂φi0(s, bs, ps)
∂b −θ(¯p0−p¯1qEbs−ps)∂φi0(s, bs, ps)
∂p
−1
2σ2b2s∂2φi0(s, bs, ps)
∂b2 −1
2σP2∂2φi0(s, bs, ps)
∂p2 −qi0j[vj(s, bs, ps)−vi0(s, bs, ps)]
−l(i0, s, bs, ps, Es)
; vi0(T, bs, ps)−κγB1−γT 1−γ
#
>0 i06=j (61) By the continuity of all functions involved in (61) (vi0, φ0i
0, φ00i
0, qij, l, ...),
120
there exist aδ >0 and an open ballBδ(bs, ps)⊂N(bs, ps) such that
−∂φi0(t, bt, pt)
∂t + inf
E∈Ai0
βvi0(t, bt, pt)−
h ri0bt
1−bt
K
−qEbt
i∂φi0(t, bt, pt)
∂b −θ(¯p0−p¯1qEbt−pt)∂φi0(t, bt, pt)
∂p
−1
2σ2b2s∂2φi0(t, bt, pt)
∂b2 −1
2σ2P∂2φi0(t, bt, pt)
∂p2 −qi0j[vj(t, bt, pt)−vi0(t, bt, pt)]
−l(i0, t, bt, pt, Et)
> δ i06=j; (t, bt, pt)∈Bδ(bs, ps) (62) and
vi0(T, bt, pt)−κγBT1−γ
1−γ > δ (t, bt, pt)∈Bδ(bs, ps) (63) Let θδ = min{t ≥ s : (t, Bt, Pt) 6∈ Bδ(bs, ps)} be the first exit time of (t, Bt, Pt) (= (t, Bs,bt s, Pts,ps))from Bδ(bs, ps). Letθ=θδ∧τα whereτα is the first jump time of α(t)bs,ps,i0. Then θ > 0, a.s.. For 0 ≤t ≤θ, we
have
βvi0(t, Bt, Pt)−∂φi0(t, Bt, Pt)
∂t
−h ri0bt
1−Bt
K
−qEi0Bt
i∂φi0(t, Bt, Pt)
∂b −θ(¯p0−¯p1qEBt−Pt)∂φi0(t, Bt, Pt)
∂p
−1
2σ2b2s∂2φi0(t, Bt, Pt)
∂b2 −1
2σP2∂2φi0(t, Bt, Pt)
∂p2 −qi0j[vj(t, Bt, Pt)−vi0(t, Bt, Pt)]
−l(i0, t, Bt, Pt, Et)> δ i06=j; (t, Bt, Pt)∈Bδ(bs, ps) (64) and
vi0(T, bt, pt)−κγBT1−γ
1−γ > δ (t, bt, pt)∈Bδ(bs, ps) (65) As previously, we can replace φi0 by a new test-function ψ defined as follows:
ψ(., ., ., j) =
φi0(., ., .), if j=i0 vi0(., ., .), if j6=i0.
(66)
For any stopping timeτ ∈[s;T]. Applying Itˆo’s formula to the switching process e−βtψ(t, Bt, Pt, α(t)), taking integral from t=s tot= (θs∧τ)−
and then taking expectation yield Ebs,ps,i
e−βθ∧τψ(θ∧τ, Bθ∧τ, Pθ∧τ, α(θ∧τ))
=vi0(s, bs, ps)+Ebs,ps,i
"
Z (θ∧τ)−
s
e−βt
−βψ(t, Bt, Pt, α(t))+∂ψ(t, Bt, Pt, α(t))
∂t +h
riBt
1−Bt K
−qEiBt
i∂ψ(t, Bt, Pt, α(t))
∂b +θ(¯p0−¯p1qEBt−Pt)∂ψ(t, Bt, Pt, α(t))
∂p +1
2σ2Bt2∂2ψ(t, Bt, Pt, α(t))
∂b2 +1
2σP2∂2ψ(t, Bt, Pt, α(t))
∂p2 +qα(t)j[vj(t, Bt, Pt)−ψ(t, Bt, Pt, α(t))]
dt
#
; α(t)6=j (67)
in which we usedEbs,ps,i
e−βθ∧τψ(θ∧τ, Bθ∧τ, Pθ∧τ, α(θ∧τ))
= Ebs,ps,i
e−βθs∧τψ(θ∧
τ, Bθ∧τ, Pθ∧τ, α(θ∧τ)−)
due to continuity. Noting that the integrand in the RHS of (67) is continuous in t. Using (64), (65) and thatvi0(t, Bt, Pt)≤