Opial-Type Theorems and the Common Fixed Point Problem
9.5 Applications to the Common Fixed Point Problem
LetU ={Ui}i∈I, where I :={1,2,...,m}, be a finite family of cutters Ui:H →H, having a common fixed point. The common fixed point problem is to find x∗∈
i∈IFixUi. In this section, we study the convergence properties of sequences gen-erated by the recurrence
xk+1=xk+λkσk(xk)
⎛
⎝
i∈Jk
wki(xk)Vikxk−xk
⎞
⎠, (9.44)
whereλk∈[0,2],σk:H →(0,+∞)are step-size functions,Vk={Vik}i∈Jkis a fam-ily of cutters Vik:H →H, i∈Jk={1,2,...,mk}with the property
i∈JkFixVik⊃
i∈IFixUiand wk:H →Δmkare weight functions
wk(x) = (wk1(x),wk2(x),...,wkmk(x)) (9.45)
(the subsetΔm denotes here the standard simplex, i.e.,Δm={u∈Rm: ui≥0, i= 1,2,...,m, andm
i=1ui=1}). Ifσk(x) =1 for all x∈H and for all k≥0, then the method defined by the recurrence (9.44) takes the form
xk+1=xk+λk
⎛
⎝
i∈Jk
wki(xk)Vikxk−xk
⎞
⎠, (9.46)
and is called the simultaneous cutter method. Ifσk(x)≥1 for all x∈H and for all k≥0, then method (9.44) is called the extrapolated simultaneous cutter method.
The recurrence (9.44) can be written in the form xk+1=xk+λkσk(xk)
Vkxk−xk
, (9.47)
where Vk=
i∈JkwkiVik,or in the form xk+1=Vσk
k,λkxk. (9.48)
Remark 9.20. The sequence of weight functions {wk}∞k=0 induces a control se-quence. This notion is usually applied in the literature if the values of wk are extremal points of a standard simplex (see, e.g., [13, Definition 3.2] or [17, Definition 5.1.1]). One can recognize special cases of a sequence of weight func-tions wk as known control sequences. In particular, the weight functions{wk}∞k=0 can be constant, i.e., wk(x) = (wk1,wk2,...,wkmk)∈Δmkfor all x∈H, k≥0. A simple example of such a control sequence is the cyclic control (see [27, Equality (2)], [13, (3.3)] or [17, Definition 5.1.1]) The sequence{wk}∞k=0can also be a constant sequence, i.e., Jk=J and wk=w :H →Δmfor all k≥0. A simple example of such a control is the remotest set control (see [27, Equality (3’)] or [13, (3.5)] or [17, Definition 5.1.1]). Sequences of weights depending on x∈H enable, however, a more general model and demonstrate the importance of assumptions on the weight functions control.
Definition 9.21. Let Vi:H →H, i∈J={1,2,...,l}. We say that a weight func-tion w :H →Δl is appropriate with respect to the familyV ={Vi}i∈Jor, shortly, appropriate if for any x∈/
i∈JFixVithere exists a j∈J such that
wj(x)Vjx−x =0. (9.49)
Lemma 9.22. Let Vi:H →H, i∈J={1,2,...,l}, be cutters having a common fixed point and let V=
i∈JwiVi, where w :H →Δlis appropriate with respect to the familyV ={Vi}i∈J. Then
(i) FixV=
i∈JFixVi,
(ii) V is a cutter, consequently, for allλ∈(0,2), the operator Vλ is 2−λ
λ -strongly quasi-nonexpansive,
(iii) The following inequalities hold
i∈JFixVi=H then the inclusion is clear. Otherwise, sup-pose that x∈FixV , x∈/
i∈JFixVi and that z∈
i∈JFixVi. Since a cutter is strongly quasi-nonexpansive (see Lemma9.4(ii)) we haveVix−z<x−z for any i∈J such that x∈/FixVi. The convexity of the norm, the strict quasi-nonexpansivity of Viand the fact that the weight function w is appropriate yield
V x−z=
We get a contradiction, which shows that FixV ⊂
i∈JFixVi.
Applying again Lemma9.4(i) we deduce that V is a cutter. By Lemma9.4(ii) the operator Vλ is 2−λ
λ -strongly quasi-nonexpansive for anyλ∈(0,2).
(iii) Letλ∈[0,2], x∈H and z∈FixV . The convexity of · 2and Lemma9.4(i)
≤ x−z2+λ2
i∈J
wi(x)Vix−x2−2λ
i∈J
wi(x)Vix−x2
=x−z2−λ(2−λ)
i∈J
wi(x)Vix−x2, (9.54) i.e., the inequality (9.50) holds. Inequality (9.51) follows from the convexity of
the function · 2.
Definition 9.23. Let V ={Vi}i∈J be a finite family of operators Vi:H →H, i∈J, and letβ∈(0,1]be a constant. We say that a weight function w :H →Δ|J|
isβ-regular with respect to the family of cuttersU ={Ui}i∈I, or, shortly, regular if for any x∈H there exists a j∈J such that
wj(x)Vjx−x2≥βmax
Uix−x2|i∈I
. (9.55)
If
i∈JFixVi⊃
i∈IFixUithen a weight function which is regular with respect to the familyU ={Ui}i∈Iis appropriate with respect to the familyV ={Vi}i∈J. Example 9.24. LetV =U and let I(x) ={i∈I|x∈/FixUi}and let m(x) =|I(x)|
be the cardinality of I(x), for x∈H. The following weight functions w :H →Δm, where w(x) = (w1(x),...,wm(x)), are regular:
(a) Positive constant weights, i.e.,
w(x) =w∈riΔm (9.56)
for all x∈H, where riΔm={w∈Rm|w>0 ande,w=1}is the relative interior ofΔm. A specific example is furnished by equal weights, i.e., wi(x) = 1/m, i∈I. To verify that w is regular set j∈Argmaxi∈IUix−x andβ = mini∈Iwiin Definition9.23.
(b) Constant weights for violated constraints, i.e.,
wi(x):=
⎧⎪
⎪⎨
⎪⎪
⎩ wi
j∈I(x)
wj
, for i∈I(x),
0, fori∈/I(x),
(9.57)
where w= (w1,w2,...,wm)∈riΔm. A specific example is wi(x):=
1/m(x), for i∈I(x),
0, fori∈/I(x). (9.58)
To verify that w is regular set j∈Argmaxi∈IUix−x andβ =mini∈Iwi in Definition9.23.
(c) Weights proportional toUix−x, i.e.,
wi(x) =
⎧⎪
⎪⎨
⎪⎪
⎩
Uix−x
j∈I
Ujx−x, for x∈/
i∈IFixUi,
0, for x∈
i∈IFixUi.
(9.59)
To verify, set j∈Argmaxi∈IUix−xandβ=1/m in Definition9.23.
(d) Weight functions w :H →Δmsatisfying the condition
wi(x)≥δ for i∈I(x) (9.60)
for some constantδ>0. To verify, choose j(x)∈Argmaxi∈IUix−xand set β=δin Definition9.23. These weight functions were applied by Combettes in [19, Sect. III] and in [20, Sect. 1]. Observe that the weight functions defined by (9.56) and by (9.57) satisfy (9.60).
(e) Weight functions w :H →Δm for which wi(x) =0 for all x∈H and for all i∈/Jγ(x), where
Jγ(x) ={j∈I| Ujx−x ≥γmax
i∈I Uix−x}, (9.61) for someγ ∈(0,1]. To verify, set j=j(x)∈Jγ(x)withωj(x)≥1/m andβ = γ2/m in Definition 9.23. The existence of such j follows from the fact that wi(x)≥0 for all i∈Jγ(x)and
i∈Jγ(x)wi(x) =1. Specific examples are obtained as follows:
(i) When Ui=PCi for a closed convex subset Ci⊂H, i∈I, and wi(x) =
1, if i=argmaxj∈IUjx−x
0, otherwise. (9.62)
In this case, w defines a remotest set control (for the definition, see [27, (3’)]
or [17, Sect. 5.1]).
(ii) When Ui=PCi for a closed convex subset Ci⊂H, i∈I, and wi(x) =
1, if i=j(x)
0, otherwise, (9.63)
where j(x)∈Jγ(x)for someγ∈(0,1]. In this case w is an approximately remotest set control (for the definition, see [27, (3)] or [17, Sect. 5.1]).
Definition 9.25. LetVk={Vik}i∈Jk be a sequence of cutters Vik:H →H, i∈ Jk={1,2,...,mk}, k≥0, and let the sequence{xk}∞k=0be generated by the recur-rence (9.44). We say that a sequence of appropriate weight functions wk:H →Δmk
(applied to the sequence of familiesVk) is
• Regular (with respect to the familyU ={Ui}i∈I) if there is a constantβ∈(0,1]
such that wkareβ-regular for all k≥0,
• Approximately regular (with respect to the familyU ={Ui}i∈I) if there exists a sequence ik∈Jksuch that the following implication holds
k→∞limwkik(xk)Vikkxk−xk2=0=⇒ lim
k→∞Uixk−xk=0 for all i∈I, (9.64)
• Approximately semi-regular (with respect to the familyU ={Ui}i∈I) if there exists a sequence ik∈Jksuch that the following implication holds
k→∞limwki
k(xk)Vik
kxk−xk2=0=⇒lim inf
k→∞ Uixk−xk=0 for all i∈I. (9.65) Example 9.26. Here are examples of weight functions which are approximately reg-ular or approximately semi-regreg-ular with respect to the familyU ={Ui}i∈I. (a) A regular sequence of weight functions is approximately regular.
(b) A sequence containing a regular subsequence of weight functions is approxi-mately semi-regular.
(c) Let{xk}∞k=0be a sequence generated by the recurrence (9.46), whereVk=U and wk =δik. We call the sequence {ik}∞k=0 a control sequence (see [13, Definition 3.2]). Recurrence (9.46) can be written as follows
xk+1=xk+λk
Uikxk−xk
. (9.66)
Implication (9.64) takes the form
k→∞limUikxk−xk=0=⇒lim
k→∞Uixk−xk=0 for all i∈I. (9.67) If (9.67) is satisfied we say that the control sequence{ik}∞k=0is approximately regular. If we set Ui=PCi for a closed convex subset Ci⊂H, i∈I, then impli-cation (9.67) can be written in the form
klim→∞PCikxk−xk=0=⇒lim
k→∞max
i∈I PCixk−xk=0. (9.68) A sequence{ik}∞k=0satisfying (9.68) is called approximately remotest set con-trol (see [27, Sect. 1]).
(d) (Combettes [19, Sect. II D]). Let Ikbe a nonempty subset of I, k≥0. Suppose that there is a constant s≥1 such that
I=Ik∪Ik+1∪...∪Ik+s−1for all k≥0. (9.69) Let Ui=PCi, where Ci⊂H is closed and convex. Let{xk}∞k=0be a sequence generated by the recurrence (9.46), whereVk=U ={Ui}i∈I,λk∈[ε,2−ε] for someε∈(0,1), and wk∈Δmis a weight vector such that
i∈Ikwki =1 and
wki ≥δ >0 for all i∈Ik∩I(xk), k≥0, and I(x) ={i∈I|x∈/Ci}. Bauschke and Borwein called a sequence of weights satisfying (9.69) with Ik={i∈I| wki >0}an intermittent control (see [4, Definition 3.18]). The recurrence (9.46) can be written in the form xk+1=Tkxk, where Tk=Id+λk(Vk−Id)and Vk=
i∈IkwkiPCi, or, equivalently, in the form
xk+1=xk+λk
⎛
⎝
i∈Ik
wkiPCixk−xk
⎞
⎠. (9.70)
One can show that Vkis a cutter. We show that{wk}∞k=0is approximately regular.
Let i∈I be arbitrary and let rk∈ {0,1,...,s−1}be such that i∈Ik+rk, k≥0.
By the triangle inequality, we have xk+rk−xk ≤
rk−1 i=0
xk+i+1−xk+i=
rk−1 i=0
Tk+ixk+i−xk+i
≤
s−1
i=0
Tk+ixk+i−xk+i, (9.71)
for k≥0. Since Tkareλk-relaxed cutters andλk∈[ε,2−ε], Lemma9.22(iii) yields limk→∞Tk+ixk+i−xk+i=0, i=1,2,...,s−1, consequently,xk+rk− xk →0. Further, by the definition of the metric projection and by the triangle inequality, we have
PCixk−xk ≤ PCixk+rk−xk ≤ PCixk+rk−xk+rk+xk+rk−xk. (9.72) Let jk ∈ Ik be such that PCjkxk−xk =maxj∈IkPCjxk−xk, k ≥0. Let limk→∞wkj
kPCjkxk−xk2=0. Since wkj
k≥δ for jk∈I(xk)we have
klim→∞PCjkxk−xk=0. (9.73) Since i∈Ik+rkwe have
PCixk+rk−xk+rk ≤ PCjk+
rkxk+rk−xk+rk.
consequently, limk→∞PCixk+rk−xk+rk=0. The inequalities (9.71) and (9.72) yield now limk→∞PCixk−xk=0, i.e.,{wk}∞k=0is approximately regular.
(e) LetH =Rn, let Ui:H →H, i∈I, be cutters having a common fixed point and let lim infk→∞λk(2−λk)>0. Consider a sequence generated by the recurrence (9.66) with a repetitive control{ik}∞k=0⊂I, i.e., a control for which the subset Ki={k≥0|ik=i}is infinite for any i∈I (see., e.g., [1, Sect. 3]). It is clear that N0={0,1,2,3,...}=K1∪K2∪...∪Kmand that Ki∩Jj=/0 for all i,j∈I,i=j.
The control{ik}∞k=0is approximately semi-regular. This follows from inequality (9.26) which guarantees that
∞ k=0
λk(2−λk)Uikxk−xk2<∞. (9.74)
Note that the series above is absolutely convergent, thus, m
i=1
k∈Ki
λk(2−λk)Uixk−xk2= ∞ k=0
λk(2−λk)Uikxk−xk2<∞. (9.75)
Therefore,
k∈Ki
λk(2−λk)Uixk−xk2<∞for all i∈I (9.76) and
k→∞,k∈Klim i
λk(2−λk)Uixk−xk2=0 for all i∈I. (9.77) Since lim infk→∞λk(2−λk)>0,we have limk→∞,k∈KiUixk−xk=0 for all i∈I, consequently,
lim inf
k→∞ Uixk−xk=0 (9.78)
for all i∈I, and {ik}∞k=0 is approximately semi-regular. One can prove that the approximate semi-regularity also holds for sequences generated by (9.46), where Jk=I andV =U and the sequence of weight functions{wk}∞k=0has the property
i∈Ikwki =1 for Ik⊂I, k≥0 and wki >δ>0 for i∈Ik, and i∈Ik for infinitely many k, i∈I. Note that a repetitive control is a special case of a sequence{wk}∞k=0having the above property.