HAL Id: inria-00000987
https://hal.inria.fr/inria-00000987v2
Submitted on 11 Jan 2006
HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from
L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de
How to bring together fault tolerance and data consistency to enable grid data sharing
Gabriel Antoniu, Jean-François Deverge, Sébastien Monnet
To cite this version:
Gabriel Antoniu, Jean-François Deverge, Sébastien Monnet. How to bring together fault tolerance and
data consistency to enable grid data sharing. Concurrency and Computation: Practice and Experience,
Wiley, 2006, Concurrency and Computation: Practice and Experience, pp.1-19. �inria-00000987v2�
"#%$'&)(+*,*-.$'&)/"#%01'(+24352!6879*3%&.2!6:;<1=-.*)6?>5@5@5@+AB'BCEDGF+HI9*-1+35*-GJK(=LGM8$=NPORQ'S<T%UWVYX+ZO<[\].^_-)*,LGMY#%$_7 `+a%ab`<c?a%d,c_e%dgfh`=68a5`Ri
jlknm opk qsrKtCuwv opkxvzy{oK|wy{r~}zw'o
opkz_y{rgzuy xu oK kuPtPopyu
opk yuq_yvrt oK |rtuwv
%C4
∗† ) ¡ £¢¤ £¥5¦¤ §¨ª©«¬C £
,®<¯?°±,²³®,°s´=µ¶·µ?¸º¹=».¼)½)¸¿¾4ÀÁGÂI®».µ?µ¤».½KÃWÄÅ ´=ƳÇCÈ'½p¶»ÊÉË»<´WÈ?̸!».È_Ä ÍΣÏhÐ?Ѯһ.µµ».½<ÄÓ¼G´=µÔ)»
Õ֡׬×wØÙ³Ú
ÛÜݺÞßàCßá'â¡àããâ%á_Þ5Þbá?Þä%Üáå=ÜàCæ¿æ¿á?çèCáéêPäbâ%àçÞ5ßàâ%á?ç¤äãà?äbàÞ%ÜàâWÝ4çèxëgÝ¿ä%ÜÝ4çìå+é¤ínßîä5Ý4çèzèCâWݺãÞ
ï
îݺæYägàCÞå£æ4îÞbähá_âêá_ãá'â%àä5Ý¿éçÞ+ðñgçzÞ%îå+Üßæ¿à?äbêòéâ+ínÞ+óä%Üá¡à_ô_àCÝ¿æ¿à
ï
Ý¿æºÝ¿ä)õzéCêÞbähéCâ%àèCá{â%á_Þbé¤îâWå+á_Þínà'õ
å+ÜàçèCáªÝ4çöàãõçàíÝ¿åìëà'õCóÊéCêäbá?çöãîá¬ähé÷ÜàâWãëàâ%á¬êàCݺæºîâ%á?Þ+ðKøwáùêòéåîÞzé¤çúä%Üá¬ßâ%é ï æ¿á?í
éCêÜàçãæ¿Ý4çèùä%Üáå=é¤çÞ5ݺÞbäbá?çå=õwéCêâ%á_ßæºÝ¿å+àäbá_ãûãàähàüÝ4çwä%Üáßâ%á?Þbá?çå=áxéêgêòàݺæ4îâ%á_Þ+ð³øwáxßâ%éßéÞbá
àüÞbéCêä.ëàâ%áxàâWå=ÜÝ¿äbá_å+ä%îâWáëýÜݺå=Üsãá_å+é¤îßæYá?Þå+é¤çÞ5ݺÞbäbá?çå+õûínàCçàèáíáçä{êâ%é¤íþêòàCîæ¿äÿäbéæ¿á'â%àçå+á
ínàçàèCá?íná?çä+ðÒøwáxݺæºæºîÞbäbâ%àäbáä%ÜݺÞàâWå=ÜÝ¿äbá_å+ä5îâ%áëÝ¿ä5ܬàüå+àCÞbáxÞbä%îãõwÞ%Üé_ëÝ4çèùÜé?ë äbéìãá_Þ5Ý¿è¤ç
à å+é¤çÞ5ݺÞbäbá?çå+õ ßâ%éCäbéå+éæîÞ5Ý4çè êàîæYä
äbéæYá_â%àCç¤ä ï îݺæºãÝ4çè ï æ¿éåÞ+ð Ø Þwà ßâ%ééêéCêå=é¤çå+á_ßä+ó
ëKáãá_Þ5å+âWÝï áüàìßâ%éCäbéCä)õßáìݺíßæ¿á?íná?çäbàä5ÝYé¤çûéCêä5ÜݺÞßâ%éCähéå=éæëÝ¿ä5ÜÝ4ç óIàùÞbéCêä)ëKà?âWá
áßá'âWÝ4íná?ç¤ähàCæCßæYàäbêéCâ=í êòéâ³èCâWݺããàäbàÞ%ÜàâWÝ4çèó_àCçã¡ëáÊâWá_ßéCâ%äÒé¤ç¡àKßâ%á_æºÝ4íÝ4çàâ%õ{áßá'âWÝ4íná?çäbàCæ
á'ô?àæ4îàäbÝ¿é¤çéCêä%Üáßâ%éßéÞbá_ãàßßâ%éCàå+Ü ð
"!$#&%('*),+.-0/2123&%546!876'29$3:9<;>=?9$#&%542!276@A912B53C3&+BEDF#:946)GD.7?),+46;>%5;H3&D,42)GIJ/8#&+3&+),+B5;
KLNMPORQSTVUXWZYQ.[\TO
]_^`,^bac^d^8e8faJfd6`hg(die8jGglkmfd?n6gljGo8dpaqf$d6`,rsgArut$vpjGjFfd2`Gw(xm^y`Go8zpgAt{o8|}ac^~&o8jg(d6`Gf$jGfr:`h`Fo`Fpfe8jGgAk
t$o8aqzpv`Gg(dpebt$o8aqavdpgE`&x2C of$n2f$j. ^2rco|_`Fokp^ x2dpob^zzpjFo6^8t,^8rqf$fdgAkfw(xfr:`G^w(gAr:fk|o8j
`GjG^8dr:z^jGf$d6`kp^`,^rF^jGgldpe}o8dce2jFgAkcgld|j,^8r:`FjGvt`GvpjFf.r$vpjFjGf$d6`Gw(x28`Gpf<aqo2r:`gAkfw(x6Hvr:f.kc^zpzjFo6^8t,J`Fo
kp^`G^ac^d^e8faqf$d6`|o8jkgAr:`FjGg(pvp`Ffke2jFgAktPo2aJzv`G^`Fglo8djFfw(glfr}o8dFPR5\P }¡2¢>¢{¤£F¢¥¦§PP£,¦cfP`&f$f$d
t$w(glf$d6`Gr^dkt$o8aqzpv`Gg(dehr:fjFn2f$j,r$p¨r<^8dfP©p^aqzpwlf8`Fpf*ª_wlo8vr}«l¬.®XzpwA^`F|o8jGa"zpjGon?glkf.rkp^`G^s^2t$tPf.rFr
∗¯°±\±\²:³µ´°¶ · ²&¶ ¸&²¹µ° º8» ¼,½ ±\¾¿²&À?ÁZ¶P¹¤°¶.¾¿Â
ÃÄVÃ\Å ÁÆ
ÃÇXÄÈÃ Á
¯V¼,É´. ³· ²CÊR²:¼, À¿¾¿²&Â
ËÌÍ,ÎPÏÄ
²&¶ ¶ ²&³
Ð
±µ¼,¶ ¸&²
†ÑpÒɼ,¾¿ÀAº.» ¼,½ ±µ¾¿²&ÀAÓÁX¶$¹µ°¶ ¾¿ÂÔZ¾¿±\¾¿³H¼.ÓÕ(±
¯R°¶$¹µ±µ¼,¸&¹HÆGÖ±µ¼,¶$¹C³µ´8°¶.³¤°±&º8» ×
ÅØ
±µ°GÙµ²&¸>¹Z°,Õ
Ð
±\²&¶ ¸HÚ0ÁX¯
ÃRÛ
×{¾¿¶ ¾¹µ¾5¼G¹¤¾ÜP²C¼,¶ ·¹¤Ú ²CÊR±\¾¹\¹H¼,¶PÝ
Ä
²&Ö¾¿°¶
! Ò ý
! "#%$'&#)(*",+.-*$/103254"-*&6(*&78	:=<8>@?03&#AB6'(*C4-D&(D&EF&69G4-D&IHG$7%!6A7(*"FG(*F(*=&6J
4"6-D69K9=F9L(*-"MNF-FJOE4;&6=#(8P-D(D6-("6J8(?=JK(QR(*=9=9.S(D-D6"MNF-T4-D&(D&78&69,UV=
-DWGA=-*%RXDY[Z]\_^a`F^bc$(Dd9=&7F9==eI(DK&#?1fgh(*&64i&6Mg+.-*$/10321Jj+.9K&# A")=G(*B6-I(*%)$(DkI(9=&6B#T:K<F>lJ
UV-*5'A9K(*=49=i8&64"K%R&6M'*6mS$(Dno ;p6EA"9=9Kqr-DFB#=(*-*%$?s03"pF&6"*=(*"8qr&6Mt(*%
-DF49=F6g-D)&IUsFH#F-,(,(*"cA"*F-%u,"6-*B#6?vxws2y:zI>14-D&IHE=$7%,9-DB6F{@DF69K)$"I(DRx(D&6-B6cq7(*F|J
F&6"*=(*=Bc&M!m*8(3&M} "A7~;-D3$7(*-DK A(*$Q&IH6-vG(*-*"8(?03"gA"*F-Vm-DFG(xL(D*tx(D&6-B6g-D6
6"$nA|(DF6c(*m4;&6--Dqh A~;-DmMN&#-8T8=FG(T$I(5(*-"MNF-6F-*&G*mpUV=$7F{@6-*%k"8(xUs&6-DO;?
0}-D6"MNF-6"B#FFG(j(*=9K9]I((*gA"*F-%u"-DB6L6"$&m8&6x(DF"Fqc%"*-DV4-D&IHG$7%$
MN&#-V(*c"6B6F#(L&6MC'A9K(*=49='8K%L&6M!(D'D'$(D"?"/!K"69K9=q6J]G(*&#-*Op:=< %>}=g&6(*-L-*%8#(
F7649KV&6Mq7(*F4-D&IHG$7=Bt"61(D&RX*Y8Z;\^a`8^bl\_m9K&7F(*#J6&IH6V$6FF&6-$7=B.(*&(*",$
&6M",*WGAF8&6M8A7(D(*=&6"?Fv@(14-D&64;&#*})=G(*FB#-D(*%$)44"-*&G6t9=9K&IUV=BV(DsA"-(D&.D$A9K
$(Dg4968FG(xAx(j9=KO#sF&64A7(I(DK&#"9x&6 "?LBG=JI$I(,9=&7F(*=&6c6"$'(*-"MNF-1-Ds(}(D3A"*F-%u
"6-*B#6?
(D=|(*)F&6G(*FG(V&6M1mB6-D&IUV=BcEAc -V&MC44"9KF(*=&6"3A"*=B9=6-*B#.6m&#AG(D3&6M1$7(*-DK A(*$
$(D"JjUF9=6K(*I(pXDY8Z;\_^a`F^b;FGXFXF"bxk#Ibh\K%`Ibl^aI" Gq(*"4-D&6B6-F-6-*%6T
Ix&#-9K=(I(DK&#r6B#6K"(m(*dFFKG(TA"d&6M.&7$7-*JC9-DB6F{@DF69K8&#m4"A7(D(*=&6"69VB6-D=$?EA"
p9=&IU3{l9=FH#F9V44"-*&G6n6O6mB#-*$n4"-*&#B6-KB58E(*-DF9Kqh-$h(D&i6"B#6?1v8&##(D-D#x(%J!(*
F&6"FF47(m&M'6b@5*[^G5FXF[^a`XQMN&6-mB6-D$i8&64A(*=Bh:I>3"6' Fn4"-*&G%$JUVK(*h(DRB#EC(*&
4-D&IHE=$hbDIlZ"I*XF"bT#`D`X85b#IbI?L03|44-D&##=Q=9K9=A"(*-I(*%$o Eq (*i¡"¢£}¤h¥¦§*&M(xU3-D
FE4;F-D=mG(D949I(MN&#-*|?G03,A"*F-&69=q6FFD%j$(DtHE))B#9K&# "9$7#(D¨F-%?G03g-*HE8L"6"$79=
$(DS9=&7F9==eI(DK&# 6"$(*-"MNF-UVK(*"&6A7(Q6EqhF9=4 MN-*&#©(D4-D&6B#-D6m-?CªL&IUsFH#F-%J1(RT6 9K
(D&5A"*|6$$7K(*=&69sKG(c4"-*&IHE$7$i EqS(DQ4"-*&#B6-F-%J«KMgEq6?103|-*HE89&k(*-"*4"-DFG(D9Kq
A"*,6$7%W#AI(*t-DF4"9KF(*=&6dx(D-D(*B6=L6"$|8&6x(DF"FqR4-D&(D&78&693(D&F"*A-D'$I(HI=9=6 K9=K(xqQ$
F&6"*=(*"8q#?03%c"6=*L(-DB6F(gT9-DB6F{@DF69K#J$7qE")B6-D$d-(D8(*A-D6?vk4"6-(D=FA9=6-J
(Dk*F-DHG8d*A44;&6-*(DH6#(T*A"6T(*&#-D6B6-*%&#A-DF.x&#K=Bh6"$ 9K%HG=BJC&6-TA"874%[(D$79=q
Ma6K9=K"B"?03Vs(*MN-FUs&6-DOUVK(*=|UV=|Ust8&6$7A"[(D$R(*)(*A$7qR4-D*FG(D$QK(*"=V44;F-%?
¬
D6F\KX8®c¯#XX@Z°*XZ;\^a`Db@X±6b@±`I"[^bXF"b²³03B6&G9'&6MR´$(D{@*"-D=B-*HE8h(D&µ69K9=&IU
B#-*$h4"49KF(*=&6"'(*&S68%*m$I(=p$7x(D-*= A7(D$hEHG=-D&6FG(%?
6-*8&#"$7-*=B5D8=FG(D¨
6449==I(*=&6FJ"(xqG4"=9=9Kq87= K(*=BQQ8&7$78{8&#A49=K"BR*"F6¶6?B"?;'A9K(*=49=cUs6OG9=qG{@F&6A4"9K%$F&7$7
-DA=Bc&6T$7K~;-*G(s*(Ds"$TF&E&64;F-I(*=B)HEt4;F-DK&7$7F69;$(DtF"B#?vQ*A"T6449==I(*=&6FJ
*"-D$n$I(k-Dkm·7b6F\KX#¶1(*qhFn |-D6$J} A(69=*&n·%Z"6b@Xi EqS(D$~]F-DFG(8&7$7?
F
#F8%**$&#d'A9K(*=49='K(*%FJ;$I(T-Dt&M(DF-DF4"9KF(*$Q(D&TF"F'68DV9=&7F9=K(xq6?¸LF49==I(DK&#
%W#A9=9KqdA"*$kMN&6-.Ma6A9(t(D&69=F-"F6J]="FmB#-*$"&E$q8-6*?0«&FA-Dm(*"(t-*%6$-D(*=&6"
$7&R&(.-*F(*A-Dd&6 "*&69=8(D'$(DJ;8&#"(*F8qB6A"6-D6#(DF%3"H6t(D&T ;'4-D&IHE=$7%$| EqR(Dc$(DT*F-DHE=F6?
03%mB6A-G(*.-Dc$7F¨"$5HE=S`I"^[bX8]`8|#X8\_6"$56-*m=m4"9KmG(*$5A"*K"BS`I"[^bXF;`F
Z]*Ib`\¹[?
º ^» `F·7\_bl6®I]E\_^E`[^[b@XF;`F^5RI;Im^a`m`D"bX*Y#b²¼034-D&6 "9K½&M!*"6-*=B'cA7(D6 9=$"I(D
=¾$=(*-DK "A7(*%$´GHE=-*&#FG(DQ"#Q=G(*"=H69Kq ;F¾(*A$7K%$µ$A-*=B (*"p46(p<¿hq#-QUV(DK
(Dd8&6G(D8E(&M.Àgx(D-*= A7(D$rE"-D$ Ádm&#-*qoÂÀ.ÁkÃq7(*|:=<Ä"J 6Å
>@?C03*dq7(*F4-D&IHE=$
(D-D6"4-DFG(k$I(o*"-DK"B"JLHEoAWGA#$$7-DD*4"6Fn68D*K 9=S(*&µ4Eq7F69K9=qµ$7(*-DK A(*$
6"K%F?
"FÆ(*"&7$7i&7$7KMNqy(Do$(DJc&#mF&6"*=(*"8qÇ68(*=&6Ç=S(D-*=B6B#F-D$ÈÂN6?B"?=J
«Ø+!Øÿz1=a= !z 5 !
=EH69K$(*=&6¾&6-dA4]$I(D%Ã8Jg68&#-D$7=B(*&*&6h8&#"(*F8qo4-D&(D&78&69l?V 9-DB6pH6-*=8(xq´&MÀ.7Á
F&6"*=(*"8qµ&E$F9"$±4"-*&6(*&78	=S:_ EJG<"J6<%¿J 6Å
J
>c"H6S ;FF $8¨"%$Jg(*K--D&69=i ;F=Br(*&
*4%8KMNqdUV-*&(*'&7$7g"H6)(*& c&(D¨"%$&6MC(*m&E$¨I(DK&#J;6"$dUV?]03Fqd4-D&IHE=$
HI-D=&6A"(*-6$7F{l&6~] ;8(xUsFFQ(*".(*-DFB6(*Q&M«(Dt8&#"(*F8qB6A"6-D6G(*F%6"$T(D.8T8=F"FqT&M«(*
=49KFG(D(*=&6?
ªL&IUsFH#F-%J(*-6$(DK&#"9]À.Á§*q7x(DFH6,B#F-D69K9=q$7F&#"x(D-D(*%$T*(*xMa#[(D&6-DqcFFK"8qÂa?6?=J
%-*{l9==6-*4$7A"4"DÃQ	Kq´&6I\\@8`\KXnF&67¨B6A-I(DK&#"F¶s=µ4-68(*8#JVA4´(D&nMNU¼(DF"|&6M
&7$7%k:
Å
>l?s03RR&6M(*´$7A5(*&i(DpKG(*-D="96O &M'DF69=6 =9KK(xq&6Mt(*p9=B6&#-*K(*A%$r(*&
"6"$79=t$I(cF&6"*=(*"8q#?Ád&#(V&M}(*.(*=6J7(DFqR-*9Kq&#QB#9K&# "9]=GHI69K$I(DK&#"s&6-3B69=&6 9]A4]$I(D
&6M]69K97FE(*=Bt$I(.F&64=?#fgc(*V&6(*-C""$J6m&IH6-*UV9K=B.x&6-D(xqt&6M;4"-*&6(*&78	=16D*A3
[bIbl^a`8&6¨"B6A-I(DK&#RUV-*.&7$7%V$7&&(L$7*F&6"[(V&#-sMa=9?v@(VV89=6-3(*"(s(D*t6DA"m4(*=&6"
$7&&(&69$´6Eq&6-Dk=(DpF&6G(*FE(Q&M'´\KIl#X@F`D\KXFJ'II;c^a`5B#-*$=7MN-D#x(D-*A[(*A"-*#?/"6A9K(D
6-*Q&59=&6"B6F-m8FF47(DK&#"FJ1 A(m(DFqi ;F&64"-*(m&6ML(*"B#F-D69-DA9=1-D*&6A-8%)qS %8&6
AH6K9 "9KL6"$FH#FG(*A"69K9=qm %8&6,HI6K9 9=LBG= I¨"9=9Kq#J6U-*%&#A-DFCT$7qE"6mF69K9=qLx&#K
(DK7MN-6(*-DA"8(*A-D6?;v5*A"58&#G(*8E(%J;F&6"*=(*"8qd4"-*&6(*&78	=gF"&(-*9Kq6Eq&#-*c&6kG(*K(*=
*A44;&#*$(D&, ;(D6 9K#J%#(D-D#$7K(*=&6"69K9=qgU36(*sF##?%nFUh644-D.(D&L(*"F=-!$7%=B6'=!$78¨(DF9=q
%8%*D-Dq6JG(*&=G(*FB#-D(*.(*"*."FU¾GqE4;&(D*?
03«$7,=1(«(*"8&#-*&M7(Ds$*KB#)&M7(DB#-*$t$(DI{*"-DK"BL-*HE8Us=G(*-D&7$7A"8%$t=T:>l?03
*F-DHE=F,$7F¨"%$Q#'GqE -D$Tq7(*½K"*4=-*%$ EqTÀ.Á§*q7x(DFgÂNMN&6-(*-"*4"6-*#(368DC(D&m$"I(D
6"$T8&#"*=(*"8qm"6B6F#([ÃC$2 2q7(*F.ÂMN&#-j(*"F=-sDF69=6 K9=K(xqm6"$H6	=(*=9KK(xqG{(D&69=F-"F%Ã8?
03g4"4;F-O#,TMNA-*(*-(*4 Eq|4-*&G=Bk644-Dd69K9=&IUVK"B5`I[^[bX8]`8'Z;*b@%`I\¹c(*&
(O6=G(*&k#FF&6AG(g8·7\_bb@\KX8DI;`XR(*"-*&#AB6i$7%8&6A"49K%$S"6B6F#()&6MV(*%T(xU8(D?}03
&(DKHI(*=&6""$(D,B#F-D69"4-D="8=49=6-*,4-*%G(*$TKQ7[(DK&# ?#vQE%[(*=&6Q)Us,$7D8-D= ,(*
$7F(D6K9=$p-K(*8(*A-D"$pUs*&IU "&IU (*&|A"*(*-6$(DK&#"91B6-D&6A"458&#'AF(*=&6S8&#m4;&6"FG(D
&6M!Ma6A9K({l(*&69=F-G(L$7x(D-*= A7(D$*q7x(DFt:=<6<#J[<I>«#V A=9$7K"BT 9=&EO73MN&#-,8&#"*=(*"8qQ4-*&6(*&78	=?03
644-DR=3=9K9=A"(*-I(D$T=E8(*=&6
UVK(*|F#x(DA"$7qTF749=6K"KBc(*")$7*KB#R&6M!'MaA9K({l(*	K-D6#(
F&6"*=(*"8qt4"-*&6(*&78	?E%[(*=&6z"&IUL}"&IUh(*"=14-D&(D&78&69E"#1 FmK49=F#(D$m='(D,¡"¢£!¤h¥¦
49I(*MN&6-D³$k4-D*FG(.4-DF9==m="6-*qdFE4;F-D=mG(D91H69KAI(*=&6«?«E&68&#"89=A"$7=B-*6-*O7$
MNA7(DA-D)$7K-D8(*=&6"V6-*.B6=H6Q=E8(*=&6 E?
!#"$&%('*)+ ,-"%(. .%* /0)1 23)0+ !24 !)5. ,62 1)7'(7. !)8
240)+# !24 !)5.
9
8(µA¨"-x(µ&(D (*"(µ ;&(D MaA9K(´(D&69=F-"F "6=*´6"$ 8&#"(*F8q 4"-*&6(*&78	=o6-*
(D-D#$7(DK&#"9=9=q=49=FFG(*%$kA=Bp*X@Z]\_^a`Ibl^aI?ǻL&IUsFH#F-%J"(DA"$7-*9=qEKBQ&(*=HII(DK&#"-D'(D&(D69K9=q
$7K~]F-DFG(VMN&6-V%6R&6M}(D(xUs&mA%F?
:
X@Z]\_^a`Ibl^aI ^ `I[^[bX8]`8 Z]*Ib`\¹F²<;&#"*=(*"8q 4-D&(D&EF&69¼A"* $I( -DF49==I(DK&# MN&6-
Z"X8N8[;`X,=DA"J(*&t9=9K&IUn'A9K(*=49=V&7$7!(D&.-D#$t(DL*6s$(D.=m4-9=9K9GHE,9=&7F696FFD%F?
ª,&IUH6F-%JFUV"F'g&7$7&7$7K¨"1g$I(,8Eq6J(*38&#"(*F8q4-D&(*&7F&69G=!68(*=H(*%$J6?B"?(*s&(DF-
F&64=3cA"x(L ;tA4]$I(D$|&#-VKEHI9==$"I(*%$JE(*&4"-*H6FG(L*A "*WGAFG(V-D6$Q&64;F-I(DK&#"sMN-D&6°-D8(DA-*"KB
! Ò ý
=EH69K$|$I(?L&(D(*"(,2 2oq7(*FL69=*&A"*t-*49==I(*=&6(D&TF"F)6FFD39K&79=(xq#J A7(.m&Gx(
&6M«(*"F $7&&(L6$"$7-*%*VF&6"*x(DF"Fq=DA"J="8)$"I(Dm3B6F-9=9Kq='A7( 9=6?
:
X@Z]\_^a`Ibl^aI°8I 8I·7\_bbI\=X8*;`X%²§¸LF49==I(DK&#³ 9& 8&#m	Kq A%$³ Eq MaA"9( (D&69=F-"F
,:
#
>(D&'F"""FcIII^\=6F^\_^b=R6FEHEK-D&6#(jUVK(*TMa=9KA-D?
"FRt"&E$,&Gx(DKB
|$(D8&64EqkF-D#"J&6(*-)8&64"K%.p 6$HI6K9 9=m Gqk&(*"F-&7$7?j-D=&6A".-DF49==I(DK&#
(*-I(DFB6="H6g Fx(DA"$7=$:=<
>lJG9=6$KB'(*&mHI-DK&#A"C(D-D#$78{@&~ ;8(xUsFRFFK"8q6"$(Dg9=FH#F9
&6M«MaA"9(V(D&69=F-"F.B#A"-G(DF$?
vµ$7(*-DK A(*$µq7(*QUV-*p &6(*¾8&6x(DF"Fq I;MaA9K((*&69=F-8$o(*& p"$79K%$J
-DF49=FI(DK&#hF6i QA"%$iUVK(*n$&6A 9=RB#E?;&#"*WGAFG(D9Kq#J}$74"$7=Bk&#hUV8(DF-'(*%R(xU&
**A%V-D.#$$7-DD%$Q*F4"6-D(*9Kq&#-s"&(J(xU&-K(*%[(*A"-D69]$*KB#"V-Dg4;&#D*K 9=6?
)5. !+0 . / !7'(+#) 4&G**= 9KÈ44-D&## 8&6x( = 6$$-*%**K"B¼8&6x(DF"Fq 6"$ MaA"9(
(*	K-D6"8)(L(*c*6m)(*=m#J-DF9=qEK"B&6|(*"cD'*8(,&6MC$"I(DT-*49KF#F?/&6-gKx("F6J$"I(D
8K%F-*%I(*%$ Eqc(D8&6x(DF"Fqc4"-*&6(*&78	=j(*&'"6"8.$I(t9K&79=(xqF6R*F-DH6L6 "#OGA"4
MF-D#"L&78A-%? ;&#EH6F-*F9=q6J "#OEA4-DF49==6g8-DI(D$MN&#-,Ma6A9(.(*	K-D6"8cFk cA"%$ Eq
(*F&6"*x(DF"Fqi4-*&6(*&78	?j03"=T644-D&##h"6Sx&6-$7*#$7HIG(D6B66¶!(D$7*=B6 &M.(*
8&#-*-D*4&#"$7=B'*&M(xU3-D,9q6-3H6-*q81KFJE#sK9=9KAx(D-D(*$Q EqT&#,Ma6A9(*{(D&69=F-G(VÀ.7Á
q7(*:=<z"J I>@?
!#"$&%( ! !7'(+#) $7K~;-*G(,44-D&##F&6"*x(3K$7%=B6"KB(D'F&6"*=(*"8qR4-*&6(*&78	«$
(*pMa6A9(d(D&69=F-"F5%"* 4"-I(DF9=q6?V03d44-D&##´"#|H6F-9.MN%I(*A"-*%F?V/!K-(J
(*S$7%=B6µ&MmF&6"*x(DF"Fq 4"-*&6(*&78	=Q=d*=m4"9KK¨"$JL="85(*"p4"-*&6(*&78	=$7& &(|"H6k(*&
6$$-*%*MaA9K(3(*	K-D6"8.=D*A3I(Lc9K&IUµ9KH69?703-*FMN&6-D6JE(V34&G**= 9Kg(*&9=FH#F-B6g87x(DKB
8&#"(*F8q4-D&(D&78&69?}fg9Kqp	K=(D$S=#(DF-68(*=&6p F(xUFp(*Q8&6x(DF"Fqk4-D&(D&78&69
"$(DrMaA9K(h(D&69=F-"F %"* F%$S(D& ´$8¨"%$ Âa*F´E%[(DK&#Æ"? Ã[?c78&#"$J
8&#"(*F8q4-D&(*&7F&69}6"$tMa6A9(!(*	K-D6"8sx(D-D(*B6=!Fc V$7H69K%$tK$7F4;F"$FG(*9=q6?03
MaH6&#-D389=6F-g$7*KB#J%6&M1(*)(xU&8&#FG(DL KBQ$7$7F(*%$(*&K(D,*4;8K¨-D&69=6?
/!K"69K9=q6JE(DV44-D&##T4-D&IHE=$7%(*)6 K9=K(xq(*&874;F-DK#(VcA9(DK4"9Kt4;&#D= =9KK(*=s(D&8&6A"49K
HI-DK&#A"38&6x(DF"Fq4-D&(*&7F&693UV(DHI6-*=&6A"Ma6A9(V(D&69=F-"F.(*-I(DFB#K%F?
03mB6E}&6M(D=.4"64-=.(D&$7D8A"D.&IU (*&"6B6m8&6x(DF"Fq"$MaA9K((*	K-D6"8mI(.(*
D.(*=6J=d|#X`D·%Z;\KXU3q6JEA"*K"Bc(DL%8&#"$Q644-D&##?
$ "'*%('()+ 1)7'(7. !)84.$#%(7 07 ! #) ,-"%. .%* 1)5. 12 ) !)5.7
vmB6F-9lJ%(*-6$7K(*=&6"6978&6x(DF"Fq)4-D&(D&EF&69MN&#-jÀ.Á *q7x(DF1-DF9=qt&6x( 9=3FG(*K(*=1=&6-$7F-}(*&
B#A"-G(*,(D"I(,$"I(D#F8%**36-*t8&#-*-D8(*9=qRDI(*¨"$?/"&6-V="(D86Jc9-DB6EAc -V&M14-*&6(*&78	=
#**&78I(*L(*&'%6T$(Dc)&7$7.&69$7=Bt(Dg&Gx(s-*%8FG(3$I('8Eq6?#03"=sj(D-*A,MN&6-(*gH6-*qm¨"-x(
4-D&(D&78&69]MN&#-}*WGAFG(D=69#8&#"*=(*"8qm:K<%ÄI>@JF A(!9*&3MN&6-«-DFFG(1"IX FXt4"-*&6(*&78	==49=FFG(*=B
9eqn-DF9=6*8&#"*=(*"8q¾:
>,&#-RD8&64;kF&6"*=(*"8qµ:K<¿>@JUV-* IX5;%6X5R=o"-DB6|&6M
«Ø+!Øÿz1=a= !z 5 !
¿
=G(D6K=B h-D8MNF-DF8k$(D8&64Eq#?v@(|=QK4;&6-*(D6#(Q(*& &(D(D"I(Q(*%p4-D&(*&7F&69T=m4"9K8K(*9=q
#**A3(*"(C(*,&6V&7$7L"FH6-1Ma=9=?#EAT6DA"m4(*=&6F"&(j ;L6$7V=Tt$7qE"6m3B6-D$
GHE=-*&#FG(JUVF-D)Ma6A9K(D.q&78A-%?"vpA"5R8&#G(*8E(%JK(.gK4;&6-*(DG(g(*&|H6&6$d*A"i[^G6\KX
Z"I^ba)x18I^\·7*X8J7UV"&#*g8-6*TUs&6A9$RF&64-D&6V(D "HEK&#-&6M(*"gUV	K*qE(*|?E03"F-D8MN&6-D6J
(D)-D&69=.&6M!"&6)&7$7t"#3(*& ;)49q6%$R Eq|FG(*K(xqQ6 9=(*&(D-D6"4-DFG(*9=q-*%68(V(*&MaA"9(,$
$7D8&6"8(*=&6"J7K&6-$7-(D&=#(=mB#KH#FQ$FB6-DF&6M!HI=9=6 =9KK(xqMN&6-3(Dt-*FMNF-DF"F.$"I(DF&64Eq6?
fgA-m4-*&G*69c(*&k"6"8Q(*|HI=9=6 =9KK(xq5&6Mg*A"hFG(D(DK%c EqiA"*=B5*&6R 6*=R A=9=$7=B
9=&7O7j(D"I(V"H#, ;FF$78¨$QUV(D=R(D.F&6G(*FE(s&6MMaA9K({l(*	K-D6G(s$7x(D-*= A7(D$q7(*g:=<6<6JD<>l¶
-DF49=FI(DK&#h"6J!B#-*&#A4hFc -D*=4n4-D&(D&78&69J!(*&6RcA9K(*F6(JCF&6"*F"*A"J}F(D6?
=G(*-D&E$A"8(D*t 9=&EO73=|8E(,*[(DK&#?"03JUs)$7D8-D= .(*"gxB#9KA".9q6-Dx,(D-*&#AB6UV(*
F&6"*=(*"8qR4-*&6(*&78	]KG(*-D#[(3UV(DQ(D*.MaA9K({l(*	K-D6G(3 "9K&7O7F?
$#$0"%(. .%* /0)5. 124 ) !)5.71$ 7. / '(
I^\_·7DXm%6XF\K²
c-DcF&6"*$7F-DK"B(xU&R(xqG4;g&MCMa6K9=A-DL(*"(.$|(D&R ;m#$$7-DD%$|K5TB6-D$
GHE=-*&#FG(?V/!=-D(JV&7$7%|qo8-6*J3?6?L"&E$|68(|"&6-D69K9=q ÂN-DFF=H6S"$¾*F"$µD*6B6
#F8&#-D$KB)(*&c(*K-V*4%8K¨F(*=&6ÃAG(*=9;(*qMa=91Â8-6*TMa6K9=A-DÃ[?E03=Ma6K9=A-Dg&7$7F9]sOG"&IUVR6
(DC8I^\@[bDZQ&7$7F9l?#E%8&#"$JUV#**A%*DB#1F6' ;L$7F9q6%$)&6-19=&#(J$7A"(D& A7~]F-C&IH6-&IUL
&#-t(*&d(DF4;&6--Dqk9=KOpMa6K9=A-D?
R6DA"mc8I^ \KID[S8&#mcAF(*=&6h"6F9?v@M,d4-D&78D.Z
*F"$"Rh%*DB#i (*&n6&(DF-Q4-*&7FDS´K7¨(DkEAc -Q&6Mt(*=m%T(D-D&6AB#oSMa=-{@9=&#Dq
"69J«6"$SKM$7&E%t&('Ma=9J«(*RH6#(DA"9=9=q-*%8KH#³MN-*&#¼Z]?«v7MN&#-*9=9=q6JUsT6DA"m
(D"I(LF(xU&#-*O9==O73qQ$7A49==I(Dt&6-V9=&#*.*&6D*6B6JE A7(L&6(,9=9&M!(*|?
vk&#A-LMa6K9=A-D'&7$7F9lJ]Um8&6$7F-,(xU&Q=d(*=KB|6*4;[(F¶(*"mF&6'A"=I(*=&6$F9qE.$
(D8&64A(DI(DK&#(DK?
6O6c(*#**A47(*=&6k(*"(tA44;F-t ;&6A"$"A4&#k(D*c(*=m%87x(
A(-Ds"&(jOE&IUV?03EA"1&#A-j9=B6&#-*K(*16D*A366*qG-*&#&6A(DK=Bt&E$F9lJA"*KBt38I^\·7*X
#X8bX`8bl^aI|"6|?G7A"R'*F-DHE=FLj=Q"6-*B#V&M4-D&IHE=$7=B)'9Kx(s&M&7$7%*A"*4%[(D$(D&'"H#
Ma6K9=$? ;9=#**=9sMaA"9((*	K-D6"8|-D|&M(DF A=9(R&#n(D*|EqG4;&(D*JCUV 6-*
-D69Kx(D=.=B#-*$RF&6G(*FE(?
[^a`68[b*#`8bl^aI"F²§w3#%$)&6c(*"sEqE4;&(*"*!FG(*=&6%$c6 &IH#6J.GA"' ;F-1&M] "(*-68(*=&6"!"H#
;F$78¨""$MN&6-L(*)6"B#FFG(L&MC$7K~;-*G(g6*4%[(V-*9=(*%$R(D&MaA"9(L(D&69=F-"FK$7(*-DK A(*$
*q7x(DFF?
#"$ 24 !2 /7'40. #%(7
?j036*I·%Z´X8X8*7^Z¾ "(*-68(*=&6o:=<6<F>V=5"6=*
4-D&IHG$7=Bd(DQ6 K9=K(xqS(*&k6"B#Rk*8(&ML&7$7%m"HEKB5k8&#m&#h=#(DF-D(?103&7$7
9K&#B6=B.(*&)B#-*&#A4m"H6s(*&)(*&#-*s(DL8A-D-DFG(j8&64;&#*(DK&#&M;(*VB#-*&#A4Âa?6?6(*,m' ;F-
9K(Ã[?Ig}"&E$!qx&#Kc&6-!9K%H6(*sB6-D&6A4c"$'FH6cF-D#J(*"Fc -19Kx(1-D"6B6=B"?
03s6*·%ZQXFDXF*E^ZT4-D&(D&EF&69#"6«(*&.F"*A-Dg8F-*(D6Kc$7FB#-*j&MF&6"*x(DF"Fqg&6M(*%9K(D
Eq*qE"-D&6=eF=B(*"cFc -D,HEKUL,&6M!(DmB6-D&6A4?;ws8(xUsFF|(xUs&THE=FU *qG-*&#=eI(DK&#"J
(*Q*6mQF('&MLDDB6%)*&6A9$S ;R$7F9==H6F-D$S EqS9=9j(DR&7$7%)UVK(*=ndB#-*&#A4?}vi&6A-
F##J"(DRDI·%ZnX8X8*E^Z m%""=*¼44"9K=g(*&dQB6-D&6A45&Ms&7$7g(*I(t49q|(*&6B#8(DF-
(*-D&69=&MC"IX)G(*K(xqT&MC8&#"(*F8q4-D&(D&EF&69F?
z
! Ò ý
Atomic Multicast group membership
Adapter
send/receive get suspect list
propose/decide
Consensus multicast/receive join/leave/getview/send/receive get suspect list
Group communication and
Detector
Unreliable Failure Unreliable Communications
!#"%$'&)( &"+*,&-.-/"0#1#2&43.( &1"1*5-67-8779*:*; &1<&=&>9'?
.#24'* 2 "%(.'*7.
03"V&6VFG(D(xqc=C="-DB63&6M;=G(D6K=B.(*"V-*FMNF-DF"F3$"I(DtF&64Eq6?Iv@(j
-*4-D*FG(*%$' EqcB#-*&#A4m&M&7$7j&6UV(*V-D8MN-*"8L$(DtF&64Eq)j-DF49==I(D$?6gC=&6A-
&E$F9&7$7%jqcF-D#«J(*&)"A"-*3(D"I(6A47{l(*&6{@$(*LF&64Eq)UV=9K9-*6KHI=9 9=VUVA,
4%**=m(*C-*49==I(*=&6|?%03F-D8MN&#-*#J[UV(D)&6A-«-*49KF(*=&6)DF#JF9=9(Dj-DF49==6
-DgA"4;$(*%$*='A9K(D6F&#A"9=q6?03"=3B#	 )#KH6%$R EqR$79K=H6-*=B9=9D*6B6s=(*
*6c&#-D$7-.(*&9=9CB6-D&6A"4kFc -D?ÁdFc -D&6M(DB6-D&6A4p"H#'(D&|6B6-DFmA4;&6ip&6-$7F-
MN&6-VDDB6$79K=H6-*qT6"$Q(*VB#-*FFG(3=V-D#$RA"*KB(D6"$-$S`DFXF[·E.4"-*&6(*&78	=?
@ #)7 !)7"7 .$#%(71
§`FX8"[·ET4-*&6(*&78ωK9=&IUL'*8(m&ML&7$7%)(D&kB#-*T&6h58&#m&#
HI9=A6¶%6p&7$74-D&64;&#*t*&6HI9=AT$k(D4-D&(D&EF&69C"A"-*%(*"(RÂx<Ã.FH6G(*A"69K9=q569K9
&7$7!(D"I($&t&(CMa6K9"$8$7VHI9=A6JÂ Ã}(D"I(jHI69KAV61 ;FF4-D&64;&#*$c Eq'*&6V&7$7L$
ÂaGÃ!(*.$7F=$$HI9=AL(*.*6mLMN&6-69K9A7Ma6A9(xq&7$7%F?#vT&6A"-F#V(Dg$8*K&#= ;&6A7(
(*V&#-D$F-C=UV=DDB6%C-DV$7F9=KH#F-D$'(*&(DLB6-D&6A"4cFc -D?603g8&6"A14-*&# 9=F
Ki#qE"-D&6"&6A".q7(*'Fp ;R	KH#$k(*"6O7(*&S·7*X8\^a6F\KX.8I^\_·7*X|#X8bX`8bId:=<
Å
>@?03
-*	K,&M(D*.$8(*%[(D&6-(*&'4"-*&IHE$7g'9Kx(3&M}&7$73*A"4;8(*%$(*&c .Ma6A9(xq#?703gF&6"*F"*A"
4-D&(*&7F&69F6F&64;.UVK(*(D)44"-*&7=(*68A-6Fq&M«(Dt9==(,8&##(DFG(D?
03*s 9K&7O7!FcKG(DF-6[(!UV(Dc%6)&6(*-1Kc6EqtUsq7?v'(*14"4;F-%J%U38&#"$7-!g9=q#F-D$J
$7%8&#A49=$h$7%=B6µÂa/!KB#A-Dk<%Ã8J}="*4=-*%$i Eq :=<>l?1ªL-*#J«(Di66Z;bX8d&7$7A9=|9=9K&IUL'KB#F-*{@9KH6F9
*&M(xU3-D9=q#F-(*&5-*B6x(DF-'(*&(DTMa6K9=A-DQ$7F(*%[(*=&6-*HE8R6"$S(*&k¨"9K(*F-c(*"Q9==(c&6M,A4;8(*$
&7$7%V68&6-$7=Bc(*&&#.A-{4;F¨$W#A9=(xqT&6M1*F-DHE=F6J763=S:Ä>l?
«Ø+!Øÿz1=a= !z 5 !
Dynamic CP Configuration
Consistency
and Group Membership Protocol Group Communication Group Self−organization Consistency Protocol (CP)
management Fault−tolerance management
. &"+*4> 3 !#"%$'& - ;=(( &09974 ;3 $'1"> <&>74=?
$ 7'*)+ ,-"%. .#%( /)5. #2 #) !)5.7 '*) 1)7'(7. !)830. #%(7
fgA-$7%5(D&pA|(D "(*-68(*=&6"$7%*F-*= ;$r ;&IH6Q(*&S A=9$ MaA9K({l(*	K-D6#(FG(D(DK%T 9=(*&
49q5(*Q-*	KT&6M,8-D(D=9FG(*K(*=cK8&6x(DF"Fq54"-*&6(*&78	=?}/"&6-'="(D6"8#J}%6X]#X|F6
;T-DF496F$p EqpdB#-*&#A4p&MV&7$7'"$79K%$SHE=|B#-*&#A4SF' ;F-*K4i=G(*-Ma#8T$iA4"4&#-(DKB
(*&6.'A9K(*F#x(%?ªL&IUsFH6-JE*&6t6[(DK&#"s9K=O6 )6*·%Z5FX8\ IGI^b^ak&#-R`D!·7*b^a5x
]X56*·%ZdXFXFLF%$m(*&t ;,"6"$79=$ Eq'=B6"F-*{l9=FH#F979q6F-?6EA"T68(*=&6"-DV&("8%*D-D=9Kq
*4%8K¨c(*&F&6"*=(*"8qd4"-*&6(*&78	=ÂNl?6?(DFqpFS4"49Kq(*&dH6-D691F&6"*x(DF"Fqd4-*&6(*&78	=Ã[?03q
6-*.K(*A"(*%$T4-DF=*F9=qI((DLx ;&6A""$-Dq#L F(xUFTMa6A9K((D&69=F-"F,"6B6mG(s$T8&#"(*F8q
B6FG(?]ªL"8#J;Us'"F$(*&QKG(*-D&7$7A"F'(xUs&R=G(*F-*Ma6F'9q6-D,K5&6A--K(*8(*A-D6J;6."&IUV
=d/}=B6A"-* ?
#"$$ !%(, +)'1 .'*)
03"=|9q6-Q"6"$79=(Di8&64;&#*(DK&#µ&6MmB6-D&6A4µ&Mm&7$7(D"I(
(*&#B68(DF-i#[(h6i¾&#mr&7$7#J) Eq F"-*=B¾(**FG(*FS&6MQ(D (*-6$7K(*=&69R6*I·%Z
XFDXF*E^Zd "(*-68(*=&6m GqcK89=A"$7=B')6*I·%ZdXFDXF*E^ZZ"I\_^a`FI?E03L9q6F-j$8$7%CUVF
(*&5-*m&IH#MN-D&6 (*B6-D&6A"4i&7$7c-*4&#-(D$S(D&k ;RMa6A9K(xq6J1 Eqp4-8(DF-DKeKB(*g&Gp&6M
(*gMa=9=A-*.$78(D8(*&6-%?Ev@(369=*&'-DF&IH#j"&E$(*"(s"&(*KMNqT ;&6A((DF=-sMNA7(*A-D$7=D8&#%[(*=&6F?
/	K9=&IUVK"Bp*A" -*m&IHI69=J!(*|9q6F-#$$U Fc -Dm(D&S(*|B6-D&6A"4J1(*&S=G(D=(*
HI=9=6 K9=K(xqk&M,(*Q&6&7$76?10«&p$7&5*&"J!K('(D6O6%'=G(*&5#FF&6AG(cF&6"(*-=G(D'*4;8K¨"%$hI(
9=9K&7I(*=&6T(*=m#¶E(*%8%*D-Dqm&6-DqT=eF#JE(*F(xU&#-*O4;F-*MN&6-D6"8#J#&#-s(*-DF49==I(DK&#
4	K8qTÂa874-DD%$'=c(*F-D1&M;GA"' ;F-C&M]89=A"(*F-!UVF-Ds(*&t*4-*%6$c$I(g-DF4"9KF#FJEA' ;F-1&6M
-*49==6C4;F-s89=A"x(DF-%J6F(D?¹Ã[? j6-*=&6A"C(*-6$7F{l&6~]jF&6A9$ ;,874-DD*$I((*9=FH#F9!ÂN6?B"?G69K9=F-
B6-D&6A4i*Ke(D&F"""FR8&#'AF(*=&6S8TFK"8qpH7F?}9=6-*B#F-tB6-D&6A"4S*=eF)(*&="F-*%6*(*
9KH69&M«Ma6A9K(V(*&69=F-8%Ã8?
Ä
! Ò ý
8 )024'(
@
)7'*7. !)8 0. #%
@
#)+#"$ .'(#)
Fr*&6RU°&7$7=m6$"$7$h(*&5(*
B6-D&6A4(D"I(g#[(,6g&#m'&7$76J"(*cFU38&#m-L"#3(*&QKK(*9==eF),(D(*)=&#-D$7-V(*&R
8&#"(*FG(3UV(D|(*)(D(*&M}(*t&6(*-VF' ;F-V&6M«(*"tB6-D&6A4?03"
º
I;c^a`jI"[^bXF;`F
¬
*b@%`I\jI }6·7*Ibl^aI9=q#F-)$7F¨"%t&IU(*&d="x(G(*I(DTd8&#"(*F8qk4"-*&6(*&78	C&6iA
&7$7?03tU´&7$7tcA"(V¨"-D(3(D6O6KG(D&T6FF&6AG(3(*")8&6¨"B6A-I(DK&#RDDB6%sB6F"F-I(*%$
Eq(*t&6(*-LFc -D3&6M}(DtB6-D&6A4|I(V(Dt9=FH69&M!(*V9q6-JE ;8MN&6-Dt-D68(*=Bc(*&8E(DF-D"9
D*6B6s6$"$7-*%**$R(*&m(DtB6-D&6A4«?
v(*$7F&6A49=$6-DK(*%[(DA-*1Usj4-D&64;&#*6J(D3*I·%Z X8\ GI"^%b^ac9q6-"$.(D
º
I;Im^a`
jI"[^bXF;`F
¬
*b@%`I\j}6·7*b^aT9=q#F-1F(jA49=KyKG(*-Ma#8s(*"-*&#AB6mUV'(DL8&#"(*F8q
4-D&(D&78&69G=#(DF-68(D}UV(D'(DsMaA9K(}(D&69=F-"F(*-I(DFB6q#?%03EA"J#'&M"(*%sFG(*K(*=1' ;V$7*=B6%$
="$74"$7FG(D9Kqm6FF&6-$7=B,(D&(j4;F¨;B#E=JI"$m&6"9Kq'.9=KK(*%$c=G(*-D#[(*=&6cF%$1(D&. ;L$7F¨"$
;8(xUsFR(DF|?
@
7 7."8 !7'(+#)'*)+ '* 1 '(0% ,-"%(. .#%( /)5. #)7'(7. !) 830. #%
033(xqE4F69B6-D$c6449==I(*=&61U3(-DB68(j6-*39=&G&G9Kqm8&7$7F{@F&6A49==B.6449==I(DK&#"FJ6KUVH6F-9
F&E$j-DAT=T4"6-D69K9=F9"&6T$7K~;-*G(s89=A"(*-D"$K(*-D(*=H69Kqc8""B6L$(D?E03%,$"I(D)8""B6
F-D-DK%$g&#A7((D-*&#AB6-D#$,&#-UV-*K(*6FFD%;(*&,V$"I(D{@*"6-*=B3-*HE86JA"t#}¡"¢£}¤h¥¦:>l?
035-*	Kk&Mt(*"=-*HE8R(*&n"*A-*58&6x(DFG(#FFD(*&"6-*%$$I(JsUV=9Kk(*-"*4"-DFG(D9Kq
"6"$79=K"BQMa6K9=A-D?03t=)UVF-DmMaA9K({l(*	K-D6#(t8&#"*=(*"8q4"-*&6(*&78	=.-DF9=qG=B|&65(*"T44-D&##
4-D&64;&#*$p=nE8(*=&6i6-*A"*8MNA9l?10«&d=9K9=A"(*-I(D(*)$7"J(D=c%[(DK&#S$D8-DK ;t"&IUy(D& A=9=$
*A"4-D&(*&7F&69(D-*(*=B.MN-D&6]I8I·7\_b6bI\KXF*Ib14-*&6(*&78aK49=F#(DK"Bt(*'XF"bl[c`I"[^bXF;`F
#X8\?
,¨"-D(3KG(*-D&7$7A"FL(*"g#(D-*qF&6"*=(*"8qm&7$7F9$R) 6*=6J#&#MaA"9(*{(D&69=F-G(4-D&(D&78&69
UVSK49=F#()K(?
(DFi*&IU"&IU (*"='4-*&6(*&78	jF6p ;6$7Ma6A9K({l(*&69=F-G(tA"*K"B|(*
644-DQ4-D&64;&#*$T=(*t4"-*HG=&6As*8(*=&6?
# <)#) ,-"%(. .#%( /)5. #)7'(7. !) 840. #% ,6 . !)5.8 #)7'*7. /) 8 24 /%
2j-DFHE=&6A"874-*=F8hUVK(*yÀ7Á F&6"*x(DF"Fq´4-D&(D&EF&69d"#"&IUV±(*"(k-*9=7$±8&#"(*F8q
&7$7F9iF6y ;rK49=FFG(D$HGµ8T8=FG(i4-D&(*&7F&69p(5(Dr4-D=F &6MR-D(*-D=8(*$8&#"(*F8q
B#A"-G(*?t/&6-nK"(D6"8#Jt(*"o4-D&6B6-F-ScA"x(hA´*qE"-D&6=e(*=&6&64;F-I(*=&6FJ)*A"½6
JE(*&T6O6)*A-*)(*mA %W#A"FG(g68%**L6-*)F&6-D-*%[(D9Kq*(*x¨"%$J6"$ JG(*&R69K9=&IU
(D9=&E9V&7$7K¨F(*=&6"(D&i ÂN6B6-*9=qi&6-T9eK9=qÃm4-D&64"6B#I(D$h(*&i-DF&(Dd&7$7?03B6F-9
-DWGA=-*FG(=HI9=$nMN&#-&E$F99K=O6|-DF9=#|8&#"(*F8qo:=<>lJC#(D-*q8&6x(DF"Fqo:_ %>L&6-TD8
F&6"*=(*"8qk:K<¿>@?
v(*4"4;F-%J6UsVMN&78A"&6(DmXF"bl[c`I"^[bX8]`8c%6XF\_?E,&644;&#*$c(D&'&(DF--*9=E%$mm&7$79=J
K('-DWGA=-*%tS8749==F('#**&78I(DK&6M3$(D(D&qE"-D&6"Ke%I(*=&65&6 7x%[(F?«03"=c9=9K&IUL.(D&E$F9
(D&T9KH6-D6B6.(*'-*9=(*=&6"*=4 ;8(xUsFT*qG-*&#=eI(DK&#Q&# 7x8(L(*I(,4-D&(D8(D,F-*K(*F69}*8(*=&6J
6"$p(*Q$I(68D*$5UV(DKh(*"(c%[(DK&#?}½"&E$6u)HEKUÆ&ML&#T$I(d %8&#m%tA47{l(*&6{@$"I(*
«Ø+!Øÿz1=a= !z 5 !
(a)
C C
C C
C C
Home Home
(b)
)"#>31(6 $!" ><<&>70%&109974 *; &1<&=&>?
	KqQUVF(D)&7$7)G(*F-s(*"'6D&7F=(*$8-DK(*F9}%[(*=&6«?"03VF9=K="I(DVA"FD*6-*qT(*-ITJ
*K8V&6"9Kqc&7$71(D"I($89-D3(*"F=-jKG(DFG(*=&6m(*&)#FFDC$I(UVK9=9B6F(jA4]$I(D$JG"$m&6"9Kq'(*,$"I(D
UVRUV=9=9; ;6FFD%$UV=9K9] ;gA4]$(*$?77A"Qm8&#"8-*MN&#-FT8=F"Fq6O6%C(*"=3&7$7F9'B6&E&7$
"$7$(*K(D)8&##(D8E(V&M1*FK#(D¨;B6-D=$8&#m4"A7(*=B"?
03p4-*&#B6-F-Q"6Q(*& &6 -*H#d(xU&=µ-DWGA=-*FG(D?s/!=-D(JV69K9t*"-D$o$"I(Dn"H6k(*&
;#**&78I(D$SUVK(*(c9=#x(m&6QB6A"6-D$7=Bk*qE"-D&6=e(*=&6S&6 x[(%?178&#"$J18F9KA"*=H6R#F8%**
(D&k-D$p$I(d"H6m(D& R8749==F(D9KqS$7x(DKB#A%$pMN-*&#§"&67{@889=A"*KH#6FFD% Eq5A"*=B|(xU&
$7K~]F-DFG(4-DKK(*=H6%F¶ JUVB6-G(D1cA7(*A"69"F7F9KA=&6 J%UV9=9K&IULC"&67{
F7F9KA=H6.6FFD%&#QcA9K(*=49K&7$7%(*&m 4;F-*MN&6-Dm%$T=Q4-9=9K9?E±$78(=9K%$Q$7%*F-*=47(DK&#T&M}(*
&7$7F9«=3B#KH#FKS:_ %>@?
v(D=6*c(*A"$7q#J]&6A-x(-*(*=BR4;&6=G(..k]I8I·7\_b6bI\KXF*IbL4-D&(D&EF&69}MN&6-.FG(*-Dqd8&#"(*F8q
Â/}=B6A"-*)Âa#Ã*Ã[?
'6-*)F&6"*=$F-DKBRXFX|4-D&(D&EF&69lJ7KdUV"=dRXc]#X),#**&78I(*%$
(D&5%6n$(D"?103"=m&7$7=c-D*4&#"= 9=RMN&#-c6KG(D6K"KBpk-D8MN-*"88GqpMN&#-'(D"I(T$(D?103
&#,&7$7,69=*&)B6%j)9=&7Om#**&78I(D$m(*&'($(D"?
Rt4-D&78%*FG(*-D'8-DK(*F9;%[(DK&#
4-D&(D8(*$. EqA"tV9=&7O]J[(*6D&78I(D$*"-D$.$I(VA4]$I(D$t&#g(Dj&7$7&#(*=B3(*I(}4"-*&78%*
ÂaMC%8DD-Dq7Ã8?"fg9=HE=Bm(*)F-*K(*F69«*[(DK&#JE(*")9K&79&7$7¨;FI(DK&#")ÂaMjEqÃs-D.(*-"*(*(*$
(D&R(Dc"&6'&7$7#?$;&6"*WGA#(D9Kq#J;#FFD%V(*&|*"-D$$"I(DRKEH#&69=H6'*&6cF&6'A"=I(DK&#",UVK(*
(Dt&6&7$7#?
1' '()+ 0. #%
vS(DR4-D&(D&78&69O#8(D"$p&6A7( ;&IH6#J(*R&6T&7$7R=m89=6-*9=q5dF-*K(*F69FG(D(xq5(*"(ccA"x(c
HI=9 9=sMN&6-1(*"L4-D&(*&7F&69E(*&t ;L-D(*=&6"69?E="8,KB6-D$'GHE=-*&#FG(CUL"&(j-D9=x(D=9=9Kq
#**As(*"(AmG(*K(*=CUV=9K9" L=49=FFG(*%$ Eq)Ma=9=A-*F{MN-DF3&7$7%FJ(*CCUVF-D3(*"L44-D&##
4-D&64;&#*$RKE%[(DK&#F6R ;)44"9K=$?fgA"-V4-*&G*69s(*&6O6g(*%FG(D(DK%3MaA9K({l(*	K-D6G(s Eq
A"*=Bki-D=%$pH6F-*K&#p&6M3(*|*·%ZrXFXF7^Z6 "(*-6[(DK&#?«03R&6T&7$7R='-*49=#8%$
EqhB#-*&#A4r&M'&7$7%kÂ/}=B6A"-*p´ÂN ;ÃÃ[?V03QB6-D&6A4&6M)&7$7Q"6R(*"MN&69=9=&IUVKBn4-*-(DK%F¶g<%Ã
<
!I " ý
,9K9.D*6B6*FG(Q(*&n*A"oiB#-*&#A4-Dd-*%8F=H6%$ 8 I\\,XFXF5xdbNX|6*I·%Z'^µbNXkFIX
*6XFÂaI(D&6V'A9K(*F#x([Ã ÃC03",B6-D&6A"4"j-DL*F9KM{l&#-*BG=eF=B"¶(DFqm=G(D=T*&6LA"*F-*{@*4;8K¨"%$
-DF49=FI(DK&#R$7B6-DFL EqT$7qE"6mF69K9=q"$R6$$7=BmFU´m' ;F-UV"FR"8%*D-DqmKg*-*(xLU3q6?
03*F9=8(*=&6p&M(DUyFc -D"$79K%$p Gq(* 3*I·%Z ]XF\ Il#"^%Ibl^aI9=q#F-%J;UV"F-D6
(DF=-tK"(D=69K=e(*=&6p=B6%$ Eqd(D
º
I]Im^a` jI"[^bXF;`F
¬
*Ib`\jI!·7DIbl^aIh9q6-J]6
FE4"9=6K%$R=E8(*=&6|? ?
03GA"' ;F- &MÈ*='A9K(D6F&#A"¼Ma6A9K(D A"44&#-(D$ Gq (D *&69=A7(DK&# $74"$ &6 (*
=49KFG(D(*=&6m&M"(D3A"$7-*9=qEK"B,Ma6A9(*{(D&69=F-G(1 A=9=$7=B 9=&7OE3Â8&6"AFJII(D&6 "-*&G6$6(Ã[?
fgA-jFA-D-*#(C=49KFG(D(*=&6A"44&#-(1A4m(*&
bn−12 c='A9K(D6F&#A"!Ma=9=A-*%1UV(D=TgB#-*&#A4JIUV-*
n =3(DtB6-D&6A"4Q*Ke6?
L&6(*(D"I(Q(*p8&#"(*F8q 4-*&6(*&78	,F6oA"*d(*"kU§IXpFG(D(xq#JsF&64&G%$r&M)cA9(DK4"9K
&7$7%FJ7F6[(D9KqQ63K(LKK(*9=9=qRA"*$R(*t"&6t&7$7K(Dt&6-DKB#K9lJG"&6QMaA9K({l(*	K-D6#(VH#F-=&6?Ev@(
(*=9K936D*A'(*Q&6Rm9=Usq7)HI=9 9=6J} A7(m(*m4-*-(xqp'&IU½#KH6%$p(*-"*4"-DFG(D9Kq
MN&#-Q(Di4-D&(D&EF&69lJs(*"6O7R(D& (*i=49KFG(D(*=&6¾&M'(DhEF9KM{@&6-DB#"KeKBr+.-*&#A4±ÁdFc -D*=4
6 "x(D-D#[(DK&#?;03O7.(*&Q(*"=t644-D«J"(D8&6x(DF"Fqd4-D&(*&7F&691K49=F#(TX*YE#`8bl\_|b"XFIX
^bl[^aF·7b@XT\#[^b7 #=(3KK(*9lJ7&#TMaA"9(*{(D&69=F-G(H#F-=&6?E03t8&#"*=(*"8q4-D&(D&EF&69$
(Dt-*49==I(*=&6{l "#%$Ma6A9(V(D&69=F-"Fg%"* -D,(DEA"L89=6-*9=qT$7%8&6A"49K%$?
$ #'()+ %* + 71%( # '( / '*% &,-"%..%* 1)5. 0. #%
9
8(tA".&(D'(D"I(%JKSQB6-D=$58&6x(DK"BR&M389=A"(*F-,MN$7-D(*=&6J]=#(DF-*{@F9KAx(DF-.9=(*F8q.B6F"F-9=9Kq
=B6"F-(DFt=G(*-I{89=A"x(DF-9I(DF"Fq6?8vt&#-D$7-](*&V=4-*&IH#!(*j4"-*&6(*&78	I8T8=F"Fq6J%VAK(D6 9=j44-D&##
n-DF9=qS&6m==KeKB5(*"Q=G(*F-*{89=A"x(DF-8&#mcAF(*=&6"?!03"=m$75"6c ;FF A"*$nK &#m
À7Áq7(*F."$k"6g9=6$(*&Q(*$7%=B65&M37^aX8**`E^a`I\38&#"(*F8q|4-D&(*&7F&69F?;v ; 9 ¸ ;Æ:¿I>lJ
9=&7F93F#m-DQF-*%I(D$i&#n#n89=A"(*-J}(*&p&647(DK=eFQ(*9=&E9=(xqS&6Mg8&#"%8A7(DKH#Q#F8%**)(*&
-DF&(DL$I(t&7$7¨;FI(DK&#"?6vd:
>@J(*"=s44"-*&G6m=449==$m(*&c$7=(*-D= A7(*%$9=&EOc"6B6F#(%J6 Eq
-DF&#-D$7-*=Bc9K&7OT-DWGA%x(F¶7-DWGA%x(MN-D&6 (*t9=&7F6989=A"x(DF-L6-*-*H#$Q FMN&6-D-*m&6(*-DWGA(D?
9
F(.A"g&IUyF&6"*$7F-.E^aXF**`D7^a`I\sH6F-*K&#&MC(Dc4"-*&6(*&78	!*O6F(D%$d&6A7(.Kk(*E%[(*=&6
?=<6?
03!H6-D*K&#J%K9=9KAx(D-D(*$'&6m/}=B6A"-*
Â#Ã[J!K"*4=-*%$) Eq(*"=F--F69J%&6F{l "#%$t4-D&(D&EF&69#MN&6-
-DF9=#LF&6"*=(*"8q$7%*F-*= %$=:
>l?G03,$7%t=(*&cA"*,b\KXFXF\"E^aXF*ID`D73"IX;%6X8[?"fg
%6T89=A"(*-JGT\K%`I\"X.UV=9K9]*F-DH6L68%**1MN-D&6Ç(D,9=&7F9;89=A"(*F-%JGUVF-D#jc6\K6\"IX.UVK9=9
*F-DH6,$"I(Dc68D*C(D&'(D89=A"x(DF-FJGl?#?#(D&)(Dg9=&7F69&#?
c89=KG(s$(*&68%*&#m
$(D"J#K(sUV=9=9;-DWGA=-DV(*6D*&EF=(*%$9K&7Om(*&c(9=&7F69?Gv@M(*s&6g&IUV"j(DgF&6-D-*%4;&6$7K"B
#F8%*-DKB##(j(D&'(D$I(JE(VF6QDI(D=MNq(*68%*?7f,(DF-DUV#J#K(VUVK9=9]-*%W#A"((*".9=&7OmMN-*&#Æ(*
B#9K&# "9CJ«UVK(*h6iA4]$I(D$i8Eqk&Ms(*"R$I(? L&(D(*I(t(*"RB69=&6 9C&#mR&69=q5*F-DH6%.(*
-DWGA%x(j**A$T Gqm(D,9=&7F9&6%G(s"6&m8&6G(D-*	&6TUVI(-DWGA%x(6-*,*A "*WGAG(*9=q*F-DH6%$
Eq|(*"c9=&7F91&#?]ª,&IUH6-J"(*&m==Kem=G(*-{89=A"(*F-8&#'AF(*=&6"J]T9=&E91&#m*F-DH6
9=&7F9-DWGA%x(VUVK(*|=B6-V4-*=&6-DK(xq(*"6|-*m&6(*t-DWGA%x(3=DA"$Q&6|&(DF-,F9KAx(DF-FJ7-DFF=H6$QHE=
(D|B69=&6 "69s"&66?j0}&pH#&6$h(D-DHII(DK&#JC59==mK(=*8(&#h(*"dGA"' ;F-&M8&6%8A7(DKH##F8%**
*F-DH6%$T EqR%6R9=&7F69&66J&m(*I(V-*&(*-DWGA%x(3 )*F-DH6%$(*&E&?
03m8E(tx(DF4p=g(*&O#)(*"=.=F--F9}4-D&(*&7F&69}MaA9K({l(*	K-D6#(%?;0}&Q(*.4A-D4&G#J;UsmA"
(D)*6g(D"=WGA)$7%*F-*= ;$K(Dt4-DFHEK&#A"V*[(DK&#?
)-*4968.#|9K&7F69&6 EqQB#-*&#A4
«Ø+!Ø 1Wa= !5 !
<6<
Global home
LDG LDG LDG
C
C C C
C C
C C
C LDG: Local Data Group
GDG: Global Data Group C: Client node
GDG
(b) C
C C C
C C
C C
C Local
home
Local home Local
home
(a)
%" >3(6.<7 #>;$'1">2<&>70&997;.*0 &<&=&>?
&6M&7$7JG(*"(UsgF69K9}`I\
º
Ib 3*I·%ZhÂ
9
À.+tÃ8?7s(3'KB#F-s9=FH69J#(*",B69=&6 9;&6,-*49=#8%$
Eqh 3\K6I\
º
Ib 3*·%Z Âl+À.+tÃ8JjUV&G|Fc -D-DQ(*
9
À+dÂa/!=B6A-D
Âa ÃÃ8?03+À+
6"$h(D
9
À+"H#R(D9M{@&6-DB#6=eF=B4-D&64;F-*(*=#m$8(D6K9=$=(D|4-DFHEK&#A"%[(DK&#¶1(*q
=G(D6K'*&6sA"*F-*{@*4%8K¨"$)-*49KF(*=&6'$FB6-DF Gq)$qG=9=9Kqt6"$'#$$7=B,UhFc -D}UVF
%8%*D-Dq6?
'(24'(.7 #, . 07 ! # 0) #77' %* . !)7'*)7
03 FFG(*-9$7 &6Mµ(D 4-*&G%$644-D&## 8&#"(DÆ=A=B -*49==I(*=&6"$B#-*&#A4
F&6'A"=I(*=&6S x(D-D#[(*=&6g=i&6-$7-g(D&dF"F(*THI=9 =9KK(xq&6M3F-*K(*F69C4-*&6(*&78	CFG(*K(*=?
031U3q6J%(*VF&6"*=(*"8qt4"-*&6(*&78	GF&6A9$)(D-D6"*4"-DFG(*9=q.(*	K-D(*(xU&.OEK"$"1&M"Ma6K9=A-D¶E<%Ã!8-6*
&6Mt(*p&7$7R(*I(Q=49=FFG(JV#RhB#-*&#A4J(*S8-D(D=9gFG(*K(xq5 Ã(*4&#-D6-*qMa=9KA"-*%R&6Mt(*
F&6'A"=I(*=&69=KO73 ;8(xUsFQ(D*&7$7?
#
@
0&'()+ '. 1%('( !)5. ,-'(%*"$ !7
03644-Dʒ&6A"9=$5 FG(DF"$$5 GqkA"=BQ(*Dm(*%W#A"cMN&#-F"6"8=BQ(*THI6K9 =9=(xq
&6M3&6(*-'#(D(DK%'=EH6	KH#$pKh(*Q4-*&6(*&78	?}/&6-cKx("F6J(DQF9K=FG(c#F8%**=B|(*$I(8&#A9$
69=*& ;Q-DF49=FI(D$?!ªL&IUsFH#F-%J«$7F4;F$7K"B5&#i(*44"9KF(*=&6J}(*c=c&(9=Usq7t4;&#D*K 9=6?103
AH6K9 "K9=(xq¾&MT*F"*&6-hÂa"-$7U3-DS(*=m-DÃd&#-56449==I(*=&6 $F49=&IqEmG(k&6 "(D#89=Âa*&M(xU3-D
GHE=-*&#FG()$7F4;F$7F"FK%FJ}%8A-D(xqk4	K8=J«*&M(xU3-Dc9==FF"*-D(*-D=8(*=&6"J]8(D6?Ã8J«qO#(
=4&G**K "9Kk(*&h-DF49=FI(Dd(*"pF9K=FG(?sv´*A"oF#%FJMN&6-449=FI(DK&#"TUV"F-D(=Q=m4;&6-*(D6G(T(*&
(D&69=F-I(*tF9K=FG(3Ma=9KA"-*%FJ$7K~]F-DFG(V(*%W#A"3"H#,(D& tA"*$?
<
!I " ý
client C1
LDG LDG
acquire
acquire acquire
W(X)
lock ? data X read X lock lock
acquire
client C2 GDG
DetectionFailure
; 0 0 !
client C2
retry_acquire client C1
LDG GDG LDG
lock ?
lock acquire
acquire
W(X) acquire
acquire lock
W(X) data X read X lock
read X release
data X Failure
Detection
"! 1#$%0 &('*),+-.1 ,/ 1
9
F(At8&6$7F-|K(*AI(*=&6 ÂN=9K9=A"(*-I(D$5&65/!=B6A-DT¿6Ã8J;UV"F-D89==FG(
C1	=$7=Bd*&6c9=&7O F-D#%F?;0«&QF"*A-Dt(*"c9=KH#F%*,&MC(Dc9=&7OEKBRm%""=*|J"(Dc9=&7OQ6"B#F-cÂaF-D6¶(*"
9
À.+tÃ
F&6A9$c$8$73(D&38*`XV(DV9=&EO'-*9K%6*UVcK($7F(*8(D1(DL89==FG(u!Ma=9KA"-*#?6031Usq#JI&(*"F-j89==FG(D
"HE=B-*%W#A"(*$(*9=&7OhÂN6?B"?
C2ÃgUs&6A9$ ; 9=m(*&|6W#A"K-DcK(?ª,&IUH6-J(*F&6-D-*%[(*"DL&M
*A"iDF'$74"$7FG('&#p(*T4;&(DFG(*9K4"#[('&6M3(*R#[(DK&#"t4;F-*MN&6-Dm%$p Gqk(*TMaA9K(xq
F9K=FG(t$7A-DKBQ(gF-*K(*F69!*8(*=&6&#(Dm#[(DK&#"V(D"I(.(*m&(DF-89==FG(D.U3K(*=BMN&6-g(*"c9=&7O|6-*
*A44;&#*$R(*&4;F-*MN&6-D|?ªLF-Dt-Dt'MNUµ4;&#D*K 9=tK(*AI(*=&6F?
9
F(jA"CA"44&G#JIMN&6-C="(D6"8#J(*"(C(*LF9K=FG(
C1m&7$7K¨"%C&69=q'*&639K&79$(D.AG(*=9K(8-6*
6"$p(*"()(*"*R&7$7¨;FI(DK&#")6-*&6('-D "%[(*%$SKh(*TB#9K&# "9=9=q5*"-D$S$(D?}vS(*mF6*6J(*
B#9K&# "9"$"I(D)=x(DK9=9"HI9=$T"$m(DgF9K=FG(
C2F&6A9$$7%8$7V(*&'KB#&6-D
C1uCMa=9=A-*g"$4-D&78$UVK(*
(DV87FA7(*=&6&6M;K(DjF-*K(*F69%[(DK&#?603j*(DA"I(DK&#mF&6-D-*%4;&6"$"FJ%MN&6-K"(D6"8#J(*&t&#A-j8&#"(*F8q
4-D&(D&78&69lJEUV$7&E%3&(L4;F-*MN&6-D°EqTB#9K&# "968(*=&6 FMN&6-D.(*F$Q&6M«(D)8-D(D=9*[(DK&#?03
&7$7K¨F(*=&6"s4;F-*MN&6-Dm%$=c8-D(D=9%[(DK&#Q-D,B#9K&# "9=9=qm4"-*"BGI(*%$ Eq(*-DF9=6*L-D(*=&6?
9
F()A"t&IUÇ6DAm(*I(t(*"T6[(DK&#"4;F-*MN&6-Dm%$k Eqk(*TF9K=FG(
C1 "H6*&6B69=&6 "691K4"#[(
6"$Q(*"(g&#tB69=&6 "69K9=qR*"-D$$I(-*=="F&6"*=(*G(LM
C1Ma=9=L FMN&6-D¨"=BK(Dg8-D(D=9
*8(*=&6?%v)(D=1*F&6"$)6*6J
C2&6(}=B6&#-*
C1u«Ma=9=A-*#J&(*"F-DUV=*jK(!UV=9K9E4-D&78%*}K8&6x(DFG(
$(D"?
L&6(*-K(*AI(*=&6´(*"(dq9=#$o(D&rK"F&6"*x(DF"FK%Q|-DF9I(*%$(D&Ma69=*5Ma=9KA-Di$78(D8(*=&6"
Âa-*m' ;F-m(*I((*QMa=9=A-*d$7F(*%[(*&#-c6D*A$i(D&5 ;|A-DF9==6 9=%Ã[?fg /}=B6A"-*|zJ!(*"
9
À.+mu
Ma6K9=A-D'$78(D8(*&6-gUV-*&#B69=qQ$8$7%V(*I(L(DcF9K=FG(
C1Ma6K9?03Lq mFA%$Q Eq|&#) "6$9KqG{
F&67¨"B#A-D$|(DKF&#A7(J]&#-g Eq|(*"*9=&IUL$7&IUVd&Mj(D.F9K=FG(%J$7Ac(*&|&#m'(*m4;&6--Dq|&IH6-*9=&##$?"03
9
À.+(DF$7%8$7L(*&MN&#-DFt(*")9K&7O-*9K%6*t"$|9=8(gF9K=FG(
C2(D&R6W#A"K-D(*'9K&7O|"$|&7$7KMNq
*&6t-D$$I(?
9
(*-JF9K=FG(
C1(*-DK%s(*&-DF9=#g(*t9=&7O]J7 A7(,K(L-*%9=Ke(*I(LK(,"6V69K-D#$7q ;Fp-DF9=#%$k EqkMN&6-86?vS(D)F##Jd	KA7(DKq5 (D&|(*-Dq(*&#FWGA=-*m(D9K&7OpB#6KS$
-D8{@87FA7(*g(*")8-D(D=9*[(DK&#?
«Ø+!Ø 1Wa= !5 !
<
vm69K9G(D*s6*J(C!F9K%-D9Kq=4&#-(G(}MN&#-!(*39=&EOt4"-*=(DKH#3Â P ÃE(D&.-D8(DA-D
(DVA"*F-j*&6VKMN&6-D(*=&6 ;&6A7(C(DV4;&#D= 9=3Ma=9KA-D!(D"I(jq)H63 F$7F(*8(*%$J#*&.(*"(C(*
A"*F-gqRO#(*c-*=B6G(g$7%8=&6ǦFK(*-,=B6&#-*(D)Ma6K9=A-D6J&6-V(D-*=B6B#F-,*&6t-D&69=9K "#O"P-D8&IH#F-Dq
#[(*=&6F?«EAS#[(DK&#"t-DB6F"F-9=9Kq6449==I(*=&6{@$74"$7#()6"$S&#A9$k&6() "$79=$S(t(*
9=FH#F9;&M(*".$7(*-DK A(*$RqE"-D&6"Ke%I(*=&6|?
-D,FA-*-DFG(D9KqmU&#-*OE=B)&#RT"6"8%$
cA7(*A"69#F89=A"=&6t%"*J% 9=j(D&L(D-D#Og89==FG(«Ma6K9=A-D«6"$t-DF4;&6-*(«-DF9=FHIG(«=7MN&6-DI(DK&#) ;&6A7(
(DMa=9KA"-*x(D&6-Dq6?
@ 0&'()+ '. ,-'*%(" !7 #, %*"7. / %* # !% . +#"7
v|&6A"-s"K-D6-DF69*6JE(*"*K(*A"(*=&6"V$7%*F-*= ;$| ;&IH6gMN&6-V89==FG({@9KH69]Ma=9KA-D3qR69=*&m
B#F-D69K=eF%$mMN&6-V89=A"(*F-*{@9KH6F9Ma=9=A-*%gÂa-*F' ;F-s(D"I(s(*
9
À+3 ;F"H#g6s89==FG(Ds&M«(*t+À.+tÃ8?
9
À+½F6|(*&69=F-I(D'T9==mK(*%$EAc -,&M*='A9K(D6F&#A"VMa6K9=A-DL&6MC(*m&7$7%V(*I(t8&64;&#*)K(?
v@MC&6-DtMaA"9(L&7FFA-J"&6-LKMC(*'UV&69=)A"$F-D9KqE=BT4Eq7F69«89=A"(*-L=g$7&IUVJ"(*
9
À.+Ma6K9?ªL-*
6B#=JG(*"F-DtqR (xUs&c6Kd*(DA"I(DK&#"F?
v@M(DmMa=9KA"-*&7FFA-D.UV=9=T&#mm9=&E9jF9K=FG(t"6&7$7K¨"$k(*"T$I(Q4"-*&6(*8(*%$k Eq|(*I()9=&EO]J
(DF(D,*(DA"I(DK&#==K9-(*&t(D,&#L$7%*F-*= %$KT(*g4-*HEK&#A"j*A "*[(DK&#"$qmB6F"F-9=9Kq
;t"$79K%$R=d=K9-V"F-%?
v@M}(D)UV	KA$7F-D9KqE=BT89=A"(*-V=L$&IUVJ7&6-VKMC&T89=KG(L&6Q(*"(,89=A"x(DF-L"&69$3(*"t9K&7OR(V(*
(DK)&6M!(DtMa6K9=A-D6J(DF|(DF-D)UV=9K9} '&R$(D="8&#"(*F8=VUVK(*&6(*-,89=A"(*-D?
9
F(,A",&IU
#**A.(*"(gIx&6-DK(xq&M1(*t"&E$3(D"I(,6O6A4
9
À+&6d&#)89=A"x(DF-
LMa6K9lJ"UV=9=)&#m F9K=FG(
C #F8%**L(*$(DQ&65(*"(F9KAx(DF-%?03'Ma6K9=A-DcH6#(t$78(D[(D$5 Eq|(*T+À+mJUV=
MN&#-DF3(D'9=&7OQ-DF9=##JKk&6-$7F-V(D&RDI(*MNqQ9=&7OQ-DWGA%x(V=D*A, Gq&(DF-.89=A"(*F-?03'F9K=FG(
C
q(D-*=B6B#F-s(*t="(D6#(D=(*=&6&MCmFU
9
À+ &#d89=A"x(DF-
L1?7v@(,F6Q(DFd$7D8&IH6-s(*"(V(*)$(D
"#' ;FF&6"FA-*-DFG(D9Kqp&E$¨"%$i&6 89=A"(*F-
L Âa Eq C K(D*F9KMDÃm$i&6h&6(*-mF9KAx(DF-F?!v*A"n
*(DA"I(DK�==I(*=&6{l9=FH#F9«-DF&IH6-*q"6=*g6-*cFD*6-*q#J*K=9=6-.(*&Q(*m&6%,#(DK&#$
=(*t4-DFHE=&6A"3*8(*=&6?
$ ")'()+ . +0#"$ /&%('(1 .'*) %* # !%
,&(DF-V=4&#-(G(L6*4%[(L&M!&6A-V4"-*&G%$R4"4-*&G6Q=3-DF9I(D$R(*&(*"t-*49KF(*=&6$7FB#-*g(D&
A"*$QMN&#-L#B#-*&#A4FG(*K(xq6? ;&6"*=(*"8qR4-*&6(*&78	=3-DF9=qR&#(*-"*4"-DFG(V-DF49==m6"B#FFG(L Eq
(DB6-D&6A45FG(*K(*=?ǻL&IUsFH#F-%J"(DT8&#"*=(*"8qd4-D&(D&78&691A"*F-qU3G(.(*&(*A"(*-DF49==I(DK&#
9=FH#F9=&6-$7-3(*&T&# 7(D6KdB#&G&7$Q(*-6$F&~p F(xUF|4;F-*MN&6-D6"8)6"$MaA"9(L(D&69=F-"F6?"03" 3*I·%Z
X8\ GI"^%b^a59q6-s63(D&m=49=FFG(g*&6-*49==c6"B#FFG(V4	K8q#J9=KO#t&7$7)9K%[(DK&#
MN&#-L(*")-*4968FG(,&M1Ma6A9(xq&7$7%F?;03=,=,K9=9=A"x(D-D(*%$|&6/!KB#A-Dm EJUVF-D(*m9M{@&6-DB#6=eF=B
B#-*&#A4RFc -D*=4|4-*&6(*&78	&E&#*s&7$7
D (*&-DF496F,(DMaA9K(xqR"&E$
C?
2j-D&(*&7F&694;&69=8='F&6A9$S4;&6=#(m&6A7(c&7$7'UV(Dn8-(=i4-*-(DK%F?3·"I"bl^bIbl^XtZ\_^a`F^aX[dF6
/(*=Ke.'(*-6$7&~d ;8(xUsFFRMaA9K(3(*	K-D6"8."$R4-MN&#-*8, EqT-D8MNA9=9Kq6"B#KB'(*B#-*&#A4
*KeÂa?6?3(D5-DF4"9KF(*=&6´$7B6-DFÃ[?3ªLF86JVnB6-D&6A4o#$7k&6M'Eqr&7$7QUVK9=9tA"44&#-(|Eq
F&6"FA-*-DFG(V&7$7Ma6K9=A-DJ7 A7(,K(LUVK9=9U36(*tF&#-*qR*4"#8t"$UV=9K9«9K&IUsF-3(Dt8T8=F8qR&6M1$"I(D
