HAL Id: tel-00512559
https://tel.archives-ouvertes.fr/tel-00512559
Submitted on 30 Aug 2010
HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.
L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.
Modèles et algorithmes pour la modélisation parcimonieuse de signaux de grande dimension
Boris Mailhé
To cite this version:
Boris Mailhé. Modèles et algorithmes pour la modélisation parcimonieuse de signaux de grande dimension. Traitement du signal et de l’image [eess.SP]. Université Rennes 1, 2009. Français. �tel- 00512559�
o
"!$# %'&)(+*-,.#0/+!1*23 4)# /5#(6( #"!87
9;:<=9>@?9BAC?D<FEG?H>JILKNMPORQ?TSC9COVUXWZY[<\S]:C^_WC?TM_M1?`EG?"abS?2UcDBdeM1?
fhgGikjml@nZoGj]peqkn"qkn
4srutv#&)/ 4)# wyx@&)(6*C,.#0/+!1*23 4+# /z#0( (6#!87
{
?-MUVO|:}M~y\S]DOVUc?Tz?-MUbE}<6POLdeMDe>
#0G F e VsPVBB
fkjBJnBG];n"f_pj
= =¡=¢8£
f_jBf_pj;n¤`l¦¥§ik_¨©]qknjªn«C¬knBjJ«C¬kn o ®G¯}°5±X²y±X³=´
µ ±
k¨¶i ·q\n
²
nB«-¬knBjJ«C¬knnB
±
¸gGj¹5p}¨@º=iknZn2
³»
J¼¹½nB
´
l@pJgG¨@jnBC¾
µÀ¿
g¹ÁfhgpGJn"i_k¨¶ÂnBjJ]¨©p¨@jn}¾
à ÄzÅ.ÆÈÇ2ÉyÊ ÉÌË Í"Ç2ÎÄÏÐTËÒÑ+Ó É·Ê
Ô
ÄvÕ.Ï ÇBÍ ÏÉ
Ô
Ï×Ö·ÊÉ·ØÙËÍZË×Ð2ÄvØ
Ô
ÍÏÛÚ[ÐBÓ ÄÙØ.Ð;ÉyÕ6ÊÉ Å.É ÊÐ2ÎvØ6ÍÕ5Ü
Å.É ÎÏÒÍHØ+Å.É Å)ÐBÓ É·Ø+ÊÐ2ÄÙØ
ÝßÞ\àBá
á
â ã]Bäâ "åHæyBä\ä\
á
ç
\èBéTBêë\
e
ìíªîCï-ð2ñòóíô¦õ}ö¦÷yøùTúÌûùTü¦ýÛì}íbþ
ÿ ×} #0(64+wß*T(
! "$#&% '()*+,
t.- }20/21&+H#0(
34 5768(( :9;=<?>+@A ('CBA5D(%FEG5H )* H# I7%%J5D LK
u×}=NM#PO)/z3
Q GI7 )RA'S TI7 Q )#& I7%%J5H )
0U }=4/ tHw #/5t
) )* WVX#&YZYT[ +,@'
M} ,]\z( 4)#0/^u #PO)( !N
34 5768(( SIH((5,*'_!3!Ea`b#C57Kcd F)e(
ÿ
gf=Tf}ihH*- h½rÁ
4! G Q j#d aC)e(
/kf!lmu/5*dh r (+,]\zw
no p WVq#057Kcd n
";*(0I@*(
"m j 'Yn34* ) E '' )*S%J5H 0YN<I@u5H +IHd 'S%J+I7+,) I@DI7;=
"m jI7d YZYT[ (dn¡ )¢ £u¤@u5H+,05H+(IH 0+N%J¥;* 0Yn%(9_;=<?I7YZ+)
)e(D
" &9F5H(0;*(05H;;*eRD(I7Yn*(RD ¦HT9_£,§(I7++'((5H+,%GIH(('(0(¤@,D
"m §+N%GI7 ))*;* ¨9n©SI7 )+%J5H YN<?I@A5H 0%J )Yn*(SI7Yn%J I7+(0(5H+N(I7;*5H+¥£uGI7+_¡)
GI7*(0+I7%%GI7 )YZ+,9_`&I7(I7++D
"m &9FYoIn5HYn%GI7RD+Sª¨*I7+Rn%J5HN )YN<I@u5H (5H+,N%J+GI7+,0;=<?' )) SYoI7+,( )
º
ÀpÁ,ÂÁuÃ7ÄuÅÁ,Â]ÁÆJÇÈ É
ÊÌËÍaÎ
Á¥Ï:ÁuÈoÂ
Ë
ÇÅÑÐ,ÃÒÁ,È Ó
ÔÆJÇÃ7ÕgÏaÖ&ÄDÇÅÕ¯Æ ×G×
× ØÚÙuÄAÕJÂ]Û!Õ¯ÈÅÑÇÅÑÕJÆÜÛ Ë ÃÒÄuÅ8ÂÕ¯Æ:ÅÑÁÖjÈÁÝÃ Ë Û:ÅÏ:Á.Ï&Á.ÈÒÅÞ¯Æ Ë Öjß ÎÕ¯Æ&ÞGÈ]ÈÖjÃàÏ&Á,È]Ï:ÅÄDÇÅÕJƤá
Æ Ë ÅÃ7ÁuÈ ÎÕ¤Ä Ë Ö§ß âg×
ã ã 3! 5H[;*eYZ SSSSSSSSSSSSSSSSSSSSSSSSS dã
ã ä
I7;=<I7 )_SSSSSSSSSSSSSSSSSSSSSSSS
D
ã ã "+Yn*(I7)*5H++5H )YZ
`p
SSSSSSSSSSSSSSSS D
ã
V;RA5H ))YZ(RD;*5H5H+(SSSSSSSSSSSSSSSSSS
D«
ã ã ;;åI7RAd æSSSSSSSSSSSSSSSSS D«
ã "PI7+Ro34 (Tç8"m3ÌèéSSSSSSSSSSSSS D«
ã « ê
))5HRA5H+GI7;:"mI7+Rb34 ()Fç
ê
"3ÌèëSSSSSSSS
¬
ã « Q 5HYn%;*d'(I7;RA5H ))YZ(¨%J5H ()yNSSSSSSSSSS ¬
ã ¬ ¨*)*5H++GI7 ( I7%*(NSSSSSSSSSSSSSSSSSS Dì
ã ì í
IHd*+,34 (Tç
í
3ÌèoSSSSSSSSSSSSSSSSS
Dî
ã « WYn%;*'YZ+,I7)*5H+b I7%*0"m3]%J5H C;*(Cd*)*5H++GI7 (Ì+,@DI7 )åI7+,(C%GI7 !) I7+();åI7)*5H+ Aï
ã ¬ Q 5H+d)*5H+(¤<?5H%)YoI7;' SSSSSSSSSSSSSSSSSSS
Aï
ã ¬ã Q 5H+;(*5H+ SSSSSSSSSSSSSSSSSSSSSS Dð
ã ì WYn%;*'YZ+,I7)*5H+qñ I7%*ò ¤<ê "3ó() 0(d*5H++GI7 (;*5,I7d SSSS Dð
ã ì ã Q I7;*;&(05H ) ';åI7)*5H+(ÝSSSSSSSSSSSSSSSSS
Dð
ã ì Q I7;*;&;*I_YoI7) )* í I7Y SSSSSSSSSSSSSSS Dô
ã ì ã õ ;åI7+ SSSSSSSSSSSSSSSSSSSS «D
ã î
`j5,
ê
"m3öSSSSSSSSSSSSSSSSSSSSSSSSSS
«D
ã î ã ( )%)*5H+¥RA'+' I7;*DSSSSSSSSSSSSSSSSSSS «D
ã î Q 5HYn%;*d'÷SSSSSSSSSSSSSSSSSSSSSS
«D
ã î « Q 5HyNd¥(5H(LKcd*)*5H++GI7 TSSSSSSSSSSSSSSSS «D«
ã ï 4+()*5H+mI7dÚd*5H++GI7 (YT;)yKc';;*(øSSSSSSSSSSSSS « ¬
ã ð
WYn%;*'YZ+,I7)*5H+mI7+(0"m3!ù© SSSSSSSSSSSSSSSSS
«Dî
ã ð ã V;RA5H ))YZ`§5, í 3úSSSSSSSSSSSSSSSSSSS «Dð
ã ð V0e( I7%*TI7dNI75HYZ((';*)*5H++'(pSSSSSSSSSSSS «Dð
ã ô V%%;*I7)*5H+mI7dÚ()RD+GI7d YT;)*I7+GI7dÝSSSSSSSSSSSSSSS «Dô
ã ãû '();I7(0d%J' )YZ+,I7déSSSSSSSSSSSSSSSSSSSë¬ û
ã ãû
ã
!+¥"V!ù`§V
õ
SSSSSSSSSSSSSSSSSSSSSë¬
û
ã ãû "m3!ù©iSSSSSSSSSSSSSSSSSSSSSSSSë¬
ã ãDã 3a ()%J)@A(PSSSSSSSSSSSSSSSSSSSSSSSSë¬
ã ãDã ã ";)*dYZ+()*5H+(üSSSSSSSSSSSSSSSSSSSë¬
ã ãDã þý GI7+,)yÿGI7)*5H+m;=<? ) 5HYnYn*(%GI7 0 I7%%J5H )¨9 ê "m3ÜSSSS ¬D¬
ã ã
Q
5H+;()*5H+NSSSSSSSSSSSSSSSSSSSSSSSS ¬ ì
â Û:Û&Ã7Á,ÆJÇÅÈÈ Ë ÞGÁÏ&Á¥ÏaÅÄDÇÅÕ¯Æ:Æ Ë ÅÃ7ÁuÈZÅ8Æ Ë ÃHÅË ÆJÇÈnÛ Ë ÃoÇÃ Ë Æ&È ÎË ÇÅÕ¯Æ Ó
ã ä I7;=<I7 )_SSSSSSSSSSSSSSSSSSSSSSSS ¬ ð
ã ã
V;RA5H ))YZS¤<
ê
;*(GI7(+dKcE:*;*SSSSSSSSSSSSSS ¬ ô
ã V;RA5H ))YZS" ê øSSSSSSSSSSSSSSSSSSS ¬ ô
ã « V;RA5H ))YZS©¨K SSSSSSSSSSSSSSSSSS ìDû
ã ¬ Q
5H+;()*5H+ SSSSSSSSSSSSSSSSSSSSS ìdã
3aIH(5H%)YoI7;j%J5H 0;=<I7;RA5H ))YZ¤<
ê
;*(GI7(+¥E:*;*iSSSSSSSSS
ìdã
ã 34 5H[;*eYZüSSSSSSSSSSSSSSSSSSSSSS ìD
Q
I7;*;j;=<I75HYZ5H%)YoI7;
ϕ(i)d SSSSSSSSSSSSSS ìD
« `¤*+mI@A;*%GIH((+,
ρ I7+(0;=<I7;RA5H ))YZT¤<ê ;*()GI7(+E:*;* ìD«
¬ Q 5HYn%;*d'÷SSSSSSSSSSSSSSSSSSSSS
ì ¬
ì `¤*+mI@AS©¨K¨úSSSSSSSSSSSSSSSSSSS ìDì
« '();I7(%J' )YZ+,I7déSSSSSSSSSSSSSSSSSSS ìDî
« ã ê [d¡))y64YZ( S£,GI7;'S;=<?I7%% +,)*((I7RAóSSSSSSS ìDî
«
,¢+,)e(S5H++'(()( SSSSSSSSSSSSSS
ìDî
« « ý ;j();*RuI7+¥dN%GIH(IHI7%I7)y64%GI7 0 I7%%J5H )¨I7N%GIH( ÿ ^SSS ìAï
« « ã Q 5HYn%GI7 I7*(5H+m9n5,o*+,(ÿd'( SSSSSSSSSS ìAï
« « Q
5HYn%GI7 I7*(5H+m9n()%%J5H )S'5HYn%J5D())*5H+Nÿ'ZSSSS ìAï
« « «
4+(YT[;*;=<I7;yRA5H yYZ SSSSSSSSSSSS
ìDô
« ¬ ä @DI7;GI7)*5H+() ;åI_[GIH(S¤<yYoI7RA(¤<ê ;*()GI7(+E&*;*¾SSSSS ìDô
¬ V%% +,)*((I7RASSd*)*5H++GI7 (+,@DI7 )åI7+,(0%GI7 0) I7+();åI7)*5H+øSSSSSS îDð
ì
V%% +,)*((I7RASSd*)*5H++GI7 (YT;)*I7+GI7d SSSSSSSSSSS
îDô
ì ã "m';åI7+RAS(I7+(0'65H )YoI7)*5H+SSSSSSSSSSSSSSS îDô
ì "m';åI7+RAI@AS'685H )YoI7)*5H+(£,;*5H+£uG( SSSSSSSSSS ïHû
î Q
5H+;()*5H+NSSSSSSSSSSSSSSSSSSSSSSSS ïã
É ¤ÙuÛ Ë Ã Ë ÇÅÑÕJÆ.Ï:Á¥ÈÅÞ¯Æ Ë Öjß Ä Ë ÃÒÏaÅ Ë ÖjÁ,ÈZÛ Ë Ã Ë Û:Û&Ã7Á,ÆJÇÅÈÈ Ë ÞGÁÏ&Á¥ÏaÅÄDÇÅÕ¯Æ:Æ Ë ÅÃ7ÁuÈ É
« ã c+) 5,d)*5H+d;åIFÿ[ );;åI7)*5H+mI7 )*;åI7 óSSSSSSSSSSSSS ïH«
« ã ã
34'+5HYZe+T;+*£u SSSSSSSSSSSSSSSSS
ïH«
« ã
V0£u*())*5H+¥(';*) 5,I7 då5HRD IHYnYZ( SSSSSSSSSSS
ï ¬
« ã « 34 5H[;*eYZ) IH5H+d¥()RD+GI7;jÿ[ );;åI7)*5H+ SSSSSSSS ï ¬
« ä I7;=<I7 )_SSSSSSSSSSSSSSSSSSSSSSSS ïHì
« ã
V+GI7;¢(+¥5HYn%J5D(I7+,(+'%J+I7+,(_ç8 Q VèpSSSSSSSS
ïHî
«
5H()) IH)*5H+[GI7)YZ+,W¢%*£,Zç8V
õ
è¾SSSSSSSSS
ïDï
« « "m')5,(0[GIH('(0( ;åIF%GI7 YZ5H+*SSSSSSSSSSSS ïDï
« ¬ Q
5H+;()*5H+ SSSSSSSSSSSSSSSSSSSSS ïHô
« « V+¯I7;y¢d((0;Yn(;=<?V õ SSSSSSSSSSSSSSSSS ïHô
« « ã
>+N(;¤[GI7)YZ+,W¢,%*£,SSSSSSSSSSSSSSS
ðDû
« « d [GI7)YZ+,(W¢,%*£,( SSSSSSSSSSSSSSS ðDû
« ¬ V%% +,)*((I7RASSd*)*5H++GI7 S%J5H ;*In()%% (()*5H+N;=<IH)@'@u+,) )*;åI7 ðdã
« ¬
ã
"m5,e;*RA'+' I7)y6 SSSSSSSSSSSSSSSSSSS
ðdã
« ¬ 34 )+%JéSSSSSSSSSSSSSSSSSSSSSS ðD
« ¬« ( )%)*5H+dN()¢d()eYZ SSSSSSSSSSSSSSSS ðD
« ì '();I7(%J' )YZ+,I7déSSSSSSSSSSSSSSSSSSS ð ¬
« ì ã ä
@DI7;GI7)*5H+() 0(5H++'(()¢+,)')*£,(öSSSSSSSSSS
ð ¬
« ì ã Q I7 IH' )*())*£,((05H++'(;+*£u(kSSSSSSSS ðDî
« ì V+GI7;¢(£uGI7;I7)@u SSSSSSSSSSSSSSS ðDð
« ì «
V+GI7;¢(£uGI7+,)I7)@uNSSSSSSSSSSSSSSS
ðDð
« î 3a ()%J)@A(PSSSSSSSSSSSSSSSSSSSSSSSS ô ¬
« î ã V%% +,)*((I7RA9FI7;;*SSd*)*5H++GI7 @HI7 )åI7[;*éSSSSSSSS ô ¬
« î
C())YoI7)*5H+oI75HYoI7)*£uÌ;åII7;;* (ad*)*5H++GI7 (C9GIH£,' I7)*5H+
ô ¬
« ï "m5,';*(I7)*5H+ xv8{Ì(0YZ5H)y68( SSSSSSSSSSSSSSSSS ôDî
« ð Q 5H+;(*5H+ÚSSSSSSSSSSSSSSSSSSSSSSSSS ôDî
nÅÍ:ÎÅÕGÞ¯Ã Ë Û:ÅÑÁ ×
ÊÌËÍaÎ
Á¥Ï:ÁuÈaÞ¯Ö&ÃÒÁ,È ×
ÌÅÑÈÇÁÏ&Á,È ËÎÞGÕGÃHÅÑÇ &ÂÁuÈ ×¯×G×
C (
ϕ I75HYZ
s (RD+GI7;
r '(*d
x 5,!o*+,('5HYn%J5D())*5H+
λ 5H ) ';åI7)*5H+(¨dÚ '(*d¥I@u;*Sd*)*5H++GI7
m YZ5H)y6 ˆ
x (5H;5H+¥ 'T9F+Ú% 5H[;*eYZ¤<?5H%)Yn*(I7)*5H+
"PI7) )*(
Φ d*)*5H++GI7
Ψ (5H(LKcd*)*5H++GI7
S (RD+GI7;¤YT;)*I7+GI7;:5HN(RD+GI7dÚ¤<I7%% +,)*((I7RA
R '(*d
X 5,!o*+,(¨'5HYn%J5D())*5H+
A IH)@'I7) )åI7;*
V IH)@'@u+,) )*;åI7
W+I7)*5H+
Xi i"$#&%
5H;*5H++
X Xi,: i"$#&%
;RD+S
X xi i"$#&%
5,!o*+,dN@u
x x(i) @DI7 )åI7[;*
x 9F;=<' I7)*5H+ i
¨YZ+()*5H+(
N ;*5H+RD d¥()RD+GI7;
D +5HYF[ S¤<I75HYZ(I7+(0;Sd*)*5H++GI7
K +5HYT[ ¤<I75HYZ(I7+(;åIn'5HYn%J5D())*5H+
L ;*5H+RD ¤<+NYZ5H6
T ;*5H+RD ¨YZ5,dyÿGI7)*5H+mdN '()*d¥I7+(0`j5u ê "m3
B +5HYF[ S[GI7)YZ+,(I7 dåIH£,(I7+(0+N Q í
I +5HYT[ S¤<' I7)*5H+(¤<+I7;RA5H ))YZ
C +5HYT[ SSI7+GI7d
S +5HYT[ SS()RD+GI7dÚ¤<I7%% +,)*((I7RA
¨5H )YZ(
krk2 +G5H )YZS;*d*++
kxk1 +G5H )YZ `1
(05,!o*+,(
kxk0
+G5HYT[ SS5,!o*+,(+5H+N+,;*(0GI7+(;*@A
kMkF RO
+G5H )YZSSE 5H[J+(¤<+NYoI7) )*
hϕ1, ϕ2i % 5,dy(I7;åI7 Sd @u (
argminEf(e) +(YT[;(0';*'YZ+,(
e E £u¤Yn+Yn*( f(e)
M +(YT[;*SYZ5H)y68(
T +(YT[;*S) I7+(L65H )YoI7)*5H+(
M∗ IHH¡L5H+, M
`C<?5H[d¡L¨)S)e((¤<I7%%J5H ) (0 '%J5H+((% I7)*£u(I7dÚ% 5H[;*eYZ(¨£,§<?5H+¥ +dK
5H+,) _£,GI7+m5H+P(5HGI7T);*( (¨ % '(+I7)*5H+(%GI7 YZ5H+*G((¤`§(¨ % '(+,I7)*5H+(
%GI7 YZ5H+*((45H+()*()+,49¨I7%% 5, 4;*Ì(RD+GI7;d5HYnYZÌ+5HYT[y+¯I7(5H+ wÑ}*xH+ ¤<+T6=I7[;*
+5HYT[ _T@A (I7%%J;*'(ZxD~={H|oz_5H*(*(¨I7+(¨+qH~8{H}}¯xH+J3:5H ¨) 5H@u ¨+T % 'K
(+,I7)*5H+[GIH('Z( %J§<?I75HYZ(j5H+àIp[J(5H+¤<+];åI7 )RAo5HyXI7+(;(TI75HYZ(%J5H@HI7+,
%GI7 ))*%J 9;åIS'5HYn%J5D())*5H+§
ê
+b);*(5H+(Ìd*)*5H++GI7 (,A{H}¯AxD}G~zu5H+,+GI7+,%;(
¤<I75HYZ(£u;åIFI7;;*Sd¥()RD+GI7;=
ê +¥() 5H@AI7;*5H (@HI7+,d % 5H[;*eYZ(-
.
5HYnYZ+,Ì5H*() CI7+(4+od*)*5H++GI7 5H++';*(CI75HYZ(C£uj<5H+Z@DI);*( !%J5H C'5HY_K
%J5D( 0+¥()RD+GI7;j5H++'
.
5HYnYZ+,) 5H@A +Pd*)*5H++GI7 n£,:%J )YZ;åIo % '(+,I7)*5H+X%GI7 YZ5H+*(n¤<+
)I7+6=I7Yn;;*S(RD+GI7d/
Q
(dé% 5H[;*eYZ((5H+,N) e(¥5HYn%;*(`§(mI7;RA5H ))YZ(m£uS;*(¥ '(5H;@A+,IHK
YZ+,0(5H+, +,);*(I7[;*(0+ % I7)*£,DF<I7) (I7;RA5H ))YZ(0(5H(LKc5H%)YoI7dpYoI7*( %;( I7%*(
d*()+,,YoI7*( d I7(()JYZ5H+,) +, ;* ( ;Yn( £,GI7+p5H+ @A) I7 RD I7+( ()RD+GI7dp
%;()* (Yny;;*5H+(T¤<?'GI7+,);;*5H+(
Q
)n)e(_% 5H%J5D(Z(I7;RA5H ))YZ(FI7%GI7[;*(n) I7
(S()RD+GI7dP_RD I7+nI7;;*Z(I7+((IH )yÿG S;åI £uGI7;'ZdX '();I7§I7+()!£,§<+ZI7%%;*I7)*5H+
;åIF%GI7 YZ5H+*%J5H 0;åI_('%GI7 I7)*5H+¥S(5H (I7 dåIH£uG(
( P / i× B
`j(%,¢d()**+(,;*(YoI7)'YoI7)**+(;*(+d65H )YoI7)*+(+¨5H++GI7*((+,%GIH(;* [J5H+
Q
)(5H+NIT(5H@A+, +¨''685H )YZ';* ) I@DI7;=d )( ;g( (5H@u+, d0o;*¤<?%;yK
£, ¨;* ()H¡LF _% '*(¯YoI7*(SI7mYZ5H+(5H+X(I7£uT;* 5HYoI7+n*(&1J¨5H(
I7;;*5H+(Ì5H+G5HYnYZ+ %GI7 C+0+,) 5,d)*5H+p) e(CRA'+' I7;*¨I7o) I7YZ+, db()RD+GI7;¯())+'
I7dp+5HYT[ ((%J (5H++(%J5H £u¤;*YZ5H0()RD+GI7;¤+§<?'@u5,£, )*+N¤<I7) S£,§<+YoI7 £,
+,)y68 )*D
2
â§
á
ã43céT65Gâ\
ç
ã]87:9©ã]BêÙBäãb\â
á
9<;ä=7 ç>
>+ó()RD+GI7;(Z+¥RD I7+ b%¢()*£,]|oz?@*m£,@HI7 )*I7+(o;=<?()%GIH#75HöI7+(o;*
Yn%(Aj(5H+(T+ RD*()) '(jYoI7RA(FI7% '(T%GI7 T+ I7%%GI7 ;%5H5&()*()YZ5HRD I7%G(&';*) 57K
I7 d*5HRD I7YnYZ(G+()*5H+';* )*£uI7+G(0+;RD+V¨S`!§`j) I7YZ+,¨d¥(RD+GI7;j()0;åI
d*(%;+£u¤YoI7+%;*(0()RD+GI7dNI7+(%;()* (0[(B
.
I7YZ';*5H ;åI£uGI7;'%J @C%GI7 Ì;=<,YoI7+Xç8Yn%;*(,u+p'RuI7;*( ;* I7d*5,;åI
()%% (()*5H+¥(¢udp 5HRA(( +%5H5oI@u,D¯IH()§è
.
d) I7 ¥I75HYoI7)*£uYZ+pÚ;=<+d685H )YoI7)*5H+ç8Yn%;*(E4 5H++GI4F*) (ZYZ5H(oI7+(
+% IH(D(5H[d¡)(0I7+(0+yYoI7RADG(0[(0I7+(0+N5H I7+';*) )*£,Dè
OQP+RTS
ã . Q 5HYn%GI7 I7*(5H+p;åI¨%5H5HRD I7%*¤<+b(e++GI7) ;;*Tç%J5H )) I7Ì0`§+GId,9¨RuI7è
!¤<+YoI7RAI7;'I75H Tç%y;*(4+'%J+I7+,(Ì ;*5H+y65H )YZ0() 4;=<+, )@HI7;;*
[0,1]è:9d 5HD
.
+,'RD 0;=<+d685H YoI7)*5H+ I7b()RD+GI7;J0YoI7+*e ¨9S£u§<?;;*0%*((/U) ) I7+()
ç8dYn%;*VdYZ5,YZ(VS`! IHd*5,5HYnYT+åI7)*5D+(è
Ê Ã Ë ÅÑÇÁÂ]Á,ÆgÇÆ¤Ö:Â]Ù,Ã7Å Ö&Á V&@HI7+,S;=<?I@Ae+YZ+,Tn;=<+d685H )YoI7)*£,D§;=<?((+,;Ìn(S) I7K
YZ+,('I7*+, 'I7;*('( %GI7 0( (0';*) )*£,(+5D(:¡)5H (;*¨) I7YZ+,0dÚ(RD+GI7;¤()
% (£uGS+,)*e YZ+,¨!W¤)'I7+(0;*SYZ5H+S+,YZ' )*£,DG`§()RD+GI7;j%,¢d()*£uS5HYnYZ+%GI7
U) X*sxH}¯~8ÑwÑw{H}}*Fç85H+b+0% +b£u§<+b+5HYT[ 0ÿ+¯0YZ() (è4,YxH}G~8ZQ*_ç8GIH£uYZ()
+ %Jo% +d ¥£u§<+Ý+5HYT[ Úÿ+Ú@HI7;* (od*()+(è!N£,%J )YZb¤<I7%% 5, b;*
()RD+GI7;§%GI7 0+(¨ÿ+*S[(YoI7+y%;åI7[;*S%GI7 0+¥5H d+GI7
[
= à ç á
"\UYZ¥ÿ+*( ( 5H++'(N(5H+, (5H@u+,p) e( RD I7+( 3aI7 ÚYn%;*D%J5H % '(+,
+,YZ' )*£uYZ+,T5H(;*(S(5H+(SI7Gd[;*(%GI7 S;<?5H ;;*Z,YoI7+D§;a6=I7% +d bI75H n¬
û
ûDûDû 'GI7+,);;*5H+(0%GI7 0(5H+Zç+
Q
$I7d*5_('GI7+,);;*5H++'9T¬D¬ ãûDûX]_^ èd5H+¨%J5H +
GI7+(5H+ ì Yn+,(,;G6I7
44100∗60∗5≈ ã« Yn;;*5H+( ¤<?'GI7+);y;*5D+(d3:5H 'd ) 5HYn%;*'5H+N);*(S(|Z{a`w*z
`jIFdYZ+()*5H+
N ¤<+Ú()%GIH¨(Ì;*+5HYT[ %GI7 I7YZe) (£,§<;¯6I7Ìÿ %J5H ;*5,I7;(
+N%J5Hy+YoI7+*e S+*£uD34I7 Yn%;D 5,5H 5H++'(()o(+%J5H ( %J' () +
I7 )DD5H+ + I7 )()4dYZ+()*5H+
D`jIGI7+(5H+n+,YZ' )*£u% ''YnYZ+,CYZ+,)*5H++'
()0SdYZ+()*5H+
N = 13Yn;;*5H+(
3:5H )I7+,Ì%GI7 )Yn5H(o;(b()RD+GI7d.*()I7+,(oI7+(bb()%GIHDC;åIX) e(ZRD I7+¥YoIÒ¡)5H )'
+ %J5H ) I7*+,¡)I7YoI7*(Z%GIH(( n%J5H o(oGI7+(5H+(!3aI7 oYn%;*D4;åImÿRD
ã
YZ5H+,) ¥cbH¥9
cbH ;* %J5H )) I7o `j+GIqçYoI7RAN5H I7YnYZ+,o);*(' %J5H _6=I7 Ú(_((èTn+ YoI7RA
5dGIH£,n%y;ÌIÚ''ZRA'+' 'bI7;*'I75H YZ+,F+'%J+I7YnYZ+F(TI7) ( ê +]@u5HS[*+
£u;=<YoI7RAI7;*'I75H 0+%J5H ) I7§¡I7YoI7*(!%GIH(( !%J5H !+%5H5HRD I7%*A,>+0(e++GI7) ;;*
()5HYn%J5D('Z¤<?5H[d¡L(§(5H@u+S5H%GIH£u(§£u!(_IH+,;*(+(I7d]I7) (9p;=<?5H[d¡)60
;=<I7%%GI7 ;!%5H5j, ;åIb%5H5HRD I7%*Z5H[+,D§5H+X@A5HS5H+nFRD I7+( ^ 5H+(5HYZ5HRAe+(
£u5H ) ()%J5H++,9;åI() L6=IH¤<+Z5H[d¡L!!5H+,5H (!@,y6(4£uYoI7 £u+,!;åI6 5H+,)*e 0+,)
dX5H[¡L(§ *+n5H-CIÚI7+(S;åIàñ¨+RA¨òXI7;*'I75H D&3:5H ;åIÚGI7+(5H+§¤;*Z%'+5HYZe+
£u:I_RA'+' ';*()RD+GI7;&()5H+(*' I7[;*YZ+,¨%;(()Yn%;*£,;*( ã« Yn;;*5H+(¨SYZ() (-;åI
Q G5H( Ì+bYZ5,e;*¨((yRD+¯I7dg,D<?()('%GI7 Ì;=<?()%GIH¨+,) +%J) ^ 5H+¨£uJ5H+,)*+,
;*( ()RD+GI7dó+,' ((I7+,(Úp+RD I7+ ^ 5H+P£u5H+,)*+, 5H ;* ()D Q 5HYnYZP;åI ^ 5H+
¤<+,' @U(%;(¨%J)_£uT;=<?()%GIHDg;y;*F +;*(()RD+GI7d¥%;(()Yn%;*(9o % '(+, gI7
;*¥¤<*+,)yÿG +GI7+(5H+N%GI7 (( ã« Yn;;*5H+(5,!o*+,(¯5H+Ú;åI_ % '(+,S%GI7 e
.
;*6I7£u§<?;;*I7%%GI7 ))*+,9F+NYZ5,e;*SSGI7+(5H+(%5H5HRD I7%*(&
.
+P¡L ()) +,Z
K N %GI7 I7YZe) (o£u *+,)yÿG+,Z;åIPGI7+(5H+.9;=<+,' )* od YZ5,e;*D
W;J¢pIF5H+ dYZ+()*5H+(B;åI HÑ|o}z{H}mgfA~N}zc`@Y
N ¨;=<?()%GIH¨YZ() DdRD I7+D ;åI
H|o}z8{H}}G~N}zh`gY
K dNYZ5,e;D
ê + );*(p(5H@u+,F(FYZ5ue;*(¥ñ,DG5H( òJ:9N[GIH(bb(I7)*())*£u(F%GI7 FYn%;*DaIÒÿ+
RA5HYnYZ S¤<?'@u+,);;*(S ) (SFYZ5,';*(I7)*5H+i¤I7P;*X£,§<+X()RD+GI7;!(5HI7+(5HP5H (d
YZ5,e;*DJ5H+¥;&5H+++m(5H ¤<I7%%GI7 )+GI7+GF5H+,)+,P+,)
û
ã
G34;(¨(5H T()0685H )
%;(0;åI_5H++'TI7%%GI7 ))*+,¨I7NYZ5,e;*D
j
7}é9@êÙäk9©
ê +q%Jn);*( n;=<+,@DI7 )åI7+N(n5H++'(o')d*'(n%GI7 Zd@u ((_) I7+(L65H )YoI7)*5H+(Z%J5H
' ) ¥;*NYZ5,e;*¥(Yn%;*YZ+,\!(0+.(RD+GI7;¨I7%%GI7 ))*+, I7.YZ5,e;*DI7;*5H (b(IP) I7+()685H )YZ'
I7%%GI7 ))*+,NI7(()I7óYZ5,e;*D34I7 pYn%;*DI7+(b;*IH(p¥;åI]YT()*£,DC;*¥@u5H;YZm(5H+5H
¤<+b+5Ho%JT@DI7 )* F +5H(Fd0W¤' +,(¡)5H'(F+àYlUYZoYn%(F(<IÒ¡)5H+, ê +à%J
5H+S'ÿ+ +ÚYZ5,e;*SYT()*I7;§%GI7 e
.
++5HS();åI_YT()*£,D
.
+éYZ5H I7 PYT()*£,XI7Yn%;yÿG'DD<?()LKW9ÒKcd XYT;)%;*'X%GI7 Ú+é+5HYT[ D0()ÚP;åI
YT(£,D
.
;=<IHd)*5H+md YZ5H I7dNYT()*£,(0;åI_YT()*£,D
>+öYZ5,e;*P+,@HI7 )åI7+,Ú%GI7 ÚIHy5H+ YT;)%;*I7)*5H+ %GI7 +ö+5HYT[ X() dPwÑ}*xH+
`!<?'+dS;=<?()%GIH£u§<;¤5H@, '%J+Ú( ';*'YZ+,(¨[GIH(Dd5HXxD~={H|oznç;*( +5H( %J5H
+5H) nGI7+(5H+¯è ê +X(I7£,F(<;:¢mI I7PYZ5H+( ã« Yn;;*5H+(SF+5H(%J5D(()[;*(4ç8D<?();*_IH(
()§5H+¥5HYn%S5H(0;*(+()I7+(I7d£,;*(++5H%J_U) ¡L5H'è¯I7;*5H (;*YZ5,e;*+RD;*5H[J
5H;=<?()%GIH_TYZ() D ê ¨;=<+,' @US¤<+mYZ5,e;*_(¨¤<mU) F%;(%J)£,T;=<?()%GIHDg5H+
;åI_;+'I7 )'(;*+S()Z0%GIH(
n Ë
Ã7ÄuÅ8Â]Õ¯Æ:ÅÁ
ê
+pIÒ¡)5H0+0¢,%J5H)e(¨I7oYZ5,e;*%J5H +o 'd ;=<?'+dD>+oYZ5H I7
oYT(*£ub5H+,)*+,
K N +5H(&`§bYZ5,e;*p@*+,_I7;*5H (F+o+*5H+ b(5H(LKc(%GIH(
5HYnYZS;*YZ5H+,) S;åITÿRD %J5H 0+¥()%GIHSSdYZ+()*5H+ «
j
eë çà
êÙ
á
è2ãâ\k9¶è
á
Q
)¨)e((<I7)IH9T;åI '(5H;)*5H+N % 5H[;*eYZ(Yn%J5H )I7+,(0£u§<?5H+ +5H+,) £,GI7+
5H+é) I@DI7;;*X() N(ÚYZ5,e;*(Ú%¯I7 yYZ5H+ I7+()S£u§<9 +]I7%%;*I7)*5H+ YZ'd*I7;*(Ú(
YZ5,e;*(
ØÚÙ,ÄAÕ¯ÂÛ!ÕGÈÅÑÇÅÕ¯ÆæÛ Ë Ã7ÄuÅ8Â]ÕJÆ&ÅÁ,Ö&ÈÁ '5HYn%J5D( Z+q(RD+GI7;() n+ YZ5,e;*Ú%GI7 YZ57+g
D<?()) 5H@A £,;*( I75HYZ( (5H+,IH)y68( ý GI7+b;¯¢bIS%;( ¤<I75HYZ( £,
N I7+G(Ì;*YZ5,e;*D;
d*()¨%;()* ('5HYn%J5D(y5H+G(W;g(Ì6=IH;*¤<?+Ú) 5H@A +DYoI7*() e(d0oy;*S¨) 5H@u
;;*£,G5H+,)*+,Ì;*YZ5H+(̤<I75HYZ(_D;6I7d I7((I¢u 45H(C;*(C'5HYn%J5D()*5H+(Ì%J5D(()[;*(
o;*(b5HYn%GI7 5H(pI@u5H+(ZYn*(pI7ó%J5Hy+o+öI7;RA5H ))YZ I7%*£,I7;*;*¥+5H+.%GIH(o;åI
OQP+RTS .
5H(LKc()%GIH( %GI7 YZ5H+*dÚI@u
K = 2 I75HYZ( ¤<+Úd*)*5H++GI7 S9 « I75HYZ(I7+(
+Z(%GIHdYZ+()*5H+
N = 3D`§(CIÒd(!(5H+,a;åId )*5H+o(CI75HYZ(A`§ YZ5,e;*0()a;=<+*5H+
(0%;åI7+([;*(-;*(()RD+GI7d¥ '(%J@A+,¨() 5H@u I7+(+§<Yn%J5H )T;*£u;&(%;åI7+(
YoI7*(0%GIH(I7;;* (
Q
YZ5,e;*(+5H+dKc5H+,@uVd;*(0%J5H+,(
A B (5H+,I7+(YoI7*(¨I7+
%J5H+,d¥(RDYZ+,
]A, B[+§<¢ ()
Û&Û:ÃÒÁÆJÇÅÈÈ Ë Þ¯ÁÏ&ÁÏaÅÑÄAÇÅÑÕJÆ&Æ Ë ÅÃÒÁ,È >+ÚYlUYZSYZ5,e;*S+%J )YZ%GIH( % '(+, 5H(
;*( ()RD+GI7db;=<?(%GIHD ý GI7+ 5H+ (5HGI7')d* ( ()RD+GI7d¤,;G6=I7 5H+¨5H*() +p[J5H+
YZ5,e;*%J5H 0dgI7+( ;*IHd %GI7 YZ5H+*d¤;*5Hy d YZ5,e;*S5H ) ()%J5H+¥I7N5Hy d
d*)*5H++GI7 DV%% +d + d*)*5H++GI7 DD<?() +Úd*)*5H++GI7 S£ug % '(+,[*+
+¥+(YT[;*SS5H++'(§<?I7%% +,)*((I7RAD
¨5H(I@u5H+(% 5H%J5D('¨+I7YZ';*5H I7)*5H+¥¤<+NI7;RA5H ))YZ¤<I7%% +,)*((I7RA¨d*)*5H++GI7 (
d*()I7+, Q )I7YZ';*5H I7)*5H+ +Ú;=<I7;RA5H ))YZ%;( I7%*%;(()Yn%;*9F);*(
o
ÇÖjÏ:ÁTÏ:Á ÎË Í ÃHÅÎ8ÎÑË ÇÅÕJÆ Ë ÇÃHÅËÎÁ `jIÿ[ );y;åI7)*5H+ZI7) )åI7;*(j;åI0%;(:5H I7+(aI7+5HYoI7;*(
dà )¢)YZbI7 dåIH£,D:Và; o[GI7)) D&;*(_I7) )åI ç85H 5H ;;*)(èT(ZYZ)+,Z9N) YT[;*
¨5H(I@u5H+(S);('n;=<I7%% +,)*((I7RAbZd*)*5H++GI7 (T%J5H S*(5H;* S;*(S) IH(n;åIpÿ[ );;åI7)*5H+
I7+(0;=<?';*) 5,I7 d*5DRD I7YZYZTdÚ%GI7)*+,
4Üfp_/× 0/×
j
7}é9@êÙäk9©
á
â ·â\ä\ëk7 á
`&I+5H5H+.p%GI7 YZ5H+*N%J )YZZp685H )YoI7;*( n;*Ú5H+%oI7[()) I7Z¤<+G [GIH(]ñ[*+
IHI7%'òb%J5H 0 % '(+, +6=I7Yn;;*S5H++'SS()RD+GI7d +,YZ' £,(
n Ë Ã7ÄuÅ8Â]Õ¯Æ:ÅÁ¥Áuß Ë ÄDÇÁ 5H
H +()%GIH ] ;[J dYZ+()*5H+
NG>+()RD+GI7;
s∈H ()
d KK=%GI7 YZ5H+*dp() Ì+[GIH(
Φ(¯(IS'5HYn%J5D()*5H+
x ;;*¨£u s= Φx +5H+,)*+, £,
K N 5,!o*+,(+5H+m+,;*(J`§T+5HYT[ FF5,!o*+,(+5H+m+,;*(
x ()GI7[);;*YZ+
+5H' kxk0=P
1≤n≤N|xn|0V+()=GI7;*5H (£,;=<I7;RAe[ ;+'I7 SYZ5H+,) £u5H()RD+GI7;j%J U) '5HYn%J5D('() 05HS[GIH(D;åI_%GI7 YZ5H+*T'I7[;++,GI7++,) S;*(()RD+GI7dÚ£,j5H+,
!W¤)@AYZ+, [J(5H+Ú5H¨;åI[GIH(¨ dp£uJ%J@A+,(5H+,+, ¤<+Ú(5H(LKc+(YT[;*D
í '5HYZ') )*£,YZ+,;=<?+(YT[;*(()RD+GI7d
KK=%GI7 YZ5H+*Ú()
Φ() ;=<+*5H+Ú( CNK (5H()K
()%GIH( +RA+d '( %GI7 5H(;*(5HYT[+GI7*(5H+( %J5D(()[;*(
K @A ( Φ Q +(YT[;*
()0+5H+dKc5H+,@AD5HYnYZS;*YZ5H+, ;åIFÿRD
n Ë Ã7ÄuÅ8Â]Õ¯Æ:ÅÁ Ë Û:Û&Ã7Õ¤Äq&ÙuÁ `§(Ú()RD+GI7dö+,YZ' )*£,(N'I7+,N+ RA'+' I7;[ )'(+P( I7LK
¥£u§<9]I7(¥N;åIX£,GI7+,)yÿGI7)*5H+§5H+.5Hyp5H+¥(5H@u+,o(N5H++, p¤<+N%GI7 YZ5H+*
I7%% 5,'Dc+,))@uYZ+,C+.()RD+GI7;
s %J5D((eÚ+àxvAv){hfH|ZxD~88{H}vx)|Z{H}=,zm() Z+
d*)*5H++GI7
Φ(<;%JÌ(0'5HYn%J5D( +
s= Φx+ruI@u krk2 ksk2
kxk0N õ *+
(gr d)'ÿ+)*5H+¥£,GI7;I7)@A+§<?()%GIH( );*(I7[;*d YZ+,G4;;*%J/U) 65H )YT;*'
%;()* (6=IC5H+( 5HYnYZ¨+p% 5H[;eYZ¤<?5H%)Yn*(I7)*5H+¥(5H( 5H+,) I7+,D
Q
;;*£ug( I);*('
*j();åI_YZ;;* TI7%% 5dyYoI75H+P9
K )YZ(e
ˆ
x= argminkxk
0≤Kks−Φxk22
3:5H p+[GIH(5H ))5H+5H )YoI7;*A )PI7%% 5YoI7)*5H+é(I7;*;*m()Yn%;*YZ+,N9]%GI7 )) ¥;åI
'5HYn%J5D())*5H+
x= Φ∗s s() Φ+nYZ)I7+,Ì9 û ;*(!5,!o*+,(!;*(4%;(a6I7[;*(D`j +5HYT[
!5,!o*+,(:I4W¤'(j'%J+d5HYn% 5HYn*(&(5HGI7'!+,) !;åI5HYn%GIH'C4;=<I7%% 5dYoI7)*5H+
0;=<? ) 5HYnYn*(D
sÚÈ
Ë
Þ¯ÁuÈ `jIo%GI7 YZ5H+*F% 5, F+_I7*T%J5H ¨%;yG()* (I7%%;*I7)*5H+(g`&Io% Yn*e _();åI
5HYn% ((*5H+]I@AT%J )D§,:+P()RD+GI7;a%JtU) nI7%% 5,'F%GI7 YZ5H+*G(YZ+,() ¨+T[GIH(
5H ))5H+5H )YoI7;*AGI7;*5H (0(IF'5HYn%J5D()*5H+¥5HYn%J5H )S£,;*£,(5,!o*+,(65H )(0¨+5HYT[ d
;*(_5H+,_YZ5H+(Z¤<Yn%J5H )I7+N() _;*Im£,GI7;' p 5H+()) ))*5H+qÿ+GI7;*D43aI7 )Yn;*(F685H YoI7(n
5HYn% (()*5H+N '%¯I7+d(£,§d%;*5H+,)*'DG5H+Ú%J -
.
BA3!
í
£,§d%;*5H+) I7+(L65H )YZ'S Q ù
.
BA3! í K DûDûDû 9_[GIH(S¤<?5H+;*)(
.
;*( 65H )YoI7(I75ZYn% « 0V¨V Q [GIH('(0() 0(0) I7+(L65H )YZ'(" Q ù
Q 5HYnYZ5HI7) YZ5,e;D;åIF%GI7 YZ5H+*S%J0'RuI7;*YZ+,uU) %;*5H'S+N'[ )I7RAD
,%%J5D(5H+(C£u ;*()RD+GI7;
s(aRA'+' '9¨%GI7 )) !¤<+05HYn%J5D(I7+,0%GI7 YZ5H+*(4¤<+Z[ ) IHd)y6a[;åI7+SRuI7(()*+
e
s= Φx+e
V;*5H (_5H+à%Jn'[ )
s + I7;*;åI7+,_+ I7%% 5dYoI7)*5H+q%GI7 YZ5H+*(Ú()
Φ I@uo+
ó'RuI7;J9;G
e Q <?(!;åI[GIH(0(C+*£u(Ì 5H+() ))*5H+p¤<YoI7RA(C%GI7 Ì(;;åI7RA (05,!o*+,(¤<?5H+;*)(
j
7}é9LêÙäv9¶
á
â\yâkäuk9@é-ã89¶äkä=7:9¶ äk=7äã
ù&5H(&;*(:;åIH(((:Ì()RD+GI7dS+Ì(5H+j%GIH(& % '(+,I7[;*(a%GI7 YZ5H+*(YZ+4() j+Ì[GIH(
5H ))5H+5H )YoI7;*D Q <?()0+5HI7YnYZ+,Yn%J5D(()[;*S£,GI7+Ú;*(0()RD+GI7dÚ%J5D((e+,0%;()* (5HYn%J57K
(I7+,(FI7d]% 5H% )*''(_d0Wg' +,(A:I7)IH£ubT ;åIÒI7)*5H+ %J5H FZ;åINYT()*£,Dj5H+,5H (_
) ( %J5H (YoI7RA(yI7+( IH(5H+ %J ) 5H@u +¨[J5H++¨[GIH(%J5H % '(+,
GIH£u5HYn%J5D(I7+,ç8 Q ù %J5H 4;*(a) (H )@A;*(4%J5H 4;*(45H+,5H (D"m Q ùÝ9¨5H )
;*5H+RD';;*%J5H ;*(0I7)IH£,( ;åIÒI7)*5H+(0(+5H(è
ê
+Ú(5HGI7 I7IÒ;*5H ( %J5H@u5H
% '(+, ;*()RD+GI7;¤() ;=<+*5H+N([GIH((,YoI7*(5H+ ¢o%J d I7;=<+*'¨;åIF'5HYn%J5D()yK
)*5H+§
ØÚÙ84Æ&ÅÑÇÅÕ¯Æ >+H~8{H}}¯xH+
Φ = (ϕm)1≤m≤M
(+6I7Yn;;*S@u (+I7 (
H
I7%%J;*'(FxA~={H|oz¯5HSYoI7+*e T'£,@HI7;*+,+YoI7) )*T5H+,;*(¨I75HYZ((5H+,;*(5H;*5H++G(
>+ d*)*5H++GI7 N()_dwA{H}¯AxD}G~(<;RA'+e p5H
H _£, M > NaI7+(_pIH(&5H ()RD+GI7;:%J5D((eT+T+dÿ+y'_F'5HYn%J5D())*5H+(S(
ΦJ¨'I7+YZ5H+(J;åIo+5H)*5H+XF%GI7 YZ5H+*
(PRA'+' I7;*(i + ()RD+GI7;()NdN%GI7 YZ5H+*d () Ú+ d*)*5H++GI7 5H+I7+,
Φ ()+
Ú((n'5HYn%J5D()*5H+(o;=<?(
ê
+q%JbI7;*5H (n@u5H n;åIm%GI7 YZ5H+*¥5HYnYZÚ+N5H+,) I7+,¥
'RD;åI7 )*(I7)*5H+£,¤%J )YZ5H*( 0+'5HYn%J5D()*5H+¥%GI7 )Ynj5H(;;(%J5D(()[;*(
x Õ¯Â]Û
Î
ÁAßjÅÑÇÙ `§(¨I7%%;y*I7)*5H+(¨YZ+,)*5H++'(¨% ''YnYZ+,Zç85HYn% (()*5H+§¯'[ )I7RAD:è
()+,+,@*(I7RAI7[;*(I7+G(;*IH( 5H+I7+,9F5H+d)*5H+N(I@A5H I7;*; 0+I7%% 5YoIÒK
)*5H+Ú%GI7 YZ5H+*(S
s"mI7; (YZ+,;åIF 5H+I7+IÒ¡)5H+5HYn%;*'S5HYT[+GIÒK
5H p9NbI7;*;=&EG5H )YZ;;*YZ+,a5H+ (o5H++o+à+@uI7 Z%GI7 YZ5H+*ÚI75H )*('
K&T5H+
;åI_YZ;;* TI7%% 5dYoI7)*5H+¥%J5D(([;*S9n+@uI7y
ˆ
x= argminkxk
0≤Kks−Φxk22 ç ã è
`§% 5H[;*eYZ5H+()*( % )+%GI7;*YZ+, 9¨*+,)yÿG Ì;*()%%J5H )Ì
ˆ
xDD<?()LKW9ÒKcd 0;=<?+(YT[;*(
+d*( d %J5H ;*(£u;*(;*(5,!o*+,(
xd
(5H+,+5H+dK=+,;*(¤W;a(Z+()__% 57¡L
s ()
;*(TI75HYZ(FZo()%%J5H ) Q Z% 5H[;*eYZpIN''Z% 5H@u'o3aK Q 5HYn%;* z&5H++o5H++GI4F*T%GIH(T
YZ;;* ¨I7;RA5H ))YZIH£,;=<?((I7jGI7()y6a(
CNK ()%%J5H )(0%J5D(()[;*(e{?"V ôAï | ù&5H(4;*(!I7%%;*I7)*5H+(Ì£ud%;*5H+,!;åI%GI7 YZ5H+*0);*(+,!5H+(CI7;RA5H ))YZ(C(5H(LK
5H%)YoI7dg¤YoI7*(n5HYn%;*'n%J5H;¢+5HYnåI7;*D§4+X% I7)*£uGH¤;åIpd*())+)*5H++,) ZI7;RA5H ))YZ(
%J5H;¢,+5HYnåI7d+5H+%J5H;¢,+5HYnåI7d¥+§<?()%GIH(065H 'YZ+,%J ))++,F+¥) I7YZ+,d()RD+GI7;=
4+N!W¤d;*( ¯I7( 68 '£u+(0¤<?'GI7+,);;*5H++GI7RATI7YZe++,06IH;*YZ+,9F) I7 (05H++'(
T) e(¨RD I7+FI7;;*w¯%J5H ¨+_(;*TYoI7RA ãûD ¬} ãûD ¬N5Hm+TYn+,nTYT()*£uGF'GI7+dK
);;*5H++'9 ãîq~]u^ A5H+o()!'¡99
N ≈106DI7+(CIH(D5H+Z+@A5H!%;(4;åId0W¤' +0+,) +
I7;RA5H ))YZ%J5H++,)*;G4+oI7;RA5H ))YZ%J5H;¢+5HYnåI7;G RD '0';*@u'7;*(!d_(5H+,a) 5H%Z5rdK
do%J5H TU) );*('(, @, I7YZ+, RD I7+( 5H++'(,YlUYZ;åIT5HYn%;*'£,GIHd I7)*£u
N2 ()¨+GIH(([;*H¤3aI7 Yn%;*DJ%J5H ) I7 + Q FYT()*£, ç
ã
D¤'GI7+,);;*5H++'
9o¬D¬ãK~]u^ è¨I@uT+m% 5HRD I7YnYZZF5HYn%;*'
N2 () ¨+X5H d+GI7 S68 '£u+
1GHz
;Ì6I7d I7F% (£u ã I7+B1:c;Ì¢I5H+b+à[J(5Hy+ %J5H _(nI7;RA5H ))YZ(n£u%J )YZ)+,n
) I7 (05H++'(RD I7+dYZ+()*5H++Ú+NYn%(0 I7*(5H++GI7[;*D
\X} =lP 0/hGl 0/×4U×Bu}).B@ /0Ue 0/X H¯U `=
×e 0/F/=5V $G0Ue
3!*(£u ;åI¥ NdGI7())@u b;åIYZ;;* NI7%% 5YoI7)*5H+ó9
K )YZ(n'ÿ+*N9
;=<?'£,GI7)*5H+öç ã è()+RA'+' I7;C) 5H%à5r(D&n+5HYT[ I7;RA5H ))YZ(F(5H(LKc5H%)YoI7d5H+,
''% 5H%J5D('(
Å8Æ&Å8ÂÅÈ Ë ÇÅÕJÆ.Ï&ÁmÆ&ÕGÃHÂ]Á
`p
>+% Yn*e TI7%% 5,T(+(% '%GI7 ;=<?5H%)Yn*(I7)*5H++,dK
YZ' )*£,DÌI7+(p¥IHd H5H+ö(I7p£u§<?5H+ó%Jp p;*(bYn+YoI;*5,I7d.¤<+¥685H+)*5H+
d0W¤' +,)åI7[;*n%GI7 S(+,ZFRD IHd*+,&,4_%;(S)F65H+)*5H+]()S()) )*YZ+,5H+,@AD
I7;*5H (Z;;*p+§<IHdYZbI7 YoIÒdYTY÷£,§<+ +*£, Yn+YTY ;*5,I7;0£,()ZI7(() RD;*5H[GI7;=!"mI7;yK
(YZ+,;åI_5H+,) I7+,%GI7 YZ5H+*
kxk0 ≤Kd+§<?(+§5H+@ADd+¤YlUYZ5H+,)+,D
ê
+.G ¥5H+9P Yn%;åIH o;åIX+5H )YZ
`0
%GI7 o+ 65H+)*5H+.% 5,D!YoI7*(Z%;(b()Yn%;*¥9
5H%)Yn*(
Q
5HYnYZ
kxk0= lim
p→0+ D
X
d=1
xp ç è
= lim
p→0+kxkpp
ç « è
;*( I7+d*I7( +GI7) ;*((5H+,Ì;*(%(57K=+5H )YZ(
kxkp
I@u p% 5, û Q (%(57K=+5H YZ(
65H )+*((+,!+Z '();I7!%GI7 YZ5H+*dZI7+,C£,
p≤1D`jI+G5H )YZ
`1H[*+o£,;*I%;(C';*5HRD+' m;åI%(57K=+5H )YZ
`0(p;åI%;(p%J5H%;åI7 XI7 ÚD<?() +@ I7*+5H )YZD5H+P5H+,@AD
¨0W¤' +,(I7;RA5H ))YZ(¨5H+,0''% 5H%J5D('(0%J5H '(5Hd S(+5H@uI7dÚ% 5H[;*eYZ(
ÎÞGÕGÃHÅÑÇ &ÂÁuÈbÞ ÎÕ¯ÖjÇÕ¯ÆjÈ >+FI7) T@*()*5H+%;(+d685H YoI7)*£uT%GI7 );åIo5HYT[y+GI75Hy _d
% 5H[;*eYZD`jI_¨3aKc5HYn%;*')@*+,;åIF5HYn%;*'RDRuI7+,(£,¨;=<?()%GIH((5H;5H+G(
£,§<?5H++!%J&%GIH(&(!%J )YZ)) ̤<?d%;*5H :dGI7())@uYZ+,ÒW;D6=I7&5H+!) 5H@u &+YZ5¢u+T
+GI@RD 9@¨I7+( ()%GIH%J5H 5H+()) ) ¨+(5H;)*5H+p%J)09%J) Q <?();*% )+%J
(I7;RA5H ))YZ(RD;*5H5H+(_ç85HI7;RA5H ))YZ(¨S%J5H ()èG'+d S' I7)@uYZ+,;*S()%%J5H )
F;åIb'5HYn%J5D())*5H+§§>+P5HP%;()* (SI75HYZ(5H+()*' '(5HYnYZF[J5H+((5H+,(';*)*5H++'(
(5H() I7(4I7n()RD+GI7;=7%*(a;*% 5,(()(4()ay' ' () :;* '()*dZI7+()5H[+,§D34;()* (4@DI7 )åI7+,(
¥(bI7;RA5H ))YZ(pRD;*5H5H+(b5H+,b''N% 5H%J5D('(b%J5H o;*¥ )e ¥¥(';*)*5H+öÚ;=<I75HYZm9
+;*@u ;åI_YoI7+*e ;*S(5H()) I7 SdN '()*d§
W;a()I7YT(I7+,_5H+()I7 £,T;*(SI7;RA5H ))YZ(;*(¨%;( I7%*(d*()I7+,SIH);;*YZ+,
(5H+,'RuI7;*YZ+,;*(S%;(TI7+*+(§3!*(£uo(TI7;RA5H ))YZ(F(5H+,S(5H(LKc5H%)YoI7d¤¤;åIÚ5HYnYTdK
+GI7'm(YT[;*m+()m(<mU) %;@bH 5H )*+,'m@u (o;åI P¤<I7;RA5H ))YZ(Ú5HYnYZ)I7+,
YZ5H+(¤<? ) (GS£,&In+,) I4F*+'++D¯I7)*5H+m(5r(G5H) TI7%% 5,5H+(*() In5H+
%;@bH9T%GI7 )) 0(0I7;RA5H ))YZ(0 I7%*(009F 9T;*(0I7YZ';*5H (5H+ ;*(0IH';*' I7+,
(5H+NdYn+,GI7+,;=<? 5HYnYn*(S%J5H 0+¥5rI7;*;j+'RD;RAI7[;*D
dI7+G(6=I7 o¤<I7) o,¢,%J5H)e(Dj5H((FI7;RA5H ))YZ(F(5H+,o5HYn%;*d'pI7]YZ5H+(F£uGIÒK
d I7)*£,n+
N¤n£u!()Z9 Yn%U ;* );*(I7)*5H+à() (S5H++'(_RD I7+nI7;;*D
'I7+YZ5H+(H5H+F%J:6=I7 ÌYn*dF()5H+_d*(%J5D(¤<,¢,%J5H)e((a(%%;*'YZ+,I7 (4( &;åI¨()) ))
dNd*)*5H++GI7 A
x Ë ÈÏ:ÁuȨÏaÅÑÄAÇÅÑÕJÆ&Æ Ë ÅÃÒÁ,È ÎÕgÄ Ë Ö§ß `§IH(a%GI7 ))*;* !£u,+G5H(:+,' (( ()a;(ad*)*5H+dK
+GI7 (a;*5,I7dg
ê
+_(%%J5D( £u5H(:;*(!I75HYZ(4dnd*)*5H++GI7 0(5H+,:+,;*(a5H (4¤<+_+, )@DI7;;*
n;*5H+RD
L N Q <?()S;*ZIH(S%J5H T(d*)*5H++GI7 (TYn%(LK6 '£,+o5HYnYZZ;*(d*K )*5H++GI7 (_ í I7[J5H _5H "m Q ùøç) I7+(L65H )YZ'p+ 5D()+,(_d*( (TYZ5,dyÿG'è:%¯I7 FYn%;*D
ê
+à(I7£,n;*o5rT¤<+o' I7)*5H+ o"PI7+R34 (pç8"m3Ìè%JFI7;*5H (T'%J+d o%;yG(
L YZ5H+(0 N I7 5H( ;*( ) I7YZ+,!W¤)'( ()+,;*5,I7d¤d£ug+§<?() %GIH( ;*IH(
%J5H ;*(I7) (0I7;RA5H ))YZ(0d*()I7+,(¨'I7+YZ5H+(I7;RA5H ))YZ(Ì;=<+Ú(%;(RD 5D(()* (
*()I7+,(
`jI_% Yn*e S%¯I7 ))*SS))e(
ã
()05H+(IH 'T9F;åI_% '(+,I7)*5H+m`j5,
ê
"3:G+¥I7;yK
RA5H ))YZ0RD;*5H5H+pI7%GI7[;*I7;*;* Ì0YZ;;* (I7%% 5dYoI7)*5H+(£,0"35HÌ+Z ()I7+,
I7+(;åI_YlUYZS;åIH((5HYn%;*d'D
\X×4/B/ ssVeV 0/T/×R}=
V&@HI7+,YlUYZZ;*nI7;*;ÌZ'5HYn%J5D())*5H+
s = Φx+r (_%J5D(_;*n% 5H[;*eYZod5HyXd
d*)*5H++GI7
Φ 5HYnYZ+,) 5H@A +d*5H++GI7 T£,§%J YZ¨ % '(+, %GI7 YZ5H+*dK
(YZ+,0+¥+(YT[;*SS()RD+GI7dÚ¤<I7%% +,)*((I7RA
S = (s1...sS)
, % 5H[;*eYZp65H+I7YZ+,I7;0%JZ(5H@A+,lU) p;åI7*(('pÚcbH'D4D<?()_%GI7 Ú£,§<?5H+ %J
(5H@u+;=<?(£,@A S+P6I7*(I7+,SI7%%J;Ì9b+n5H++GI7*((I7+nd%J )n(S()RD+GI7dX9p) I7 §3aI7
dYn%;*D§5H+X(I7£,_([GIH((Yn%(LK68 '£u+Z(5H+,RA'+' I7;*YZ+,[*+IHI7%'(9p;åIb K
% '(+,I7)*5H+S()RD+GI7dÚ(5H+5H (
nSÃÒÕ
Í:Î
ÐÂ]Á 34I7 L685H*(G;*Td*)*5H++GI7 _9Z);*( +§<?()%GIH(5H++,§ Q <?();TIH(£,GI7+5H+(5HdK
GI7 ) I7 o(n(RD+GI7d ñS5H)*£,( ò () n;(£u;*(n;åIm5H++GI7*((I7+xpv8{6=I7n'6=I7
`!<I7%%;*I7)*5H+m@*('%J¨I7(()§+'(() (d*)*5H++GI7 (¨%;(¨IHI7%'(£,§<+¥)*5H++¯I7y
RA'+' )*£uI7dn5H++'(!%GI7 ))*;*e (£u§<?5H+o(5HGI70 % '(+, uI7+(C0IH(D+I7) @u5H*
()b¤<I7%% +d +ód*)*5H++GI7 P9X%GI7 )) p¤<?Yn%;*(ÌEG5H )YZ;;*YZ+,5H+ö(N5H++¥+.+yK
@AI7o%GI7 YZ5H+*
KD+5H;y;*)*5H+p05H++'(̤<I7%% +,)*((I7RA0 I7+RA'(ÌI7+(!+YoI7) )*
S = (s1...sS)5H+N S;*)*5H++¯I7y
Φ = argminˆ ∀ϕ∈Φ,kϕk
2=1 min
∀1≤d≤D,kxdk0≤KkS−ΦXk2F RO
ç¬,è
`jIbYn+Yn*(I7)*5H+]()
X +§<?() )*+P§<?I7) _£,T;=<? ) 5H[+,_%GI7 ¨;=<I7%% 5YoI7)*5H+]%GI7 yK YZ5H+*(S
S () Φ
Q 0% 5H[;eYZ¨()Ì+5H %;(Ì5HYn%;*£u0;*% ''+,`!<I7%% 5,¨(5H(LKc5H%)YoI7;*;åIH()K
()*£u%J5H ;*¨ '(5Hd ())YZ5H+H¡)5H+,YZ+,;*(6IH (
Φ X %GI7 5H%)Yn*(I7)*5H+¥I7; )+'D
`!<?5H%)Yn*(I7)*5H+m(05,!o*+,(9_d*)*5H++GI7 Sÿd'S'I7+,;;*K=YlUYZS+I7%% 5dYoI7)*5H+¥%GI7 LK
YZ5H+*(Dd;=<?((+,)*;¤dp) I@DI7;¤+ÚI7%% +,)*((I7RA¨%J5H )() ;=<?5H%)Yn*(I7)*5H+Nd d*)*5H++GI7 A
`jIodd*eYZ%GI7 ))*T))e(S% '(+,+T+(*5H+;=<I7;RA5H ))YZF¤<ê ;*()GI7(+
SE:*;*{ê E ôAï4|§I7+(;*£,;ÌI ''oIÒ¡)5H'n;=<?())YoI7)*5H+ I75HYoI7)*£uo¤<+à(%GI7 I7YZe) (
£uj@DI7I7%GI7 I@DI7+,_U) S 'RD;*'T9_;åI_YoI7+§ Q IÒ¡)5H0%J )YZ+S5H+,@u )RA+S%;( I7%*
I7 4+5H) %GI7 I7YZe) 5H%)YoI7;J9GIH£,y' I7)*5H+o(4YZ;;* Ì£u§<+Z%GI7 I7YZe) ÿ' %J5H !5H
;=<I7;RA5H ))YZDD4;;* +F;=<I7;RA5H ))YZ %;(:6IH;*9% +d +FYoI7+_%*(£,§<;¢TI+F%GI7 I7YZe)
¨YZ5H+(09T 'RD;* G5H+Ú( 5r %GI7 y' I7)*5H+N() +'RD;RAI7[;*S@HI7+,;*¨Yn%(I7;*;§¤<+