O
pen
A
rchive
T
OULOUSE
A
rchive
O
uverte (
OATAO
)
OATAO is an open access repository that collects the work of Toulouse researchers and makes it freely available over the web where possible.
This is an author-deposited version published in : http://oatao.univ-toulouse.fr/ Eprints ID : 12418
The contribution was presented at TALN 2013 : http://www.taln2013.org/
Official URL:
http://www.taln2013.org/actes/www/TALN-2013/actes/taln-2013-long-003.pdf
To cite this version : Chali, Yllias and Mojahid, Mustapha and Hasan, Sadid A. L'utilisation des POMDP pour les résumés multi-documents orientés par une thématique. (2013) In: 20eme conference sur le Traitement Automatique des Langues Naturelles (TALN 2013), 17 June 2013 - 21 June 2013 (Les Sables d'Olonne, France).
Any correspondance concerning this service should be sent to the repository administrator: staff-oatao@listes-diff.inp-toulouse.fr
!"#$%&%'($%)*+,-'+./01.+2)#3+&-'+34'#54'+5#&$%6
,)7#5-*$'+)3%-*$4'+2(3+#*-+$845($%9#-+
!""#$%&'($"#
)*&+$,#,&-.&/$%$0
)*&12%3$4($&156$(#,
7&
8)9&:0#;<=%#3>&5?&@<3(A=#,B<*&-C*&'$0$,$&
879&:0#;<=%#3D&E$2"&+$A$3#<=&F&GHGI*&))J&H3<&,<&K$=A500<&L)MN7&I52"52%<&'<,<O& (1) yllias.chali@uleth.ca (2) mustapha.mojahid@irit.fr
HP+:1P&QQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQ&&
@R5A6<S3#?&4=#0S#4$"&,2&=D%2TD&T2"3#U,5S2T<03%&5=#<03D&4$=&20<&3(DT$3#V2<&<%3&,<&BD0D=<=& 20& =D%2TD& W& 4$=3#=& ,<& ,5S2T<03%& %52=S<%& <0& =D450%<& W& 20<& =<V2X3<& ?5=T2"D<& 4$=& "R23#"#%$3<2=.&'<33<&3YS(<&<%3&,#??#S#"<&S$=&#"&0R<O#%3<&4$%&,<&TD3(5,<&<??#S$S<&452=&T<%2=<=&"$& %$3#%?$S3#50& ,<& "R23#"#%$3<2=.& '<"$& #03=5,2#3& $#0%#& 20<& #0S<=3#32,<& ,$0%& "<& 4=5S<%%2%& ,<& BD0D=$3#50&,<&=D%2TD.&Z$0%&S<3&$=3#S"<*&052%&4=545%50%&20<&T5,D"#%$3#50&,<&"R#0S<=3#32,<&<0& ?5=T2"$03& 053=<& %>%3[T<& ,<& =D%2TD& S5TT<& 20& 4=5S<%%2%& ,<& ,DS#%#50& T$=\5;#<0& 4$=3#<""<T<03&5A%<=;$A"<%&8E]1ZE9&S$=&,$0%&,<&05TA=<2O&,5T$#0<%&50&$&T503=D&V2<&"<%& E]1ZE& 4<=T<33<03& ,<& BD=<=& <??#S$S<T<03& "<%& #0S<=3#32,<%.& Z<%& <O4D=#<0S<%& $44=5?50,#<%& %2=&"<%&6<2O&,<&,500D<%&,2&A$0S&,R<%%$#&Z:'&503&,DT503=D&"R<??#S$S#3D&,<&053=<&$44=5S(<.& -C+IH-'I& QQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQ&&
:'%*;+./01.'+<)3+=)2%76>)7#'-,+0#&$%61)7#5-*$+?#55(3%@($%)*+
I(<& T$#0& B5$"& 5?& 354#SU?5S2%<,& T2"3#,5S2T<03& %2TT$=#^$3#50& #%& 35& B<0<=$3<& $& %2TT$=>& ?=5T& 3(<& %52=S<& ,5S2T<03%& #0& =<%450%<& 35& $& B#;<0& V2<=>& 5=& 4$=3#S2"$=& #0?5=T$3#50& =<V2<%3<,&A>&3(<&2%<=.&I(#%&3$%\&#%&,#??#S2"3�&"$=B<&4$=3&A<S$2%<&3(<=<&#%&05&%#B0#?#S$03&_$>& 5?&T<$%2=#0B&_(<3(<=&3(<&2%<=&#%&%$3#%?#<,&_#3(&3(<�?5=T$3#50&4=5;#,<,.&I(#%=5,2S<%& 20S<=3$#03>& #0& 3(<& S2==<03& %3$3<& 5?& 3(<& %2TT$=>& B<0<=$3#50& 4=5S<,2=<.& G0& 3(#%& 4$4<=*& _<& T5,<"& 3(<& 20S<=3$#03>& <O4"#S#3">& A>& ?5=T2"$3#0B& 52=& %2TT$=#^$3#50& %>%3<T& $%& $& E$=3#$"">& ]A%<=;$A"<&1$=\5;&Z<S#%#50&E=5S<%%&8E]1ZE9&%#0S<&=<%<$=S(<=%�&T$0>&$=<$%&($;<&%(5_0& 3($3& E]1ZE%& S$0& ,<$"& _#3(& 20S<=3$#03>& %2SS<%%?2"">.& `O3<0%#;<& <O4<=#T<03%& 50& 3(<& Z:'& A<0S(T$=\&,$3$%<3%&,<T50%3=$3<&3(<&<??<S3#;<0<%%&5?&52=&$44=5$S(.& & 1]I+U'@P+&a&HD%2TD&T2"3#U,5S2T<03*&=D%2TD&5=#<03D&=<V2X3<*&E]1ZE.& b`!c]HZ+a&I54#SU?5S2%<,&T2"3#U,5S2T<03&%2TT$=#^$3#50*&E]1ZE.&
A B*$3),#7$%)*+
:0&=D%2TD&T2"3#U,5S2T<03%&5=#<03D&4$=&"$&3(DT$3#V2<&8#.<.&4$=&20<&=<V2X3<9&<%3&23#"<&,$0%& "$& B<%3#50& ,<%& ,5S2T<03%& <3& "<%& %>%3[T<%& ,<& =<S(<=S(<.& G"& 4<23& ?52=0#=& 4$=& <O<T4"<& ,<%& %<=;#S<%& ,R#0?5=T$3#50& 4<=%500$"#%D%& %<"50& "<%& A<%5#0%& ,<%& 23#"#%$3<2=%.& Z$0%& S<3& $=3#S"<*& 052%&S50%#,D=50%&V2<&"<&4=5A"[T<&,<&4=5,2#=<&,<%&=D%2TD%&T2"3#U,5S2T<03%&5=#<03D%&4$=& "$& 3(DT$3#V2<& =<;#<0,=$#3& W& <O3=$#=<& 20& %52%U<0%<TA"<& ,<& 4(=$%<%& S(5#%#<%& W& 4$=3#=& ,<%& ,5S2T<03%& 5=#B#0$2O& 81$0#& <3& 1$>A2=>*& )ddd9.& e2B<=& ,<& "R#T45=3$0S<& ,R20<& 4(=$%<& <%3& "R$%4<S3& "<& 4"2%& <%%<03#<"& ,<& "$& BD0D=$3#50& ,<& =D%2TD.& '<33<& 3YS(<& <%3& ,#??#S#"<*& <0& B=$0,<& 4$=3#<&4$=S<&V2R#"&0R<%3&4$%&S<=3$#0&V2<&"$&4(=$%<&S(5#%#<&%5#3&%2??#%$TT<03&#T45=3$03<&452=& X3=<&S50%#,D=D<&S5TT<&20<&4(=$%<&,2&=D%2TD.&G"&<%3&DB$"<T<03&,#??#S#"<&,<&B$=$03#=&V2<&"<%& 4(=$%<%& S(5#%#<%& ;503& %$3#%?$#=<& 353$"<T<03& "R23#"#%$3<2=.& '<& 4=5A"[T<& 4<23& X3=<& =D%5"2& <0& =<?5=T2"$03&"$&3YS(<&,$0%&20<&4=5A"DT$3#V2<&,<&4=#%<&,<&,DS#%#50%&%DV2<03#<""<%.&!"#$ %&'()"#$ '"$ *+&,"##-#$ '"$ '.,/#/&0$ %1+2&3/"0$ 45678$ #"$ #&09$ 13.+.#$ -9/)"#$ '10#$ -0"$ 31+/.9.$ '"$ *+&:)(%"#$ '"$ '.,/#/&0$ 47-9"+%10;$ <==>8?$ !1$ #*.,/@/,19/&0$ 'A-0$ *+&:)(%"$ '"$ '.,/#/&0#$ #.B-"09/"))"#$ "0$ "03/+&00"%"09$ 9&91)"%"09$ &:#"+31:)"$ 13",$ -0$ %&'()"$ '"$ 9+10#/9/&0$ %1+2&3/"0$ "#9$ 1**").$ 567$ 4C-##")$ "9$ D&+3/E;$ FGGH8?$ !"#$ 567$ #&09$ -9/)"#$ *&-+$ %&'.)/#"+$)1$*+/#"$'"$'.,/#/&0$'10#$'"#$#/9-19/&0#$&I$)"#$+.#-)919#$#&09$"0$*1+9/"$1).19&/+"#$ "9$"0$*1+9/"$'.*"0'"09$'-$,J&/K$'A-0$'.,/'"-+?$L$9&-9$/0#9109;$-0$567$"#9$'10#$-0$,"+91/0$ .919$!;$"9$-0"$1,9/&0$'/#*&0/:)"$"$"#9$"0#-/9"$,J&/#/"$'.*)1M109$)"$567$1).19&/+"%"09$'10#$-0$ 0&-3")$.919$!#$N$"9$-0"$+.,&%*"0#"$,&++"#*&0'109"$%"&!'$!#($"#9$199+/:-."?$O/0#/;$)"$0&-3")$.919$ !#$'.*"0'$'"$)A.919$1,9-")$!$"9$)A1,9/&0$"$"0$.9109$,&0'/9/&00"))"%"09$/0'.*"0'109$'"$9&-#$)"#$
.919#$ "9$ 1,9/&0#$ 109.+/"-+#?$ !1$ 9P,J"$ *+/0,/*1)"$ '"#$ 567$ "#9$ '"$ 9+&-3"+$ -0"$ @&0,9/&0$ '"$ '.,/#/&0$π$B-/$#*.,/@/"$-0"$1,9/&0$*1+9/,-)/(+"$B-/$#"+1$,J&/#/"$'10#$-0$.919$!$N$)"$:-9$.9109$'"$ ,J&/#/+$ -0"$ *&)/9/B-"$ B-/$ %1K/%/#"$ )1$ +.,&%*"0#"?$ Q"*"0'109;$ )"#$ 567$ 0"$ *"-3"09$ 9+1/9"+$ )A/0,"+9/9-'"$ &I$ #"$ 9+&-3"09$ )"#$ .919#$ '"$ )A-9/)/#19"-+;$ )AJ/#9&+/B-"$ '"#$ 9+10#/9/&0#;$ "9$ )"#$ 1,9/&0#?$!"$%&'()"$567$*1+9/"))"%"09$&:#"+31:)"#$47R5678$E.0.+1)/#"$)"$%&'()"$567$"0$ *"+%"99109$'"$*+"0'+"$"0$,&%*9"$.E1)"%"09$'"#$@&+%"#$'A/0,"+9/9-'"?$O/0#/;$'10#$'/@@.+"09#$ '&%1/0"#;$*)-#/"-+#$1**)/,19/&0#$&09$@1/9$1**")$1-$7R567$4S&-0E;$FGGT$N$!/#&0;$FG<G$N$U-/$
)*$ "+?;$ FGGV8?$ 610#$ ,"9$ 1+9/,)";$ 0&-#$ *+&*&#&0#$ 'A-9/)/#"+$ )"$ 7R567$ *&-+$ %&'.)/#"+$
)A/0,"+9/9-'"$/0J.+"09"$W$)1$9P,J"$'"$+.#-%.$%-)9/X'&,-%"09#?$$
610#$ 0&9+"$ 9P,J"$ '"$ +.#-%.;$ )A"03/+&00"%"09$ "#9$ *1+9/"))"%"09$ &:#"+31:)";$ ,1+$ /)$ "#9$ /0,"+91/0$ '"$ #13&/+$ #/$ -0"$ *J+1#"$ ,J&/#/"$ ,&0'-/9$ )"$ #Y#9(%"$ W$ -0$ .919$ '"$ +.#-%.$ &-$ 0&0?$ O/0#/;$ 0&-#$ '.@/0/##&0#$ -0$ %&'()"$ 'A&:#"+319/&0$ ,&!'$ -($ B-/$ '.@/0/9$ )1$ *+&:1:/)/9.$ '"$ *"+,"3&/+$ )A&:#"+319/&0$ -$ '10#$ )A.919$ !?$ Q",/$ ,&0#9+-/9$ -0$ "0#"%:)"$ 'A.919#$ '"$ ,+&Y10,"$ B-/$ "#9$-0"$+"*+.#"0919/&0$'"$*+&:1:/)/9.#$'"#$.919#$+.")#$*&##/:)"#?$7-/#B-"$0&-#$0"$*&-3&0#$ '.9"+%/0"+$'"$%10/(+"$#Z+"$#/$0&-#$13&0#$199"/09$)A.919$+.#-%.$&-$0&0;$0&-#$#-**&#&0#$)"$ @1/9$B-"$)A1E"09$1$,&001/##10,"$'"$9&-#$)"#$.919#$'"$,+&Y10,"$"9$1/0#/;$)1$*&)/9/B-"$&*9/%1)"$ *"-9$[9+"$1**+/#"$*1+$)1$9+10#@&+%19/&0$'"#$.919#$'"$,+&Y10,"$*1+$)"#$1,9/&0#?$
7&-+$ @&+%-)"+$ 0&9+"$ 9P,J"$ "0$ 9"+%"#$ '"$ 7R567;$ 0&-#$ #-**&#&0#$ B-A-0$ "0#"%:)"$ '"$ '&,-%"09#$ #&-+,"#$ "9$ )"-+#$ +.#-%.#$ '"$ +.@.+"0,"$ 4CC8$ ,+..#$ *1+$ -0$ "K*"+9$ J-%1/0$ #&09$ '&00.#$ E1+109/##109$ )1$ #19/#@1,9/&0$ '"#$ -9/)/#19"-+#?$ !&+#B-A-0"$ *J+1#"$ "#9$ #.)",9/&00."$ ,&%%"$,10'/'19"$*&-+$-0$+.#-%.;$#1$*+&:1:/)/9.$'A&:#"+319/&0$"#9$,1),-)."$"0$%"#-+109$#1$ *1+"09.$13",$)"$CC?$\0"$31)"-+$'"$+.,&%*"0#"$"#9$199+/:-."$)&+#B-"$)"$#Y#9(%"$199"/09$)A.919$ '"$+.#-%.?$D&-#$+"*+.#"09&0#$,J1B-"$*J+1#"$'A-0$'&,-%"09$,&%%"$-0$3",9"-+$'"$9+1/9#X 31)"-+#$4]&/+$#",9/&0$>8?$D&9+"$1**+&,J"$9"09"$'"$*+&'-/+"$'"#$+.#-%.#$1-9&%19/B-"#$B-/$ #&/"09$)"$*)-#$*+&,J"$'"#$CC?$610#$)1$*J1#"$'A1**+"09/##1E";$)"$#Y#9(%"$1**+"0'$)"#$*&/'#$ 1**+&*+/.#$'"#$9+1/9#$"0$%&'.)/#109$)1$+")19/&0$"09+"$)"$CC$"9$)"$+.#-%.$,10'/'19$"K9+1/9?$\0"$ @&/#$B-"$)"$%&'()"$'A&:#"+319/&0$"#9$1**+/#;$)A1E"09$199"/09$)A.919$@/01)$'"$+.#-%.$"9$)1$*J1#"$ 'A1**+"09/##1E"$#"$9"+%/0"?$!"#$*&/'#$@/01-K$1**+/#$*&-+$,J1B-"$199+/:-9$#&09$-9/)/#.#$*&-+$ *+&'-/+"$ '"#$ +.#-%.#$ W$ *1+9/+$ '"$ 0&-3"))"#$ '&00."#$ '10#$ )1$ *J1#"$ '"$ 9"#9?$ D&-#$ 13&0#$ -9/)/#.$ -0"$ 3"+#/&0$ '"$ )A1)E&+/9J%"$ .&λ($ '"$ )1$ '"#,"09"$ '-$ E+1'/"09$ '"$ ^192/0#$ 4_-99&0$ "9$ U1+9&;$<==`8$*&-+$+.#&-'+"$0&9+"$%&'()"$7R567$*+&*&#.?$6"#$9"#9#$&09$.9.$%"0.#$#-+$)"#$ a"-K$'"$'&00."#$'"$+.@.+"0,"$6\Q<$"9$)"#$+.#-)919#$'"#$.31)-19/&0#$&09$%&09+.$)A"@@/,1,/9.$'"$
0&9+"$1**+&,J"?$610#$)1$#-/9"$'"$)A1+9/,)"$0&-#$'.,+/+&0#$#-,,"##/3"%"09$)1$9"+%/0&)&E/"$'"#$ 7R567;$)"#$:1#"#$@&+%"))"#$'"$0&9+"$9+131/)$'.@/0/##109$)1$9P,J"$'"$+.#-%.$%-)9/X'&,-%"09#$ &+/"09.$ *1+$ -0"$ 9J.%19/B-"$ ,&%%"$ -0$ *+&:)(%"$ 'A-0$ 7R567;$ )A"#*1,"$ '"$ 9+1/9#$ *&-+$ $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
!"#!$%"&'"!()"%(#*!+%"%,()"%(#+!+-.'!"%("/#$!0-"&'+1/("'()"%(!$%1)'+'%(2"()3$4+)1+'05&6((
! "#$%&'()(*&#+,#-+./01.+
75&'!+0!"-"&'(+1/(89:(;10(5<<!"&'(1&(=5&(>+2!"(%'+'0%'0;1"(#51!(#"!-"''!"()+(#)+&0<0>+'05&( 2+&%( 1&( "&40!5&&"-"&'( '5'+)"-"&'( 5=%"!4+=)",( 1&( :?89:( <51!&0'( 1&( -52.)"( -+'*$-+'0;1"( #51!( )"%( #!5=).-"%( 2"( 2$>0%05&%( %$;1"&'0"))"%( 2+&%( )"%( "&40!5&&"-"&'%( #+!'0"))"-"&'( 5=%"!4+=)"%6( @"( #!0&>0#+)( +4+&'+A"( 231&( :?89:( "%'( 23+450!( 1&"( +!>*0'">'1!"( >5-#).'"(#51!(-52$)0%"!()30&>"!'0'12"(0&*$!"&'"(+1(#!5=).-"($'120$(BC51&A,(DEEFG6(
!23 145&'&6&('+5($%#))#+
H&(:?89:("%'(1&('1#)"(!"#$%#$&#$'#$(#$)*(B@0%5&,(DEIEG(5J(K(( I6 "$"%'(+,-./01-$2,3404.(2$<0&0(>5--"(1&("&%"-=)"(23$'+'%(-1'1"))"-"&'("/>)1%0<%6( D6 %(!"#!$%"&'"(+,-./01-$2,014567.(#5%%0=)"%(;131&(+A"&'(#"1'("<<">'1"!(2+&%(1&($'+'6( L6 &("%'()3"%#+>"(2"%(5=%"!4+'05&%(;1"()3+A"&'(#"1'(#"!>"450!6( M6 '8.#$0#$.,9$:$;<8.,N.#$09("%'(+-$=62>+-$2-$4<07.54567(;10(2$&5'"()+(#!5=+=0)0'$(23+''"0&2!"()3$'+'( %3(%0()3+>'05&(0("%'("<<">'1$"(2+&%()3$'+'(.6( O6 (8.#$69("%'()"(=62>+-$2,6?.-<@04567(;10(%#$>0<0"()+(#!5=+=0)0'$(2"(#"!>"450!()35=%"!4+'05&(6( 2+&%()3$'+'(.6( F6 )8.#$09("%'()+(A6714567$2-$<316=/-7.-(;10(2$<0&0'()31'0)0'$(2"()3+A"&'(P("<<">'1"!(1&"(+>'05&(0( $'+&'(2+&%()3$'+'(.6(!2! 784696+,#+:$(;9':#+
H&(:?89:(%1##5%"(;1"()3$'+'(21(-5&2"(&3"%'(#+%(20!">'"-"&'(5=%"!4+=)"6(:+!(>5&%$;1"&',( 1&( :?89:( #"1'( %"1)"-"&'( 2$210!"( 2"%( 0&<5!-+'05&%( 1'0)"%( P( #+!'0!( 235=%"!4+'05&%( 20%#5&0=)"%6( 7"''"( 0&>"!'0'12"( #"1'( Q'!"( >52$"( #+!( )3$'+'( 2"( >!5R+&>"( ?,( ;10( "%'( 1&"( 20%'!0=1'05&( 2"( #!5=+=0)0'$( %1!( '51%( )"%( $'+'%( #5%%0=)"%( B@0%5&,( DEIEG6( ?&( &5'"( ?8.9( )+( #!5=+=0)0'$(+''!0=1$"(P()3$'+'(!$")(#+!()3$'+'(2"(>!5R+&>"(?6(S51%(#5145&%(>+)>1)"!(1&($'+'(2"( >!5R+&>"( >51!+&'( >5--"( 1&"( 20%'!0=1'05&( 2"( #!5=+=0)0'$( >5&20'05&&"))"( %1!( )"%( $'+'%( !$")%( $'+&'(25&&$"%()+(%$;1"&>"(2"%(5=%"!4+'05&%("'(2"%(+>'05&%("<<">'1$"%(T1%;130>06(9+&%()3$'+'(2"( >!5R+&>"(>51!+&'(?8.9#(%0()3+>'05&("%'("<<">'1$"("'(1&"(5=%"!4+'05&(6("%'(#"!U1",()"(&514")($'+'( 2"(>!5R+&>"(%"!+(25&&$(#+!(BV1%%")("'(S5!40A,(DEELG(K(b (′ s ) =′ αO( ′ s , o) T( s, a,s s )b( s)′ ∑ ( BIG( 5J(α("%'(1&"(>5&%'+&'"(2"(&5!-+)0%+'05&(;10(-"'()+(%5--"(2"%($'+'%(2"(>!5R+&>"(P(I6(9+&%( 1&(:?89:,()3+>'05&(5#'0-+)"(231&(+A"&'(%3+##10"(1&0;1"-"&'(%1!()3$'+'(2"(>!5R+&>"(>51!+&'( 2"()3+A"&'(#10%;1"()3+A"&'(&3"%'(#+%(>5&%>0"&'(2"(%5&($'+'(+>'1")6(:+!(>5&%$;1"&',()"(>R>)"(2"( 2$>0%05&%(231&(+A"&'(:?89:(>5&%0%'"(P("/$>1'"!()3+>'05&(0("&('"&+&'(>5-#'"(2"()3$'+'(+>'1")( 2"(>!5R+&>"(?,(2"()35=%"!4+'05&(6,("'(2"()+('!+&%0'05&(+1(&514")($'+'(2"(>!5R+&>"(B$;1+'05&(IG6( @+('W>*"(%104+&'"(>5&%0%'"(P("<<">'1"!(1&"(!">*"!>*"(2"()+(#5)0'0;1"(5#'0-+)"(2+&%()3"%#+>"( >5&'0&1( 2"%( $'+'%( 2"( >!5R+&>"%( BV1%%")( "'( S5!40A,( DEELG6( H&( $'+'( 2"( >!5R+&>"( 0&0'0+)( ?B( B+R+&'(1&"(20%'!0=1'05&(1&0<5!-"G("%'(%#$>0<0$"(P()3"/$>1'05&()5!%(2"()30&0'0+)0%+'05&(2"(&5'!"( %R%'.-"(#!5#5%$6(
!"# $%&'()*+,+-.%&'
!"#$%&'()%*#"'#+,%-&./0#12'*#34563#1%)(#+,78)$0,#&2"8()%*#+%$$)-&0#10#&2"90*(#1"*$#'*#7("(# :'2)&#+%',,")(#"((0)*1,0#1"*$#'*#80,(")*#)*(0,;"&&0#10#(0/+$<#=0#(>+0#10#$%&'()%*#0$(#"++0&7# '*0# +%&)():'0# 0(# *%(7# !# ?@'$$0&# 0(# A%,;)9B# CDDEF<# !2)170# 97*7,"&0# 12'*# 34563# 0$(# :'0# &2"8()%*#%+()/"&0#*0#17+0*1#:'0#10#&27("(#10#8,%>"*80#8%',"*(#10#&2"90*(B#8",#)&#*2"#"88.$#:'2G# &27("(# ,70&# "8('0&<# 3",# 8%*$7:'0*(B# &"# +%&)():'0# %+()/"&0# ?:')# 1%**0# &"# +&'$# 9,"*10# '()&)(7# 0$+7,70FB#*%(70#!"#$%&B#0$(#'*0#"++&)8"()%*#10$#7("($#10#8,%>"*80#G#&2"8()%*<#A%'$#17H)*)$$%*$# &"#;"&0',#10#&2"8()%*#'#1"*$#&27("(#10#8,%>"*80#%#$0&%*#&"#+%&)():'0#!#*%(70#(!"$%)"'&"I#
Q π (b, a)= Eπ
{
Rt|bt = b, at = a}
# ### # #= γk r t+ k + 1|bt = b, at = a k=0 ∞ ∑
}
{
## # ?CF#J8)B# *!# ,0+,7$0*(0# &"# ;"&0',# 0$+7,70# 7("*(# 1%**7# :'0# &2"90*(# $')(# &"# +%&)():'0# !B# @(# 0$(# &0#
+,-.,/,-0",123+3#:')#0$(#17H)*)0#0*#H%*8()%*#10#&"#$7:'0*80#10#,78%/+0*$0$B#,(#KLB#,(#KCB#<<<#%M#
,(#0$(#&"#,78%/+0*$0#*'/7,):'0#:'0#&2"90*(#,0N%)(#G#&2)*$("*(#(<#A%'$#"++0&%*$#(!#&"#H%*8()%*#
"8()%*O;"&0',# +%',# &"# +%&)():'0# !<# 4# ,0+,7$0*(0# &0# H"8(0',# 12"8('"&)$"()%*# :')# 17(0,/)*0# &2)/+%,("*80# 10$# H'(',0$# ,78%/+0*$0$<# !0# $>$(./0# 0$$")0# 10# (,%';0,# &"# +%&)():'0# %+()/"&0# +",# &2)(7,"()%*# 10# &"# +%&)():'0<# P*0# H%)$# &"# +%&)():'0# %+()/"&0# !## 0$(# %-(0*'0B# &2"90*(# 8Q%)$)(# &0$#"8()%*$#0*#'()&)$"*(#&0#+,)*8)+0#12'()&)(7#/"R)/"&0#0$+7,70#?@'$$0�(#A%,;)9B#CDDEF<#
# /)01*%'23/42'().5'*%'56&.76'
#"8 9:;+5)::%7%:,<'6,=,'%,'=>,+):'
!"#(S8Q0#10#,7$'/7#/'&()O1%8'/0*($#%,)0*(70#+",#'*0#(Q7/"():'0#8%*$)1.,0#'*0#,0:'T(0#5# ?'*0#(Q7/"():'0F#0(#'*0#8%&&08()%*#10#1%8'/0*($#;%)$)*$#6#U#V.7)".8)"999)".-W#+%',#97*7,0,#'*# ,7$'/7<# !20$+"80# 127("($# :')# 178,)(# &20*;),%**0/0*(B# )*8&'0# &0$# 7("($# 10# ,7$'/7# 0(# *%*# ,7$'/7<#!2"8()%*#%+()/"&0#10#&2"90*(B#*0#$"8Q"*(#+"$#1"*$#:'0("(#)�$(B#17+0*1#10#$%*#7("(# 10# 8,%>"*80# 8%',"*(<# !20$+"80# 127("($# 10$# 8,%>"*80$# 0$(# 8%*()*'B# ,0+,7$0*(7# +",# '*0# 1)$(,)-'()%*# 10# +,%-"-)&)(7$B# 8%/+,0*1# &20*$0/-&0# 10$# 7("($# :'0# &2"90*(# +%',,")(# +,0*1,0<# 6"*$# &0# +,%-&./0# 120R(,"8()%*# 10# ,7$'/7B# &2%-X08()H# 0$(# 10# $7&08()%**0,# '*# 0*$0/-&0# 10# +Q,"$0$# )/+%,("*(0$# 10# &"# 8%&&08()%*# 10# 1%8'/0*($# 1%**70# +%',# 8%*$()('0,# &0# ,7$'/7# 8"*1)1"(<# 6"*$# 8Q":'0# 7("(# 10# 8,%>"*80B# %*# 1)$+%$0# 12'*# 0*$0/-&0# 12"8()%*$# +%$$)-&0$# :')# +%',,")0*(# T(,0# %+7,70$# $',# &20*;),%**0/0*(# %M# 8Q":'0# "8()%*# )*1):'0# &"# $7&08()%*# 12'*0# +Q,"$0# +",()8'&).,0# ?0*# '()&)$"*(# &"# H%*8()%*# +%&)():'0# 10# &27:'"()%*# CF# G# +",(),# 10$# +Q,"$0$# 10$#1%8'/0*($#,0$("*(0$#*%*#0*8%,0#)*8&'$0$#1"*$#&0#,7$'/7#8"*1)1"(<#
#"! 3?&%5;=,+):'%,'56>)7(%:&%'
!%,$:'0#*%'$#8Q%)$)$$%*$#'*0#+Q,"$0#8%*$)17,70#)/+%,("*(0B#*%'$#8"&8'&%*$#$"#+,%-"-)&)(7# 12%-$0,;"()%*# 0*# /0$',"*(# $"# +",0*(7# ";08# &0$# ,7$'/7$# 10# ,7H7,0*80$# H%',*)$<# A%'$# /0$',%*$# 80((0# $)/)&",)(7# 0*# '()&)$"*(# &2%'()&# "'(%/"():'0# @4PYZ# ?@08"&&# 4,)0*(01# P*10,$('1># +%',# Y)$()*9# Z;"&'"()%*F# ?!)*B# CDD[F<# !0$# /0$',0$# 8%*80,*0*(# &0# *%/-,0# 12'*)(7$# :')# $0# 8Q0;"'8Q0*(# (0&$# :'0# &0$# *O9,"//0$B# &0$# /%(O$7:'0*80$B# 0(# &0$# +"),0$# 10# /%($#0*(,0#&0$#10'R#,7$'/7$#?10#,7H7,0*80#0(#0R(,")(F<#!0$#/0$',0$#10#@4PYZ#8%*$)17,70$#
!"#$% &'()*+,% -,% .% /0% 10% 20% 340% &'()*+50% &'()*+6% 7$% &'()*89% :;!% <=7% >?% @A"B?BC>C$D1%>?%
@>=!%D>7ED7%F7%>?%GA"H?#G7%7!$%?$$7C#$70%"#%?AACE7%I%>JD$?$%F7%AD!=KD0%7$%=#7%ADG"K@7#!7%F7%/% 7!$% ?$$ACB=D70% !C#"#% L% 7!$% A7$"=A#D9% 57% M'N:M% @"=A% =#% AD!=KD% O"#G$C"##7% F7% >?% K?#C;A7% !=CE?#$7%P% I% GQ?<=7% C#!$?#$0% >J7#ECA"##7K7#$% 7!$% F?#!% =#% G7A$?C#% D$?$% #"#% "B!7AED% !9% R7>?% !CS#COC7%<=J=#7%@QA?!7%7!$%!D>7G$C"##D7%7$%FD@>?GD7%F?#!%>7%AD!=KD%G?#FCF?$%!?#!%!?E"CA%!C%>7% !H!$;K7% ?% ?$$7C#$% >JD$?$% F7% AD!=KD% "=% #"#9% M=C!<=7% !% #J7!$% @?!% G"##=% T%7U?G$7K7#$%V0% =#7% FC!$ACB=$C"#% F7% @A"B?BC>C$D% -7!@?G7% F7!% D$?$!% F7% GA"H?#G74% !=A% $"=!% >7!% D$?$!% @"!!CB>7!% -AD!=KD%"=%#"#%AD!=KD4%7!$%K?C#$7#=7%"W%"#!$%C#FC<=7%>?%@A"B?BC>C$D%FJX$A7%F?#!%=#%D$?$%!% @?A$CG=>C7A9%8=A%>?%B?!7%F7%>JD$?$%?G$=7>%F7%GA"H?#G70%=#7%?G$C"#%"@$CK?>7%%%7!$%GQ"C!C%7$%A7Y"C$% =#7%ADG"K@7#!7%&%B?!D7%!=A%>?%@A"B?BC>C$D%FJ"B!7AE?$C"#0%7$%>J7#ECA"##7K7#$%!7%FD@>?G7%I%=#% #"=E7>% D$?$% #"#% "B!7AED7% !'9% 5J7#ECA"##7K7#$% SD#;A7% ?>"A!% =#7% "B!7AE?$C"#% ('% @"=A% ?G$=?>C!7A% >JD$?$% F7% GA"H?#G79% 5J7#!7KB>7% F=% @A"G7!!=!% $7#$7% F7% @A"F=CA7% =#% AD!=KD% !CKC>?CA7%?=%AD!=KD%F7%ADODA7#G7%7#%?!!=A?#$%DS?>7K7#$%<=7%>7%AD!=KD%G?#FCF?$%#7%G"#$C7#$% @?!%FJC#O"AK?$C"#!%A7F"#F?#$7!9%
!"! #$%&'()*&+,-(,./01.,
:?#!% #"$A7% O"AK=>?$C"#0% >7% #"KBA7% FJD$?$!% AD7>!% 7!$% DS?>% I% F7=U% -D$?$% AD!=KD0% D$?$% #"#% AD!=KD49% M=C!<=7% >J7#ECA"##7K7#$% 7!$% @?A$C7>>7K7#$% ?GG7!!CB>70% #"=!% ?E"#!% K"FD>C!D% >7% @A"B>;K7%G"KK7%=#%M'N:M%7#%C#$A"F=C!?#$%=#%#"KBA7%C#OC#C%FJD$?$!%F7%GA"H?#G70%<=C%!"#$% "B!7AE?B>7!% @?A% >J?S7#$9% M"=A% AD!"=FA7% G7% @A"B>;K70% #"=!% G"#!CFDA"#!% =#7% ?@@A"GQ7% FJ?@@A"UCK?$C"#% O"#G$C"##7>>7% ?=% @A"B>;K79% ,"=!% A7@AD!7#$"#!% >?% O"#G$C"#% ?@@A"UCKD7% ?G$C"#+E?>7=A%G"KK7%=#7%O"#G$C"#%>C#D?CA7%@?A?KD$AD7%?E7G%>7%E7G$7=A%F7%@?A?K;$A7!
θ
!
t9%Z%GQ?<=7% @?CA7% D$?$% F7% GA"H?#G7+?G$C"#% #")* %$0% C>% 7UC!$7% =#% E7G$7=A% G">"##7% F7% $A?C$!0% !
ϕb = (ϕb(1),ϕb(2),...,ϕb(n))T ?E7G% >7% KXK7% #"KBA7% F7% G"K@"!?#$!% <=7%
θ
!
t9% 5?% O"#G$C"#%?@@A"UCKD7%?G$C"#+E?>7=A%7!$%F"##D7%@?A%P%
Qt(b, a) = ! θ t T! ϕ b = θt(i )ϕb(i ) i=1 n ∑ %% -24%
,"=!% G"#!CFDA"#!% #"$A7% @A"B>;K7% G"KK7% =#% @A"B>;K7% F7% @AC!7% FDGC!C"#% !D<=7#$C7>>7% I% Q"AC["#% C#OC#C% <=C% $A"=E7% =#% E7G$7=A% F7% @?A?K;$A7!%
θ
!
%@"=A% K?UCKC!7A% +#")* %$* I% @?A$CA% F7% >JD<=?$C"#%-249%,"=!%=$C>C!"#!%=#%?>S"AC$QK7%F=%SA?FC7#$%F7%>?%@">C$C<=7%@"=A%AD!"=FA7%#"$A7% @A"B>;K7%F7%M'N:M9%57!%Z>S"AC$QK7!%F=%SA?FC7#$%F7%>?%@">C$C<=7%"#$%$7#F?#G7%I%7!$CK7A%>7!% @?A?K;$A7!% ,% 7#% 7OO7G$=?#$% =#7% K"#$D7% F=% SA?FC7#$% !$"GQ?!$C<=79% 57% SA?FC7#$% ?@@A"UCKD% @?A% >JC#$7A?G$C"#% ?E7G% >J7#ECA"##7K7#$0% 7$% >?% ADG"K@7#!7% <=C% 7#% AD!=>$7% 7!$% =$C>C!D% @"=A% K7$$A7% I% \"=A% >J7!$CK?$C"#% F7% ,9% 57!% ?>S"AC$QK7!% F=% SA?FC7#$% F7% >?% @">C$C<=7% "@$CKC!7% =#% "B\7G$CO% #"#% G"#E7U7% 7$% #7% !"#$% S?A?#$C!% <=7% @"=A% $A"=E7A% =#% "@$CK=K% >"G?>% -]A?#?E?#% -.*%/90% 1LL^49% ,"=!% =$C>C!"#!% =#7% E7A!C"#% F7% >J?>S"AC$QK7% K"FCOCD7% +* #0$% F7% 6?$_C#!% ?E7G% F7!G7#$7%F7%SA?FC7#$%>C#D?CA7%-8=$$"#%7$%]?A$"0%/^^`4%7#%?@@>C<=?#$%>?%@">C$C<=7%a+S>"=$"##7% ?OC#% F7% FD$7AKC#7A% >?% K7C>>7=A7% ?G$C"#% @"!!CB>7% @"=A% !D>7G$C"##7A% >7!% @QA?!7!% >7!% @>=!% CK@"A$?#$7!9% ,"=!% #"=!% !7AE"#!% F7% >?% @">C$C<=7% a+S>"=$"##7% -G7% <=C% !CS#COC7% <=7% >?% @>=@?A$% F=%$7K@!%G7$$7%@">C$C<=7%GQ"C!C$%=#7%?G$C"#%?E7G%>?%E?>7=A%K?UCK?>7%7!$CKD70%K?C!%=#7%?G$C"#% 7!$% !D>7G$C"##D7% ?=% Q?!?AF% ?E7G% =#7% @A"B?BC>C$D% -a4% @"=A% $A"=E7A% >JD<=C>CBA7% 7#$A7% >J7U@>"A?$C"#% 7$% >J7U@>"C$?$C"#% @7#F?#$% >?% @Q?!7% FJ?@@A7#$C!!?S79% ,"=!% ?E"#!% @"!D% a% .% L9/9%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%
1%:?#!% GQ?<=7% D$?$0% >?% @A"B?BC>C$D% FJ"B!7AE?$C"#% 7!$% KC!7% I% \"=A% >"A!<=7% <=7% >7% !H!$;K7% 7!!?C7% F7% SD#DA7A% =#% AD!=KD% <=C% 7!$% =#% @?!% F7% @>=!% E7A!% >7% AD!=KD% F7% ADODA7#G79% 5?% @A"B?BC>C$D% >?% @>=!% D>7ED7% F7% >?% GA"H?#G7% 7!$% "B!7AED7%>"A!<=7%>7%AD!=KD%F=%!H!$;K7%?%>?%G"AA7!@"#F?#G7%>?%@>=!%@A"GQ7%?E7G%>7%AD!=KD%F7%ADODA7#G79%
!"#$"%&#'()*&+,-')"(./*&0.'"$"(&1#*&+0("'#&+2*0&,+&/*",,*1)*&+0("'#32+,*1)&4&56&7&*(&",&0.'"$"(& 1#*&+0("'#&+1&.+$+)8&4&96&7:&
;*$& <(+=*$& 8*& #'()*& $',1("'#& >?@A>& $'#(& =)<$*#(<*$& 8+#$& ,B+,-')"(./*& 9& 'C& D& *$(& 1#& 2*0(*1)& 8*& ()+"($32+,*1)$& EF'")& $*0("'#& GH& 1(","$<& ='1)& )*=)<$*#(*)& 0.+I1*& =.)+$*& 8*& 8'01/*#(&J
θ
!
t&*$(&,*&2*0(*1)&8*&='"8$&='1)&,*&2*0(*1)&8*&()+"($&I1*&,*&$K$(L/*&2+&+==)*#8)*&*(& M& *$(& ,*& 0'*NN"0"*#(& 8B+0(1+,"$+("'#& 1(","$<& ='1)& 0+,01,*)& ,+& )<0'/=*#$*& 8B1#*& =+")*& <(+(3 +0("'#:& ;*& N+0(*1)& 8B+0(1+,"$+("'#& 8<(*)/"#*& ,B"/=')(+#0*& 8*$& N1(1)*$& )<0'/=*#$*$:& O'1$& +2'#$&-+)8<&,+&2+,*1)&"#"("+,*&8*&M&4&6:9&I1B'#&N+"(&8"/"#1*)&8B1#&N+0(*1)&0'))*$='#8+#(&+1& #'/P)*& 8B"(<)+("'#:& Q+#(& I1*& ,+& =',"("I1*& "#"("+,*& $<,*0("'##*& ,*$& +0("'#$& -,'1('##*$%& ,B+,-')"(./*& 0'#("#1*& ,B+==)*#("$$+-*& 8*& ,+& N'#0("'#& +0("'#32+,*1)& +2*0& 1#*& ,+& =',"("I1*& -,'1('##*:& R*=*#8+#(%& I1+#8& 1#*& +0("'#& *S=,')+('")*& *$(& $<,*0("'##<*& =+)& ,+& =',"("I1*& 8*& 0'/=')(*/*#(%&,*$&()+0*$&8B<,"-"P","(<T%&
e ! %&$'#(&"#"("+,"$<*$&='1)&('1$&,*$&0'1=,*$&<(+(3+0("'#&
*(&*,,*$&$'#(&/"$*$&4&U'1)&*#&8*1S&<(+=*$:&A+#$&,+&=)*/"L)*&<(+=*%&$"&1#*&+0("'#&*S=,')+('")*& *$(& =)"$*%& *,,*$& $'#(& /"$*$& 4& 6& ='1)& ('1(*$& ,*$& =+")*$& <(+(3+0("'#:& A+#$& ,*& 0+$& 0'#()+")*%& ,*$& ()+0*$& 8B<,"-"P","(<& ='1)& ('1(*$& ,*$& =+")*$& <(+(3+0("'#& $'#(& 8<0'/='$<*$& =+)& MV:& A+#$& ,+&
8*1S"L/*& <(+=*%& ,+& 2+,*1)& 8*& ,+& ()+0*& 8B<,"-"P","(<& 8*& ,+& =+")*& +0(1*,,*& <(+(3+0("'#& *$(& "#0)</*#(<*&8*&9&('1(&*#&+001/1,+#(&,*$&()+0*$:&;+&2*)$"'#&')"-"#+,*&8*&,B+,-')"(./*&!"#$&8*& W+(X"#$& 1(","$*& 1#*& +==)'S"/+("'#& ,"#<+")*& 8*& ,+& N'#0("'#& 8*& ,+& 8*$0*#(*& 8*& -)+8"*#(& +2*0& 8*$& ()+"($& P"#+")*$:& Q'1(*N'"$%& <(+#(& 8'##<& I1*& #'1$& ()+"('#$& 1#& /<,+#-*& 8*&()+"($& 4& 2+,*1)& )<*,,*& *(& P'',<*##*& E2'")& $*0("'#& GH%& #'1$& +2'#$& /'8"N"<& ,B+,-')"(./*& ='1)& 8<0,*#0.*)& 1#*& /"$*&4&U'1)&8"NN<)*#(*&='1)&,*$&()+0*$&8B<,"-"P","(<:&A+#$&,+&8*1S"L/*&<(+=*&8*&,+&/"$*&4&U'1)& 8*$&()+0*$&8B<,"-"P","(<%&'#&"#0)</*#(*&,+&2+,*1)&+2*0&,*&$0')*&81&()+"(&0'))*$='#8+#(:&;B+U'1(& 8B1#*& <(+=*& 8*& $+1(& +,<+('")*& <2"(*& ,*$& /+S"/1/$& ,'0+1S& 8+#$& #'()*& +,-')"(./*:& ;*& =+)+/L()*& #& 8<N"#"(& I1*,& 0)<8"(& #'1$& ='12'#$& +00')8*)& +1S& <(+($& +#(<)"*1)$:& %& *$(& ,*& =+)+/L()*&8*&,+&(+",,*&8*&=+$&='1)&,*&=)'0<8<&8*&,+&8*$0*#(*&8*&-)+8"*#(&I1"&*$(&)<81"(&=+)& 1#&N+0(*1)&8*&6%55&8*&$')(*&I1*&,B+==)*#("$$+-*&0'#2*)-*&2*)$&,*&P1(:&&&*$(&,*&(+1S&8B*))*1)&8*& =)<8"0("'#& <(+(32+,*1):& Y#& Z&<="$'8*&[& *$(& ,+#0<& 4& ,+& =.+$*& 8B+==)*#("$$+-*& ='1)& 0.+I1*& (.L/*& *(& $*& (*)/"#*& I1+#8& ,B<(+(& 8*& )<$1/<& N"#+,& *$(& +((*"#(:& ;+& 0'#8"("'#& Z&'& #B*$(& =+$& (*)/"#+,*&[& *$(& $+("$N+"(*& ,')$I1*& '& $*& )<NL)*& 4& ,B<(+(& N"#+,& 8*& )<$1/<:& ;B<(+(& 8*& 0)'K+#0*& "#"("+,& +& 1#*& 8"$()"P1("'#& 8*& =)'P+P","(<& 1#"N')/*& $1)& ,*$& <(+($& )<*,$:& ;B+0("'#& "#"("+,*& *$(& 0.'"$"*& *#& N'#0("'#& 8*& ,+& =)'P+P","(<& 8B'P$*)2+("'#& 8*$& =.)+$*$:& !& #'()*& 0'##+"$$+#0*%& ,+& N')/1,+("'#&=)'='$<*&=+)&,+&2*)$"'#&/'8"N"<*&8*&,B+,-')"(./*&!"#$&8*&W+(X"#$&*$(&')"-"#+,*& 8+#$&,+&N+\'#&8'#(&",&)*=)<$*#(*&,+&(]0.*&8*&)<$1/<&')"*#(<*&$1)&1#*&(.</+("I1*:&
! "#$%&'()'#(*+%,*#(
O'1$&)*=)<$*#('#$&0.+I1*&=.)+$*&8B1#&8'01/*#(&0'//*&1#&2*0(*1)&8*&()+"(32+,*1)&Eϕ&8+#$& ,B+,-')"(./*& 9H:& O'()*& *#$*/P,*& 8*& ()+"($& 0'/=)*#8& 8*1S& (K=*$%& ,*& =)*/"*)& 0+)+0(<)"$*& ,B"/=')(+#0*&8B1#*&=.)+$*&8+#$&1#&8'01/*#(&*(&,*&$*0'#8&/*$1)*&,+&$"/",+)"(<&*#()*&0.+I1*& =.)+$*& *(& ,+& )*I1^(*& 8*& ,B1(","$+(*1):& R*$& ()+"($& '#(& <(<& +8'=(<$& =+)& =,1$"*1)$& ()+2+1S& 0'##*S*$& 4& 0*((*& =)'P,</+("I1*& E_8/1#8$'#%& 95`5&J& ;"(2+X& ()* +,:%& a696&J& b0.",8*)& *(& c'#8+8+8"%&a66dH:&
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
T&Y#*& ()+0*& 8B<,"-"P","(<& *$(& 1#& *#)*-"$()*/*#(& (*/=')+")*& 8*& ,B'001))*#0*& 8B1#& <2<#*/*#(%& 0'//*& ,+& 2"$"(*& 8B1#&
!"# $%&'(%)*%)+,-./0(1234%)*,'3%)/5(2&%)
!"#$%$"&'()#'*+,-#)#'.!"#$!%&'($#$!)*+!$#!,'-*.#/,!(*!012*,!#,!3!4(!5+/!06*/!0-7*8#/,!-/,! $-*.#/,! ,#/0(/7#! 3! +/74*'#! 4#$! +/5-'8(,+-/$! 4#$! %4*$! %'17+#*$#$9! :-*$! (.-/$! (/(4;$1! 8(/*#44#8#/,!4(!7-44#7,+-/!0#!0-7*8#/,$!0-//1$!#,!/-*$!(.-/$!7-/$,(,1!)*#!4(!%'#8+<'#!#,! 4#$!=!0#'/+<'#$!%&'($#$!06*/!0-7*8#/,!'1%-/0#/,!2+#/!3!7#!,'(+,9!:-*$!4#*'$!(,,'+2*-/$!(+/$+! 4#!$7-'#!0#!>!#,!?!(*@!(*,'#$!%&'($#$9! /"&01)1,'()#'*+,-#)#'.!"#$!%4*$!4-/A*#$!%&'($#$!7-/,+#//#/,!%4*$!0#!8-,$!#,!-/,!*/#!%4*$! A'(/0#! %'-2(2+4+,1! 0#! 7-/,#/+'! 0#$! +/5-'8(,+-/$! +8%-',(/,#$9! B('! 7-/$1)*#/,C! */#! 4-/A*#! %&'($#!(!0#!8#+44#*'#!7&(/7#!0#!5+A*'#'!0(/$!*/!'1$*819!:-*$!0-//-/$!4#!$7-'#!0#!>!3!*/#! 4-/A*#! %&'($#! #,! ?! (*@! (*,'#$9! "6(/(4;$#! 8(/*#44#! 0#! 4(! 7-44#7,+-/! 0#! 0-7*8#/,$! /-*$! (! (8#/1!3!5+@#'!4#!$#*+4!0#!>>!8-,$!%-*'!7-/$+01'#'!)*6*/#!%&'($#!#$,!4-/A*#9! 2",,)#*"&(-&3)' -4)3' 5)' %$%,)'.! D+! /-*$! ,'-*.-/$! 0#$! 7&#.(*7#/,$! 0#! 8-,$! #@(7,$C! 0#! $;/-/;8#$C!-*!06&;%-/;8#$!#/,'#!4#!,+,'#!#,!*/#!%&'($#C!/-*$!4*+!(,,'+2*-/$!4#!$7-'#!0#!>C! $+/-/! ?9! :-*$! *,+4+$-/$! 4(! 2($#! 0#! 0-//1#$! E-'0:#,F!GH#442(*8C! >IIJK! %-*'! 46(77<$! (*@! $;/-/;8#$!#,!(*@!&;%-/;8#$9! 6+70(-15.%!>!LGλK!0#!E(,M+/$!8-0+5+1!N! 6&%,7#'.!α,θ , λ ,γ ,ϕ ,ε, !/-82'#!06+,1'(,+-/$!"!! 8",%$)#'.!.#7,#*'!
θ ! !0#$!%-+0$!(%%'+$! O/+,+(4+$(,+-/!N!
θ ! !3!
0 C!!
e ! !3!
0 C α !3!?9?>C! λ!3!?9ICγ!3!?9>! #$!%!←!1,(,!0#!7'-;(/7#!#,!(7,+-/!0#!461%+$-0#!+/+,+(*@!
ϕ
!←!#/$#824#!0#$!,'(+,$!%'1$#/,$!0(/$!&C!%! 80'(!'!(!)!**!"!92-(%) ) :-)2!#$,!/-/!,#'8+/(4!!!6+0(&) ) ) 80'()'!∈!ϕ!!!92-(%! !e(i ) ← e(i ) +ϕ(i ) ! ) ) ) 5(+'#!46(7,+-/!(C!-2$#'.#'!4(!'17-8%#/$#!#,!461,(,!$*+.(/,!2! ! !
δ← r −∑iϕ(i )θ(i )! ! ! 80'(!(!!∈!+,#-!!!92-(%! !
ϕ
!←!#/$#824#!0#!,'(+,$!%'1$#/,$!0(/$!#C!%! !Q ←a ∑iϕ(i)θ(i)! ! ! ) ! !
δ←δ+γmaxaQ !a ! ! !
θ ←θ +αδe ! ! ! ! !
δ← 0.99 ×α! ! ! :-!%'-2(2+4+,1!≤!>P!ε!!!!6+0(&! ! ! ! 80'(!
a ∈ A(b) !!92-(%) !
Q ←a ∑iϕ(i)θ(i)! ! ! ! ) ! ! !
a ← arg maxa a Q ! ! ! !
! e ←γλe ! !
! ! &-303!!
a ← action aléatoire ∈ A(b)!
! ! !
! e ← 0 ) )! ! '#,-*'/#'!!
θ ! ! !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! F!:-*$!*,+4+$-/$!0(/$!7#,,#!'#7&#'7&#!4(!.#'$+-/!=9?!0#!E-'0:#,9! (++ Q a Q a ← a ← &-3 #,-*'/,
!"#$#%&' "())%*&' +!,-' .! "#! $%&'#! (#! )! #$*! +**',-./! 0! .1#! 23'+$#! +22+'*#1+1*! 0! .1#! %4+$$#!
(567! 2+'8,! 9! :#'$&11#;! "&%+4,$+*,&1;! <'=+1,$+*,&1;! 61*,*/! =/&2&4,*,>.#;! ?1$*+44+*,&1;! @+*#;! A&11+,#;! 7&8-'#;! B&'+,'#C! 7&.$! 2#1$&1$! >.5.1#! 67! +%%'&D*! 45,82&'*+1%#! (5.1#! 23'+$#! #*! 1&.$!.*,4,$&1$!4#!$E$*F8#!<GH!IJ#K,1#;!LMMLN!2&.'!4+!'#%&11+,$$+1%#!(5#1*,*/$!1&88/#$C!
/*0$12*' &3%4$5$12*' .! "+! 2#'*,1#1%#! 2'&-+-4#! (5.1#! 23'+$#! #$*! +OO#%*/#! 2+'! 4+! 2'/$#1%#! (#!
8+'>.#.'$! 4#P,%+.P! IQ!,82&'*+1*!R;! Q!,82&$$,-4#!R;! Q!#1! %&1%4.$,&1!R;! Q!#1O,1!R;! #*%CNC! 7&.$! .*,4,$&1$! .1#! 4,$*#S!(#! LLT! #P2'#$$,&1$! #*! 1&.$! (&11&1$! 4#! $%&'#! (#! )! 0! .1#! 23'+$#!
%&1*#1+1*!.1#!#P2'#$$,&1!(+1$!%#**#!4,$*#!#*!M!$,1&1C!
!"# $%&'(%)*%)&+,+-.(+/0).1%2)-.)(%3'4/%)*%)-5'/+-+&./%'()
67*89247*)*"#':*'";<=9))*'.!?4!$5+=,*!(.!'+22#4!#1*'#!4+!'#>.U*#!#*!4+!23'+$#!%+1(,(+*#!
(+1$!4+>.#44#!1!'#2'/$#1*#!4+!4&1=.#.'!(.!1V='+88#!I1!W!);!L;!X;!YNC!Z#**#![+4#.'!#$*!&-*#1.#! #1! (,[,$+1*! 4#! *&*+4! (#$! %&V&%%.''#1%#$! (#! 1V='+88#$! (+1$! 4+! '#>.U*#! #*! (+1$! 4+! 23'+$#! %+1(,(+*#;!2+'!4#!1&8-'#!(#!1V='+88#$!(+1$!4+!23'+$#!I",1;!LMMYNC!
/>6'.!6*+1*!(&11/!(#.P!$/>.#1%#$!J)!#*!JL;!4+!24.$!4&1=.#!$/>.#1%#!%&88.1#!I"JZN!(#!J)!#*!
JL!#$*!.1#!$&.$V$/>.#1%#!%&88.1#!+[#%!4+!4&1=.#.'!8+P,8+4#C!
/>6?' .! "+! 24.$! "&1=.#! J/>.#1%#! Z&88.1#! :&1(/'/#! I"JZ:N! +8/4,&'#! 4+! 8/*3&(#! (#! -+$#!
"JZ! #1! 2'#1+1*! #1! %&82*#! 4+! 4&1=.#.'! (#$! %&''#$2&1(+1%#$! %&1$/%.*,O$! '#1%&1*'/$! I",1;! LMMYNC!"+!"JZ:!2#'8#*!(#!%&1$#'[#'!4+!(.'/#!(#$!%&''#$2&1(+1%#$!%&1$/%.*,[#$!(+1$!.1#! *+-4#!0!(#.P!(,8#1$,&1$!(#!2'&='+88+*,&1!(E1+8,>.#C!"#!%+4%.4!(#!"ZJ:!#$*!-+$/!$.'!4+!\V 8#$.'#!#1*'#!.1#!'#>.U*#!#*!.1#!23'+$#C!
>92#;@$<=9))*' .! Z#! *'+,*! 8#$.'#! 4#! %3#[+.%3#8#1*! (#! -,='+88#$! #1*'#! .1#! 23'+$#!
%+1(,(+*#! #*! .1#! 23'+$#! '#>.U*#C! "#! J+.*V-,='+88#! %&82*#! $%'.2.4#.$#8#1*! *&.*#$! 4#$! 2+,'#$! (#! 8&*$! #1! %&''#$2&1(+1%#;! +4&'$! >.#! "JZ! $5,1*/'#$$#! $#.4#8#1*! 0! 4+! 24.$! 4&1=.#! $/>.#1%#!%&88.1#C! 67*89247*)*"#':*')(#&'*094#&'.!?4!$5+=,*!(#!%+4%.4#'!4#!1&8-'#!(#!8&*$!/>.,[+4#1*$!(+1$!4+! 23'+$#!%+1(,(+*#!#*!4+!23'+$#!(#!4+!'#>.U*#C! 67*89247*)*"#':*'>A"("A)*&'.!Z5#$*!4#!%3#[+.%3#8#1*!#1*'#!4+!4,$*#!(#$!$E1&1E8#$!(#$! 8&*$!4#P,%+.P]!#P*'+,*#!(#!4+!23'+$#!%+1(,(+*#!#*!4#$!8&*$!(#!4+!'#>.U*#!+$$&%,/#C!"#$!8&*$! 4,/$!0!4+!'#>.U*#!$&1*!&-*#1.$!#1!4#$!'#824+^+1*! 2+'! 4#.'! $#1$! 2'#8,#'!$E1&1E8#!.*,4,$+1*! _&'(7#*!I\#44-+.8;!)``TNC!7&.$!%&1$,(/'&1$!>.#!4#$!!"#!$%!!(#!%3+>.#!8&*C!
67*89247*)*"#' :*&' 7A3*=("A)*&' *#' :*&' 7A3("A)*&' .! Z5#$*! 4#! %3#[+.%3#8#1*! #1*'#! 4+!
4,$*#!(#$!3E2#'&1E8#$!#*!3E2&1E8#$!Ia.$>.5+.!1,[#+.!L!(+1$!_&'(7#*N!(#$!1&8$!#P*'+,*$! (#!4+!23'+$#!#*!4#$!8&*$!(#!4+!'#>.U*#!+$$&%,/#C! 67*89247*)*"#':2'<B(&&9$=*'.!7&*'#!$E$*F8#!#P*'+,*!4#$!=4&$$+,'#$!2&.'!4#$!1&8$!2'&2'#$! (#!_&'(7#*C!"#!%3#[+.%3#8#1*!(#$!=4&$$+,'#$!#$*!4#!%3#[+.%3#8#1*!#1*'#!4+!4,$*#!(#$!8&*$! 4#P,%+.P!>.,!$&1*!#P*'+,*$!(#!4+!(/O,1,*,&1!(.!=4&$$+,'#!(#$!1&8$!(+1$!4+!23'+$#!%+1(,(+*#;!#*! 4#$!8&*$!(#!4+!'#>.U*#!+$$&%,/#C! !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
S7&.$! +[&1$! %&1$*'.,*! 1&*'#! 4#P,>.#! #1! $#! '/O/'+1*! +.P! #P2'#$$,&1$! (#! *'+1$,*,&1! (,$2&1,-4#$! (+1$! 3**29bbcccC$8+'*Vc&'($C&'=b*'+1$,*,&1c&'($C3*84!
!"#$%&'()%#*$+,-&.!"#!$%&'()%&!*+#$&!$,-%!.#/.-/&%!/#!0('(/#%(+*!012+#3(4-&!&2+%&!/#!%&4-5+&!
&+! /#! $6%#0&! .,20(0+&! 7! #2#/10&%! /&-%0! #%8%&0! 012+#3(4-&0! &2! -+(/(0#2+! -2! #2#/10&-%! 012+#3(4-&!9! 2,-0! -+(/(0,20! .&/-(! :&! ;<6#%2(#=>! ?@@@ABC! "#! 0('(/#%(+*! &2+%&! :&-3! #%8%&0!
012+#3(4-&0!&0+!.#/.-/*&!&2!-+(/(0#2+!/#!!"#$%&"#'#"()*'+*,'-.+'),/,.+!;<,//(20!&+!D-EE1>!FGG?AC!
/0-1#,20-3-)%& 4-'& 5673-)%'& 4-& 8#'-& 9:8;& .! H,-0! &3+%#1,20! /&0! IJ! :&0! $6%#0&0! :#20! /#!
.,//&.+(,2!:&!:,.-'&2+0!&2!-+(/(0#2+!/&!$#.=#K&!:&0!IJ!:LMNMOC!H,-0!E(/+%,20!&20-(+&!/&0!IJ!&2!
P*%(E(#2+! 0L(/0! .,2+(&22&2+! *#'0"%'1.'-)',.2*3%.'"*'*#'0"%'$"##.4.C! H,-0! ,8+&2,20! #(20(! /&! '&(//&-%!0.,%&!:&!.6&P#-.6&'&2+!:&0!IJ!;Q,P1!.%')-C>!FGGRAC!
! "#$%&'()*+,+'-*.)+.%/,01,+'-*.
!23 4%5'*'+'-*.6).0,.+789).)+.8-&$1:.
<&+! #%+(./&! 0L(2+*%&00&! 7! /#! +S.6&! :&! %*0-'*! '-/+(T:,.-'&2+0! ,%(&2+*&! $#%! -2&! +6*'#+(4-&! ;(C&C! ,%(&2+*&! $#%! -2&! %&4-5+&A! .,''&! .&/#! &0+! :*E(2(+! :#20! /#! D,.-'&2+! U2:&%0+#2:(2K! <,2E&%&2.&>! DU<TFGGB!V! 5'6%)#%' 1"##7.' *#.' 2*.+%&"#' $"08-.4.' 91.+$,&8%&"#' 1*' +*:.%;' .%' *#.'
$"--.$%&"#' 1.' 1"$*0.#%+' 8.,%&#.#%+<' -)' %=$>.' $"#+&+%.' ?' 8,"1*&,.' *#' ,7+*07' /&.#' $"#+%,*&%' #@.4$71)#%' 8)+' ABC' 0"%+'DE! "L&20&'8/&! :&0! :,.-'&2+0@!DU<TFGGW! &+! FGGB! $%,P&2#(&2+! :-!
.,%$-0! XYUXMHZ>! 4-(! &0+! .,'$,0*! :L#%+(./&0! $%,P&2#2+! :&! E(/0! :&! $%&00&! :&! /LX00,.(#+&:! [%&00! &+! H&\! ],%=! Z('&0! ;?@@O! T! FGGGA! &+! :&! /#! ^(26-#! H&\0! XK&2.1! ;?@@WTFGGGAC! H,-0! -+(/(0,20!/&0!K%,-$&0!:&!:,.-'&2+0!;.,2+&2#2+!.6#.-2&!FR!#%+(./&0!:&!$%&00&A!:&!DU<TFGGW! $,-%! #$$%&2:%&! /&0! $,(:0! %&0$&.+(E0! :&! .6#4-&! +%#(+! .,20(:*%*! 4-(! 0&%,2+! &3$/,(+*0! $,-%! $%,:-(%&!:&0!%*0-'*0!$,-%!/&0!K%,-$&0!:&!:,.-'&2+0!:&!DU<TFGGBC!
!2; <,&,(=+&):.61.:>:+=().
"&! _&-! :&! :,22*&0! $%,:-(+! -2! 2,'8%&! :&! $6%#0&0! P,/-'(2&-3C! [,-%! 0('$/(E(&%! 2,+%&! +S.6&! 2,-0! E(/+%,20! /&0! ?GG! $%&'()%&0! $6%#0&0! :L-2! K%,-$&! :&! :,.-'&2+0! :,22*0! &2! &'$/,1#2+! -2&!#$$%,.6&!0-$&%P(0*&!8#0*&!0-%!/L&2+%,$(&!'#3('#/&!;`#3I2+AC!H,-0!.6,(0(00,20!`#3I2+! .#%! (/! #! ',2+%*! :&! 8,22&0! $&%E,%'#2.&0! &2! %*0-'*! #-+,'#+(4-&! :&! +&3+&! ;a&%%(&%>! FGG?AC! "&0! 010+)'&0! 0-$&%P(0*0! 2*.&00(+&2+! -2&! K%#2:&! 4-#2+(+*! :&! :,22*&0! $&2:#2+! /L#$$%&2+(00#K&C! H,-0! #$$/(4-,20! /&0! 2,1#-3! :&! 0,-0T0*4-&2.&0! :&! .6#b2&! *+&2:-&! ;I3+&2:&:! N+%(2K! N-80&4-&2.&! c&%2&/! T! INNcA! $,-%! *+(4-&+&%! #-+,'#+(4-&'&2+! +,-+&0! /&0! $6%#0&0!:&!DU<TFGGW!&+!$%,:-(%&!0-EE(0#''&2+!:&!:,22*&0!$,-%!/L#$$%&2+(00#K&C!"LINNc!#! *+*! #$$/(4-*! #P&.! 0-..)0! $,-%! /L#22,+#+(,2! #-+,'#+(4-&! ;Q(%#,! .%' )-C>! FGGdA!9! 2,-0! /L&3$/,(+,20! :#20! /&! .#/.-/! :&! 0('(/#%(+*! &2+%&! .6#4-&! $6%#0&! .#2:(:#+&! &+! /&! %*0-'*! :&! %*E*%&2.&C! "&0! H! $%&'()%&0! $6%#0&0! 0,2+! &20-(+&! .6,(0(&0! &2! E,2.+(,2! :-! 0.,%&! :,22*! $#%! INNc! &+! *+(4-&+*&0! e!f?!g! ;$6%#0&! %*0-'*A>! &+! /&0! #-+%&0! e!T?!g! ;$6%#0&! 2,2! %*0-'*AC! H,-0! .,20+%-(0,20! /&! 010+)'&! `#3I2+! -+(/(0#2+! /&! $#.=#K&?G!`#3I2+! :&! "(2C! [,-%! :*E(2(%!
/L&3$,2&2+(&/! #P#2+! /&0! P#/&-%0! F! :#20! /&0! ',:)/&0! `#3I2+>! -2! $#%#')+%&! 0-$$/*'&2+#(%&! &0+! -+(/(0*! :#20! /&! $#.=#K&! /,%0! :&! /L#$$%&2+(00#K&C! H,-0! .,20&%P,20! /#! P#/&-%! α! .,''&! P#/&-%! $#%! :*E#-+C! "&! ',:)/&! `#3I2+! #$$%(0! &0+! -+(/(0*! $,-%! $%*:(%&! /&0! *+(4-&++&0! :&0! !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
B!D(0$,2(8/&!0-%!E+$VhhE+$C.0C8%,\2C&:-h$-8h2/$#%0&%h! O!6++$Vhh\\\C(0(C&:-hi.1/hJI!!
@!DU<TFGGW!&+!DU<TFGGB!,2+!E,-%2(!%&0$&.+(P&'&2+!RG!&+!dR!K%,-$&0!:&!:,.-'&2+0C! ?G!6++$Vhh\\\C.0C-#/8&%+#C.#hi/(2:&=h:,\2/,#:0C6+'!
!"#$%&%' ()(' )*%&#+,&%' -&%' -)((,&%' ./0123345' 6&%' +$7&8#%' -&' !#)*$*979:,' ;)##&%!)(-$(:' $8<',:9=8&::&%'!#,-9:&%'%)(:'8:979%,&%'!)8#';7$%%&#'7&%'!"#$%&%5'
>)8#'#,%)8-#&'():#&'?)-@7&'>AB.>C'()8%'$!!79=8)(%'7D$7E)#9:"?&'!"λ#'?)-9F9,'-&'G$:H9(%' %8#' 7&%' -)((,&%' -&' ./01233I' &:' ()8%' 8:979%)(%' 7&%' #,%87:$:%' -&%' !)9-%' F9($8<' !)8#' )*:&(9#' 7&%' 2J3' ?):%' -8' #,%8?,' K' !$#:9#' -&%' L33' !#&?9@#&%' !"#$%&%' M-,NK' %,7&;:9)((,&%' !$#' 7&' %O%:@?&' B$<P(:' -&' *$%&Q' -&%' E)8!&%' -&' -);8?&(:%' -&' ./0123345' R)8%' $+)(%' ,E$7&?&(:' E,(,#,' -&%' #,%8?,%' -&' 2J3' ?):%' &(' 8:979%$(:' 7&' %O%:@?&' B$<P(:' %&875' >)8#' ;)?!$#&#' 7&%' !&#F)#?$(;&%'-8'%O%:@?&'>AB.>C'()8%'$+)(%';)(%:#89:':#)9%'$8:#&%'%O%:@?&%'%8!&#+9%,%'&(' 8:979%$(:'7&%':&;"(9=8&%'*9&(';)((8&%'S'B$;"9(&%'K'+&;:&8#%'-&'%8!!)#:C'B)-@7&%'-&'B$#H)+' ;$;",%'&:'0"$?!%';)(-9:9)((&7%'$7,$:)9#&%'M#&%!&;:9+&?&(:'TUBC'VBBC'0WXQ5'
R)8%' 8:979%)(%' 7&%' ?Y?&%' MPTTZ' ,:9=8&:,%Q' -)((,&%' -$(%' 7$' !"$%&' -D$!!#&(:9%%$E&' -&' ;&%' %O%:@?&%5' R)8%' 8:979%)(%' ,E$7&?&(:' 8(' ?)-@7&' -&' #,%8?,' ()(' %8!&#+9%,' !)8#' ,+$78&#' 7&' ?)-@7&' >AB.>'[' 7&%' $!!#);"&%' %8!&#+9%,&%' %)(:' %)8+&(:' !78%' -9FF9;97&%' K' $!!79=8&#' K' -&%' &(%&?*7&%'-&'-)((,&%'$#*9:#$9#&%')\'-&%'?)-@7&%'-&'#,%8?,%'E,(,#,%'!$#'7D"8?$9('(&'%)(:' !$%' -9%!)(9*7&%5' 6D$7E)#9:"?&' -&' #&E#)8!&?&(:' Z1?&$(%' &%:' 8:979%,' !)8#' ;)(%:#89#&' 7&' %O%:@?&'()('%8!&#+9%,5'.$(%':)8%';&%'%O%:@?&%C'7&'?Y?&'&(%&?*7&'-&':#$9:%'MT&;:9)(']Q'&%:' 8:979%,'!)8#'#&!#,%&(:&#'7&%'!"#$%&%'-8'-);8?&(:';)??&'+&;:&8#%'-&':#$9:%5'
!"#
$%&'(&)*+,-&()+.&)*/(0-1-2345$-P(' ./012334C' ;"$=8&' :"@?&' &:' %)(' E#)8!&' -&' -);8?&(:%' )(:' ,:,' #&?9%' $8<' ]' -9FF,#&(:%' ,+$78$:&8#%' -8' R^T_5' 6D,+$78$:&8#' $' ;#,,' &(%89:&' 8(' #,%8?,' -&' 2J3' ?):%' =89' #,!)(-' $8' *&%)9('-D9(F)#?$:9)(%'&<!#9?,&%'-$(%'7&'%8N&:5'0&%'?87:9!7&%'`'#,%8?,%'-&'#,F,#&(;&'a'%)(:' 8:979%,%' -$(%' 7D,+$78$:9)(' -&' ():#&' ;)(:&(8' -&' #,%8?,5' R)8%' $+)(%' ;)(%9-,#,' 7&%' ?&%8#&%' -D,+$78$:9)('7$#E&?&(:'!#$:9=8,&%C'7$'!#,;9%9)('M>QC'7&'#$!!&7'MWQ'&:'7$'X1?&%8#&'!)8#'():#&' :b;"&' -D,+$78$:9)(' -&%' #,%8?,%' E,(,#,%' !$#' 7&' %O%:@?&' &(' 8:979%$(:' 7$' *)c:&' K' )8:97%' -D,+$78$:9)('$8:)?$:9=8&'WA/dP'M69(C'233]QC'=89'$',:,'$-)!:,&'!$#'./05'
!"#"6
7+.8&9&*:+,-&%0;-<*==>90,):-:?:)@.0:-6&%' :$*7&%' L' &:' 2' -)((&(:' 7&%' %;)#&%' WA/dP12' &:' WA/dP1T/' -&' :)8%' 7&%' %O%:@?&%C' &:' 7$' :$*7&'e'9(-9=8&'7&%'9(:&#+$77&%'-&';)(F9$(;&'K'fJ'g'-&':)8%'7&%'%O%:@?&%'$F9('-&'!)8+)9#'F$9#&' -&%' ;)?!$#$9%)(%' %9E(9F9;$:9+&%5' 0&%' #,%87:$:%' ?)(:#&(:' =8&' 7&' %O%:@?&' >AB.>' &%:' 7&' !78%' !&#F)#?$(:C' 7$' !78!$#:' -8' :&?!%C' !#)8+$(:' $9(%9' 7D&FF9;$;9:,' -&' ():#&' ?)-@7&' >AB.>C' K' 7D&<;&!:9)('-D8('!&:9:'()?*#&';$%LL5'6$'#$9%)('-&';&::&'!&#F)#?$(;&'&%:'-8&'$8'F$9:'=8&'-$(%'
7&';$%'-&%'$!!#);"&%'%8!&#+9%,&%'&:'()('%8!&#+9%,&%C'7&';)?!)#:&?&(:'$!!#9%'&%:'*$%,'%8#' 8(';)#!8%'-D$!!#&(:9%%$E&'F9<&'$7)#%'=8&'7&'?)-@7&'>AB.>'?&:'K'N)8#'&('!&#?$(&(;&'%)(' ,:$:' -&' ;#)O$(;&' &(' %&' *$%$(:' %8#' 7$' !#)*$*979:,' -D)*%&#+$:9)(' &:' 8:979%&' 7$' #,;)?!&(%&' )*:&(8&' !)8#' #,$N8%:&#' 7&%' !)9-%' -&%' :#$9:%' -$(%' ;"$=8&' 9:,#$:9)(' $F9(' -&' F)8#(9#' 8(' &(+9#)((&?&(:' -D$!!#&(:9%%$E&' !78%' &FF9;$;&5' P(' !$#:9;879&#C' 7D$+$(:$E&' -&' 7D$!!#);"&' >AB.>' &%:' )*:&(8' &(' !#&($(:' -&%' -,;9%9)(%' %,=8&(:9&77&%C' 7K' )\' 7&%' $8:#&%' %O%:@?&%' +)(:' :#$9:&#' 9(-,!&(-$??&(:' ;"$=8&' !"#$%&' MTUBQC' )8' ;)(%9-,#&#' %&87&?&(:' 7&%' -,!&(-$(;&%' &(:#&'7&%'!"#$%&%'-9#&;:&?&(:'$-N$;&(:&%'M0WXC'VBBQ5'
' ''''''''''''''''''''''''''''''''''''''''
LL'6&%' ;"&+$8;"&?&(:%' -&%' 9(:&#+$77&%' -&' ;)(F9$(;&' WA/dP1T/' !)8#' TUBC' B$<P(:' &:' >AB.>' 9(-9=8&(:' =8D97%' (&' %)(:'!$%'%9E(9F9;$:9+&?&(:'-9FF,#&(:%'7&%'8(%'-&%'$8:#&%5'
!
"#$%&'($! )*++(,! -./01$123! 45'($6.(! "78! 9:9;9<! 9:9;=;! 9:9;>;! ?88! 9:9;@A! 9:9BA<! 9:9B9@! C)4! 9:9=@=! 9:9;DD! 9:9;9D! 8*EF3%! 9:9;<A! 9:9;B=! 9:9;AD! G5'(3$! 9:9==B! 9:<9=H! 9:9B9H! -I8J-! 9:<H;@! 9:<9@A! 9:<<@D! K*L,(!<!M!N($!'($6.($!)IOPF5H! "#$%&'($! )*++(,! -./01$123! 45'($6.(! "78! 9:<>HD! 9:<ABH! 9:<DDA! ?88! 9:<>DB! 9:<@>@! 9:<D=;! C)4! 9:<H>;! 9:<D;=! 9:<D@<! 8*EF3%! 9:<>>B! 9:<@<<! 9:<D@<! G5'(3$! 9:<>D;! 9:<=DH! 9:<AH9! -I8J-! 9:H9;B! 9:<D>H! 9:<@BD! K*L,(!H!M!N($!'($6.($!)IOPF5"O! !
"#$%&'($! )IOPF5H! )IOPF5"O!! "78! 9:9@=;!Q!9:<9H=! 9:<HD>!Q!9:<=9>! ?88! 9:9;>;!Q!9:9B@=! 9:<>9@!Q!9:<AB>! C)4! 9:9@HB!Q!9:9B@D! 9:<<@<!Q!9:<AD@! 8*EF3%! 9:9@;<!Q!9:<9>@! 9:<H@=!Q!9:<@>@! G5'(3$! 9:9@@H!Q!9:9BA>! 9:<HD<!Q!9:<ABD! -I8J-! 9:<9=;!Q!9:<H@>! 9:<@>A!Q!9:<=@H! K*L,(!>!M!N($!13%(.R*,,($!S(!023T1*30(!U!BA!V!+26.!,($!S1TT/.(3%$!$#$%&'($! !"#"$ %&'()*)+,&-.)/01.20,.,3,45'0,.20.6),0.
J*3$! ,*! %*L,(! DW! 32%.(! '2S&,(! -I8J-! +.2+2$/! ($%! 02'+*./! *6E! $#$%&'($! S(! L*$(! X"YZ! 2TT101(,$!S(!JOC5H99=:!"Y5<!.(%26.3(!%26%($!,($!'(1,,(6.($!+[.*$($!XU![*6%(6.!S(!HA9!'2%$Z! S*3$! ,(! 0[*'+! \KF]K^! S6! +,6$! ./0(3%! S206'(3%:! N_1S/(! +.1301+*,(! S(! "Y5H! ($%! S_1`32.(.! ,(! %[&'(! 3*..*%1T! %26%! (3! `/3/.*3%! *6%2'*%1a6('(3%! S($! ./$6'/$! L*$/$! $6.! 63(! T2.'6,*%123! ?88<H:! "(,23! 0($! ./$6,%*%$W! ,(! '2S&,(! -I8J-! +.2+2$/! S/+*$$(! %.&$! ,*.`('(3%! %26$! ,($!
$#$%&'($! S(! L*$(:! N*! %*L,(! A! 13S1a6(! ,($! 13%(.R*,,($! S(! 023T1*30(! U! BAV! S($! 45'($6.($! )IOPF!+(.'(%%*3%!S(!R/.1T1(.!,*!$1`31T10*%1R1%/!S($!./$6,%*%$:!!
"#$%&'($! )IOPF5H! )IOPF5"O! "Y5<! 9:9@99>B! 9:<9A9=! "Y5H! 9:9B>;H! 9:<D@D<! -I8J-! 9:<<@D! 9:<@BD! ! K*L,(!D!M!C2'+*.*1$23!*R(0! ,($!$#$%&'($!S(!L*$(!X45$02.($Z! ! !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! <H![%%+MbbS60:31$%:`2Rb+6L$bH99D+*+(.$b1S*:023.2#:+$!!
!"#$%&'#( )*+,-./( )*+,-.!+(( !0.1( 232456(7(232586( 231229(7(2312:1( !0./( 232;:/(7(232:;2( 2318//(7(231425( <*=><( 23129;(7(231/56( 231564(7(23195/( ( ?@AB'(4(C(DE$'FG@BB'#(H'(IJEKL@EI'(M(:4(N( !"#"# $%&'()*+%,-(./0-1234(4-5/-12()4->@E#(B@($@AB'(5O(EJ$F'(#"#$%&'(<*=><('#$(IJ&P@FQ(@RS(#"#$%&'#(TRL(JE$(P@F$LILPQ(@R(>+U. /2293( V@( &J"'EE'.>+U( F'PFQ#'E$'( B@( &J"'EE'( H'#( #IJF'#( )*+,-( H'( $JR#( B'#( #"#$%&'#( P@F$LILP@E$( M( >+U./2293( V'#( #IJF'#( HR( &'LBB'RF( #"#$%&'( @R( >+U./229( W<LEX@BL(!"#$%3O( /229Y( #JE$( QX@B'&'E$( LEHLTRQ#( H@E#( B@( $@AB'3( ZJR#( IJE#$@$JE#( TR'( EJ$F'( #"#$%&'( @( @$$'LE$( H'#( #IJF'#( PBR#( QB'GQ#( TR'( B'#( #IJF'#( &J"'E#( )*+,-( H'( $JR#( B'#( #"#$%&'#( P@F$LILP@E$#( M( >+U. /229($JR$('E(FLG@BL#@E$(H'($F%#(PF%#(@G'I(B'(&'LBB'RF(#"#$%&'3(V@($@AB'(9(HJEE'(B'#(LE$'FG@BB'#( H'(IJEKL@EI'(M(:4N(H'#([.&'#RF'#()*+,-3(( !"#$%&'#( )*+,-.1( )*+,-./(( =J"'EE'.>+U( 238225( 232:44( ='LBB'RF( #"#$%&'( 2386;;( 231//;( <*=><( 238692( 231158( ?@AB'(5(C(UJ&P@F@L#JE(@G'I(( B'#(#"#$%&'#(H'(B\Q$@$(H'(B\@F$(W[.#IJF'#Y( !"#$%&'#( )*+,-.1( )*+,-./(( ='LBB'RF( #"#$%&'( 238615(7 23884:( 2311;2(7( 231/95( <*=><( 238/96(7( 2388;5( 23129;(7( 231/56( ?@AB'(9(C(DE$'FG@BB'#(H'(IJEKL@EI'(M(:4N( !"#$%&'#( ]R@BL$Q(BLEX3( ]R@BL$Q( )QPJE#'#( !0.1( 83/8( 13;5( !0./( 838;( /391( ='LBB'RF( 8311( 6382( !^=( 6362( 6342( _==( 63/2( 6312( U)[( 6322( /392( =@S-E$( 63/2( /3:2( `.&'E#( 6352( 6382( <*=><( 8322( 63;2( ?@AB'(;(C(!IJF'#(&J"'E#(H'(B@(TR@BL$Q(BLEXRL#$LTR'('$(H'#(FQPJE#'#
!"#
$%&'(&)*+,-.&,(/''/--!"#$% &'"($% )*(+% #(*% +'&,#&-."(% )&(#*,,*% .(-*($.'*% &/.(% 01&(&,2$*3% ,1*//.4&4.-+% 0*% ("-3*% &553"46*7% *(% 0*)&(0&(-% 8% 0*#9% #(.'*3$.-&.3*$% 0.5,:)+$% 0*% ,&(;#*% )&-*3(*,,*% &(;,&.$*% 0*% <#;*3=>%,&% ?#&,.-+% ,.(;#.$-.?#*% 0*$% 3+$#)+$% *-% 0*$% 3+5"($*$% ;,"@&,*$% 4"(/"3)+)*(-% 	%
0.3*4-.'*$% 01+'&,#&-."(=A%BCDEFGGHI% J&% -&@,*% K% 53+$*(-*% ,&% ?#&,.-+% )"2*((*% ,.(;#.$-.?#*% *-%
,*$% $4"3*$% 0*$% 3+5"($*$% ;,"@&,*$% 0*% -"#$% ,*$% $2$-L)*$I% !"#$% 5"#'"($% 4"($-&-*3% ?#*% ,*% $2$-L)*% MNOBM% 0+5&$$*% 0*% )&(.L3*% $.;(./.4&-.'*=P%-"#$% ,*$% $2$-L)*$% 0&($% ,&% 5,#5&3-% 0*$%
4&$7% -"#-% *(% $*% 3&553"46&(-% 0*% -3L$% 53L$% 0*$% $2$-L)*$% 0*% @&$*% *-% 0#% )*.,,*#3% $2$-L)*% *(% -*3)*$%0*%?#&,.-+%,.(;#.$-.?#*I%D*%3+$#,-&-%$1*95,.?#*%5&3%,*%/&.-%?#*%("-3*%)"0L,*%MNOBM%(*% 4"($.0L3*% #(% &,;"3.-6)*% 0*% 5"$-E-3&.-*)*(-% "#% 01"30"((&(4*)*(-% 0*% 563&$*$% 5"#3% &)+,."3*3% ,*$% 3+$#)+$% ;+(+3+$% 5&3% ,*% $2$-L)*I% D*5*(0&(-7% *(% -*3)*$% 0*% 3+5"($*% ;+(+3&,*% 0#%4"(-*(#7%("-3*%$2$-L)*%MNOBM%&%*)5"3-+%,*%)*.,,*#3%$4"3*%*(%&55"3-&(-%#(*%)*.,,*#3*% 53+4.$."(%5"#3%3+5"(03*%&#%@*$".(%01.(/"3)&-."(%0*)&(0+%5&3%,1#-.,.$&-*#3I%
0
1+,2'(3*+,-J&%4"(-3.@#-."(%53.(4.5&,*%0*%4*-%&3-.4,*%*$-%#(*%/"3)#,&-."(%*(%-*3)*$%MNOBM%0#%53"@,L)*% 0#% 3+$#)+% )#,-.E0"4#)*(-$% "3.*(-+% 5&3% #(*% -6+)&-.?#*I% D"))*% .,% (1*$-% 5&$% 4*3-&.(% 0*% $&'".3%$.%#(%3+$#)+%4*(-3+%$#3%#(%-6L)*%3+5"(0%&#%@*$".(%01.(/"3)&-."(%0*%,1#-.,.$&-*#3%"#% ("(7% ("#$% &'"($% 53"5"$+% ?#*% 4*--*% .(4*3-.-#0*% $".-% )"0+,.$+*% *(% 4"($.0+3&(-% ,&% -Q46*% 0*% 3+$#)+% 4"))*% +-&(-% #(% 53"@,L)*% MNOBMI% !"#$% &'"($% 4")5&3+% ,*% $2$-L)*% MNOBM% 53"5"$+% &'*4% ?#&-3*% )+-6"0*$% 01&553*(-.$$&;*% $#5*3'.$+*$% @.*(% 4"((#*$% R% O&9S(-7% DTU7% VWO%*-%XOOI%!"#$%&'"($%+;&,*)*(-%+'&,#+%("-3*%&553"46*%$#3%#(%)"0L,*%0*%4,#$-*3.(;%YE O*&($%("(%$#5*3'.$+I%!"-3*%$2$-L)*%MNOBM%&%0+5&$$+%,*$%0*#9%$2$-L)*$%0*%@&$*$%"//.4.*,$% *-%,*$%$4"3*$%)"2*($%0*%BCD%-"#-%*(%$1&553"46&(-%0*$%5*3/"3)&(4*$%0#%)*.,,*#3%$2$-L)*%0*% BCDEFGGHI% J*$% .(-*3'&,,*$% 0*% 4"(/.&(4*% 8% ZP[% "(-% )"(-3+% ?#1.,% (1*9.$-*% 5&$% 0*% 0.//+3*(4*% $.;(./.4&-.'*%*(-3*%("-3*%$2$-L)*%*-%4*%,+&-I%!"#$%&'"($%&#$$.%53"4+0+%8%#(*%+'&,#&-."(% &553"/"(0.*% )&(#*,,*% 0*$% 3+$#)+$% ;+(+3+$% 5&3% ,*% $2$-L)*I% J*$% 3+$#,-&-$% )"(-3*(-% ,1*//.4&4.-+% 0*% ("-3*% $2$-L)*% MNOBM% 53"5"$+*% 0&($% ,&% )"0+,.$&-."(% 0*% ,1.(4*3-.-#0*% 0*% ,&% -Q46*%0*%3+$#)+%)#,-.E0"4#)*(-$%"3.*(-+*%5&3%#(*%-6+)&-.?#*I%
M&3).% ,*$% 5*3$5*4-.'*$% 8% 4*% -3&'&.,7% ("#$% *('.$&;*"($% +-#0.*3% ,1&55"3-% 0*$% .(0.4*$% /"#3(.$% 5&3%,&%).$*%*(%/"3)*%)&-+3.*,,*%*-%5,#$%5&3-.4#,.L3*)*(-%0&($%,*$%4.-&-."($%*-%,*$%$-3#4-#3*$% +(#)+3&-.'*$I%%
4/5/62*/5/,)3-J*$%3*46*346*$%53+$*(-+*$%0&($%4*-%&3-.4,*%"(-%+-+%53.$*$%*(%46&3;*%5&3%,*%!&-#3&,%V4.*(4*$% &(0% S(;.(**3.(;% T*$*&346% D"#(4.,% \!VSTD]% 0#% D&(&0&% ^% B.$4"'*32% _3&(-% &(0% ,1C(.'*3$.-+% 0*%J*-6@3.0;*I% %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% =>%J1&44"30%.(-*3E&(("-&-*#3%0*%D"6*(%*$-%4&,4#,+%5"#3%,*$%0*#9%<#;*$%\`%a%GIb=]7%4*%?#.%-3&0#.-%#(%0*;3+%.)5"3-&(-% 01&44"30%*(-3*%*#9%\J&(0.$%*-%Y"467%=ZHH]I% =A%6--5RccdddE(,5.3I(.$-I;"'c53"<*4-$c0#4c0#4FGGHc?#&,.-2?#*$-."($I-9-%% =P%J*$%0.//+3*(4*$%$"(-%$-&-.$-.?#*)*(-%$.;(./.4&-.'*$%8%5%eIGP%*(%#-.,.$&(-%,*%-*$-%0#%-%0*%V-#0*(-I% %
!"#"$%&'%()
S.R.K. Branavan, H. Chen, L. S. Zettlemoyer, and R. Barzilay. 2009. Reinforcement Learning for Mapping Instructions to Actions. In Proceedings of the Joint conference of the 47th Annual
Meeting of the Association for Computational Linguistics (ACLIJCNLP 2009), pages 329–332,
Suntec, Singapore.
T. H. Bui, B. van Schooten, and D. Hofs. 2007. Practical Dialogue Manager Development using POMDPs. In Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue, Antwerp,
Belgium, pages 215– 218.
Y. Chali, S. A. Hasan, K. Imam: A reinforcement learning framework for answering complex questions. IUI 2011, pages 307-310
Y. Chali, S. A. Hasan, K. Imam: Improving the performance of the reinforcement learning model for answering complex questions. CIKM 2012, pages 2499-2502
E. Charniak. 1999. A Maximum-Entropy-Inspired Parser. In Technical Report CS-99-12, Brown University, Computer Science Department.
M. Collins and N. Duffy. 2001. Convolution Kernels for Natural Language. In Proceedings of
Neural Information Processing Systems, pages 625–632, Vancouver, Canada.
H. P. Edmundson. 1969. New Methods in Automatic Extracting. Journal of the Association for
Computing Machinery (ACM), 16(2):264–285. C. Fellbaum. 1998. WordNet - An Electronic
Lexical Database. Cambridge, MA. MIT Press.
L. Ferrier, 2001. A Maximum Entropy Approach to Text Summarization. M.Sc. thesis, School of Artificial Intelligence, Division of Informatics, University of Edinburgh.
T. Hirao, J. Suzuki, H. Isozaki, and E. Maeda. 2004. Dependency-based Sentence Alignment for Multiple Document Summarization. In Proceedings of the 20th International Conference on
Computational Linguistics, pages 446–452, Geneva, Switzerland.
E. Hovy, C. Y. Lin, and L. Zhou. 2005. A BE-based Multi-document Summarizer with Query Interpretation. In Proceedings of the Document Understanding Conference, Canada.
T. Joachims. 1999. Making large-Scale SVM Learning Practical. In Advances in Kernel Methods
- Support Vector Learning.
J. R. Landis and G. G. Koch. 1977. The Measurement of Observer Agreement for Categorical Data. Biometrics, 33(1):159–174.
C. Lin. 2004. ROUGE: A Package for Automatic Evaluation of Summaries. In Proceedings of
Workshop on Text Summarization Branches Out, Post-Conference Workshop of Association for Computational Linguistics, pages 74-81, Barcelona, Spain.
P. Lison. 2010. Towards relational POMDPs for adaptive dialogue management. In Proceedings
of the ACL 2010 Student Research Workshop, pages 7–12.
M. Litvak, M. Last, and M. Friedman. 2010. A New Approach to Improving Multilingual Summarization using a Genetic Algorithm. In Proceedings of the 48th Annual Meeting of the
Association for Computational Linguistics, pages 927–936. ACL.
I. Mani and M. T. Maybury, 1999. Advances in Automatic Text Summarization. MIT Press. A. K. McCallum. 2002. MALLET: A Machine Learning for Language Toolkit.
D. Pelleg and A. Moore. 1999. Accelerating exact k-means algorithms with geometric reasoning. In Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and
data mining, pages 277–281. ACM.
P. Pingali, R. K, and V. Varma. 2007. IIIT Hyderabad at DUC 2007. In Proceedings of the
Document Understanding Conference, Rochester, USA. NIST.
M. L. Puterman. 1994. Markov Decision Processes– Discrete Stochastic Dynamic Programming. John Wiley & Sons, Inc, New York.
S. Russel and P. Norvig, 2003. Artificial Intelligence A Modern Approach, 2nd Edition. Prentice Hall.
S. Ryang and T. Abekawa: Framework of Automatic Text Summarization Using Reinforcement Learning. !"#$%$&'()*+,-./01)EMNLP-CoNLL 2012, pages 256-265, Jeju Island, Korea.
F. Schilder and R. Kondadadi. 2008. FastSum: Fast and Accurate Query-based Multi-document Summarization. In Proceedings of the 46th Annual Meeting of the Association for
Comput-ational Linguistics on Human Language Technologies, pages 205–208. ACL.
S. Sekine. 2002. Proteus Project OAK System, http://nlp.nyu.edu/oak.
R. S. Sutton and A. G. Barto. 1998. Reinforcement Learning: An Introduction. The MIT Press, Cambridge, Massachusetts, London, England.
S. Young. 2006. Using POMDPs for dialog management. In Proceedings of the 1st IEEE/ACL
