Caption vs. Query Translation for Cross-Language Image Retrieval

(1)

%$'&())* +-, )* ./012!

3547698;:<8>=769?A@

BDCFEG47HJILKMCFNI-=PORQSNTOU=7HLKV4WIYX>=7NZIL6G[TX>C]\]^G_-N9X>`7C]HL\YXaIcbd=POeZf@9CFgMC]8>[h^iZf@9CFgMC]8>[h^G_%jMk

l5monimopYqUrfsWtu;vxwYuzy|{y|q}nim~fpmosP

1||

9=7HDKV4PNfb2FHY=\Y\J84PNG?76G47?7CHYCFIYHLXaC]`478hI|47\Yf\]^9IL@9CEGHYC[T=7KMX>NG4PNI%4PEGE9HY=47|@X\IY=IYH|4PNG\Y84WIYC

IY@9CA6GCFHLb2X>NIY=VIL@9C84PN9?A6G4P?AC=PO5IL@9C[T=TF69KMCFNIF=78>8aCIYX>=7N*UIL47HY?ACID84PNG?76G47?7Ck-x@9X\-=POILCFN

?7X>`7C]\HLC]\Y698aIL\47\?A=f=f[47\]^XaOxN9=PI1zCIYIYCFH^hIL@G4PNILHL47NG\J84WILXaNG?2IL@9Cd[T=T6GKC]NI=78>8>C]ILXa=AN!X>NIY=

IY@9C-69C]HYb8>47N9?76G47?7C\Y=769H|C84PNG?76G47?7CkQSNIY@GX>\ EG4PEzCFH^7QRCF`W4P8>6G4PIYC-69CFHLb1`ACFH|\J6G\5[9=fF69KMCFNI

IYH|4PNG\Y8>4PIYX>=7NMOU=AH<IL@9CQSKM47?7CW:'¡¢ ¤£7¥7¥P¦9Xa8>X>N9?76G478z4A[d@9=TDHYCFIYHLXaC]`W4P8iIL47\Y#k§QSKM47?7CDHYCFIYHLXaC]`478iX\

47|@9X>CF`AC][IY@9HL=769?A@VKV4WIL|@GXaN9?ILC¨fIY6i4P8#A6GCFHLXaC\§IY=4A\Y\Y=TX4WILC][XaKV47?7C-F47ETIYX>=7Ni\5OU=7HeIY@9C%OU=78>8a=W©x

XaN9?V84PNG?76G47?7C]\]ª59HLCFNG|@^z«CFHLKV4PNh^zZfEG4PNGX>\Y@4PNG[0Q¬IL478aX4PNkx:'4PE9IYX>=7NG\-47NG[69CFHLX>C]\4PHLCIYH|4PNi\c

8>4PIYC][6i\JX>N9?%F=7KMKMCFH|X4P8>8ab4PNG[EG6998>X>F8ab4`W4PX>8>4798aC HYC\J=A69HLFC]\]ª#A®z¯W°f±T²7³µ´f±9¶·f¸G¯f¯T¹P¶P³G²Tº<4PNG[

»

²7¼G¸TºA·i¹¯½^47NG[MHLCIYHLX>CF`W4P89EzCFHYOU=7HLKMC][6G\YXaNG?IY@9C%j¡h¬[9Xa`ACFHL?7CFNiCx8>47N9?76i4P?7CxKM=T[TCF8iE9HL=W`X[TC[

b0IL@9C¾T¸¿GÀT±dIY=f=A8afXaI]k1ÁDN!4`7C]HL47?7C©'C1ÂGNG[!69CFHLb0IYH|4PNG\Y8>4PIYX>=7NIL==769IYEzCFHYOU=7HLKÃ[9=fF69KMCFNI

IYH|4PNG\Y8>4PIYX>=7Nh^f969IIY@9X\`W4PHLXaC\47FHY=\Y\<8>47N9?76i4P?7C4PNi[069C]HYbAk

Ä ÅhÆMÇRÈ5ÉdÊÌËÍ'Ç5ÎÉÆ

Ï ?7HLC]4PI§[TC4P8T=7OiHLC]\YC]4PH||@1X\569HLHLCFNIY8>b69NG[TC]HY©x4bXaNIL@9C'ÂGCF8[=7O:<HL=A\L\§¡4PNG?76G47?7C QSN9OU=7HLKM4PIYX>=7NÐCILHYX>CF`W4P8

:'¡QcÐ%§©@9C]HYC[T=TF69KMCFNIL\ ©HYXaIJILCFNMXaNM=AN9C8>47N9?76i4P?7C47HYCxHLCIYHLX>CF`7C[fb4A6GCFHLb1©HYXaIJILCFNMX>Nd4PN9=7IY@9C]H-\YCFC7^

C7k?GkÃÑaÒÓ14PNG[ÔÑ£ÓUkÕÁDN9CF4PNÖ=7Ni\JX[TCFH:'¡hQcÐ×47\di47\YX>]4P8>8abØ4F=7K9XaNi4WIYX>=7NØ=7O1KV47|@9X>N9CÌILHL47NG\Y8>4PIYX>=7N

ÙÚ-47NG[¤ILHL4A[TXaIYX>=7NG478<KM=7NG=78>XaN9?A6G4P8'X>NTOU=7HLKV4WIYX>=7NHYCFIYHLXaC]`478UQcÐ%k§ÙÌ=A\JId:'¡QcÐÛHLC]\YC]4PH||@¤@G4A\OU=TF6G\JC[

=7N8a=TF4PIYX>N9?!47NG[¤CF¨fEG8a=AXoILXaN9?ÌIYH|4PNG\Y8>4PIYX>=7N¤HLC]\Y=769H|C\1©XaIY@*©@GX>|@IY@9C26G\JC]HL\\YC]4PH||@HYC69C]\JIL\=7HIL4PHL?7CFI

[T=T6GKC]NIL\U=AH'z=PIL@i'4PHLC-ILHL47NG\J84WILC][XaNIY=IY@GC\L4PKMC8>47N9?76i4P?7CÑÜPÓk5Ù=AN9=78>XaNG?76G478#47E9E9HL=A4A|@9C]\<F4PNIY@9C]N

6G\YC][2OU=7HHLCILHYX>CF`W478}k

x@9C]HYCÌ47HYCÚ4PI8>C]47\JIdIL@9HYC]CÌKMCIL@9=T[9\dOU=AHdILHL47NG\J84WILXa=ANhªÝJÒd9Xa8>X>N9?76G478D[TXILXa=ANG4PHLX>C]\]^£7dC¨fIYH|47IYX>N9?

©'=7H|[iÞE9@GHL4A\JCCA6GXa`W4P8>CFNI|\%OUHL=7KÃEG47HL478a8>CF8R=7H=AKMEG4PH|4P98>CF=7HLEi=AHL4G^i47NG[}ÜA%6G\JX>N9?4ÙÌ4A|@9X>N9C;H|4PNG\Y8>4P

IYX>=7NßÙÚ-D\YbT\cILCFKk

Ï

[T`W4PNI|4P?7C\D47NG[[TX>\L47[9`47NIL4P?AC]\DC¨TX\cIOU=7HC47|@!47E9E9HL=A4A|@h^#XaNGF8a6i[TXaNG?2IL@9CV[TCF?AHYC]C

=POx8>XaN9?A69X\cILX>MHLC]\Y=769H|C\4PNG[fN9=W©8>C][T?ACHLC]69X>HYC[ÌOU=AHIYH|4PNi\J84WILXa=ANhkdB%XILXa=ANG4PHLbi47\YC][ÌKMCFIY@9=T[9\1[9=7KMXo

NG4PIYC69C]HYb0ILHL47NG\J84WILXa=ANh^z96TIIY@9C\JC=POILCFNÌHLC]69X>HYCC¨fIYC]NG\YXa`AC84PN9?A6G4P?ACE9HY=TFC]\L\JX>N9?VIL=0[TC4P8R©XoIL@ÚX\Y\Y69C\

\Y6G|@d47\ 8aCF¨fXF478i47K9X>?769XaIcb7ÂKM=7HLE9@9=78>=7?AX>]4P8T`W4PHLX4WIYX>=7NÂ=AHJIL@9=7?AHL47E9@fb7ÎY=A7C]N9X>\L4WILXa=ANV4PNG[dF=7KMEz=769NG[M©'=7H|[

\YE98aXaIJILXaNG?Gk*ÙÌÛ47E9E9HL=A4A|@9C]\@G4`7C2E9HY=W`ACFNIL=!zC2Ez=7EG698>47HX>NàHYCCFNIb7C]47HL\[T69C2IY=!IY@9C4`W4PX>8>479X>8aXaIcb=PO

=7N98>XaNGCÙÌÖ\JbT\JIYC]KM\x©@GX>|@0F4PN0zCCF¨TE98a=AXoILC][OU=7H69CFHLbMIYH|4PNi\J84WILXa=ANákex@GCÙÚ\Ybf\JIYC]KÛF47N2=7OIYCFN0zC

IYHLC]4PIYC[47\x4ÚâJ9847|Mz=¨Tã©@9C]HYC4\YX>N9?78>C-ILHL47NG\J84WILXa=ANdX\xE9HY=W`fX[TC][VOUHY=AK(IY@9CX>N9E96TI-69CFHLb7k§x@9X\F47NzC

4[TX\Y4A[T`W4PNIL47?7C'OU=7He69C]HYbILHL47NG\Y8>4PIYX>=7N©@9CFHLC\J@9=AHJI^P69N9?AHL47KMKM4PIYXF478f69C]HYX>C]\5]4PNMzCKX\JIYH|4PNG\Y8>4PIYC[[T6GC

IY=8>XaKMXaIYC[!F=7NIYCF¨Ikä%=W©<C]`7CFH^#4PN47[T`W4PNI|4P?7C=POxÙÌKMCIL@9=T[9\X>\IL@G4WI8>XoIYIY8>CM=7HN9=2OU69HJIL@9CFH8>X>N9?769X\JIYX

E9HL=TC]\L\YXaN9?=7HHLC]\Y=76GHLFC]\'4PHLCNGC]C\Y\L4PHLbMIY=ME9HL=T[T6GFC6i\Y4798aC:'¡QcÐÖ\YbT\cILCFKV\\YCFCA^9C7k?GkÑ¦PÓUk

QSN[T=T69KMCFNIIYH|4PNi\J84WILXa=ANh^#IY@9CVC]NIYX>HYCV=A8a8>C]IYX>=7N!X>\ÂGH|\JIILHL47NG\Y8>4PIYC][ÚE9HLXa=AHDIL=\JC4PH||@9XaNG?Gk3 HYC]`fXa=A6G\

HLC]\YC]4PH||@fb¤Á47HL[ØÑåÓ\J@9=W©'C][IL@G4WIOU=7HM«CFHLKM47Nfæf¢ N9?78>X\J@¤Ð-¢x: ¬ç[94PIL4G^eÙÌ'i47\YC][¤69CFHLb!IYH|4PNG\Y8>4P

IYX>=7N=76TIYEzCFHYOU=7HLKMC][`W4PHLXa=A6G\[9X>IYX>=7NG47HYb¬G47\YC][!KMCIY@G=f[G\F^e47NG[*[T=T6GKC]NIIYH|4PNi\J84WILXa=AN¤=76TIYEzCFHYOU=7HLKMC][

ÙÌµ69C]HYbMILHL47NG\Y8>4PIYX>=7Nh^C]\YEiCX4P8>8abOU=AH'8>=7NG?7CFHx69CFHLX>C]\]kRÙÌ:'4PHL8aC]bÑçPÓ\Y@9=W©'C][MIL@G4WI'OU=7HGHYC]NG|@fæf¢ N9?78>X\J@

èYé]êcêëì>íîhêSïð|ñòóôêë]õöê5ó÷ð|îøê5ùFúñ'ûPêcîhí|ì9üúûñýôü}üýôíùüýôùþ#ÿ öýöúõ}ýôóôýôüê%íùóôýôùê0ü]ü}õ}êJñü

(2)

CFNiC][ÚfbIY@9CM[TX>HYCILXa=ANÚ=PO<IYH|4PNG\Y84WIYX>=7NÝ9HLCFNi|@fæf¢ N9?78>X>\Y@ÌEzCFHYOU=7HLKMC][ÌzCIYIYC]HDIL@G4PN¢eNG?78>X>\Y@fæfGHYC]NG|@OU=AH

69CFHLbd4PNi[[T=T6GKC]NI'ILHL47NG\Y8>4PIYX>=7NikRG6cXaX;4PNG[Qc\J@9X>W4©'42ÑÓhE9HYC\JC]NIYC][241Ic©'=PS\JIL4P?AC-KMCIL@9=T[©@9C]HYCX>N9Xo

IYX4P8#HLCILHYX>CF`W4P8z©x47\ ÂGHL\JI<EzCFHYOU=7HLKMC][6G\JX>N9?A6GCFHLbILHL47NG\Y8>4PIYX>=7Nh^IY@GCFNdIL@9CDIY=7E!Ò]¥A¥7¥1[T=TF69KMCFNIL\<IYH|4PNi\J84WILC][

X>NAIL=IY@GCD69CFHLb8>47N9?76G47?7C6G\YX>N9?ÙÌ^7ÂGNG4P8>8>b[T=TF69KMCFNIL\<HYCFH|4PNG7C][G4A\JC[M=7Nd4ILHL47NG\J84WILXa=ANd\YF=7HLC7kRx@9X>\

KMCIL@9=T[2©x47\\Y@9=W©N2IY=M=769IYEzCFHYOU=7HLKÕ69CFHLbVIYH|4PNi\J84WILXa=AN24P8>=7NGC47NG[2iC©'CF8>8\Y69XoILC][2IY=M84PHL?7C=A8a8>C]IYX>=7NG\]k

Ï

[9`47NIL4P?AC]\<=PO§[T=T69KMCFNIxIYH|4PNi\J84WILXa=ANX>NG8>6G[TCAª-cÒ<N9=M69CFHLbMIYH|4PNi\J84WILXa=ANX\xHYCA6GXaHLC][d4PIHY69N9}ILXaKMC7^

4PNi[µ}£AN9=ÚOU69HJIL@9CFHIYH|4PNi\J84WILXa=AN¤X>\HYC69XaHLC][©@GCFNEGHYC\JC]NAILXaNG?IY@9C2HYC\J6G8oI|\1IL=ÌIY@GC26G\YCFHkÚä%=W©<C]`7CFH^§4

KV4c=AH [TX\Y4A[T`W4PNIL47?7CX\5IY@i4WIeILHL47NG\J84WILXa=ANM=PO8>47HY?AC-=A8a8>C]IYX>=7NG\5X\<C¨TEiC]NG\YXa`ACi=7IY@dX>NMIYX>KMCD4PNi[MHYC\J=A69HLFC]\]k

9=AHCF¨94PKME98>C7^<Á4PH|[µÑåÓ-\JEzCFNIIYC]NKV47|@9X>N9CFKM=7NIL@G\1ILHL47NG\Y8>4PIYX>N9?IY@GCZTB Ï Þ µ«C]HYKV47N=A8a8>C]IYX>=7N

}£AåTÒA^7¦A¥1NGCF©-\Y©XaHLC4PHYIYX8>C]\|k

ÁDN9C147HYC4M=PO<:'¡hQcÐHLC]\YC]47HL|@0©@9X|@@G47\%HYCCFX>`7C[08aC\Y\D4WIJILCFNIYX>=7NX\-X>KV4P?ACHYCFIYHLXaC]`478}kxQSNÌF=78>8aCIYX>=7Ni\

\Y6G|@Ý4A\@9X\JIY=7HLX=AH\JIY=T|EG@9=PIL=7?7H|4PEG@9X>4PH||@9Xa`AC]\]^§KC[TXF4P8]47\YC2N9=7IYC\47NG[47HJIÞ@9X\JIY=7HLb=78>8>C]ILXa=ANG\]^

X>KM47?7C\ 4PHLC%4AF=AKMEG4PN9X>C][MfbM\J=AKMC%fXaNi[V=POILC¨fIC7k?Gk§KMCIL4P¬[G4WIL41=7H<]4PETILXa=ANG\|5\JC]KV4PNIYXF478a8>bHLCF84WILC][IL=

IY@GC%X>KM47?7CÑ£WÓRÑaÒ£Ó¬k§QSKV4P?7C\ ]4PNMIY@GCFNzC%HLCILHYX>CF`AC][M6G\YX>N9?\JIL47NG[94PH|[IYCF¨fIJ¬G47\YC][MQcÐKCFIY@9=T[9\]k59=AHeIY@G=A\YC

=7HL?A47N9X\Y4PIYX>=7NG\DKV4PNG47?7X>N9?XaKV4P?ACMHYC]Ei=\JXaIY=AHYX>C]\X>N¤©@9X>|@!IYCF¨fIX>\47\L\J=TX4WILC][Ú©XoIL@¤XaKV4P?AC]\VC7k?Gkd=ANT8>X>N9C

4PHYI?4P8>8aC]HYX>C]\|^§=7NGC©x4bÚIL=ÚC¨TE98>=7XaIIL@9C]\YCX\bCFNi4P98>XaNG?ÚK6G8oILXa8>XaNG?76G478'4AFC\Y\1IY=ÚIY@9C]K0k¤«X>`7CFN*IY@G4PI

X>KM47?7C]4PETILXa=ANG\4PHLCIcbfE9X>]4P8>8ab0K6i|@Ú\JKV478a8>CFH%IY@G47NÚ\cI|4PNG[G4PH|[0IYC]\JIJS=A8a8>C]IYX>=7NÌ[T=TF69KMCFNIL\]^#XoIX>\%OUC]4A\JX>98>C

IY=MEzCFHYOU=7HLK[T=TF69KMCFNIxIYH|4PNG\Y8>4PIYX>=7Nh^TC]`7C]N2=AN284PHL?7C]H'X>KV4P?ACF=78>8aCILXa=ANG\Fk

QSNIL@9X>\DEG47EiC]HDQ-F=7KMEG4PHLC69C]HYb4PNG[Ú[T=T69KMCFNIDIYH|4PNG\Y8>4PIYX>=7NOU=AH4dFHY=\Y\J¬8>47N9?76G47?7CX>KM47?7C1HLCILHYX>CF`W478

IL4A\JG47\YC][=7NÝIY@9CÌZIk

Ï

NG[THLCF©-\VF=78>8aCIYX>=7Nà=PO@9X\cIL=7HLX>2E9@9=7IY=7?AHL47E9@G\4PNG[IY=AE9XF\OUHL=7K IL@9CQSKM47?7CF

:'¡¢<µ£P¥A¥P¦4A[Ì@9=THYCFIYHLXaC]`478I|47\Y#k1x@9X>\EG47EiC]H[TXa`fX[TC]\X>NIY=dIL@9COU=78>8a=W©X>N9?iª%\JCILXa=AN!£[9C]\LHLXazC]\DIY@GC

C¨TEzCFHLXaKMC]NAI|4P8h\YCIL69Eh^G\YC]IYX>=7NÜ[9C]\LHLXazC]\'IL@9CHYC\J6G8oI|\F^947NG[\JCIYX>=7N0¦V=ANG8>6G[TC\'IY@9X\C¨TEzCFHLXaKMC]NAIk

-ÈeÎ%ÆÇÇ§Ë

QSN¤IL@9X>\M\YC]IYX>=7N*Q1[TC\YFHYX>zCdIY@GC2CF¨fEzCFHLX>KC]NIL4P8'\JCFIY69EÝXaNi8>6G[TX>N9?ÌIL@9C2QSKV47?7C:'¡;¢ IYC\cIM=78>8>C]ILXa=ANh^§IY@GC

¾T¸¿9ÀT±ÌHLCILHYX>CF`W478 \JbT\JIYC]K0^RIL@9C2A®z¯°f±9²7³!4PNi[

»

²7¼G¸TºA·i¹¯½ÌÙÌ47|@GXaN9C2H|4PNG\Y84WIYX>=7N!IY=f=A8>\]^54PNG[¤4A[9[TXaIYX>=7NG478

84PN9?A6G4P?ACDE9HL=TC\Y\YXaNG?6G\YC][2OU=AH-HL=A\L\c¬8>47N9?76i4P?7C%HYCFIYHLXaC]`478}k

"!# $%'&)(+*-,./&013245 76/6/8:9;=<?>A@$B&DC+E0F>HGIGJ&D@KEML>HN

x@9CQSKV4P?7CW:'¡¢<£7¥7¥7¦47[d@9=T%ILC]\JIxF=78>8aCILXa=AN2=ANG\YX>\JIL\<=PO;4[T=T6GKC]NIF=78>8aCILXa=ANh^4\YCIx=PO;6i\JC]H<N9C]C][9\

C¨TE9HLC]\L\YC][0XaNz=PIL@ÌNG4PIY69H|4P8h84PNG?76G47?7C14PNi[2©XaIY@!4PNC¨TC]KEG8>47H-XaKV47?7C7^z4PNG[0OU=AH-C]4A|@6G\YCFH-N9C]C][4d\YCID=PO

HLCF8>CF`W4PNGFCOc6i[T?7C]KC]NIL\dÑÓ¬kd=AE9X>]\4PNG[!HLCF8>CF`W4PNGFCOc6i[T?7C]KC]NIL\147HYCE9HL=W`X[TC[ÌOU=AH14PN47[!@9=THLCILHYX>CF`W478

IL4A\J©@GX>|@!X>\DIY@GX>\]ªD?AXa`ACFN4K698oILXa8>X>N9?76G4785\cI|4WIYC]KMCFNI1[TC]\LHLXaGXaN9?046i\JC]HNGCFC][h^#ÂGNG[47\KV4PNfbHYC]8aC]`W4PNI

X>KM47?7C\ 47\<Ez=A\L\JX>98>C-OUHL=7K IY@9C[T=T69KMC]NAIx=A8a8>C]IYX>=7Nhk5x@9X\ HLCILHYX>CF`W4789IL4A\JV\YXaK6984WIYC\ ©@GCFN46G\JC]H X\<4798>C

IY=!C¨TE9HLC]\L\IL@9CFX>HNGCFC][*XaNÝNG4WIL69HL478 84PN9?A6G4P?AC7^R96TIMHYC69XaHLC]\4Ì`fX\J6G478<[T=TF69KMCFNIIL=ÌOU698aÂG8'IY@GCFX>H\YC]47HL|@

HLC]69C]\JI]k

x@9C[T=T69KMC]NAI=A8a8>C]IYX>=7N0=7Ni\JX\cI|\ =7OR£PG^aÒÜ7ÜX>KV4P?AC]\ OUHY=AK(IY@9C1ZI Ï NG[9HYC]©-\'¡XaGHL47HYbME9@9=7IY=A?7H|4PE9@9X

=A8a8>C]IYX>=7NRQ4PNi[4P8>8#XaKV47?7C]\<@G4`ACD4PN047]=7KMEG47NfbX>N9?ILC¨fIY6i4P8[TC]\LHLX>ETIYX>=7N0=7Ni\JX\cILXaNG?=POS[TX\JIYX>NGIxÂGC]8>[9\

\YCFCA^]CAk?ik;RX>?769HLCÒk;x@9C\JC§ÂGC]8>[G\F47NiCe6i\JC[XaNG[9Xa`fX[T6G4P8>8>b%=7H;=78>8>C]ILXa`ACF8>b-IL=xO47X>8>XoI|4WIYC XaKV4P?AC5HYCFIYHLXaC]`W4P8k

x@9C£PG^aÒÜ7ÜF47ETIYX>=7Ni\;F=7NG\YX>\JI;=7OG¦7¦i^¥+Aå<ILCFHLKM\§47NG[VÒ7^ÜP¦T9^¦UW¦©<=AHL[=TFF69HLHYC]NGC\WVIL@9C<KV4P¨fX>K6GK]4PETILXa=AN

8>CFN9?7IY@MX>\5ÜGÒ]çD©<=AHL[G\F^W969I =7NM4`7C]HL47?7C ¦T%©'=7H|[9\RX>N8>CFNG?PIY@k Ï 8a8iF4PE9IYX>=7NG\§4PHLCx©HYXaIJILCFNMX>NYX'HLXoILX>\Y@M¢eN9?A8aX\J@^

4P8aIY@G=769?A@IY@9C<8>47N9?76i4P?7C<4P8\J=%F=7NIL47XaNi\=A8a8>=T69X>478ACF¨TE9HYC\Y\YX>=7NG\]k Ï E9EGHY=¨TX>KM4PIYC]8ab9ÒZµ=7OGF47ETIYX>=7NG\R=ANIL4PX>N

IYCF¨fIXaN478a87ÂGCF8[9\]^FIL@9CeHLC]\JIh?7CFNGCFH|4P8>8ab-©XaIY@G=76TIIL@9C [TC\YFHYX>ETIYX>=7NÂGC]8>[hkQSNKM=A\JIF4A\JC\zIY@9CeX>KV4P?ACe[TC]\LHLXaE9IYX>=7N

X\140?7H|4PKMKV4WIYXF478e\JC]NIYCFNiCM=PO4PHL=769Ni[Òå0©<=AHL[9\]kVx@9CVKV4c=AHYXaIcbÌ=POxX>KM47?7C\V[A£TZ4PHLCX>N9847|Ú47NG[

©@9XaIYCA^G4P8aIY@9=A69?7@=A8a=A69HxXaKV47?7C]\47HYC4P8\Y=EGHYC\JC]NAIX>N0IY@9C1F=78>8aCIYX>=7Nk

x@9C£P¥7¥7¦IYC\cI=A8a8>C]IYX>=7NdF=7NG\YX>\JIL\<=PO§£7å69C]HYX>C]\IL=7E9XF\| [9C]\YXa?AN9C][MIL=\YXaK6984WIYC41H|4PN9?AC-=PO;HYC4P8>X>\JIYX

\YC]4PH||@0HYCA6GC]\JIL\IL=d4dHL=A\L\84PN9?A6G4P?ACXaKV4P?ACHYCFIYHLXaC]`W4P8\YbT\cILCFKk¢eN9?A8aX\J@`ACFH|\JX>=7NG\-=PO§IY@9C1IY=7EGX>]\%=ANG\YX>\JI

=POh4ILXoIL8aC}41\Y@9=7HYI \JC]NIYCFNiC=7H E9@9H|47\YC-[TC]\LHLXaGXaN9?IL@9C%\YC]47HL|@HYC69C]\JIeXaNd4OUCF©ß©<=AHL[G\L^74PNG[V4Ni4PHLHL4PIYX>`7C

4[TC]\LHLXaE9IYX>=7N=PO5©@G4PID=ANG\cILXoIL6TIYC\%4MHLCF8>CF`W4PNI-=AH-N9=7N9HLCF8>CF`W4PNI-X>KV4P?7COU=AHIY@i4WID\YC]47HL|@HLC]69C]\JI|k'x@GC

(3)

/021$34 $5 ".

6 1879 1: (;<! $# =">%?@)

A CB 73

ED2 1:

(FGH%?@%IGJ "@ "K " "LMN@)K)O%P+Q " "4R@=S ,%,

+Q@H%?="@>%(+I%UTK+Q@%?=TV=UT*@)O@)*OW$@%I="@X*T*@)*)X&=S ,%?,Y*X @)C%U "

J*@=S& ?X8.

A 9 " (="@Z.

á[\\

] 021 1$^$39 D 0 3 -_CT*)K;$@+Q "@>%?T* "

`9 , ^$1*3 CBKa!b>cd"egfhb>i,ji,kldmnapo,q>i,j>roeoi"qsld>i"m

apt,r2uv"jq"ki,wCx> yc,kr>kl>orx"ma!z>cdd>i>{ro"c,jhf}|h~}zc,wo"i"m

1 ,CBVp;

Q\ Q

X$=QH

á Q|á

á>[\

J @

@) =" J*N@S "QJ ,! %?*) )*X*! ") @E*@%? "(Q %?& @)OG%?T

)*S&#Z%I'() * ,+-,Y$! "n@) O! -%?N "Q+I) ) "I<%?T* X ")

nT @NX ) T*X8Y !@%?T "->G*) N

á>á

á

.<'I

#Z%? *NX$H%??@%,.

RX>?769HLCMÒ7ª Ï NCF¨94PKME98>CX>KV4P?AC47NG[0F4PE9IYX>=7N2OUHY=AK IY@9CQSKV47?7C:'¡;¢ *F=78>8aCILXa=AN

IYXaIY8>C]\M=7O%C]4A|@¤IY=AE9X2@i4`7CzCFC]NILHL47NG\Y8>4PIYC][*XaNIY=àÒ£Ì8>47N9?76i4P?7C\Fª0ZfEG4PNGX>\Y@h^eQ¬I|4P8>X>47Nh^<«CFHLKV4PNh^<9HLCFNG|@h^

BD6TIL|@h^TB4PN9X\Y@h^fZT©<C[TX>\Y@h^;X>N9N9X\Y@h^G:<@9XaNGC]\YC7^A47EG4PN9C\JCA^7Ð6G\L\YX>47Nd4PNG[ Ï HL479X>xfbNG4WILXa`AC%\YEiC4P7C]HL\]k;x@GC

IYC\cI-F=78>8aCIYX>=7N4P8\Y=F=7NG\YX>\JIL\'=7OR4M\JCFI=PO;HLCF8>CF`W47NGC c6G[T?ACFKMCFNIL\'OU=AHC]4A|@dIY=AE9XDi47\YC][2E9HYX>KV4PHLXa8>bV=7N2IY@GC

X>KM47?7CA^T96TI%4P8\Y=M4A\Y\YX\cILC][dfbIY@9CX>KV4P?7C]4PETILXa=ANhk

"! $%'&n &E LJ& ,7G¢¡K£'C+E&D*

QSN0IY@9C¾f¸¿GÀT±VXaKME98>CFKMC]NAI|4WILXa=AN0=7O58>47N9?76G47?7CKM=f[9CF8>8aX>N9?MOU=7H%QcÐ^G[T=T6GKC]NIL\-47NG[A6GCFHLXaC\-4PHLC`X>CF©'C][4A\

=7i\JC]HY`W4WILXa=ANG\#OUHL=7K?7C]N9CFH|4WILXa`AC569N9X>?7H|4PK8>47N9?76G47?7C5KM=T[TCF8\ }\JC]C7^C7k?Gk'Ñ¤PÓ7OU=AH;KM=7HLC5X>NTOU=7HLKV4WIYX>=7Nzk4¥D6GCFHLXaC\

4PNi[[T=TF69KMCFNIL\547HYC'HYC]E9HLC]\YCFNIYC[147\§C\cILXaKV4WILC][8>47N9?76i4P?7C<KM=f[9CF8\§©XoIL@©'=7H|[1E9HL=7i4P9X>8aXaIYX>C]\§[TC]HYX>`7C[OUHL=7K

IY@GC'[T=TF69KMCFNIL\]^P69CFHLXaC\;47NG[IL@9C'F=78>8aCILXa=AN47\R4-©@G=78>C7k;x@GC<C\cILXaKV4WILC][169C]HYb47NG[[T=TF69KMCFNIR84PNG?76G47?7C

KM=T[TCF8\8¦§¨ 4PNG[©¦§8ª HLC]\YEiCIYX>`7C]8ab9x47HYC1F=7KMEG4PHLC][47NG[HL47N97C[06G\JX>N9?VIL@9Cj¡h¬[9Xa`ACFHL?7CFNiCKMC]47\Y69HLC7^G47N

4PEGE9HY=47|@©@9X>|@MF47NMiC8>XaACFN9C[1IL=IY@9C`AC]IY=7HYS\JEG4AC<K=T[TC]89=PO#HLCIYHLX>CF`W4P8T©@9C]HYC69C]HYX>C]\547NG[[9=fF69KMCFNIL\

4PHLCHYC]E9HLC]\YCFNIYC[dfbd`7CIL=7H|\<H|4WIL@9CFHxIL@G4PN84PN9?A6G4P?ACDKM=T[TC]8>\]k

QSNMIY@GC]\YC%C¨TEzCFHLXaKMC]NAI|\F^AIY@GCDj¡S[TX>`7C]HY?ACFNGFC'84PNG?76G47?7CKM=T[TCF8zX>\ 6G\YC][V©XaIY@VIL@9CD47G\Y=78>6TIYC%[9X>\L=A69NIYX>N9?

KMCIL@9=T[µ=PO\YKM=f=PIY@GXaN9?U«¬ ¥Q®Pk ¾T¸¿GÀf±à=P#CFH|\69C]HYbßCF¨fEi4PNG\YXa=ANØfbµ\J69EGE98aC]KMCFNIYX>N9?*IL@9CXaN9XaIYX4P8

69CFHLb©XoIL@=A8a8>C]IYX>=7NTS\JEzC]FXoÂz'IYCFHLKV\e=ATIL47XaN9C[OUHY=AK 4OUCFC[TG47|KM=f[9CF8kRQSNdIY@9C\JC-CF¨TEiC]HYX>KMCFNIL\]^4Ic©<=7

=AKMEi=AN9CFNI%KMXa¨IL69HLCKM=T[TCF8;X>\%6G\JC[IY=C]\JIYX>KM4PIYC©<=AHL[0E9HL=7G479X>8aXaIYX>C]\X>NIL@9C1OUC]C][TG4A|2KM=T[TC]8}k-BDCO47698oI

EG47HL47KCFIYC]H`478a6GC]\%47HYC6i\JC[0OU=7HIL@9C1OUC]C][TG4A|KM=T[TCF8ª¯°¬²±³¬¥Q®ôåT^9©XaIY@!£7¥IYC]HYKV\-\YCF8>C]IYC][0OUHL=7KIY@GC

IY=AE¤Ò]¥V[T=TF69KMCFNIL\%HYCFIYHLXaC]`7C][2OUHL=7KÕIY@9C1X>N9XaIYX4P8§69CFHLb!EG\JC]6G[T=dHLCF8>CF`W47NGCOUC]C][TG4A|=AH%3 Ð-5^G©XaIY@=7NGC

OUCFC[TG4A|dXoILCFH|4WILXa=ANhk

"!U´ $µM,7NOCUGJ,SEMLJ> N¶ &DCT>M·}R@ &DC

QSN0IY@9C\JCC¨TEiC]HYX>KMCFNIL\]^TILHL47NG\J84WILXa=AN2X\EzCFHYOU=7HLKMC][06G\YXaN9?MIL@9CA®z¯°f±9²7³4PNG[

»

²7¼G¸fºA·z¹¯½KV47|@GXaN9CILHL47NG\J

84WIYX>=7N}ÙÌ-RHYC\J=A69H|C]\]k;x@GC=7HLXa?AXaNG478T¢eN9?A8aX\J@V]4PETILXa=ANG\§©<C]HYC'ILHL47NG\J84WILC][XaNIL=«CFHLKM47Nh^AGHYC]NG|@h^PQ¬I|4P8>X>47N

4PNi[ZTEG4PN9X\Y@26G\YX>N9?A®i¯W°f±9²7³ß´f±9¶·T¸9¯f¯T¹P¶7³9²Tº*´f±T¸¿;¹À7¿¸º¹>»©@9X|@0IY=f=724Pz=76TID£@9=A69HL\'OU=AH-C]4A|@284PN9

?76i4P?7C'EG47XaHC¼Wk§9=7H569C]HYbILHL47NG\Y8>4PIYX>=7N

»

²7¼G¸fºA·z¹¯½DOUHL=7K

Ï

8oI|4g½DX>\JIL4©x47\R6G\YC][k§x@9X\ROUHYC]C<=ANT¬8aX>N9CxHYC\J=A69H|C

X\;Ez=W©'CFHLC][1fbA®z¯W°±9²7³%IL@9CFHLCFfb1478a8>=W©XaNG?D=AKMEG4PHLX>\Y=7NiCFIc©<C]CFNMA6GCFHLb47NG[[T=T69KMCFNIRIYH|4PNG\Y84WIYX>=7N©XoIL@

IY@GC1\Y47KCHLC]\Y=769H|CAk

¡hX>7C4PNfbOU=7HLK =PO IYH|4PNG\Y8>4PIYX>=7N!KCFIY@9=T[^hÙÚ F47NÚHLC]\Y698aIX>N!C]HYHL=7NGCF=76i\%69CFHLX>C]\iCF476G\JC=PO'[TXogdF698o

IYX>C]\C]NG=A69NIYCFHLC][[T69HLXaN9?ÚIYH|4PNG\Y84WIYX>=7N¤X>NGF8a6G[9XaN9?iª2\Y@9=7HYI69C]HYX>C]\HLC]\Y698oILXaNG?ÚX>N8>XoIYIY8>C2XaO%N9=AN9C0\YbfNIL47IYX

\JIYHL6GIL69HYCIL=dC¨TE98>=7XaI]^GCFHLHY=AHL\xX>NIY@9C=7HLXa?AXaNG478hHL=A\L\x8>47N9?76i4P?7CILC¨fIUCAk?ik<\YEiC]8a8>X>N9?dKMX>\JIL477C\=7HX>NG=AHYHLC]I

KMX>\JIYH|4PNG\Y8>4PIYX>=7NÝ=POE9HY=AEiC]HVNG4PKMC\F^x4PNG[àX>NG=AHYHLC]IMIYH|4PNG\Y8>4PIYX>=7Nà=PO4PK9Xa?A69=76i\©'=7H|[9\C7k?Gk\YCF8>C]IYX>N9?

IY@GC©HL=7N9?\YCFNi\JC1=7O 4VN9=A69NÌ=7HD`7C]HYik%x@9CC#C]I=PO5ILHL47NG\J84WILXa=ANCFHLHY=AHL\x=ANÌHLCIYHLX>CF`W4P8;EiC]HJOU=AHYKV4PNiCOU=AH

QSKV4P?AC:'¡¢<*£P¥A¥7ÜIY=7EGX>]\xX>\-[9X>\L6G\L\YC][2XaN¤ÑaÒ]¥Ó¬ke9=AHK=AHYCX>NTOU=7HLKV4WILXa=AN2=ANZfbT\JIYH|4PNh^9\YCFCCAk?ikxÑaÒ7ÒFÓk

þhð|ò]õýôíùü êcîê§õ}î¬ð|ùüó÷ðLõ}ê û g¿ý÷ð|ùÀFý÷ð|ùøOÁð|ùø-ð|ù ÃÂRíúø}Ä§ð|îDðLõ ð|î]ó÷ð|ù ÆÅùýgêcîü}ýõW`

(4)

CL topics English captions

Snowball Remove

SYSTRAN/

Babelfish

& retrieval Indexing Lemur recode UNIX

Normalisation

Stopwords Stemming

Translation

RX>?769HLC1£Tª5x@9C1FHY=\Y\J84PNG?76G47?7C-HLCILHYX>CF`W4P8EGHY=TC\Y\

"!8 $%'& & ERLJ& ,7GM>A@ &DCUC

«X>`7CFNÝK698aIYX>8>XaN9?A6G4P8-]4PETILXa=ANG\M4PNG[Ý69CFHLXaC\F^ ©<C=AKEi4PHLC269CFHLb¤`7C]HL\Y6G\[T=T69KMC]NAIMILHL47NG\J84WILXa=AN*6G\YXaNG?

IY@GCÌHL=A\L\c¬8>47N9?76i4P?7CHYCFIYHLXaC]`478E9HL=fFC]\L\M\J@9=W©NàX>NßRX>?769HLCÌ£Tkµ«X>`7CFNßK698oILXa8>X>N9?76G478xIY=AE9X>]\MIY=ILHL47NG\J84WILC

X>NAIL=Ì¢eN9?A8aX\Y@h^;=AH¢eNG?78>X>\Y@¤F4PE9IYX>=7NG\IL=IYH|4PNi\J84WILCX>NIY=ÚGHYC]NG|@h^5«CFHLKV4PNh^RQ¬IL478aX4PN=7HZfEG4PNGX>\Y@h^R©<CMÂGH|\JI

IYH|4PNi\J84WILC§IY@9C5ILC¨fIL\h6G\JX>N9?xIL@9C ÙÌ\Ybf\JIYC]Kk -CF¨fI;\cIL=7Ef©'=7H|[9\#4PHLC5HYC]K=W`AC][D6G\YXaN9?-\JIY=AEf©<=AHL[D8aX\JIL\E9HL=W`fX>[9C][

©XaIY@IY@9C0P³G¶f¼G²fºfº\cILCFKMKMCFH7k;=X>KEGHY=W`ACHLC]]4P8>8}^;©<CIY@GCFN¤4PE9EG8ab\cILCFKMKMXaN9?6i\JX>N9?Ú7³G¶f¼G²Tºfºd47NG[

HLCFKM=W`7C[TX>4AHLXoILX>]\ 6i\JX>N9?IY@9C_O%Q±T¸7¶T¸IL==A8}k5;=MEiC]HJOU=AHYK IY@GX>\]^T©<CHLC]=T[TCDIY@GC|@i4PH|47ILCFH'\JCFI<OUHL=7K

84WIYX>NhÒDIY=Vä%ÙÚ¡àC7k?Gke«CFHLKV4PNIY=7EGX>Ìâ Ï 67CFNi4PNG\YX>|@ILCFNd`A=7N2;CFKMEzCF8>NXaNÏ ?7bfETILCFNGãX\<IYH|4PNG\JOU=7HLKMC][

X>NAIL=*â Ï 6\F8>Xa? VC]NG4PNG\YX|@AILCFN0`7=AN;CFKMEzCF8>NXaN Ï 69KM8V?7bfETILCFNGãG^i47NG[0IY@9C]NIY@9Cä%ÙÌ¡Ý|@G4PH|47IYCFH|\x4PHLC

HLCFE9847FC][àfb*IY@GCFX>H=7HLX>?7X>NG4P8-4A\YFXaX%|@i4PH|47ILCFH|\UC7k?Gk â Ï 6 !SCFNG47NG\JX|@IYC]Nà`A=7NßC]KMEiC]8aNµX>N#"x?AbfETIYC]NGãAk

RXaNi4P8>8abA^A4P8>8G|@G47HL4AILCFH|\54PHLCxF=7Nf`7C]HJILC][IY=8>=W©<C]HeF4A\JCAk§Zf=i^POU=AHeC¨94PKME98>C7^;â

Ï

6$7C]NG4PNG\YX|@AILCFN`7=AN;CFKMEzCF8>N

X>N%

Ï

?AbE9IYCFNiãÌX\HLC][T6iC][IL=âL4P6G\L\JC]NG4PNi\JX|@IIYCFKMEzCF8>NÝ47?7bfETILãGkÚx@9C2HYC\J698aIL47NIF47ETIYX>=7Ni\4PHLCdX>NG[TCF¨fC[

©XaIY@Ø¾T¸¿GÀT±¤4PNG[àHLCILHYX>CF`AC][*6i\JX>N9?IY@9CÌj¡h¬[9Xa`ACFHL?7CFNiC84PNG?76G47?7CKM=T[TC]8}k

Ï

8a8ÂiCF8[9\OUHY=AK IY@GCXaKV4P?AC

F47ETIYX>=7N4PHLC6G\YC][0[T69HLXaN9?MX>NG[TCF¨fX>N9?ik

&CEzCFHYOU=7HLK×Ic©'=ÌHLCILHYX>CF`W4P8<C¨TEzCFHLXaKMCFNI|\F^5=AN9CdG4A\JC[¤=7N69C]HYb!IYH|4PNi\J84WILXa=AN*4PNG[IL@9C=7IY@9C]Hi47\YC][

=7N[T=T69KMC]NAIIYH|4PNi\J84WILXa=ANhkDQSN!i=7IY@C¨TEzCFHLXaKMCFNI|\%©'C478>\Y=dEzCFHYOU=7HLK HYCFIYHLXaC]`W4P8R©XoIL@!4PNi[Ì©XaIY@9=A6TIDOUC]C][f

G4A|047NG[=AKEi4PHLCHYCFIYHLXaC]`478CWzCIYX>`7C]N9C]\L\OU=AH%X>NG[TX>`fX>[T6i4P8;IY=7EGX>]\Fk-Ð6GNG\D47HYC1[9X>\JIYX>N9?76GX>\Y@9C][Ú47\OU=A8a8>=W©-\]ª

[TC [TC1HLCFE9HLC]\YCFNIL\-«C]HYKV47N[9=fF69KMCFNIIYH|4PNi\J84WILXa=ANX}kC7k«CFHLKV4PN0IY=AE9XF\HLCILHYX>CF`AC][2OUHY=AKÛIL@9C[T=T6GKC]NI

=A8a8>C]IYX>=7NMILHL47NG\J84WILC][V476TIY=AKM4PIYXF478a8>bX>NIY=M«CFHLKM47Ni_Vf[TC CFNdHLCFE9HLC]\YCFNI|\<«CFHLKV4PNd69C]HYbIYH|4PNG\Y84WIYX>=7NÌX}kC7k

«CFHLKV4PN¤IL=7E9XF\IYH|4PNi\J84WILC][¤4P69IY=7KV4PIYXF4P8>8>bX>NIY=¢eN9?A8aX\J@*47NG[¤HLCILHYX>CF`AC][OUHL=7K IY@GC2¢eNG?78>X>\Y@[T=T6GKC]NI

=A8a8>C]IYX>=7Nik¡4PNG?76G47?7C]\D4PHLC1X[TCFNIYXaÂGC[!4A\-OU=A8a8>=W©-\FªxOUH ¬(GHYC]NG|@h^[TC ¬(«CFHLKM47Nh^#C]\ ¬(ZfEG47N9X\J@h^C]N ¬

¢eNG?78>X>\Y@4PNG[XaIÆ¬ Q¬IL478aX4PNhkxÐ69Ni\-©XaIY@Ú47N4A[9[TXaIYX>=7NG478%âJOUGãMHYC]E9HLC]\YCFNI-HYCFIYHLXaC]`W4P8h©XaIY@EG\YCF6i[T=dHLCF8>CF`W4PNGFC

OUCFC[TG4A|zk

"!(' 2 S,7G·',SEMLJ>HN*) &,7C·hR&DC

_-NGXaNIYC]HYEz=784WILC][dÙÌC]4PN

Ï

`7C]HL47?7C-3eHLC]FX>\YX>=7NÙ

Ï

3<^AHLC]]4P8>8i4PNi[d4N9=AHYKV4P8>X\JC[EGHYCX\JX>=7Nd4PIDÒ]¥A¥KMC]47\Y69HLC

+-,.0/1

á"\\

47HYC6G\YC][0IL=dKMC]47\Y69HLCHYCFIYHLXaC]`478hC#C]IYX>`7C]N9C]\L\Fk2&C16G\YC+3,./1

á\\

IY=dF=7KMEG4PHLCHL69NG\©XaIY@Ì47NG[

©XaIY@9=A6TI§OUCFC][9G47|zC]]4P6G\YC IL@9X\§KC47\Y69HLC<X\RN9=PI5X>NG69C]NGC[fb1|@G47N9?7C\X>NIL@9CxHL47N9Ez=A\YXoILXa=AN=POzHYC]8aC]`W4PNI

[T=T6GKC]NIL\VA=AN98abfb1IY@GC-Nf69KzCFHe=7OzHLCF8>CF`W47NAIe©@GX>|@M=TFF69HeX>NMIY@9CxIL=7EÒ]¥A¥MOUHL=7K EGHYC]`X>=76i\§C¨TEiC]HYX>KMCFNIL\

©'C'4A\Y\Y69KMC IL@G4WI56G\YCFH|\§4PHLC<©X>8>8aX>N9?DIY=`fXaC]©4WI58>C]47\JIxÒ]¥7¥%XaKV47?7C]\xÑaÒ£ÓUk4+ ,./1

á\\

N9=7HLKV4P8>X>\YC]\RE9HLC]FX>\YX>=7N4PI

Ò]¥A¥2(+

á\\

x©XaIY@HLC]\YEiCIIL=IL@9C1Nf69KiC]H=PO§HYC]8aC]`47NI[9=fF69KMCFNIL\OU=7HC]4A|@069C]HYb7kex@9X>\-KC47\Y69HLC]\'IY@GC

E9HL=7Ez=7HYIYX>=7N2=PO§HYC]8aC]`47NIx[T=TF69KMCFNIL\HLCILHYX>CF`AC][XaN0IY@GCIY=7EÒ]¥A¥2X}kC7ke4HLC]]4P8>8KC47\Y69HLC^TH|4WIL@9CFH'IL@G4PN0IY@GC

E9HL=7Ez=7HYIYX>=7N=POzIY@9CxIL=7EÒ]¥A¥©@9X>|@V47HYCxHLCF8>CF`W4PNI]k5«X>`7CFNV45+

á"\\

\L=7HLC4PNG[M4\YCIe=7OzHLCF8>CF`W4PNiCSc6G[T?ACFKMCFNIL\

OU=7H469CFHLb76IL@9C\JX8FC?7X>`7C]Ndfb:96;9^fIY@9CN9=AHYKV4P8>X\JC[dE9HLC]FX>\YXa=AN4WIÒ]¥A¥\L=AHYC+ ,./1

á\\

X\'?7X>`7C]Ndfbzª

+ ,./1

á\\

¬ +

á\\=<

Ò¥7¥

>@?BA

JÒ]¥7¥CD9E6#9

cÒ

x@9CDN9=7HLKV4P8>X>\YC][VEGHYCX\JX>=7N\L=AHYC%HL47N9?7C\5OUHL=7K ¥X>NG[TXF4PIYX>N9?NG=HLCF8>CF`W4PNI'XaNIY@9CDIY=AEÌÒ]¥A¥9^AIY=0Ò%©@9X|@

X>NG[TXF4WILC]\CFXaIY@GCFH4P8>8§HYC]8aC]`47NI47HYCXaNÚIY@9CIY=AEÒ¥7¥ÚXoOF9G6H9JI Ò¥7¥=7HDIY@i4WI14P8>8RIY=7EÝÒ]¥A¥[T=T6GKC]NIL\4PHLC

HLCF8>CF`W4PNIXoOK9L6#9NMÖÒ]¥7¥k-&!C[TCFÂGN9C+3,./1

á\\

¬Ò47\'4POQRQDS%IY=AE9X>OU69HYIY@GCFHxHYCFIYHLXaC]`W4P8z69N9HLC]69X>HYC[Ge47NG[

+-,.0/1

á"\\

¬¥4A\%4:T!ULSIL=7E9XdUHLCF8>CF`W47NGCOUCFC][9G47|0©Xa8>8RiC69NG\Y6GFFC]\L\cOU698R69N98>C]\L\IL@9C6G\JC]H%X\-©X>8a8>X>N9?dIL=

?7=MzCFbA=7NG[IY@9CIL=7EÒ]¥A¥Ak

V öFõõò+]^_^Lüùí ;ûð|óôód`õ¬ð|îõ¬ð|î}úüI`íî}øW^ e>ü}ýõêg]ýôüýõ}êT] kjW^ _i^ kjWl

W Áê5êSï]òó÷ð|ýôùõ}öýôüì>úî}õ}öêcî;ð|ùKX}úü}õ}ýìõ}öýôühñêJð|üúî}ê§ýôùPYZ ![

(5)

"!#$ %"!

&('*),+,-

è/..

01 2"1

3546578:9 ; 354<:9*6"6 354=:>8"8 ? 3

@A2 35498"B< ; 354<"67= 354=:376 9 7

1# 1# 354>"37< =:848: 354?*="3:? 354B8"?3 9 B

1# 1# @A2 354B"?*6"< ="=548: 3546:?*<57 354B"?*6"< 6 6

@DC @DC 354=:>"B8 ?343: 354?87E? 354>">>"8 > B

@DC @DC @D2 354=:>6:9 ?346: 3548"<7= 354>=">:B 6 B

GF GF 354>"<*=0? 6">48: 354?"B93 354>"3"?"B = 7

GF GF @D2 354=:>"9"9 ?34=0 3548:99"B 354>:B?6 ? B

$ 354=:8>"6 ?84B" 354<="6"< 354>"6"?8 9 7

$ @A2 354=:>6:9 ?346: 3548">"?"B 354>"6>= 6 B

H I KJRËÇLJ

ÐC\J698aIL\5OU=7He4P8>8hÒbDHL69NG\547HYC\Y@9=W©NXaNMIL@9CxOU=78>8a=W©X>N9?IL4798>C]\]ª;R4P98>CÒ\J69KMKV4PHLX\JC\§HYCFIYHLXaC]`478TC#C]IYX>`7CFNGC]\L\

OU=7H1[9=fF69KMCFNIIYH|4PNG\Y84WIYX>=7N^h4PNG[;4798>CV£OU=AH69C]HYbÌIYH|4PNG\Y8>4PIYX>=7NhkVÁDN4`ACFH|4P?AC47FHY=\Y\4P8>85K698aIYX>8>XaN9?A6G4P8

HL69NG\]^f69C]HYbILHL47NG\J84WILXa=ANd=769IYEzCFHYOU=7HLKM\'[T=T6GKC]NI<ILHL47NG\J84WILXa=ANdG4A\JC[V=7N0Ù

Ï

3%ª¥Gk¦¦£dPåTZ =PO@9X>?7@GC]\JI

¢eNG?78>X>\Y@Ù

Ï

3<R`T\]kR¥GkÜ<¤¤+}çAå+Z=PO#@9Xa?A@9C]\JI ¢eNG?78>X>\Y@Ù

Ï

3<RHLC]\YEzC]ILXa`ACF8>b7k§x@9X\5`W4PHLXaC\547HL=A\L\R8>47N9?76i4P?7CA^

@9=W©'CF`ACFH^;©@9C]HYC0[T=T69KMC]NAIIYH|4PNi\J84WILXa=ANOU=7HVZfEG4PNGX>\Y@Ö©XoIL@9=76TIOUCFC[TG4A|T1X>\@9X>?7@9C]HIL@G4PNÝHYC\J6G8oI|\1OU=AH

69CFHLbIYH|4PNG\Y8>4PIYX>=7N4Ù Ï 3¤=7O¥9k¦+AÜ7ç`T\Fk§¥9k¦AçåW¦HYC\JEzC]IYX>`7C]8ab9k§ä-=W©'CF`ACFH^7[TXzC]HYC]NGC\ezCIc©'CFC]NdHYC\J6G8oI|\

©XaIY@9=A6TIMOUCFC][9G47|¤zCIc©'CFC]Nà[T=TF69KMCFNId4PNG[ÝA6GCFHLbIYH|4PNG\Y8>4PIYX>=7Nà4PHLC2\JIL4WILX>\JIYXF478a8>b*\YXa?AN9XoÂzF4PNIM=7N98>b¤OU=AH

Q¬IL478aX4PN4PNi[«C]HYKV47N6G\JX>N9?IY@GCF&ØXa8=¨T=7N2IYC\cI-©XaIY@MONà¥Q®¥Aå7k

¥D69C]HYbVILHL47NG\Y8>4PIYX>=7N0X>\KM=AHYC1\Y6GFFC]\L\cOU6G8hiCF476G\JCIL@9CIYH|4PNi\J84WILXa=AN2EG47XaH QP¢eN9?A8aX\J@X\xIcbfE9XF4P8>8>bzCIJ

IYC]HIY@G47N¢ N9?78>X>\Y@ P SR7k#¢ N9?78>X\J@ PÝ«CFHLKV4PNÌEzCFHYOU=7HLKV\©<=AHL\JI47NG[Ú6GEi=AN!X>NG\YEiCIYX>=7N!©<CÂGNG[ÚIY@i4WIKM=A\JI

CFHLHL=7H|\R47HYC[T6GCIY=1¢ N9?78>X>\Y@M©<=AHL[G\§iC]XaN9?X>NGF=7HLHYCIY8>bF=7KGXaN9C[IY=OU=7HLK «C]HYKV47NMF=7KMEz=769NG[ILCFHLKV\Fk§9=AH

C¨947KEG8aCA^WIY@9CEG@9HL4A\JCâYi4P8>8>\§=7O:<HL6G47|@i4PNZfIL4WILXa=ANV4Pz=W`7Cx¡h=T|@ Ï ©<CãX>\RILHL47NG\J84WILC][XaNIY=âL

4P8>8aCx[TCFH ZfIL4W

IYX>=7N#:<HY6G4A|@G4PN

69iC]HR¡=T|@G4©<Cã9kQSNIY@9X\RC¨94PKME98>C7^â:<HY6G4A|@G4PNZfIL4WILXa=ANGã%47NG[ÌâL¡h=T|@ Ï ©'C]ã4PHLC F=7KGXaN9C[

H|4WIY@GCFH§IY@i4PN8aCFOI<47\§E9HL=7EzCFH5Ni4PKMC]\]k &C%4P8\Y=%ÂGNi[[9CIYC]HYKMX>N9CFH|\54PNi[F=7Nc6iIYX>=7Ni\54PHLC'©HL=7NG?78>b1=7K9X>N9C][^

C7k?Gk¤âYiC]8a=W© CFKG4PN9fKMCFNI|ãILHL47NG\Y8>4PIYC]\IL=ßâJ69NIYC]HLB4PKMKVã4PNG[âY8aX>N9X>N9?G4PN9T\Lã2IY=ØâY[9XaCbX

47N97Cã9kM354PHYI

=PODIY@9CE9HL=7G8aC]K X>\V]4P6G\YC][fbF47ETIYX>=7NG\ILC¨fIL\MzCFX>N9?;âY[TX>HJIcbTã!4PNG[Ý69N9?AHL47KKV4PIYXF4P847NG[ÝF=7698[ÝiCX>K

E9HL=W`7C[ÌfbÚ8>C]47N9X>N9?26GE!IL@9Cd¢eNG?78>X>\Y@ÌILC¨fIL\EGHYX>=7HIY=0ILHL47NG\J84WILXa=ANhkMx@9X>\X\8>C]\L\E9HY=A98>CFKV4WILX>OU=7H169C]HYb

IYH|4PNi\J84WILXa=ANHLC]\Y698oILXaNG?X>N0@9Xa?A@9CFHHLCILHYX>CF`W478zCWzCILXa`ACFN9C\Y\]k5B%=T6GKC]NIIYH|4PNG\Y8>4PIYX>=7N2X>\xKM=7HLC\J6iFC\Y\JOU698#OU=AH

=PIL@9CFH 8>47N9?76G47?7C\5iCF476G\JC%ZTEG4PN9X\Y@h^GHYC]NG|@d4PNi[Q¬I|4P8>X>47Nd4PHLC8aC\Y\<=AKEz=76GNG[MHYX|@IY@G47N«CFHLKV4PNVKV4PfX>N9?

QP¢eNG?78>X>\Y@ILHL47NG\Y8>4PIYX>=7N0iCFIJIYC]H]k

QSN¤?7C]N9CFH|4P8 HYC\J698aIL\\J@G=W© IL@G4WIOUCFC[TG47|HLC][T6GFC]\EiC]HJOU=AHYKV4PNiCd4WOILCFHIY@9C2XaN9XaIYX4P8'HLCIYHLX>CF`W4P8k Xx47\YC][

=7N + ,.0/1

á"\\

^x4P8>8HLC]\Y698oI|\OU=7Hd69C]HYb¤ILHL47NG\Y8>4PIYX>=7NÝ47HYC08>=W©<C]H©XaIY@àOUC]C][TG4A|#kßÐ-C]\Y698oI|\d4PHLC\JX>KMXa84PHMOU=AH

[T=T6GKC]NIDILHL47NG\J84WILXa=ANÌC¨9FCFETI19HLCFNi|@!4PNi[ÌQ¬IL478aX4PNÌOU=7H©@9X|@ÚHLC]\Y698oI|\4PHLC@9X>?7@9C]HV[TXzC]HYC]NGC\4PHLCN9=7I

\JIL4WILX>\JIYXF478a8>b\YXa?AN9XaÂiF47NAIkex@9CKM=A\JI-8>XaACF8>bdHYC47\Y=7NG\<OU=AHxIY@9X\-4PHLC7ªJÒ<N9=7N9=AETIYX>KV4P8EG47HL47KCFIYC]Hx\YCIYIYX>N9?A\

OU=7H1IY@9COUCFC][9G47|!K=T[TC]8}^547NG[Ø}£AOUCF©(HLCF8>CF`W4PNI[T=T6GKC]NIL\1X>NIY@GCdIY=AEØÒ]¥zCFX>N9?Ì6G\YC][OU=AH1HLCF8>CF`W4PNGFC

OUCFC[TG4A|zk§QSN0IY@GCHYC]KM47XaNi[TCFH=7OIY@GX>\-[9X>\L6G\L\YXa=AN2©'COU=fF6G\=AN2HLC]\Y698aIL\x©XaIY@9=A6TIOUCFC[TG47|#k

RXa?A69HLC]\ÜIY=Dç%\J@9=W©¤4`ACFH|4P?7C§E9HLC]FX>\YX>=7NHLC]\Y698oI|\hOU=AHX>NG[TX>`fX>[T6i4P8fA6GCFHLXaC\OU=7HRz=PIY@[T=T69KMCFNI§4PNG[169C]HYb

IYH|4PNi\J84WILXa=ANOU=AH 4P8>8984PN9?A6G4P?AC]\RC¨9C]ETI<ZfEG47N9X\J@h^AXoI<X>\5X>NIYC]HYC\cILXaN9?IL==7G\YCFHL`7C<IY@i4WIeIL@9X>\eX>\5NG=PIeIL@9C-F4A\JCxOU=AH

4P8>8§A6GCFHLXaC\Fk9=AHDHLCILHYX>CF`W4P8RX>N!«CFHLKV4PNh^¤69C]HYX>C]\DEzCFHYOU=7HLK zCIYIYC]H©XaIY@[T=T69KMC]NAIIYH|4PNi\J84WILXa=ANh^;Ò¥VOU=AH

9HLCFNi|@h^iÒAÒOU=7HZfEG47N9X\J@47NG[dçOU=AH<Q¬I|4P8>X>47Nhk7X'C]F476G\YC-HYCFIYHLXaC]`W4P8GCWzCILXa`ACFN9C\Y\<[TCFEzCFNG[G\<6GEi=ANVIYH|4PNG\Y84WIYX>=7N^

69CFHLX>C]\§=POh£SÜ©<=AHL[G\5F4P6i\JCxEz==AH5HYCFIYHLXaC]`W4P8TEzCFHYOU=7HLKM47NGCxC]`7CFNMXaOiILHL47NG\Y8>4PIYX>=7N=POTc6G\cI<=7N9Cx©'=7H|[X\5©HL=7N9?ik

9=AH CF¨T47KME98aCA^7IL=7E9XD£AåEzCFHYOU=7HLKM\<zCIJILCFHx47FHY=\Y\e478a8z84PN9?A6G4P?AC]\5©XaIY@[9=fF69KMCFNI ILHL47NG\Y8>4PIYX>=7Nhk§x@9X\ X\ zC

F476G\YCxIY@9C©'=7H|[1OU=AH1âY]4PNG478>ãX\5KMX>\JIYH|4PNG\Y8>4PIYC[X>NV4P8>898>47N9?76i4P?7C\RIY=âL|@G4PN9NGCF8ãDX>NV¢eN9?A8aX\Y@h^7969I<=AHYHLC]IY8>b

(6)

"!#$ %"!

&('*),+,-

è/..

01 2"1

1# 35493*=0? 85746: 3548="3"8 354>:9E=#7 6 7

1# @A2 354=:<<= 8"34?" 3548:B97 354>="3"< ? B

@DC 354=09076 ?>43: 354?"?*6"8 354>=:B"B 6 >

@DC @A2 354=09*6:? ?>48: 3548"67> 354>:B*<:? 6 =

GF 354=:<>= ?<48: 354?6*=:8 354>"66"8 = 7

GF @A2 354=09*3:? ?"B04<: 354?79> 354>576:? ? B

$ 354=:6"9*= ?"904B" 3548"8*=0B 354>="8= 9 7

$ @D2 354=0?078 ?64>: 354?"9*3"> 354>="3"8 6 >

R4P98>C1Ü9ª

Ï

=AKMEG4PHLX>\Y=7N2=PO;IY@9CZf@GCgVCF8[0HYC\J698aIL\x©XaIY@=7IY@9C]H-\J6G9KMX>\L\JX>=7Ni\

(F

#" GF#2 GFF 1 GFF #F

#" > 7

F, B 7

$C 7> =

#C, = =

5! * 7 7

IYH|4PNi\J84WILC][OUHL=7K ¢eN9?A8aX\Y@VXaNIY=1IY@9CDOU=769H IL47HY?ACI 84PN9?A6G4P?AC]\-C7k?GkâY]4PNG478>ã PâYW4PNG478aCãPÔâY|@G47N9N9CF8ãAkx@9X>\

\Y@9=W©-\<IY@G4PIIYH|4PNG\Y8>4PIYX>=7N2OU=7HxIL@9X>\-©<=AHL[X>\NG=PI-\JbfKMKMCILHYXP^9XkC7k§IY@i4WI-¢eN9?A8aX\Y@ P ¬ QP¢eN9?A8aX\Y@hk

Á%O%=A69H|\JCA^;X>NÝ\Y=7KMC]47\YC]\69C]HYb!IYH|4PNi\J84WILXa=AN¤X>\iCFIJILCFHIY@G47N[T=T69KMC]NAIIYH|4PNi\J84WILXa=ANhkÚ9=AHCF¨T47K

E98>C7^e«CFHLKV4PNIY=AE9X£P¥¤FâJHLXa`ACFH©XaIY@*4`fX>4A[T6GIXaNIL@9CdG4A|f?7HL=769NG[GãADEiC]HJOU=AHYKV\i47[T8>bÚOU=AH[T=T6GKC]NI

4P8aIY=A?7CFIY@9C]H]k ¥D69C]HYbIYH|4PNG\Y84WIYX>=7NßO47Xa8\dzC]]4P6G\YCÌC]XoIL@9CFH0©<=AHL[G\d4PHLCÌKMX>\JIYH|4PNG\Y8>4PIYC[C7k?Gk âYi=4WI|\dX>Nµ4

|@G47N9N9CF8ãHL4PIY@9C]HxIY@G47NØâJz=A4PIL\xX>N4V]4PNG478>ã^9NG=PIIYH|4PNi\J84WILC][04WI%4P8>8 C7k?GkâL¢5¨fIYC]HYNi4P8#`fXaC]©-\=PO5¢e?AbE9IYX4PN

IYC]KME98aXãHL4PIY@9C]HIL@G4PNâY¢e¨fIYCFHLX>=7HR`X>CF©-\R=7Oi¢e?AbE9IYX4PN1ILCFKME98>C]\LãA<^P=AHR\YbfN9=7NfbfKM=76G\;IYC]HYKV\§4PHLC'6G\JC[1X>NG\JIYC]4A[

©@9X|@!47HYC=7HLHLC]I96TI1[T=0N9=PIKV4WI||@ÌIY@GCM]4PETILXa=ANIYC]HYKV\MUCAk?ikÌâJX>KV4P?AC]\D=PO<¢ N9?78>X>\Y@ÌzC]4A=7Ni\YãHL4PIY@9C]H

IY@i4PNßâJX>KV4P?7C\'=POR¢ N9?78>X\J@08aX>?7@IL@9=76G\YC]\LãAk

&CMÂGNG[IY@GCVOU=78>8a=W©X>N9?=AHYHLCF84WILXa=ANG\iCFIc©<C]CFN*4`ACFH|4P?7CE9HLC]X\YXa=AN\L=AHYC\OU=7H69C]HYb4PNG[[T=T6GKC]NI

IYH|4PNi\J84WILXa=AN*U6G\YXaNG?2ZfEzC]4PHLKV4PN\-HL@9=d©XaIY@ M N¥Q®¥9ÒPª'«C]HYKV4PN*}¥9k>Ò£7ÜA^ZfEG47N9X\J@*}¥9kôåTÒ7Ò7^GGHYC]NG|@

¥GkPÜ7çPx47NG[ÌQ¬I|4P8>X>47N¥Gk7£7åPk%x@9C8>4A\cIIY@9HLCFC8>47N9?76i4P?7C\-\Y@9=W©Ô4\YXa?AN9XaÂiF47NAI=AHYHLCF84WILXa=AN0zCIc©'CFC]N

4`7C]HL47?7CE9HLC]FX>\YXa=AN6G\YXaN9?2CFXaIY@9C]H[9=fF69KMCFNID=AHD69C]HYb2IYH|4PNG\Y84WIYX>=7N*X}kC7k%IY=AE9X>]\%EzCFHYOU=7HLKÃ\JX>KMXa84PHL8ab06G\YXaNG?

CFXaIY@GCFHV4PE9EGHY=47|@ik¤«C]HYKV47NX\NG=PId=AHYHLCF84WILC][zC]F476G\YC2=7O%HYC47\Y=7NG\?7X>`7C]N*E9HLCF`fX>=76G\Y8abOU=AHM69C]HYb¤47NG[

[T=T6GKC]NIIYH|4PNG\Y8>4PIYX>=7Nhk

É ÈeÎEJRÉÆ ÎÇ É1Ç -È Å 3 ! #" JRË%$ÎEJLJRÎFÉÆ J

R4P98>CÌÜ¤\J6GKKV47HYX\JC\MIY@GCÌHYC\J6G8oI|\V=7TI|4PX>N9C][ß47?A4PX>NG\JId4P8>8-=PIL@9CFH|\d\Y699KMXoIYIYC[ßIY=¤QSKV4P?AC:'¡;¢ £7¥7¥P¦ikµQ

\Y699KMXoIYIYC[dHLC]\Y698oI|\5OU=AH'[T=TF69KMCFNI ILHL47NG\J84WILXa=ANV©XoIL@HLCF8>CF`W4PNiCOUC]C][TG4A|=AN98>bM4A\Y\Y69KMX>N9?IY@GC]\YC%©'=7698[VzC

IY@GC @9X>?7@9C\cI;HYC\J698aIL\]^96TI;IY@9X\;[9X>[NG=PIE9HL=W`7C§IL=-zCeIYHL69CAk;x@9C'4`7CFH|4P?AC;H|4PNGDEz=A\YXoILXa=AN147FHY=\Y\h478a8A8>47N9?76i4P?7C\

6G\YXaNG?IY@9C\Y699KMXaIJILC][HLC]\Y698oI|\X\¦GkçMV§©@9C]HYC47\6G\YXaNG?IY@9Cd@GXa?A@9C]\JI1HYC\J6G8oI|\14PN¤4`7C]HL47?7CEi=\JXaIYX>=7N¤=7O£9k£9k

X\=7TI|4PX>N9C][hkdQ¬I1X>\\J=AKC]©@G4WI1\Y69HLE9HYX\YXaN9?0IL@G4WIIL@9C2ZfEG47N9X\J@¤\Y699KMX>\L\YXa=AN!6G\YX>N9?Ì[T=T69KMC]NAIILHL47NG\Y8>4PIYX>=7N

E9HL=W`7C[1IL=1iC-IY@9C-@GXa?A@9C]\JI zC]F476G\YC=769H 47E9E9HL=A4A|@6G\YC][M`ACFHLb8>XoIYIY8>C-84PN9?A6G4P?AC'EGHY=TC\Y\YX>N9?14PNG[fN9=W©8>C][T?AC

=PO#ILHL47NG\J84WILXa=ANhk &ØXaIY@2A6GCFHLbILHL47NG\J84WILXa=AN47NG[MN9=OUC]C][Ti47|#^7©'C%=A698[@i4`7CX>KEGHY=W`AC][IY@9C%HL47N9Ez=A\YXoILXa=AN

=PO§=76GHx¢ N9?78>X\J@h^TQ¬I|4P8>X>47N047NG[«CFHLKV4PN0CFNIYHLXaC\Fk

(7)

QSN!IY@9X\EG4PEzCFHQD@G4`7CE9HLC]\YCFNIYC[ÌC¨TEzCFHLXaKMC]NAI|\©@9CFHLCFfbQ=7KMEG47HYC[T=T69KMC]NAI147NG[!69C]HYbILHL47NG\Y8>4PIYX>=7N

6G\YXaNG?dIY@GCMA®z¯W°±9²7³µ´f±9¶A·T¸G¯f¯T¹W¶7³G²Tº4PNG[

»

²7¼G¸TºA·i¹¯½2ÙÌ \JbT\JIYCFKV\%OU=7HIY@GCQSKV4P?AC:'¡;¢ ß£P¥7¥7¦47[Ì@9=T

X>KM47?7CHLCILHYX>CF`W4P89IL47\Y#k5ÁDNV4`ACFH|4P?7Cx69CFHLb1ILHL47NG\Y8>4PIYX>=7NM=76TILEiC]HJOU=AHYKV\5[T=TF69KMCFNIeIYH|4PNi\J84WILXa=ANOU=AH<ZfEG47N9X\J@h^

Q¬IL478aX4PN^G9HLCFNG|@4PNi[«C]HYKV47N2ILC¨fIL\]^9969IIY@9X\-`W4PHLX>C]\47FHY=\Y\'z=PIL@084PNG?76G47?7C4PNG[2IY=AE9XPkº½e47HYX>=76G\'ILHL47NG\J

84WIYX>=7NÚCFHLHY=AHL\DF4P6i\JC8a=W©HLCILHYX>CF`W4P8RC#C]IYX>`7C]N9C]\L\-OU=AHDz=PIL@[9=fF69KMCFNI4PNG[Ì69C]HYb0ILHL47NG\J84WILXa=ANÌKMCIL@9=T[9\Fk

«X>`7CFNÝIY@GCC#=7HYIdXaNf`7=A8a`AC][XaNØ[T=T6GKC]NIVIYH|4PNG\Y8>4PIYX>=7Nà4PNG[à8>=W©<C]HHLCILHYX>CF`W478'EzCFHYOU=7HLKV4PNGFC0IY@G47Nß69C]HYb

IYH|4PNi\J84WILXa=ANh^iXaI©<=A698>[Ú4PE9EzC]47H%IL@G4WIDIY@9C8>4PIJILCFH4PE9E9HL=A4A|@X>\DzCIJILCFHOU=7HDIY@GX>\HLCIYHLX>CF`W4P8;IL4A\J#kB%=T6GKC]NI

IYH|4PNi\J84WILXa=ANß]4PNßzC!4PEGE98aX>C][ß4POIYCFH2HYCFIYHLXaC]`W4P8-E9HLX>=7HVIL=*E9HLC]\YCFNIYX>N9?¤F47ETIYX>=7NG\dIY=¤IL@9CÌ6G\YCFHHL4PIY@9C]HVIY@G47N

X>NAILHY=T[T6iX>N9?MCFHLHY=AHL\<XaNIL=MIY@9CHLCILHYX>CF`W4P8#E9HL=TC\Y\]k

ä-=W©'CF`ACFH^i©'C=7G\YCFHL`7C\J=AKCX>NAILCFHLC]\JIYX>N9?0C#C]I|\47FHY=\Y\%XaNG[9Xa`fX[T6G4P8§IL=7E9XF\©@9C]HYCM[T=T6GKC]NIILHL47NG\J

84WIYX>=7N0=769IYEzCFHYOU=7HLKM\x69C]HYbMILHL47NG\J84WILXa=ANhk§x@9X>\xX\xEG47HJILX>F698>47HY8>bIYHL69C©@9CFN69CFHLX>C]\x4PHLC\Y@9=AHJI4PNG[0HL6GFX>478

69CFHLb!IYCFHLKV\47HYCdKMX\cIYH|4PNi\J84WILC][=7HN9=PIIYH|4PNG\Y8>4PIYC[4PI478a8k X'C]]4P6G\YCdF47ETIYX>=7NILHL47NG\J84WILXa=AN¤X>\1OUC]4A\JX>98>C

OU=7HX>KM47?7CM=A8a8>C]IYX>=7NG\DiCF476G\JCF47ETIYX>=7NG\47HYCIcbEGX>]4P8>8abK6i|@!\Y@9=7HYIYC]H%IL@G4PN!K=\cI=PIL@9CFHDIYCF¨fIL\]^#OU69HJIL@9CFH

©'=7HL2=A698[C¨TE98>=7HLC1=AK9X>N9X>N9?dz=PIY@![T=T69KMCFNI4PNG[69C]HYb2IYH|4PNG\Y84WIYX>=7NIL=dX>KEGHY=W`ACHYC\J698aIL\D4PNG[IL4PAC

47[9`47NIL4P?AC=7O<©@9X|@!KMCFIY@9=T[?7X>`7C\DzCIYIYC]HHYCFIYHLXaC]`478§EiC]HJOU=AHYKV4PNiCbÚKC]HY?AXaNG?IL=7?7CFIY@9C]HHYC\J698aIL\DOUHL=7K

[T=T6GKC]NI4PNG[69CFHLbIYH|4PNi\J84WILXa=ANhkMQ%©'=7698[4P8\J=08aX>7CIL=C¨TE98>=7HLCX>KME9HY=W`fX>N9?0IY@9CMOUC]C][Ti47|ÌKM=T[TCF85fb

IYH|4PX>N9X>N9?VEG47HL47KCFIYC]HL\xOU=AH-=7E9IYX>KM478`W4P8>69C\FkxRXaNG478a8>b7^zQx©<=A698[28>X>7CIL=dC¨TE98>=7HLCKMCIY@G=f[G\IY=XaKME9HL=W`7C[T=T

69KMCFNIILHL47NG\J84WILXa=ANX>NIY=«CFHLKV4PN0fbdKV4PfXaNG?IL@9CIYCF¨fIL\-F8aC4PN9C]H'EGHYX>=7HxIL=HL69N9NGXaN9?IL@9C1ÙÌ\JbT\JIYCFKk

ÍÆÉ W-Ê%3O %ÆÇ J

x@9X\©<=AHY©'4A\]4PHLHYX>C][¤=A6TI©XaIY@GXaNIY@9C¢e69HL=W`fX>\YX>=7N¤E9HL=PcCI4PIMZf@GCgVCF8[_%N9Xa`ACFH|\JXaIcbOU69NG[TC[*fbIY@GC

¢ 3'ZTÐ-:}¢e69HL=W`fX>\YXa=ANhªR«ÐÞWÐ%å7çT PÞP¥9Òk

I P%È7%ÆÍA J

ÑaÒÓ«HLCOUC]NG\cILCIYIYC7^z«kaª:<HL=A\L\<¡;4PN9?A6G4P?ACDQSNTOU=AHYKV4PIYX>=7N2Ð-CIYHLX>CF`W4P8k5j8a6f©'CFH Ï ]47[TC]KX3e6G98aX\Y@9CFH|\F^%=7HY

Ñ£Ó13§CFIYCFH|\]^T:Dk>^X<H|47\L|@98>CFH^AÙ¤k>ª:<HL=A\L\<8>47N9?76G47?7C%\YbT\cILCFK C]`478a6i4WIYX>=7NªRx@9C8>CORF4PKMEG47Xa?ANG\]k7=A69HLNG4P8i=PO

IL@9C Ï KMCFHLXF4PNZf=TX>CIcbdOU=7HQSNTOU=AHYKV4WILXa=ANZ9X>CFNGFC14PNG[0C|@9N9=A8a=A?7bÌ}£7¥7¥GÒ%Ò]¥7çU]æ#Ò]¥T7£

ÑÜWÓÁ47HL[^TBkaªZTCFHL`X>N9?6G\YCFH|\xXaNKV4PNfbd84PN9?A6G4P?AC]\]kRB%S¡hX>0KV47?A4]XaNGCJÒ*¤¤UP

Ñ¦PÓ:<8>=769?A@h^D3§k>^ZT4PNG[9CFH|\J=ANh^%Ù¤k>ª _%\YCFHC¨TEzCFHLXaKMC]NAI|\0©XoIL@IL@9C!C]69HL=W`X\YXa=ANHL=A\L\c¬84PN9?4P69?ACXaKV4P?AC

HLCILHYX>CF`W4P8\YbT\cILCFKk5QSNhªº

Ï

ZfQJZT^GXaN\Y699KMX>\L\YXa=ANhkh}£7¥7¥P¦f

ÑåÓÁ47HL[^§Bkaª Ï F=7KMEG47HL4PIYX>`7CV\cIL6G[Tb=PO%69C]HYb4PNi[*[T=T69KMC]NAIIYH|4PNG\Y84WIYX>=7NOU=AHFHY=\Y\J84PNG?76G47?7CXaNT

OU=AHYKV4WILXa=ANHYCFIYHLXaC]`478}k2QSNhªM3eHL=fFCFC[TXaNG?A\=POxIL@9CÜPH|[*:<=7NTOUC]HYC]NGCV=7OxIY@9C

Ï

\Y\Y=TX4WILXa=AN!OU=AHÙÌ4A|@9X>N9C

;HL47NG\Y8>4PIYX>=7NX>N0IY@9C

Ï

KMCFHLX>]47\]k#JÒ*¤<¤ A<¦P£æf¦+AÜ

ÑçWÓ1ÙÌ:'4PHL8aC]b7^7Z#k>ª'ZT@9=7698[©<C<IYH|4PNG\Y84WIYC<IY@GCx[9=fF69KMCFNIL\§=AHRIY@9C69CFHLX>C]\RXaNMHL=A\L\;8>47N9?76G47?7C<XaNTOU=AHYKV4PIYX>=7N

HLCILHYX>CF`W4P8QSNhª53eHL=fFCFC[TXaNG?A\e=7OhIY@GCÜUIL@ Ï NGN6i4P8ÙCFCFIYX>N9?=POhIL@9C Ï \L\J=TX4WILXa=ANVOU=7H%:<=AKEG6TIL4PIYX>=7NG478

¡XaN9?A69X\cILX>]\FkhJÒ*¤¤<¤A'£P¥+æT£9ÒF¦

ÑÓ1G6cXaX^ Ï k47NG[ßQc\J@GXaW4©x49^kaª Ï E9E98>bfXaN9?ÝKV47|@9X>N9CIYH|4PNi\J84WILXa=ANÝIL=¤Ic©'=PS\cI|4P?7CÌFHY=\Y\J¬8>47N9?76G47?7C2XaNT

OU=AHYKV4WILXa=ANHYCFIYHLXaC]`478}k2QSNhªM3eHL=fFCFC[TXaNG?A\=POxIL@9Cd¦PIL@Ý:<=7NTOUC]HYC]NGCV=7OxIY@9C Ï \Y\Y=TX4WILXa=AN!OU=AHÙÌ4A|@9X>N9C

;HL47NG\Y8>4PIYX>=7NX>N0IY@9C

Ï

KMCFHLX>]47\

Ï

ÙÌ

Ï

S£7¥7¥A¥Akh£P¥A¥7¥A%Ò]ÜWæT£P¦

ÑWÓ:<8>=769?A@h^93§k>^iZT4PNi[TCFH|\J=ANh^9Ù¤k>^GÙ

698>8>CFH^Gä1k>ª1x@9C1HL=A\L\x84PN9?A6G4P?ACDX>KV4P?7CHLCILHYX>CF`W4P8#ILHL4A|ÚUX>KV4P?AC]8>CO|

£7¥7¥P¦ik;QSNª Zf699KMX\Y\YXa=ANh^fIY=d47E9EzC]4PHk}£7¥7¥P¦f

Ñ¤WÓ z@i4PX^i:Dka^G¡;4#CFHYIcb7^nik>ª Ï \cIL6G[Tb=7O§\YKM=f=PIY@GXaN9?MKMCIL@9=T[9\xOU=AH-8>47N9?A4769?7CKM=T[TCF8\-4PEGE98aX>C][2IL=d47[2@9=T

(8)

Topic

25 21 17 13 9 5 1

Average Precision

2.5

2.0

1.5

1.0 .5

0.0 DE_EN DE_DE

;X>?76GHYCÜ9ª

Ï

`7CFH|4P?AC3 HYCX\JX>=7NOU=7H%«C]HYKV4PN2IY=AE9XF\

ÑaÒ]¥WÓ:<8>=769?A@h^i3§k>^ZT4PNG[9CFH|\J=ANh^GÙ¤k>ª

Ï

\Y\YC]\L\JX>N9?MILHL47NG\J84WILXa=ANÌ6G4P8>XoIcb2OU=7HHL=A\L\84PN9?A6G4P?ACX>KV4P?AC1HYCFIYHLXaC]`W4P8k

QSNhª ZT699KMX>\L\YXa=ANh^fIY=d47E9EiC4PHk}£P¥A¥7Ü

ÑaÒ7ÒÓ1ä%6TIL|@9X>NG\]^E&ka^7ZT=7KMCFH|\F^Wäkaª Ï NQSNIYHL=T[T6GIYX>=7NIL=%KV47|@9X>N9C'H|4PNG\Y84WIYX>=7Nk Ï ]47[TC]KX 3 HYC\Y\]^W¡h=ANG[T=7N^

¢ N9?784PNG[!cÒ$¤ 7ç

ÑaÒ£Ó:<8>=769?A@h^W3§ka^7Z94PNG[TC]HL\Y=7N^Ù*kaª x@GC<CWzCIL\;=POiHYC]8aC]`47NGCeOUCFC][9G47|X>NHL=A\L\h84PNG?76G47?7CeX>KV4P?7C<HYCFIYHLXaC]`W4P8k

QSNhªR3eHL=TCFC[TX>N9?A\;=POiIY@9C-£PçPIY@M¢e69HL=7EzC]47N:<=7N9OUCFHLCFNGFC'=ANQSNTOU=AHYKV4PIYX>=7NÐ-CIYHLX>CF`W4P8h}¢':<QcÐ¥P¦fkT}£7¥7¥P¦f

ÜåPÜæTÜ7çAÜ

(9)

Topic

25 21 17 13 9 5 1

Average Precision

2.5

2.0

1.5

1.0 .5

0.0 FR_EN FR_FR

RX>?769HLC¦Gª Ï `ACFH|4P?AC3 HYCX\JX>=7NOU=7H-9HLCFNi|@IL=7E9XF\

Topic

25 21 17 13 9 5 1

Average Precision

2.5

2.0

1.5

1.0 .5

0.0 ES_EN ES_ES

RX>?769HLC1åTª

Ï

`7CFH|4P?AC3 HYCX\JX>=7NOU=7H%ZfEi4PN9X\J@2IY=AE9XF\

(10)

Topic

25 21 17 13 9 5 1

Average Precision

2.5

2.0

1.5

1.0 .5

0.0 IT_EN IT_IT

RXa?A69HYCçGª

Ï

`7C]HL47?7C3eHLC]FX>\YXa=ANdOU=AHQ¬IL4P8>X4PN2IY=7EGX>]\