Thesis
Reference
User interaction and performance evaluation in content-based visual information retrieval
MULLER, Henning
Abstract
Cette thèse donne une vue détaillée sur la recherche d'informations visuelles basée sur le contenu, un secteur d'étude actif dans le domaine de la vision par ordinateur. Les principaux objectifs de cette investigation sont la recherche d'images ou d'autres documents visuels dans les archives, basée sur le contenu visuel uniquement, et, en général, sans l'usage d'annotations textuelles. Les deux thèmes principaux sont l'interaction avec l'utilisateur et l'évaluation de performance. L'interaction avec l'utilisateur, et l'apprentissage à long terme en particulier, s'est révélée être la clé pour obtenir de bonnes performances. L'interaction de différentes méthodes améliore les résultats des recherches de manière significative.
L'évaluation des résultats de recherche a été largement négligée dans la recherche. Ceci est pourtant extrêmement important puisque seule une évaluation correcte permet de montrer les progrès que certaines techniques peuvent apporter. Un benchmark complètement automatisé et basé sur des tests effectués par de vrais utilisateurs est mis en oeuvre sur la base de langage de communication MRML.
MULLER, Henning. User interaction and performance evaluation in content-based visual information retrieval . Thèse de doctorat : Univ. Genève, 2002, no. Sc. 3363
Available at:
http://archive-ouverte.unige.ch/unige:150
Disclaimer: layout of this document may differ from the published version.
[ Downloaded 01/06/2012 at 14:58:59 ]
1 / 1
!#"
$&%('*),+,$&-.$0/1+32456/87:9;)-<'=+,5?>A@B$ CD)9*7:$FE,E,$&@B)HGJIKCL@B/
M NPORQ STU#OVQPWYXZU\[]^T W_Ta` bcOVQ<de]Qgf W_TaXO
hjikW_lnmoWpUq[]^T [rT s ]^TUPOtTUvuvw WxNPOV`
y [NqmoW_lzST{d|]QPf WpUq[]^T } O~UQP[OikW_l
V
%B)
"
$0E,$&/A+
"
$&$.'?'.K'1@B+
"
$28$FE3E56$&/K&$0E28$J4 /B51$&)E5+
"
$28$$0/$0;$
%9;@B)3918+,$0/B56)$J;)';2B$J2B$
!
98+$&@B) 2B$0EE56$&/K&$0E08-$0/A+,569;/P5/B7:9;)-.'*+,5?>A@B$
%K'*)
V,Jz
¡¢¢
n£
28$
¤
$&/K2BE,B@B)#¥§¦ 6$&-<'*1/B$F¨
GH©$0E,$Jª «J¬¬A¬¬
J®Lª
®L¯ ®
°*±1±1°
'ZK'1@B+ $\28$0E E,&5$0/K$FE&E,@B)v6$q%B)$F' A5?E.28$$0EE56$&@B)EGH©B56$&))CL@B/A+ $&%B©('*/B$';)©('*/K2 ';56$&+
&92B5)$0+,$&@K)E28$.+©$FE$.$+¬A¬¬n';@8+,91),5?E,$456-.%B)$0EE569;/ 28$<?'P%B)
"
$0E,$&/A+,$+,©$0E,$;rE'*/(E$¬8%B)5-.$0) 2491%B56/B591/
E,@B)6$0E%B)9;%91E,5+,569;/KEH>A@B5vE,9;/A+
"
$0/B9;/K
"
$&$FE&I
$0/$&1$;6$
±
-<'*5
°*±;±A°
"!#$
&%1'1&>A@B$0E('V®*)e®
¤
"!#!
$%"&')(+*
),-
&. /0"!#!
132
&.'
,
4!5'6&7&
,78
'9!:;!5'6&<
1
1I3=/A+),9828@K+,569;/IJIIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI
1I
°
9*+,56='=+591/ IJIIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI
°
1I> GH©K$0E,56EH9=1$&)A56$? IIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >
1I@ B56$&/A+,5BA(91/A+,)5B@B+,569;/KEe9*7+,©K56EH+©B$0E,5?E IJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @
CED '6&.
&.GF"HI9
),KJ
!#*
2
&LM'N O;!5'6&
!
* P
° I3=/A+),9828@K+,569;/IJIIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Q
° I1I 'R©('=+35?E-@B+,56-.$0285?'SR#IIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Q
° I1I
°
¦e++©B$ )91EE,5/B9*7 -<'*/ vE56$&/K&$0E{IIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI T
° I1I> 9A'*?E'*/K2 %B)9;B6$&-<EH56/PA5?E,@K'*56/87:9;)-<'=+591/ )$+),56$&='* IJIIJIIIJIIIIJIIIJI ±
° I°
¯ 56E,@K';%($0)&$&%8+591/IJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI
° I° I GH©K$©A@K-.';/ 5?E@('*E E+,$0- IJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI
° I° I°
CL),$F'=+,+,$&/A+51$JE,56-56?'*)5+ IIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >
° I° I> C $0)&$&%8+@K'*1),91@B%B56/B IIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >
° I> U|91-.%(91/B$&/A+EH9;7'U()V=
¤
IJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI XW
° I>KI CL),$0%B)9&$0EE56/B9*7+,©B$5?E@K';2898@B-.$0/1+ IJIIIIIJIIJIIJIIIJIIIIJIIIJI Y
° I>KI
°
K$0'*+,@B)$0E';/K2P©K'*)';+,$&)5?E +560EL$&¬A+)'1+$02v7:),91- 5-<';;$0EIJIIJIIIJIIIIJIIIJI Z
° I>KI> [ @K$&)<7:9;)-@B?'=+591/ IIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI
° @
° I>KI@ [ @K$&)%B)9&$0EE56/B.'*/K2PE,5-.566';),5+ <-.$0'1E@B)$0E IIIIJIIJIIJIIIJIIIIJIIIJI
° W
° I>KIW K$0'*+,@B)$ ';0$0EEH'*/K2g2B'*+'.E +9;)'*1$IIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI
° Y
° I>KIY [ @K$&)%K'*)';2B51-.E0),$FE@K+E2856E,%B?' ;8)$&6$&='*/($7:$&$F28K';]\ IIJIIIJIIIIJIIIJI
° Z
° I@ ®D¬B'*-.%B6$E 8E+$&-<EVIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI
° Z
° I@(I [ )V=^U`_a[ @B$&) )(b=-<'*;$';/K2gA5?28$09bU|91/A+,$&/A+ IIIJIIJIIJIIIJIIIIJIIIJI
° Q
° I@(I
°
¯ 5)'*1$IIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI
° Q
° I@(I> CL56c3@B/A+$&)FBCD©B9;+,9;99\8$+*I IIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI
° Q
° I@(I@ q¦
¤
IIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI
° Q
° I@(IW )e69;)?e9;)62 IJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI
° T
° I@(IY d +©B$&)3E 8E+$&-<EcIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI > ±
° IW ¤
$&?'=+,$F2v5?EE@B$FEIIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI > ±
° IWBI qCL®|e_9Z IJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI > ±
° IWBI
° ¤
$+,)56$&='*9;7n9;+,©B$0)-$F285?'IIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI > °
° IY [email protected].';) IIJIIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >@
>KI E+,$0-'*)©B5+,$F+,@K),$ IJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >SY
>KI1I 69;('*E+,)@K+@B),$ IJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >SY
>KI1I
° !
5?E +),56B@8+591/IIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >SY
>KI1I> ®"!56$&/A+7:$0'*+,@B)$';&&$0EEgIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >)Z
>KI1I@ c '*)2;?H'*)$^IJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >ST
>KI
° #%$&#('
IIIIJIIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >ST
>KI
° I B9;%$ IIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @ ±
>KI
° I°
'R© () 7:91)H+,©B$ 28$FE,&),56%8+591/NR IIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @ ±
>KI
° I> ®D¬B'*-.%B6$
#%$&#('
&92B$ IIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @&
>KI
° I@ ¦ %B%B6560'=+591/KE IJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @ >
>KI> K$0'*+,@B)$0EIIIJIIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @S@
>KI>KI U|9191) IIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @S@
>KI>KI
°
Gn$¬+@B),$ IIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @)W
>KI>KI> ¦ /B/B9;+'=+591/ IIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @ Y
>KI>KI@ K$0'*+,@B)$ 91-%('*)56E,9;/ IIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @ Y
>KI@ K$0'*+,@B)$ ?|$051©1+5/KE©B$&-.$FE.IIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @;Z
>KI@(I )H'1E5? ?|$051©1+5/K56/+*-,.0/21<IIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @;Z
>KI@(I
°
U|91-.%K'*)5/K.E,$&1$&)'*(7:$0'*+,@B)$ ?|$051©A+,56/B1E IJIIIIIJIIJIIJIIIJIIIIJIIIJI @ Q
>KI@(I> 8$&%K';)'*+,$&b?e$&56;©A+,56/B+,©B$J7:$F'=+@B),$1),91@B%KEIIIIIJIIJIIJIIIJIIIIJIIIJI W ±
>KI@(I@ 8$&%K';)'*+,$&?e$&56;©A+,56/BR%91E,5+51$ '*/K2/B$01'=+51$ >1@K$&)91-.%(91/B$&/A+E¥
¤
98&©K59(4E
-.$&+,©B98289191 B¨PIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI W ±
>KI@(IW ¦ 2B285+,569;/K';7:$0'*+,@B)$ ?|$051©A+,56/B7§';+9;)EH$F'*)/B$027:),91-@KE,$&)56/A+,$0)'1+,569;/ IJIIIJI W
>KIW ®L='*6@K'=+591/v9*7+,©K$*-,.0/21E 8E+,$&- IIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI W>
>KIWBI G ¤ W
±;±
2B'=+'*K'1E$oIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI W4@
>KIWBI
° G ¤ ° W
±1±
2B'*+';K';E,$JIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI WSW
>KIWBI> ' ';E,©B56/B*+9;/P2B'=+'*K'1E$ IIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI WSW
>KIWBI@ U|91),$02B'=+'*K'1E$ IIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI WY
>KIWBIW U|91-.%K'*)56E,9;/ 9*7+,©B$$0='*6@K'=+591/KE IIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI WY
>KIY [email protected].';) IIJIIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI W Z
354 2 &.
4!5'6& 06
@(I E,';B565+56/g56-<'*1$)$+),56$&='; IIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI WT
@(I1I = /A+$&)';+591/gE,%$&$02xIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Y ±
@(I1I
°
8$0'*)©g%B),@K/B5/KIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Y ±
@(I1I> d +©B$&)@(E,';B565+ v5?E,E,@B$0EzIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI YSQ
@(I
°
[ @K$&)E +'*),+,56/B.%(915/A+ IJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI YSQ
@(I
° I Gn$¬+FK'*/B/K9*+'*+,569;/ IJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI YST
@(I
° I° = -<';;$J$¬B'*-.%B6$1¥E¨3IJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI YST
@(I
° I> = -<';;$E$0;-.$&/A+EH9;))$&;569;/(EIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Z ±
@(I
° I@ ;\;$+©xIIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Z ±
@(I
° IW d +©B$&)3E+';)+5/K%9;56/A+E IIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Z ±
@(I>E=/A+$&)';+591/v%K';)'12856;-<E IIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Z
@(I>KI [ @K$&) <+,$&¬A+@K'*n'*/B/B9;+'*+,569;/ IJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Z
@(I>KI
°
[ @K$&) $¬B'*-.%B6$1¥E¨<IIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Z °
@(I>KI> = -<';;$JB)9?3E56/B9;)H+';),1$+E$F'*)© IIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Z °
@(I>KI@ d +©B$&)%('*)';2856;-<EIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Z °
@(I@ CL),$FE$0/A+'=+591/v9;7r+,©K$ E$F'*)©v)$0E,@B+EIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Z4>
@(I@(I E$0)5/A+$&),7§';$FEe7:9;)7*8,.9/:1 IIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Z4>
@(IW ¤
$&6$&='*/K&$7:$&$02BK';]\ IIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI ZW
@(IWBI +,)'=+,$0;56$0Ee7:91)%(9AE5+,56;$'*/(2 /K$&1'*+,56;$),$0$0='*/K&$ 7:$0$028(';]\kIJIIIJIIIIJIIIJI Z4Y
@(IY $0';),/B56/B9=;$0)HE,$&1$&)'*+,$0-.%(91)';E,0'*6$0EIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Q ±
@(IYKI ¦ /K'*8E5?EH9*7 @KE,$&)69;AK$FE IIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Q
°
@(IYKI> ®D¬8%($0),56-.$&/A+';%($0)7:91),-<'*/($J9*7n+,©B$6$0';),/B$F27§'1+9;)vIJIIJIIJIIIJIIIIJIIIJI Q@
@(IZ ¦ ©K5$0)';)© 7:9;)6$0';),/B56/B IJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Q)Z
@(IQ [email protected].';) IIJIIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI QSQ
*5;!5'6&`'6L
!
*
O 6"1
WBI ®L='*6@K'=+591/v56/ +$¬+3)$+,)56$&='* IIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI T °
WBI1I c 56E+,91) IIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI T °
WBI1I
° G ¤
®VUK_GH$&¬+
¤ ® +,)56$&='*<U|91/87:$&)$&/K&$ IIJIIIIIJIIJIIJIIIJIIIIJIIIJI T °
WBI1I> d +©B$&)32B$&;$091%B-.$&/A+EaIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI TSY
WBI
°
®L='*6@K'=+591/v56/g5?E@('*56/87:9;)-<'=+,569;/g)$+,)56$&='* IJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI TSY
WBI
° I c 56E+,91) IIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI T)Z
WBI
° I°
CL),91B6$&-<EaIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI TST
WBI
° I> !
98@B-.$0/1+ &9;6$F+591/KEeIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI TST
WBI
° I@ [ @K$&)<+'1E\8EPIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI ± >
WBI
° IW ¤
$&6$&='*/K&$ @K281-$0/A+E IIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI ± >
WBI
° IY C $0)7:91),-<';/K$-.$0';E,@B)$0EtIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI ± W
WBI
° IZ $0';E,@B)5/K+©B$%$&),7:9;)-.';/K$9*7 )$&6$&='*/K&$ 7:$0$028(';]\ IIJIIJIIIJIIIIJIIIJI ± T
WBI> ¦7:@K ';@8+,91-.'*+,$F2v5?E@K';5/B7:9;)-.'*+,569;/g),$&+,)5$0='*($0/K©B-<'*) \IJIIJIIIJIIIIJIIIJI ± T
WBI>KI )e$0/K©B-<'*) \5/B.E,9*7+?H'*)$cIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI ±
WBI>KI
°
U|91/;AK1@B),56/B+,©K$($0/K©B-<'*) \.7:9;)39;+,©B$0)5-<';;$J2B'=+'*K'1E$FEIJIIIJIIIIJIIIJI
WBI>KI> ¦ /P$¬B'*-.%B6$$&='*6@K'*+,569;/ IIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI
WBI>KI@ K),91-56-<'*;$FE|+,9<-@K+5-.$02B56' IIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI °
WBI@ ¦ ?e$&;_AK'1E$F2$&/K©B-<';)^\56/BE 8E+$&- IIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI °
WBI@(I d 1$&)5$? IJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >
WBI@(I
°
U|91-.-@B/B5?&'*+,569;/ 7:)';-.$?e9;) \ IIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >
WBI@(I> U|91/;AK1@B),56/B+,©K$($0/K©B-<'*) \oIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @
WBI@(I@ ¤
$0E,@B+EzIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @
WBIW GH©K$ / aIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI XW
WBIWBI 'R©('=+ &';/P-.'\;$J'($0/K©B-<'*) \vE,@K&&$0EE 7:@BR IIIIJIIJIIJIIIJIIIIJIIIJI XW
WBIY 'R©('=+3$&?E,$J0'*/g($$&/(©B-<'*) \;$02NR IJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI XW
WBIYKI 99\5/K7:91)3'.E%$0&5A(J56-<'*1$\IIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Y
WBIYKI
°
99\5/K7:91)3'/A@K-$&)9*7 E,5-.566';)5-<'*1$0E IIIIIJIIJIIJIIIJIIIIJIIIJI Y
WBIYKI> 99\5/K7:91)3'.E\1$+©g9*7 '*/P56-.';;$ IIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Y
WBIYKI@ G'*);$&+3E$F'*)©\¥:91)3&';6$02 5-<';;$JB)9?3E56/BA¨IIIIIJIIJIIJIIIJIIIIJIIIJI Y
WBIYKIW CL)'1+560'*'*%B%K5?&'*+,569;/ +,$0E+E IJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Y
WBIYKIY $0';E,@B)$+,©B$ E&';6';B565+ <9*7 '+U()V=
¤ E E+,$0- IIIIJIIJIIJIIIJIIIIJIIIJI Z
WBIYKIZ Gn$0E+E7:9;)3E,%($F5?'*'*%K%B5?&'*+,569;/P'*)$0'1EjIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Z
WBIYKIQ ®L='*6@K'=+591/ 9;7 U()V=
¤
5/A+,$0)7§'1$FE IJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Z
WBIZ GH©K$ +),@B+,©#'*9;@8+ U|91),$0#IIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Z
WBIZ8I )H'1E5?%($0)7:91),-<'*/(${IIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI Q
WBIZ8I
°
d %B+,56-5&56/B.+©B$ >A@B$&)56-.';;$#IIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI T
WBIZ8I> ¤
$&-.9=5/B.K'12v56-<'*1$0E IIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI T
WBIZ8I@ ¤
$&-.9=5/B.K'12 &6'1E,E,$0E IIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI
°;±
WBIZ8IW U|)$0'*+,56/B<'/B$?KE,-<'*6$0)H5/;$0)+$02AK6$IIJIIIIIJIIJIIJIIIJIIIIJIIIJI °
WBIZ8IY ¦,%($0)7:$F+%$&),7:9;)-<'*/K&$IIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI °
WBIZ8IZ ®D¬+,$&/(E56;$J6$0'*)/B56/B9*77:$0'=+@B)$ ?e$&56;©A+E#IIJIIIIIJIIJIIJIIIJIIIIJIIIJI
°1°
WBIZ8IQ U|91-.%K'*)56E,9;/IIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI ° >
WBIQ [email protected].';) IIJIIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI ° @
*5!#;!5'6&<
1C
YKI Gn)';28$0-.';)^\8ERIJIIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI ° Y
YKI1I c 56E+,91) v9*7+,)';28$0-.';)^\8EIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI ° Y
YKI1I
° ' 9;) \K9?V7:91)H+,)';28$0-<'*) \E$F'*)© '*/(2v191'*?Ee9*7+,©B$)$+),56$&=';%K),98$FE,E IIJIIIJI ° Z
YKI1I> U|9828$FE3'*/(2 &6'1E,E,5A&'=+591/KE|7:9;)H+)'128$&-<'*) \8E IIIIIJIIJIIJIIIJIIIIJIIIJI ° Q
YKI1IW E56/B *8,.9/:1 7:91)H+,)';28$0-.';)^\<)$+),56$&=';aIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >
°
YKI1IY ¦7:)'*-.$?|91)^\.7:91)H+,)';28$0-.';)^\<)$+),56$&=';IIJIIIIIJIIJIIJIIIJIIIIJIIIJI >SY
YKI1IZ U|91/K6@KE,591/ IIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >SY
YKI
°
$0285?&';0=-.';;$FEIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >)Z
YKI
° I ¦ %B%B6560'=+591/$A($&?2BE ?5+,©B56/g+,©B$-.$02B560'*2891-.';5/ IIJIIJIIJIIIJIIIIJIIIJI >)Z
YKI
° I° ¦ %K),9 $0+H7:91)@B/K<5-<'*1$J),$&+,)5$0 ';IIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >)Z
YKI
° I> U|91/K6@KE,591/KE IIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >SQ
YKI> [email protected].';) IIJIIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI >ST
P D '6&<S*5!#'N& 1 3 1
Z8I [email protected].';) IIJIIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @&
Z8I
° ¤
$0&';9;7r+©B$-<'*56/P'1©B56$&;$0-.$&/A+E IJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @
°
Z8I> K@8+,@K),$)$0E,$0';)©v2B5)$0+,569;/KExIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @S@
Z8I>KI *8,.9/:1 IJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @S@
Z8I>KI
° ¦ =';),56$+9;7-.$F2856'IIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @S@
Z8I>KI> ¤
$0'*n'*%B%B65?&'=+591/KE IJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @S@
Z8I>KI@ K$0'*+,@B)$0EPIIJIIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @)W
Z8I>KIW q'*/K';;$&-.$0/1+H7:@B/(+,569;/(E3'*/K2gE,$0@K),5+ IIJIIIIIJIIJIIJIIIJIIIIJIIIJI @)W
Z8I>KIY E$0)5/A+$&)';+591/ IJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @ Y
Z8I>KIZ ®L='*6@K'=+591/ IIJIIJIIIIIJIIJIIIJIIJIIIIIJIIJIIJIIIJIIIIJIIIJI @ Y
'N;!5'6& 1 3 6
*#'N
190
!5 '6L !-
<
19
P
!5 '6L
; * 1 "1
H !: *5!#'
-
1
2 &
,
/
1
GH©B$L;)9?5/B3';-.9;@B/A+r9;7BA5?E,@K'*15/87:91),-<'*+,569;/$&56/B %B)9828@K&$02'*/(2-<';28$L' =';5?'*B6$ 9;/ +,©B$ ?|91),?2 ?5628$
?e$&g'*/K2 9;/ 9*+,©K$&)H-.$0285?'E,@K©g';E 9;@B)/K';6E
/B$?3E%('*%$&)ED9;)e56'+,$0$056E,591/ &),$F'=+,$FE|+,©B$J/B$0$02<+92B$&;$091%
+9A916E37:9;) -.';/K'*15/K.+,©B$FE$2B'=+'BI3¦ E3+,©B$@KE,$9*7 +$¬+,@K';';/B/B9;+'=+591/KE-<' g5/A+,)9828@K&$ /B$?p';-B56;@B5+,56$0E
';/K2<$&))9;)ED'*/K2vE56/K$ 5+H5?EL1$&)I?e9;) \S_A56/1+$&/KE,56;$;19;/A+$&/A+ K';E,$02.5?E@('*K56/87:91),-<'=+591/)$+,)56$&='*¥MU()e¯e=
¤ ¨
©K'1E $&$0/q%B)9;%91E,$02g+9 ';@8+,91-.'*+,5?&'; $&¬+,)';+-.$0'*/K5/B;7:@B5/87:91),-<'*+,569;/#7:)9;- 56E,@K';2898&@B-.$&/A+E0IGH©K$
7:$F'=+,@K),$FEL9;7+,©B$FE$ 56E,@K'*2898@K-$0/A+EH'*)$ E+,9;)$02v'*/K20'*/$@KE$F2<7:91)e>A@B$0)56/BKI d 7+,$0/A+,©B$J>A@B$&)5/B56E
2891/B$K'1E$F2v91/ $&¬8';-.%B$J56-<'*;$FE¥M[ )H® _ [ @B$&)< ® ¬B';-%K$ ¨I
'R5+,©B56/ +,©K$<7:)';-.$?e9;) \#9*7e+,©B5?E+©B$0E,56E0 '#9;/A+$&/A+ K';E,$02\56-.';;$.)$+,)56$&='*3¥U() = ¤
¨E8E+,$0-g/K';-$F2
*8,.9/:1©K'1EH($0$&/#)$0'*+,$F2;?©B5?©g5?EH%K';)+9*7+,©K$Jª =-<'*1$J56/K2856/BGn9A91D¥
¨I
GH©B$J-.91E+356-%9;),+';/A+&9;/A+,)56B@8+,569;/(EH%B),$FE$0/A+,$02 56/ +©B5?EH+,©B$FE5?E'*)$
/:1 , /:1 ,56/ U()V=
¤
F7:)9;-p56-%K),9=56/B3+©B$H),$FE%9;/KE,$D+5-.$e9*7' E E+,$0- 7:9;) $++$&) 56/A+,$&)';+,56
5+ v+,96$0';),/K5/B.9=1$&)3E,$&;$0)';+,$0-%9;)'*nE,0'*6$0E3';/K2P='*)591@KEH@KE,$&)31),91@B%KEH@KE,5/Kv285$0),$0/1+3-.$&+,©B982BE
7:9;)%91E,5+51$'*/K2 /B$&A'=+51$ 7:$0$028(';]\q¥ $0+,569;/a@A¨I
, g56/v5?E@('*K56/87:91),-<'=+591/<),$&+,)5$0='*(';/K2.+©B$ &),$F'=+,569;/<9;7r'&9;-.%B6$+,$0.'*@B+,9;-<'*+,5?3$&/K©
-<'*) \.7:9;) U()V=
¤
\¥$F+591/ W1¨I
d @B)e56-.';;$),$&+,)5$0='*E8E+,$&- *8,.9/:1"!5?E|(';E,$02<91/ E,$&;$0)';(-.$&+,©B982BEH'*/(2 ';19;)5+©B-<E +,©('=+3'*)$3+'4\;$0/
7:)9;-^+,©B$691E,$&v)$&?'=+$02 AK$062P9;7 +,$¬+¥§9;) 5/87:91),-<'*+,569;/(¨H)$+),56$&=';L¥§G
¤
6=
¤
¨I0d @B)E 8E+,$0-^%B)9=;$F2+©K'=+
5+5?E@KE,$7:@B +928$&1$&69;% '#EE+,$0- 9;7H&9;-.%(91/B$&/A+E ?©B$&)$<%K'*),+E0'*/ $),$0%B?';$F2q$F';E,5;I B@B),+,©B$0)0r+,©B$
@KE,$J9*7?|$0v+$0©B/B9191;56$0EHE,@K© '1E
¤
Ee+,9.562B$&/A+,5756-.';;$FE'*/K2%) '1Ee'?'*/B1@K'*1$3+9.2B$0E)5$2B'=+'
©K'1E ';6E,9<E©B9?/P+9<($5-.%9;),+';/1+F('1EH+,©B$FE$ +,$0©K/B9;69;15$FE ?56r$E,@B%B%9;),+,$02g7:91) '.69;/B.+5-.$'*/K2 +,©K$
%$&)-.5++©B$ 285?E +),56B@8+$02g@KE,$9*7r+©B$ E E+,$0-PID¦p28$+'*56$F2 28$FE,&),56%8+591/P0'*/g($J7:91@B/K2g56/ 8$0+591/ >
¦_7:@K/K2B'*-.$0/1+'*e%K'*),+ 9*77*8,.9/:1P56E +,©B$ #@B+,56-$F285?'
¤
$&+,)5$0 ';#';)^\@B% '*/B1@K'*1$
#%$&#('$#
I GH©B56E
&9;-.-@B/K560'=+,569;/v%B),9;+,9891(/K9*+H9;/BE$0),1$02<'1E|'E$0%K'*)'=+591/<9*7+©B$@KE$0)H5/A+,$0)7§'1$'*/K2+,©B$J';+,@K';>A@B$0)
$0/B;56/B$;|B@8+'*?E,9q-<';28$g%91EE56B6$PE,$&1$&)'*L7:@B)+©B$&)2B$&;$091%B-.$&/A+EE,@K©~'1E6$0';),/K5/B\7:)9;- @KE,$&).69;4A($FE
';/K2 +,©K$ )$0'*+,569;/ 9*7 '#7:@B '*@8+9;-<'=+56($0/K©B-<'*) \5/B7:)';-$?|91)^\I@K©Z'%B),9;+,9891|';69?3EJ7:9;)+,©B$
E+';/K2B'*)285&$F2 '1&$FE,E|+9.+,©B$ E 8E +$&-PI
%'&)(+*-,/.102(+*436508791.
E$0) 56/A+,$&)';+,569;/ '*/K2q@KE,';B565+P5/K&@(28$.-.';/ 285:$&)$&/A+';E,%($F+E 56/ U()V=
¤
IGH©B$.56/A+,$&)';+,565+P9*7e'
E 8E+$&-x5?E ©B56;©B28$0%($0/K28$0/1+|9;/+,©B$)$0E,%(91/KE,$HE,%$&$02I d 7+$&/A' )$0E,%9;/KE,$e+,56-$9;7"E,$091/K256EDE,$&$0/'1E+,©B$
65-.5+ 7:91) 56/A+,$&)';+,565+1I GH©B5?E3+©B$0E,56E %B)$0E,$&/A+E E$0;$&)'*r-$&+,©B982BE 7:9;))$028@K&5/K<+,©B$>A@B$&)v+5-.$5/56-<'*1$
)$+),56$&='*';/K2$0;$&/v;56;$0E|+©B$ %91EE,5B5665+ .+9$&¬$F@8+$>1@K$&)5$FE ?5+,©P'-<'*¬56-@K-k),$FE%9;/KE,$3+5-.$J65-.5+0BE,9
+©B$@KE,$&)3&';/ ('*?'*/K&$$+?e$&$0/#';&&@B)'; ';/K2gE%$&$F2 9;7r+©B$),$&+,)5$0='*)$0E,@B+E&I
¤
$0$0='*/K&$ 7:$0$028K'1]\<56EHE,$&$0/ ';Ee91/B$ 9;7+,©K$ \1$ 8EL+,9B),5?281$ +©B$E$0-.';/A+,5? A'*%v';/K2v56-.%B)9=;$ )$+),56$&=';
)$0E,@B+E0I d /K +,©B$@KE,$&) \/B9?3E ?©('=+¥E¨ ©B$ )$0';?H'*/A+E '*/K2g+©@KE&(),$&+,)5$0='*nE 8E+$&-<E/B$0$02P+9v'*/('*0$
;=<>?>A@CBED?DGF?F?FCHJIAK?LCHEMON?IPDQAMOR>AFPSANPTDOIVUWR?>PD
XY<>?>A@CBED?DOZ[U\@PTAN]H^L?KVUWIT_Ha`Y<bD
c <>?>A@CBED?DGF?F?FCHdeNYdVfgH^KPTA>PD
+©B$@KE,$&)$&©K' 569;)+,92B56E9=1$&)+,©B$v;91'; 9*7'#E$F'*)©I $&1$&)'*DE+,)'=+,$0;56$0EJ'*/(2\-.$&+,©B982BEJ7:91) )$&6$&='*/K&$
7:$0$028K'1]\ ';),$D&9;-.%K'*)$02'*/(2J$0E,%($F5?'*6 +,©B$D@(E$ 9;7/K$&1'*+,56;$7:$&$F28K'1]\ 5?E%B56/B%9;56/1+$02'1E+,©B$ \;$ 3+,931$++5/K
$+,+,$&) ),$&+,)5$0 ';),$FE@B+E0IDCD)9;K$0-.EV?5+,©P$¬B&$0EE56;$/B$&A'=+51$ 7:$0$028K'1]\v'*)$ 7:9;@B/K2P';/K2 '.E,9;6@8+,569;/g@KE,5/K
¤
980©B59(4E';19;)5+©B-_7:9;)3E,$&%('*)'=+,$0+?e$&56;©A+5/B.%91E,5+51$'*/K2g/B$01'=+51$>A@B$0) v%K'*),+EH5?EH%B)9;%91E,$02I
GH©B$.)$0'*+,569;/\9*7L@KE'*1$69;$AK6$0EJ56/
#%$&#('
7:9;)-.'*+J';69?3E $F'*)/B5/Kv7:)9;- @KE,$&)J$&©K' 569;)J'*?E9 9=;$0)
E,$&1$&)'*+$&-.%(91)';E&';$FE ';/K2'*?E,99;/P+©B$(';E,56E 9*7LE,$&;$0)';@KE,$&)E ';/K2#9*7L2B5:$&)$&/A+ @(E$0) 1),91@B%KE0I )e'1E$F2
91/ +©B$ 56-<'*;$FEH-<'*) \;$02v+,91;$&+,©B$0) @KE,$&)E&B56-.%(91)+'*/A+3'*/K2g6$0EE56-%9;),+';/A+7:$0'=+@B)$0E30'*/g($ 5?28$0/1+5A($02I
¦ /'*%B%B)91'1©+©K'=+ &9;-K5/B$FEH+,©K56E ?e$&56;©A+5/B+?5+,©g+©B$7:)$0>A@B$&/( S_AK'1E$F2b?e$&56;©A+E39*7+,©B$*8,.9/:1E 8E +$&-
5?E3E,©B9?/v+9.;56;$J;$0)<19A982 ),$FE@K+E&I
3 3 087P9 .
®L ';@('=+,569;/©K';E.E,©B9?/ +,9 $g$&¬+,)$&-.$& 5-.%9;),+'*/A+.5/K'1E5?&'; '*6e)$0E,$0';)©Z2B9;-<'*56/KE+,9 %B),9=1$
E,@K&&$0EE 91) 7§';56@B)$;I =/+$¬+),$&+,)5$0='*K+©B$<G
¤
®VU$&/K©K-.';)^\P©K'1EJ';©B56$&1$02#'gE+),91/B)56E,$56/\)$+),56$&=';
>A@K';5+.9=;$&)D+,©B$ +,$0/ ;$F'*)E 9*75+Ee$¬85?E+$&/K&$;I =/56-<'*;$ ),$&+,)5$0 ';A/B9($0/K©B-<'*) \$&¬856E+Ee'*/K25+e56Ee'*6-.91E+
56-.%(9AE,E,5K$J+9.&9;-.%K';),$'*/ .+?e9<E 8E+,$&-<EH91)$&;$0/v+9 @K281$ +©B$&56)3%$&),7:9;)-<'*/K&$ 91 $0+,56;$&;I
= /#+©B5?E3+©B$0E,56E¥$F+591/ W;¨'<7:@B#'*@8+9;-<'=+56 ($0/K©B-<'*) \g7:9;) 56-<'*1$ ),$&+,)5$0='*r5?E 2B$&;$091%($F2#'*/K2q'
7:)'*-.$?e9;) \g56E%B)$0E,$&/A+,$F2P+,©('=+ ?|91@B62\'*69? ' E56-.5?'*)$&/K©B-<';)^\56/Bv$0;$&/A+J';E5/q+,$&¬A+J)$+,)56$&='*IGH©B56E
$&/K©K-.';)^\ '*?E,9 9 $&)E';0$0EE<5?' ' ''' 5/A+$&),7§';$';/K2
#%$&#('
_K';E,$02R&9;-.-@B/K560'=+,569;/rI @K©
?e9;) \#E+56 /B$&$F2BE+,9g$.2B9;/B$+,9P-<'4\1$E,@K©\'g$&/K©B-<';)^\56/Bv$0;$&/A+J),$F'*65+ 1B@8+J+,©K$ )e$0/K©K'=+©B69;/56E
28$AK/B5+,$0P'*/g5-.%9;),+';/1+ E+,$0%g+,9?H'*)2BEH'*/g$&='*6@K'=+591/ $0;$0/1+FILGH©B5?E©K'*%B+,$&)3';6E,9<'*);@B$FE|+,©B$ /K$&$02 7:91)3'
E+';/K2B'*)285&$F2v56-<'*;$2B'*+';K';E,$ 56/K&@K2B5/B>A@B$0) +,9;%K560E'*/K2g91),)$0E,%(91/K2856/B),$0$0 ';/K$ @K2B;-.$&/A+E0I
P75 3 04791.&
¦ +©B9;@B1©P+,©B$ *-,.0/21.E E+,$0-^©(';E3/K9*+ $&$0/q';2B';%8+,$F2 +,9v';/PE,%($F5BA( 2891-.';5/rB+,©K$ +?e9'*%B%B65?&'=+591/
$&¬8';-.%B$FE<28$0E)56($F2Z56/8$0+591/ Y E,©B9?k+,©K$#%(9;+,$&/A+56';e9;7 5?E@K';5/B7:9;)-.'*+,569;/~),$&+,)5$0 ';I 1 / 1
/ 1 Z56E'#/K'=+@B)'*L';%B%B6560'=+,569;/ A($&?2 7:9;) 56-<'*;$v),$&+,)5$0 ';L';E'>A@B$&)\E+';)+5/B#%9;56/A+'*6)$0';2 q$¬85?E +E&I
A+561+©B$ 5?E@('*87:$F'=+,@K),$FED/B$0$02+,9($ ';2B';%8+,$F2+,9 +©B5?ED%K';)+56&@B6';)D%B)9;B6$&-P'*/K2.5?E@('*KE,$0';)© ?56-.91E+
65B\1$&q/B$0;$0))$&%K6'1$+,©B$<@(E$<9;7V\1$ )?|91)2KE 91) 9828$0EE@K© ';E+©B$<¯ 56$&/K/K'#9828$<$00'*@KE,$+,©B$E,$0';)© 56E
K'1E5?&';.E$0-.';/A+,5?3'*/K2.5?E@('*B7:$F'=+@B),$FEL';),$3E+,56(7§'*)e'X?e' 7:),91-$&56/B 9;7rE$0-<'*/A+,5?/K'*+,@B)$;I=+|©K'1ED$&$0/
E,©B9?/g©B9?|$0;$0)|+©K'=+5?E@K';E$F'*)©v5?E3'@KE,$7:@Br&9;-.%B6$&-.$&/A++99;+,©B$0)H+,$F©B/B5?>1@K$0E0I
$0;$0)';A';%B%B6560'=+,569;/ AK$&?2BE ';),$e28$ AK/K$027:9;) / ,9, / 1 / 1 ,/ I ®LE,%($F5?'*6+,©K$|+$¬+,@K),$'*/('*E,5?E
9;7 UeGt@B/K<5-<'*1$0EHE,$&$&-<EH+9.($ '%B)9;-.5?E56/B AK$&?2 7:9;)H+©B$@KE,$9;7 &9;/A+,$0/A+ K';E,$02+,$0©K/B56>A@B$FE&I
9 .5 &8791.&
d @B) *-,.0/:1%B)9;;)'*- 28$0-.9;/KE+,)'=+$0E +,©B$7:$0'1E56B565+ P+,9a?e9;)\a?5+©\1$&)g?'*);$7:$0'*+,@B)$E,%K'1$0E ?©B56$
E+,56 %B)9=562B5/B7§';E+J'1&$FE,E3+,9g;9982P),$&+,)5$0='*),$FE@B+E0IJ¦3+,©B91@B;© ';$0) PE,5-.%B6$7:$F'=+@B),$E$&+ ?H';E @KE,$02
+©B$ )$0E,@B+E9*73+©B$PE 8E+,$&- ?e$&)$vE'=+56E75/B '*/K2~'?'*);$56-.%B)9=;$&-.$0/1+5/~),$&+,)5$0='*H>1@('*65+ 91@B?2 ($
)$0'1©B$02v+,©B)9;@K;© E,$&1$&)'*285$0),$0/A+3-$&+,©B982BE39*7n@(E$0)5/A+,$0)'1+591/I
®L ';@('=+,569;/v%B),9=1$02.+9$+,©B$$0EE,$&/A+,5?'*%9;56/1+H56/v7:@B),+,©K$&)';28=';/K56/B +©B$ AK$&?29;7n5?E@K';(56/87:91),-<'=+591/
)$+),56$&='*I '*/ #'*%K%B5?&'*+,569;/KE'*/(2q'*6;91),5+,©K-.E $¬85?E +J5/q+,©B$IAK$062K@8+5+J56E/B9?p56-.%(91)+'*/A+ +©K'=++,©K$
&9;/KE,9;6562K'=+,$'*/K2+,©K'*+%B),91-.56E,5/Kv)$0E,$0'*)©2856),$F+591/KE 0'*/\($.5?28$&/A+,5BAK$F2#+,9 7:@B),+,©B$0)';28='*/($+,©B$IAK$&?2I
¤
$F'* ?|91),?2 '*%B%B65?&'=+591/KE ?56|/B$&$F2 E@(©Z'P;@K';)';/1+$&$.9*73E,$&)56&$'*/K2 -@K© -.9;)$<$091/B9;-.5?.5/A+$&)$0E+
-<' $;$0/B$&)'=+$02v+,©B)9;@B1©+©B56E0I
A+56-@K© ?|91)^\P/B$0$02BE +,9g$2891/B$7:9;)J),$F'* '*%B%K5?&'*+,569;/KE';EE©K9?/q56/$F+,569;/ YBI K$0'=+@B)$0E /B$&$F2
+9($';2B';%8+,$F2g+,9vE,%$05BA( ';%B%B6560'=+591/289;-<'*56/KE3';/K2g+,©K$ U()e¯e=
¤
';%B%B6560'=+,569;/(E3/B$0$02g+,9v($5/A+,$0;)'=+$02
56/A+,9+©B$ ?e9;) \K9?I¦ 1$&)v56-%9;),+';/A+ ;9A'*7:91)3+©B$ 7:@8+@B)$5?E 28$AK/B5+,$0g+,9 ;$0/B$&)'=+$ '$&/K©B-<';)^\56/B
$0;$&/A+H7:9;)H+©B$ AK$062I
3
7A02*4( ,/.102*49 504791.
4';@B;-.$&/A+'=+,569;/\28$?'g>1@('*/A+,5+
"
$28$.289;/B/
"
$&$FE 5?E@B$06$0E/@B-
"
$0),5?>A@B$0E ';&&$0EE56B6$0E +';/1+E,@B)J4= /A+,$&)/B$&+
>A@B$ A5?'24';@8+,)$0E|-
"
$0285?';ED+,$06Ee>A@B$ ?'+
"
$&
"
$0A5?E,591/91@v28$FE 91@B),/('*@8¬<'&)
"
$ "
$?' / "
$F$FE,E,5+ "
$328$2
"
$&1$&69;%B%$&)e28$0E
91@8+,566E 28$;$FE +591/P%($0),-.$+,+';/1+ 45/(28$¬B'=+591/P$+ ?'.),$F©B$&)©B$'*@B+,9;-<'*+,5?>1@K$J2B$2898@B-.$0/1+E3-@B+5-
"
$F285?';E0I
4@8+565?E,'*+,569;/ 24';/B/B9*+'=+591/KED7:91@B)/B5$FEL%('*)H@B/v91%($0)'*+,$0@B)L©@B-<'*56/v$FE +H@B/B$JE,9;6@8+,569;/ %K'*),+,56$&6$>A@B5%($0),-.$+
4'1&*$0E3E
"
$0-.';/A+,5?>1@K$'*@8¬P9; $+E )$&-<'*)>A@K'*B6$0E0I 4@8+5656E'=+591/24'*/B/B9;+'*+,569;/KE %($0@8+ +9;@8+$7:9156E $&/B1$&/K2B),$0)
28$FEv%K),91B$&-.$0E0'*) $q+,$¬+$\2
"
$F)5=';/1+@K/B$q56-<'*;$q$0E+v+,)F$FEE@K $0+,572$FE69;)E>A@456 ';),56$\E,$&69;/R6$0E
56/K28565628@(E&I 4'*/B/B9;+'*+,569;/J$0E+$&/91@8+,)$ +,)0$0E&9@8+$&@KE,$;F$+rE,$&@K$FE$FE56-<'*;$FE>A@B5;91/1+@K/5/A+
"
$&)$+91--.$0)&56';
19;/A+$+),$J'*/B/K9*+
"
$&$0E0I
!
$FE-.56569;/(E5-<';;$0Ee)$0E+,$0),91/1+E'*/KEH-.9 ;$0/g24'1&*$0E0I
'<),$F©B$&)©B$ 2456-.';;$FE E04$FE + )
"
$0
"
$&
"
$&$$0EE$0/A+,56$&6$2K'*/KE 28$0E289;-<';5/B$FEH+,$0>A@B$$ 9;@B)/K';5?E-.$v¥§566@KE
+)'*+,569;/Z24'*),+,5?6$0E¨J$+2B'*/KE$FE - "
$F2856'*+,©$0>A@B$0EJ9@ $FE 56-<'*;$FEJ7:9;/A+';@KEE5|%K'*),+,56$245/;$0/A+'*56)$0E &9;-.-.$
28$.65)$0EJ2B';/KE$FE K5B6569*+,©$0>A@B$FE&I 'v)$0©K$&)©B$2456-.';;$FE $FE+ "
$01'*6$&-.$0/1+J/
"
$F$FE,E'*56),$%(91@B)J$FE -@KE
"
$&$FE
¥§),$F©B$&)©B$L24@B)$0E24'*),+¨=6' )5-.56/B9;69;15$3¥§$&-.%B)$&56/1+$0E2856;5+'*6$0E0 ),$F91/B/K'*5?EE,';/K$ 28$|A5?E'*;$FE¨06$0En56/KE
+5+@8+EH%9;@B)H?'%K),91%B),5
"
$&+
"
$56/A+,$&66$0+@B$&66$.¥§),$F©B$&)©B$28$ -<';)>A@B$FE¨D9;@v?'-
"
$028$F56/B$;82891-.';5/K$ 9@ >A@K'*/A+5+ "
$
2456-.';;$FEE91/1+%B)9828@B5+,$FE¥:%K';)3$¬8$&-.%B6$E,0'*/B/K$&) UeGJ8%B©B9;+,9AE28$-
"
$&?'*/B91-.$0E¨I
45?2
"
$0$28$6' )$0©B$0)©B$%K'*)J6$&9;/A+,$0/A@q$0E+24$&¬A+)';5)$';@8+,91-<'=+,5?>A@B$&-.$0/1+J28$0EJ0'*)';+
"
$&)5?E +56>A@B$FE9;
$F+,56;$FE|>A@B5)$ r$+,$0/A+|'*@-.56$&@8¬6$ &9;/A+,$0/@56E,@B$&24@B/B$ 5-<';;$;I U|$FE|0'*)';+
"
$&)5?E +56>A@B$FE 9;@ 2B$0E)5%8+$&@B)E0
+$&6$FE3>A@B$28$0E3&9;@B6$&@K)Ee9;@#28$FEe+,$&¬A+@B)$0E0BE91/1+$0/g
"
$&/
"
$&)'*24@K/g/K51$0'*@PE
"
$&-<'*/A+56>A@B$J';EE$ JK';E0I
'q285?E +),56B@8+591/698&'*6$v28$FE.9;@K$0@B)E9;@~$FE&9;/A+,91@B)E2B'*/(E6$0E56-.';;$FEE,9;/A+28$FE.&'*)';+
"
$0),5?E+,5?>1@K$0E
"
$01';$0-$0/A+3@8+,565?E
"
$&$FE&I 'E$0;-.$&/A+'=+,569;/#24@B/B$5-<';;$ $0/)
"
$&;569;/(E' ;$02B$0E '*++),56B@8+E E,5-.566';5)$0E3%($0),-.$+
?'),$F>1@$+$ %K';)e)
"
$0;569;/<9;@ %K'*)H)$&?'=+591/v$&/A+),$%B6@KE56$&@K)Ee)
"
$&1591/KE&$J>A@B5
"
$0$0;$36$J/B56;$0';@ E "
$&-<';/1+56>A@B$28$0E
0'*)';+
"
$&)5?E +56>A@B$FE&I
'P),$F©B$&)©B$<%K';) $g91/1+$&/@R¥§';@ -9 1$&/Z28$ &'*)';+
"
$0),5?E+,5?>1@K$0E$¬+,)'*5+,$FE '*@B+,9;-<'*+,5?>1@K$&-.$&/A+¨/4$FE +
+9;@8+$7:9;5?EP%K'1E#E
"
$0-<'*/A+,5?>A@B$\$&+#@B/B$ )$0>A@$&+,$ '*%B%K';),$0-.-$0/A+PE,5-.%B6$ 91--.$ 9;/A+,)$G_-915+,9;@B+,$0EP6$0E
56-<'*;$FE >A@B5 &9;/A+,56$&/K/B$&/A+P@B/©K'*+ ~/4$0E+g
"
$&/
"
$&)'*6$&-.$&/A+%K'1E %91EE,5B6$;I U|$&++$ %$&),+,$ 245/B7:9;)-.'*+,569;/KE
E "
$&-<';/1+56>A@B$FE E&4'*%K%($06$36$
A
/
/ ,P0/¥:9;@
/ , .¨I =K$0E+'/K9*+,$0)L>A@B$36$7:91EE
"
$E
"
$0-<'*/A+,5?>A@B$
7§';5+ E,@B5+,$v'.@B/K$'*@8+),$2
"
$&;)';2K'=+,569;/g28$456/87:9;)-<'=+591/g65
"
$&$'*@#0'*%8+$&@B)FIVU|$+,+,$2
"
$&1)'12B'=+591/vE&4'*%K%($06$ 6$
O/ / 1 ,/e¥§9;@ / 1 .¨&9;-.-.$-.9;/A+,)
"
$J2B'*/KEH?'.51@B),$ 1I
ª "
$0';/B-.9;56/KE&86$0E3)
"
$FE@K+'=+EE,9;/A+ E,9;@B1$&/A+3E,'*+,5?E 7§';56E'*/A+E&B0'*)36$0E30'*)';+
"
$0),5?E +56>A@B$FE|2B$ K';E _A/K51$0'*@gE91/A+
7:)
"
$0>A@B$0-.-$0/A+H-.5?E$FEH$&/#91),)
"
$06'*+,569;/' ;$F$91/A+,$&/@PE
"
$&-<'*/A+,5?>A@B$J24@K/B$5-<';;$;I
CL@KE,56$&@B)E+$0©B/K56>A@B$FE&9;-.-.$|6$ 1 // /2/ / ¥:56/87:9;)-<'=+591/28$e)$+,91@B);$&/('*/A+ 2B$|4@B+,565?E,'*+,$0@B)¨
91@g4'*%B%B)$&/A+56EE,';;$<'%K'*),+,56)328$456/A+,$&)';+,569;/P' ;$F 4@B+,565?E,'*+,$0@B)39;/A+3%9;@B)K@8+ 24'*-
"
$&6569;)$&)H$FEH)
"
$0E,@B+'=+E
28$FE)$0>A@$&+,$0E0I
3 7A02*4( "! ( 5 ( *45 (#%$Y7P.'&9"*)( 3 04791.& 7P& ( ( & 36* P(5 9 .+*
08(+.
' E,9;6@8+,569;/%B),91%(9AE
"
$&$D%9;@B) ) "
$&%9;/(28),$|'*@8¬%B)9;B$0-$FEn2B$|4';/B/B9;+'=+591/ +,$06E >A@B$e$FE 9@B+E '*@B1-.$&/A+
"
$FE
$&+?'vE,@B $F+,565+ "
$;$FE +J6'v),$F©B$&)©B$2456/87:9;)-<'=+591/KE 5?E@K$&6$FE %K';) 6$.9;/A+$&/@¥MU|91/A+,$&/A+_ )H';E,$02P¯ 56E,@K'*
=/87:91),-<'*+,569;/
¤
$&+,)5$0='*0U()e¯e=
¤
91@ U|9;/A+$&/A+ _ )e'1E$F2 =-.';;$
¤
$+,)56$&='* U() =¤
¨K'1E
"
$0$E,@B) 4$&¬+,)';+591/
';@8+,91-.'*+,5?>A@B$28$0E56/K285?$FEH56E,@B$&?E24@B/B$56-<'*;$1I
Information
Abstraction Monde réel
Image
Caractéristiques Fossé sensoriel
Fossé sémantique
!" #"#%$&#"'%(*)+$-, .
/ 10'2()"!345$& 6 #)+$7)982 :3;# !" <) '$ =:>%!:% <:%((1"#?45$&($0)!<"2 A@.
<0'2()"! =0'1#-)7B4C-DECGFIHKJL+MNFIMO+CPHQL+RTS%U'MN%$V0' WRXML+CPRTS%YS%H!R=O[ZCPY*L%\SED]22$7 8-0' 2$^=;_2 =$2 '$&#
(_0'`a(*)+-b#)N #)+$K)982 :V0[c) '$ b0'(*)"4d;Q% $3e%$ ; !)+$.)fYhgS4OS^i>CPHjS $=b :% )"
;Q V#kc)+!)#"l'301#);mal'"2#"230'#Xc);;!) "#?8a- #[ma (*)+7;Q !V:>2(];! !0'3:%((%$&#"4<()4
$$^)+"$ 3;!)3#Xcn1"#X.*)KJ_DEoi^pFIqF\CGSr $1"(;Q$)+$];Q !A)"$;_ :%%;'$"2W8a- #"#`()
) !&;Q r)+!)#"l'%*#s:>2(];Q$ (%$70?c t '$"#)I$% 7)98 :u0 *$%G):% . / s0%" K0'2()"!
45$V;!!:>;!)#" (] $V#"%7v)*:%%# 0'A#Xc"CPH_RTS%MLi%RXCGFIHwpF+YxY*S>y2YL2ip'CPHQS%.dc"CPH_RTS%qPqzC{\S>HjiSKLIMERXC|}i%CGS>qPq"S]45$3)+ !
'$"#-' A;Q 3)+!)#"l'%<#Xc$%^):>$s)982 :#Xc '$"#-)+$% !V>$;_2 )(~%#"2 <#"4& #"$)I$^<0' :^m :^m4
;!)< 6;a:% _b0[c);;%$-)+2.)rMS^i^pS%Mip!SO[ZCPH >F+MEYL+RkCGF+HDNRSRXU!S%qPq"SED $&+e ! (] $&#"10'2()"!
, < c);;a:^m!*#"r;# !x07#-)u :^m :^m70?c'2(*)I$"2!x8- %##"4A;!)x#7:%$ a [.W)s (N#-)+!:%
-0'30!)+!b# =2$%^):>$! `a#"4K%8I)+# !)+$! `a#"1$':^I)+0'4<:%)+^):>$ -$-,2 ! 2 7#-)]:>_5$ !:>$60'
, [e%$4:%((]0)!3#"*l'5$ v%(~CJS%MK0b :>"$30)!3#"*:^m!);{$] !"8I)+$4.x[0'2()"!]0'4* LID%SEDfOS
O2FIH!HAgS S>D6 $(;_2$^)+$;_2 f5$':^%]# ]"(*) ]%$# *0 :>";'$% ^]0?c(*)+2 `}:>2(;'$7$ 0'6#-)
2)!0'>';= %_:>V 6()+$kv%0'145$"2r0'2)!0' =, !)2${$ <0[c'(*)I$"2!%.
)(# N0a:% (%$N8a %#- `% # A#"4A()4122$x;- 1 :>_-0b )+$W0!)+!A:%>$$f$m[v42`
(*)+-b#)x :^m :^m;!)+=#3:%$ a 7 c);;#, 1)+ _v)]0?c)+ '$4b(~ 0'-) . b$ :^m-, =0'2$b#? $}G){$
%$)+$b-:>[;Q !^)+%$<)+-' (%$e%$ $#"-'% < =# <0'':> !(] $b$%a$ # `!24G#"A[`'#-)](N !-,2 !4E`
#-)38-0b %$#"4;!)+2 b%[. / 0' !kv 4;Q% !8%$d0?c)+##" :%$ ";!#" !% ^(~ 0'-)=G"(*)+2 `9$%$`
8a-0}%%`')"(*)+$[`' 6la!:^m-)I$K#"A: )74:^mb )$^E.
0'"V $ $ :^m-, $#"-'% ;Q #-)4:^m%^:^m;_)+#":%$ `sl:>2(;-#"4:%)I
^):>$ -5$, 4K8a- !%##"4%`3#"46( 4u0'("#-)+"$2`V#5$a:^I)W0 u0'2= r>$w0'46>'%(;# u0
l'5$ v%( ]0'r4:^m%^:^mK$*0b4:>{$ ]0)+!x#6:^m_)+;"$r@.[ 0'"V%%$x(~ 0)2Nl$%2)#" (%$
CBIR
Caractéristiques
Traitement de requête Interface Stockage
Feedback
M decine é
Psychologie Interaction homme-machine Traitement
d’images Vision
par ordinateur
Recherche d’information
textuelle Bases de
données
Intelligence Artificielle
56;@B)$
° ')$0©B$0)©K$ %K';)H$ &9;/A+,$0/A@g$0E+3$&/g)$&?'=+,569;/P' ;$F %K@KE,56$&@B)EE,&5$0/K$FE&I
3 7A02*4( P . & &0( ( ( 9 * 3 *4( 5 ( *45 ( 36* P(
5 91.102(+.
$e%K),9 $+ *-,.0/21¥§¯ 5?E@('*=/87:91),-<'*+,569;/CL),98&$0EE56/B37:91) ®D/B©K';/K$F2
¤
$+,)56$&='*¨n$0E+ (';E
"
$eE,@B) %B6@KE,5$0@B)E
+$0©B/B5?>A@B$0E2B$ )$0©B$0)©K$ 245/B7:9;)-.'*+,569;/KE|+$¬+,@B$06$0E&9;-.-.$J$FE A©B5$0)Ee56/;$&)E
"
$0E ¥:=/;$0)+$02v56$FE¨|%9;@B)
6$E+,98]\='*1$ 28$2891/B/
"
$0$0E016$),$0$0 ';/K$ 7:$&$F28K';]\<%9;@K)e45/A+,$0)'1+591/v' ;$F34@8+565?E,'*+,$&@K)e$&+6'%(91/K2
"
$0)'*+,569;/
7:)
"
$0>A@B$0/A+,56$&6$28$FE28$0E)5%B+,$&@K)E0I U|$++$%(91/K2
"
$0)'*+,569;/ $0E+H(';E
"
$&$JE@K)$FE328$&@B¬ 91/KE+'=+'=+,569;/(EE@B56='*/A+,$FE
@B/B$&'*)';+
"
$0),5?E+,5?>1@K$e%K)
"
$0%(91/K2
"
$0)';/A+,$2B'*/(ED456-<'*;$289;/K/B$3@B/B$ (91/B/B$J28$0E)56%8+,569;/28$$&++,$ 5-<';;$
6'v7:)
"
$0>A@B$0/K$24';%B%K'*)5+,569;/q28$<&$++$0'*)'=+
"
$&)56E+,5?>A@B$ 2B';/KE45-<';;$;/K9*+
"
$ ¥:+,$&)- 7:)$0>A@B$0/K B¨ $0E+
'*69;)E
"
$&
"
$&
"
$0$
@B/B$ &';)'1+,$0),5?E+,5?>1@K$7:)
"
$0>A@B$0/1+$\2B';/KEg6'916$0+,569;/V/K$ %$&)-.$+P%K';Eg@B/K$ 9;/K/B$ E "
$0$F+,569;/rI¥:?'
7:)
"
$0>A@B$&/($J2B'*/KEH?'.916$0+,569;/8/B9;+
"
$ K916$0+,569;/ 7:),$F>A@B$&/K $0E+
"
$0
"
$0
"
$&$ ¨
$0E28$FE,&),56%8+,$0@B)E' ;$0 @B/ "
$&
"
$&
"
$ $+3@B/ P7§'*56B6$ E$0),91/1+H7§' 19;)56E
"
$0E|&';)e56?E3E91/A+e+)0$0EH285?E,&),56-.5/K';/A+E0I
4$FE%K'1$28$FE0'*)';+
"
$&)5?E+56>A@B$FE $FE +.'*@KEE,5LE56-.5?'*56)$v'*@8¬ 2898@K-$0/A+E+$¬+,@K$&?E& &';)56# '#@B/Z1)';/K2
/B91-B)$ 2B$ &';)'1+
"
$&)56E+,5?>A@B$0EJ%91EE,5B6$0Eg¥ Q W
±;±;±
¨-<'*5?E©K'1>A@B$56-.';;$ $&/&9;/A+,56$&/A+E,$&@K$0-$0/A+@B/B$
%$+5+$ %K';)+5$\¥
±1±;± °;±;±1±
¨I $vB@8+.28@Z%B)9 $&+ *-,.0/:1g$FE + "
$&A'*6$&-.$&/A+28$ )
"
$&$0) @B/B$g'*)©B5+$0+,@B)$
-.9828@B?'*56),$>A@B5B%K@B56EE,$ $+,)$285?E+),56B@
"
$0$e7§';566$&-.$&/A+0I $3E 8E +0$&-.$e-.92B@B6';5)$H%B)
"
$0E,$&/A+,$e@B/';@8+,)$' ';/A+'*1$+
©K'1>A@B$|©B$0)©K$&@B)n%($0@8+n+)' =';56$0)e' @B/B$|%K'*),+,56$e2B5:
"
$&)$&/A+$L28@69;156&5$0 6$|%K),91;)'*-.-.$D),$FE +'*/A+r/
"
$0'*/K-915/(E
@8+565?E,';B$ = $&/)
"
$FE@B+,$$%B)9 $+ .0/ 1 /P¥ Jª F¨ '*%K%($0
"
$ = Gg¥Jª = -<';;$56/K2856/BPGr99;¨I
U|$0@B5_&5|$FE+7:9;),+,$0-$0/A+'*/()
"
$2B'*/(E 6$0E+,$0©K/B9;69;15$FE ?|$0 +,$06E>A@B$v6$v?'*/K1'*1$28$ 2B$0E)5%8+591/)
%9;@B) $FE A(©K5$0)E69;v$+ ?'91-.-@B/B5?&'*+,569;/#$&+ $FE
¤
E¥§3/K57:91),-
¤
$FE91@B)&$ 98&'*+,91)¨e%9;@B) 562B$&/A+,5BAK$&)
28$FE56-.';;$FE&I
'56;@B)$ >-91/A+,)$6$0E2B5:
"
$&)$&/A+E9;-.%91E'*/A+EH28@#E 8E+0$&-.$ *-,.0/21$+36$&@B)EH56$&/(E&I
$0EJ)$0>A@$&+,$0EE,9;/A+$$0+,@
"
$&$0E ' %('*),+,56) 24@K/B$ , /:1 / ,, /P 1\¥5= r91@ Je=)'*%B©K560'*D E,$&)
=/A+,$0)7§'1$ ¨I^ /B$ %K'*),+,56$\7:9;/K2B';-.$&/A+';$ 28@ E 8E+0$0-$ $0E+P$ . 1 / / 1 0, ,
#%$&#('
<>?>A@CBED?DOZ[U\@PTAN]H^L?KVUWIT_Ha`Y<bD
G<>?>A@CBED?DGF?F?FCHJIAK?LCHEMON?IPD
<>?>A@CBED?DGF?F?FCHJIAK?LCHEMON?IPDQAMOR>AFPSANPTDOIVUWR?>PD
Indices stockés Méthode de
stockage
Sch ma de pond ration
é é Paradigme
de requête Algorithme
de feedback
Machine de recherche Extraction des
descripteurs
Interface Analyse MRML
Analyse MRML Interaction avec l’utilisateur
et nouvelles images soumises
MRML Nouvelles
images
Génération de la requête
G sultats énération des ré Pr sentation
des r é
ésultats
Addition des nouvelles images
Nouvelles images
Collections d’images
!)]$ !:>$ 10' h)98 :V$2 !<:>4<:>2(];Q2)+$^%.
u #"$(]40'-)<%$" 89)#s)a ;#-)+! !)4>. / f;+$':%#*;_ (>$0'K'%;_)+%1#Xc$%G):%K0'f#-)u(*)I
:^ms0'6 :^m :^m!7%$*r$ 82v)W#-) !)u0' *0b%82%#;;Q%(%$^]0b :%"$0)!#"4*:^m!)+;!{$4 %$
A#Xc);;%$-)uv)6;!)+$A0'f#Xc$ )2:E$ )984:]#kc '$#)I$% A%$N !A#kc 89)#" _)I$. ;_ (>$
):%:+v N5$^)+!0)0'>$)+ '$(*)I$, K) l'$ v (.s)s()2:^mK0'74:^m%^:^m:>2{$N#-)u , [e%$K0
#Xc$ G)2:>>$N:% x !*4, ?e>$x$ *!)2)2$1 1#"4A:%))2:E$%$-, 5$':^d% 0)!#-)7_)
0'A0=% =2 6>a$^)+"$4<0'" :>$ (] $V#kc"(*) !2 1;_)=%_:>10)+_<#)*:%##"4:E$"2[.d[1!4 #"$)+$
45$%! "$7 b%!* N#-)s!)2r0?c 7!:>$~0'r;Q!0b%^)I$` ;!)+^)0"2(]70?c$ )2:E$~>$x !
)#"2{$m(3;Q !<#"3%40'!)2:^Q.
d#" !% ^"$%G):>4$%$<0b 8 #"2;;= 0)+!#"V: )0'<0' *;5%$ `;_)+>' (];!#""$ G)2:>=%)98I)
_)+
/
m!)+(%1G >`!)+![,2 c !A)+ '$2$%G):%3_)'%3 <# <$ :^m!#2"4}b%r%u V.
:^m_)+;"$!r0b4:>{$% 0b%$)"##l'5$ v%(CJ!S>M7>$A4:%)+^):>$ -$-,2 ! .Ac5%8I)+# !)+$w0'CJS%M
45$&%Q4:E$ =1 <;!#" !% ^=!)10'A0'2= =0?c"(*)+2 <)!r01(]2$%=#), !)#""$10'4= #{$^)I$^%.
"$#%'&(*),+.-0/214365!)7-8+.%9:)7(<;5=%?>-890@BAC)7(<@D(FE,%G),-HC+I-J)K%'&&+.-H5L)7(FE,E,%MN-0O-
@PAQ(<5L),-8+.%9:).(F;5
dc$%^):>$w)982 :1#Xc '$#"-)I$ [c $3;!)2% !#" (] $3#"("$ rv)7#kc2$%G):%x0?c '$#)I$"2w(*)+-:%'
$" 2$;# !" x);_4:E$^%.RV0'4A;Q$x#"4N;# !x"(;Q$)2$^A45$]#)w8"$4K0?c2$%^):>$0?c ~;!
2)(]("$ )2:E${5..S&2(*)#" (] $ `j :%!0'3:>2(]($ (];_b0%;Q_&45$=%2)0b&:>2(](3#)N_2!
(*)I'(*)+#3;Q !< ul'$ v (]8a^)+(] $b$%^):>$"5.
/
%$$$m[v4;;Q2;#" _% ^<(%$m'0'4=;_2 & 0' 3#$ (;!V0'1! ;_2!0'A#-)]4:^m%^:^m2.[
$ :^m-, 1$!) 3 # 3(~>$m'0' 0'#-)K :^m!%^:^mx0?c'(*)I$_V$>a$ !%##"4%.[43$^)I$%2"4
;!:>;!)+# =;Q !&)+(~%#%b#)]8a{$ 1$A
T
4:^m%^:^m6 !f HQF+Y %MSwMS>D^RXMS%CPH!ROS iL+MLi%R!gS>MEC-DERXCVU>U!S>DBW3#"4f0' :>;'$ *$*$> ;_)+f#%
"(;Q$)!:>KG;_2!0b )+$_& #"2~iGW>$]RXWQ# !0'-:> 8a #&$ v =!4,2 !%$&0!)+!#)K:>## :E$"2
;_2$%$&;!)2=_4)+ !:% ;60?c"'2(*)+$6W
T
4:^m%^:^m !& HQF+Y %MSNMS>D^RXMS%CPH!R<O[ZCPY*L%\SEDPW_# <(*)+2 &, $& r_)&0'A:%#)2%( 2$4`!)+;! v4
, [c !W;Q ^:> $)+2x0'*: )+^):E$%-5$, 4&)+"$W>$N 89)#" =`j[c$1;^)I$-, %( 2$;# !#-)7;Q2"#{$
0?c"e>$:>#-)'% b0)!<# &@Y]2 BYx;! (]%^b #{$^)I$^b)Zf:^mb 1v)]#Xc54:>^)+[.
N0 :>";'$% ^1)984: ik #" 8d rG>$N !f;_2!0b )+$WG)+#41;! %$AQ ) !:>2 ;;# !A0'*$%(;!
;Q N#kc5%8I)#" !)+$W;!)+^:>*, [c"#-A:>2$% $N0' 1#-5$ A0?c()4;#" _1#"2 ! .K 1:%>$$f^)+-2[`[#
)+W0'8a{$ 45$1(%#"#% !A,2 !x#"= )".N[ 3$ $; !8%$1, [c !W)+ 0'8a"$ x(;_2$^)+$1 $
n56;@K),$ @C 456/A+,$0)7§'1$ /K'\;$XU|©('*)-$0)0I
$0E<E+,)'=+
"
$&;56$0E245/A+,$0)'1+591/' 1$0 4@8+,56656E'=+$&@B)E,9;/A+.@B/R'*@8+),$g%(915/A+56-.%(91)+'*/A+0I 3/ @8+5656E'=+$&@B)
$&¬%
"
$&)5-.$0/1+
"
$ '*)),56;$ /B9;)-<'*6$&-.$&/A+' 9;B+,$&/K5)q2B$0E#)
"
$0E,@B+'*+EP/B$&++,$0-.$&/A+-.$&566$&@B)E>A@4@B/p@8+5656E'=+$&@B)
-.9;56/KEv$¬8%
"
$0),56-.$&/A+
"
$P28@ 7§';5+ 2B$#4@8+,56656E'=+591/V28@ 7:$&$F28K';]\I®D/R%K';)+56&@B56$&)Fe$#7:$0$028(';]\/
"
$&A'=+,57J$0E+
E,9;@KE_A@B+,565?E
"
$q%K';) @B/@8+5656E'=+$&@B)2
"
$&B@B+'*/A+F $&/A+)' /('*/A+v@B/B$ ) "
$&%9;/(E$\5/K'12B'*%B+
"
$0$\28@ E 8E+0$0-.$;I C 9;@K)
%K';56$&)#' $g%B),91B$&-.$; /B91@KE%B)9;%91E,9;/KE24' $F+$&).@B/B$g%(91/K2
"
$0)'*+,569;/V¥§
"
$0K$0),$0-.$&/A+¨/
"
$&1'*+,56;$v';@8¬Z56-
';;$0E /B91/q-<'*)>A@
"
$&$FE3%K';)J4@8+,56656E'=+$&@B)FI
!
$FE
"
$&='*6@K'*+,569;/KE 9;/A+J-91/A+,)
"
$>A@B$<$&++,$+,$F©B/B5?>A@B$2B9;/B/B$0/A+2B$
9;/P)
"
$0E,@B+'=+E&I
¦ @o91/1+)';5)$; @B/K$@8+5656E'=+591/ $¬B$FE,E,56;$ 28@ 7:$0$028(';]\{/
"
$&A'=+57R%$&@8+_9;/(28@B56),$ ' %(91/K2
"
$0),$0)
/ "
$&1'*+,56;$0-$0/A+28$0E&'*)';+
"
$0),5?E+,5?>1@K$0E%($0)+5/K$&/A+,$FE %K';))'*%B%9;),+ '#?'#),$F>A@ $+$;I 4'*6;91),5+,©K-$2B$
¤
98&©B5
%$&)-.$+ 24'*++
"
$&/@B$0)&$L%B)9;B$0-$1IU|$+ '*6;91),5+,©K-$e&';6&@B$eE
"
$&%K';)
"
$0-.$&/A+$FE%K'*),+,56$0En%(9AE5+,56;$FEr$&+/
"
$&A'=+,56;$FE
28@P7:$0$028(';]\g%(91@B)36$0E 915/(28),$v'6' AK/rI $0E )
"
$FE@K+'=+EH918+,$0/@KE3E,9;/A+ E,@B%
"
$0),56$&@B)EH'*@8¬#'*@B+,)$0EH+$0©B/B5?>A@B$0E
%9;@B)56/A+
"
$0;)$&)H6$ 7:$0$028(';]\/
"
$&1'*+,57I
U|91--.$ 9;/E+,98]\;$+,9;@B+,$0E6$0E';+591/KE2B$ 4@B+,565?E,'*+,$0@B)2K'*/KE@B/OA(©K5$0)28$ 7:9;)-<'=+
#%$&#('
56H$0E+
%91EE56B6$ 24@8+5656E,$&)<&$++$ 56/87:91),-<'=+591/Z%9;@B).'*-
"
$0569;)$&)6$0E)
"
$0E,@B+'=+E E,@B)@K/B$
"
$0©B$06$<+,$0-.%(91),$06$v%B6@KE
69;/B1@B$;I U|9;/K/K'*5?E,E'*/A+3+9;@8+$0E6$0E 5-<'*1$0E>A@B5E,9;/A+-.';)>A@
"
$&$0E $&/KE,$&-B6$0E2B'*/KE @B/B$
"
$+'*%$28$7:$&$F28K'1]\
91/g%$&@B+ 9;/(E+'=+,$0)H$FEH7§'*5+EE,@B56 ';/A+E6
28$0E 56-<'*;$FE -.';)>A@
"
$&$0E\91--.$%($0)+5/K$&/A+,$FE 2B'*/KE ?'- $&-.$
"
$&+';%($ 28$7:$&$F28K';]\p91/A+ 28$FE &'
)'1+
"
$&)56E+,5?>A@B$0E|56-%9;),+';/A+,$0EH$0/g&9;-.-@K/ ¥91/B/B$¬8569;/g%(9AE5+,56;$ ¨
E5 @B/B$#56-.';;$P$0E+-<'*)>A@
"
$&$P91-.-$P%$&),+,56/B$&/A+$#$+v@B/K$'*@8+),$#91-.-$#/K9;/%($0)+5/B$0/A+,$2B';/KE<?'
" "
¥§&9;/B/B$&¬8591/ / "
$&1'*+,56;$ ¨I
)H';E
"
$#E,@B)v$FEv28$0@8¬7§'*5+E0e91/R%($0@8+ 0'*?@B6$&)@K/ 7§';+$&@B)g245-.%9;),+'*/($#%9;@B)g©K';>A@B$#&';)'1+
"
$&)56E+,5?>A@B$
$0/t%B)$&/K';/A+v$&/9;-.%8+$\&9;-K5$0/t28$7:9156Eg$&++$ 0'*)';+
"
$&)5?E+56>A@B$
"
$&+'*5+ 2B';/KE @B/B$ 9;/K/B$¬8569;/R%91E,5+51$
$&+v9;-B56$&/~2B$P7:9;5?E2K'*/KE.@B/K$9;/K/B$¬8569;//
"
$&A'=+,56;$1I $g7§'1+,$0@B)&';6&@B
"
$ %$&@B+'$+,)$#91-B56/
"
$g' ;$0 ?'
%9;/K2
"
$&)'=+591//B91),-<'*6$P28@E8E +0$&-.$ *-,.0/21\>1@K53$0E+<K';E
"
$&$gE@K)<$FE7:)
"
$F>A@B$&/K&$0E V$+ I $0E)
"
$0E,@B+'=+E
E,9;/A++)0$FE.%($0)7:91),-<';/1+EE,5 456/A+,$&)';+,569;/ $0E+7§';5+$q' ;$F ?' -'$0-$#(';E,$28$q2891/B/
"
$0$0E0I $FE+A(©K5$0)E
2456/1+$&)';+,569;/<9;/A+
"
$+
"
$$&/B)$&156E+,)
"
$'%('*),+,56)|24@B/B$J28$&-.91/KE +)'*+,569;/+?e$&28$ *-,.0/:1$&+|91/%($0/KE,$ 9;B+,$&/K5)H28$0E
) "
$0E,@B+'*+Ee$&/K&9;)$J-$0566$&@B)E' ;$F 28$FEH)';56EH@8+565?E,'*+,$&@K)E0I
Requête
Session
Utilisateur
Groupe d’utilisateurs
Sur tous les utilisateurs
n56;@K),$ W_ /B$©B5
"
$&)'*)©B56$ %9;@B)4';%B%B)$&/A+,5?EE,';;$;I
¦ ;$0 $&+.';%B%B)$&/A+,5?E,E'*1$\'69;/K+,$0),-.$1D9;/Z%K),91%(9AE$g28$ ) "
$F'*656E,$&) @K/~E E+0$&-.$v24'*%B%K),$0/1+56EE'*;$ E@B)
%B6@KE,5$0@B)En/K51$0'*@B¬9;-.-.$2
"
$F)5+ 2B'*/KE 56;@B)$ WBI /B$e+,$06$e+,$0©K/B56>A@B$H%$&)-.$+D28$e%B),$0/K28)$e&9;/B/('*5?E,E'*/K&$
28$FEJ5/B7:9;)-.'*+,569;/KEJ2B';/KE@B/B$<E,$&@B6$.),$F>1@$+$$&+2K'*/KE@B/B$<E,$0EE569;/ 28$.),$F>A@ $+$ ¥' ;$0@B/ E$0@B B@8+¨n-.';56E
';@KE,E,5nE,@B)%B6@KE56$&@K)E
"
$0©B$06$0E+,$&-.%9;)$&6$FE3K'1E
"
$&$0E E@B)4@8+565?E,'*+,$&@K)E0E,@B) @B/B$&$&),+';5/B$K';E,$28$289;/B/
"
$&$FE
2456-.';;$FEH$+3$&/AK/#E@B)H+9;@8+$0EH56/A+,$&)';+,569;/KE¥§-@B+,5_A(';E,$;8-@K+5_@8+,565?E'=+,$0@B)E¨I
Gn9;@8+$0EL$FE +,$F©B/B5?>A@B$0E|2456/A+,$0)'1+,569;/2B@289;-<'*56/B$ 2B$ ?'),$F©B$&)©B$H%K';)L6$ 91/1+$&/@<$+e28$0Ee2
"
$&+'*56?ED28$0E
+$0©B/B5?>A@B$0E 2
"
$0&),5+,$FEH2B'*/KE&$+,+,$ E,$0+591/ %$&@K;$&/A+ $&+,)$ +),91@B
"
$0Ee2B';/KE6$ U|©('*%B5+,)$ @KI
3 7A02*4( 3 3 0479 . ( & & &/0( ( ( & ( *4( 5 ( *45 ( 36* P(
5 91.102(+.
4"
$0='*6@K'=+591/~E+'*/(2B'*)285?E
"
$0$ 28$FEE E+0$&-.$0E.28$#)$0©B$0)©K$g2456-.';;$FE$FE+@K/ 2B9;-<'*56/B$#>A@B53/4$0E+%K';E
$0/K91),$ +)0$0E$0;9;6@
"
$1Ir®D/
"
$&/
"
$&)'*&©K'1>1@K$LE 8E+0$0-.$ $0E+n$&=';@
"
$LE@K)n28$FEn2891/B/
"
$0$0E&9;-.%B$+$&-.$&/A+n2B5:
"
$&)$&/A+$0E0
&$ >1@K5$&-.%$F©B$+,9;@B+,$ 91-.%K'*)'*5?E91/I
C ';)D9;/A+),$11$0/$ >A@B591/K$0),/B$6$ 2B9;-<'*56/B$ 28$ ),$F©B$&)©B$328$FED56/87:9;)-<'=+,569;/(E +,$&¬+,@B$06$0E014
"
$&='*6@K'*+,569;/
E+';/K2B'*)285?E
"
$&$e$0E+D+,)0$0E &9;@B)'*/A+$J¥28$&%K@B56E|6$0ED';/B/
"
$0$0E TSY
±
¨r$&+L$0'*@(9;@K%.2B$ 916$0+,569;/KE0=+,$FE+ED$&+L%B@BB65?&'
+591/KE E91/A+ 285?E,%(91/B5K$FE&I
!
$0%B@B5?E TT
°
6$
/ $ 1 ,/ 2/:1 / / ¥G ¤
®VUF¨r%K),91%(9AE$|@B/B$H%B?'=+,$&7:9;)-.$
24
"
$0 ';@('=+,569;/ ¥§($0/K©B-<'*) \B¨%9;@B) $FE3-<';©B56/B$FE 28$ )$0©K$&)©B$ 28$ +$¬+,$1I U|$+ ($0/K©B-<'*) \ $FE+J28$&1$&/@#6$
E+';/K2B'*)22K'*/KE 6$289;-<'*56/B$H$+ 6$0E ) "
$0E,@B+'*+E%B)9;@B1$&/A+ >A@B$H6$0E %$&),7:9;)-<'*/K&$0E9;/A+D'*@B1-.$&/A+
"
$ "
$&/K9;)-$0-.$&/A+
%$&/K2K'*/A+3$FE285¬g28$0),/B5$0),$FEe';/B/
"
$0$0E0I
ª 91E#$P91)+E#%(91@B)q4
"
$&='*6@K'*+,569;/ 28$0EE 8E+0$&-.$FE#28$Z)$0©B$0)©B$ %K';)6$91/1+$&/@pE91/A+K';E
"
$0E#E,@B)6$0E
$&¬%
"
$&)5-.$0/1+'=+591/KE2B'*/(E$289;-<'*56/B$ 28@P+$¬+,$$+ E,%
"
$F5?'*6$&-.$&/A+3E@K) G
¤
®VU I $FE391-%91E'*/A+EH$0EE$0/1+5$06E
%9;@B)4
"
$&='*6@K'*+,569;/P24@K/B$-<';©B56/B$28$J),$F©B$&)©B$JE91/A+
@B/B$+ / / / / , / E+';/K2B'*)285?E
"
$&$0E0A56B)$$&+3;)'=+@B5+$
28$0E 28$3)$0>A@$&+,$11>A@B5K%$&@K;$&/A+ $+,)$328$FED56-.';;$FED28$3)$0>A@$&+,$91@<@B/B$ 28$FE,&),56%8+591/.+,$¬+@B$&6$ 24@K/
B@8+ 24@B/B$)$0©K$&)©B$
28$0E?/ / /.0/21 , / /%(91@B) ©(';>A@B$+ '1©B$ $+ K';E
"
$0EHE,@B) ?'.K'1E$ 28$289;/B/
"
$&$FE2456-<'*1$0E K6$
-.5$0@8¬$0E+D24' ;9;56)%B@(E56$&@B)E @B1$&-.$&/A+E %9;@K)%K),$0/K28)$e$0/&9;-.%8+$e?'JE@K $0+,56A5+
"
$e28$FE @8+,56656E'=+$&@B)E
28$0E / 1 / / .0/:1 1 /P>A@B5D%$&@K;$&/A+-.$FE@B)$&)6'#>A@K';5+
"
$2B$0E)
"
$&%9;/(E$FE 5|$0E+56-%9;),+';/A+
24' ;9;56)L@K/v/B91-B)$ 28$-.$0E,@B)$0E|%(91@B)e2B5:
"
$&)$&/A+E|'1E%$0+Ee28$ %$&),7:9;)-<'*/K&$ -<'*5?Ee'*@KEE5@B/B$-.$0E,@B)$
-<' +,)$0EE$¥:6$0'12 -.$F';E,@B),$ ¨e>1@K5%B@B5?E,E,$ $+),$J?'(';E,$J24@B/#&6'1E,E,$&-.$&/A+328$FE3E 8E+0$0-.$0Ee%K'*),+,5?56%K';/1+E&I
C 91@B)@B/($0/K©B-<'*) \\91%
"
$0)'*+,569;/B$0D5e-<'*/K>A@B$ $&/K&9;)$@B/B$ , 1 1? 1 // 0,P0/P>A@B5|%$&)-.$+,+,$v@K/
'1&*$0ELE+';/K2B';)285?E
"
$ '*@B¬.-<'1©B5/K$0EH28$),$F©B$&)©B$;I®D/g$-91-.$&/A+
#%$&#('
$0E+e6$JE$0@B
"
$&)5+'*B6$ E+';/K2B'*)2
2B';/KEe$ 2B9;-<'*56/B$;I ' . 1 ,:,. ,28$FEL1),91@B%($FEL28$ ),$F©B$&)©B$$FE +H'*@KEE556-%9;),+';/A+,$ >A@B$ 4';0$&%B+'=+591/
&9;-.-.$vE+'*/K2K'*)2\24@B/ $&/K©K-.';)^\IPC 9;@B) ';@B;-.$0/1+$&)4'128©
"
$FE569;/ 56L$0E+ 56-%9;),+';/A+28$E,9;@B651/B$&)>1@K$
;4$FE+3@B/K$)
"
$0@B/B569;/g'*-.560'*6$ %9;@K)3%B)
"
$0E,$&/A+,$0)e2B$0EH+$0©B/B5?>A@B$0EH$&+3/B9;/g%K'1EH@B/B$ 91-.%($&+,5+,569;/I
/R($0/K©B-<'*) \91-.%B$+,$0-.$&/A+v'*@8+9;-<'=+56E
"
$g$0E+),$F'*656E
"
$#2B';/KE<$&++,$+,©$FE$' 1$0 4'*5?28$q2B$
# $ #%'
&9;-.-.$6';/B1';;$P%9;@B)?' 7:9;)-@K6'*+,569;/R28$0Ev),$F>A@ $+$0E<';@8+,91-.'*+,5?>A@B$0E0I $qE,©
"
$&-<' 28@R$&/K©B-<';)^\~$0E+
%B)$0E,$&/A+
"
$2K'*/KEH?'<51@B),$ YBI
Jugements de rélevance
Collection d’images
Images de requête Groupes de
jugement Mesures de
performance
Machines de recherche MRML Serveur de Benchmark
Données du système
n56;@K),$ Y] A+),@(+,@K),$ 28@P$&/K©K-.';)^\ '*@8+9;-<'=+56E
"
$;I
$HE,$&);$0@B) 28$$&/K©B-<';)^\ $FE +DE
"
$&%('*)
"
$|28$FE -<';©B56/B$0E 2B$),$F©B$&)©B$e%K'*)
#%$&#('
91-.-$H?'*/BA'*1$|%9;@B)
6$0E ),$F>A@ $+$0E0I '<K'1E$28$2891/B/
"
$0$0E32456-<'*;$FE$+$FE -.$FE@B)$0E 28$ %$&),7:9;)-<'*/K&$E91/A+ '*@KEE,5r56E,56B$FE3%9;@B)
+9;@KE6$0EE 8E+0$0-$FE&I C '*).91/A+,)$$FE+ ';©K$0E28$ )$0>A@$+,$v$+<$FE @K;$&-.$0/1+E.28$ %$&),+,56/B$0/K$g/B$PE91/1+%K';E
5?E56B6$0E %(91@B)
"
$05+$&)3+9;@8+$';-B56;@+ "
$;I '<K';E,$2456-<'*;$FE31)'*+,@B5+,$FE 28$43/B56;$0)E,5+
"
$2B$ ' ';E,©B5/K*+,91/
$FE+ @8+565?E
"
$0$&9;-.-.$.K';E,$.%B),56/K&5%K';$1I
!
$0E'*@8+),$FE (';E,$0EJ28$2891/B/
"
$0$0EJE91/A+J';@KE,E,5 @8+5656E
"
$0$0EJ91--.$1%K'*)
$&¬$0-.%B$1B?'(';E,$J2B$IU|9;)$&9;@P?'(';E,$J2B$6'.G
"
$0
"
$056E,591/ @B5?EE$
¤
91-.';/K28$<¥§G ¤
¨I
C 91@B)3%$&)-$&++),$4';0*$FE'4
"
$&='*6@K'=+591/28$/r456-.%(91)+$>A@B$&$&/(28),915+F(@K/B$56/A+,$&),7§';&$ ?e$&q'
"
$+
"
$ )
"
$ "
$&$
>A@B5289;/B/K$ ';0*$FE '*@.($0/K©B-<'*) \I¦ %B)0$0E @B/K$ 91/;AK;@K)'*+,569;/.28$ E'J-.'1©B56/B$ 28$3)$0©K$&)©B$;*6$$&/K©B-<';)^\