INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE

(1)

THÈME 3

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE

Reducing the Redundancy in the Selection of Samples for SVM-based Relevance Feedback

Marin Ferecatu — Michel Crucianu — Nozha Boujemaa

N° 5258

July 5, 2004

(2)

(3)

')(*"+-,/.102&346578902;:

<>=@?BADC>EGFH?BFJIJ=LKNMPOQ<>ADI'RSFJT7UV?WMSIJAX=@CYMPOQZ9[]\JRS=_^V[@Ma`WFJb_=]=

c6dfe4g"hikjmlonJpqhWrtsHuvptwyxHn9dfxHgVg"h4zXgs{u|dawynfhH}

w~gsHhWW}fx{nfnfWhWW}fuxHnfnaswtqs{nauhB

Qrqx{hplog"hWfw~s

s{f@x{rqpfhrthWu|dah4r|u|dfhn@SH{j{f~f}a{{j{kas{{hB

9;W4' f¡{{¢ lonwygs{{hrthpqrtw~h4£'sf¤wypqdrth4~h4£'s{nauh6¥¦hWhW1§asHu|¨]}pqdah7©pqr|s'pqhW{hWg"fyx'HhWV§kptdfhªq1pth4g

¥¦xHrqh4~hWupqw~nfptdfhªw~gs{hBQfrthWqh4nJpthWVpqxkpqdfh7aqh4rsphW£{h4rt$¥¦h4hWf§as{u|¨VrqxHfna"dasHskptrqxHnfh«]hWupxHn

ptdfh¬pqr|snL¥¦hWrx¥Swyn1¥¦xHrqgspqw~x{n2§Lh4p¤hWh4npqdah)a©hWrªsnLptdfhkq©pqhWg2®¯ªqwyna9°±7²³W}f¤h)f1p¥¦xHrq¤6sr|

s´nah4¤-s{upqw~£{hµ~hWsrtnfw~nf¶qh4~hWuvptwyxHn·ptrtspqhW{¸ptdas'p9g"w~nfw~gVw~¹4hB9rthWffnafs{nau_§Lh4p¤hWh4nºpqdah³wygs{{hW

arqhB©hWnHpthW2ptx9ptdfhVa©hWrs{na2p|s¨{hBªw~nJpqx2s{uWux{anHp¬s{t©agVfpqw~x{napqdasp)s{rqh$©@hWu4w¼»Lukpqxpqdah$rthptrqw~h4£'s

qhpqpqw~nfa®S½G¾1@h4rtwyg"hWnHp|xHn9qh4£{hWrts{aw~gs{h7fs'p|s§asH©hBuxHn1»artg¿pqdfhs'p©ptrtsHuvptwy£Hh4nfhBqx¥Àpqdaw~©hWyhBuvptwyxHn

©pqr|s'pth4H{®ÂÁÃhµs©x»anaÂpqdLs'pw~na©hWnaqw¼ptwy£wyp´pqxÃpqdfh³tu4s{yhx¥7pqdfhµfsptsÃws1hB©w~r|s§f~harqxHLhWr©p

¥¦xHrptdfh"°1±7²³7h4g"f~x'{hB³s{ªyhBsrtnfh4r|w~n³rth4~h4£'snau4h)¥¦h4hB1§asHu|¨2s{naµ¤h$qdfx'¤Ädfx'¤Åpqxx{§1p|sw~nÆ©Lu|d

w~naqh4naqwypqw~£Jwyp§ptdfh)aqh)x¥;q@hWuwy»Lu¬¨Hh4rtnfh4]¥¦fnLuvpqw~x{nL4®

ÇµÈJÉ]ÊtËkÌ 'Í;{¢ wygsHhkrthptrqw~h4£'sX}Ytsg"f~h$qh4~hWuvptwyxHnY}Ys{upqw~£{hVyhBsrtnfw~nfa}]rthW1aupqw~x{n³x{¥rthW1anafsnLu{}

¨Hh4rtnfh4@¥¦fnLuvpqw~x{n

(4)

%(34(S(3 %6( 5V+-,

¢ snasVrqhBu|dfh4r|u|dfh7w~gs{hB6sN£{hWuªrqh4pqxHfr1h¬LhWr©ptwynfhWnauhH}1~s"©pqr|s'pt4{w~hªhWg"fyx'H4hasr

~hq©pqeWg"hLxHfrkq4~hWuvptwyxHnfnfhWryhB)w~g"s{{hB)frtWqh4nJpqWhW21ptwy~wqspqh4arµu|dasJfhwypqWrtspqw~x{n¸s2fnfh

Hrts{na1h"w~gV@x{rqpts{nauh9LxHfr~hpqr|sna©¥¦h4rqpkwynf¥¦x{rtg"spqw~x{n¸hWnHptrqh1pqw~ywts'pqhWfrkh4pk~h9©1©pqeWgVhH®¯pqw~ywyz

tsnJpª~hW¬°±²¸}Lnax{a7frtx{@xHqx{naanfhknfxHf£{hWy~hg"ptdfx11h$fh$q4~hWuvptwyxHn³§asH©Whk©arªs{ffrth4nJpqwqtsHh

sHuvptw¼¥}Jfw6g"w~nfwyg"w©hs³rthW1xHnafsnLuh9hWnJpqrth9~hW$wygsHhWJfh1pqw~ywts'pqhWfr"1x{wypVgs{rJfhWr$h4p$ptwyhWnHp

u4x{g"1pth³d@xpqdaeWqhW9q@Wuwy»JfhBs·u4x{nJpqh4¾Jpth³1h³s´rqhBu|dfh4r|u|dfhH®4£'s~aspqw~x{n ©ar9f~aqwyhWfrt

§Ls{qhW)wygs{{hWkux{nf»arqg"hWnHps'p©ptrtsHuvptwy£wypq1hs³©pqr|s'pqW{w~h1h©WyhBuvptwyxHnÃarqxHLxJ©Wh{®ªx{aksN£{x{nL

WHs{yhWgVhWnJpux{nLp|s'pqHahw~nJ£'s{rqwsnau4h1rtWqf¼p|s'pfhsafrqhWnJpqwqtsHhWu|dfhWy~hª1hB1xHnfnfWhWQhBp

anfh7arqxHfrqw~pt1ptwy~hasna6uhuxHnHpth¾pqh7hp6nfx{Lg"x{nJptrqxHnau4x{g"g"h4nJpxH§1pqhWnfw~ranfhpth4~yhwyn£'srtwsnau4h

LsrhWgVayxHwY1h¬¥¦x{naupqw~x{na©znfx'Hs{1¾©@Wu4w¼»JfhB4®

PÌ B Ê ¡ 2¢ rqhBu|dfh4r|u|dfh)wygsHhWLsr~hkuxHnJpqh4nY}@©WyhBuvptwyxHn³h4¾1h4g"f~hWW}LsafrqhWnJpqwqtsHh¬sHuvptw¼¥}

rtWfauvptwyxHn1h)sVrqhB1x{nLfsnau4h{}J¥¦x{nLuvpqw~x{n2nfx'Js

(5)

' kk;k;&

(*)+

W Ì Í;¡-,Ì + .

/10 È 42,

+43

Ì 5 26 È W;Í É 7

f®8 s'p|s§asH©hB¥¦x{r:9¶gVh4pqdfx1fh4£'s~as'ptwyxHn ®¬®)®)®¬®)®¬®)®®)®¬®)®)®¬®)®¬®)®¬®)®)®®)®

f® logs{{h)uxHnHpth4nJp1hWturtw~1pqw~x{n®¬®)®)®®)®¬®)®¬®)®)®¬®)®¬®)®®)®¬®)®)®¬®)®¬®)®¬®)®)®®)® ;

f®i w~gVhWnaqwyxHnas~w¼p9rqhB1auvptwyxHn ®¬®)®)®®)®¬®)®¬®)®)®¬®)®¬®)®®)®¬®)®)®¬®)®¬®)®¬®)®)®®)® <

.=0 ?> È È È ¡2,Ì + Ë ,¦-6 È Í + Í; + ¡ É È Í ¡{2,Ì + @

ia®8/°fsg"f~h©hWyhBuvpqw~x{n2snLsHuvpqw~£{h¬~hWs{rqnfw~nf ®)®¬®)®)®¬®)®¬®)®®)®¬®)®)®¬®)®¬®)®¬®)®)®®)® A

ia® hW1aupqw~x{n2x¥pqdfh)rthWffnafs{nau¥¦xHrs{upqw~£{h¬yhBsrtnfw~nf$¤wypqd³°±² ®¬®)®¬®)®¬®)®)®®)®B8B

ia®i ½Q¾@h4rtw~gVhWnJpts h4£'s~as'ptwyxHnx{¥rthW1anafsnLurthW1Luvpqw~x{n!®)®®)®¬®)®)®¬®)®¬®)®¬®)®)®®)®B88

C1)+D f ,D

+ ¡ È Ì

W¡H

È + Íº-6

È

¡-6

Ì ,¡ ÈÆÌE5

-6

ÈGF@È

+ È ( 7

71H$Ì

+ ¡ ;2,Ì + (JI

K L

$ (S

c6dahuxH©px¥6frtx'£w~1w~nf2rtw~u|d¸snLrth4~ws§f~h"pqh4¾Jptassnfnfx{ptspqw~x{na¬¥¦xHr)wygs{{hWwyn´srt{hfs'p|s§asH©hB4}

sH¤h4~sHptdfhM©yw~nfHfw~©pqwuJsJN9s{tqxu4w~spqhBÆptx³ptdfhWqhs{nfnfxp|s'ptwyxHna4};h¾1fsw~nak¤dJÃptdfh9rthptrqw~h4£'s

x{¥wygs{{hW$§asH©hB¸x{n¸ptdfh4w~rG2POQªuxHnHpth4nJpSRDuxHnHpth4nJp©z§asH©hB¸wygs{{hrthptrqw~h4£'sX}UTWVlXkw~$x¥ªdawyHd

w~nJpqhWrqhBp6pqx1fsNZY88Q[X®

lonºptdfhÆhBsrty¶HhWs{rtx{¥)rqhB©hBsr|u|dÂw~n\TWVl}Qpqdah³¥¦x1ua9¤sH"x{n]M Jfh4rtÂ§ £Jwqash4¾fsg"f~hQN

R_^`V±ª½UXaLsqhWs{rtu|d2©hBqqw~x{n2§LhW{w~na§frqhB©hWnJpqw~nfsnµh¾fs{gVayh)w~gs{hbRx{rªq¨{h4ptu|dEX6pqx"pqdah$qhWsr|u|d

hWnf{w~nfh"s{)scM©£Jwqas Jfh4rtN|}]ptdfh4npqdahh4nfHwynfhVrthpqarqna¬w~gsHhW7pqdaspsrth$£w©as{y~³qwyg"w~~s{r¬pqxpqdfh

JfhWrq)w~gsHh{®ShWu4h4nJpq~{}'ptdfhuxHnauhW1pGx¥dM©qh4gs{nHptw~uHs{JNdLs{S§@h4h4nVh¾pth4naqwy£Hh4~aqhW$wynVptdfhTWVl

rthWqhWs{rtu|dµu4x{g"gkfnaw¼p2ptx9h¾1frthWtªpqdfh"1wqu4rqhWasnau42§Lh4p¤hWh4n³ptdfhVyx'¤6zyhW£{hWY¥¦hWspqfrthWªpqdLs'p)u4sn§Lh

rthWsH1w~yh4¾JptrtsHuvpthW9¥¦rqxHg pqdah)wygsHhW6snLfhWturtwy1ptwyxHnapqdLs'pªsrthgVhBsnfw~nf{¥¦fÀ¥¦x{r6ptdfh)aqh4r|6x¥;pqdfh

qhWs{rtu|dÃh4na{w~nfh{®µc6dfh9s{1pqxHgs'pqwus{tqxu4w~spqw~x{nÃx¥qau|d¸1hWturtwyfpqw~x{na¬ptxµpqdah9~x'¤6zX~h4£Hh4S¥¦hWspqfrthWw~

u4frtrqhWnHptyx{nay¥¦hWsH©w~§f~h)¥¦x{r£{hWrqrqhBptrqwuvpthWµ1xHg"s{wynLªsnL³sfaywu4spqw~x{naW®Á dfhWnÆ©hBsr|u|dfw~nfg"x{rth

Hh4nfhWrqwu¬w~g"s{{hkas'pts{§as{qhWW}axHnfhkqx{~1pqw~x{n2¥¦xHrªrthW1Luw~nfpqdah$qh4gsnJpqwu)Jsµwpqxu1p¬sqhWsr|u|dµ©hBz

qw~x{n2wynJptx9©hW£{hWrts{Yux{nL©hBu1ptwy£Hh)rqh4pqrtwyhW£Ns{Yrtx{fnaaR¦wypqhWrtspqw~x{naXsnL2yh4ppqdfhka©hWrªfrtx'£w~fh¬¥¦h4hWf§as{u|¨

rth4Jsr|1w~nf"pqdfhVrthWqf¼p|ªx{¥h4£Hh4rtrthptrqw~h4£'s{rtx{fnLÀ}]h{®a®¬§ Jas{ywy¥¦wyna9w~g"s{{hBªrthptfrqnahW³sHªhWw¼ptdfh4r

M©rth4~h4£'snJpeN¬x{rUM©w~rqrth4~h4£'snJpfNgR¦rth4~h4£'s{nauh¬¥¦hWhW1§asHu|¨]}a:9hXv® 9frtx{g3pqdfw¥¦hWhW1§asHu|¨]}1pqdfhkh4nfHwynfh)arqxH{rthW©z

qw~£{h4~2yhBsrtna7pqdfh"£w©as{ ¥¦hBs'ptfrqhBx¥ptdfh"wygs{{hWªpqdahVL©hWrwyxxH¨Jw~nf9¥¦x{r¬wynpqdah"u4frtrqhWnHp)qhWsr|u|d

qhWtqwyxHniRptdfhMptsrt{h4peN7x{¥ptdfh)aqh4rQXv®

l pGgkLpS§Lh6nfx{pqhBdfhWrqhpqdaspSpqdfh6©hWgsnJpqwuJskqdfxHf~knfxpG§@hqh4hWn$sH ptdfhfnfwHahh4¾1f~s{nas'ptwyxHn

¥¦xHrptdfh7fwkjua¼ptwyhBhWnauxHfnJpqhWrqhBwyn9rqh4pqrtwyhW£Ns{L§"£w~qas{@u4x{nJpqhWnHp-a ptdfhlMnfg"h4rtwu4sLHs{JNx{rQptdfha©h

x{¥w~nauxHgVayh4pqh"x{r¬uxHn1¥¦aqwynf21hBqu4rqw~1pqw~x{nLªx{¥pqdah$£w©as{Gux{nJpth4nJpW}Àw¬su4x{g"f~h4g"h4nJpts{rqµuWsaqh$x{¥

arqxH§fyhWg¬wyn´rthpqrtw~h4£'sX®c xµrthWfauhVpqdaw~knJagVhWrqwu4s{GHs{Y}Yx{nahdas{ptx³1h4£Hh4~x{ÃwygsHh©w~{naspqfrthW

(6)

Ryx'¤6z~h4£{hWÀwygs{{h¬¥¦hWspqfrthWXpqdLs'p7s{rqh¬§@xpqdµrtwu|d2s{na¥swypqdf¥¦fD®cxgs¨{h)rthptrqw~h4£'s{ÀgVxHrqh)hjuw~h4nJpW}

ptdfhWqh)©w~{nLs'pqarqhBqdfxHf~2s{~qx$§@huxHg"as{upW®

c6dfh2:9Åg"hptdfx1¶h4g$§Lx11w~hWÂwyn sÆqhWs{rtu|d´h4na{w~nfhqdfx{a~Âx{@h4r|s'pqh9wyn_rqhBsQptwyg"h2snaÂ©dfxHf

gs¾w~g"wy¹Wh2pqdfhÆrtspqw~xÃ§@hp¤h4hWnºpqdfh HLs~w¼p R¦x{r9rqhWyhW£Ns{nauh X$x¥¬pqdfhÆrqhB©fypt9sna_pqdahÆsg"x{anHpx{¥

w~nJpqhWrtsHuvpqw~x{n §@hp¤h4h4nºptdfh³aqh4rsna ptdfhÆq©pqhWg2®ªn·:9Pg"h4pqdfx1 Rqh4h]Y{ [¥¦x{rs´rqhW£wyhW¤XVw~

fh»anfhB2§9p¤xuxHgV@x{nah4nJptW}Ls~hWs{rqnah4rªs{naµsqh4~hWuvptx{rB®p7h4£{hWrq9¥¦h4hB1§as{u|¨rtx{fnaY}fpqdahyhBsrtnfh4r

L©hBptdfh¬wygs{{hWgsrt¨{hB9sH M©rth4~h4£'snJpeNªxHr Mw~rqrth4~h4£'s{nHpfNª§pqdfh¬aqh4rptxVrthzhW©pqw~gs'pthªptdfhptsrt{h4px{¥

ptdfhVa©hWrW®w~£{h4nÃsn³hBptwygspqw~x{nÆx{¥GpqdfhVp|srt{hpB}aptdfh"©hWyhBuvpqxHru|daxJxJ©hBptdfh$w~gsHhWª¥¦x{r¤dfw~u|dÆpqdfh

L©hWrw~sH©¨HhW9pqx"frtx'£Jw1h7¥¦h4hB1§as{u|¨s'ppqdah)nfh¾prqxHfnaÀ®

c6dfh7ptsH©¨x{¥Ypqdah7~hWs{rqnfhWrw£{h4rt1wju4fyp6w~nptdfh¬ux{nJpth¾px{¥:9 RD©hWh Y-[} Y{ [X§@hWu4s{aqhªptrts{wyn1z

w~nfµh4¾1s{g"fyhBsrthtu4sr|uh R¦pqdfhWwyrnfg$§LhWrkw)aqas~~Æ~x'¤hWr¬pqdas{n´pqdfhnfg$§LhWrx¥1w~g"h4naqw~x{na)x{¥

ptdfh1hBqu4rqw~1pqw~x{n¸qas{u4h-X}Ypqdah"pqr|sw~nfwyna³©h4pw~)dahWsN£wy~³w~gk§as{~s{nauhB Rpqdah4rthsrthVx{¥pqhWnÃgs{nJg"x{rth

M©w~rqrth4~h4£'snJpfN¬h4¾1s{g"fyhBptdasnGMrth4~h4£'s{nHpfNx{nfhB Xªsnaµ§@xptd³ptrts{wynfw~nfsnaµhW£'s~as'ptwyxHn³gka©p7§@hVLhWr©z

¥¦xHrqg"hBw~n¶rthWs{Gpqw~g"h{®³²µau|d¸rthWu4h4nJp¤x{rt¨Æw§asH©hBxHn¶©afLxHr©p$£{hWupqxHr)g"sHu|dfw~nfhW RD°±²¸}UY8W[X}

Y8B [X¬§@hWuWsaqhptdfh4´sN£{xHw~Æpqxx³rthW©pqrtw~upqw~£{hs{tqfg"1pqw~x{narqhWHsr|1w~nfpqdfhfs'p|s R¦hH®L®9ptdas'p$u4~sHqqhW

qdfxHf~dasN£{h7h4~yw~1pqwu©das{Lh Xv}fs{rqh£Hh4rtah¾1w~§fyhgRuWsn§Lh7pqfnahW§¨Hh4rtnfh4@h4nfHwynah4h4rtw~nf XGs{na9s{y~x'¤

¥sHp~hWs{rqnawynfs{nah4£'s~aspqw~x{n¥¦x{rg"hB1wyag$zoqwy¹WhWµfspts§Ls{qhWW®QÁh$srt{fh¬dfhWrqh¬ptdas'pªw~n£'srtw~s{nauhpqx

ptdfh)quWs~h¬x¥ ptdfhfsptsVw~s{nw~g"LxHr©p|snJp1hWqw~rts{§fyh7¥¦hWspqfrth¬x¥;pqdfh¬~hWs{rqnfhWr6wynpqdah:9¶uxHnJpqh¾psnL

¤h)©dax'¤·pqdLs'p©xHg"h¨Hh4rtnfh4srth§Lh4p©pqhWrpqdLsn2xptdfh4r|6wyn2s{u|dawyhW£Jw~nfVpqdaw~W®

lonµg$au|dµx¥;pqdfhk¤xHrq¨x{nµ:9}fptdfhw~g"s{{hB6¥¦x{r¤daw~u|dpqdahaqh4rªwsH©¨HhWpqxfrtx'£w~fh¬¥¦h4hWf§as{u|¨

spªptdfh$nah¾p7rtx{fnLµ¤hWrqh$©w~g"fy2ptdfxHqh)ptdas'p¬¤hWrqh$ufrtrqhWnJpq~2u4x{naqw1h4rthW2§pqdfh$yhBsrtnfh4rs{R¦@xz

pth4nJpqws~~X)pqdfhg"xH©p$rth4~h4£'snJps©xL};w~nÂqx{g"h9uWs{qhW)ptdfhWqh9w~gsHhWks{rqh9rts{na1x{g"~Ãqh4~hWupqhBÀ®n

w~g"LxHr©p|snJppth42sdfhBs{9¤sHpqdfh¬w~nHptrqx11Luvpqw~x{nw~niY8 < [ snaiY8-; [Yx¥Ssn?% QE¥¦rts{gVhW¤xHrq¨

¥¦xHrª:9 aqwyna°±7²Æ4®6ÁÃhkf1p7¥¦x{rt¤s{rtdfhWrqhks{nµwyg"frtx'£{hWg"h4nJpx¥Spqdfws{uvptwy£Hh)yhBsrtnfw~nfptrtspqhW{{}

§Ls{qhW)xHn$s7rqhB1auvptwyxHnkx{¥fpqdfhrthW1fnLfsnau4)§Lh4p¤hWh4nkpqdfhwygs{{hW;qh4~hWuvpthWÀ}Hsna$s'p©pth4g"1p;pqxw~fh4nJpqwy¥¦

ptdfhMq1x{gsw~nx¥arqh4¥¦h4rth4nau4hQN7x{¥S1wy«]h4rth4nJp©hWyhBuvpqw~x{nµ©pqr|s'pth4{w~hWW®

ÁÃhgkLpªhWg"fdas{qw~¹4h¬pqdLs'p7:9_¤6s{s{ff~wyhBpqx"p¤xfrqxH§f~h4gx¥Q1wy«]h4rth4nJpªnaspqfrth{®c6dfh)»ar|p

s{naÃg"xH©pkux{g"g"x{npLh9x¥6frqxH§f~h4gu4x{naqwp|¬wynÃ»anafwynfÆwygsHhW¬w~n¸sµ©@hWu4w¼»LuVp|srt{h4pk©h4p;pqdfh

¥¦x1u4a)w)x{n´r|snf¨w~nf2gVxJpx{¥ptdfh M©rqhWyhW£'snJpeN"wygsHhW¬§@h¥¦xHrqh"ptdfh M©wyrtrqhWyhW£'snJpeN$xHnfhWrtspqdfhWr¬pqdas{n

xHnÂ»Lna1w~nf¸sÆ¥¦rtx{nJptwyhWrV§@hp¤h4hWn M©rth4~h4£'snJpeNs{na Mw~rqrth4~h4£'s{nHpfN9wygs{{hWW®n wynJpqhWrqhBptwynaÃ§a1pyhBq

u4x{g"g"x{n¶L©hx¥79Äw~Vw~n_1h4»anfw~nfÃsus{tkx{¥ªw~g"s{{hB$s{na¶h4¾Jpth4nafwynfÆpqh4¾Jptass{nfnfxp|s'ptwyxHnakx{¥

qx{g"hwygsHhW$wyn_pqdahu4~sHqkpqxpqdfhxptdfh4r|u4yhBsrtyH}GwynÂpqdfwu4sH©h9pqdfh¥¦x1uaVw$xHnÂw1h4nJptw¼¥¦w~nfÃs

Hxx¥¦rtx{nJpqw~h4rª§Lh4p¤hWh4npqdfh$us{tx¥Gw~nHpth4rthW©pªsnaptdfhkx{pqdfhWrwygs{{hWW®U9ax{rhBs{u|d2¨wynL2x¥Gfrtx{§f~h4g

sqLhBuwy»LuVh4£'s~as'ptwyxHnÆg"hptdfx1´©dfxHf³§@hVL©hB a¬wynpqdfhV»ar|©p)uWs{qhk¤h"gka©p)gVhBs{qfrthkptdfh©@h4hB

x{¥w~g"frqx'£Hh4g"h4nJp¬x¥pqdfh"r|snf¨w~nf RpqdahfrthWuwqh$r|snf¨w~nfx¥pqdfhM©rqhWyhW£Ns{nJpeN$xHr)x¥ptdfh M©wyrtrqhWyhW£'snJpeN

w~gsHhWwaqas~y2fnawyg"@x{rqptsnJpQXv}À¤dfw~yhVw~n³pqdahVqhWu4x{na³uWs{qhk¤h$dLsN£{h)ptxhW£Ns{yLs'pqhkpqdfh"qLhWhW³x{¥

w~g"frtx'£{h4g"hWnHp6x¥;pqdah¬u4~sHqqwy»Lu4spqw~x{nY®

lon´ptdfh9nfh4¾p$©hBuvptwyxHnÃ¤hh¾1fsw~n¸x{arku|dfx{wuhx{¥{rtx{fna1pqrt1pqd¸fspts§Ls{qhW¥¦x{rkh4£'s~as'ptwynaÆ:9

s{yHx{rtw¼ptdfgªs{naµ¤h$1hBqu4rqw~§LhkpqdfhVw~g"s{{hV©w~{naspqfrthWª¤h$h4g"f~x'{®¬c6dfh"s{uvptwy£Hhkqh4~hWuvptwyxHnÆ©pqr|s'pqhW{

¤wypqd2s$rqhB1auvptwyxHn9x{¥ pqdahrthWffnafs{nauw6frthWqh4nJpqhBw~n2°hBuvptwyxHniVsnauxHgVLsrthW"ptxVx{pqdfhWrptrtspqhz

HwyhB4®lon³°hWupqw~x{nµ¤hux{g"as{rqhptdfhrthWqf¼p|x{§fptsw~nfhB¤wypqd³fw¼«]h4rth4nJpª¨Hh4rtnfh4sna2¤hqdfx'¤!¤d

¨Hh4rtnfh4pqdaspfrtxfauh)tu4s~hzw~nJ£'s{rqwsnau4hªx{¥ptdfh°±7² qdfx{a~§Lh)arqh4¥¦h4rtrqhBÀ®

(7)

" _&Y

"!#$%'&()*( +-,

¿qLhBuwy»Lu$9 g"hpqdaxÃu4s{n³§@h"fh4£{hWyxHLhB³snL³h4£'s{yaspqhB³x{nÃs9Lsrqpqwufsrsff~wu4s'ptwyxHnY}À¤wypqds

¤h4~yz 1h4»anfhBqu4h4nas{rqw~xks{nas¤h4~yzXw1h4nJptw¼»ahB{rtx{ax¥Yaqh4r|W®(.¬nfx'¤w~nf)ptdfh¬©@hWu4w¼»Lus{tqfg"1pqw~x{na

u4x{nau4h4rtnfw~nfVpqdfhks{ff~w~uWs'ptwyxHnY}1pqdahkqu4h4nas{rqw~xsnaptdfhaqh4r|dfhWyLx{1ptwyg"w~¹4w~nfptdfhk:9_g"hpqdaxY®lp

w¬nfhW£{h4rqpqdah4~hWtªw~g"LxHr©p|snJp¬pqx»anawyg"frtx'£{hWg"h4nJptªpqxµ:9!gVh4pqdfx1fptdas'ps{rqhVrqhW~spqw~£{hWy2{hWnfh4r|s

s{na9s{ff~VpqxVg"s{nux{nJpth¾ptW®½£Ns{yLs'pqw~nf"©Lu|d9w~gVarqx'£Hh4g"h4nJpt§h¾1LhWrqw~g"h4nJpqw~nf$¤w¼ptdaqh4r|w~

£Hh4rtµ1wkju4f¼p¬ptx2qhp¬fY}©w~nauh"wyp¤x{a~rqh Jfwyrthptdfhuxx{@h4r|s'ptwyxHn³x¥g"s{n³1w¼«]h4rth4nJp){rtx{aaªx{¥

L©hWrtw~n£'s{rqw~x{au4x{nJpqh4¾ptW®

c6dfhuxHgVg"xHn9sypqhWrqnaspqw~£{hwpqxkL©h7wygsHhªfspts§Ls{qhWS¥¦xHr¤dfwu|d9sk{rtx{fnaVptrqfpqdwsN£'s{wys§f~h

ptdfw6{rtx{fnapqrt1pqd2aqas{y~9uxHrqrthWq@x{nafpqxVptdfh1h»Lnfw¼ptwyxHnx{¥;s"qhpx¥;gk1ptas~yh¾fu~aqwy£Hh7w~gsHh

u4~sHqqhWW}Sux'£{hWrqw~nf2ptdfhhWnJpqw~rqh9as'pts{§as{qh{®0/ª¥ªux{artqh{};¥¦x{rVs³HrqxHfnaptrq1ptd¶fs'p|s§asH©hsn¶aqh4rVu4s{n

x{¥pqhWn»Lnag"s{nxptdfh4rus{tqhWpqdLs'px'£{hWrqspqdfxJ©h¬x¥;pqdah){rtx{fnapqrt1pqd }a©xVptdfh)h4£'s~aspqw~x{nx¥;s

rthptrqw~h4£'s{g"hpqdaxx{n)©Lu|dsfs'p|s§asH©hQuWsnfnaxp §@huxHnaqw~1hWrqhBh¾1dasLptwy£HhGh4£{hWn)¤w¼ptdrthWqLhBuvpYptxpqdfh

u4x{nJpqhWnJp;x{¥fpqdaspSqw~nf{~has'pts{§as{qh{®;c xux'£Hh4rSsª¤w1hrts{nf{hx¥Lu4x{nJpqh4¾Jp|4}'wypGw~;£Hh4rtw~g"LxHr©p|snJp;pqxa©h

qh4£Hh4r|s]{rtx{anapqrt1ptd2as'pts{§as{qhWs{napqxdLsN£{h)u|dasr|s{upqhWrqwptw~uWpqdasp71wy«@hWrnfxp7x{nf~s{gVxHnfVpqdfhB©h

as'pts{§as{qhWW}]§f1psqxsg"xHnfptdfhus{t©hBªx{¥hWsHu|dÆfspts§Ls{qh{® x{pqhVpqdLs'p)§2»ana1w~nf2ux{rtrth4s'pqw~x{nL

§@hp¤h4hWnpqdahrthWqfyptx¥Àptdfh9¸g"hpqdaxas{naptdfhu|dLsr|s{uvpth4rtw~©pqwu4Qx¥qx{g"h7u4~sHqqhWx{rfs'p|s§asH©hB4}

xHnfh)u4s{nw1h4nJptw¼¥¦¤sN1¥¦x{rsHfs1ptwyna"9¸pqxsqLhBuwy»Lu¬uxHnHpth¾pW®

hWyhW£'snau4h³¥¦h4hB1§asHu|¨ g"h4pqdfx1fgkLpdfh4~!rthW1Luw~nf¶ptdfhÃqh4gs{nHptw~u³Hs ® l p2gsN_ptdfh4n>§Lh

w~g"LxHr©p|snJp ¥¦xHrSh4£'s~as'ptwyna7:92ptxsN£Hx{w¬dasN£wynaªw~nkptdfhHrqxHfnaptrqfpqd$as'pts{§as{qhWYpqxxg"s{nlMpqrtw~£JwskN

u4~sHqqhWW}1wX®hH®¥¦xHr¤dfwu|d³©w~g"f~h)yx'¤6zyhW£{hWÀ£Jwqas qw~gVw~srtw¼pw~7s©ju4wyhWnHpus{t©wy»Lu4spqw~x{n2urtw¼pth4rtwyxHn

R¦pqdfw;gsN§@hpqdfh6u4sH©h¥¦x{rGus{tqhWYarqx11au4hW¥¦x{r;h4£'s~as'ptwynaqwyg"f~hHah4rtwyhB §¬h¾fsg"f~h-X}'§LhBu4s{a©h

qau|d2us{t©hBg"sN©hW£{h4rth4~§fws{ptdfh)rqhB©a¼p|4®

Á wypqd$pqdfhB©h6urtwypqh4rtwswyn$g"wynaY}¤h©hWyhBuvpthWqh4£Hh4r|s{HrqxHfnaptrqfpqdkfspts{§as{qhWY¥¦x{r;pqdfhh4£'s{yaspqw~x{n a

1

¬c<"wªu4x{g"@xHqhWx¥Spqdah${"g"xJpª1wjufypu4~sHqqhW¥¦rqxHg ptdfhTx{~fg$§fw~s9ux{~x{ras'pts{§as{qh{}

hWsHu|dus{tQuxHnHp|sw~nfw~nf <¬1wy«]h4rth4nJp£wyhW¤Qx{¥Às{n"x{§1hBuvpxHnsnfnfwy¥¦x{rtg¿§as{u|¨{rtx{anaÀ®c6dah4rth

w~h4nfxHf{d£w~qasÀ£'s{rqws§fw~~w¼p¤wypqdawyn2h4£Hh4rtus{t6x¥;pqdfwfspts{§as{qhs{naÀ}asp6pqdfhtsg"hpqw~g"h{}

pqdfhw1hWnHptw¼px¥hWs{u|dÃus{t¬w~¬naxp©a§1hWup)pqx2wynJpth4rtfrqh4ptspqw~x{nY®"c6dfhus{tqhW¬srthVs{~qx2©j"z

uw~h4nJpq~9srt{h7pqxs{y~x'¤·¥¦xHrs$@h4rqpqw~nfhWnHpL©h¬¤wypqdµ:9®

1

¬c"8WH"das{:A9us{t©hB4}fhBs{u|dµuxHg"LxJ©hB2x¥l8WH$w~gsHhWqh4~hWupqhW¥¦rtx{g3pqdahTx{rth4 as'pts{§as{qh{®

Á dfw~yh)ptdfh)dfw~{d1z~h4£{hWY©hWgsnJpqwu46x{¥;hBs{u|dµus{tsrth)u~hWsrt~1h»anahWÀ}apqdfhWrqh)ws"ptrqxHnf"yx'¤6z

yhW£{hW@£w©LsÀ1w~£{h4r|qw¼p"¤wypqdfw~nhBs{u|dus{t4®Sc6dfwgs{¨{hWptdfh ¬c"8B{$fs'p|s§asH©h1wkju4f¼p¥¦xHrs

^`V±ª½ sfarqxJs{u|d9§a1pªsV{xx1uWsna1wfspqh¥¦x{rqhWs{rtu|d¤w¼ptd29®

1

¬ci{iR<'us{t©hB4}]hBs{u|d³dasN£w~nf9iHw~g"s{{hB Xªsna ¬clAZRD;us{t©hB4}@hWsHu|d³¤w¼ptd A9wygs{{hW

x{nf~dX"¤h4rthµ§ffw~¼p¥¦rtx{g qh4£{hWrts{©xHfr|uhW RÁhW§·²µaqh4fg2}TxHrqhWD}6±ªw©pqh¾X® ¬clA´gs{wynf~

uxHnHp|sw~nacMoptrqw~£w~s{Nu4~sHqqhWsnL·¤6s{x{rtwyHwynas{y~ 1h4£Hh4~x{@hW·¥¦x{rpqdfh´hW£Ns{yLs'pqw~x{n!x¥$w~gsHh

©w~{nLs'pqarqhBw~nsS^`V±7½>uxHnJpqh¾pB}L¤dfw~~h ¬ciHw7u4x{g"LxJ©hBµx¥Q§@xptdSMpqrtwy£wskNkus{t©hBªsnL

g"x{rth¬fwkjua¼pxHnfhWW}1wD®h{®GdLsN£Jw~nf"g"x{rth¬yx'¤6z yhW£{hWL£w©as{Y1w~£{h4r|qw¼pH®

(8)

VÆ©pqafJw~nfpqdahWqh"as'pts{§as{qhWW}À¤h$¥¦xHfnaÃs{)s©w~{naw¼»LuWsnJpuxHgVg"xHnu|das{rtsHuvpqhWrqw©pqwu)pqdah"¥s{uvp

ptdas'p7pqdfh$©w~¹4h$x¥Spqdfh$£'srtwyxHaus{tqhWu4x'£{h4r|s{nµwyg"@x{rqptsnJpªr|sna{h)x¥fw¼«]h4rth4nJp7tu4s{yhBa`8)pqxV¥¦x{r

¬c<{1} 8ªptxVk¥¦x{r ¬c"8B{f} 87pqxgA)¥¦x{r ¬ciHksnL 87pqxVk¥¦xHr ¬clAa®S²³x{rth7Hh4nfhWrts{y~{}©Lu|d9u|dasna{hW

w~ntu4s{yh¬u4s{n9x1u4u4fr¥¦rqxHg x{nfh¬fspts§Ls{qhpqx"snaxpqdah4rB}H¥¦rtx{g xHnfh¬us{tQptxVs{nfxptdfh4r6¤wypqdfw~n9ptdfh)qs{g"h

as'pts{§as{qhx{r6h4£Hh4n9§@hp¤h4hWnLsrqptx¥pqdfh¬¥¦rtx{nJpqw~h4r6x{¥;s"qs{g"hu4~sHqW®h9fx{r6aqh4rqzo1h»anahW9u4~sHqqhWw~ns

§awyH{h4rGfspts{§as{qhsHqqx1uws'pthW)ptx)s7rthWs{1rqh4pqrtwyhW£'s1qu4h4nas{rqw~xa}'xHnfh©dax{fkh4¾1LhBuvpQh4£Hh4nV~s{rqHh4rSu|dasna{hW

w~n³tu4s~h)¥¦rtx{g3x{nfhku4~sHqpqx9s{nfxptdfh4rB®6lp¥¦x{~yx'¤pqdasp7s~x'¤Åqh4nL©wypqw~£w¼ppqxptdfhktu4s{yhx{¥Spqdfhkas'pts

u4x{fµ§@h$s1hWqwyr|s§ayh)¥¦hBs'ptfrqh$x¥Gptdfh$~hWs{rqnah4rªhWg"fyx'HhW¥¦xHr7:9]¤hV©dLs~;qh4hw~nÃ°1hWuvptwyxHn³ptdas'p

ptdfww~6w~na1hWhWpqdahu4s{qh{®

- -, , $ + +-,

lonÆpqdfw¬©hBuvptwyxHnÆ¤h$frthWqh4nJp7pqdfhVwygs{{h"1hWturtwyfpqx{r| RD©w~{nLs'pqarqhB X¤hVaqhVs{na³¤h$©pqrthWt7pqdfhVwygVz

@x{rqpts{nJp¬u4x{nfnfhBuvptwyxHn³pqdLs'p)h¾1wp|¬§Lh4p¤hWh4npqdfh Jas~wypµx¥ptdfh"wygs{{h"1hWturtwyfpqx{r|snarqhWyhW£'snau4h

¥¦hWhW1§Ls{u|¨]®

9;w~na1w~nf9HxJx1µw~gsHhk1hWturtw~1pqxHrt6ptdas'p)u4s{n³s{uWufr|s'pth4~1hBqu4rqw~§@h)pqdfhV£w~qas{s{q@hWuvpx¥Qgsn

fw¼«]h4rth4nJp9us{tqhWVx¥¬wygs{{hWVws´u|das~~h4nfHwynfÃp|s{q¨@®·°Lu|dºfhWturtwy1ptx{r|"srthhBs{qwyhWrVpqx¶uxHg"f1pqh

¥¦xHrq@hWuws~w~¹4hW>fs'p|s§asH©hB4}ª¤dfh4rthÃq@hWuwy»LufrtwyxHr¨nfx'¤~hW1HhÆu4s{n!§@hL©hB pqxº1hW£JwqhÃs_g"x{rth

fhW1wu4spqhW fhWturtwy1ptwyxHnºx¥¬pqdfhÆwygsHh³uxHnHpth4nJpW® /7nºx{nahÆ©w1hH}6pqdfhWrqhµwptdfhÆr|s'ptdfh4rqf§1hBuvpqw~£{h

arqxH§fyhWg x¥Yptdfh7£w©Ls]ux{nJpth4nJps{naÀ}x{nptdfhxpqdah4r6©w1h{}Jptdfh4rth7wpqdfh£{hWrq"fr|s{upqwu4sLnfh4hBptxk»anL

s³{xx1ÃpqhWu|danfw~uWs Ngs'ptdfh4gspqwu4s1hWturtwyfpqw~x{n¸x¥6ptdfw~Vtsg"h£w~qas{uxHnJpqh4nJpB®Æ°wynLuhptdfh4rthwnfx

@h4rq¥¦hWup1hBqu4rqw~1pqw~x{nVx¥À£w©as{auxHnJpqh4nJpRh4£{hWn"dJag"s{naQ1wts{rth4h¤dfhWnwynJpqhWrqarqh4pqw~nf)wygs{{hWXv}{gVxJp

g"h4pqdfx1fpqrtptxk»anLs${xx19u4x{g"frtx{g"w~qhªw~n9§Lssnau4wynf$pqdah¬fw¼«]h4rth4nJps{qLhBuvptx{¥w~g"s{{hux{nJpth4nJpW®

)+

È 3

' 1

È Í ¡ Ì Ì

1

È

È 64,D4

Ì 3

' ¶

Ts{t©wu4s{Su4x{~x{r)dfw©pqx{Hrts{g7Hwy£Hhs©ptspqwptw~uWs

fhWturtwy1ptwyxHn2x¥;pqdfhku4x{~x{ru4x{nJpqhWnHpw~n2pqdahwygs{{h{}a§f1pª¤wypqdfxH1pª¨Hh4h4awynfs{nqas'ptw~s{Ywynf¥¦x{rtg"spqw~x{n a

s{yLfwy¾hW~srthhJas{y~Vwyg"@x{rqptsnJpB}{w~na1h4@h4nL1h4nJpq~"x¥Àptdfh4w~r@xHqw¼ptwyxHnY®x'¤h4£Hh4rB}fwy¾hW~dasN£wyna)pqdfh

tsg"hu4x{~x{rsrth)nfx{p7©w~g"wysrªw¼¥G¤hkuxHna©w1hWrpqdfhWwyrªnfh4w~{d§@x{rtdfxxw~n2pqdfhkwygsHhcY8-A [ }4Y-[® 9ax{~yx'¤

ptdfh)w1hWsVx¥;¤hWwyHdJpqw~nf"hWs{u|d2uxHyxHr6§Js$g"hBs{qfrqh¬Hwy£w~nf$wyptwyg"@x{rqptsnLuh¬wynptdfh)yx1uWsYuxHnJpqh¾p-a

h( c ) = 1 M N

M − 1

X

i =0 N − 1

X

j =0

w(i, j)δ(f (i, j) − c )

¤dah4rth

h( c )

w~pqdfh7dfwptx{{r|sg £'s~fh¥¦xHrQpqdah7uxHyxHr

c

}

M

^snL

N

srthpqdah71w~g"h4naqwyxHnax¥Àpqdahªw~g"s{{h RwynÃfwy¾1h4X}

f (i, j)

^w~ptdfh R¦w~g"s{{h Xªu4x{~x{r7¥¦x{rpqdfh"fwy¾1h4

(i, j)

^}

w(i, j)

wpqdfh"¤h4w~{dJpqw~nf9¥¦fnauvptwyxHn s{na

δ(·)

^wptdfh wyr|s{uk1w~©pqrtw~§f1pqw~x{n ®:Vaqwyna91wy«@hWrqhWnHp7¤hWwyHdHptwyna¥¦fnaupqw~x{na7sna2£'srtw~x{au4x{~x{r

qasHuhWx{nfhu4s{nx{§1p|sw~n9s)¥s{g"wy~"x¥Yw~g"s{{h1hWturtwyfpqx{r|W®c6dfhWrqh7w~sk1Ls]s{qLhBuvpw~nptdfh¬1h»anaw¼ptwyxHn

x{¥]pqdfh7¤hWwyHdHptwyna)¥¦fnaupqw~x{na2aSh4g"fdasH©w~¹4w~nffnaw¼¥¦xHrqg srthWsHGx{rh4g"fdasH©w~¹4w~nfnfxHn1zfnfwy¥¦x{rtg¿s{rqhBs{;j

¤daw~u|d2s{qLhBuvpw6g"x{rthw~g"LxHr©p|snJp1h4@h4nLfx{npqdah Hah4rt{®

¯7©w~nf³s{¤hWwyHdHptwyna¥¦anauvptwyxHn

w(i, j) = ∆ ² (i, j)

^};¤dfhWrqh

∆

^w~¬ptdfh sfs{u4w~s{nÃu4x{g"f1pthW´s'p ptdfh¬ufrtrqhWnJpfwy¾hW

(i, j)

}h4g"fdasH©w~¹4hBu4x{rtnfh4r|Qs{nahB1{hBQw~npqdah7w~gs{hH®ÁÃhx{§1p|sw~nwynpqdfw6u4s{qhªs 4% J PO $® ªnfxptdfh4r7¤hWwyHdHptwyna$¥¦anauvptwyxHn³w~pqdfharqxH§as§fw~~w¼px¥Spqdfh$ufrtrqhWnJp

aw¼¾1h41u4x{~x{r;¤w¼ptdfwyn"s7yx1u4s{¤wynafx'¤ R %$%$ _JPOQ_ % bXv®Sl¥LpqdfwSfrtx{§as{§fwy~wypwS©gs{y

(9)

ptdfh4n$pqdahaw¼¾1h41§@h4~x{naHpqx)s7¹4x{nahw~nkptdfhw~g"s{{h¤dfh4rthpqdfhuxHyxHr;sHuvptwy£wypw~;w~g"LxHr©p|snJpW}x{pqdfhWrq¤wqh

¤h¬dasN£{h¬s"r|s'pqdah4r6fnfwy¥¦x{rtg srthWsa®Gc6dfw~¥¦anauvptwyxHng"hBs{qfrqhBpqdfh)~x1u4s{Yux{~x{r1xHg"wynas{nauhH®

ÁÃh4w~{dJpqw~nfÂ¥¦fnauvptwyxHna§frtwynfÂnfh4¤-w~n1¥¦x{rtgs'ptwyxHn·wynJptx¶pqdahÆdfwptx{Hrts{g"iR¦hH®L®P~xuWs¬©dLs@hÆx{r

pth¾pqarqh Xv}¤dfwu|dkwGsn$wyg"@x{rqpts{nHpSfrtwynLuw~fyh6w~nk§fawy1w~nf¬rqhWyws§f~hwygsHhqw~{naspqfrthWW® c6dfh6rthWqf¼ptwyna

w~nJpqhW{r|s'pqhB©w~{nLs'pqarqhBG{hWnfh4r|s~y$LhWr©¥¦xHrqg §@hpqpqh4rpqdLsn9su4x{g$§fwynLs'pqw~x{nx{¥ us{t©wu4s{D}J©w~nfHyh4zsH©@hWup

¥¦hBs'ptfrqhB4®

È È a26; > È Í È B¡,> Ì ' c x¸1hBqu4rqw~§Lh2ptdfh³qdas@h³uxHnHpth4nJpx¥)snºw~gs{h2¤h2a©h³s

daw~©pqxH{r|sg §Ls{qhW¸xHn¸pqdfh xHf{d¸ptrts{na©¥¦x{rtg}S¤dfwu|d¸{w~£{hB)ptdfhHyxH§as§LhWdasN£wyxHrks~x{naÆptrts{wyHdJp

~w~nfhW6w~nµ1w¼«]h4rth4nJpª1w~rthWuvptwyxHna R PO bXv®

ch¾pqarqhk¥¦hWs'ptfrthk£{hBuvptx{r|ªsrthk§Ls{qhWµxHnµpqdfh9fxHfrqw~h4r7pqr|snL¥¦xHrqg2}@x{§1p|sw~nfwynas9fw~©pqrtwy§a1pqw~x{n³x{¥

ptdfh©@hWupqr|s@x'¤hWr;1hWnaqw¼pks{yxHnfptdfh¥¦rqh Jfh4nau4s'¾1hWW®c6daw~GqwyHnas'ptfrth@h4rq¥¦x{rtg";¤h4~1x{nkpqh¾ptfrqh

w~gsHhWsnLÀ}faqhWw~n³ux{nfnauvptwyxHn2¤w¼ptdx{pqdfhWrw~g"s{{h)qwyHnas'ptfrqhB4}fuWsnµqwyHnfw¼»@u4snJptyw~g"frtx'£{hpqdfh

x'£Hh4r|s~L§@h4dLsN£Jw~x{rB®

c6dfh$wygs{{h¬¥¦hWspqfrthWª¤hka©h$dfh4rthks{rqhaQpqdah s{fs{uwsn2¤h4w~{dJpqhB2dfwptx{{r|sg2}1ptdfhkarqxH§as§fw~~w¼p

¤h4w~{dJpthW2dfwptx{Hrts{g}apqdfh xHf{d³daw~©pqxH{r|sg2}fptdfh9ax{frtw~h4rdfw©pqx{Hrts{gs{na³su4~sHqqwu4s;uxHyxHrdfwz

ptx{Hrts{g>xH§1pts{wynfhBw~n °± ux{~x{rSqas{u4h{® c6dfh;xHwynJp;¥¦hWs'ptfrth£{hBuvptx{r;das{g"x{rthptdasn;{{ª1wyg"hWna©w~x{nL4®

ÁÃh¸©dfxHf!©pqrthWt9dfhWrqhpqdahÆ¥ sHuvppqdasp2Hxx!©w~{naspqfrthWW}¤dfwu|d>u4x{g$§fwynahÃqh4£Hh4r|s7sH©@hWupt

x{¥¬pqdfhwygsHhÆuxHnJpqh4nJpiRDuxHyxHrW}6pth¾pqfrthÆs{na·qdas@h-X"w~n!s¶qw~nf{~h1hBqu4rqw~1ptx{rB}6s{rqh³pqdfh§as{qh2¥¦x{r

g"xHrqh³qx{fdaw~©pqwu4spqhW qhWs{rtu|dºg"hptdfx1f©au|d·sHrth4~h4£'snLuh2¥¦h4hB1§asHu|¨@®9¿qdfxHf~·nfxp9§@hÆL©hB

ptx_u4x{g"LhWnats'pqhÆ¥¦x{ryx'¤ Jas{ywyp wygsHhqwyHnas'ptfrthWW}§f1ppqxÂ@h4rq¥¦x{rtg ©hBsr|u|dfhWpqdasp§ xptdfh4r

arqw~nauw~f~hW6¤x{f§@h)g"x{rthfwkjua¼pwy¥;naxpwyg"@xHt©w~§f~h{®Q:9Âw~6w~n¥s{uvp£Hh4rtrqhW~spqhBpqxqf§1hBuvpqw~£{h

w~gsHhus{t©wy»Lu4spqw~x{nY}SsnL¸s2¨{h4Ãh4~h4g"hWnHpVsrth"pqdfh©w~{naspqfrthW)pqdasp$uxHnHp|sw~n¸gkau|d¸w~n1¥¦xHrqgs'ptwyxHn

¤dawy~h¬dasN£wynfsV~x'¤>1w~g"h4naqwyxHnY®

+, +-,#)+ "$* "+-,

c6dahV£Hh4rt³dfw~{dÃnfgk§@h4rx{¥1w~g"h4naqw~x{na¬x{¥ptdfh¬x{w~nJp¥¦hBs'ptfrqh£HhWupqx{r)uWsnÃg"s{¨{h:9!wyg"fr|s{upqwu4s

hW£{hWnº¥¦x{rgVhB1w~fgVzqwy¹Whfspts{§as{qhWW® qxa}ptdfhÆdfw~{dah4rptdfh´1wyg"hWna©w~x{nLs~w¼p x¥)ptdfhÃfhWturtwy1ptwyxHn

qasHuh{}fpqdfh$gVxHrqhfwkjua¼pªwptdfh)p|s{q¨x{¥ptdfhk~hWs{rqnfhWrW®lonµx{r|1h4rpqxrthW1au4h)pqdahk1w~gVhWnaqwyxHnµx¥Spqdfh

¥¦hBs'ptfrqh£HhWupqx{r|W}'¤haqh~wynahWsrGarqw~nauw~as{auxHgV@x{nah4nJpsnas{y1qw~lRWTX}H¤daw~u|d"wQs{upqas{y~$s{ff~wyhB

qh4Lsr|s'pqhWyÃptxÃhBs{u|d_x¥ptdfh2wygsHh9¥¦hBs'ptfrqhB"frth4£wyxHaqy¸1hBqu4rqw~§LhBÀ®ÂÁÃhµh4£'s{yaspqhpqdfh2rthptrqw~h4£'s

@h4rq¥¦x{rtgsnau4h¬x¥;pqdfh)rthWqfypqw~nfwygs{{h)1hWturtw~1pqxHrt6w~nµs ^`V±7½ ux{nJpth¾p§§ffw~~fwynfs$arqhBuw©w~x{n1z

rthWuWs~ 1wsHrts{g ¥¦x{r7hWsHu|d³fs'p|s§asH©hH®6c¤x9©Lu|d³1w~s{{r|sgs{rqh)frthWqh4nJpthW2w~nZ9;wyL® 8ksna³f® ¥pth4r

sVrthW1Luvpqw~x{nw~n2fwyg"h4nL©w~x{n2x¥Gs§@x{fp$ptwyg"hB4}f¤h¬rqhWgsw~n¤wypqdfw~n³s¿x'£Hh4r|s~]yxJq6x{¥ Jas{ywypw~n

ptdfh)frthWu4w~qwyxHn1z rqhBu4s~]1w~s{{r|sgW®

lonºfrth4~wyg"w~nasrt¶h4¾@h4rtw~gVhWnJptW}¤h³sfayw~hW WTptx´pqdfh³£HhWupqx{r|"uxHnHp|sw~nfw~nf¸s~6pqdfh³w~gsHh

¥¦hBs'ptfrqhB§ffpW}G¤wypqd_sÆ©w~g"wysr$rqhB1auvptwyxHn¸wyn 1w~gVhWnaqwyxHnY};pqdfhx'£{h4r|s~Qrthptrqw~h4£'srqhB©a¼p|¤h4rthnfxp

sH6{xx1À®ÁÃhsqxVh4¾1LhBuvpqhB2¨{hWrqnfhWÀWT RfY8N [Xpqx§@hpqpqh4r¥¦xu4axHnrth4~h4£'s{nHpnax{nf~wynahWsr Mq1w~g"h4n1z

qw~x{naeN pqdaw~"qdfx{f_wynafh4hWÂ§Lhptdfhµu4s{qh9¤dah4n_pqdfh2gsnfwy¥¦x{Âqas{nfnfhWÂ§¸pqdfhw~g"s{{hB$wV£{hWrq

~x'¤6zo1wyg"hWna©w~x{nLs§ffpqwyHnfw¼»@u4snJpty_nfx{nf~w~nfhWs{rW® ªx'¤hW£{h4rB}¤dfh4n!u4x{g"as{rqw~nf .¬WT ptxÂ~wynahWsr

T ¤hVnfxptw~u4hWÆpqdasp7ptdfhV»art©p)LhWr©¥¦xHrqg"hB³r|s'pqdah4rLxx{rt~2¥¦x{rpqdfh"Hh4nfhWrts{ywpwygs{{h$as'pts{§as{qhW

¤h)srth¬¤xHrq¨w~nfkxHnY}aqf{HhW©pqw~nfkptdas'pptdfh)frth4£w~x{a6s{tqfg"1pqw~x{nw~6¤rtx{naVw~npqdfhB©huWs{qhWW®

(10)

0.65 0.7 0.75 0.8 0.85 0.9 0.95 1

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

Precision

Recall

Full signatures PCA

9;w~{frthg8%aGhB©fypx¥Ss"rqhB1aupqw~x{nwynµ1w~g"h4naqwyxHn¤wypqd2~wynahWsr TÄx{npqdfh ¬c<{$as'pts{§as{qh{®

0.4 0.5 0.6 0.7 0.8 0.9 1

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

Precision

Recall

Full signatures PCA

9;w~{frthaGhWqfypx¥GsVrqhB1auvptwyxHnw~nµ1w~gVhWnaqwyxHn¤wypqd2~wynfhBsrWTÄxHnpqdfh ¬c"8B{Vfs'p|s§asH©hH®

(11)

ªxpqhªpqdaspwy¥ s~fpqdahªus{t©hBG¤h4rth¨Jnax'¤ns)frtwyxHrqwX}'pqdah4nx{pqdfhWrg"hptdfx1fqau|ds{1wqu4rqw~g"wynas{nJp

s{nas~1©w]¤x{f¬§Lhg"x{rthQsffrtx{arqws'pth¥¦xHr rthW1Luw~nf6pqdfh1w~gVhWnaqwyxHn)x¥pqdfh1hWturtwyfpqw~x{nqas{u4h{®°Lu|d

s{nsHqqfg"1pqw~x{nu4s{nfnfxp§@h¬g"sH1hwyn2rthWs]qw¼ptas'ptwyxHna6¤dfh4rth7pqdfh)us{tqhWsrth1h4»anfhB9w~nJpqh4r|s{upqw~£{hWy

§pqdahkaqh4r|4}Àqx¤h$sqx9sN£{xHw~1hB2gs¨wyna9wyp7dfhWrqhH}L¥¦xHrªptdfhkHrqxHfnaptrqfpqdÆfspts{§as{qhWª¤hL©hB³w~n

xHfrh4£'s{yaspqw~x{nY®

"$#% & 4Q 4 v (Skm(S

) ) "+-, , $ "+&- )' ,+ ,

lon_x{r|1h4r$pqxÃgs'¾1w~gVw~¹4h9pqdfh2r|s'ptwyx§Lh4p¤hWh4n¶ptdfh HLs~w¼p Rx{rVrqhWyhW£Ns{nauh Xx{¥pqdahrthWqfypt"sna¶pqdfh

s{g"x{fnJp)x¥wynJpqhWrtsHuvptwyxHnÆ§@hp¤h4h4npqdaha©hWr)snapqdah"q1pth4g2}Àptdfh©hWyhBuvptwyxHnx{¥w~g"s{{hBª¥¦xHr)¤dfwu|d

ptdfh)aqh4rws{q¨{hBptxVarqx'£w1hª¥¦hWhW1§Ls{u|¨9sppqdfh)nfh4¾p6rtx{ana9g$a©p§LhuWsrth¥¦f~ypta1w~hWÀ®

lonJpqhWrqhBptwynaµw~1hBs{)¤h4rthw~nHptrqx11LuhWÃw~n YA[s{na Y[X};¤dfh4rth"pqdah9frtx{§f~h4gfna1hWr)¥¦x1uakw~pqdfh

wypqhWrtspqw~£{hqhWs{rtu|dV¥¦x{rx{nfh7©@hWu4w¼»LuwygsHhwynsfs'p|s§asH©hRf_ QqhWs{rtu|dEX Hsph4£Hh4rtkrtx{fnaY}{ptdfhªaqh4r

wSrthJfw~rqhB¬pqx)u|dfxxHqh{}'§@hp¤h4hWnkptdfhp¤xw~g"s{{hBarqhB©hWnHpthWk§Jpqdfh6h4na{w~nfh{}'ptdfh6x{nfhptdas'pGwGu~xHqhW©p

ptxVpqdfh¬p|srt{hp6w~g"s{{hH®Sc6dah©hWyhBuvpqw~x{n2©pqr|s'pqhW{ffp¥¦x{rt¤s{rtw~npqdfwuWs{qhsp©pqhWg"1pt6ptx"w~1hWnJpqwy¥¦s'p

hW£{hWrq)rtx{fnLptdfhg"xH©pSw~n1¥¦xHrqgs'ptwy£Hh§awynas{rq$©hWyhBuvpqw~x{nL4}wX®h{®pqdfxJ©hpqdLs'psrthh¾1LhBuvpthW$pqx¬gs'¾1w~gVw~¹4h

ptdfh¬pqr|snL¥¦hWrx¥Swynf¥¦x{rtg"spqw~x{n2§@hp¤h4h4nptdfh)aqh4rªs{napqdfhhWnf{w~nfhbRx{rrth4g"x'£{h)s"gs'¾1w~g"s{Ysg"x{anHp

x{¥7fnLuh4rqpts{wynJp¸rth4Jsr|1wyna³pqdahp|srt{h4pXv® ÁÃh2u4x{naqw1h4rVpqdLs'ppqdaw~u4rqwypqhWrqw~x{nÂpqr|snaq~spqhB$w~nJpqxÃp¤x

u4x{g"f~h4g"h4nJp|srt2u4x{nafw¼ptwyxHna¥¦xHrpqdfhVwygs{{hW7w~nÆptdfhVqh4~hWupqw~x{n a7hWsHu|d³wygs{{hVgka©p§@h"sgk§awyHfx{a

Hwy£Hh4nptdfh¬ufrtrqhWnJphBptwygs'ptwyxHnx¥ pqdfhpts{rqHhp6snapqdfhrqhB1fnaasnau4V§@hp¤h4hWnptdfh)1w¼«]h4rth4nJp6wygs{{hW

dLs{6ptx§Lhkyx'¤)®6¯n1¥¦xHr©ptfnaspqh4~{}apqdfhkh4nJpqrtx{fwu)urtwypqh4rtw~x{n2h4g"f~x'{hBw~n?YA [X}4Y[;1xhBnfxpquWs~h)¤hWy

ptxkptdfhqhWsr|u|dx{¥w~g"s{{hBw~n2sksrt{hWrqhpR _ QqhWsr|u|dEXsnapqxVpqdah¬qh4~hWupqw~x{nx¥ g"xHrqh7pqdas{n2

w~gsHhWW®hTxHgVa1ptspqw~x{nas{Àx{1ptwyg"w~¹Ws'ptwyxHna6gkLp§@h¬¥¦x{fnaY}frqhWyw~nfVx{npqdfh)aqh¬x¥S©@hWu4w¼»Lu¬~hWs{rqnah4r|

s{naÀ}1@xHt©w~§f~{}fqLhBuwy»Lu)qhWsr|u|du4x{nJpqh4¾ptW®

V6s{qhW"xHnpqdah1h4»anfwypqw~x{nx{¥ s{upqw~£{h~hWs{rqnfw~nf RD©hWh¥¦xHrh4¾1s{g"fyh Y< [X}Hptdfh7qh4~hWupqw~x{nx{¥Yh¾fsg"f~hW

¥¦xHrQptrts{wynfw~nfk°±²³pqx@h4rq¥¦x{rtg Hh4nfhWrts{fus{t©wy»LuWs'pqw~x{nVp|s{q¨w~pta1w~hWw~n Y[®;Á dah4n"pqdah7us{tqw¼»fz

uWs'ptwyxHn9h4rtrtx{rw~nau4rqhBs{qhW¤w¼ptd9ptdfh)1w~©pts{nauh§@hp¤h4h4npqdah7g"wqu4~sHqqw¼»LhWh4¾fsg"f~hW6snapqdfh¥¦rtx{nJpqw~h4r

RDs`Mqqx¥pgs{rqHwynJNwa©hB¥¦xHrptdfh°±7²ZX}Jpqdfh)sfpqdfxHrtwynJpqhWrqhBptwyna{~"fw~©pqw~nf{aw~qdp¤x$uWs{qhW2ahBsrty

s{naµs'pth$©ptsHhWªx¥Q~hWsrtnfw~nfa®7lon³ptdfh$hBsrty2©ptsHhWW}aptdfh$u4~sHqqwy»Lu4spqw~x{nµx¥Qnah4¤h4¾1s{g"fyhBwª~w~¨{h4~

ptx³§@h¤rqxHnfa};©x2ptdfh¥sHpthW©pkrqhB1aupqw~x{n¸w~n¸{h4nah4r|s~wy¹Bs'pqw~x{nÃh4rtrtx{r)u4s{n¸§Lh9sHu|dfw~h4£{hBÃ§JÃ©hWyhBuvptwynf

ptdfh)h¾fs{gVayh¬ptdas'pw¥s{r©ptdfhW©p6¥¦rqxHg pqdahkufrtrth4nJphW©pqw~g"spqw~x{n2x¥;pqdah)¥¦rqxHnJpqw~h4rB® frtw~nf~spqh©pts{{hW

x{¥~hWsrtnfw~nfa}@ptdfhus{t©wy»Lu4spqw~x{n³x{¥nfhW¤h¾fsg"f~hWwyw~¨{hWy2ptx§@h"rqw~{dJp7§a1p¬pqdfh"gsrt{w~n³gsNµ§Lh

qf§@x{1ptwygs{D}aqxVpqdfh¬¥sHpthW©prqhB1aupqw~x{n2wyn2hWrqrtx{ru4s{n§@hs{u|dawyhW£{hW§qh4~hWupqw~nfVpqdfh)h4¾1s{g"fyh¬ptdas'p

w"u~xHqhW©pkptxptdfh2ufrtrqhWnJpVhBptwygs'ptwyxHnÂx{¥pqdfh¥¦rtx{nJpqw~h4rB® x{pqhpqdaspW}s{u4u4x{r|1w~nf³ptxÆptdfhu4~sHqqwu4s

¥¦xHrqg$fs'pqw~x{nx{¥ s{upqw~£{hª~hWs{rqnawynfL}{ptdfh¬s1ptdfx{r|QxHnfyu4x{naqw~fh4rQptdfh¬©hWyhBuvpqw~x{n9x¥ qwynfHyh7h¾fsg"f~hWQ¥¦x{r

s§@h4~w~nf R¥¦x{rsHf1wypqw~x{npqxVptdfh¬pqr|sw~nfw~nf©h4pX6s'phW£{h4rtrtx{fnaY®

ª~qx´¥¦x{r9°±²yhBsrtnfh4r|W}qh4£{hWrts{©hWyhBuvpqw~x{nºurtwypqh4rtwsÃs{rqh2frthWqh4nJpthW_wyn Y8 <2[7s{naºsfayw~hW_pqx

u4x{nJpqhWnJp©z §as{qhWÃpth¾pVrthptrqw~h4£'s{¤wypqd_rqhWyhW£Ns{nauh¥¦h4hWf§as{u|¨]®¸c6dfhqw~gVayhBp Rs{naÂu4x{g"f1p|s'pqw~x{nLs~y

u|dahWs@hW©pXYx¥fptdfhWqh6urtw¼pth4rtw~s7ux{nL©wp| w~n$qh4~hWupqw~nfptdfhpqh¾p|¤daxHqhrth4frthWqh4nJptspqw~x{naUR¦w~nptdfh¥¦hBs'ptfrqh

qasHuhVwynafauhBÆ§µptdfh"¨{h4rtnfhWPX7srthVu4yxJ©hBppqxptdfh"dJ@h4rtfsnfh"ufrtrth4nJpq~³1h»LnfhW§µpqdfh°±²¸®

(12)

ÁÃh7qdas{y]u4s{yapqdfw6©w~g"fyhurtw¼pth4rtwyxHn"pqdfh©hWyhBuvptwyxHnx¥ÀptdfhWM©g"xH©psg$§fw~{fxHa NR²Xu4snL1w~as'pqh RXv®

c6daw~7©hWyhBuvpqw~x{n³u4rqwypqhWrqw~x{n2wGa©pqwy»ahB³w~n?Y8<2[;§pqdfhk¥ s{uppqdasp7¨nfx'¤~hW1Hh)x¥Spqdahks§@h4 x{¥Q©au|d³s

uWsnafw~fspqhdLs~£{hWpqdfh$£{hWrtqwyxHn1zo©asHuhH®lon³pqdfw7uWs{qh{}Lpqdfh$£{hWrtqwyxHnµ©asHuhwªpqdfhV©h4p7x¥QLsr|sg"hpth4r|

x{¥ptdfh)dLhWrqfsnahWw~n¥¦hWs'ptfrth©asHuhpqdLs'p7s{rqh)uxHg"as'ptwy§f~h)¤wypqdpqdfh$s~rqhBs{1s§@h4~hW2h4¾1s{g"fyhB4®

c6dahfrtxJx{¥Àx¥]pqdfwrqhB©fypsHqqfg"hWSptdas'ppqdfhª£{h4r|qwyxHn"qasHuhwQnfx{ph4g"1ps{naVpqdaspW}Jwynpqdfh¥¦hBs'ptfrqh

qasHuhs{t©x1u4w~spqhWÆpqx³pqdfh¨Hh4rtnfh4X}s{yQpqdfhw~gsHhW¬x¥6£{hBuvptx{r|¬wyn´ptdfhw~nff1p$qasHuhdasN£Hh"u4x{na©pts{nJp

nax{rtg®;c6dfhWqh6s{t©fg"1ptwyxHna¤wy~dfx{¤wypqd"sfarqxHfrqws'pthu|dfxHw~u4hW ¥¦x{r;pqdfh¨{hWrqnah41sna)¥¦x{r;pqdfh6§@x{fnL

R

C

Xx{npqdfh"as{rts{g"hpqhWrtx{¥pqdah°1±7² Rptdfh

α

X®lonxHrt1hWrpqx2g"wynfw~g"wy¹Wh"pqdfh"nfg$§LhWr)x¥~hWs{rqnawynf

rtx{anafW}]pqdfhaqh4r¬w)s{q¨{hBµpqx2s§@h4qh4£Hh4r|s;h¾fsg"f~hW¬sp¬hW£{hWrqµrtx{fnLs{nas{ySptdfhWqh"h¾fsg"f~hW

s{rqhqh4~hWupqhBµs{u4u4x{r|1w~nfVpqx"pqdah$² u4rqwypqhWrqw~x{n ®lon?Y82; [pqdfhV² qh4~hWupqw~x{n³urtwypqh4rtw~x{nw~7sff~w~hWpqx

TWVl ¤wypqd_rqhWyhW£'snau4h¥¦h4hB1§as{u|¨¸s{na¶qdfx'¤n´pqxÃfrtxfauh9s³¥s{©pqhWr$w1h4nJptw¼»LuWs'ptwyxHn¶x¥ptdfh9p|srt{h4p

w~gsHhWpqdas{npqdfhqh4~hWupqw~x{nx¥Srts{na1x{g w~gsHhW¥¦x{rs§@h4~w~nfa®

$ * "+ , "!# "$* ,$, "+&- ) ' , +, + "!

Á dawy~hpqdfh¬² Äurtw¼pth4rtwyxHn9frtx'£w~fhWs$u4x{g"f1p|s'pqw~x{nLs~y"h«]hWupqw~£{h¬©xHyfpqw~x{nptxkptdfh)©hWyhBuvptwyxHn9x¥pqdfh

g"xJpsg$§fw~{fxHaw~gsHhW Rts'ptw~©¥¦wynakptdfh¬»ar|puxHna1wypqw~x{ngVhWnJpqw~x{nfhBs{§Lx'£Hh-Xv}1¤dah4na©hB¥¦xHr6pqdfh

qh4~hWupqw~x{nÃx¥6g"x{rth$ptdasn´xHnfhu4snL1w~as'pqh"w~gs{h"wyp$1xhW¬naxprth4g"x'£{h$pqdfhrthWffnafs{nauw~hW¬§@hp¤h4hWn

ptdfhu4s{na1wfs'pthW Rw¼pª1xhB6nfxpªts'ptw~©¥¦pqdah©hBux{nLu4x{na1wypqw~x{n Xv®

ÁÃh©fH{hBp¬dfh4rth$pqxpqr|snaqs'pqhkpqdfw)uxHna1wypqw~x{nÃx¥~x'¤rthW1anafsnLuµw~nHptxpqdfhV¥¦x{~~x'¤wynfs{ffw¼z

ptwyxHnas;uxHna1wypqw~x{n aw¼¥

x i

s{na

x j

s{rqh¬ptdfhkw~nfffpqas{u4hrqhWfrthWqh4nJptspqw~x{na6x{¥;p¤x9uWsna1wfspqhw~gs{hB4}

ptdfh4n"¤h6rqh Hawyrths7~x'¤Â£'s{yfh6¥¦xHr

K(x i , x j )

^R^wD®h{®Sx{¥apqdah£Ns{yah6pts¨Hh4nV§)pqdfh¨Hh4rtnfh4¥¦xHrSpqdfwGas{wyrGx{¥

w~gsHhWXv®;l¥Ypqdfh¨{hWrqnah4

K

ww~na1au4wynaVs w~y§@h4rqp6©pqrtaupqfrthªxHnpqdfh7¥¦hWspqfrth7qasHuh{}Jwy¥

φ(x i )

^}

φ(x j )

s{rqh$pqdahVw~gsHhWx¥

x i

}

x j

wynpqdaw~¥¦hBs'pqarqhqas{u4hVs{naÆwy¥s{ySptdfh"wygs{{hWx{¥£{hBuvptx{r|7w~npqdfh"w~nff1p

qasHuhVdasN£{h"uxHnap|snJp)nfx{rtg2}Àpqdah4npqdfws{a1w¼ptwyxHnasQu4x{nafw¼ptwyxHnuxHrqrthWq@x{naf7ptx2srthJfw~rqhWg"h4nJpx{¥

RJas{qw¼zeXoxHr©ptdfx{Hx{nas{ywyp§@hp¤h4h4n

φ(x i )

^s{na

φ(x j )

^R^qwynLuh

K(x i , x j ) = hφ(x i ), φ(x j )i

Xv®ªÁhkqdas{y

uWs~Àpqdaw~7urtw¼pth4rtwyxHn9ptdfhkqh4~hWuvptwyxHn2x¥Spqdfh`Mg"xH©pªsg$§fw~{fxHasnaxHr©ptdfx{Hx{nas{NRD² /"XuWsna1wfspqhW

R¤h)qdas~Yqh4h)s'pqhWrpqdasppqdfwnas{gVh¬wnfx{ppqxp|s~ysffrtx{arqws'pth¥¦x{ru4h4rqpts{wyn¨{hWrqnfhW~Xv®

ÁÃhµ©dfxHf¶nfx{pqhpqdaspVptdfhµ² / u4rqwypqhWrqw~x{nÂuWsn_§Lh2h¾pth4na1hB¸ptxÃrthWfauhrqhB1fnafs{nauw~hWV§@hz

p¤h4hWn9ptdfh)h¾fs{gVayhB©hWyhBuvpqhB21frtwynfqf§aqhJfhWnHp:9ÂrqxHfnafW®Qc6dfws{ffw¼ptwyxHnasYu4x{na©pqr|sw~nJp6gsN

§@hw~gV@x{rqpts{nJpwyn¸qw¼ptas'ptwyxHna¬¤dfh4rthVpqdfh9nJagk§@h4r)x¥6s§@h4~hWÃh¾fsg"f~hW¬w)g$au|d~x'¤h4r¬pqdLsnÃpqdfh

fwyg"h4nL©w~x{nx¥;pqdfh)w~nfffpª©asHuh)snLptdfhus{t©hB6srthrthW©pqrtwuvpqhB9w~n2g"xH©pfwyrthWupqw~x{naW®

c6dfh7² /·u4rqwypqhWrqw~x{nVdasHGs)©w~g"fyhªwynJpqaw¼ptwy£Hhh¾1fsnaspqw~x{n$¥¦x{rQ¨Hh4rtnfh4

K(x i , x j )

pqdasp1hWu4rqhBs{qh

¤wypqd´snwynLurthWs{qhVx¥Qptdfh1wp|snau4h

d(x i , x j )

R¦¤daw~u|dÃw~ptdfhu4sH©hk¥¦x{r)g"xH©p¬u4x{g"g"x{n¨{h4rtnfhW~XQaw¼p hWnauxHfr|s{hBQptdfhqh4~hWuvptwyxHnx{¥fna~s{§LhWyhBh4¾fsg"f~hWpqdaspªsrthª¥s{r6¥¦rqxHg hWsHu|dx{pqdfhWrwynw~nff1p7qasHuh{}

s{y~x'¤w~nfpqx§@hpqpqh4rh¾1f~x{rth6pqdahªufrtrth4nJpQ¥¦rtx{nJpqw~h4rB®cxw~gVayhWgVhWnJppqdaw~urtw¼pth4rtwyxHnY}{¤h»ar|pLhWr©¥¦xHrqg

s{nÆ² ©hWyhBuvpqw~x{nÆx¥ssrt{hWrªqhp7x{¥Qfnfs§@h4~hWÆh¾fsg"f~hWW®7c6dfhWnY}]¤hk§ffw~~³pqdfh"² / ©hWyhBuvptwyxHn

§w¼pth4r|s'pqw~£{hWyu|dfxxHqwynfµsHs2nfh4¤¿h¾fs{gVayh"ptdfh

x j

pqdLs'pkg"w~nfwyg"w~¹4hB)pqdahdfwyHdfhW©px¥6ptdfh£'s~fhW

p|s¨Hh4nÃ§J

K(x i , x j )

¥¦x{rks{yGptdfh

x i

h¾fsg"f~hWptdas'pks{rqhs{yrthWsH1µw~nau~a1hB´wynÃpqdah9ufrtrth4nJp² /

qh4~hWupqw~x{nY®

lonks{h4nah4r|s{u4~sHqqw¼»@u4s'ptwyxHn)ux{nJpth¾pW}'sqwyg"w~~s{r Mq1w~£{h4r|qw¼pNSu4x{nafw¼ptwyxHn¬¥¦x{rYptdfhqh4~hWupqhB)h¾fsg"f~hW

¤6s{f1p¥¦x{rt¤6sr|"wyn Yi[Às{nahW£'s~as'pthWxHn9qh4£{hWrts{a§@h4nau|dag"s{rq¨u4~sHqqw¼»@u4s'ptwyxHnfrtx{§f~h4g¥¦rqxHg pqdfh

(13)

w~n Y8<2[_a1w~£{h4r|qw¼pwgs'¾1w~gVw~¹4hB¤dfh4npqdah)dJ@h4rtfsnfhBs{t©x1uws'pthW9pqxVpqdahwynL1wy£w1as{Yh¾fsg"f~hW

s{rqhx{rqpqdax{{xHnasÀs{nas{rqhptdJLux{g"f~h4g"hWnHp|srt"pqxhBs{u|dxpqdah4rw~ndas{y£w~nfVpqdfh)£Hh4r|©w~x{n©Ls{uhH®

ÁÃhnaxpqhpqdaspptdfh6² _u4rqwypqhWrqw~x{n)w~nbY8 < [X}Y82; [wYptdfhtsg"hs{ pqdfhx{nfhf1p;¥¦x{rt¤s{rt¬w~n Y[¥¦x{rpqdfh

s'pth©pts{{hBx{¥ ~hWsrtnfw~nfa®Gc6dfwusrtwy»ahWpqdfh¥sHuvp6pqdasp6pqdfh)² Äurtwypqh4rtw~x{n9rth4~w~hWx{n9p¤xVwyg"@x{rqpts{nHp

¥¦ar©ptdfh4rsHqqfg"1pqw~x{nLa»ar|pB}QptdfhµfrtwyxHrVxHnÂptdfhµ£{hWrtqw~x{n_qasHuh2w~"r|s'ptdfh4r"fnaw¼¥¦xHrqg qhWuxHnaÀ}pqdfh

qx{~1ptwyxHn"¥¦x{fna§JVptdfh°±²*wu4yxJ©hptxptdfh7u4h4nJpqhWrx{¥]HrtsN£wypkx{¥Àpqdfh7£{h4r|qwyxHn©asHuhH®;c6dfh©hBuxHna

sHqqfg"1ptwyxHnVuWsn"§LhªrqhWyw~h4£HhW$§J$aqwynfV6sNHhW;Sx{w~nHp²Æs{u|dfw~nfhW:Y8N-[aw~napthWsH$x{¥À°1±7²³x{rSpqdahg"x{rth

qx{adfw~©pqwu4spqhBu4rqwypqhWrqwska1p¥¦x{rt¤s{rt9wyn Y8 <2[}as{y§@h4wypªs'psVdfw~{dfhWrux{g"ffpts'ptwyxHnasYu4xH©pW®

ªx'¤hW£{h4rB}Jwyn9pqdfh¬hWs{rq~p|sHhWQx{¥sn:9¶qhWt©w~x{npqdfh7¥¦rqxHnJpqw~h4r¤wy~Àaqas~y"§@h¬£{h4rt"fnfrth4~w~s{§f~h

s{naÀ}1h4@h4nL1wyna$xHnpqdfh7wynaw¼ptw~s{yw~¹Wspqw~x{nx{¥Àpqdfh¬©hBsr|u|dsna"ptdfh¬u|dasr|s{upqh4rtwptw~uWGx¥Àptdfh7u4~sHqqhWW}HgsN

§@hg$au|dsrt{h4rSptdasn"ptdfhp|srt{h4pus{tRptdfh4rthªs{rqhg$au|d"¥¦h4¤h4rh¾fsg"f~hWQpqdas{n1wyg"hWna©w~x{nLQw~npqdfh

fhWturtwy1ptwyxHn³©Ls{uh Xv®6l pª¥¦xHy~x'¤6ptdas'p7pqdfhk»art©p7sHqqfg"1pqw~x{nµgsNnfxp7dfx{2wyn³pqdfh$hWsrt~©ptsHhWx{¥

~hWs{rqnawynfL®lon©Lu|d9u4sH©hB4}©hWyhBuvptwynfkpqdfxJ©h7fnfs§@h4~hW9h¾fsg"f~hWpqdasp6s{rqh7ufrtrqhWnJpq~"u4x{naqw1h4rthW"§

ptdfhVyhBsrtnfh4r¬s{gR¦@xpth4nJpqws~~XpqdahVg"xJp¬rqhWyhW£'snJpuWsnqx{g"h4pqw~gVhBªarqx11au4hVs9¥s{©pqhWru4x{n£{hWrqHh4nau4h

x{¥ ptdfh¬¥¦rqxHnJpqw~h4r1frtw~nfVpqdfh¬»ar|©p¥¦hW¤>rtx{anaf6x¥S:9®

9ax{rVpqdfwVrqhBs{qx{nY}S¤hsHf1hW¶pqxÃx{fr"uxHg"asrtw~qx{nL)pqdah9¥¦xHy~x'¤wynaÆurtw¼pth4rtw~sa9qh4~hWuvp$pqdfhbM©g"xH©p

@xHqwypqw~£{hQNanf~s{§LhWyhBh4¾1s{g"fyhBsHu4u4x{r|1wynapqxªpqdfh6ufrtrth4nJp;1hBuw©w~x{n¥¦fnauvptwyxHn$x{¥1pqdfh°±² RD1h4nfx{pqhB

sHG²µ¶urtwypqh4rtw~x{nEXSs{na"©hWyhBuvpGpqdahUMg"xJpG@xHqw¼ptwy£HhsnaVx{rqpqdax{{xHnaskNfna~s{§LhWyhB$h4¾fsg"f~hW:RD1h4nfx{pqhB

sH²³ /"Xv®c6dfh´²µ /u4rqwypqhWrqw~x{n·sHff9pqxº²µ ptdfh´ux{nL1w¼ptwyxHn!x{¥yx'¤-rthW1anafsnLuºfrth4£wyxHaqy

fhWturtwy§@hWÀ®VÁ dfhWnÃu4x{g"asrtw~nf9ptdfh²µ urtw¼pth4rtwyxHn³ptxptdfhqf{HhW©pqw~x{n³w~n Y[G¥¦xHr¬pqdfh"hBsrty³©pts{{hW

x{¥~hWs{rqnawynfL}Y¤h"qh4h"ptdas'p¤h"x{nf~µ¥¦x1uL)x{nÃpqdahh¾fsg"f~hW¥¦xHr)¤dfw~u|dÃptdfh£'s~fhW¬p|s¨Hh4nÃ§JÆpqdfh

fhWuwqwyxHn¥¦anauvptwyxHnÃx{¥6pqdfh°1±7² srthgs'¾1wygs{sna´u4x{g"f~hpqhWywyHnfx{rthVpqdfh9h¾fsg"f~hW¥¦xHr¤dfwu|d

ptdfhWqh³£'s~fhB9srth³g"w~nfwygs{7pqdfww~9§LhBu4sL©h³x{¥)pqdfhÃs{qgVg"h4pqrtÂx¥¬ptdfhÆrthptrqw~h4£'suxHnHpth¾p2aÃw~n

Hh4nfhWrts{D}Sptdfh2nfgk§@h4r"x¥7rqhWyhW£Ns{nJpVwypqhWg""wVh¾1@hWuvpthWÂpqxÃ§Lh2g$au|dÂ~x'¤hWrkptdasnÂpqdfh2nfg$§LhWrVx{¥

w~rtrqhWyhW£Ns{nJpwypqhWg"W®

' + , ) &()*#( "+-, "$* ,$, "$* "+-,

ÁÃh@h4rq¥¦x{rtg"hW"uxHgVLsrtw~qx{na;§@hp¤h4hWn$ptdfh¥¦xHfrqh4~hWuvptwyxHnurtw¼pth4rtw~s¬xHn$ptdfhHrqxHfnaptrq1ptdVas'pts{§as{qhW

ws = 9

ws−1

u4~sHq6qh4rt£{hBsHpqdfh)w~nfwypqwsM©rqhWyhW£Ns{nJpeN7h4¾1s{g"fyh¥¦xHr6s"1wy«]h4rth4nJpª:9¶qhWt©w~x{n }J¤dawy~h¬pqdfh)sHqqx1uws'pqhB

w~nfwypqws

ws − 1

M©wyrtrth4~h4£'snJpeNh¾fs{gVayhBksrth9r|snL1x{g"~qh4~hWuvpthWÀ® 9fxHrkrthWsH©xHna¬pqdLs'p"¤wy~§@hWu4x{g"h s{fas{rqhWnHp6w~nµ°1hWuvptwyxHnL}f¤hL©h¥¦x{r6ptdfhuxHg"asrtw~qx{nLarqhB©hWnHpthWdfh4rthpqdfh¬ptrqwsna{fsr6¨{hWrqnah4X®

ÁÃh§LhWHs{n§³hW£Ns{yLs'pqw~nfpqdah"fw¼«]h4rth4nJpkqh4~hWuvptwyxHnÃu4rqwypqhWrqwsx{npqdfh '42 É > ÈÂÌ 5 >; Ì È

g"hWnHptwyxHnfhW9wyn9pqdfhw~nHptrqx11Luvpqw~x{n#a»Lna1w~nf$wypqhWgw~ns$©@hWu4w¼»@up|srt{hp6©h4pW}1§V¥¦x1uaqwyna$xHnrts{nf¨wyna

g"xJpx¥Gpqdah`M©rqhWyhW£Ns{nJpeNwygs{{hWª§Lh4¥¦x{rthptdfh"M©w~rqrth4~h4£'snJpfN¬xHnfhW7rtspqdfhWrptdasn³xHnµ»anafwynfs¥¦rtx{nJpqw~h4r

§@hp¤h4hWn¶ptdfhu4~sHq$x¥7wynJpqhWrqhBp"sna¶pqdfhxptdfh4rVw~g"s{{hB4®¶°w~nauhpqdahxHnf~Ãw~n1¥¦xHrqgs'ptwyxHnÂsN£'sw~~s{§f~h

r|sna¨Jw~nf³x{¥pqdfhgMrth4~h4£'s{nHpfNx{rkx{¥pqdahM©wyrtrqhWyhW£'snJpeNwygs{{hWW®ÆlonÂx{r|1h4rkpqxÆhW£'s~as'pthpqdahqLhWhW¸x{¥

(14)

0.4 0.5 0.6 0.7 0.8 0.9 1

0 2 4 6 8 10

Mean precision

Iteration

MAO MA MPO MP

0.4 0.5 0.6 0.7 0.8 0.9 1

0 5 10 15 20 25 30 35 40

Mean precision

Iteration

MAO MA MPO MP

(15)

0 0.5 1 1.5 2 2.5

0 2 4 6 8 10 12 14 16 18 20

Classification error

Iteration

MAO MA MPO MP

9;w~{frthªa;½Q£Hx{~1pqw~x{n"x¥]ptdfhªus{tqw¼»LuWs'ptwyxHnVhWrqrtx{rGxH§1pts{wynahWV¤w¼ptdpqdahª1wy«@hWrqhWnHp©hWyhBuvpqw~x{n©pqr|s'pth4{w~hW

xHn9ptdfh ¬c<Vfspts{§as{qh{®

ptxx{nfhqh4~hWupqw~x{nµurtwypqh4rtw~x{nY® 9ax{rh4¾1s{g"fyhH}f§p|s¨wynawynJpqxsHu4u4x{fnJps~rqhBs{19~s{§LhWyhB2wygsHhW6f~a

N

^§LhWwynf

ptdfh)nfgk§@h4rx{¥;w~gsHhWwyn2hBs{u|d2us{t X®

fhWturtwy§@hWµs{§Lx'£Hh{®:TyhBsrtyH}fpqdahrqhB1aupqw~x{nµx¥SptdfhkrthW1anafsnLu9§@hp¤h4hWnµpqdahwygs{{hWª©hWyhBuvpqhB¥¦x{r

²³ºs{na²µ /Purtw¼pth4rtw~sa®

q~wyHdHpty"§@hpqpqh4rB}f1frtw~nfkptdfh7»art©p6w¼pth4r|s'pqw~x{nL4}Hpqdas{n9ptdfh¬² Äsna²/Äurtw¼pth4rtw~sa®;c6daw~§@h4dasN£w~x{rw~

pfwu4s{Y¥¦xHrWMpqrtwy£wskNu4~sHqqhWW}awX®h{®¥¦xHrª¤dfwu|dÆqwyg"f~h JfhWrqw~hWª§Jh¾fs{gVayh$hWs{qw~y»ana³s{yx{r7gVxJp

x{¥ ptdfhMrth4~h4£'s{nHpfN7w~g"s{{hB4®

¥¦rtx{nJptwyhWr§@hp¤h4hWnGM©rth4~h4£'snJpeN"snaGMw~rtrqhWyhW£Ns{nJpeNkw~g"s{{hB4}À¤dfwu|d´u4snÃ§@hwyg"@x{rqptsnJp¥¦x{r)h4¾Jpth4nafwynf

pth¾pqLs1snfnaxptspqw~x{na;x{¥L©xHg"hw~gs{hB;wyn$pqdfhhM©rqhWyhW£Ns{nJpeNu4~sHq pqxpqdahx{pqdfhWrtW® lon$pqdfwGu4sH©hH}'¤hdasN£Hh

ptxh4£'s{yaspqhptdfh7q@h4hW"x{¥Àwyg"frtx'£{hWgVhWnJpQx¥Àpqdahªus{t©wy»LuWs'pqw~x{n ®;c6dfh7us{t©wy»Lu4spqw~x{n"h4rtrtx{rGw1h4»anfhB

dah4rth¬sH

n/N + (N − p)/N

^}f¤dfh4rth

N

w~6ptdfhku4~sHqqwy¹Wh{}

n

N −p

w;pqdahnJagk§@h4rGx¥@¥sqhnah4Hspqw~£{hB4®lon9;w~a®G7¤huWsn"©hWhptdfhh4£Hx{~1pqw~x{n$x¥@pqdfhu4~sHqqw¼»@u4s'ptwyxHn hWrqrtx{r;¥¦xHrSpqdfhªfw¼«]h4rth4nJpqh4~hWuvptwyxHnVu4rqwypqhWrqwsx{n$pqdfh ¬c<fs'p|s§asH©hH® 7Gh¾1@hWuvpthWÀ}{pqdfhu4x{n£{hWrqHh4nau4h

(16)

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7

0 2 4 6 8 10 12 14 16 18 20 MAO

MA MPO MP

9;w~{frth ;daÃ½Q£Hx{~1pqw~x{n x{¥ptdfh³r|s'pth³x¥M¥s©hµ@xHqw¼ptwy£HhWeN2xH§1pts{wynahWº¤wypqd ptdfhÆ1wy«@hWrqhWnJp©hWyhBuvptwyxHn

0 0.5 1 1.5 2 2.5 3 3.5

0 2 4 6 8 10 12 14

SVM positives / class size

Iteration

MAO MA MPO MP

9;w~{frth <aY½Q£Hx{~1pqw~x{n$x¥fptdfhr|s'ptwyx7§Lh4p¤hWh4nkpqdfhwygs{{hW;uxHnaqw~1hWrqhB)§¬pqdfh°±² s{ M©rqhWyhW£'snJpeNsnL

ptdfh¬nfgk§@h4rx{¥w~g"s{{hBw~nµs"us{t¥¦xHrpqdfh1wy«]h4rth4nJp©hWyhBuvpqw~x{n2©pqr|s'pqhW{w~hWx{npqdfh ¬c<{kas'pts{§as{qh{®

(17)

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9

-3 -2 -1 0 1 2 3

Mean precision

log(γ) Hyperbolic

Laplace RBF Hyperbolic MAO

9;w~{frth7aQ°h4naqwypqw~£Jwypx¥ pqdfh°±²-pqx"sVquWs~h7as{rts{g"hpqhWrQ¥¦xHrptdfh¬1w¼«]h4rth4nJp6¨{hWrqnfhW~x{n9pqdfh ¬c<{

as'pts{§as{qh{®

;f}@sqwyg"w~~s{rh4£Hx{~1pqw~x{n2w¥¦xHfna¥¦x{rªpqdfhkrtspqh)x¥S¥s{~qh@xHqw¼ptwy£HhWW}fx¥Gfrtwygs{rqwyg"@x{rqptsnLuh¬¥¦x{rªpqdfh

cx"§Lh4p©pqhWrfna1hWrt©pts{naptdfh)§@h4dasN£w~x{rx¥ ptdfh)1wy«@hWrqhWnHpqh4~hWupqw~x{nu4rqwypqhWrqwsf}¤h)s©xVpta1w~hWpqdfh

nfg$§LhWrQx¥Àw~gs{hBSwyn"ptdfhªu4~sHqW}'¥¦x{rpqdfhfw¼«]h4rth4nJpqh4~hWupqw~x{nurtw¼pth4rtw~s¬xHnVpqdfh ¬c<{¬fs'p|s§asH©hH®c6dfh

rthWqfyptGxH§1pts{wynahWVx{nVpqdah ¬c<fspts§Ls{qh6s{rqhqdfx'¤nVwynb9;w~a® <®Sc6dfhªu4x{n£{hWrqHh4nau4hwQqwyHnfw¼»@u4snJpty

¥sHpth4r6¥¦xHr6pqdfh² /sna² u4rqwypqhWrqwsf}1§@hWuWsaqh)²µ sna2²µ /1xnfx{p¥¦x1u4ax{npqdah¬¥¦rqxHnHptwyhWrW®

L V5)(; 4 &4 kS ¶; :6(S

u4~sHqqhW6x{¥pqhWn2u4x'£{hWrt6sn2w~g"LxHr©p|snJprts{nf{hx¥Q1wy«]h4rth4nJpªquWs~hW Rf8¬pqx <k¥¦x{r6ptdfh ¬c<{$as'pts{§as{qh{} 8

ptxk7¥¦x{rGptdfh ¬c"8WH)fs'p|s§asH©h Xv®Áhh4¾1LhBuvpQ{h4pQg"x{rth©w~{nfwy»LuWsnJpQu|dasnfHhWSw~nquWs~hpqxx1u4u4frS¥¦rtx{g

xHnfhfspts§Ls{qh¬pqxsnaxpqdah4rB}f¥¦rtx{g xHnfhaqh4rqzo1h»anahW2us{tpqx9s{nfxptdfh4rª¤w¼ptdfwyn³s~s{rqHh¬as'pts{§as{qh)x{r

§@hp¤h4hWnµasrqptx¥Spqdfh¥¦rqxHnHptwyhWrx¥Qqx{g"hku4~sHqqhWW® pqxxptrqxHnfqh4naqw¼ptwy£wypx{¥Spqdfh~hWs{rqnah4rptxpqdfh

tu4s{yh¬x{¥ pqdahfs'p|sVu4x{f9pqdfhWn2qh4rtw~x{aqy9yw~g"w¼pwypts{ff~w~uWs§fw~~w¼pw~n2snµ:9Âu4x{nJpqh4¾pW®

s{napqdfh

C

§@x{ana2x{n2ptdfh

α

C

§@x{fnLuWsn§Lhqhpw~n2x{frrthptrqw~h4£'sÀu4x{nJpqh4¾Jp ptx©xHgVh¬dfw~{d2£'s~fh¬¤wypqdfxH1pª©w~{naw¼»LuWsnJpq~9s«@hBuvpqw~nf"@h4rq¥¦x{rtg"s{nauh Xv®

c6dfh7»ar|p¨{hWrqnfhWL¤h7u4x{naqw1h4rw~pqdah ¬s{aqqwsnZRx{r6s{1wsV6s{qw~W9fanauvptwyxHnEXQxHnfh{}

K(x i , x j ) = exp − γkx i − x j k ²

γ

(18)

0.2 0.3 0.4 0.5 0.6 0.7 0.8

-3 -2 -1 0 1 2 3

Mean precision

log(γ) Hyperbolic

Laplace RBF

as'pts{§as{qh{®

c6dfhaqh9x¥6ptdfhsfs{u4hZR¦xHrkh¾1@x{nfhWnJpqwsX¬¨{hWrqnfhWD}

K(x i , x j ) = exp − γkx i − x j k

^}G¤6s{

sH1£{x1uWs'pqhBÃwyn Y; [¥¦x{r$dfw~©pqxH{r|sgVz§as{qhWwygs{{h1hBqu4rqw~1pqxHrtW®2lon Y8Wi [}Spqdfw¨Hh4rtnfh4¤sH¬¥¦x{ana´pqx

c6dfh6dLhWrq§@x{~wu¨Hh4rtnfh4X}

K(x i , x j ) = 1

ε+γkx i −x j k

}{uWsnk§@huxHgVa1pqhB¥sHpGsnak¤hdasN£Hh s{yrthWsH1aqhW2wypª¥¦xHrª:9 ¤wypqdµ{xx12rthWqf¼p|4®6c6dfhVquWs~h)asr|sg"hpth4rw

γ

^s{Hs{wyn

ε

γ

snaµwx{nf~2aqhW2pqxsN£{xHw~2nfg"h4rtwu4s;frtx{§f~h4g

R¤h)qhpwyppqxf®{8-X®

ªy;pqdahkptdfrqhWhk¨Hh4rtnfh4¤hkg"h4nJptwyxHnfhWsrthLxJ©wypqw~£{hV1h»Lnfw¼pth$¨Hh4rtnfh4W®7c6dfhkpqrtw~s{nf{fsr7¨{hWrqnfhWD}

K(x i , x j ) = −kx i − x j k

}J¤6s{Gw~nJpqrtxfauhBwyn Y8[]s{s "LxJ©wypqw~£{hªfh»anfwypqh7¨{hWrqnfhWD}H§f1p ptdfhuxHn£{h4rt{hWnauhVx¥°±²³)rth4gsw~na¬{Lsr|snJpqhWhW³¤wypqdÃptdfw~k¨{hWrqnfhWlY8W[®lon Y8B [Qpqdahpqrtw~s{nf{a~s{r

¨Hh4rtnfh4]¤6s{6qdfx'¤nptx$dasN£HhsV£Hh4rtVw~nJpqhWrqhBptwynfVfrtx{@h4rqpa;wypgs¨{hBpqdfh¥¦rtx{nJpqw~h4r¥¦x{ana9§°1±7²³

C

§LxHfnaÀ}§f1p hW£{hWn¶pqdahWqh~w~gVwypt9srth~hWtptrqxHnf¥¦x{rVpqdfh2ptrqwsna{fsrV¨{hWrqnfhWpqdas{nÂ¥¦xHr"pqdfh ¬sLqqw~s{n_¨Hh4rtnfh4Xv®

ªxpth¬pqdaspª©w~nauh¬ptdfh¬pqrtwsnfHf~s{r6¨{h4rtnfhWÀw~naxp@xHqw¼ptwy£Hh1h»anaw¼pth)§f1pªxHnfyux{nL1w¼ptwyxHnas~~LxJ©wypqw~£{h

fh»anfwypqhH} ptdfhs{uWuxHfnJp¬arqx'£w1hWÆwyn Y8 <2[} Yi[¥¦x{r¬pqdah² ©hWyhBuvptwyxHn´u4rqwypqhWrqw~x{nÃ1xhW)naxpdfxH~Æ¥¦x{r

ptdfw¨Hh4rtnfh4X® x'¤h4£{hWrW}qwynau4hªptdfh£Ns{yah7x{¥

K(x i , x j )

d(x i , x j )

}{xHfrÀa©pqwy»Lu4spqw~x{nV¥¦x{rSptdfhª² /!urtwypqh4rtw~x{nVdfx{fW}{s{G¤h4~asH;pqdfhGLptw¼»LuWs'ptwyxHnVx{¥Lptdfhª² u4rqwypqhWrqw~x{n´w~n Y%[X® ªxpqhpqdaspkpqdahaqhx¥sµg$f¼ptwyaywu4spqw~£{has{rts{g"hpqhWr)¥¦x{rpqdfh9pqrtw~s{nf{fsr)¨Hh4rtnfh4

Rh{®a®

K(x i , x j ) = −γkx i − x j k

XdasH6nfx"h«]hWupx{npqdfhk°±²¸®

¥¦xHfnakw¼pSpqxfrtx'£w~1h§Lh4p©pth4rSrqhB©a¼p| ptdasnf® Â¥¦h4¤Âx{pqdfhWr;fw~t©w~g"wysrtwypg"hBs{qfrqhBURD©xHg"hx{¥a¤dfwu|d

kx i −x j k

}gs{wynf~

¤wypqdÆpqdfh ¬s{aqqwsn³¨Hh4rtnfh4SsnaÆ©xHgVh4pqw~g"hW7¥¦x{r£'srtw~s{§fyh4zX~h4napqdÆrqhWfrqhB©hWnJpts'ptwyxHnax{¥Qpqdah$w~gs{hB4®

°1x{g"h)x¥SpqdahWqhg"hWs{qfrthW1xHnpª{as{rts{nJpqh4hptdfhkuxHn£{h4rt{hWnauhx¥Sptdfh$°±² sna2¤h)frth¥¦h4rtrthWnfxp

(19)

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

0 2 4 6 8 10

Mean precision

Iteration

Hyperbolic Laplace RBF Triangular

9;w~{frth"8Wa Tx{g"as{rqw©xHnkx{¥apqdah1w¼«]h4rth4nJpQ¨Hh4rtnfh4;x{n$pqdfh ¬c<{7as'pts{§as{qh{}'¤wypqdVptdfh²µ¸©hWyhBuvptwyxHn

u4rqwypqhWrqw~x{n ®

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

0 5 10 15 20

Mean precision

Iteration

Hyperbolic Laplace RBF Triangular

9;w~{frth:88%a#Tx{g"as{rqw©xHn¬x¥pqdfh1wy«@hWrqhWnHp;¨{hWrqnfhW~Yx{n¬pqdah¬c"8WHfs'p|s§asH©hH}W¤wypqdpqdfh²³Æ©hWyhBuvptwyxHn

u4rqwypqhWrqw~x{n ®

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE

THÈME 3