• Aucun résultat trouvé

Appendix C: Results of the Robust-WSD Track

N/A
N/A
Protected

Academic year: 2022

Partager "Appendix C: Results of the Robust-WSD Track"

Copied!
787
0
0

Texte intégral

(1)

Appendix C

Results of the Robust Track

Prepared by:

Giorgio Maria Di Nunzio and Nicola Ferro

{dinunzio, ferro}@dei.unipd.it

Department of Information Engineering University of Padua

Italy

(2)
(3)

Introduction

(4)
(5)

1.

2.

3.

- - - -

- - -

- - -

- - -

- - - - - - - - - - - - -

The following pages contain the results and graphs for all the experiments that have been officially submitted to the CLEF 2007 campaign for the Ad-hoc Robust track.

This document is divided in three main parts:

List of submitted experiments Track overview results and graphs Individual experiment results and graphs

1. List of Submitted Experiments

This section gives a listing of all experiments and their characteristics:

2. Track Overview Results and Graphs

For each track/task graphs and tables are shown in order to compare the experiments.

The graphs and tables contain the following information:

Best experiments of at most top five participants Interpolated recall vs precision averages plot Average precision comparison to median plot All experiments

Average precision box plot Average precision Tukey t-test plot

Best experiments of at most top five participants Document cutoff levels (DCL) vs precision at DCL plot R-Precision comparison to median plot

All experiments R-Precision box plot R-Precision Tukey t-test plot

A table with descriptive statistics of performance figures for each topic Min: The minimum of a set of observations

1st Q: The first quartile of a set of observations

2nd Q: The second quartile (median) of a set of observations 3rd Q: The third quartile of a set of observations

Max: The maximum of a set of observations Mean: The arithmetic mean of a set of observations Std: The standard deviation of a set of observations

IQR: Interquartile range, the difference between the 3rd and 1st quartiles

Range: The difference between the maximum and the minimum of a set of observations C.Var: Coefficient of variation, the spread of a set of data as a proportion of its mean Geom.: The geometric mean of a set of observations

Harm.: The harmonic mean of a set of observations

MAO: The mean of absolute deviation of the values in a set of observations

Results for CLEF 2009 Ad-hoc Robust Track

Participant: name of the participant who submitted the experiment.

Country: country of the participant.

Expeirment DOI: Digital Object Identifier (DOI) for each experiment.

Task: track/task to which the experiment belongs.

Lang.: language of the topics used to create the experiment (ISO identifiers for language).

Fields: identifies the parts of the topics used to create the experiment (T = title, D = Description, N = Narrative).

Constr.: identifies how the query has been constructed from topic fields (manual/automatic).

Pool: specifies if experiment was used for relevance assessment pooling.

(6)

- - - - - - -

3. Individual Experiment Results and Graphs

This section provides the individual results for each official experiment. For each experiment the following tables and graphs are shown:

Overall statistics and information

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL plot R-Precision statistics and box plot

R-Precision comparison to median plot

Topics are identified with DOIs, as well as the experiments. The prefix for the DOI of a topic is 10.2452. The following example

shows how to build the DOI for a topic given its number: for topic 200-AH, the corresponding DOI is 10.2452/200-AH

(7)

List of Submitted Experiments

(8)
(9)

darmstadt Germany 10.2415/AH-ROBUST-MONO-EN-TEST- CLEF2009.DARMSTADT.DA_1

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no darmstadt Germany 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.DARMSTADT.DA_2

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no darmstadt Germany 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.DARMSTADT.DA_3

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no darmstadt Germany 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.DARMSTADT.DA_4

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no darmstadt Germany 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.DARMSTADT.DA_5

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.GENEVA.ISIENNATDOMTDN

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TDN AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.GENEVA.ISIENNATTDN

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TDN AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.GENEVA.ISILEMTD

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.GENEVA.NAT_TDN_WEB

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TDN AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.GENEVA.NUS_WSD_TD

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no ixa Spain 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.IXA.ENENNOWSD

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no know-center Austria 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.KNOW-CENTER.ASSO

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no know-center Austria 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.KNOW-CENTER.SYNONYM

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no know-center Austria 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.KNOW-CENTER.SYNSET

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no reina Spain 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.REINA.ROB1

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no reina Spain 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.REINA.ROB2

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TDN AUTOMATIC no reina Spain 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.REINA.ROB3

AH-ROBUST-MONO-EN-TEST-CLEF2009 en T AUTOMATIC no reina Spain 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.REINA.ROB4

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TDN AUTOMATIC no reina Spain 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.REINA.ROB5

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no ufrgs Brazil 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.UFRGS.UFRGS_MONO

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.UNIBA.UNIBAKRF

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.UNIBA.UNIBAKTD

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.UNIBA.UNIBAKTDN

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TDN AUTOMATIC no valencia Spain 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.VALENCIA.NLEL0901

AH-ROBUST-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no valencia Spain 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2009.VALENCIA.NLEL0906

AH-ROBUST-MONO-EN-TEST-CLEF2009 en T AUTOMATIC no ixa Spain 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2009.IXA.ESENNOWSD

AH-ROBUST-BILI-X2EN-TEST-CLEF2009 es TD AUTOMATIC no know-center Austria 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2009.KNOW-CENTER.BILIASSO

AH-ROBUST-BILI-X2EN-TEST-CLEF2009 es TD AUTOMATIC no know-center Austria 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2009.KNOW-CENTER.BILISYNONYM

AH-ROBUST-BILI-X2EN-TEST-CLEF2009 es TD AUTOMATIC no know-center Austria 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2009.KNOW-CENTER.BILISYNSET

AH-ROBUST-BILI-X2EN-TEST-CLEF2009 es TD AUTOMATIC no reina Spain 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2009.REINA.BILI1

AH-ROBUST-BILI-X2EN-TEST-CLEF2009 es TD AUTOMATIC no reina Spain 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2009.REINA.BILI2

AH-ROBUST-BILI-X2EN-TEST-CLEF2009 es TDN AUTOMATIC no reina Spain 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2009.REINA.BILI3

AH-ROBUST-BILI-X2EN-TEST-CLEF2009 es T AUTOMATIC no reina Spain 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2009.REINA.BILI4

AH-ROBUST-BILI-X2EN-TEST-CLEF2009 es TDN AUTOMATIC no reina Spain 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2009.REINA.BILI5

AH-ROBUST-BILI-X2EN-TEST-CLEF2009 es TD AUTOMATIC no ufrgs Brazil 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2009.UFRGS.BILINGUAL

AH-ROBUST-BILI-X2EN-TEST-CLEF2009 es TD AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2009.UNIBA.UNIBACROSSKEYRF

AH-ROBUST-BILI-X2EN-TEST-CLEF2009 es TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2009.UNIBA.UNIBACROSSTD

AH-ROBUST-BILI-X2EN-TEST-CLEF2009 es TD AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2009.UNIBA.UNIBACROSSTDN

AH-ROBUST-BILI-X2EN-TEST-CLEF2009 es TDN AUTOMATIC no alicante Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.ALICANTE.ALI01WND

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no

(10)

Participant Country Experiment DOI Task Lang. Fields Constr. Pool

alicante Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST- CLEF2009.ALICANTE.ALI03WNDWSD

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no darmstadt Germany 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.DARMSTADT.DA_WSD_1

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no darmstadt Germany 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.DARMSTADT.DA_WSD_2

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no darmstadt Germany 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.DARMSTADT.DA_WSD_3

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no darmstadt Germany 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.DARMSTADT.DA_WSD_4

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no darmstadt Germany 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.DARMSTADT.DA_WSD_5

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.GENEVA.ISINUSLWTDN

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TDN AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.GENEVA.ISINUSWSDTD

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no ixa Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.IXA.ENENALLSENSES100DOCS

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no ixa Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.IXA.ENENBESTSENSE100DOCS

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no ixa Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.IXA.ENENBESTSENSE500DOCS

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no jaen Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.JAEN.SINAI1_NOWSD_FB_OKAPI

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no jaen Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.JAEN.SINAI2_NUS_FB_OKAPI

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no know-center Austria 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.KNOW-CENTER.ASSOWSD

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no know-center Austria 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.KNOW-CENTER.SYNONYMWSD

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no know-center Austria 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.KNOW-CENTER.SYNSETWSD

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no reina Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.REINA.ROBWSD1

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no reina Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.REINA.ROBWSD2

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TDN AUTOMATIC no reina Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.REINA.ROBWSD3

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en T AUTOMATIC no reina Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.REINA.ROBWSD4

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TDN AUTOMATIC no reina Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.REINA.ROBWSD5

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no ufrgs Brazil 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.UFRGS.WSD_MONOLINGUAL

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.UNIBA.UNIBAKEYSYNRF

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.UNIBA.UNIBAWSDNL0802

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.UNIBA.UNIBAWSDNL0901

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.UNIBA.UNIBAWSDTD

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.UNIBA.UNIBAWSDTDN

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TDN AUTOMATIC no valencia Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.VALENCIA.NLEL0902

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no valencia Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.VALENCIA.NLEL0903

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en T AUTOMATIC no valencia Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.VALENCIA.NLEL0904

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en TD AUTOMATIC no valencia Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2009.VALENCIA.NLEL0905

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2009 en T AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST-

CLEF2009.GENEVA.ISINUSWSDTD

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TD AUTOMATIC no

ixa Spain 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009.IXA.ESEN1STTOPSALLSENSES100DOCS

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TD AUTOMATIC no

ixa Spain 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009.IXA.ESEN1STTOPSBESTSENSE500DOCS

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TD AUTOMATIC no

ixa Spain 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009.IXA.ESENALLSENSES100DOCS

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TD AUTOMATIC no

ixa Spain 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009.IXA.ESENBESTSENSE500DOCS

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TD AUTOMATIC no

know-center Austria 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009.KNOW-CENTER.BILIASSOWSD

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TD AUTOMATIC no

know-center Austria 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009.KNOW-CENTER.BILISYNONYMWSD

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TD AUTOMATIC no

know-center Austria 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009.KNOW-CENTER.BILISYNSETWSD

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TD AUTOMATIC no

(11)

reina Spain 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009.REINA.BILIWSD2

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TDN AUTOMATIC no reina Spain 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST-

CLEF2009.REINA.BILIWSD3

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es T AUTOMATIC no

reina Spain 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009.REINA.BILIWSD4

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TDN AUTOMATIC no reina Spain 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST-

CLEF2009.REINA.BILIWSD5

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TD AUTOMATIC no

uniba Italy 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009.UNIBA.UNIBACROSSKEYSYNRF

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST-

CLEF2009.UNIBA.UNIBACROSSWSDNL0802

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST-

CLEF2009.UNIBA.UNIBACROSSWSDNL0901

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST-

CLEF2009.UNIBA.UNIBACROSSWSDTD

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TD AUTOMATIC no

uniba Italy 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009.UNIBA.UNIBACROSSWSDTDN

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2009

es TDN AUTOMATIC no

(12)

Track Overview Results and Graphs

(13)
(14)

AH-ROBUST-CLEF2009 Track Overview Results and Graphs AH-ROBUST-MONO-EN-TEST-CLEF2009

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Recall

Precision

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision

darmstadt [Experiment DA_4; MAP 45.09%; Not Pooled]

reina [Experiment ROB2; MAP 44.52%; Not Pooled]

uniba [Experiment UNIBAKRF; MAP 42.50%; Not Pooled]

geneva [Experiment ISIENNATTDN; MAP 41.71%; Not Pooled]

know−center [Experiment ASSO; MAP 41.70%; Not Pooled]

141−AH142−AH143−AH144−AH145−AH146−AH147−AH148−AH149−AH150−AH151−AH152−AH153−AH154−AH155−AH156−AH157−AH158−AH159−AH160−AH161−AH162−AH163−AH164−AH165−AH

−1

−0.5 0 0.5 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 141−AH to 165−AH)

darmstadt [Experiment DA_4; MAP 45.09%; Not Pooled]

reina [Experiment ROB2; MAP 44.52%; Not Pooled]

uniba [Experiment UNIBAKRF; MAP 42.50%; Not Pooled]

geneva [Experiment ISIENNATTDN; MAP 41.71%; Not Pooled]

know−center [Experiment ASSO; MAP 41.70%; Not Pooled]

166−AH167−AH168−AH169−AH170−AH171−AH172−AH173−AH174−AH175−AH176−AH177−AH178−AH179−AH180−AH181−AH182−AH183−AH184−AH185−AH186−AH187−AH188−AH189−AH190−AH

−1 0 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 166−AH to 190−AH)

darmstadt [Experiment DA_4; MAP 45.09%; Not Pooled]

reina [Experiment ROB2; MAP 44.52%; Not Pooled]

uniba [Experiment UNIBAKRF; MAP 42.50%; Not Pooled]

geneva [Experiment ISIENNATTDN; MAP 41.71%; Not Pooled]

know−center [Experiment ASSO; MAP 41.70%; Not Pooled]

191−AH192−AH193−AH194−AH195−AH196−AH197−AH198−AH199−AH200−AH251−AH252−AH253−AH254−AH255−AH256−AH257−AH258−AH259−AH260−AH261−AH262−AH263−AH264−AH265−AH

−1 0 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 191−AH to 265−AH)

darmstadt [Experiment DA_4; MAP 45.09%; Not Pooled]

reina [Experiment ROB2; MAP 44.52%; Not Pooled]

uniba [Experiment UNIBAKRF; MAP 42.50%; Not Pooled]

geneva [Experiment ISIENNATTDN; MAP 41.71%; Not Pooled]

know−center [Experiment ASSO; MAP 41.70%; Not Pooled]

266−AH267−AH268−AH269−AH270−AH271−AH272−AH273−AH274−AH275−AH276−AH277−AH278−AH279−AH280−AH281−AH282−AH283−AH284−AH285−AH286−AH287−AH288−AH289−AH290−AH

−1 0 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 266−AH to 290−AH)

darmstadt [Experiment DA_4; MAP 45.09%; Not Pooled]

reina [Experiment ROB2; MAP 44.52%; Not Pooled]

uniba [Experiment UNIBAKRF; MAP 42.50%; Not Pooled]

geneva [Experiment ISIENNATTDN; MAP 41.71%; Not Pooled]

know−center [Experiment ASSO; MAP 41.70%; Not Pooled]

0 1

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 291−AH to 315−AH)

darmstadt [Experiment DA_4; MAP 45.09%; Not Pooled]

reina [Experiment ROB2; MAP 44.52%; Not Pooled]

uniba [Experiment UNIBAKRF; MAP 42.50%; Not Pooled]

geneva [Experiment ISIENNATTDN; MAP 41.71%; Not Pooled]

(15)

ufrgs [Experiment UFRGS_MONO; MAP 31.69%; Not Pooled]

valencia [Experiment NLEL0906; MAP 33.42%; Not Pooled]

reina [Experiment ROB3; MAP 37.09%; Not Pooled]

geneva [Experiment ISILEMTD; MAP 37.38%; Not Pooled]

ixa [Experiment ENENNOWSD; MAP 38.26%; Not Pooled]

uniba [Experiment UNIBAKTD; MAP 39.62%; Not Pooled]

valencia [Experiment NLEL0901; MAP 40.26%; Not Pooled]

know−center [Experiment SYNONYM; MAP 40.33%; Not Pooled]

know−center [Experiment SYNSET; MAP 40.33%; Not Pooled]

reina [Experiment ROB5; MAP 40.66%; Not Pooled]

uniba [Experiment UNIBAKTDN; MAP 41.50%; Not Pooled]

geneva [Experiment NAT_TDN_WEB; MAP 41.59%; Not Pooled]

know−center [Experiment ASSO; MAP 41.70%; Not Pooled]

geneva [Experiment ISIENNATDOMTDN; MAP 41.71%; Not Pooled]

geneva [Experiment ISIENNATTDN; MAP 41.71%; Not Pooled]

reina [Experiment ROB1; MAP 41.94%; Not Pooled]

uniba [Experiment UNIBAKRF; MAP 42.50%; Not Pooled]

darmstadt [Experiment DA_3; MAP 43.16%; Not Pooled]

reina [Experiment ROB4; MAP 43.50%; Not Pooled]

darmstadt [Experiment DA_1; MAP 43.96%; Not Pooled]

darmstadt [Experiment DA_2; MAP 44.09%; Not Pooled]

reina [Experiment ROB2; MAP 44.52%; Not Pooled]

darmstadt [Experiment DA_5; MAP 45.00%; Not Pooled]

darmstadt [Experiment DA_4; MAP 45.09%; Not Pooled]

Experiments

Ad−Hoc Robust Monolingual English Test Task − Box Plot of the Topics

(16)

AH-ROBUST-CLEF2009 Track Overview Results and Graphs AH-ROBUST-MONO-EN-TEST-CLEF2009 10.2455/TUKEY_T_TEST.91EB3343B3844844935B940F5AEA7190

NLEL0906 ROB3 ISILEMTD ENENNOWSD UNIBAKTD NLEL0901 SYNSET SYNONYM ROB5 UNIBAKTDN NAT_TDN_WEB ISIENNATTDN ISIENNATDOMTDN ASSO ROB1 UNIBAKRF DA_3 ROB4 DA_1 DA_2 ROB2 DA_5 DA_4

Ad−Hoc Robust Monolingual English Test Task − Tukey T test with "top group" highlighted

Experiments

(17)
(18)

AH-ROBUST-CLEF2009 Track Overview Results and Graphs AH-ROBUST-MONO-EN-TEST-CLEF2009

5 10 15 20 30 100 200 500 1000

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Retrieved Documents (logarithmic scale)

Precision

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Retrieved documents vs Mean Precision

darmstadt [Experiment DA_4; R−Prec 43.01%; Not Pooled]

reina [Experiment ROB2; R−Prec 43.54%; Not Pooled]

uniba [Experiment UNIBAKRF; R−Prec 41.28%; Not Pooled]

geneva [Experiment ISIENNATTDN; R−Prec 40.43%; Not Pooled]

know−center [Experiment ASSO; R−Prec 40.13%; Not Pooled]

141−AH142−AH143−AH144−AH145−AH146−AH147−AH148−AH149−AH150−AH151−AH152−AH153−AH154−AH155−AH156−AH157−AH158−AH159−AH160−AH161−AH162−AH163−AH164−AH165−AH

−1

−0.5 0 0.5 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 141−AH to 165−AH)

darmstadt [Experiment DA_4; R−Prec 43.01%; Not Pooled]

reina [Experiment ROB2; R−Prec 43.54%; Not Pooled]

uniba [Experiment UNIBAKRF; R−Prec 41.28%; Not Pooled]

geneva [Experiment ISIENNATTDN; R−Prec 40.43%; Not Pooled]

know−center [Experiment ASSO; R−Prec 40.13%; Not Pooled]

166−AH167−AH168−AH169−AH170−AH171−AH172−AH173−AH174−AH175−AH176−AH177−AH178−AH179−AH180−AH181−AH182−AH183−AH184−AH185−AH186−AH187−AH188−AH189−AH190−AH

−1 0 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 166−AH to 190−AH)

darmstadt [Experiment DA_4; R−Prec 43.01%; Not Pooled]

reina [Experiment ROB2; R−Prec 43.54%; Not Pooled]

uniba [Experiment UNIBAKRF; R−Prec 41.28%; Not Pooled]

geneva [Experiment ISIENNATTDN; R−Prec 40.43%; Not Pooled]

know−center [Experiment ASSO; R−Prec 40.13%; Not Pooled]

191−AH192−AH193−AH194−AH195−AH196−AH197−AH198−AH199−AH200−AH251−AH252−AH253−AH254−AH255−AH256−AH257−AH258−AH259−AH260−AH261−AH262−AH263−AH264−AH265−AH

−1 0 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 191−AH to 265−AH)

darmstadt [Experiment DA_4; R−Prec 43.01%; Not Pooled]

reina [Experiment ROB2; R−Prec 43.54%; Not Pooled]

uniba [Experiment UNIBAKRF; R−Prec 41.28%; Not Pooled]

geneva [Experiment ISIENNATTDN; R−Prec 40.43%; Not Pooled]

know−center [Experiment ASSO; R−Prec 40.13%; Not Pooled]

266−AH267−AH268−AH269−AH270−AH271−AH272−AH273−AH274−AH275−AH276−AH277−AH278−AH279−AH280−AH281−AH282−AH283−AH284−AH285−AH286−AH287−AH288−AH289−AH290−AH

−1 0 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 266−AH to 290−AH)

darmstadt [Experiment DA_4; R−Prec 43.01%; Not Pooled]

reina [Experiment ROB2; R−Prec 43.54%; Not Pooled]

uniba [Experiment UNIBAKRF; R−Prec 41.28%; Not Pooled]

geneva [Experiment ISIENNATTDN; R−Prec 40.43%; Not Pooled]

know−center [Experiment ASSO; R−Prec 40.13%; Not Pooled]

0 1

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 291−AH to 315−AH)

darmstadt [Experiment DA_4; R−Prec 43.01%; Not Pooled]

reina [Experiment ROB2; R−Prec 43.54%; Not Pooled]

uniba [Experiment UNIBAKRF; R−Prec 41.28%; Not Pooled]

geneva [Experiment ISIENNATTDN; R−Prec 40.43%; Not Pooled]

(19)

ufrgs [Experiment UFRGS_MONO; R−Prec 31.30%; Not Pooled]

valencia [Experiment NLEL0906; R−Prec 32.98%; Not Pooled]

reina [Experiment ROB3; R−Prec 36.49%; Not Pooled]

geneva [Experiment ISILEMTD; R−Prec 36.92%; Not Pooled]

ixa [Experiment ENENNOWSD; R−Prec 37.13%; Not Pooled]

valencia [Experiment NLEL0901; R−Prec 38.72%; Not Pooled]

know−center [Experiment SYNONYM; R−Prec 38.87%; Not Pooled]

know−center [Experiment SYNSET; R−Prec 38.87%; Not Pooled]

reina [Experiment ROB5; R−Prec 39.12%; Not Pooled]

uniba [Experiment UNIBAKTD; R−Prec 39.40%; Not Pooled]

know−center [Experiment ASSO; R−Prec 40.13%; Not Pooled]

geneva [Experiment NAT_TDN_WEB; R−Prec 40.25%; Not Pooled]

geneva [Experiment ISIENNATDOMTDN; R−Prec 40.43%; Not Pooled]

geneva [Experiment ISIENNATTDN; R−Prec 40.43%; Not Pooled]

uniba [Experiment UNIBAKTDN; R−Prec 40.82%; Not Pooled]

reina [Experiment ROB1; R−Prec 40.94%; Not Pooled]

darmstadt [Experiment DA_3; R−Prec 41.13%; Not Pooled]

uniba [Experiment UNIBAKRF; R−Prec 41.28%; Not Pooled]

darmstadt [Experiment DA_1; R−Prec 41.62%; Not Pooled]

darmstadt [Experiment DA_2; R−Prec 41.67%; Not Pooled]

reina [Experiment ROB4; R−Prec 42.37%; Not Pooled]

darmstadt [Experiment DA_5; R−Prec 42.57%; Not Pooled]

darmstadt [Experiment DA_4; R−Prec 43.01%; Not Pooled]

reina [Experiment ROB2; R−Prec 43.54%; Not Pooled]

Experiments

Ad−Hoc Robust Monolingual English Test Task − Box Plot of the Topics

(20)

AH-ROBUST-CLEF2009 Track Overview Results and Graphs AH-ROBUST-MONO-EN-TEST-CLEF2009

NLEL0906 ROB3 ISILEMTD ENENNOWSD NLEL0901 SYNSET SYNONYM ROB5 UNIBAKTD ASSO ISIENNATTDN ISIENNATDOMTDN NAT_TDN_WEB ROB1 DA_3 DA_2 UNIBAKTDN DA_1 UNIBAKRF DA_5 ROB4 DA_4 ROB2

Ad−Hoc Robust Monolingual English Test Task − Tukey T test with "top group" highlighted

Experiments

(21)
(22)

AH-ROBUST-CLEF2009 Track Overview Results and Graphs AH-ROBUST-MONO-EN-TEST-CLEF2009

Statistics for Number of relevant retrieved documents

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

141-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

142-AH 7.00 8.00 8.00 8.00 8.00 7.96 0.20 0.00 1.00 0.03 7.96 7.95 0.08 8.00 8.00 8.00 0.00

143-AH 37.00 39.00 39.00 39.00 39.00 38.92 0.40 0.00 2.00 0.01 38.92 38.92 0.15 39.00 39.00 39.00 0.00

144-AH 3.00 3.00 3.00 3.00 3.00 3.00 0.00 0.00 0.00 0.00 3.00 3.00 0.00 3.00 3.00 3.00 0.00

145-AH 35.00 37.00 37.00 37.00 37.00 36.92 0.40 0.00 2.00 0.01 36.92 36.92 0.15 37.00 37.00 37.00 0.00

146-AH 1.00 2.00 2.00 2.00 2.00 1.92 0.28 0.00 1.00 0.14 1.89 1.85 0.15 2.00 2.00 2.00 0.00

147-AH 47.00 49.75 51.00 51.00 51.00 50.24 1.27 1.25 4.00 0.03 50.22 50.21 1.03 48.00 51.00 50.38 1.10

148-AH 3.00 6.00 6.00 6.00 6.00 5.64 0.81 0.00 3.00 0.14 5.57 5.47 0.58 6.00 6.00 6.00 0.00

149-AH 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00

150-AH 2.00 8.00 9.00 10.00 10.00 8.60 1.96 2.00 8.00 0.23 8.23 7.54 1.34 7.00 10.00 9.09 1.00

151-AH 7.00 9.00 9.00 9.00 12.00 9.28 0.98 0.00 5.00 0.11 9.23 9.19 0.61 9.00 9.00 9.00 0.00

152-AH 9.00 11.00 11.00 11.00 11.00 10.76 0.52 0.00 2.00 0.05 10.75 10.73 0.38 11.00 11.00 11.00 0.00

153-AH 0.00 0.00 1.00 1.00 1.00 0.52 0.51 1.00 1.00 0.98 0.00 0.00 0.50 0.00 1.00 0.52 0.51

154-AH 18.00 20.00 20.00 21.00 21.00 20.40 0.71 1.00 3.00 0.03 20.39 20.38 0.58 20.00 21.00 20.50 0.51

155-AH 3.00 3.00 3.00 3.00 3.00 3.00 0.00 0.00 0.00 0.00 3.00 3.00 0.00 3.00 3.00 3.00 0.00

156-AH 14.00 19.75 20.00 20.00 21.00 19.16 1.99 0.25 7.00 0.10 19.05 18.92 1.52 20.00 20.00 20.00 0.00 157-AH 61.00 130.00 131.00 137.00 139.00 129.12 15.26 7.00 78.00 0.12 127.83 125.87 7.41 129.00 139.00 133.32 3.58 158-AH 1.00 32.00 34.00 34.00 34.00 29.48 10.77 2.00 33.00 0.37 21.89 6.83 6.84 31.00 34.00 33.36 0.90 159-AH 45.00 48.75 50.00 51.00 54.00 49.96 2.07 2.25 9.00 0.04 49.92 49.88 1.49 47.00 54.00 50.17 1.83

160-AH 2.00 2.00 2.00 2.00 2.00 2.00 0.00 0.00 0.00 0.00 2.00 2.00 0.00 2.00 2.00 2.00 0.00

161-AH 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00

162-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

163-AH 115.00 120.00 121.00 121.00 121.00 120.52 1.23 1.00 6.00 0.01 120.51 120.51 0.69 120.00 121.00 120.75 0.44 164-AH 20.00 25.00 25.00 27.00 27.00 25.44 1.53 2.00 7.00 0.06 25.39 25.34 1.09 24.00 27.00 25.67 1.05

165-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

166-AH 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00

167-AH 1.00 5.00 5.00 5.00 5.00 4.72 0.84 0.00 4.00 0.18 4.56 4.20 0.47 5.00 5.00 5.00 0.00

168-AH 10.00 18.00 18.00 18.00 18.00 17.68 1.60 0.00 8.00 0.09 17.58 17.44 0.61 18.00 18.00 18.00 0.00

169-AH 1.00 4.00 4.00 4.25 6.00 3.96 1.34 0.25 5.00 0.34 3.68 3.30 0.86 4.00 4.00 4.00 0.00

170-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

171-AH 2.00 17.00 18.00 18.00 19.00 16.92 3.59 1.00 17.00 0.21 15.98 13.22 1.97 16.00 19.00 17.87 0.92

172-AH 6.00 7.00 7.00 7.00 7.00 6.88 0.33 0.00 1.00 0.05 6.87 6.86 0.21 7.00 7.00 7.00 0.00

173-AH 2.00 2.00 2.00 2.00 2.00 2.00 0.00 0.00 0.00 0.00 2.00 2.00 0.00 2.00 2.00 2.00 0.00

174-AH 2.00 2.00 2.00 2.00 2.00 2.00 0.00 0.00 0.00 0.00 2.00 2.00 0.00 2.00 2.00 2.00 0.00

175-AH 6.00 7.00 7.00 7.00 7.00 6.88 0.33 0.00 1.00 0.05 6.87 6.86 0.21 7.00 7.00 7.00 0.00

176-AH 39.00 39.00 39.00 39.00 39.00 39.00 0.00 0.00 0.00 0.00 39.00 39.00 0.00 39.00 39.00 39.00 0.00 177-AH 11.00 13.00 13.00 13.00 13.00 12.88 0.44 0.00 2.00 0.03 12.87 12.86 0.22 13.00 13.00 13.00 0.00

178-AH 3.00 3.00 3.00 4.00 4.00 3.44 0.51 1.00 1.00 0.15 3.40 3.37 0.49 3.00 4.00 3.44 0.51

179-AH 18.00 21.00 22.00 22.00 22.00 21.32 1.11 1.00 4.00 0.05 21.29 21.26 0.82 21.00 22.00 21.68 0.48 180-AH 20.00 38.50 40.00 40.00 40.00 37.88 4.47 1.50 20.00 0.12 37.54 37.08 2.90 37.00 40.00 39.65 0.75 181-AH 90.00 91.00 92.00 92.00 92.00 91.68 0.56 1.00 2.00 0.01 91.68 91.68 0.46 90.00 92.00 91.68 0.56

182-AH 3.00 4.00 4.00 4.00 4.00 3.92 0.28 0.00 1.00 0.07 3.91 3.90 0.15 4.00 4.00 4.00 0.00

183-AH 4.00 4.00 4.00 4.00 4.00 4.00 0.00 0.00 0.00 0.00 4.00 4.00 0.00 4.00 4.00 4.00 0.00

184-AH 9.00 9.00 9.00 9.00 9.00 9.00 0.00 0.00 0.00 0.00 9.00 9.00 0.00 9.00 9.00 9.00 0.00

185-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

186-AH 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00

187-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

188-AH 0.00 1.00 1.00 1.00 1.00 0.92 0.28 0.00 1.00 0.30 0.40 0.00 0.15 1.00 1.00 1.00 0.00

189-AH 7.00 7.00 7.00 7.00 7.00 7.00 0.00 0.00 0.00 0.00 7.00 7.00 0.00 7.00 7.00 7.00 0.00

190-AH 7.00 7.00 7.00 8.00 9.00 7.52 0.77 1.00 2.00 0.10 7.48 7.45 0.67 7.00 9.00 7.52 0.77

(23)

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

191-AH 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00

192-AH 4.00 6.00 6.00 6.00 6.00 5.92 0.40 0.00 2.00 0.07 5.90 5.88 0.15 6.00 6.00 6.00 0.00

193-AH 5.00 6.75 7.00 7.00 7.00 6.72 0.54 0.25 2.00 0.08 6.70 6.67 0.43 7.00 7.00 7.00 0.00

194-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

195-AH 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00

196-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

197-AH 49.00 50.00 50.00 50.00 50.00 49.96 0.20 0.00 1.00 0.00 49.96 49.96 0.08 50.00 50.00 50.00 0.00

198-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

199-AH 10.00 10.00 10.00 10.00 10.00 10.00 0.00 0.00 0.00 0.00 10.00 10.00 0.00 10.00 10.00 10.00 0.00

200-AH 2.00 8.00 9.00 9.00 9.00 8.48 1.42 1.00 7.00 0.17 8.24 7.69 0.75 8.00 9.00 8.75 0.44

251-AH 33.00 52.50 55.00 58.00 61.00 53.84 6.27 5.50 28.00 0.12 53.43 52.93 4.38 48.00 61.00 55.26 3.83 252-AH 25.00 29.00 29.00 29.00 29.00 28.80 0.82 0.00 4.00 0.03 28.79 28.77 0.37 29.00 29.00 29.00 0.00 253-AH 72.00 136.50 147.00 153.25 159.00 142.60 18.30 16.75 87.00 0.13 141.11 139.06 12.06 123.00 159.00 145.54 11.12 254-AH 82.00 165.00 179.00 182.25 194.00 171.20 22.92 17.25 112.00 0.13 169.18 166.33 14.83 146.00 194.00 176.48 11.63

255-AH 3.00 4.00 4.00 4.00 4.00 3.88 0.33 0.00 1.00 0.09 3.86 3.85 0.21 4.00 4.00 4.00 0.00

256-AH 19.00 31.00 34.00 34.00 34.00 31.24 5.15 3.00 15.00 0.16 30.73 30.09 3.75 29.00 34.00 33.33 1.46 257-AH 44.00 54.00 58.00 61.25 63.00 57.08 4.97 7.25 19.00 0.09 56.86 56.63 4.15 44.00 63.00 57.08 4.97

258-AH 2.00 3.00 4.00 4.00 4.00 3.48 0.77 1.00 2.00 0.22 3.38 3.26 0.67 2.00 4.00 3.48 0.77

259-AH 1.00 3.00 3.00 3.00 3.00 2.88 0.44 0.00 2.00 0.15 2.82 2.73 0.22 3.00 3.00 3.00 0.00

260-AH 56.00 61.00 62.00 62.00 63.00 61.44 1.58 1.00 7.00 0.03 61.42 61.40 1.13 60.00 63.00 61.91 0.81 261-AH 2.00 13.00 17.00 22.25 28.00 17.56 6.73 9.25 26.00 0.38 15.78 12.57 5.31 2.00 28.00 17.56 6.73 262-AH 32.00 60.00 71.00 76.00 79.00 65.24 14.61 16.00 47.00 0.22 63.24 60.76 11.59 39.00 79.00 68.04 11.40 263-AH 32.00 43.75 47.00 47.00 48.00 44.92 4.41 3.25 16.00 0.10 44.68 44.40 3.16 42.00 48.00 46.36 1.73 264-AH 19.00 21.00 21.00 21.25 22.00 21.04 0.73 0.25 3.00 0.03 21.03 21.01 0.46 21.00 21.00 21.00 0.00

265-AH 5.00 6.00 6.00 6.00 6.00 5.84 0.37 0.00 1.00 0.06 5.83 5.81 0.27 6.00 6.00 6.00 0.00

266-AH 2.00 3.75 4.00 4.00 4.00 3.56 0.82 0.25 2.00 0.23 3.44 3.30 0.67 4.00 4.00 4.00 0.00

267-AH 19.00 20.00 20.00 21.00 21.00 20.32 0.56 1.00 2.00 0.03 20.31 20.31 0.49 19.00 21.00 20.32 0.56

268-AH 2.00 3.00 3.00 3.00 3.00 2.88 0.33 0.00 1.00 0.12 2.86 2.83 0.21 3.00 3.00 3.00 0.00

269-AH 8.00 8.00 8.00 8.00 9.00 8.08 0.28 0.00 1.00 0.03 8.08 8.07 0.15 8.00 8.00 8.00 0.00

270-AH 15.00 56.00 57.00 57.00 57.00 54.80 8.38 1.00 42.00 0.15 53.53 50.82 3.49 56.00 57.00 56.70 0.47 271-AH 12.00 22.75 23.00 24.00 24.00 21.76 4.06 1.25 12.00 0.19 21.28 20.67 2.88 22.00 24.00 23.48 0.68 272-AH 5.00 13.00 13.00 14.00 14.00 12.64 2.25 1.00 9.00 0.18 12.36 11.94 1.40 12.00 14.00 13.41 0.59 273-AH 60.00 79.75 81.00 83.00 83.00 79.68 5.10 3.25 23.00 0.06 79.50 79.30 3.21 77.00 83.00 81.27 1.72 274-AH 6.00 15.00 16.00 16.00 16.00 15.16 2.12 1.00 10.00 0.14 14.93 14.56 1.14 14.00 16.00 15.70 0.56 275-AH 40.00 56.75 62.00 63.00 65.00 59.12 6.49 6.25 25.00 0.11 58.73 58.27 4.89 49.00 65.00 60.61 4.08 276-AH 53.00 58.75 59.00 59.00 59.00 58.44 1.42 0.25 6.00 0.02 58.42 58.40 0.85 59.00 59.00 59.00 0.00 277-AH 13.00 17.00 19.00 20.00 25.00 18.72 2.26 3.00 12.00 0.12 18.59 18.45 1.67 13.00 21.00 18.46 1.89 278-AH 11.00 16.00 21.00 21.00 21.00 18.96 2.89 5.00 10.00 0.15 18.71 18.42 2.45 11.00 21.00 18.96 2.89

279-AH 3.00 4.00 4.00 4.00 4.00 3.96 0.20 0.00 1.00 0.05 3.95 3.95 0.08 4.00 4.00 4.00 0.00

280-AH 3.00 19.00 21.00 22.00 24.00 19.56 4.98 3.00 21.00 0.25 18.29 15.50 3.08 17.00 24.00 20.87 2.10 281-AH 40.00 42.00 42.00 42.00 42.00 41.88 0.44 0.00 2.00 0.01 41.88 41.88 0.22 42.00 42.00 42.00 0.00 282-AH 1.00 24.00 25.00 29.00 30.00 25.08 6.26 5.00 29.00 0.25 22.62 12.85 3.92 21.00 30.00 26.61 2.89 283-AH 14.00 31.75 35.00 36.25 37.00 33.44 4.87 4.50 23.00 0.15 32.94 32.18 3.19 27.00 37.00 34.25 2.75 284-AH 38.00 38.00 38.00 38.00 38.00 38.00 0.00 0.00 0.00 0.00 38.00 38.00 0.00 38.00 38.00 38.00 0.00 285-AH 61.00 66.00 68.00 69.00 69.00 67.20 2.24 3.00 8.00 0.03 67.16 67.13 1.76 63.00 69.00 67.46 1.86 286-AH 2.00 8.00 8.00 10.00 10.00 8.16 2.06 2.00 8.00 0.25 7.75 7.05 1.37 6.00 10.00 8.65 1.19 287-AH 41.00 46.00 48.00 48.00 49.00 47.04 1.79 2.00 8.00 0.04 47.01 46.97 1.24 43.00 49.00 47.29 1.30 288-AH 38.00 53.50 58.00 64.25 70.00 58.00 7.91 10.75 32.00 0.14 57.44 56.84 6.16 38.00 70.00 58.00 7.91 289-AH 13.00 17.00 18.00 18.00 18.00 17.56 1.04 1.00 5.00 0.06 17.53 17.48 0.63 17.00 18.00 17.75 0.44 290-AH 42.00 48.75 49.00 49.00 49.00 48.00 2.06 0.25 7.00 0.04 47.96 47.91 1.52 49.00 49.00 49.00 0.00

(24)

Statistics for Number of relevant retrieved documents

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

291-AH 26.00 28.00 28.00 29.00 30.00 28.44 0.92 1.00 4.00 0.03 28.43 28.41 0.73 27.00 30.00 28.54 0.78

292-AH 4.00 4.00 4.00 4.00 4.00 4.00 0.00 0.00 0.00 0.00 4.00 4.00 0.00 4.00 4.00 4.00 0.00

293-AH 8.00 34.00 34.00 34.00 34.00 32.92 5.20 0.00 26.00 0.16 32.05 30.06 1.99 34.00 34.00 34.00 0.00 294-AH 27.00 27.00 27.00 27.00 27.00 27.00 0.00 0.00 0.00 0.00 27.00 27.00 0.00 27.00 27.00 27.00 0.00 295-AH 21.00 34.00 43.00 45.00 50.00 39.00 9.00 11.00 29.00 0.23 37.78 36.33 7.36 21.00 50.00 39.00 9.00 296-AH 4.00 24.00 24.00 24.00 24.00 22.96 4.13 0.00 20.00 0.18 22.08 19.78 1.91 24.00 24.00 24.00 0.00 297-AH 8.00 10.00 11.00 12.00 12.00 11.08 1.12 2.00 4.00 0.10 11.02 10.96 0.88 8.00 12.00 11.08 1.12 298-AH 25.00 28.00 28.00 29.00 30.00 28.00 1.22 1.00 5.00 0.04 27.97 27.95 0.80 27.00 30.00 28.36 0.73 299-AH 67.00 73.00 74.00 75.00 76.00 73.72 2.19 2.00 9.00 0.03 73.69 73.65 1.44 71.00 76.00 74.26 1.18 300-AH 40.00 41.75 42.00 42.00 42.00 41.64 0.70 0.25 2.00 0.02 41.63 41.63 0.55 42.00 42.00 42.00 0.00 301-AH 4.00 5.00 5.00 14.00 16.00 8.12 4.72 9.00 12.00 0.58 7.00 6.20 4.24 4.00 16.00 8.12 4.72 302-AH 8.00 16.75 17.00 17.00 17.00 16.20 2.12 0.25 9.00 0.13 16.01 15.75 1.22 17.00 17.00 17.00 0.00 303-AH 10.00 12.00 13.00 14.00 14.00 12.96 1.06 2.00 4.00 0.08 12.92 12.87 0.78 10.00 14.00 12.96 1.06 304-AH 6.00 12.00 15.00 15.00 15.00 13.24 2.45 3.00 9.00 0.19 12.96 12.59 1.89 8.00 15.00 13.54 1.98 305-AH 44.00 59.00 61.00 61.00 61.00 58.32 4.92 2.00 17.00 0.08 58.10 57.85 3.65 59.00 61.00 60.60 0.75

306-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

307-AH 31.00 67.75 71.00 73.25 75.00 68.24 9.23 5.50 44.00 0.14 67.38 66.11 5.51 62.00 75.00 70.52 3.72 308-AH 10.00 10.00 11.00 11.00 11.00 10.52 0.51 1.00 1.00 0.05 10.51 10.50 0.50 10.00 11.00 10.52 0.51 309-AH 5.00 10.00 10.00 10.00 10.00 9.64 1.08 0.00 5.00 0.11 9.56 9.44 0.60 10.00 10.00 10.00 0.00 310-AH 24.00 43.50 48.00 51.00 59.00 46.16 6.85 7.50 35.00 0.15 45.57 44.82 4.78 35.00 59.00 47.08 5.17 311-AH 42.00 50.75 52.00 53.00 53.00 51.00 2.77 2.25 11.00 0.05 50.92 50.84 1.84 48.00 53.00 51.70 1.40 312-AH 22.00 30.75 31.00 31.00 31.00 30.24 2.11 0.25 9.00 0.07 30.16 30.06 1.16 31.00 31.00 31.00 0.00 313-AH 5.00 8.00 12.00 15.00 17.00 11.64 3.95 7.00 12.00 0.34 10.89 10.05 3.36 5.00 17.00 11.64 3.95 314-AH 13.00 16.75 17.00 17.00 17.00 16.60 0.91 0.25 4.00 0.05 16.57 16.54 0.61 17.00 17.00 17.00 0.00 315-AH 27.00 39.00 45.00 53.25 59.00 44.52 10.25 14.25 32.00 0.23 43.28 41.95 8.74 27.00 59.00 44.52 10.25 316-AH 28.00 85.00 95.00 100.75 110.00 87.16 23.85 15.75 82.00 0.27 82.44 75.46 18.00 68.00 110.00 96.29 10.62 317-AH 10.00 26.50 28.00 29.00 30.00 26.68 4.26 2.50 20.00 0.16 26.18 25.38 2.81 24.00 30.00 27.95 1.65

318-AH 9.00 9.00 9.00 9.00 9.00 9.00 0.00 0.00 0.00 0.00 9.00 9.00 0.00 9.00 9.00 9.00 0.00

319-AH 10.00 14.00 16.00 16.00 17.00 14.96 1.57 2.00 7.00 0.10 14.87 14.77 1.18 13.00 17.00 15.17 1.20 320-AH 6.00 9.00 11.00 12.00 13.00 10.20 1.91 3.00 7.00 0.19 10.00 9.77 1.54 6.00 13.00 10.20 1.91

321-AH 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00

322-AH 7.00 11.00 12.00 13.00 14.00 11.72 1.72 2.00 7.00 0.15 11.59 11.44 1.33 9.00 14.00 11.92 1.44 323-AH 11.00 21.00 25.00 25.00 25.00 22.96 3.25 4.00 14.00 0.14 22.67 22.26 2.37 18.00 25.00 23.46 2.13 324-AH 19.00 37.50 61.00 65.25 69.00 53.04 15.49 27.75 50.00 0.29 50.28 46.89 13.39 19.00 69.00 53.04 15.49 325-AH 59.00 60.00 60.00 61.00 61.00 60.40 0.65 1.00 2.00 0.01 60.40 60.39 0.58 59.00 61.00 60.40 0.65

326-AH 1.00 3.00 4.00 4.00 4.00 3.28 0.98 1.00 3.00 0.30 3.05 2.70 0.75 3.00 4.00 3.59 0.50

327-AH 0.00 4.00 4.00 4.00 4.00 3.84 0.80 0.00 4.00 0.21 2.39 0.00 0.31 4.00 4.00 4.00 0.00

328-AH 23.00 23.00 23.00 23.00 23.00 23.00 0.00 0.00 0.00 0.00 23.00 23.00 0.00 23.00 23.00 23.00 0.00 329-AH 17.00 17.00 17.00 17.00 17.00 17.00 0.00 0.00 0.00 0.00 17.00 17.00 0.00 17.00 17.00 17.00 0.00 330-AH 45.00 51.00 51.00 51.00 51.00 50.16 1.82 0.00 6.00 0.04 50.13 50.09 1.34 51.00 51.00 51.00 0.00 331-AH 12.00 17.00 17.00 17.00 17.00 16.80 1.00 0.00 5.00 0.06 16.76 16.72 0.38 17.00 17.00 17.00 0.00

332-AH 3.00 8.00 8.00 8.00 8.00 7.80 1.00 0.00 5.00 0.13 7.69 7.50 0.38 8.00 8.00 8.00 0.00

333-AH 5.00 5.00 5.00 5.00 5.00 5.00 0.00 0.00 0.00 0.00 5.00 5.00 0.00 5.00 5.00 5.00 0.00

334-AH 4.00 5.00 5.00 5.00 5.00 4.96 0.20 0.00 1.00 0.04 4.96 4.95 0.08 5.00 5.00 5.00 0.00

335-AH 11.00 14.00 14.00 15.00 15.00 14.00 1.00 1.00 4.00 0.07 13.96 13.92 0.64 13.00 15.00 14.22 0.67 336-AH 0.00 11.50 13.00 14.25 16.00 11.88 4.26 2.75 16.00 0.36 6.66 0.00 3.22 10.00 16.00 13.80 1.40 337-AH 18.00 20.00 20.00 20.00 20.00 19.76 0.52 0.00 2.00 0.03 19.75 19.75 0.38 20.00 20.00 20.00 0.00 338-AH 10.00 10.00 10.00 10.00 10.00 10.00 0.00 0.00 0.00 0.00 10.00 10.00 0.00 10.00 10.00 10.00 0.00 339-AH 18.00 19.00 19.00 19.00 19.00 18.92 0.28 0.00 1.00 0.01 18.92 18.92 0.15 19.00 19.00 19.00 0.00

340-AH 5.00 5.00 5.00 5.00 5.00 5.00 0.00 0.00 0.00 0.00 5.00 5.00 0.00 5.00 5.00 5.00 0.00

(25)

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

341-AH 5.00 6.00 6.00 6.00 6.00 5.96 0.20 0.00 1.00 0.03 5.96 5.95 0.08 6.00 6.00 6.00 0.00

342-AH 55.00 95.00 96.00 96.00 96.00 94.00 8.15 1.00 41.00 0.09 93.53 92.88 3.12 94.00 96.00 95.62 0.71

343-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

344-AH 30.00 31.75 33.00 33.00 33.00 32.28 1.10 1.25 3.00 0.03 32.26 32.24 0.92 30.00 33.00 32.28 1.10

345-AH 8.00 9.00 9.00 9.00 9.00 8.92 0.28 0.00 1.00 0.03 8.92 8.91 0.15 9.00 9.00 9.00 0.00

346-AH 10.00 11.00 11.00 11.00 11.00 10.96 0.20 0.00 1.00 0.02 10.96 10.96 0.08 11.00 11.00 11.00 0.00

347-AH 7.00 8.00 8.00 8.00 9.00 7.92 0.49 0.00 2.00 0.06 7.91 7.89 0.29 8.00 8.00 8.00 0.00

348-AH 0.00 2.00 2.00 2.00 2.00 1.92 0.40 0.00 2.00 0.21 1.23 0.00 0.15 2.00 2.00 2.00 0.00

349-AH 27.00 27.00 27.00 27.00 27.00 27.00 0.00 0.00 0.00 0.00 27.00 27.00 0.00 27.00 27.00 27.00 0.00 350-AH 9.00 10.00 10.00 10.00 10.00 9.84 0.37 0.00 1.00 0.04 9.83 9.83 0.27 10.00 10.00 10.00 0.00

(26)

AH-ROBUST-CLEF2009 Track Overview Results and Graphs AH-ROBUST-MONO-EN-TEST-CLEF2009

Statistics for Average Precsion

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

141-AH 0.0667 1.0000 1.0000 1.0000 1.0000 0.9627 0.1867 0.0000 0.9333 0.1939 0.8973 0.6410 0.0717 1.0000 1.0000 1.0000 0.0000 142-AH 0.4062 0.9366 0.9705 0.9750 1.0000 0.9396 0.1143 0.0384 0.5938 0.1216 0.9289 0.9113 0.0507 0.8978 1.0000 0.9619 0.0272 143-AH 0.5861 0.6595 0.7237 0.9114 0.9441 0.7720 0.1298 0.2519 0.3580 0.1682 0.7615 0.7510 0.1189 0.5861 0.9441 0.7720 0.1298 144-AH 0.2611 0.5650 0.7024 0.7500 0.8056 0.6314 0.1710 0.1850 0.5444 0.2708 0.6020 0.5647 0.1389 0.3625 0.8056 0.6627 0.1379 145-AH 0.4077 0.5944 0.6721 0.6857 0.7697 0.6426 0.0801 0.0913 0.3619 0.1247 0.6372 0.6310 0.0616 0.5131 0.7697 0.6523 0.0648 146-AH 0.0486 0.4420 0.5041 0.5066 0.5172 0.4353 0.1345 0.0646 0.4687 0.3091 0.3973 0.3160 0.1077 0.5000 0.5172 0.5061 0.0046 147-AH 0.2978 0.6711 0.7587 0.8158 0.8477 0.7241 0.1326 0.1447 0.5498 0.1832 0.7085 0.6868 0.0993 0.4925 0.8477 0.7418 0.1007 148-AH 0.0523 0.0815 0.1703 0.1991 0.2055 0.1398 0.0631 0.1176 0.1532 0.4517 0.1239 0.1080 0.0601 0.0523 0.2055 0.1398 0.0631 149-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 150-AH 0.0010 0.0462 0.0615 0.1499 0.2323 0.0896 0.0670 0.1037 0.2313 0.7476 0.0533 0.0113 0.0570 0.0010 0.2323 0.0896 0.0670 151-AH 0.0393 0.1558 0.2306 0.3446 0.4464 0.2306 0.1212 0.1888 0.4071 0.5253 0.1870 0.1347 0.0928 0.0393 0.4464 0.2306 0.1212 152-AH 0.1145 0.3979 0.5416 0.6729 0.7673 0.5226 0.1765 0.2750 0.6528 0.3378 0.4831 0.4265 0.1427 0.1145 0.7673 0.5226 0.1765 153-AH 0.0000 0.0000 0.0010 0.0013 0.0028 0.0009 0.0010 0.0013 0.0028 1.1135 0.0001 0.0000 0.0008 0.0000 0.0028 0.0009 0.0010 154-AH 0.1132 0.3054 0.3582 0.4031 0.4721 0.3444 0.0859 0.0977 0.3590 0.2496 0.3304 0.3107 0.0636 0.1715 0.4721 0.3540 0.0727 155-AH 0.0091 0.1075 0.1391 0.1960 0.2889 0.1491 0.0681 0.0884 0.2797 0.4567 0.1283 0.0859 0.0517 0.0091 0.2889 0.1491 0.0681 156-AH 0.0556 0.1251 0.1413 0.1668 0.3676 0.1583 0.0698 0.0417 0.3121 0.4411 0.1463 0.1359 0.0471 0.0898 0.2039 0.1401 0.0294 157-AH 0.0479 0.4695 0.4874 0.5695 0.7143 0.5005 0.1295 0.0999 0.6664 0.2587 0.4658 0.3656 0.0810 0.3397 0.7143 0.5194 0.0906 158-AH 0.0001 0.3429 0.4699 0.5767 0.6984 0.4228 0.1987 0.2338 0.6983 0.4699 0.1633 0.0007 0.1520 0.0001 0.6984 0.4228 0.1987 159-AH 0.1088 0.2158 0.2526 0.3627 0.7430 0.3084 0.1419 0.1469 0.6341 0.4603 0.2821 0.2593 0.1069 0.1088 0.5359 0.2903 0.1116 160-AH 0.0242 0.0455 0.0656 0.1481 0.2522 0.1010 0.0667 0.1025 0.2280 0.6599 0.0806 0.0635 0.0573 0.0242 0.2522 0.1010 0.0667 161-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 162-AH 0.1667 0.2500 0.5000 1.0000 1.0000 0.5780 0.3394 0.7500 0.8333 0.5872 0.4797 0.3968 0.3038 0.1667 1.0000 0.5780 0.3394 163-AH 0.5755 0.8054 0.8579 0.8662 0.8867 0.8279 0.0657 0.0608 0.3113 0.0794 0.8250 0.8215 0.0447 0.7246 0.8867 0.8384 0.0403 164-AH 0.0406 0.0673 0.1283 0.1683 0.3257 0.1314 0.0683 0.1010 0.2851 0.5198 0.1154 0.1005 0.0497 0.0406 0.2428 0.1233 0.0562 165-AH 0.5000 1.0000 1.0000 1.0000 1.0000 0.9800 0.1000 0.0000 0.5000 0.1020 0.9727 0.9615 0.0384 1.0000 1.0000 1.0000 0.0000 166-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 167-AH 0.0003 0.0829 0.2160 0.3016 0.4256 0.1894 0.1281 0.2187 0.4253 0.6763 0.1139 0.0063 0.1187 0.0003 0.4256 0.1894 0.1281 168-AH 0.0104 0.3299 0.4708 0.5091 0.7830 0.4368 0.1516 0.1792 0.7726 0.3471 0.3770 0.1632 0.1116 0.2147 0.6415 0.4403 0.1066 169-AH 0.0004 0.0089 0.0161 0.0533 0.1673 0.0379 0.0458 0.0444 0.1669 1.2091 0.0183 0.0054 0.0335 0.0004 0.0852 0.0266 0.0252 170-AH 0.3333 1.0000 1.0000 1.0000 1.0000 0.9733 0.1333 0.0000 0.6667 0.1370 0.9570 0.9259 0.0512 1.0000 1.0000 1.0000 0.0000 171-AH 0.0005 0.0654 0.1176 0.1284 0.1704 0.0978 0.0452 0.0630 0.1698 0.4623 0.0725 0.0114 0.0377 0.0005 0.1704 0.0978 0.0452 172-AH 0.0194 0.0753 0.0915 0.1230 0.2767 0.1053 0.0523 0.0477 0.2573 0.4967 0.0943 0.0820 0.0362 0.0194 0.1931 0.0982 0.0390 173-AH 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 174-AH 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 175-AH 0.4821 0.7227 0.7473 0.7775 0.8322 0.7415 0.0657 0.0548 0.3501 0.0887 0.7381 0.7341 0.0420 0.6767 0.8322 0.7523 0.0383 176-AH 0.7836 0.8966 0.9247 0.9331 0.9392 0.9020 0.0503 0.0365 0.1556 0.0558 0.9006 0.8990 0.0374 0.8738 0.9392 0.9223 0.0170 177-AH 0.0741 0.2111 0.3467 0.4632 0.6054 0.3562 0.1627 0.2521 0.5312 0.4567 0.3149 0.2670 0.1326 0.0741 0.6054 0.3562 0.1627 178-AH 0.0131 0.0406 0.1207 0.1792 0.2932 0.1242 0.0948 0.1386 0.2801 0.7628 0.0811 0.0449 0.0752 0.0131 0.2932 0.1242 0.0948 179-AH 0.1318 0.4083 0.6480 0.7809 0.8444 0.5930 0.2174 0.3726 0.7126 0.3666 0.5405 0.4697 0.1858 0.1318 0.8444 0.5930 0.2174 180-AH 0.0095 0.0879 0.5949 0.6824 0.7726 0.4303 0.3045 0.5945 0.7631 0.7077 0.2453 0.0851 0.2853 0.0095 0.7726 0.4303 0.3045 181-AH 0.5387 0.8137 0.8307 0.8404 0.8660 0.8103 0.0671 0.0267 0.3273 0.0828 0.8070 0.8031 0.0414 0.8079 0.8660 0.8360 0.0169 182-AH 0.0268 0.0845 0.1543 0.5100 0.5680 0.2481 0.1997 0.4254 0.5412 0.8047 0.1671 0.1072 0.1804 0.0268 0.5680 0.2481 0.1997 183-AH 0.0193 0.0496 0.1869 0.3572 0.6000 0.2406 0.1849 0.3076 0.5807 0.7682 0.1616 0.0942 0.1517 0.0193 0.6000 0.2406 0.1849 184-AH 0.3827 0.5443 0.5781 0.6126 0.6695 0.5725 0.0769 0.0682 0.2869 0.1344 0.5669 0.5606 0.0525 0.4521 0.6695 0.5888 0.0548 185-AH 0.0046 0.2375 0.3333 1.0000 1.0000 0.5382 0.3732 0.7625 0.9954 0.6935 0.3617 0.0859 0.3325 0.0046 1.0000 0.5382 0.3732 186-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-AH 0.0109 0.1250 0.2000 0.5000 1.0000 0.3732 0.3469 0.3750 0.9891 0.9294 0.2340 0.1142 0.2811 0.0109 1.0000 0.3732 0.3469 188-AH 0.0000 0.0017 0.0088 0.0563 0.2000 0.0434 0.0689 0.0546 0.2000 1.5874 0.0067 0.0001 0.0553 0.0000 0.1000 0.0117 0.0228 189-AH 0.7254 0.8786 0.9478 0.9866 1.0000 0.9319 0.0653 0.1080 0.2746 0.0700 0.9295 0.9270 0.0515 0.7254 1.0000 0.9319 0.0653 190-AH 0.3101 0.6564 0.6875 0.7057 0.8109 0.6702 0.0945 0.0493 0.5008 0.1409 0.6616 0.6493 0.0561 0.5863 0.7466 0.6842 0.0341

(27)

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 191-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-AH 0.1539 0.3941 0.5260 0.7288 0.9762 0.5492 0.2547 0.3347 0.8223 0.4638 0.4897 0.4287 0.1990 0.1539 0.9762 0.5492 0.2547 193-AH 0.2067 0.4209 0.4806 0.5837 0.7871 0.4987 0.1231 0.1628 0.5804 0.2469 0.4828 0.4645 0.0957 0.2067 0.7871 0.4987 0.1231 194-AH 0.0625 0.2000 0.3333 1.0000 1.0000 0.5456 0.3870 0.8000 0.9375 0.7094 0.4028 0.2841 0.3635 0.0625 1.0000 0.5456 0.3870 195-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-AH 0.5000 0.5000 0.5000 1.0000 1.0000 0.7400 0.2550 0.5000 0.5000 0.3445 0.6974 0.6579 0.2496 0.5000 1.0000 0.7400 0.2550 197-AH 0.2600 0.6573 0.7957 0.8881 0.9558 0.7400 0.1959 0.2308 0.6958 0.2647 0.7075 0.6651 0.1570 0.3892 0.9558 0.7600 0.1721 198-AH 0.1250 0.3333 1.0000 1.0000 1.0000 0.7683 0.3470 0.6667 0.8750 0.4516 0.6536 0.5102 0.3151 0.1250 1.0000 0.7683 0.3470 199-AH 0.3575 0.4582 0.5533 0.6424 0.6786 0.5441 0.1021 0.1843 0.3211 0.1877 0.5342 0.5237 0.0836 0.3575 0.6786 0.5441 0.1021 200-AH 0.0007 0.2803 0.5845 0.6538 0.7357 0.4620 0.2353 0.3734 0.7350 0.5094 0.3181 0.0161 0.2092 0.0007 0.7357 0.4620 0.2353 251-AH 0.1546 0.4753 0.5292 0.5469 0.6011 0.4966 0.0994 0.0716 0.4465 0.2001 0.4814 0.4559 0.0630 0.4522 0.6011 0.5223 0.0443 252-AH 0.2418 0.3989 0.4401 0.5206 0.5766 0.4417 0.0919 0.1217 0.3349 0.2080 0.4311 0.4190 0.0692 0.2418 0.5766 0.4417 0.0919 253-AH 0.0995 0.3333 0.4313 0.4508 0.4767 0.3897 0.0889 0.1174 0.3772 0.2282 0.3745 0.3484 0.0691 0.2397 0.4767 0.4018 0.0666 254-AH 0.0628 0.1945 0.2428 0.2657 0.3209 0.2315 0.0642 0.0713 0.2580 0.2772 0.2200 0.2035 0.0483 0.1311 0.3209 0.2386 0.0548 255-AH 0.1317 0.3451 0.4437 0.5283 0.5972 0.4238 0.1133 0.1832 0.4655 0.2673 0.4058 0.3817 0.0912 0.1317 0.5972 0.4238 0.1133 256-AH 0.2501 0.8057 0.8391 0.8587 0.8771 0.7641 0.1727 0.0530 0.6269 0.2261 0.7367 0.6963 0.1300 0.8057 0.8771 0.8453 0.0236 257-AH 0.1403 0.2226 0.2637 0.2841 0.3205 0.2481 0.0462 0.0615 0.1802 0.1864 0.2433 0.2378 0.0368 0.1403 0.3205 0.2481 0.0462 258-AH 0.0077 0.0212 0.0349 0.1178 0.3039 0.0692 0.0727 0.0967 0.2962 1.0500 0.0434 0.0292 0.0565 0.0077 0.1653 0.0594 0.0549 259-AH 0.0012 0.5032 0.6728 0.6760 0.6836 0.5743 0.1941 0.1728 0.6824 0.3380 0.3853 0.0197 0.1382 0.4090 0.6836 0.6241 0.0934 260-AH 0.3093 0.5342 0.6312 0.6653 0.7110 0.5938 0.0911 0.1312 0.4017 0.1535 0.5857 0.5759 0.0755 0.4885 0.7110 0.6056 0.0707 261-AH 0.0043 0.0750 0.1163 0.3442 0.3869 0.1750 0.1317 0.2692 0.3827 0.7526 0.1192 0.0507 0.1151 0.0043 0.3869 0.1750 0.1317 262-AH 0.0493 0.1895 0.3504 0.4110 0.4580 0.3090 0.1235 0.2214 0.4088 0.3999 0.2734 0.2217 0.1031 0.0493 0.4580 0.3090 0.1235 263-AH 0.0401 0.2035 0.2256 0.2516 0.2919 0.2198 0.0543 0.0481 0.2518 0.2470 0.2086 0.1859 0.0368 0.1805 0.2919 0.2320 0.0334 264-AH 0.2354 0.4141 0.5496 0.6039 0.7331 0.5042 0.1268 0.1899 0.4976 0.2516 0.4869 0.4676 0.1093 0.2354 0.7331 0.5042 0.1268 265-AH 0.0234 0.2484 0.4421 0.5740 0.7410 0.4269 0.1934 0.3256 0.7176 0.4529 0.3571 0.2224 0.1532 0.0234 0.7410 0.4269 0.1934 266-AH 0.0024 0.0082 0.0338 0.1295 0.1845 0.0642 0.0650 0.1213 0.1821 1.0131 0.0317 0.0146 0.0570 0.0024 0.1845 0.0642 0.0650 267-AH 0.2141 0.2517 0.3266 0.3562 0.4418 0.3097 0.0677 0.1046 0.2277 0.2185 0.3027 0.2960 0.0588 0.2141 0.4418 0.3097 0.0677 268-AH 0.0754 0.6684 0.6768 0.6905 0.7255 0.6397 0.1325 0.0221 0.6501 0.2071 0.6049 0.5012 0.0740 0.6667 0.7121 0.6816 0.0134 269-AH 0.0769 0.1974 0.2310 0.2828 0.3780 0.2342 0.0719 0.0854 0.3011 0.3069 0.2217 0.2063 0.0555 0.0769 0.3780 0.2342 0.0719 270-AH 0.0115 0.6720 0.7112 0.7428 0.7784 0.6722 0.1555 0.0708 0.7669 0.2314 0.5898 0.2050 0.0810 0.5886 0.7784 0.7121 0.0436 271-AH 0.0721 0.4726 0.5450 0.5896 0.6244 0.4733 0.1885 0.1170 0.5523 0.3983 0.3963 0.2705 0.1436 0.3191 0.6244 0.5492 0.0702 272-AH 0.0102 0.1308 0.1706 0.2166 0.2710 0.1629 0.0729 0.0857 0.2607 0.4472 0.1302 0.0719 0.0551 0.0102 0.2710 0.1629 0.0729 273-AH 0.4535 0.6067 0.7197 0.7452 0.8257 0.6852 0.0933 0.1385 0.3722 0.1362 0.6787 0.6717 0.0792 0.4535 0.8257 0.6852 0.0933 274-AH 0.0100 0.2379 0.2911 0.3320 0.4251 0.2743 0.1048 0.0940 0.4151 0.3820 0.2320 0.1220 0.0752 0.1084 0.4251 0.2956 0.0778 275-AH 0.0844 0.2624 0.3608 0.4534 0.5870 0.3459 0.1336 0.1910 0.5027 0.3863 0.3127 0.2689 0.1061 0.0844 0.5870 0.3459 0.1336 276-AH 0.3207 0.4666 0.5427 0.5860 0.6476 0.5211 0.0920 0.1194 0.3269 0.1765 0.5123 0.5026 0.0749 0.3207 0.6476 0.5211 0.0920 277-AH 0.0921 0.1500 0.1641 0.1723 0.2716 0.1669 0.0425 0.0223 0.1795 0.2547 0.1620 0.1574 0.0279 0.1199 0.1879 0.1573 0.0186 278-AH 0.0610 0.2169 0.2688 0.3160 0.3726 0.2617 0.0766 0.0991 0.3116 0.2928 0.2469 0.2245 0.0599 0.1551 0.3726 0.2701 0.0656 279-AH 0.0276 0.1510 0.3108 0.4921 0.6099 0.3157 0.1820 0.3411 0.5824 0.5766 0.2520 0.1752 0.1477 0.0276 0.6099 0.3157 0.1820 280-AH 0.0004 0.0403 0.0687 0.0977 0.1347 0.0688 0.0361 0.0574 0.1343 0.5249 0.0521 0.0084 0.0305 0.0004 0.1347 0.0688 0.0361 281-AH 0.1584 0.4062 0.4899 0.5381 0.6218 0.4641 0.1099 0.1319 0.4634 0.2369 0.4478 0.4252 0.0855 0.2554 0.6218 0.4769 0.0915 282-AH 0.0001 0.1289 0.1469 0.1695 0.2660 0.1410 0.0545 0.0406 0.2660 0.3866 0.0963 0.0014 0.0367 0.0870 0.1912 0.1478 0.0285 283-AH 0.0672 0.2578 0.3350 0.4990 0.6751 0.3626 0.1646 0.2412 0.6079 0.4540 0.3225 0.2738 0.1338 0.0672 0.6751 0.3626 0.1646 284-AH 0.3335 0.5050 0.5227 0.5612 0.6049 0.5143 0.0693 0.0562 0.2714 0.1347 0.5092 0.5035 0.0490 0.4226 0.6049 0.5288 0.0495 285-AH 0.3639 0.6317 0.7368 0.7967 0.8273 0.6757 0.1550 0.1650 0.4634 0.2294 0.6545 0.6289 0.1226 0.3936 0.8273 0.7021 0.1308 286-AH 0.0009 0.0320 0.0533 0.0921 0.1085 0.0594 0.0334 0.0600 0.1075 0.5626 0.0440 0.0146 0.0286 0.0009 0.1085 0.0594 0.0334 287-AH 0.1609 0.3508 0.4236 0.4402 0.4940 0.3873 0.0819 0.0894 0.3331 0.2116 0.3763 0.3617 0.0631 0.2788 0.4940 0.4051 0.0559 288-AH 0.0473 0.1575 0.1753 0.2499 0.3720 0.1911 0.0753 0.0924 0.3247 0.3939 0.1744 0.1539 0.0580 0.0473 0.3720 0.1911 0.0753 289-AH 0.0137 0.6243 0.7097 0.7661 0.9081 0.6764 0.1702 0.1418 0.8944 0.2516 0.5952 0.2315 0.1081 0.4675 0.9081 0.7041 0.1017 290-AH 0.0856 0.1714 0.2540 0.3076 0.3961 0.2381 0.0923 0.1362 0.3105 0.3876 0.2176 0.1946 0.0786 0.0856 0.3961 0.2381 0.0923

(28)

Statistics for Average Precsion

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

291-AH 0.2620 0.4918 0.5639 0.6751 0.7480 0.5635 0.1370 0.1833 0.4860 0.2431 0.5448 0.5226 0.1092 0.2620 0.7480 0.5635 0.1370 292-AH 0.1402 0.5931 0.6125 0.8167 0.8929 0.6432 0.1934 0.2236 0.7527 0.3006 0.5963 0.5131 0.1366 0.4493 0.8929 0.6868 0.1262 293-AH 0.0055 0.5551 0.6048 0.6413 0.6885 0.5745 0.1331 0.0863 0.6830 0.2317 0.4934 0.1127 0.0759 0.4881 0.6885 0.5982 0.0618 294-AH 0.3607 0.6145 0.6551 0.6684 0.6920 0.6239 0.0728 0.0539 0.3312 0.1166 0.6188 0.6126 0.0496 0.5342 0.6920 0.6441 0.0392 295-AH 0.0880 0.2167 0.3363 0.3742 0.4228 0.2906 0.0963 0.1575 0.3349 0.3313 0.2707 0.2457 0.0808 0.0880 0.4228 0.2906 0.0963 296-AH 0.0027 0.4732 0.5245 0.5457 0.6621 0.4826 0.1427 0.0725 0.6594 0.2957 0.3976 0.0591 0.0970 0.3691 0.6027 0.5198 0.0506 297-AH 0.1407 0.3656 0.4156 0.4380 0.5775 0.4051 0.0865 0.0724 0.4368 0.2134 0.3936 0.3771 0.0595 0.2774 0.4950 0.4028 0.0530 298-AH 0.0605 0.1661 0.2110 0.2243 0.3054 0.1980 0.0581 0.0582 0.2449 0.2933 0.1879 0.1747 0.0433 0.1063 0.3054 0.2037 0.0516 299-AH 0.2283 0.3246 0.3849 0.4388 0.5221 0.3858 0.0749 0.1142 0.2938 0.1941 0.3784 0.3704 0.0591 0.2283 0.5221 0.3858 0.0749 300-AH 0.1551 0.2008 0.2200 0.2467 0.2835 0.2224 0.0316 0.0459 0.1284 0.1421 0.2202 0.2178 0.0240 0.1551 0.2835 0.2224 0.0316 301-AH 0.0022 0.0105 0.0165 0.4054 0.5453 0.1550 0.2157 0.3949 0.5432 1.3913 0.0336 0.0110 0.1951 0.0022 0.5453 0.1550 0.2157 302-AH 0.0488 0.3064 0.3392 0.3930 0.4657 0.3404 0.0931 0.0866 0.4169 0.2734 0.3180 0.2693 0.0612 0.2882 0.4657 0.3620 0.0564 303-AH 0.0480 0.2153 0.2995 0.3792 0.4693 0.2940 0.1111 0.1639 0.4213 0.3777 0.2662 0.2242 0.0836 0.0480 0.4693 0.2940 0.1111 304-AH 0.2686 0.2800 0.3274 0.3574 0.4412 0.3275 0.0505 0.0774 0.1726 0.1543 0.3239 0.3205 0.0423 0.2686 0.4412 0.3275 0.0505 305-AH 0.1458 0.2781 0.3041 0.3438 0.4436 0.3086 0.0783 0.0657 0.2978 0.2539 0.2979 0.2858 0.0572 0.1926 0.4076 0.3107 0.0554 306-AH 0.0714 1.0000 1.0000 1.0000 1.0000 0.9429 0.2072 0.0000 0.9286 0.2198 0.8752 0.6410 0.1051 1.0000 1.0000 1.0000 0.0000 307-AH 0.0496 0.2476 0.3140 0.3432 0.4702 0.2892 0.0911 0.0956 0.4206 0.3149 0.2679 0.2314 0.0688 0.1378 0.4702 0.2992 0.0778 308-AH 0.5554 0.7475 0.7815 0.8033 0.8228 0.7629 0.0647 0.0558 0.2673 0.0849 0.7599 0.7565 0.0436 0.7005 0.8228 0.7792 0.0329 309-AH 0.0125 0.0407 0.0476 0.0528 0.0950 0.0476 0.0143 0.0121 0.0824 0.3003 0.0453 0.0420 0.0091 0.0272 0.0615 0.0471 0.0081 310-AH 0.0352 0.0787 0.0888 0.1297 0.2535 0.1004 0.0447 0.0511 0.2183 0.4452 0.0918 0.0834 0.0315 0.0352 0.1526 0.0940 0.0320 311-AH 0.1026 0.2381 0.3284 0.3703 0.4230 0.3078 0.0796 0.1322 0.3205 0.2587 0.2954 0.2792 0.0671 0.1026 0.4230 0.3078 0.0796 312-AH 0.0819 0.4301 0.4907 0.6086 0.7398 0.4834 0.1709 0.1785 0.6579 0.3536 0.4394 0.3697 0.1273 0.2047 0.7398 0.5152 0.1363 313-AH 0.0012 0.0140 0.0196 0.0556 0.1702 0.0438 0.0470 0.0416 0.1690 1.0720 0.0231 0.0092 0.0349 0.0012 0.1028 0.0296 0.0262 314-AH 0.0160 0.0642 0.0762 0.0815 0.1040 0.0726 0.0192 0.0173 0.0880 0.2645 0.0687 0.0618 0.0127 0.0595 0.1040 0.0771 0.0118 315-AH 0.1552 0.2360 0.3467 0.4312 0.6487 0.3543 0.1459 0.1952 0.4935 0.4118 0.3253 0.2973 0.1185 0.1552 0.6487 0.3543 0.1459 316-AH 0.0072 0.0639 0.1685 0.2033 0.2838 0.1443 0.0859 0.1394 0.2765 0.5954 0.1098 0.0629 0.0744 0.0072 0.2838 0.1443 0.0859 317-AH 0.0745 0.2033 0.2169 0.2505 0.2885 0.2240 0.0426 0.0473 0.2141 0.1901 0.2184 0.2096 0.0294 0.1889 0.2885 0.2302 0.0297 318-AH 0.0163 0.0729 0.1500 0.2724 0.4632 0.1838 0.1329 0.1995 0.4469 0.7231 0.1387 0.0959 0.1056 0.0163 0.4632 0.1838 0.1329 319-AH 0.0988 0.3010 0.3948 0.4478 0.5273 0.3749 0.1055 0.1468 0.4285 0.2814 0.3558 0.3281 0.0828 0.0988 0.5273 0.3749 0.1055 320-AH 0.0027 0.0168 0.0219 0.0350 0.0856 0.0282 0.0188 0.0182 0.0829 0.6663 0.0228 0.0168 0.0143 0.0027 0.0571 0.0258 0.0148 321-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 322-AH 0.0186 0.0318 0.0349 0.0535 0.1453 0.0497 0.0326 0.0217 0.1267 0.6561 0.0430 0.0386 0.0233 0.0186 0.0798 0.0397 0.0156 323-AH 0.0947 0.2647 0.2717 0.2860 0.3265 0.2613 0.0503 0.0213 0.2318 0.1923 0.2546 0.2445 0.0322 0.2569 0.3097 0.2780 0.0143 324-AH 0.0325 0.2303 0.4368 0.5765 0.6989 0.4102 0.1978 0.3461 0.6664 0.4822 0.3437 0.2403 0.1756 0.0325 0.6989 0.4102 0.1978 325-AH 0.4135 0.5222 0.5499 0.6472 0.7624 0.5816 0.0887 0.1250 0.3489 0.1526 0.5752 0.5689 0.0732 0.4135 0.7624 0.5816 0.0887 326-AH 0.1540 0.2429 0.3811 0.5130 0.5712 0.3695 0.1433 0.2701 0.4172 0.3879 0.3393 0.3080 0.1288 0.1540 0.5712 0.3695 0.1433 327-AH 0.0000 0.1509 0.2416 0.4746 0.5583 0.2869 0.1810 0.3237 0.5583 0.6307 0.1602 0.0002 0.1609 0.0000 0.5583 0.2869 0.1810 328-AH 0.3841 0.4211 0.4455 0.6070 0.8062 0.5023 0.1111 0.1859 0.4221 0.2211 0.4918 0.4825 0.0899 0.3841 0.8062 0.5023 0.1111 329-AH 0.3961 0.6105 0.6391 0.6697 0.7536 0.6314 0.0706 0.0593 0.3576 0.1118 0.6270 0.6219 0.0465 0.5674 0.7536 0.6470 0.0445 330-AH 0.2023 0.6959 0.7791 0.8251 0.8426 0.7428 0.1350 0.1292 0.6403 0.1818 0.7221 0.6824 0.0881 0.5650 0.8426 0.7654 0.0761 331-AH 0.0449 0.2446 0.2664 0.4700 0.7410 0.3223 0.1818 0.2254 0.6961 0.5639 0.2677 0.2008 0.1418 0.0449 0.7410 0.3223 0.1818 332-AH 0.1260 0.3152 0.3867 0.4404 0.5226 0.3820 0.0937 0.1252 0.3966 0.2453 0.3678 0.3483 0.0720 0.2267 0.5226 0.3926 0.0787 333-AH 0.1465 1.0000 1.0000 1.0000 1.0000 0.9580 0.1714 0.0000 0.8535 0.1789 0.9184 0.8053 0.0739 1.0000 1.0000 1.0000 0.0000 334-AH 0.0115 0.1573 0.2206 0.3023 0.4522 0.2399 0.1188 0.1450 0.4407 0.4953 0.2014 0.1231 0.0922 0.0115 0.4522 0.2399 0.1188 335-AH 0.0247 0.1404 0.1807 0.2138 0.2888 0.1782 0.0646 0.0734 0.2641 0.3627 0.1620 0.1341 0.0486 0.0640 0.2888 0.1846 0.0574 336-AH 0.0000 0.0221 0.0815 0.2031 0.2852 0.1135 0.0980 0.1810 0.2852 0.8629 0.0426 0.0002 0.0870 0.0000 0.2852 0.1135 0.0980 337-AH 0.5337 0.7109 0.8369 0.8717 0.8895 0.7889 0.1025 0.1608 0.3558 0.1299 0.7819 0.7742 0.0875 0.5337 0.8895 0.7889 0.1025 338-AH 0.0383 0.5973 0.6876 0.7820 0.9456 0.6639 0.1933 0.1847 0.9072 0.2912 0.5961 0.3904 0.1262 0.5258 0.9456 0.7112 0.1046 339-AH 0.2706 0.5356 0.5888 0.6896 0.7316 0.5859 0.1110 0.1540 0.4610 0.1894 0.5739 0.5591 0.0855 0.4074 0.7316 0.5990 0.0914 340-AH 0.2429 0.3063 0.3557 0.5108 0.6393 0.3976 0.1073 0.2045 0.3964 0.2699 0.3845 0.3723 0.0911 0.2429 0.6393 0.3976 0.1073

(29)

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 341-AH 0.1147 0.6851 0.8750 0.9048 0.9762 0.8080 0.1796 0.2196 0.8615 0.2223 0.7666 0.6596 0.1275 0.6794 0.9762 0.8369 0.1091 342-AH 0.3606 0.6240 0.7177 0.7977 0.8194 0.6884 0.1291 0.1737 0.4589 0.1875 0.6741 0.6565 0.1009 0.3714 0.8194 0.7021 0.1119 343-AH 0.0035 0.0214 0.0345 0.0534 0.1250 0.0405 0.0296 0.0320 0.1215 0.7318 0.0296 0.0179 0.0218 0.0035 0.0667 0.0338 0.0190 344-AH 0.2078 0.3961 0.4513 0.5492 0.7153 0.4690 0.1485 0.1531 0.5075 0.3166 0.4451 0.4195 0.1113 0.2078 0.7153 0.4690 0.1485 345-AH 0.0554 0.1271 0.2277 0.2948 0.4861 0.2175 0.1109 0.1678 0.4307 0.5096 0.1846 0.1489 0.0867 0.0554 0.4861 0.2175 0.1109 346-AH 0.0453 0.0638 0.0913 0.1023 0.1411 0.0860 0.0248 0.0385 0.0959 0.2882 0.0823 0.0784 0.0205 0.0453 0.1411 0.0860 0.0248 347-AH 0.0319 0.0414 0.0485 0.0938 0.1977 0.0709 0.0414 0.0524 0.1658 0.5847 0.0619 0.0554 0.0323 0.0319 0.1514 0.0656 0.0326 348-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9163 0.2462 0.0000 1.0000 0.2686 0.5904 0.0002 0.1473 1.0000 1.0000 1.0000 0.0000 349-AH 0.2763 0.3264 0.3885 0.4497 0.7860 0.4391 0.1687 0.1233 0.5097 0.3842 0.4135 0.3931 0.1314 0.2763 0.5307 0.3615 0.0633 350-AH 0.4314 0.6300 0.6858 0.7014 0.7287 0.6530 0.0774 0.0714 0.2973 0.1186 0.6479 0.6421 0.0583 0.5634 0.7287 0.6706 0.0498

(30)

AH-ROBUST-CLEF2009 Track Overview Results and Graphs AH-ROBUST-MONO-EN-TEST-CLEF2009

Statistics for R-Precision

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

141-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9600 0.2000 0.0000 1.0000 0.2083 0.6310 0.0002 0.0768 1.0000 1.0000 1.0000 0.0000 142-AH 0.5000 0.8750 0.8750 0.8750 1.0000 0.8750 0.0884 0.0000 0.5000 0.1010 0.8695 0.8621 0.0300 0.8750 0.8750 0.8750 0.0000 143-AH 0.5128 0.5897 0.6923 0.8205 0.8462 0.6923 0.1212 0.2308 0.3333 0.1750 0.6820 0.6718 0.1087 0.5128 0.8462 0.6923 0.1212 144-AH 0.0000 0.3333 0.6667 0.6667 0.6667 0.5333 0.1925 0.3333 0.6667 0.3608 0.3425 0.0002 0.1707 0.0000 0.6667 0.5333 0.1925 145-AH 0.4211 0.5724 0.6579 0.6579 0.7105 0.6105 0.0808 0.0855 0.2895 0.1323 0.6048 0.5985 0.0636 0.4474 0.7105 0.6184 0.0720 146-AH 0.0000 0.5000 0.5000 0.5000 0.5000 0.4600 0.1384 0.0000 0.5000 0.3010 0.2104 0.0001 0.0736 0.5000 0.5000 0.5000 0.0000 147-AH 0.3333 0.6225 0.6863 0.7059 0.8039 0.6588 0.1000 0.0833 0.4706 0.1518 0.6498 0.6384 0.0687 0.5098 0.8039 0.6724 0.0751 148-AH 0.0000 0.1667 0.1667 0.1667 0.1667 0.1533 0.0461 0.0000 0.1667 0.3010 0.0766 0.0001 0.0245 0.1667 0.1667 0.1667 0.0000 149-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 150-AH 0.0000 0.0000 0.1000 0.2250 0.3000 0.1240 0.1300 0.2250 0.3000 1.0484 0.0018 0.0000 0.1210 0.0000 0.3000 0.1240 0.1300 151-AH 0.0000 0.2292 0.3333 0.4167 0.4167 0.2767 0.1535 0.1875 0.4167 0.5548 0.0420 0.0000 0.1237 0.0000 0.4167 0.2767 0.1535 152-AH 0.1818 0.3409 0.5455 0.6364 0.7273 0.5091 0.1721 0.2955 0.5455 0.3380 0.4749 0.4356 0.1484 0.1818 0.7273 0.5091 0.1721 153-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 154-AH 0.0476 0.3214 0.3810 0.3929 0.4762 0.3429 0.1029 0.0714 0.4286 0.3000 0.3160 0.2626 0.0754 0.2381 0.4762 0.3745 0.0556 155-AH 0.0000 0.0000 0.0000 0.3333 0.3333 0.1067 0.1587 0.3333 0.3333 1.4878 0.0003 0.0000 0.1451 0.0000 0.3333 0.1067 0.1587 156-AH 0.0909 0.1705 0.1818 0.2727 0.4091 0.2164 0.0812 0.1023 0.3182 0.3752 0.2028 0.1903 0.0641 0.0909 0.4091 0.2164 0.0812 157-AH 0.1439 0.5162 0.5396 0.5629 0.6691 0.5324 0.0964 0.0468 0.5252 0.1811 0.5176 0.4891 0.0518 0.4964 0.6331 0.5454 0.0327 158-AH 0.0000 0.3456 0.4118 0.5000 0.6176 0.4024 0.1756 0.1544 0.6176 0.4364 0.1238 0.0001 0.1234 0.2941 0.6176 0.4572 0.0946 159-AH 0.1296 0.2593 0.2778 0.3704 0.6667 0.3163 0.1257 0.1111 0.5370 0.3974 0.2941 0.2733 0.0952 0.1296 0.5000 0.3017 0.1045 160-AH 0.0000 0.0000 0.0000 0.0000 0.5000 0.0200 0.1000 0.0000 0.5000 5.0000 0.0000 0.0000 0.0384 0.0000 0.0000 0.0000 0.0000 161-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 162-AH 0.0000 0.0000 0.0000 1.0000 1.0000 0.3600 0.4899 1.0000 1.0000 1.3608 0.0006 0.0000 0.4608 0.0000 1.0000 0.3600 0.4899 163-AH 0.5328 0.7398 0.7623 0.7807 0.8197 0.7498 0.0578 0.0410 0.2869 0.0771 0.7474 0.7446 0.0389 0.6803 0.8197 0.7589 0.0368 164-AH 0.0000 0.0741 0.1111 0.1481 0.2593 0.1141 0.0613 0.0741 0.2593 0.5378 0.0732 0.0002 0.0453 0.0000 0.2593 0.1141 0.0613 165-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9600 0.2000 0.0000 1.0000 0.2083 0.6310 0.0002 0.0768 1.0000 1.0000 1.0000 0.0000 166-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 167-AH 0.0000 0.2000 0.2000 0.2500 0.4000 0.2160 0.1281 0.0500 0.4000 0.5929 0.0484 0.0001 0.0883 0.2000 0.2000 0.2000 0.0000 168-AH 0.0000 0.3889 0.4444 0.5000 0.6667 0.4422 0.1226 0.1111 0.6667 0.2773 0.2953 0.0002 0.0784 0.2778 0.6111 0.4517 0.0717 169-AH 0.0000 0.0000 0.0000 0.0000 0.1667 0.0333 0.0680 0.0000 0.1667 2.0412 0.0001 0.0000 0.0533 0.0000 0.0000 0.0000 0.0000 170-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9600 0.2000 0.0000 1.0000 0.2083 0.6310 0.0002 0.0768 1.0000 1.0000 1.0000 0.0000 171-AH 0.0000 0.0526 0.1053 0.1053 0.1579 0.0821 0.0458 0.0526 0.1579 0.5576 0.0291 0.0001 0.0386 0.0000 0.1579 0.0821 0.0458 172-AH 0.0000 0.0000 0.1429 0.1429 0.2857 0.1086 0.0853 0.1429 0.2857 0.7858 0.0071 0.0000 0.0695 0.0000 0.2857 0.1086 0.0853 173-AH 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 174-AH 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 175-AH 0.4286 0.5714 0.5714 0.7143 0.8571 0.6400 0.0933 0.1429 0.4286 0.1458 0.6334 0.6266 0.0827 0.4286 0.8571 0.6400 0.0933 176-AH 0.6667 0.7692 0.7949 0.8269 0.8718 0.7897 0.0619 0.0577 0.2051 0.0784 0.7873 0.7846 0.0464 0.7436 0.8718 0.8132 0.0316 177-AH 0.0769 0.2885 0.4615 0.5385 0.6923 0.4185 0.1750 0.2500 0.6154 0.4181 0.3686 0.2970 0.1440 0.0769 0.6923 0.4185 0.1750 178-AH 0.0000 0.0000 0.2500 0.2500 0.2500 0.1600 0.1225 0.2500 0.2500 0.7655 0.0065 0.0000 0.1152 0.0000 0.2500 0.1600 0.1225 179-AH 0.1364 0.4318 0.6364 0.6818 0.7273 0.5418 0.1690 0.2500 0.5909 0.3119 0.5073 0.4594 0.1425 0.1364 0.7273 0.5418 0.1690 180-AH 0.0000 0.1125 0.6000 0.6250 0.6750 0.4000 0.2758 0.5125 0.6750 0.6894 0.0704 0.0001 0.2580 0.0000 0.6750 0.4000 0.2758 181-AH 0.5652 0.7364 0.7826 0.7935 0.8043 0.7617 0.0490 0.0571 0.2391 0.0643 0.7600 0.7580 0.0329 0.7174 0.8043 0.7699 0.0275 182-AH 0.0000 0.0000 0.2500 0.5000 0.7500 0.2600 0.2746 0.5000 0.7500 1.0562 0.0056 0.0000 0.2144 0.0000 0.7500 0.2600 0.2746 183-AH 0.0000 0.0000 0.0000 0.2500 0.2500 0.0900 0.1225 0.2500 0.2500 1.3608 0.0004 0.0000 0.1152 0.0000 0.2500 0.0900 0.1225 184-AH 0.3333 0.5556 0.5556 0.5556 0.6667 0.5467 0.0711 0.0000 0.3333 0.1301 0.5417 0.5359 0.0416 0.5556 0.5556 0.5556 0.0000 185-AH 0.0000 0.0000 0.0000 1.0000 1.0000 0.3600 0.4899 1.0000 1.0000 1.3608 0.0006 0.0000 0.4608 0.0000 1.0000 0.3600 0.4899 186-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-AH 0.0000 0.0000 0.0000 0.0000 1.0000 0.2000 0.4082 0.0000 1.0000 2.0412 0.0001 0.0000 0.3200 0.0000 0.0000 0.0000 0.0000 188-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 189-AH 0.7143 0.7143 0.8571 0.8929 1.0000 0.8343 0.1143 0.1786 0.2857 0.1370 0.8269 0.8197 0.0960 0.7143 1.0000 0.8343 0.1143 190-AH 0.3333 0.6667 0.6667 0.6944 0.7778 0.6667 0.0962 0.0278 0.4444 0.1443 0.6583 0.6474 0.0533 0.6667 0.6667 0.6667 0.0000

Références

Documents relatifs

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL

In previous work, Euzenat and others have proposed notions of semantic precision and recall that are supposed to better reflect the true quality of an alignment by considering