• Aucun résultat trouvé

Appendix C: Results of the Robust Track

N/A
N/A
Protected

Academic year: 2022

Partager "Appendix C: Results of the Robust Track"

Copied!
682
0
0

Texte intégral

(1)

Appendix C

Results of the Robust Track

Prepared by:

Giorgio Maria Di Nunzio and Nicola Ferro

{dinunzio, ferro}@dei.unipd.it

Department of Information Engineering University of Padua

Italy

(2)
(3)

Introduction

(4)
(5)

1.

2.

3.

- - - -

- - -

- - -

- - -

- - - - - - - - - - - - -

The following pages contain the results and graphs for all the experiments that have been officially submitted to the CLEF 2007 campaign for the Ad-hoc Robust track.

This document is divided in three main parts:

List of submitted experiments Track overview results and graphs Individual experiment results and graphs

1. List of Submitted Experiments

This section gives a listing of all experiments and their characteristics:

2. Track Overview Results and Graphs

For each track/task graphs and tables are shown in order to compare the experiments.

The graphs and tables contain the following information:

Best experiments of at most top five participants Interpolated recall vs precision averages plot Average precision comparison to median plot All experiments

Average precision box plot Average precision Tukey t-test plot

Best experiments of at most top five participants Document cutoff levels (DCL) vs precision at DCL plot R-Precision comparison to median plot

All experiments R-Precision box plot R-Precision Tukey t-test plot

A table with descriptive statistics of performance figures for each topic Min: The minimum of a set of observations

1st Q: The first quartile of a set of observations

2nd Q: The second quartile (median) of a set of observations 3rd Q: The third quartile of a set of observations

Max: The maximum of a set of observations Mean: The arithmetic mean of a set of observations Std: The standard deviation of a set of observations

IQR: Interquartile range, the difference between the 3rd and 1st quartiles

Range: The difference between the maximum and the minimum of a set of observations C.Var: Coefficient of variation, the spread of a set of data as a proportion of its mean Geom.: The geometric mean of a set of observations

Harm.: The harmonic mean of a set of observations

MAO: The mean of absolute deviation of the values in a set of observations

Results for CLEF 2008 Ad-hoc Robust Track

Participant: name of the participant who submitted the experiment.

Country: country of the participant.

Expeirment DOI: Digital Object Identifier (DOI) for each experiment.

Task: track/task to which the experiment belongs.

Lang.: language of the topics used to create the experiment (ISO identifiers for language).

Fields: identifies the parts of the topics used to create the experiment (T = title, D = Description, N = Narrative).

Constr.: identifies how the query has been constructed from topic fields (manual/automatic).

Pool: specifies if experiment was used for relevance assessment pooling.

(6)

- - - - - - -

This section provides the individual results for each official experiment. For each experiment the following tables and graphs are shown:

Overall statistics and information

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL plot R-Precision statistics and box plot

R-Precision comparison to median plot

Topics are identified with DOIs, as well as the experiments. The prefix for the DOI of a topic is 10.2452. The following example

shows how to build the DOI for a topic given its number: for topic 200-AH, the corresponding DOI is 10.2452/200-AH

(7)

List of Submitted Experiments

(8)
(9)

Participant Country Experiment DOI Task Lang. Fields Constr. Pool

geneva Switzerland 10.2415/AH-ROBUST-MONO-EN-TEST- CLEF2008.GENEVA.ISILEMTD

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.GENEVA.ISILEMTDN

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TDN AUTOMATIC no inaoe Mexico 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.INAOE.INAOEF

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no inaoe Mexico 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.INAOE.INAOEV

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ixa Spain 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.IXA.EN2ENNOWSD

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ixa Spain 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.IXA.EN2ENNOWSDPSREL

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no know-center Austria 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.KNOW-CENTER.ASSO

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ucm Spain 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.UCM.BM25_BASELINE

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ucm Spain 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.UCM.BM25_BO1

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ucm Spain 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.UCM.BM25_BO1_AVICTF

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ucm Spain 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.UCM.BM25_KLD

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ufrgs Brazil 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.UFRGS.UFRGS_R_MONO1_TEST

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ufrgs Brazil 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.UFRGS.UFRGS_R_MONO2_TEST

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.UNIBA.MONO11NUS2F

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.UNIBA.MONO12NUS2FOUT

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.UNIBA.MONO13NUS2F

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.UNIBA.MONO14NUS2F

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.UNIBA.MONO1TDNUS2F

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no unine Switzerland 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.UNINE.UNINEROBUST1

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no unine Switzerland 10.2415/AH-ROBUST-MONO-EN-TEST-

CLEF2008.UNINE.UNINEROBUST4

AH-ROBUST-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2008.GENEVA.ISIESENTD

AH-ROBUST-BILI-X2EN-TEST-CLEF2008 es TD AUTOMATIC no ixa Spain 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2008.IXA.ES2ENNOWSD

AH-ROBUST-BILI-X2EN-TEST-CLEF2008 en TD AUTOMATIC no ixa Spain 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2008.IXA.ES2ENNOWSDPSREL

AH-ROBUST-BILI-X2EN-TEST-CLEF2008 es TD AUTOMATIC no ufrgs Brazil 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2008.UFRGS.UFRGS_R_BI1_TEST

AH-ROBUST-BILI-X2EN-TEST-CLEF2008 es TD AUTOMATIC no ufrgs Brazil 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2008.UFRGS.UFRGS_R_BI2_TEST

AH-ROBUST-BILI-X2EN-TEST-CLEF2008 es TD AUTOMATIC no ufrgs Brazil 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2008.UFRGS.UFRGS_R_BI3_TEST

AH-ROBUST-BILI-X2EN-TEST-CLEF2008 es TD AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2008.UNIBA.CROSS1NUS2F

AH-ROBUST-BILI-X2EN-TEST-CLEF2008 es TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-BILI-X2EN-TEST-

CLEF2008.UNIBA.CROSS1TDNUS2F

AH-ROBUST-BILI-X2EN-TEST-CLEF2008 es TD AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.GENEVA.ISINUSLWTDN

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TDN AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.GENEVA.ISINUSWDTD

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.GENEVA.ISINUSWDTDN

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TDN AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.GENEVA.ISIUBCWSDTDN

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TDN AUTOMATIC no ixa Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.IXA.EN2ENFULLSTRUCTOPSNUSDOCSPSR EL

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no

ixa Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST- CLEF2008.IXA.EN2ENNUSDOCSPSREL

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 es TD AUTOMATIC no ixa Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.IXA.EN2ENUBCDOCSPSREL

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no know-center Austria 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.KNOW-CENTER.ASSO_WSD

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ucm Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.UCM.BM25_BO1_CLAUSES_00

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ucm Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.UCM.BM25_BO1_CLAUSES_03

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ucm Spain 10.2415/AH-ROBUST-WSD-MONO-EN-TEST- AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no

(10)

ufrgs Brazil 10.2415/AH-ROBUST-WSD-MONO-EN-TEST- CLEF2008.UFRGS.UFRGS_R_MONO_WSD1_TEST

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ufrgs Brazil 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.UFRGS.UFRGS_R_MONO_WSD2_TEST

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ufrgs Brazil 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.UFRGS.UFRGS_R_MONO_WSD3_TEST

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ufrgs Brazil 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.UFRGS.UFRGS_R_MONO_WSD4_TEST

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no ufrgs Brazil 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.UFRGS.UFRGS_R_MONO_WSD5_TEST

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.UNIBA.MONOWSD11NUS2F

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.UNIBA.MONOWSD12NUS2F

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.UNIBA.MONOWSD13NUS2F

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.UNIBA.MONOWSD1NUS2F

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no unine Switzerland 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.UNINE.UNINEROBUST2

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no unine Switzerland 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.UNINE.UNINEROBUST3

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no unine Switzerland 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.UNINE.UNINEROBUST5

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no unine Switzerland 10.2415/AH-ROBUST-WSD-MONO-EN-TEST-

CLEF2008.UNINE.UNINEROBUST6

AH-ROBUST-WSD-MONO-EN-TEST-CLEF2008 en TD AUTOMATIC no geneva Switzerland 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST-

CLEF2008.GENEVA.ISIESPWSDTD

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008

es TD AUTOMATIC no

geneva Switzerland 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008.GENEVA.ISIESPWSDTDN

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008

es TDN AUTOMATIC no ixa Spain 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST-

CLEF2008.IXA.ES2EN1STTOPSNUSDOCSPSREL

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008

pt TD AUTOMATIC no

ixa Spain 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008.IXA.ES2EN1STTOPSUBCDOCSPSREL

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008

es TD AUTOMATIC no

ixa Spain 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008.IXA.ES2ENNUSDOCSPSREL

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008

es TD AUTOMATIC no

ixa Spain 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008.IXA.ES2ENUBCDOCSPSREL

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008

es TD AUTOMATIC no

ufrgs Brazil 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008.UFRGS.UFRGS_R_BI_WSD1_TEST

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008

es TD AUTOMATIC no

uniba Italy 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008.UNIBA.CROSSWSD11NUS2F

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008

es TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST-

CLEF2008.UNIBA.CROSSWSD12NUS2F

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008

es TDN AUTOMATIC no uniba Italy 10.2415/AH-ROBUST-WSD-BILI-X2EN-TEST-

CLEF2008.UNIBA.CROSSWSD1NUS2F

AH-ROBUST-WSD-BILI-X2EN-TEST- CLEF2008

es TD AUTOMATIC no

(11)

Track Overview Results and Graphs

(12)
(13)

AH-ROBUST-CLEF2008 Track Overview Results and Graphs AH-ROBUST-MONO-EN-TEST-CLEF2008

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Recall

Precision

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision

unine [Experiment UNINEROBUST4; MAP 45.15%; Not Pooled]

geneva [Experiment ISILEMTDN; MAP 39.17%; Not Pooled]

ucm [Experiment BM25_BO1; MAP 38.35%; Not Pooled]

ixa [Experiment EN2ENNOWSDPSREL; MAP 38.10%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO2_TEST; MAP 33.95%; Not Pooled]

141−AH 142−AH 143−AH 144−AH 145−AH 146−AH 147−AH 148−AH 149−AH 150−AH 151−AH 152−AH 153−AH 154−AH 155−AH 156−AH 157−AH 158−AH 159−AH 160−AH 161−AH 162−AH 163−AH 164−AH 165−AH

−1

−0.5 0 0.5 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 141−AH to 165−AH)

unine [Experiment UNINEROBUST4; MAP 45.15%; Not Pooled]

geneva [Experiment ISILEMTDN; MAP 39.17%; Not Pooled]

ucm [Experiment BM25_BO1; MAP 38.35%; Not Pooled]

ixa [Experiment EN2ENNOWSDPSREL; MAP 38.10%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO2_TEST; MAP 33.95%; Not Pooled]

166−AH 167−AH 168−AH 169−AH 170−AH 171−AH 172−AH 173−AH 174−AH 175−AH 176−AH 177−AH 178−AH 179−AH 180−AH 181−AH 182−AH 183−AH 184−AH 185−AH 186−AH 187−AH 188−AH 189−AH 190−AH

−1

−0.5 0 0.5 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 166−AH to 190−AH)

unine [Experiment UNINEROBUST4; MAP 45.15%; Not Pooled]

geneva [Experiment ISILEMTDN; MAP 39.17%; Not Pooled]

ucm [Experiment BM25_BO1; MAP 38.35%; Not Pooled]

ixa [Experiment EN2ENNOWSDPSREL; MAP 38.10%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO2_TEST; MAP 33.95%; Not Pooled]

191−AH 192−AH 193−AH 194−AH 195−AH 196−AH 197−AH 198−AH 199−AH 200−AH 251−AH 252−AH 253−AH 254−AH 255−AH 256−AH 257−AH 258−AH 259−AH 260−AH 261−AH 262−AH 263−AH 264−AH 265−AH

−1

−0.5 0 0.5 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 191−AH to 265−AH)

unine [Experiment UNINEROBUST4; MAP 45.15%; Not Pooled]

geneva [Experiment ISILEMTDN; MAP 39.17%; Not Pooled]

ucm [Experiment BM25_BO1; MAP 38.35%; Not Pooled]

ixa [Experiment EN2ENNOWSDPSREL; MAP 38.10%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO2_TEST; MAP 33.95%; Not Pooled]

266−AH 267−AH 268−AH 269−AH 270−AH 271−AH 272−AH 273−AH 274−AH 275−AH 276−AH 277−AH 278−AH 279−AH 280−AH 281−AH 282−AH 283−AH 284−AH 285−AH 286−AH 287−AH 288−AH 289−AH 290−AH

−1

−0.5 0 0.5 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 266−AH to 290−AH)

unine [Experiment UNINEROBUST4; MAP 45.15%; Not Pooled]

geneva [Experiment ISILEMTDN; MAP 39.17%; Not Pooled]

ucm [Experiment BM25_BO1; MAP 38.35%; Not Pooled]

ixa [Experiment EN2ENNOWSDPSREL; MAP 38.10%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO2_TEST; MAP 33.95%; Not Pooled]

291−AH 292−AH 293−AH 294−AH 295−AH 296−AH 297−AH 298−AH 299−AH 300−AH 301−AH 302−AH 303−AH 304−AH 305−AH 306−AH 307−AH 308−AH 309−AH 310−AH 311−AH 312−AH 313−AH 314−AH 315−AH

−1

−0.5 0 0.5 1

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 291−AH to 315−AH)

unine [Experiment UNINEROBUST4; MAP 45.15%; Not Pooled]

geneva [Experiment ISILEMTDN; MAP 39.17%; Not Pooled]

ucm [Experiment BM25_BO1; MAP 38.35%; Not Pooled]

ixa [Experiment EN2ENNOWSDPSREL; MAP 38.10%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO2_TEST; MAP 33.95%; Not Pooled]

(14)

uniba [Experiment MONO12NUS2FOUT; MAP 14.57%; Not Pooled]

uniba [Experiment MONO13NUS2F; MAP 15.48%; Not Pooled]

uniba [Experiment MONO1TDNUS2F; MAP 16.81%; Not Pooled]

uniba [Experiment MONO11NUS2F; MAP 19.24%; Not Pooled]

inaoe [Experiment INAOEV; MAP 25.82%; Not Pooled]

know−center [Experiment ASSO; MAP 27.72%; Not Pooled]

inaoe [Experiment INAOEF; MAP 28.46%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO1_TEST; MAP 31.20%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO2_TEST; MAP 33.95%; Not Pooled]

ixa [Experiment EN2ENNOWSD; MAP 35.34%; Not Pooled]

ucm [Experiment BM25_BASELINE; MAP 36.14%; Not Pooled]

geneva [Experiment ISILEMTD; MAP 36.94%; Not Pooled]

ixa [Experiment EN2ENNOWSDPSREL; MAP 38.10%; Not Pooled]

ucm [Experiment BM25_BO1_AVICTF; MAP 38.11%; Not Pooled]

ucm [Experiment BM25_KLD; MAP 38.33%; Not Pooled]

ucm [Experiment BM25_BO1; MAP 38.35%; Not Pooled]

geneva [Experiment ISILEMTDN; MAP 39.17%; Not Pooled]

unine [Experiment UNINEROBUST1; MAP 43.17%; Not Pooled]

unine [Experiment UNINEROBUST4; MAP 45.15%; Not Pooled]

Experiments

Ad−Hoc Robust Monolingual English Test Task − Box Plot of the Topics

(15)

AH-ROBUST-CLEF2008 Track Overview Results and Graphs AH-ROBUST-MONO-EN-TEST-CLEF2008 10.2455/TUKEY_T_TEST.488B4DC45C240AEDD7AED91CF79383BE

MONO12NUS2FOUT MONO13NUS2F MONO1TDNUS2F MONO11NUS2F INAOEV ASSO INAOEF UFRGS_R_MONO1_TEST UFRGS_R_MONO2_TEST EN2ENNOWSD BM25_BASELINE ISILEMTD BM25_BO1_AVICTF BM25_KLD BM25_BO1 EN2ENNOWSDPSREL ISILEMTDN UNINEROBUST1 UNINEROBUST4

Ad−Hoc Robust Monolingual English Test Task − Tukey T test with "top group" highlighted

Experiments

(16)
(17)

AH-ROBUST-CLEF2008 Track Overview Results and Graphs AH-ROBUST-MONO-EN-TEST-CLEF2008

5 10 15 20 30 100 200 500 1000

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Retrieved Documents (logarithmic scale)

Precision

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Retrieved documents vs Mean Precision

unine [Experiment UNINEROBUST4; R−Prec 42.99%; Not Pooled]

geneva [Experiment ISILEMTDN; R−Prec 38.05%; Not Pooled]

ucm [Experiment BM25_BO1; R−Prec 36.15%; Not Pooled]

ixa [Experiment EN2ENNOWSDPSREL; R−Prec 36.12%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO2_TEST; R−Prec 32.81%; Not Pooled]

141−AH 142−AH 143−AH 144−AH 145−AH 146−AH 147−AH 148−AH 149−AH 150−AH 151−AH 152−AH 153−AH 154−AH 155−AH 156−AH 157−AH 158−AH 159−AH 160−AH 161−AH 162−AH 163−AH 164−AH 165−AH

−1

−0.5 0 0.5 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 141−AH to 165−AH)

unine [Experiment UNINEROBUST4; R−Prec 42.99%; Not Pooled]

geneva [Experiment ISILEMTDN; R−Prec 38.05%; Not Pooled]

ucm [Experiment BM25_BO1; R−Prec 36.15%; Not Pooled]

ixa [Experiment EN2ENNOWSDPSREL; R−Prec 36.12%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO2_TEST; R−Prec 32.81%; Not Pooled]

166−AH 167−AH 168−AH 169−AH 170−AH 171−AH 172−AH 173−AH 174−AH 175−AH 176−AH 177−AH 178−AH 179−AH 180−AH 181−AH 182−AH 183−AH 184−AH 185−AH 186−AH 187−AH 188−AH 189−AH 190−AH

−1

−0.5 0 0.5 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 166−AH to 190−AH)

unine [Experiment UNINEROBUST4; R−Prec 42.99%; Not Pooled]

geneva [Experiment ISILEMTDN; R−Prec 38.05%; Not Pooled]

ucm [Experiment BM25_BO1; R−Prec 36.15%; Not Pooled]

ixa [Experiment EN2ENNOWSDPSREL; R−Prec 36.12%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO2_TEST; R−Prec 32.81%; Not Pooled]

191−AH 192−AH 193−AH 194−AH 195−AH 196−AH 197−AH 198−AH 199−AH 200−AH 251−AH 252−AH 253−AH 254−AH 255−AH 256−AH 257−AH 258−AH 259−AH 260−AH 261−AH 262−AH 263−AH 264−AH 265−AH

−1

−0.5 0 0.5 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 191−AH to 265−AH)

unine [Experiment UNINEROBUST4; R−Prec 42.99%; Not Pooled]

geneva [Experiment ISILEMTDN; R−Prec 38.05%; Not Pooled]

ucm [Experiment BM25_BO1; R−Prec 36.15%; Not Pooled]

ixa [Experiment EN2ENNOWSDPSREL; R−Prec 36.12%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO2_TEST; R−Prec 32.81%; Not Pooled]

266−AH 267−AH 268−AH 269−AH 270−AH 271−AH 272−AH 273−AH 274−AH 275−AH 276−AH 277−AH 278−AH 279−AH 280−AH 281−AH 282−AH 283−AH 284−AH 285−AH 286−AH 287−AH 288−AH 289−AH 290−AH

−1

−0.5 0 0.5 1

Topic Identifier

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 266−AH to 290−AH)

unine [Experiment UNINEROBUST4; R−Prec 42.99%; Not Pooled]

geneva [Experiment ISILEMTDN; R−Prec 38.05%; Not Pooled]

ucm [Experiment BM25_BO1; R−Prec 36.15%; Not Pooled]

ixa [Experiment EN2ENNOWSDPSREL; R−Prec 36.12%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO2_TEST; R−Prec 32.81%; Not Pooled]

291−AH 292−AH 293−AH 294−AH 295−AH 296−AH 297−AH 298−AH 299−AH 300−AH 301−AH 302−AH 303−AH 304−AH 305−AH 306−AH 307−AH 308−AH 309−AH 310−AH 311−AH 312−AH 313−AH 314−AH 315−AH

−1

−0.5 0 0.5 1

Difference

Ad−Hoc Robust Monolingual English Test Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 291−AH to 315−AH)

unine [Experiment UNINEROBUST4; R−Prec 42.99%; Not Pooled]

geneva [Experiment ISILEMTDN; R−Prec 38.05%; Not Pooled]

ucm [Experiment BM25_BO1; R−Prec 36.15%; Not Pooled]

ixa [Experiment EN2ENNOWSDPSREL; R−Prec 36.12%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO2_TEST; R−Prec 32.81%; Not Pooled]

(18)

uniba [Experiment MONO12NUS2FOUT; R−Prec 16.43%; Not Pooled]

uniba [Experiment MONO13NUS2F; R−Prec 17.01%; Not Pooled]

uniba [Experiment MONO1TDNUS2F; R−Prec 19.00%; Not Pooled]

uniba [Experiment MONO11NUS2F; R−Prec 21.20%; Not Pooled]

inaoe [Experiment INAOEV; R−Prec 25.53%; Not Pooled]

inaoe [Experiment INAOEF; R−Prec 27.35%; Not Pooled]

know−center [Experiment ASSO; R−Prec 27.45%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO1_TEST; R−Prec 30.43%; Not Pooled]

ufrgs [Experiment UFRGS_R_MONO2_TEST; R−Prec 32.81%; Not Pooled]

ixa [Experiment EN2ENNOWSD; R−Prec 33.14%; Not Pooled]

ucm [Experiment BM25_BASELINE; R−Prec 35.24%; Not Pooled]

ucm [Experiment BM25_BO1_AVICTF; R−Prec 35.87%; Not Pooled]

ixa [Experiment EN2ENNOWSDPSREL; R−Prec 36.12%; Not Pooled]

ucm [Experiment BM25_BO1; R−Prec 36.15%; Not Pooled]

geneva [Experiment ISILEMTD; R−Prec 36.35%; Not Pooled]

ucm [Experiment BM25_KLD; R−Prec 36.47%; Not Pooled]

geneva [Experiment ISILEMTDN; R−Prec 38.05%; Not Pooled]

unine [Experiment UNINEROBUST1; R−Prec 41.70%; Not Pooled]

unine [Experiment UNINEROBUST4; R−Prec 42.99%; Not Pooled]

Experiments

Ad−Hoc Robust Monolingual English Test Task − Box Plot of the Topics

(19)

AH-ROBUST-CLEF2008 Track Overview Results and Graphs AH-ROBUST-MONO-EN-TEST-CLEF2008

MONO12NUS2FOUT MONO13NUS2F MONO1TDNUS2F MONO11NUS2F INAOEV INAOEF ASSO UFRGS_R_MONO1_TEST UFRGS_R_MONO2_TEST EN2ENNOWSD BM25_BASELINE BM25_BO1_AVICTF BM25_BO1 BM25_KLD EN2ENNOWSDPSREL ISILEMTD ISILEMTDN UNINEROBUST1 UNINEROBUST4

Ad−Hoc Robust Monolingual English Test Task − Tukey T test with "top group" highlighted

Experiments

(20)
(21)

AH-ROBUST-CLEF2008 Track Overview Results and Graphs AH-ROBUST-MONO-EN-TEST-CLEF2008

Statistics for Number of relevant retrieved documents

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

141-AH 0.00 0.50 1.00 1.00 1.00 0.75 0.44 0.50 1.00 0.59 0.06 0.00 0.38 0.00 1.00 0.75 0.44

142-AH 6.00 7.50 8.00 8.00 8.00 7.55 0.83 0.50 2.00 0.11 7.50 7.45 0.68 7.00 8.00 7.94 0.25

143-AH 10.00 28.50 39.00 39.00 39.00 33.45 9.41 10.50 29.00 0.28 31.63 29.04 7.72 20.00 39.00 34.68 7.82

144-AH 1.00 2.50 3.00 3.00 3.00 2.70 0.57 0.50 2.00 0.21 2.62 2.50 0.45 2.00 3.00 2.79 0.42

145-AH 17.00 31.50 37.00 37.00 37.00 33.50 6.06 5.50 20.00 0.18 32.84 32.02 4.85 26.00 37.00 35.00 4.01

146-AH 1.00 1.50 2.00 2.00 2.00 1.75 0.44 0.50 1.00 0.25 1.68 1.60 0.38 1.00 2.00 1.75 0.44

147-AH 30.00 41.00 50.50 51.00 51.00 46.05 7.74 10.00 21.00 0.17 45.33 44.52 6.43 30.00 51.00 46.05 7.74

148-AH 3.00 5.00 6.00 6.00 6.00 5.55 0.83 1.00 3.00 0.15 5.48 5.38 0.63 4.00 6.00 5.68 0.58

149-AH 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00

150-AH 0.00 4.00 10.00 10.00 10.00 7.25 4.24 6.00 10.00 0.58 0.54 0.00 3.55 0.00 10.00 7.25 4.24 151-AH 1.00 7.00 9.00 9.50 10.00 8.15 2.28 2.50 9.00 0.28 7.52 6.01 1.69 5.00 10.00 8.53 1.58 152-AH 4.00 9.50 11.00 11.00 11.00 9.95 1.73 1.50 7.00 0.17 9.74 9.42 1.18 8.00 11.00 10.26 1.05

153-AH 0.00 0.00 0.00 1.00 1.00 0.45 0.51 1.00 1.00 1.13 0.00 0.00 0.50 0.00 1.00 0.45 0.51

154-AH 14.00 18.00 20.00 20.00 21.00 19.10 1.77 2.00 7.00 0.09 19.01 18.92 1.38 17.00 21.00 19.37 1.34

155-AH 0.00 1.50 3.00 3.00 3.00 2.25 1.33 1.50 3.00 0.59 0.13 0.00 1.12 0.00 3.00 2.25 1.33

156-AH 7.00 11.00 18.50 20.00 21.00 15.80 5.33 9.00 14.00 0.34 14.68 13.35 4.56 7.00 21.00 15.80 5.33 157-AH 70.00 104.50 125.00 134.50 139.00 120.50 17.67 30.00 69.00 0.15 119.06 117.37 13.80 70.00 139.00 120.50 17.67 158-AH 1.00 23.00 32.00 33.00 34.00 28.05 7.82 10.00 33.00 0.28 24.58 12.03 5.74 22.00 34.00 29.47 4.67 159-AH 12.00 30.50 45.00 50.50 54.00 41.50 11.89 20.00 42.00 0.29 39.29 36.15 9.50 12.00 54.00 41.50 11.89

160-AH 1.00 1.50 2.00 2.00 2.00 1.75 0.44 0.50 1.00 0.25 1.68 1.60 0.38 1.00 2.00 1.75 0.44

161-AH 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00

162-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

163-AH 54.00 88.00 120.00 121.00 121.00 104.55 27.63 33.00 67.00 0.26 100.07 94.65 23.28 54.00 121.00 104.55 27.63 164-AH 2.00 11.50 22.50 25.00 27.00 18.40 9.63 13.50 25.00 0.52 13.28 7.14 8.00 2.00 27.00 18.40 9.63

165-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

166-AH 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00

167-AH 0.00 2.50 5.00 5.00 5.00 3.90 1.86 2.50 5.00 0.48 1.86 0.00 1.55 0.00 5.00 3.90 1.86

168-AH 9.00 18.00 18.00 18.00 18.00 17.40 2.01 0.00 9.00 0.12 17.24 17.00 0.96 18.00 18.00 18.00 0.00

169-AH 1.00 2.00 4.00 5.00 6.00 3.60 1.85 3.00 5.00 0.51 3.02 2.40 1.58 1.00 6.00 3.60 1.85

170-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

171-AH 4.00 16.00 18.00 19.00 19.00 15.95 4.77 3.00 15.00 0.30 14.72 12.63 3.28 15.00 19.00 17.82 1.24

172-AH 6.00 7.00 7.00 7.00 7.00 6.90 0.31 0.00 1.00 0.04 6.89 6.89 0.18 7.00 7.00 7.00 0.00

173-AH 2.00 2.00 2.00 2.00 2.00 2.00 0.00 0.00 0.00 0.00 2.00 2.00 0.00 2.00 2.00 2.00 0.00

174-AH 2.00 2.00 2.00 2.00 2.00 2.00 0.00 0.00 0.00 0.00 2.00 2.00 0.00 2.00 2.00 2.00 0.00

175-AH 5.00 5.50 7.00 7.00 7.00 6.40 0.88 1.50 2.00 0.14 6.34 6.27 0.78 5.00 7.00 6.40 0.88

176-AH 29.00 39.00 39.00 39.00 39.00 38.50 2.24 0.00 10.00 0.06 38.43 38.34 0.95 39.00 39.00 39.00 0.00 177-AH 8.00 9.50 12.00 13.00 13.00 11.20 2.02 3.50 5.00 0.18 11.01 10.79 1.66 8.00 13.00 11.20 2.02

178-AH 0.00 1.50 3.00 4.00 4.00 2.60 1.35 2.50 4.00 0.52 0.75 0.00 1.12 0.00 4.00 2.60 1.35

179-AH 4.00 13.50 21.00 22.00 22.00 17.85 6.00 8.50 18.00 0.34 16.38 14.22 4.92 4.00 22.00 17.85 6.00 180-AH 12.00 27.00 36.00 40.00 40.00 32.55 9.76 13.00 28.00 0.30 30.59 27.97 7.88 12.00 40.00 32.55 9.76 181-AH 13.00 68.00 91.00 91.00 92.00 78.20 23.49 23.00 79.00 0.30 72.29 61.19 18.90 45.00 92.00 81.63 18.27

182-AH 3.00 4.00 4.00 4.00 4.00 3.90 0.31 0.00 1.00 0.08 3.89 3.87 0.18 4.00 4.00 4.00 0.00

183-AH 1.00 2.50 4.00 4.00 4.00 3.25 1.33 1.50 3.00 0.41 2.83 2.29 1.12 1.00 4.00 3.25 1.33

184-AH 4.00 7.00 9.00 9.00 9.00 8.15 1.31 2.00 5.00 0.16 8.02 7.85 1.02 4.00 9.00 8.15 1.31

185-AH 0.00 1.00 1.00 1.00 1.00 0.95 0.22 0.00 1.00 0.24 0.56 0.00 0.10 1.00 1.00 1.00 0.00

186-AH 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00

187-AH 0.00 1.00 1.00 1.00 1.00 0.90 0.31 0.00 1.00 0.34 0.32 0.00 0.18 1.00 1.00 1.00 0.00

188-AH 0.00 0.00 1.00 1.00 1.00 0.70 0.47 1.00 1.00 0.67 0.03 0.00 0.42 0.00 1.00 0.70 0.47

189-AH 0.00 3.50 7.00 7.00 7.00 5.25 3.11 3.50 7.00 0.59 0.24 0.00 2.62 0.00 7.00 5.25 3.11

190-AH 5.00 7.00 7.00 8.00 9.00 7.25 0.79 1.00 4.00 0.11 7.21 7.16 0.55 7.00 9.00 7.37 0.60

(22)

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

191-AH 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00

192-AH 4.00 4.00 6.00 6.00 6.00 5.35 0.93 2.00 2.00 0.17 5.26 5.17 0.84 4.00 6.00 5.35 0.93

193-AH 3.00 5.00 7.00 7.00 7.00 6.00 1.78 2.00 4.00 0.30 5.66 5.25 1.50 3.00 7.00 6.00 1.78

194-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

195-AH 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00

196-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

197-AH 3.00 46.50 50.00 50.00 50.00 45.30 11.03 3.50 47.00 0.24 41.17 27.10 6.85 44.00 50.00 49.50 1.51

198-AH 0.00 0.50 1.00 1.00 1.00 0.75 0.44 0.50 1.00 0.59 0.06 0.00 0.38 0.00 1.00 0.75 0.44

199-AH 7.00 9.50 10.00 10.00 10.00 9.60 0.82 0.50 3.00 0.09 9.56 9.52 0.60 9.00 10.00 9.83 0.38

200-AH 6.00 8.00 9.00 9.00 9.00 8.45 1.00 1.00 3.00 0.12 8.39 8.32 0.83 7.00 9.00 8.58 0.84

251-AH 21.00 38.50 56.50 60.00 61.00 49.15 15.52 21.50 40.00 0.32 45.99 42.10 12.88 21.00 61.00 49.15 15.52 252-AH 25.00 28.00 28.50 29.00 29.00 28.15 1.14 1.00 4.00 0.04 28.13 28.10 0.85 27.00 29.00 28.44 0.70 253-AH 14.00 64.00 109.50 140.00 153.00 103.30 41.88 76.00 139.00 0.41 91.43 72.64 36.00 14.00 153.00 103.30 41.88 254-AH 5.00 61.00 145.00 172.00 189.00 119.35 63.61 111.00 184.00 0.53 87.76 42.61 53.48 5.00 189.00 119.35 63.61

255-AH 3.00 4.00 4.00 4.00 4.00 3.90 0.31 0.00 1.00 0.08 3.89 3.87 0.18 4.00 4.00 4.00 0.00

256-AH 4.00 30.00 34.00 34.00 34.00 30.45 7.37 4.00 30.00 0.24 28.44 23.26 4.57 24.00 34.00 32.56 2.66 257-AH 39.00 52.50 54.50 59.00 62.00 54.60 5.65 6.50 23.00 0.10 54.30 53.97 4.20 47.00 62.00 55.42 4.41

258-AH 1.00 2.00 2.00 3.00 4.00 2.45 1.05 1.00 3.00 0.43 2.21 1.97 0.89 1.00 4.00 2.45 1.05

259-AH 2.00 3.00 3.00 3.00 3.00 2.85 0.37 0.00 1.00 0.13 2.82 2.79 0.26 3.00 3.00 3.00 0.00

260-AH 18.00 52.00 62.00 62.00 62.00 55.40 12.55 10.00 44.00 0.23 53.39 50.29 9.80 39.00 62.00 58.56 7.82 261-AH 11.00 14.50 19.00 21.00 24.00 17.70 4.16 6.50 13.00 0.23 17.20 16.68 3.63 11.00 24.00 17.70 4.16 262-AH 13.00 46.50 57.50 66.00 80.00 55.00 16.75 19.50 67.00 0.30 51.60 46.38 13.20 31.00 80.00 57.21 13.89 263-AH 4.00 19.00 39.00 46.50 47.00 32.80 15.08 27.50 43.00 0.46 27.77 20.69 13.22 4.00 47.00 32.80 15.08 264-AH 9.00 17.50 20.50 21.00 22.00 19.15 3.41 3.50 13.00 0.18 18.78 18.29 2.59 15.00 22.00 19.68 2.50

265-AH 3.00 4.50 6.00 6.00 6.00 5.35 0.99 1.50 3.00 0.18 5.25 5.13 0.84 3.00 6.00 5.35 0.99

266-AH 0.00 1.00 2.50 4.00 4.00 2.40 1.64 3.00 4.00 0.68 0.13 0.00 1.40 0.00 4.00 2.40 1.64

267-AH 14.00 19.00 20.00 21.00 21.00 19.65 1.69 2.00 7.00 0.09 19.57 19.48 1.22 18.00 21.00 19.95 1.08

268-AH 2.00 3.00 3.00 3.00 3.00 2.80 0.41 0.00 1.00 0.15 2.77 2.73 0.32 3.00 3.00 3.00 0.00

269-AH 4.00 7.50 8.00 8.00 8.00 7.45 1.10 0.50 4.00 0.15 7.35 7.23 0.82 7.00 8.00 7.94 0.25

270-AH 20.00 52.00 55.50 56.50 57.00 53.15 8.06 4.50 37.00 0.15 52.16 50.43 3.99 51.00 57.00 54.89 2.08 271-AH 3.00 18.00 24.00 24.00 24.00 20.85 5.42 6.00 21.00 0.26 19.46 16.20 4.01 13.00 24.00 21.79 3.52 272-AH 1.00 11.00 13.00 14.00 14.00 12.20 3.05 3.00 13.00 0.25 11.17 7.97 2.02 10.00 14.00 12.79 1.58 273-AH 21.00 45.50 80.00 81.50 83.00 66.50 21.18 36.00 62.00 0.32 62.14 56.51 18.45 21.00 83.00 66.50 21.18 274-AH 4.00 11.50 14.00 16.00 16.00 13.20 3.52 4.50 12.00 0.27 12.55 11.61 2.72 7.00 16.00 13.68 2.85 275-AH 11.00 29.50 57.00 63.00 66.00 48.45 20.21 33.50 55.00 0.42 42.20 34.16 17.07 11.00 66.00 48.45 20.21 276-AH 41.00 48.00 56.00 59.00 59.00 53.60 6.46 11.00 18.00 0.12 53.20 52.77 5.42 41.00 59.00 53.60 6.46 277-AH 2.00 10.00 16.50 19.00 22.00 14.25 6.08 9.00 20.00 0.43 12.16 9.07 4.85 2.00 22.00 14.25 6.08 278-AH 5.00 10.00 14.50 18.50 21.00 14.25 4.81 8.50 16.00 0.34 13.39 12.42 4.05 5.00 21.00 14.25 4.81

279-AH 0.00 2.50 4.00 4.00 4.00 3.30 1.22 1.50 4.00 0.37 1.74 0.00 0.98 1.00 4.00 3.47 0.96

280-AH 6.00 12.00 17.00 19.00 22.00 15.25 4.63 7.00 16.00 0.30 14.44 13.48 4.02 6.00 22.00 15.25 4.63 281-AH 27.00 41.00 42.00 42.00 42.00 40.45 3.43 1.00 15.00 0.08 40.28 40.07 1.98 41.00 42.00 41.69 0.48 282-AH 10.00 20.00 28.00 30.00 31.00 24.80 6.78 10.00 21.00 0.27 23.66 22.25 5.48 10.00 31.00 24.80 6.78 283-AH 12.00 20.50 24.00 31.00 36.00 25.20 7.26 10.50 24.00 0.29 24.11 22.92 5.94 12.00 36.00 25.20 7.26 284-AH 0.00 24.00 38.00 38.00 38.00 30.20 13.98 14.00 38.00 0.46 13.19 0.00 11.70 8.00 38.00 31.79 12.36 285-AH 33.00 48.50 63.00 67.50 68.00 58.55 10.44 19.00 35.00 0.18 57.54 56.40 9.14 33.00 68.00 58.55 10.44 286-AH 1.00 5.00 8.50 9.00 10.00 7.10 2.73 4.00 9.00 0.38 6.34 5.10 2.39 1.00 10.00 7.10 2.73 287-AH 5.00 36.00 48.00 48.00 49.00 40.80 12.24 12.00 44.00 0.30 37.33 29.64 9.50 22.00 49.00 42.68 9.12 288-AH 22.00 36.50 46.50 60.00 71.00 48.95 14.46 23.50 49.00 0.30 46.84 44.64 12.04 22.00 71.00 48.95 14.46 289-AH 5.00 15.50 18.00 18.00 18.00 16.20 3.33 2.50 13.00 0.21 15.68 14.79 2.40 12.00 18.00 16.79 2.10 290-AH 12.00 26.50 46.50 49.00 49.00 38.65 13.14 22.50 37.00 0.34 35.75 32.09 11.16 12.00 49.00 38.65 13.14

(23)

Statistics for Number of relevant retrieved documents

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

291-AH 18.00 25.50 27.50 28.00 29.00 26.15 2.83 2.50 11.00 0.11 25.98 25.80 2.12 22.00 29.00 26.58 2.14

292-AH 4.00 4.00 4.00 4.00 4.00 4.00 0.00 0.00 0.00 0.00 4.00 4.00 0.00 4.00 4.00 4.00 0.00

293-AH 20.00 27.50 34.00 34.00 34.00 30.75 5.67 6.50 14.00 0.18 30.16 29.49 4.78 20.00 34.00 30.75 5.67 294-AH 1.00 18.00 27.00 27.00 27.00 22.05 8.94 9.00 26.00 0.41 18.27 9.93 7.42 8.00 27.00 23.16 7.65 295-AH 18.00 30.00 35.50 41.00 50.00 35.45 9.07 11.00 32.00 0.26 34.24 32.92 7.05 18.00 50.00 35.45 9.07 296-AH 1.00 16.00 24.00 24.00 24.00 20.35 6.11 8.00 23.00 0.30 17.96 10.35 4.71 14.00 24.00 21.37 4.18 297-AH 6.00 10.00 11.00 12.00 12.00 10.55 1.88 2.00 6.00 0.18 10.36 10.14 1.48 7.00 12.00 10.79 1.58 298-AH 9.00 17.00 27.50 28.50 30.00 23.20 8.51 11.50 21.00 0.37 21.02 18.28 7.10 9.00 30.00 23.20 8.51 299-AH 25.00 60.00 70.50 74.50 76.00 65.55 13.04 14.50 51.00 0.20 63.81 61.25 9.73 49.00 76.00 67.68 9.12 300-AH 3.00 28.50 42.00 42.00 42.00 33.45 15.15 13.50 39.00 0.45 26.82 16.96 12.62 17.00 42.00 40.31 6.24 301-AH 1.00 4.00 4.50 5.50 16.00 5.95 3.80 1.50 15.00 0.64 5.06 4.21 2.72 4.00 6.00 4.47 0.64 302-AH 8.00 13.50 17.00 17.00 17.00 15.20 2.82 3.50 9.00 0.19 14.89 14.52 2.34 10.00 17.00 15.58 2.32 303-AH 9.00 10.00 11.50 14.00 14.00 11.85 1.84 4.00 5.00 0.16 11.71 11.57 1.65 9.00 14.00 11.85 1.84 304-AH 1.00 4.00 11.50 13.50 15.00 9.40 5.10 9.50 14.00 0.54 7.20 4.60 4.42 1.00 15.00 9.40 5.10 305-AH 15.00 29.50 59.50 61.00 61.00 48.05 17.07 31.50 46.00 0.36 44.14 39.30 14.64 15.00 61.00 48.05 17.07

306-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

307-AH 20.00 37.50 54.00 67.00 75.00 52.55 16.73 29.50 55.00 0.32 49.60 46.23 14.00 20.00 75.00 52.55 16.73 308-AH 6.00 8.50 10.00 10.00 11.00 9.25 1.86 1.50 5.00 0.20 9.04 8.80 1.52 7.00 11.00 10.06 0.93 309-AH 7.00 8.00 10.00 10.00 10.00 9.20 1.06 2.00 3.00 0.11 9.14 9.07 0.96 7.00 10.00 9.20 1.06 310-AH 8.00 14.50 31.00 40.00 48.00 27.45 14.17 25.50 40.00 0.52 23.28 19.04 12.60 8.00 48.00 27.45 14.17 311-AH 30.00 41.00 47.00 50.00 52.00 45.55 5.75 9.00 22.00 0.13 45.17 44.73 4.59 30.00 52.00 45.55 5.75 312-AH 4.00 19.00 31.00 31.00 31.00 24.25 9.85 12.00 27.00 0.41 21.03 16.35 8.18 4.00 31.00 24.25 9.85 313-AH 5.00 9.00 13.50 16.00 17.00 12.30 3.96 7.00 12.00 0.32 11.58 10.76 3.47 5.00 17.00 12.30 3.96 314-AH 3.00 11.50 17.00 17.00 17.00 14.20 4.82 5.50 14.00 0.34 12.97 11.15 4.00 7.00 17.00 14.79 4.14 315-AH 12.00 21.50 47.50 55.00 58.00 41.45 16.91 33.50 46.00 0.41 36.92 31.51 14.51 12.00 58.00 41.45 16.91 316-AH 1.00 18.00 81.00 92.50 106.00 64.65 38.22 74.50 105.00 0.59 41.49 11.40 34.05 1.00 106.00 64.65 38.22 317-AH 18.00 22.50 27.00 29.00 30.00 25.55 4.10 6.50 12.00 0.16 25.21 24.84 3.49 18.00 30.00 25.55 4.10

318-AH 2.00 8.50 9.00 9.00 9.00 8.05 2.11 0.50 7.00 0.26 7.58 6.78 1.42 8.00 9.00 8.88 0.33

319-AH 10.00 11.00 13.50 15.00 18.00 13.50 2.33 4.00 8.00 0.17 13.31 13.11 2.00 10.00 18.00 13.50 2.33 320-AH 3.00 7.00 10.00 11.00 11.00 9.20 2.44 4.00 8.00 0.27 8.77 8.17 2.02 3.00 11.00 9.20 2.44

321-AH 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 N/D 0.00 0.00 0.00 0.00 0.00 0.00 0.00

322-AH 6.00 6.50 9.00 11.00 14.00 9.05 2.67 4.50 8.00 0.29 8.69 8.35 2.16 6.00 14.00 9.05 2.67 323-AH 7.00 18.00 22.00 24.50 26.00 21.05 4.48 6.50 19.00 0.21 20.40 19.37 3.34 17.00 26.00 21.79 3.10 324-AH 9.00 31.00 45.50 67.50 70.00 47.70 20.08 36.50 61.00 0.42 42.68 36.19 18.40 9.00 70.00 47.70 20.08 325-AH 45.00 57.00 59.00 59.50 60.00 56.95 4.54 2.50 15.00 0.08 56.76 56.56 3.38 57.00 60.00 59.06 0.93

326-AH 0.00 2.00 3.00 3.00 4.00 2.65 1.04 1.00 4.00 0.39 1.41 0.00 0.79 1.00 4.00 2.79 0.85

327-AH 0.00 1.00 3.00 4.00 4.00 2.70 1.49 3.00 4.00 0.55 0.76 0.00 1.29 0.00 4.00 2.70 1.49

328-AH 13.00 22.00 23.00 23.00 23.00 22.05 2.33 1.00 10.00 0.11 21.90 21.69 1.42 21.00 23.00 22.67 0.77 329-AH 13.00 17.00 17.00 17.00 17.00 16.65 0.93 0.00 4.00 0.06 16.62 16.59 0.56 17.00 17.00 17.00 0.00 330-AH 10.00 44.00 49.00 51.00 51.00 46.30 9.19 7.00 41.00 0.20 44.45 40.30 5.38 42.00 51.00 48.21 3.49 331-AH 12.00 16.00 17.00 17.00 17.00 16.15 1.60 1.00 5.00 0.10 16.07 15.97 1.28 15.00 17.00 16.88 0.50

332-AH 1.00 8.00 8.00 8.00 8.00 7.50 1.57 0.00 7.00 0.21 7.07 5.83 0.80 8.00 8.00 8.00 0.00

333-AH 2.00 5.00 5.00 5.00 5.00 4.85 0.67 0.00 3.00 0.14 4.78 4.65 0.29 5.00 5.00 5.00 0.00

334-AH 4.00 5.00 5.00 5.00 5.00 4.95 0.22 0.00 1.00 0.05 4.94 4.94 0.09 5.00 5.00 5.00 0.00

335-AH 10.00 13.00 13.00 14.50 15.00 13.30 1.30 1.50 5.00 0.10 13.24 13.17 0.99 12.00 15.00 13.47 1.07 336-AH 4.00 8.50 11.50 13.00 15.00 10.80 3.38 4.50 11.00 0.31 10.18 9.44 2.66 4.00 15.00 10.80 3.38 337-AH 5.00 9.00 20.00 20.00 20.00 15.65 6.57 11.00 15.00 0.42 13.64 11.15 5.66 5.00 20.00 15.65 6.57 338-AH 6.00 9.00 10.00 10.00 10.00 9.35 1.09 1.00 4.00 0.12 9.28 9.20 0.84 8.00 10.00 9.53 0.77 339-AH 14.00 19.00 19.00 19.00 19.00 18.70 1.13 0.00 5.00 0.06 18.66 18.62 0.54 19.00 19.00 19.00 0.00

340-AH 5.00 5.00 5.00 5.00 5.00 5.00 0.00 0.00 0.00 0.00 5.00 5.00 0.00 5.00 5.00 5.00 0.00

(24)

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

341-AH 4.00 6.00 6.00 6.00 6.00 5.80 0.62 0.00 2.00 0.11 5.76 5.71 0.36 6.00 6.00 6.00 0.00

342-AH 52.00 76.50 92.00 95.00 96.00 84.40 15.28 18.50 44.00 0.18 82.86 81.08 12.50 52.00 96.00 84.40 15.28

343-AH 1.00 1.00 1.00 1.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 1.00 1.00 0.00

344-AH 23.00 27.50 33.00 33.00 33.00 30.45 3.98 5.50 10.00 0.13 30.18 29.87 3.33 23.00 33.00 30.45 3.98

345-AH 3.00 5.50 9.00 9.00 9.00 7.30 2.41 3.50 6.00 0.33 6.79 6.17 2.11 3.00 9.00 7.30 2.41

346-AH 7.00 8.00 11.00 11.00 11.00 9.70 1.66 3.00 4.00 0.17 9.55 9.40 1.49 7.00 11.00 9.70 1.66

347-AH 6.00 6.00 8.00 8.00 9.00 7.40 1.05 2.00 3.00 0.14 7.33 7.25 0.92 6.00 9.00 7.40 1.05

348-AH 0.00 2.00 2.00 2.00 2.00 1.90 0.45 0.00 2.00 0.24 1.09 0.00 0.19 2.00 2.00 2.00 0.00

349-AH 23.00 26.00 27.00 27.00 27.00 26.40 1.05 1.00 4.00 0.04 26.38 26.36 0.78 25.00 27.00 26.58 0.69 350-AH 4.00 8.00 10.00 10.00 10.00 9.05 1.54 2.00 6.00 0.17 8.88 8.64 1.14 7.00 10.00 9.32 1.00

(25)

AH-ROBUST-CLEF2008 Track Overview Results and Graphs AH-ROBUST-MONO-EN-TEST-CLEF2008

Statistics for Average Precsion

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

141-AH 0.0000 0.5000 1.0000 1.0000 1.0000 0.7500 0.4443 0.5000 1.0000 0.5923 0.0562 0.0000 0.3750 0.0000 1.0000 0.7500 0.4443 142-AH 0.2661 0.7277 0.8921 0.9386 1.0000 0.8144 0.2057 0.2110 0.7339 0.2526 0.7789 0.7275 0.1591 0.4679 1.0000 0.8433 0.1646 143-AH 0.0051 0.3013 0.6779 0.7607 0.8865 0.5541 0.3094 0.4595 0.8814 0.5583 0.3344 0.0628 0.2584 0.0051 0.8865 0.5541 0.3094 144-AH 0.0011 0.0452 0.3611 0.4662 0.7556 0.3228 0.2349 0.4210 0.7545 0.7276 0.1523 0.0165 0.1878 0.0011 0.7556 0.3228 0.2349 145-AH 0.0179 0.2263 0.4370 0.6200 0.7198 0.4134 0.2425 0.3937 0.7019 0.5866 0.2795 0.1237 0.1897 0.0179 0.7198 0.4134 0.2425 146-AH 0.0072 0.0673 0.1756 0.2674 0.5062 0.2137 0.1729 0.2001 0.4990 0.8090 0.1325 0.0573 0.1400 0.0072 0.5062 0.2137 0.1729 147-AH 0.0830 0.3023 0.5581 0.6844 0.8399 0.5173 0.2366 0.3821 0.7569 0.4573 0.4443 0.3480 0.1957 0.0830 0.8399 0.5173 0.2366 148-AH 0.0093 0.0562 0.1162 0.1932 0.1971 0.1180 0.0707 0.1370 0.1878 0.5994 0.0902 0.0576 0.0640 0.0093 0.1971 0.1180 0.0707 149-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 150-AH 0.0000 0.0145 0.0756 0.1449 0.1650 0.0742 0.0597 0.1303 0.1650 0.8038 0.0120 0.0000 0.0491 0.0000 0.1650 0.0742 0.0597 151-AH 0.0002 0.0364 0.0746 0.1754 0.3922 0.1114 0.1019 0.1390 0.3920 0.9149 0.0611 0.0040 0.0817 0.0002 0.2514 0.0966 0.0797 152-AH 0.0030 0.2779 0.5227 0.5829 0.8259 0.4511 0.2073 0.3050 0.8228 0.4595 0.3324 0.0522 0.1654 0.0030 0.8259 0.4511 0.2073 153-AH 0.0000 0.0000 0.0000 0.0030 0.0227 0.0043 0.0074 0.0030 0.0227 1.7125 0.0002 0.0000 0.0056 0.0000 0.0033 0.0008 0.0013 154-AH 0.0962 0.2633 0.3331 0.3732 0.4169 0.3089 0.0868 0.1099 0.3207 0.2809 0.2936 0.2728 0.0710 0.1985 0.4169 0.3201 0.0728 155-AH 0.0000 0.0122 0.0923 0.1627 0.3768 0.1103 0.1050 0.1504 0.3768 0.9515 0.0115 0.0000 0.0799 0.0000 0.3768 0.1103 0.1050 156-AH 0.0074 0.0259 0.0769 0.0960 0.1679 0.0721 0.0461 0.0701 0.1606 0.6401 0.0519 0.0308 0.0351 0.0074 0.1679 0.0721 0.0461 157-AH 0.1388 0.3722 0.4454 0.5667 0.7063 0.4478 0.1563 0.1946 0.5675 0.3489 0.4164 0.3776 0.1130 0.1388 0.7063 0.4478 0.1563 158-AH 0.0001 0.1346 0.3247 0.4746 0.6300 0.3044 0.1879 0.3399 0.6299 0.6171 0.1673 0.0015 0.1614 0.0001 0.6300 0.3044 0.1879 159-AH 0.0021 0.0592 0.1299 0.3537 0.6580 0.2208 0.2333 0.2945 0.6559 1.0566 0.1102 0.0278 0.1907 0.0021 0.6580 0.2208 0.2333 160-AH 0.0017 0.0219 0.0478 0.0673 0.1769 0.0585 0.0547 0.0454 0.1752 0.9359 0.0287 0.0082 0.0377 0.0017 0.0731 0.0382 0.0255 161-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 162-AH 0.0080 0.0595 0.2917 0.5000 1.0000 0.3163 0.2597 0.4405 0.9920 0.8211 0.1841 0.0717 0.2171 0.0080 1.0000 0.3163 0.2597 163-AH 0.0681 0.3865 0.8069 0.8632 0.9024 0.6403 0.3185 0.4768 0.8343 0.4975 0.4893 0.2897 0.2670 0.0681 0.9024 0.6403 0.3185 164-AH 0.0006 0.0188 0.0603 0.0825 0.3667 0.0831 0.0963 0.0637 0.3660 1.1592 0.0282 0.0038 0.0663 0.0006 0.1509 0.0482 0.0398 165-AH 0.0065 0.3333 0.5000 1.0000 1.0000 0.6003 0.3256 0.6667 0.9935 0.5424 0.4478 0.1042 0.2798 0.0065 1.0000 0.6003 0.3256 166-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 167-AH 0.0000 0.0086 0.0882 0.1438 0.2828 0.0917 0.0864 0.1352 0.2828 0.9419 0.0245 0.0002 0.0678 0.0000 0.2828 0.0917 0.0864 168-AH 0.0389 0.2687 0.3634 0.4004 0.4583 0.3231 0.1155 0.1316 0.4193 0.3574 0.2882 0.2227 0.0890 0.1170 0.4583 0.3381 0.0967 169-AH 0.0008 0.0045 0.0296 0.0571 0.1667 0.0396 0.0421 0.0526 0.1659 1.0636 0.0182 0.0052 0.0312 0.0008 0.1005 0.0329 0.0305 170-AH 0.0029 0.5000 1.0000 1.0000 1.0000 0.7527 0.3748 0.5000 0.9971 0.4979 0.4437 0.0425 0.3214 0.0029 1.0000 0.7527 0.3748 171-AH 0.0016 0.0436 0.0702 0.1236 0.1995 0.0853 0.0612 0.0800 0.1979 0.7179 0.0517 0.0122 0.0477 0.0016 0.1995 0.0853 0.0612 172-AH 0.0256 0.0599 0.0954 0.1236 0.2058 0.0951 0.0485 0.0637 0.1802 0.5095 0.0830 0.0704 0.0367 0.0256 0.2058 0.0951 0.0485 173-AH 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 0.0000 0.0000 0.0000 0.0000 1.0000 1.0000 0.0000 1.0000 1.0000 1.0000 0.0000 174-AH 0.2583 0.7812 1.0000 1.0000 1.0000 0.8567 0.2645 0.2188 0.7417 0.3088 0.7959 0.7061 0.2150 0.5016 1.0000 0.9231 0.1772 175-AH 0.3038 0.5564 0.7180 0.8119 0.8874 0.6766 0.1761 0.2555 0.5836 0.2602 0.6501 0.6184 0.1379 0.3038 0.8874 0.6766 0.1761 176-AH 0.4959 0.6777 0.8285 0.9013 0.9470 0.7942 0.1313 0.2236 0.4511 0.1653 0.7828 0.7703 0.1100 0.4959 0.9470 0.7942 0.1313 177-AH 0.0576 0.1252 0.1295 0.1842 0.6192 0.1976 0.1610 0.0590 0.5617 0.8147 0.1586 0.1358 0.1186 0.0576 0.2369 0.1260 0.0369 178-AH 0.0000 0.0054 0.0150 0.1041 0.4405 0.0765 0.1201 0.0987 0.4405 1.5713 0.0094 0.0001 0.0882 0.0000 0.1523 0.0323 0.0459 179-AH 0.0019 0.0840 0.3073 0.6505 0.8881 0.3486 0.2827 0.5665 0.8863 0.8112 0.1606 0.0234 0.2359 0.0019 0.8881 0.3486 0.2827 180-AH 0.0073 0.0956 0.2584 0.6331 0.7285 0.3322 0.2731 0.5375 0.7212 0.8221 0.1998 0.0762 0.2416 0.0073 0.7285 0.3322 0.2731 181-AH 0.0023 0.3427 0.7587 0.8394 0.8762 0.6176 0.2832 0.4967 0.8739 0.4585 0.4393 0.0419 0.2444 0.0023 0.8762 0.6176 0.2832 182-AH 0.0427 0.0591 0.1517 0.3552 0.5095 0.2182 0.1587 0.2961 0.4668 0.7270 0.1562 0.1074 0.1449 0.0427 0.5095 0.2182 0.1587 183-AH 0.0014 0.0121 0.0227 0.0852 0.4770 0.0765 0.1151 0.0731 0.4756 1.5039 0.0295 0.0101 0.0779 0.0014 0.1869 0.0384 0.0473 184-AH 0.0036 0.3032 0.4422 0.5728 0.6427 0.4221 0.1788 0.2696 0.6391 0.4237 0.3271 0.0610 0.1489 0.0036 0.6427 0.4221 0.1788 185-AH 0.0000 0.0470 0.1833 0.4167 1.0000 0.2529 0.2506 0.3697 1.0000 0.9910 0.0670 0.0002 0.1896 0.0000 0.5000 0.2136 0.1835 186-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 187-AH 0.0000 0.0909 0.1250 0.2917 1.0000 0.1980 0.2178 0.2008 1.0000 1.0998 0.0620 0.0001 0.1397 0.0000 0.3333 0.1558 0.1115 188-AH 0.0000 0.0000 0.0068 0.0272 0.1000 0.0215 0.0324 0.0272 0.1000 1.5070 0.0017 0.0000 0.0255 0.0000 0.0588 0.0098 0.0161 189-AH 0.0000 0.3138 0.8522 0.9088 0.9617 0.6518 0.3926 0.5951 0.9617 0.6023 0.0504 0.0000 0.3283 0.0000 0.9617 0.6518 0.3926 190-AH 0.0381 0.3633 0.4880 0.7269 0.7802 0.5023 0.2512 0.3636 0.7421 0.5001 0.3984 0.2459 0.2049 0.0381 0.7802 0.5023 0.2512

(26)

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 191-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 192-AH 0.0269 0.1916 0.4107 0.5685 0.8656 0.4171 0.2683 0.3769 0.8387 0.6432 0.3066 0.1746 0.2063 0.0269 0.8656 0.4171 0.2683 193-AH 0.2612 0.3715 0.4489 0.4731 0.7498 0.4436 0.1340 0.1016 0.4886 0.3021 0.4253 0.4074 0.0858 0.2612 0.5475 0.4096 0.0884 194-AH 0.0031 0.1548 0.2500 1.0000 1.0000 0.4543 0.4179 0.8452 0.9969 0.9198 0.2287 0.0430 0.3820 0.0031 1.0000 0.4543 0.4179 195-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 196-AH 0.0033 0.5000 0.5000 0.5000 1.0000 0.5152 0.3011 0.0000 0.9967 0.5844 0.3512 0.0559 0.1939 0.5000 0.5000 0.5000 0.0000 197-AH 0.0002 0.4457 0.5444 0.6360 0.8836 0.5251 0.2112 0.1903 0.8834 0.4023 0.3561 0.0049 0.1516 0.2257 0.8836 0.5527 0.1761 198-AH 0.0000 0.0192 0.5000 1.0000 1.0000 0.5249 0.4633 0.9808 1.0000 0.8827 0.0330 0.0000 0.4276 0.0000 1.0000 0.5249 0.4633 199-AH 0.0164 0.3779 0.6328 0.6779 0.7315 0.5286 0.2117 0.3000 0.7151 0.4004 0.4270 0.1855 0.1708 0.0164 0.7315 0.5286 0.2117 200-AH 0.0569 0.0858 0.2725 0.4028 0.7090 0.2743 0.2011 0.3171 0.6521 0.7331 0.1986 0.1383 0.1610 0.0569 0.7090 0.2743 0.2011 251-AH 0.0301 0.2959 0.5162 0.5619 0.6087 0.4180 0.2050 0.2660 0.5786 0.4905 0.3104 0.1537 0.1659 0.0301 0.6087 0.4180 0.2050 252-AH 0.1358 0.2291 0.3273 0.4934 0.5848 0.3473 0.1420 0.2643 0.4490 0.4089 0.3179 0.2886 0.1259 0.1358 0.5848 0.3473 0.1420 253-AH 0.0027 0.0919 0.2214 0.3161 0.4726 0.2207 0.1452 0.2242 0.4698 0.6576 0.1468 0.0375 0.1216 0.0027 0.4726 0.2207 0.1452 254-AH 0.0003 0.0352 0.1831 0.2203 0.3313 0.1485 0.1074 0.1851 0.3310 0.7234 0.0578 0.0039 0.0937 0.0003 0.3313 0.1485 0.1074 255-AH 0.0364 0.1025 0.2722 0.4559 0.6179 0.3022 0.1904 0.3533 0.5815 0.6299 0.2265 0.1497 0.1604 0.0364 0.6179 0.3022 0.1904 256-AH 0.0007 0.5702 0.7750 0.8742 0.9097 0.7018 0.2204 0.3040 0.9091 0.3141 0.5098 0.0133 0.1668 0.4720 0.9097 0.7387 0.1501 257-AH 0.1076 0.1731 0.2109 0.2664 0.3035 0.2163 0.0591 0.0933 0.1959 0.2735 0.2077 0.1982 0.0476 0.1076 0.3035 0.2163 0.0591 258-AH 0.0008 0.0043 0.0077 0.0403 0.2094 0.0438 0.0720 0.0359 0.2086 1.6426 0.0113 0.0041 0.0562 0.0008 0.0640 0.0099 0.0150 259-AH 0.0096 0.3866 0.4887 0.6709 0.6823 0.4869 0.1780 0.2843 0.6727 0.3656 0.4040 0.1385 0.1371 0.0096 0.6823 0.4869 0.1780 260-AH 0.0069 0.4087 0.6118 0.6828 0.7514 0.5236 0.2201 0.2741 0.7445 0.4204 0.4083 0.1069 0.1740 0.0069 0.7514 0.5236 0.2201 261-AH 0.0213 0.0510 0.1307 0.1610 0.2784 0.1173 0.0709 0.1100 0.2571 0.6040 0.0940 0.0712 0.0578 0.0213 0.2784 0.1173 0.0709 262-AH 0.0050 0.0992 0.1509 0.2102 0.4528 0.1889 0.1397 0.1110 0.4478 0.7392 0.1351 0.0577 0.1045 0.0050 0.2102 0.1263 0.0610 263-AH 0.0037 0.0292 0.1355 0.2054 0.2623 0.1239 0.0934 0.1762 0.2586 0.7536 0.0661 0.0214 0.0812 0.0037 0.2623 0.1239 0.0934 264-AH 0.0302 0.2818 0.4659 0.6097 0.6819 0.4248 0.2174 0.3279 0.6517 0.5116 0.3327 0.1974 0.1827 0.0302 0.6819 0.4248 0.2174 265-AH 0.0052 0.0531 0.3368 0.5028 0.6944 0.3024 0.2357 0.4497 0.6892 0.7794 0.1426 0.0298 0.2047 0.0052 0.6944 0.3024 0.2357 266-AH 0.0000 0.0035 0.0159 0.0295 0.1225 0.0220 0.0274 0.0261 0.1225 1.2488 0.0033 0.0000 0.0167 0.0000 0.0521 0.0167 0.0143 267-AH 0.0133 0.1859 0.2475 0.3128 0.4589 0.2513 0.1071 0.1269 0.4456 0.4261 0.2124 0.1245 0.0777 0.0133 0.4589 0.2513 0.1071 268-AH 0.0264 0.1774 0.3922 0.6667 0.7101 0.3947 0.2444 0.4893 0.6837 0.6191 0.2814 0.1442 0.2054 0.0264 0.7101 0.3947 0.2444 269-AH 0.0258 0.1320 0.1681 0.2738 0.4503 0.2065 0.1113 0.1418 0.4246 0.5391 0.1763 0.1374 0.0872 0.0258 0.4503 0.2065 0.1113 270-AH 0.0232 0.5510 0.6645 0.7469 0.8140 0.6116 0.1890 0.1960 0.7908 0.3090 0.5318 0.2693 0.1366 0.3218 0.8140 0.6425 0.1321 271-AH 0.0482 0.2977 0.5098 0.5856 0.6310 0.4169 0.1949 0.2879 0.5828 0.4675 0.3450 0.2410 0.1697 0.0482 0.6310 0.4169 0.1949 272-AH 0.0051 0.1789 0.2611 0.2740 0.3343 0.2292 0.0880 0.0952 0.3292 0.3840 0.1884 0.0700 0.0685 0.1020 0.3343 0.2409 0.0724 273-AH 0.0577 0.1595 0.6446 0.7466 0.8791 0.5170 0.2948 0.5871 0.8214 0.5701 0.3739 0.2130 0.2561 0.0577 0.8791 0.5170 0.2948 274-AH 0.0074 0.1393 0.1981 0.3018 0.3952 0.2203 0.1086 0.1626 0.3878 0.4932 0.1771 0.0841 0.0890 0.0074 0.3952 0.2203 0.1086 275-AH 0.0168 0.0854 0.2388 0.3915 0.5197 0.2520 0.1626 0.3061 0.5029 0.6451 0.1852 0.1108 0.1401 0.0168 0.5197 0.2520 0.1626 276-AH 0.1182 0.1894 0.3378 0.3600 0.5087 0.3130 0.1172 0.1705 0.3905 0.3744 0.2902 0.2663 0.0944 0.1182 0.5087 0.3130 0.1172 277-AH 0.0008 0.0444 0.1293 0.1673 0.3538 0.1316 0.0900 0.1230 0.3531 0.6841 0.0877 0.0131 0.0692 0.0008 0.2883 0.1199 0.0753 278-AH 0.0041 0.0653 0.1326 0.2186 0.3542 0.1533 0.1110 0.1532 0.3501 0.7245 0.1038 0.0412 0.0895 0.0041 0.3542 0.1533 0.1110 279-AH 0.0000 0.0621 0.1062 0.2997 0.7615 0.1821 0.1875 0.2375 0.7615 1.0296 0.0640 0.0002 0.1448 0.0000 0.4162 0.1516 0.1322 280-AH 0.0050 0.0107 0.0307 0.0367 0.1018 0.0290 0.0215 0.0260 0.0968 0.7416 0.0221 0.0158 0.0141 0.0050 0.0418 0.0252 0.0134 281-AH 0.0351 0.2637 0.3111 0.4667 0.5891 0.3498 0.1445 0.2030 0.5541 0.4130 0.3070 0.2282 0.1190 0.0351 0.5891 0.3498 0.1445 282-AH 0.0184 0.0683 0.1460 0.2260 0.2912 0.1453 0.0891 0.1577 0.2728 0.6134 0.1066 0.0646 0.0723 0.0184 0.2912 0.1453 0.0891 283-AH 0.0105 0.0396 0.1547 0.2299 0.6792 0.1820 0.1934 0.1904 0.6687 1.0625 0.0971 0.0441 0.1386 0.0105 0.3661 0.1293 0.1110 284-AH 0.0000 0.2094 0.5166 0.5404 0.5919 0.3948 0.2270 0.3310 0.5919 0.5751 0.1553 0.0002 0.1910 0.0000 0.5919 0.3948 0.2270 285-AH 0.0552 0.2280 0.4537 0.7123 0.8339 0.4554 0.2603 0.4843 0.7787 0.5716 0.3582 0.2474 0.2191 0.0552 0.8339 0.4554 0.2603 286-AH 0.0002 0.0081 0.0257 0.0294 0.0399 0.0212 0.0117 0.0213 0.0396 0.5518 0.0149 0.0034 0.0099 0.0002 0.0399 0.0212 0.0117 287-AH 0.0005 0.1256 0.3710 0.4069 0.4651 0.2832 0.1661 0.2813 0.4646 0.5865 0.1595 0.0092 0.1435 0.0005 0.4651 0.2832 0.1661 288-AH 0.0095 0.0781 0.1233 0.2232 0.5463 0.1881 0.1720 0.1452 0.5368 0.9142 0.1233 0.0688 0.1290 0.0095 0.3444 0.1255 0.0860 289-AH 0.0030 0.4694 0.6158 0.7842 0.8692 0.5936 0.2294 0.3148 0.8662 0.3865 0.4571 0.0546 0.1842 0.0030 0.8692 0.5936 0.2294 290-AH 0.0049 0.0400 0.1570 0.2433 0.4092 0.1703 0.1230 0.2033 0.4043 0.7226 0.1034 0.0389 0.1016 0.0049 0.4092 0.1703 0.1230

(27)

Statistics for Average Precsion

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

291-AH 0.0255 0.1411 0.3697 0.5422 0.6287 0.3411 0.2142 0.4011 0.6032 0.6280 0.2343 0.1194 0.1876 0.0255 0.6287 0.3411 0.2142 292-AH 0.0118 0.2812 0.6149 0.7608 1.0000 0.5524 0.3515 0.4796 0.9882 0.6363 0.2907 0.0664 0.2711 0.0118 1.0000 0.5524 0.3515 293-AH 0.0695 0.3328 0.5434 0.6512 0.7228 0.4768 0.2317 0.3184 0.6533 0.4859 0.3791 0.2498 0.1854 0.0695 0.7228 0.4768 0.2317 294-AH 0.0001 0.2607 0.6287 0.6832 0.7540 0.4990 0.2579 0.4224 0.7539 0.5169 0.2839 0.0022 0.2174 0.0001 0.7540 0.4990 0.2579 295-AH 0.0712 0.1342 0.1628 0.2196 0.4190 0.1871 0.0930 0.0854 0.3478 0.4970 0.1677 0.1509 0.0705 0.0712 0.3070 0.1644 0.0642 296-AH 0.0001 0.1702 0.3604 0.4009 0.6393 0.3388 0.1786 0.2307 0.6392 0.5271 0.2097 0.0015 0.1411 0.0001 0.6393 0.3388 0.1786 297-AH 0.0391 0.1970 0.3759 0.3884 0.4897 0.3034 0.1329 0.1915 0.4506 0.4380 0.2606 0.1975 0.1126 0.0391 0.4897 0.3034 0.1329 298-AH 0.0081 0.0983 0.1912 0.2345 0.3565 0.1737 0.0905 0.1362 0.3484 0.5212 0.1302 0.0559 0.0740 0.0081 0.3565 0.1737 0.0905 299-AH 0.0194 0.1621 0.3822 0.4866 0.5838 0.3411 0.1875 0.3244 0.5644 0.5496 0.2641 0.1531 0.1626 0.0194 0.5838 0.3411 0.1875 300-AH 0.0016 0.0631 0.2132 0.2381 0.2950 0.1688 0.1039 0.1750 0.2934 0.6157 0.0827 0.0135 0.0876 0.0016 0.2950 0.1688 0.1039 301-AH 0.0001 0.0103 0.0185 0.0211 0.5170 0.0852 0.1581 0.0108 0.5168 1.8554 0.0193 0.0021 0.1143 0.0001 0.0211 0.0138 0.0072 302-AH 0.0488 0.1651 0.2490 0.3416 0.4401 0.2532 0.1112 0.1765 0.3914 0.4392 0.2216 0.1805 0.0955 0.0488 0.4401 0.2532 0.1112 303-AH 0.0480 0.1414 0.2359 0.3237 0.4397 0.2318 0.1107 0.1823 0.3917 0.4776 0.2008 0.1649 0.0951 0.0480 0.4397 0.2318 0.1107 304-AH 0.0002 0.0761 0.3014 0.3454 0.3880 0.2388 0.1497 0.2692 0.3878 0.6271 0.0572 0.0014 0.1279 0.0002 0.3880 0.2388 0.1497 305-AH 0.0066 0.0699 0.2408 0.3144 0.4818 0.2138 0.1397 0.2445 0.4753 0.6534 0.1365 0.0524 0.1149 0.0066 0.4818 0.2138 0.1397 306-AH 0.0125 0.1357 0.4167 1.0000 1.0000 0.5590 0.4262 0.8643 0.9875 0.7624 0.3042 0.0858 0.3969 0.0125 1.0000 0.5590 0.4262 307-AH 0.0090 0.0457 0.1275 0.1737 0.4041 0.1463 0.1221 0.1281 0.3950 0.8347 0.0938 0.0486 0.0915 0.0090 0.3640 0.1327 0.1088 308-AH 0.0076 0.4137 0.6753 0.7543 0.8395 0.5590 0.2931 0.3407 0.8319 0.5242 0.3698 0.0969 0.2413 0.0076 0.8395 0.5590 0.2931 309-AH 0.0321 0.0496 0.0818 0.0877 0.1514 0.0750 0.0325 0.0381 0.1193 0.4328 0.0685 0.0623 0.0260 0.0321 0.1326 0.0710 0.0278 310-AH 0.0063 0.0212 0.0500 0.0721 0.1167 0.0513 0.0353 0.0509 0.1105 0.6876 0.0369 0.0229 0.0289 0.0063 0.1167 0.0513 0.0353 311-AH 0.0391 0.1941 0.2385 0.2753 0.3772 0.2386 0.0739 0.0812 0.3381 0.3098 0.2217 0.1893 0.0521 0.1806 0.3772 0.2491 0.0586 312-AH 0.0007 0.1047 0.3267 0.5047 0.7196 0.3211 0.2428 0.4000 0.7189 0.7562 0.1378 0.0084 0.2162 0.0007 0.7196 0.3211 0.2428 313-AH 0.0034 0.0177 0.0726 0.1057 0.1316 0.0628 0.0469 0.0880 0.1281 0.7467 0.0387 0.0178 0.0418 0.0034 0.1316 0.0628 0.0469 314-AH 0.0047 0.0268 0.0551 0.0817 0.0990 0.0545 0.0323 0.0549 0.0944 0.5936 0.0396 0.0223 0.0280 0.0047 0.0990 0.0545 0.0323 315-AH 0.0035 0.0851 0.2873 0.4063 0.5332 0.2521 0.1701 0.3212 0.5297 0.6745 0.1374 0.0333 0.1459 0.0035 0.5332 0.2521 0.1701 316-AH 0.0001 0.0059 0.0921 0.1165 0.2312 0.0828 0.0707 0.1105 0.2310 0.8535 0.0314 0.0019 0.0567 0.0001 0.2312 0.0828 0.0707 317-AH 0.0715 0.1987 0.2154 0.2383 0.3007 0.2143 0.0498 0.0396 0.2291 0.2322 0.2065 0.1950 0.0333 0.1893 0.2637 0.2231 0.0239 318-AH 0.0019 0.0690 0.0839 0.1106 0.3657 0.0968 0.0764 0.0416 0.3638 0.7891 0.0666 0.0224 0.0459 0.0074 0.1513 0.0814 0.0334 319-AH 0.0988 0.1820 0.2163 0.3530 0.5108 0.2582 0.1189 0.1710 0.4120 0.4607 0.2331 0.2099 0.0976 0.0988 0.5108 0.2582 0.1189 320-AH 0.0053 0.0125 0.0245 0.0295 0.0879 0.0278 0.0225 0.0169 0.0826 0.8096 0.0208 0.0152 0.0146 0.0053 0.0452 0.0214 0.0114 321-AH 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 N/D 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 322-AH 0.0045 0.0196 0.0342 0.0420 0.0767 0.0330 0.0189 0.0224 0.0722 0.5747 0.0263 0.0184 0.0150 0.0045 0.0603 0.0307 0.0163 323-AH 0.0096 0.1376 0.2149 0.2487 0.3117 0.1952 0.0746 0.1111 0.3021 0.3824 0.1677 0.0963 0.0588 0.0096 0.3117 0.1952 0.0746 324-AH 0.0015 0.1397 0.2342 0.5216 0.5825 0.2929 0.2008 0.3819 0.5810 0.6858 0.1840 0.0249 0.1768 0.0015 0.5825 0.2929 0.2008 325-AH 0.1921 0.4122 0.5231 0.5717 0.6677 0.4896 0.1152 0.1595 0.4756 0.2353 0.4733 0.4519 0.0904 0.1921 0.6677 0.4896 0.1152 326-AH 0.0000 0.0397 0.1036 0.1910 0.5137 0.1591 0.1666 0.1512 0.5137 1.0470 0.0476 0.0002 0.1208 0.0000 0.2287 0.0970 0.0748 327-AH 0.0000 0.0025 0.0097 0.0729 0.6071 0.1228 0.2119 0.0704 0.6071 1.7248 0.0108 0.0001 0.1624 0.0000 0.0788 0.0213 0.0285 328-AH 0.1586 0.3209 0.4768 0.5239 0.5770 0.4227 0.1437 0.2030 0.4184 0.3399 0.3913 0.3526 0.1155 0.1586 0.5770 0.4227 0.1437 329-AH 0.2267 0.5303 0.6531 0.7294 0.7542 0.6264 0.1356 0.1991 0.5275 0.2164 0.6074 0.5798 0.1065 0.4966 0.7542 0.6475 0.1003 330-AH 0.0142 0.5299 0.6961 0.7574 0.8207 0.6182 0.2055 0.2275 0.8065 0.3324 0.5190 0.1956 0.1540 0.2518 0.8207 0.6500 0.1524 331-AH 0.0165 0.1781 0.1974 0.2515 0.4799 0.2036 0.1066 0.0734 0.4634 0.5238 0.1569 0.0858 0.0701 0.1754 0.3406 0.2208 0.0471 332-AH 0.0003 0.1154 0.3899 0.4395 0.5173 0.3095 0.1790 0.3242 0.5169 0.5782 0.1727 0.0064 0.1515 0.0003 0.5173 0.3095 0.1790 333-AH 0.0039 0.7933 1.0000 1.0000 1.0000 0.8561 0.2780 0.2067 0.9961 0.3248 0.6667 0.0711 0.2159 0.5000 1.0000 0.9009 0.1978 334-AH 0.0581 0.1413 0.2490 0.3630 0.5177 0.2649 0.1546 0.2216 0.4596 0.5837 0.2179 0.1719 0.1307 0.0581 0.5177 0.2649 0.1546 335-AH 0.0236 0.0954 0.1487 0.2071 0.2523 0.1422 0.0719 0.1117 0.2287 0.5055 0.1192 0.0897 0.0588 0.0236 0.2523 0.1422 0.0719 336-AH 0.0016 0.0108 0.0206 0.0589 0.3142 0.0769 0.1161 0.0480 0.3126 1.5099 0.0277 0.0118 0.0893 0.0016 0.0668 0.0211 0.0171 337-AH 0.0114 0.0976 0.7029 0.7573 0.8793 0.5050 0.3352 0.6597 0.8679 0.6637 0.3004 0.1029 0.3056 0.0114 0.8793 0.5050 0.3352 338-AH 0.0620 0.3790 0.5613 0.7956 0.8691 0.5568 0.2486 0.4166 0.8071 0.4465 0.4756 0.3505 0.2082 0.0620 0.8691 0.5568 0.2486 339-AH 0.1766 0.3956 0.5296 0.6597 0.8805 0.5302 0.1750 0.2641 0.7039 0.3301 0.5002 0.4655 0.1346 0.1766 0.8805 0.5302 0.1750 340-AH 0.1183 0.3000 0.3605 0.4527 0.8314 0.3971 0.1800 0.1527 0.7131 0.4534 0.3603 0.3238 0.1318 0.1183 0.6393 0.3543 0.1286

(28)

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO 341-AH 0.3072 0.4941 0.6915 0.8460 0.8833 0.6587 0.2130 0.3519 0.5761 0.3234 0.6170 0.5677 0.1700 0.3072 0.8833 0.6587 0.2130 342-AH 0.1613 0.4076 0.5126 0.6786 0.7661 0.5062 0.1855 0.2710 0.6047 0.3665 0.4652 0.4149 0.1521 0.1613 0.7661 0.5062 0.1855 343-AH 0.0010 0.0109 0.0164 0.0435 0.1429 0.0356 0.0403 0.0326 0.1418 1.1339 0.0202 0.0095 0.0299 0.0010 0.0909 0.0246 0.0233 344-AH 0.2007 0.2910 0.3796 0.5274 0.6495 0.4049 0.1338 0.2364 0.4488 0.3306 0.3834 0.3623 0.1123 0.2007 0.6495 0.4049 0.1338 345-AH 0.0155 0.0467 0.0792 0.1675 0.3182 0.1096 0.0844 0.1208 0.3026 0.7698 0.0806 0.0563 0.0686 0.0155 0.3182 0.1096 0.0844 346-AH 0.0224 0.0454 0.0572 0.0932 0.1267 0.0663 0.0313 0.0478 0.1043 0.4726 0.0596 0.0532 0.0256 0.0224 0.1267 0.0663 0.0313 347-AH 0.0161 0.0457 0.0657 0.0946 0.1955 0.0778 0.0478 0.0490 0.1794 0.6150 0.0658 0.0550 0.0343 0.0161 0.1371 0.0651 0.0292 348-AH 0.0000 0.4216 1.0000 1.0000 1.0000 0.7435 0.4377 0.5784 1.0000 0.5887 0.2162 0.0002 0.3681 0.0000 1.0000 0.7435 0.4377 349-AH 0.0398 0.2236 0.3014 0.3368 0.5710 0.2942 0.1100 0.1132 0.5312 0.3740 0.2669 0.2170 0.0777 0.1724 0.4301 0.2930 0.0722 350-AH 0.0202 0.2897 0.6135 0.6505 0.7334 0.5079 0.2079 0.3609 0.7132 0.4093 0.4263 0.2214 0.1781 0.0202 0.7334 0.5079 0.2079

Références

Documents relatifs

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL

year we used Google in order to expand the original query.. This year we

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL

used a re-ranking method that aimed to improve the initial ranking of retrieved relevant documents using a method called the minimal matching span [3].. This method aims to improve

daedalus Spain enFSenR2S AH-ROBUST-MONO-EN-CLEF2006 en TD AUTOMATIC no. daedalus Spain enFSenR3S AH-ROBUST-MONO-EN-CLEF2006 en TDN

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL