Appendix A: Results of the TEL@CLEF Task

Appendix A

Results of the TEL@CLEF Track

Prepared by:

Giorgio Maria Di Nunzio and Nicola Ferro

{dinunzio, ferro}@dei.unipd.it

Department of Information Engineering University of Padua

Italy

Introduction

1.

2.

3.

- - - -

- - -

- - -

- - -

- - - - - - - - - - - - - - - - -

The following pages contain the results and graphs for all the experiments that have been officially submitted to the CLEF 2007 campaign for the Ad-hoc TEL@CLEF track.

This document is divided in three main parts:

List of submitted experiments Track overview results and graphs Individual experiment results and graphs

1. List of Submitted Experiments

This section gives a listing of all experiments and their characteristics:

2. Track Overview Results and Graphs

For each track/task graphs and tables are shown in order to compare the experiments.

The graphs and tables contain the following information:

Best experiments of at most top five participants Interpolated recall vs precision averages plot Average precision comparison to median plot All experiments

Average precision box plot Average precision Tukey t-test plot

Best experiments of at most top five participants Document cutoff levels (DCL) vs precision at DCL plot R-Precision comparison to median plot

All experiments R-Precision box plot R-Precision Tukey t-test plot

A table with descriptive statistics of performance figures for each topic Min: The minimum of a set of observations

1st Q: The first quartile of a set of observations

2nd Q: The second quartile (median) of a set of observations 3rd Q: The third quartile of a set of observations

Max: The maximum of a set of observations Mean: The arithmetic mean of a set of observations Std: The standard deviation of a set of observations

IQR: Interquartile range, the difference between the 3rd and 1st quartiles

Range: The difference between the maximum and the minimum of a set of observations C.Var: Coefficient of variation, the spread of a set of data as a proportion of its mean Geom.: The geometric mean of a set of observations

Harm.: The harmonic mean of a set of observations

MAO: The mean of absolute deviation of the values in a set of observations

LOT: The lower threshold below which values of a set of observations are considered outliers UOT: The upper threshold below which values of a set of observations are considered outliers MNO: Mean without outliers, the arithmetic mean of a set of observations without outliers SNO: Std without outliers, the standard deviation a set of observations without outliers

Results for CLEF 2008 Ad-hoc TEL@CLEF Track

Participant: name of the participant who submitted the experiment.

Country: country of the participant.

Expeirment DOI: Digital Object Identifier (DOI) for each experiment.

Task: track/task to which the experiment belongs.

Lang.: language of the topics used to create the experiment (ISO identifiers for language).

Fields: identifies the parts of the topics used to create the experiment (T = title, D = Description, N = Narrative).

Constr.: identifies how the query has been constructed from topic fields (manual/automatic).

Pool: specifies if experiment was used for relevance assessment pooling.

- - - - - - -

3. Individual Experiment Results and Graphs

This section provides the individual results for each official experiment. For each experiment the following tables and graphs are shown:

Overall statistics and information

Interpolated recall vs precision averages plot Average precision statistics and box plot Average precision comparison to median plot Document cutoff levels vs precision at DCL plot R-Precision statistics and box plot

R-Precision comparison to median plot

Topics are identified with DOIs, as well as the experiments. The prefix for the DOI of a topic is 10.2452. The following example

shows how to build the DOI for a topic given its number: for topic 200-AH, the corresponding DOI is 10.2452/200-AH

List of Submitted Experiments

chemnitz Germany 10.2415/AH-TEL-MONO-EN-

CLEF2008.CHEMNITZ.CUT_MULTI10_W1MINUSX_PL USPLUS

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

chemnitz Germany 10.2415/AH-TEL-MONO-EN-

CLEF2008.CHEMNITZ.CUT_MULTI10_W1_PLUSPLUS

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

chemnitz Germany 10.2415/AH-TEL-MONO-EN-

CLEF2008.CHEMNITZ.CUT_MULTI10_WX_PLUSPLUS

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

chemnitz Germany 10.2415/AH-TEL-MONO-EN- CLEF2008.CHEMNITZ.CUT_SIMPLE

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC yes

cheshire United States 10.2415/AH-TEL-MONO-EN-

CLEF2008.CHESHIRE.BKAHTELMENTDT2F

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC yes

cheshire United States 10.2415/AH-TEL-MONO-EN-

CLEF2008.CHESHIRE.BKAHTELMENTT2FB

AH-TEL-MONO-EN-CLEF2008 en T AUTOMATIC no

imag France 10.2415/AH-TEL-MONO-EN- CLEF2008.IMAG.IPAL01

AH-TEL-MONO-EN-CLEF2008 en T AUTOMATIC no

imag France 10.2415/AH-TEL-MONO-EN- CLEF2008.IMAG.IPAL02

AH-TEL-MONO-EN-CLEF2008 en T AUTOMATIC yes

imag France 10.2415/AH-TEL-MONO-EN- CLEF2008.IMAG.IPAL03

AH-TEL-MONO-EN-CLEF2008 en T AUTOMATIC no

imag France 10.2415/AH-TEL-MONO-EN- CLEF2008.IMAG.IPAL04

AH-TEL-MONO-EN-CLEF2008 en T AUTOMATIC no

inesc Portugal 10.2415/AH-TEL-MONO-EN- CLEF2008.INESC.RUN1

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC yes

inesc Portugal 10.2415/AH-TEL-MONO-EN- CLEF2008.INESC.RUN2

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

inesc Portugal 10.2415/AH-TEL-MONO-EN- CLEF2008.INESC.RUN3

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

inesc Portugal 10.2415/AH-TEL-MONO-EN- CLEF2008.INESC.RUN4

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

isi India 10.2415/AH-TEL-MONO-EN-

CLEF2008.ISI.IN_EXPC2C10

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC yes

jhu-apl United States 10.2415/AH-TEL-MONO-EN-CLEF2008.JHU- APL.JHUMOEN4

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC yes

jhu-apl United States 10.2415/AH-TEL-MONO-EN-CLEF2008.JHU- APL.JHUMOEN4RF

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

jhu-apl United States 10.2415/AH-TEL-MONO-EN-CLEF2008.JHU- APL.JHUMOEN5

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

jhu-apl United States 10.2415/AH-TEL-MONO-EN-CLEF2008.JHU- APL.JHUMOENS

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

karlsruhe Germany 10.2415/AH-TEL-MONO-EN- CLEF2008.KARLSRUHE.AIFB_BL_EN

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC yes

opentext Canada 10.2415/AH-TEL-MONO-EN- CLEF2008.OPENTEXT.OTEN08T

AH-TEL-MONO-EN-CLEF2008 en T AUTOMATIC no

opentext Canada 10.2415/AH-TEL-MONO-EN- CLEF2008.OPENTEXT.OTEN08TD

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

opentext Canada 10.2415/AH-TEL-MONO-EN- CLEF2008.OPENTEXT.OTEN08TDE

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

opentext Canada 10.2415/AH-TEL-MONO-EN- CLEF2008.OPENTEXT.OTEN08TDZ

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC yes

twente Netherlands 10.2415/AH-TEL-BILI-X2EN- CLEF2008.TWENTE.M

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC yes

ufrgs Brazil 10.2415/AH-TEL-MONO-EN- CLEF2008.UFRGS.UFRGS_MONO_EN1

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC yes

ufrgs Brazil 10.2415/AH-TEL-MONO-EN- CLEF2008.UFRGS.UFRGS_MONO_EN2

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

unine Switzerland 10.2415/AH-TEL-MONO-EN- CLEF2008.UNINE.UNINEEN1

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC yes

unine Switzerland 10.2415/AH-TEL-MONO-EN- CLEF2008.UNINE.UNINEEN2

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

unine Switzerland 10.2415/AH-TEL-MONO-EN- CLEF2008.UNINE.UNINEEN3

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

unine Switzerland 10.2415/AH-TEL-MONO-EN- CLEF2008.UNINE.UNINEEN4

AH-TEL-MONO-EN-CLEF2008 en T AUTOMATIC no

xerox France 10.2415/AH-TEL-MONO-EN-CLEF2008.XEROX.AF AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no xerox France 10.2415/AH-TEL-MONO-EN-CLEF2008.XEROX.F AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no xerox France 10.2415/AH-TEL-MONO-EN-CLEF2008.XEROX.J1 AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no xerox France 10.2415/AH-TEL-MONO-EN-CLEF2008.XEROX.S1 AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC yes xerox-sas Italy 10.2415/AH-TEL-MONO-EN-CLEF2008.XEROX-

SAS.CACAOENGENGEXPANDED

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC no

xerox-sas Italy 10.2415/AH-TEL-MONO-EN-CLEF2008.XEROX- SAS.CACAOENGENGPLAIN

AH-TEL-MONO-EN-CLEF2008 en TD AUTOMATIC yes

chemnitz Germany 10.2415/AH-TEL-MONO-DE-

CLEF2008.CHEMNITZ.CUT_MERGED_SIMPLE

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC yes

chemnitz Germany 10.2415/AH-TEL-MONO-DE-

CLEF2008.CHEMNITZ.CUT_MULTI10_W1MINUSX_PL USPLUS

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no

chemnitz Germany 10.2415/AH-TEL-MONO-DE-

CLEF2008.CHEMNITZ.CUT_MULTI10_W1_PLUSPLUS

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no

Participant Country Experiment DOI Task Lang. Fields Constr. Pool

chemnitz Germany 10.2415/AH-TEL-MONO-DE-

CLEF2008.CHEMNITZ.CUT_MULTI10_WX_PLUSPLUS

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no

cheshire United States 10.2415/AH-TEL-MONO-DE-

CLEF2008.CHESHIRE.BKAHTELMDETDT2FB

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC yes

cheshire United States 10.2415/AH-TEL-MONO-DE-

CLEF2008.CHESHIRE.BKAHTELMDETT2FB

AH-TEL-MONO-DE-CLEF2008 de T AUTOMATIC no

inesc Portugal 10.2415/AH-TEL-MONO-DE- CLEF2008.INESC.RUN1

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC yes

inesc Portugal 10.2415/AH-TEL-MONO-DE- CLEF2008.INESC.RUN2

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no

inesc Portugal 10.2415/AH-TEL-MONO-DE- CLEF2008.INESC.RUN3

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no

inesc Portugal 10.2415/AH-TEL-MONO-DE- CLEF2008.INESC.RUN4

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no

isi India 10.2415/AH-TEL-MONO-DE-

CLEF2008.ISI.IN_EXPC2C10

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC yes

jhu-apl United States 10.2415/AH-TEL-MONO-DE-CLEF2008.JHU- APL.JHUMODE4

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC yes

jhu-apl United States 10.2415/AH-TEL-MONO-DE-CLEF2008.JHU- APL.JHUMODE4RF

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no

jhu-apl United States 10.2415/AH-TEL-MONO-DE-CLEF2008.JHU- APL.JHUMODE5

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no

jhu-apl United States 10.2415/AH-TEL-MONO-DE-CLEF2008.JHU- APL.JHUMODES

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no

karlsruhe Germany 10.2415/AH-TEL-MONO-DE- CLEF2008.KARLSRUHE.AIFB_ONB_DE

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC yes

opentext Canada 10.2415/AH-TEL-MONO-DE- CLEF2008.OPENTEXT.OTDE08T

AH-TEL-MONO-DE-CLEF2008 de T AUTOMATIC no

opentext Canada 10.2415/AH-TEL-MONO-DE- CLEF2008.OPENTEXT.OTDE08TD

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no

opentext Canada 10.2415/AH-TEL-MONO-DE- CLEF2008.OPENTEXT.OTDE08TDE

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no

opentext Canada 10.2415/AH-TEL-MONO-DE- CLEF2008.OPENTEXT.OTDE08TDZ

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC yes

unine Switzerland 10.2415/AH-TEL-MONO-DE- CLEF2008.UNINE.UNINEDE1

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC yes

unine Switzerland 10.2415/AH-TEL-MONO-DE- CLEF2008.UNINE.UNINEDE2

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no

unine Switzerland 10.2415/AH-TEL-MONO-DE- CLEF2008.UNINE.UNINEDE3

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no

unine Switzerland 10.2415/AH-TEL-MONO-DE- CLEF2008.UNINE.UNINEDE4

AH-TEL-MONO-DE-CLEF2008 de T AUTOMATIC no

xerox France 10.2415/AH-TEL-MONO-DE-CLEF2008.XEROX.AF AH-TEL-MONO-DE-CLEF2008 es TD AUTOMATIC no xerox France 10.2415/AH-TEL-MONO-DE-CLEF2008.XEROX.F AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no xerox France 10.2415/AH-TEL-MONO-DE-CLEF2008.XEROX.S AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no xerox France 10.2415/AH-TEL-MONO-DE-CLEF2008.XEROX.T1 AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC yes xerox-sas Italy 10.2415/AH-TEL-MONO-DE-CLEF2008.XEROX-

SAS.CACAOGERGEREXPANDED

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC no

xerox-sas Italy 10.2415/AH-TEL-MONO-DE-CLEF2008.XEROX- SAS.CACAOGERGERPLAIN

AH-TEL-MONO-DE-CLEF2008 de TD AUTOMATIC yes

chemnitz Germany 10.2415/AH-TEL-MONO-FR-

CLEF2008.CHEMNITZ.CUT_MULTI10_W1MINUSX_PL USPLUS

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no

chemnitz Germany 10.2415/AH-TEL-MONO-FR-

CLEF2008.CHEMNITZ.CUT_MULTI10_W1_PLUSPLUS

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC yes

chemnitz Germany 10.2415/AH-TEL-MONO-FR-

CLEF2008.CHEMNITZ.CUT_MULTI10_WX_PLUSPLUS

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no

chemnitz Germany 10.2415/AH-TEL-MONO-FR- CLEF2008.CHEMNITZ.CUT_SIMPLE

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no

cheshire United States 10.2415/AH-TEL-MONO-FR-

CLEF2008.CHESHIRE.BKAHTELMFRTDT2FB

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC yes

cheshire United States 10.2415/AH-TEL-MONO-FR-

CLEF2008.CHESHIRE.BKAHTELMFRTT2FB

AH-TEL-MONO-FR-CLEF2008 fr T AUTOMATIC no

inesc Portugal 10.2415/AH-TEL-MONO-FR- CLEF2008.INESC.RUN1

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC yes

inesc Portugal 10.2415/AH-TEL-MONO-FR- CLEF2008.INESC.RUN2

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no

inesc Portugal 10.2415/AH-TEL-MONO-FR- CLEF2008.INESC.RUN3

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no

inesc Portugal 10.2415/AH-TEL-MONO-FR- CLEF2008.INESC.RUN4

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no

isi India 10.2415/AH-TEL-MONO-FR-

CLEF2008.ISI.IN_EXPC2C10

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC yes

jhu-apl United States 10.2415/AH-TEL-MONO-FR-CLEF2008.JHU- APL.JHUMOFR4

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC yes

jhu-apl United States 10.2415/AH-TEL-MONO-FR-CLEF2008.JHU- APL.JHUMOFR4RF

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no

jhu-apl United States 10.2415/AH-TEL-MONO-FR-CLEF2008.JHU- APL.JHUMOFR5

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no

jhu-apl United States 10.2415/AH-TEL-MONO-FR-CLEF2008.JHU- APL.JHUMOFRS

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no

opentext Canada 10.2415/AH-TEL-MONO-FR- CLEF2008.OPENTEXT.OTFR08T

AH-TEL-MONO-FR-CLEF2008 fr T AUTOMATIC no

opentext Canada 10.2415/AH-TEL-MONO-FR- CLEF2008.OPENTEXT.OTFR08TD

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no

opentext Canada 10.2415/AH-TEL-MONO-FR- CLEF2008.OPENTEXT.OTFR08TDE

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no

opentext Canada 10.2415/AH-TEL-MONO-FR- CLEF2008.OPENTEXT.OTFR08TDZ

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC yes

unine Switzerland 10.2415/AH-TEL-MONO-FR- CLEF2008.UNINE.UNINEFR1

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC yes

unine Switzerland 10.2415/AH-TEL-MONO-FR- CLEF2008.UNINE.UNINEFR2

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no

unine Switzerland 10.2415/AH-TEL-MONO-FR- CLEF2008.UNINE.UNINEFR3

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no

unine Switzerland 10.2415/AH-TEL-MONO-FR- CLEF2008.UNINE.UNINEFR4

AH-TEL-MONO-FR-CLEF2008 fr T AUTOMATIC no

xerox France 10.2415/AH-TEL-MONO-FR-CLEF2008.XEROX.AF AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no xerox France 10.2415/AH-TEL-MONO-FR-CLEF2008.XEROX.F AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no xerox France 10.2415/AH-TEL-MONO-FR-CLEF2008.XEROX.J1 AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no xerox France 10.2415/AH-TEL-MONO-FR-CLEF2008.XEROX.S1 AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC yes xerox-sas Italy 10.2415/AH-TEL-MONO-FR-CLEF2008.XEROX-

SAS.CACAOFREFREEXPANDED

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC no

xerox-sas Italy 10.2415/AH-TEL-MONO-FR-CLEF2008.XEROX- SAS.CACAOFREFREPLAIN

AH-TEL-MONO-FR-CLEF2008 fr TD AUTOMATIC yes

chemnitz Germany 10.2415/AH-TEL-BILI-X2EN- CLEF2008.CHEMNITZ.CUT_SIMPLE_DE2EN

AH-TEL-BILI-X2EN-CLEF2008 de TD AUTOMATIC yes chemnitz Germany 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.CHEMNITZ.CUT_SIMPLE_MULTI10_W1_D E2EN

AH-TEL-BILI-X2EN-CLEF2008 de TD AUTOMATIC no

cheshire United States 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.CHESHIRE.BKAHTELBDEENTDT2FB

AH-TEL-BILI-X2EN-CLEF2008 de TD AUTOMATIC yes cheshire United States 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.CHESHIRE.BKAHTELBESENTDT2FB

AH-TEL-BILI-X2EN-CLEF2008 es TD AUTOMATIC no cheshire United States 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.CHESHIRE.BKAHTELBFRENTDT2FB

AH-TEL-BILI-X2EN-CLEF2008 fr TD AUTOMATIC no jhu-apl United States 10.2415/AH-TEL-BILI-X2EN-CLEF2008.JHU-

APL.JHUBIDEEN5

AH-TEL-BILI-X2EN-CLEF2008 de TD AUTOMATIC no jhu-apl United States 10.2415/AH-TEL-BILI-X2EN-CLEF2008.JHU-

APL.JHUBIESEN5

AH-TEL-BILI-X2EN-CLEF2008 es TD AUTOMATIC no jhu-apl United States 10.2415/AH-TEL-BILI-X2EN-CLEF2008.JHU-

APL.JHUBIFREN5

AH-TEL-BILI-X2EN-CLEF2008 fr TD AUTOMATIC yes jhu-apl United States 10.2415/AH-TEL-BILI-X2EN-CLEF2008.JHU-

APL.JHUBINLEN5

AH-TEL-BILI-X2EN-CLEF2008 nl TD AUTOMATIC no karlsruhe Germany 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.KARLSRUHE.AIFB_BL_DE

AH-TEL-BILI-X2EN-CLEF2008 de TD AUTOMATIC yes karlsruhe Germany 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.KARLSRUHE.AIFB_BL_FR

AH-TEL-BILI-X2EN-CLEF2008 fr TD AUTOMATIC no twente Netherlands 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.TWENTE.DCW

AH-TEL-BILI-X2EN-CLEF2008 nl TD AUTOMATIC no twente Netherlands 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.TWENTE.FCW

AH-TEL-BILI-X2EN-CLEF2008 fr TD AUTOMATIC yes twente Netherlands 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.TWENTE.SCW

AH-TEL-BILI-X2EN-CLEF2008 es TD AUTOMATIC no ufrgs Brazil 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.UFRGS.UFRGS_BI_SP_EN

AH-TEL-BILI-X2EN-CLEF2008 es TD AUTOMATIC yes ufrgs Brazil 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.UFRGS.UFRGS_BI_SP_EN2

AH-TEL-BILI-X2EN-CLEF2008 es TD AUTOMATIC no xerox France 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.XEROX.FRE_ENG_S

AH-TEL-BILI-X2EN-CLEF2008 fr TD AUTOMATIC no xerox France 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.XEROX.FRE_F

AH-TEL-BILI-X2EN-CLEF2008 fr TD AUTOMATIC no xerox France 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.XEROX.GER_ENG_J1

AH-TEL-BILI-X2EN-CLEF2008 de TD AUTOMATIC no xerox France 10.2415/AH-TEL-BILI-X2EN-

CLEF2008.XEROX.PRF_GER_ENG

AH-TEL-BILI-X2EN-CLEF2008 de TD AUTOMATIC yes xerox-sas Italy 10.2415/AH-TEL-BILI-X2EN-CLEF2008.XEROX-

SAS.CACAOFREENGEXPANDED

AH-TEL-BILI-X2EN-CLEF2008 fr TD AUTOMATIC no xerox-sas Italy 10.2415/AH-TEL-BILI-X2EN-CLEF2008.XEROX-

SAS.CACAOFREENGPLAIN

AH-TEL-BILI-X2EN-CLEF2008 fr TD AUTOMATIC yes xerox-sas Italy 10.2415/AH-TEL-BILI-X2EN-CLEF2008.XEROX-

SAS.CACAOGERENGEXPANDED

AH-TEL-BILI-X2EN-CLEF2008 de TD AUTOMATIC no xerox-sas Italy 10.2415/AH-TEL-BILI-X2EN-CLEF2008.XEROX-

SAS.CACAOGERENGPLAIN

AH-TEL-BILI-X2EN-CLEF2008 de TD AUTOMATIC no

Participant Country Experiment DOI Task Lang. Fields Constr. Pool

chemnitz Germany 10.2415/AH-TEL-BILI-X2DE-

CLEF2008.CHEMNITZ.CUT_MERGED_SIMPLE_EN2DE

AH-TEL-BILI-X2DE-CLEF2008 en TD AUTOMATIC yes chemnitz Germany 10.2415/AH-TEL-BILI-X2DE-

CLEF2008.CHEMNITZ.CUT_MERGED_SIMPLE_MULTI 10_W1_EN2DE

AH-TEL-BILI-X2DE-CLEF2008 en TD AUTOMATIC no

cheshire United States 10.2415/AH-TEL-BILI-X2DE-

CLEF2008.CHESHIRE.BKAHTELBENDETDT2FB

AH-TEL-BILI-X2DE-CLEF2008 es TD AUTOMATIC yes cheshire United States 10.2415/AH-TEL-BILI-X2DE-

CLEF2008.CHESHIRE.BKAHTELBESDETDT2FB

AH-TEL-BILI-X2DE-CLEF2008 es TD AUTOMATIC no cheshire United States 10.2415/AH-TEL-BILI-X2DE-

CLEF2008.CHESHIRE.BKAHTELBFRDETDT2FB

AH-TEL-BILI-X2DE-CLEF2008 fr TD AUTOMATIC no jhu-apl United States 10.2415/AH-TEL-BILI-X2DE-CLEF2008.JHU-

APL.JHUBIENDE5

AH-TEL-BILI-X2DE-CLEF2008 en TD AUTOMATIC no jhu-apl United States 10.2415/AH-TEL-BILI-X2DE-CLEF2008.JHU-

APL.JHUBIFRDE5

AH-TEL-BILI-X2DE-CLEF2008 fr TD AUTOMATIC yes karlsruhe Germany 10.2415/AH-TEL-BILI-X2DE-

CLEF2008.KARLSRUHE.AIFB_ONB_EN

AH-TEL-BILI-X2DE-CLEF2008 en TD AUTOMATIC yes karlsruhe Germany 10.2415/AH-TEL-BILI-X2DE-

CLEF2008.KARLSRUHE.AIFB_ONB_FR

AH-TEL-BILI-X2DE-CLEF2008 fr TD AUTOMATIC no xerox France 10.2415/AH-TEL-BILI-X2DE-

CLEF2008.XEROX.ENG_F

AH-TEL-BILI-X2DE-CLEF2008 en TD AUTOMATIC no xerox France 10.2415/AH-TEL-BILI-X2DE-CLEF2008.XEROX.F AH-TEL-BILI-X2DE-CLEF2008 en TD AUTOMATIC yes xerox France 10.2415/AH-TEL-BILI-X2DE-

CLEF2008.XEROX.FRE_GER_J

AH-TEL-BILI-X2DE-CLEF2008 fr TD AUTOMATIC no xerox France 10.2415/AH-TEL-BILI-X2DE-

CLEF2008.XEROX.PRF2

AH-TEL-BILI-X2DE-CLEF2008 fr TD AUTOMATIC no xerox-sas Italy 10.2415/AH-TEL-BILI-X2DE-CLEF2008.XEROX-

SAS.CACAOENGGEREXPANDED

AH-TEL-BILI-X2DE-CLEF2008 en TD AUTOMATIC no xerox-sas Italy 10.2415/AH-TEL-BILI-X2DE-CLEF2008.XEROX-

SAS.CACAOENGGERPLAIN

AH-TEL-BILI-X2DE-CLEF2008 en TD AUTOMATIC no xerox-sas Italy 10.2415/AH-TEL-BILI-X2DE-CLEF2008.XEROX-

SAS.CACAOFREGEREXPANDED

AH-TEL-BILI-X2DE-CLEF2008 fr TD AUTOMATIC no xerox-sas Italy 10.2415/AH-TEL-BILI-X2DE-CLEF2008.XEROX-

SAS.CACAOFREGERPLAIN

AH-TEL-BILI-X2DE-CLEF2008 fr TD AUTOMATIC yes chemnitz Germany 10.2415/AH-TEL-BILI-X2FR-

CLEF2008.CHEMNITZ.CUT_SIMPLE_EN2FR

AH-TEL-BILI-X2FR-CLEF2008 en TD AUTOMATIC yes chemnitz Germany 10.2415/AH-TEL-BILI-X2FR-

CLEF2008.CHEMNITZ.CUT_SIMPLE_MULTI10_W1_E N2FR

AH-TEL-BILI-X2FR-CLEF2008 en TD AUTOMATIC no

cheshire United States 10.2415/AH-TEL-BILI-X2FR-

CLEF2008.CHESHIRE.BKAHTELBDEFRTDT2FB

AH-TEL-BILI-X2FR-CLEF2008 de TD AUTOMATIC yes cheshire United States 10.2415/AH-TEL-BILI-X2FR-

CLEF2008.CHESHIRE.BKAHTELBENFRTDT2FB

AH-TEL-BILI-X2FR-CLEF2008 en TD AUTOMATIC no cheshire United States 10.2415/AH-TEL-BILI-X2FR-

CLEF2008.CHESHIRE.BKAHTELBESFRTDT2FB

AH-TEL-BILI-X2FR-CLEF2008 es TD AUTOMATIC no jhu-apl United States 10.2415/AH-TEL-BILI-X2FR-CLEF2008.JHU-

APL.JHUBIDEFR5

AH-TEL-BILI-X2FR-CLEF2008 de TD AUTOMATIC no jhu-apl United States 10.2415/AH-TEL-BILI-X2FR-CLEF2008.JHU-

APL.JHUBIENFR5

AH-TEL-BILI-X2FR-CLEF2008 en TD AUTOMATIC yes jhu-apl United States 10.2415/AH-TEL-BILI-X2FR-CLEF2008.JHU-

APL.JHUBINLFR5

AH-TEL-BILI-X2FR-CLEF2008 nl TD AUTOMATIC no xerox France 10.2415/AH-TEL-BILI-X2FR-

CLEF2008.XEROX.ENG_FRE_S

AH-TEL-BILI-X2FR-CLEF2008 en TD AUTOMATIC no xerox France 10.2415/AH-TEL-BILI-X2FR-

CLEF2008.XEROX.GER_FRE_J

AH-TEL-BILI-X2FR-CLEF2008 de TD AUTOMATIC no xerox France 10.2415/AH-TEL-BILI-X2FR-

CLEF2008.XEROX.PRF_ENG_FRE

AH-TEL-BILI-X2FR-CLEF2008 en TD AUTOMATIC yes xerox France 10.2415/AH-TEL-BILI-X2FR-

CLEF2008.XEROX.PRF_GER_FRE

AH-TEL-BILI-X2FR-CLEF2008 de TD AUTOMATIC no xerox-sas Italy 10.2415/AH-TEL-BILI-X2FR-CLEF2008.XEROX-

SAS.CACAOENGFREEXPANDED

AH-TEL-BILI-X2FR-CLEF2008 en TD AUTOMATIC no xerox-sas Italy 10.2415/AH-TEL-BILI-X2FR-CLEF2008.XEROX-

SAS.CACAOENGFREPLAIN

AH-TEL-BILI-X2FR-CLEF2008 en TD AUTOMATIC yes xerox-sas Italy 10.2415/AH-TEL-BILI-X2FR-CLEF2008.XEROX-

SAS.CACAOGERFREEXPANDED

AH-TEL-BILI-X2FR-CLEF2008 de TD AUTOMATIC no xerox-sas Italy 10.2415/AH-TEL-BILI-X2FR-CLEF2008.XEROX-

SAS.CACAOGERFREPLAIN

AH-TEL-BILI-X2FR-CLEF2008 de TD AUTOMATIC no

Track Overview Results and Graphs

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Recall

Precision

Ad−Hoc TEL Monolingual English Task Top 5 Participants − Standard Recall Levels vs Mean Interpolated Precision

unine [Experiment UNINEEN3; MAP 37.54%; Not Pooled]

inesc [Experiment RUN3; MAP 36.23%; Not Pooled]

chemnitz [Experiment CUT_SIMPLE; MAP 35.62%; Pooled]

jhu−apl [Experiment JHUMOEN4RF; MAP 35.31%; Not Pooled]

cheshire [Experiment BKAHTELMENTDT2F; MAP 34.66%; Pooled]

451−AH 452−AH 453−AH 454−AH 455−AH 456−AH 457−AH 458−AH 459−AH 460−AH 461−AH 462−AH 463−AH 464−AH 465−AH 466−AH 467−AH 468−AH 469−AH 470−AH 471−AH 472−AH 473−AH 474−AH 475−AH

−1

−0.8

−0.6

−0.4

−0.2 0 0.2 0.4 0.6 0.8 1

Topic Identifier

Difference

Ad−Hoc TEL Monolingual English Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 451−AH to 475−AH)

unine [Experiment UNINEEN3; MAP 37.54%; Not Pooled]

inesc [Experiment RUN3; MAP 36.23%; Not Pooled]

chemnitz [Experiment CUT_SIMPLE; MAP 35.62%; Pooled]

jhu−apl [Experiment JHUMOEN4RF; MAP 35.31%; Not Pooled]

cheshire [Experiment BKAHTELMENTDT2F; MAP 34.66%; Pooled]

476−AH 477−AH 478−AH 479−AH 480−AH 481−AH 482−AH 483−AH 484−AH 485−AH 486−AH 487−AH 488−AH 489−AH 490−AH 491−AH 492−AH 493−AH 494−AH 495−AH 496−AH 497−AH 498−AH 499−AH 500−AH

−1

−0.8

−0.6

−0.4

−0.2 0 0.2 0.4 0.6 0.8 1

Topic Identifier

Difference

Ad−Hoc TEL Monolingual English Task Top 5 Participants − Comparison to Median Average Precision by Topic (Topics 476−AH to 500−AH)

unine [Experiment UNINEEN3; MAP 37.54%; Not Pooled]

inesc [Experiment RUN3; MAP 36.23%; Not Pooled]

chemnitz [Experiment CUT_SIMPLE; MAP 35.62%; Pooled]

jhu−apl [Experiment JHUMOEN4RF; MAP 35.31%; Not Pooled]

cheshire [Experiment BKAHTELMENTDT2F; MAP 34.66%; Pooled]

AH-TEL-CLEF2008 Track Overview Results and Graphs AH-TEL-MONO-EN-CLEF2008

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

xerox [Experiment AF; MAP 8.74%; Not Pooled]

xerox−sas [Experiment CACAOENGENGEXPANDED; MAP 13.30%; Not Pooled]

chemnitz [Experiment CUT_MULTI10_W1_PLUSPLUS; MAP 14.53%; Not Pooled]

chemnitz [Experiment CUT_MULTI10_W1MINUSX_PLUSPLUS; MAP 16.20%; Not Pooled]

xerox−sas [Experiment CACAOENGENGPLAIN; MAP 17.27%; Pooled]

karlsruhe [Experiment AIFB_BL_EN; MAP 17.72%; Pooled]

opentext [Experiment OTEN08TDZ; MAP 20.83%; Pooled]

chemnitz [Experiment CUT_MULTI10_WX_PLUSPLUS; MAP 24.84%; Not Pooled]

ufrgs [Experiment UFRGS_MONO_EN1; MAP 24.93%; Pooled]

imag [Experiment IPAL04; MAP 25.79%; Not Pooled]

imag [Experiment IPAL03; MAP 26.18%; Not Pooled]

imag [Experiment IPAL02; MAP 26.23%; Pooled]

imag [Experiment IPAL01; MAP 26.24%; Not Pooled]

xerox [Experiment S1; MAP 27.23%; Pooled]

isi [Experiment IN_EXPC2C10; MAP 27.51%; Pooled]

ufrgs [Experiment UFRGS_MONO_EN2; MAP 27.71%; Not Pooled]

cheshire [Experiment BKAHTELMENTT2FB; MAP 27.73%; Not Pooled]

opentext [Experiment OTEN08T; MAP 28.25%; Not Pooled]

xerox [Experiment F; MAP 28.31%; Not Pooled]

opentext [Experiment OTEN08TD; MAP 28.96%; Not Pooled]

xerox [Experiment J1; MAP 29.10%; Not Pooled]

inesc [Experiment RUN2; MAP 29.69%; Not Pooled]

inesc [Experiment RUN1; MAP 29.76%; Pooled]

inesc [Experiment RUN4; MAP 30.48%; Not Pooled]

jhu−apl [Experiment JHUMOEN5; MAP 31.90%; Not Pooled]

opentext [Experiment OTEN08TDE; MAP 32.03%; Not Pooled]

jhu−apl [Experiment JHUMOEN4; MAP 33.82%; Pooled]

twente [Experiment M; MAP 34.07%; Pooled]

unine [Experiment UNINEEN4; MAP 34.46%; Not Pooled]

cheshire [Experiment BKAHTELMENTDT2F; MAP 34.66%; Pooled]

jhu−apl [Experiment JHUMOENS; MAP 34.80%; Not Pooled]

jhu−apl [Experiment JHUMOEN4RF; MAP 35.31%; Not Pooled]

unine [Experiment UNINEEN1; MAP 35.43%; Pooled]

chemnitz [Experiment CUT_SIMPLE; MAP 35.62%; Pooled]

inesc [Experiment RUN3; MAP 36.23%; Not Pooled]

unine [Experiment UNINEEN2; MAP 37.06%; Not Pooled]

unine [Experiment UNINEEN3; MAP 37.54%; Not Pooled]

Average Precision

Experiments

Ad−Hoc TEL Monolingual English Task − Box Plot of the Topics

10.2455/TUKEY_T_TEST.A8F628F37D910821BE7E8477A40939BA

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8

AF CUT_MULTI10_W1_PLUSPLUS CUT_MULTI10_W1MINUSX_PLUSPLUS CACAOENGENGEXPANDED AIFB_BL_EN CACAOENGENGPLAIN OTEN08TDZ CUT_MULTI10_WX_PLUSPLUS UFRGS_MONO_EN1 IPAL04 IPAL03 IPAL01 IPAL02 IN_EXPC2C10 UFRGS_MONO_EN2 BKAHTELMENTT2FB S1 OTEN08T J1 F OTEN08TD RUN2 RUN1 RUN4 OTEN08TDE JHUMOEN5 JHUMOEN4 UNINEEN4 M BKAHTELMENTDT2F JHUMOEN4RF JHUMOENS CUT_SIMPLE UNINEEN1 RUN3 UNINEEN2 UNINEEN3

Ad−Hoc TEL Monolingual English Task − Tukey T test with "top group" highlighted

arcsin(sqrt(Average Precsion))

Experiments

5 10 15 20 30 100 200 500 1000 0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Retrieved Documents (logarithmic scale)

Precision

Ad−Hoc TEL Monolingual English Task Top 5 Participants − Retrieved documents vs Mean Precision

unine [Experiment UNINEEN3; R−Prec 38.80%; Not Pooled]

inesc [Experiment RUN3; R−Prec 36.49%; Not Pooled]

chemnitz [Experiment CUT_SIMPLE; R−Prec 37.16%; Pooled]

jhu−apl [Experiment JHUMOEN4RF; R−Prec 35.12%; Not Pooled]

cheshire [Experiment BKAHTELMENTDT2F; R−Prec 35.15%; Pooled]

451−AH 452−AH 453−AH 454−AH 455−AH 456−AH 457−AH 458−AH 459−AH 460−AH 461−AH 462−AH 463−AH 464−AH 465−AH 466−AH 467−AH 468−AH 469−AH 470−AH 471−AH 472−AH 473−AH 474−AH 475−AH

−1

−0.8

−0.6

−0.4

−0.2 0 0.2 0.4 0.6 0.8 1

Topic Identifier

Difference

Ad−Hoc TEL Monolingual English Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 451−AH to 475−AH)

unine [Experiment UNINEEN3; R−Prec 38.80%; Not Pooled]

inesc [Experiment RUN3; R−Prec 36.49%; Not Pooled]

chemnitz [Experiment CUT_SIMPLE; R−Prec 37.16%; Pooled]

jhu−apl [Experiment JHUMOEN4RF; R−Prec 35.12%; Not Pooled]

cheshire [Experiment BKAHTELMENTDT2F; R−Prec 35.15%; Pooled]

476−AH 477−AH 478−AH 479−AH 480−AH 481−AH 482−AH 483−AH 484−AH 485−AH 486−AH 487−AH 488−AH 489−AH 490−AH 491−AH 492−AH 493−AH 494−AH 495−AH 496−AH 497−AH 498−AH 499−AH 500−AH

−1

−0.8

−0.6

−0.4

−0.2 0 0.2 0.4 0.6 0.8 1

Topic Identifier

Difference

Ad−Hoc TEL Monolingual English Task Top 5 Participants − Comparison to Median R−Precision by Topic (Topics 476−AH to 500−AH)

unine [Experiment UNINEEN3; R−Prec 38.80%; Not Pooled]

inesc [Experiment RUN3; R−Prec 36.49%; Not Pooled]

chemnitz [Experiment CUT_SIMPLE; R−Prec 37.16%; Pooled]

jhu−apl [Experiment JHUMOEN4RF; R−Prec 35.12%; Not Pooled]

cheshire [Experiment BKAHTELMENTDT2F; R−Prec 35.15%; Pooled]

AH-TEL-CLEF2008 Track Overview Results and Graphs AH-TEL-MONO-EN-CLEF2008

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

xerox [Experiment AF; R−Prec 10.42%; Not Pooled]

chemnitz [Experiment CUT_MULTI10_W1_PLUSPLUS; R−Prec 14.75%; Not Pooled]

chemnitz [Experiment CUT_MULTI10_W1MINUSX_PLUSPLUS; R−Prec 16.87%; Not Pooled]

xerox−sas [Experiment CACAOENGENGEXPANDED; R−Prec 16.99%; Not Pooled]

karlsruhe [Experiment AIFB_BL_EN; R−Prec 19.70%; Pooled]

xerox−sas [Experiment CACAOENGENGPLAIN; R−Prec 21.24%; Pooled]

opentext [Experiment OTEN08TDZ; R−Prec 21.42%; Pooled]

chemnitz [Experiment CUT_MULTI10_WX_PLUSPLUS; R−Prec 26.58%; Not Pooled]

ufrgs [Experiment UFRGS_MONO_EN1; R−Prec 27.11%; Pooled]

imag [Experiment IPAL04; R−Prec 28.14%; Not Pooled]

isi [Experiment IN_EXPC2C10; R−Prec 28.76%; Pooled]

imag [Experiment IPAL01; R−Prec 29.09%; Not Pooled]

cheshire [Experiment BKAHTELMENTT2FB; R−Prec 29.09%; Not Pooled]

imag [Experiment IPAL03; R−Prec 29.22%; Not Pooled]

imag [Experiment IPAL02; R−Prec 29.34%; Pooled]

ufrgs [Experiment UFRGS_MONO_EN2; R−Prec 30.07%; Not Pooled]

opentext [Experiment OTEN08T; R−Prec 30.07%; Not Pooled]

inesc [Experiment RUN1; R−Prec 31.06%; Pooled]

inesc [Experiment RUN2; R−Prec 31.18%; Not Pooled]

inesc [Experiment RUN4; R−Prec 31.30%; Not Pooled]

xerox [Experiment F; R−Prec 31.32%; Not Pooled]

xerox [Experiment S1; R−Prec 31.47%; Pooled]

opentext [Experiment OTEN08TD; R−Prec 32.05%; Not Pooled]

jhu−apl [Experiment JHUMOEN5; R−Prec 32.11%; Not Pooled]

xerox [Experiment J1; R−Prec 32.68%; Not Pooled]

opentext [Experiment OTEN08TDE; R−Prec 33.34%; Not Pooled]

jhu−apl [Experiment JHUMOEN4; R−Prec 33.80%; Pooled]

twente [Experiment M; R−Prec 33.89%; Pooled]

jhu−apl [Experiment JHUMOEN4RF; R−Prec 35.12%; Not Pooled]

cheshire [Experiment BKAHTELMENTDT2F; R−Prec 35.15%; Pooled]

jhu−apl [Experiment JHUMOENS; R−Prec 35.57%; Not Pooled]

unine [Experiment UNINEEN4; R−Prec 35.89%; Not Pooled]

inesc [Experiment RUN3; R−Prec 36.49%; Not Pooled]

unine [Experiment UNINEEN1; R−Prec 36.68%; Pooled]

chemnitz [Experiment CUT_SIMPLE; R−Prec 37.16%; Pooled]

unine [Experiment UNINEEN2; R−Prec 37.93%; Not Pooled]

unine [Experiment UNINEEN3; R−Prec 38.80%; Not Pooled]

R−Precision

Experiments

Ad−Hoc TEL Monolingual English Task − Box Plot of the Topics

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 AF

CUT_MULTI10_W1_PLUSPLUS CUT_MULTI10_W1MINUSX_PLUSPLUS CACAOENGENGEXPANDED AIFB_BL_EN CACAOENGENGPLAIN OTEN08TDZ CUT_MULTI10_WX_PLUSPLUS UFRGS_MONO_EN1 IPAL04 IN_EXPC2C10 IPAL01 BKAHTELMENTT2FB IPAL03 IPAL02 OTEN08T UFRGS_MONO_EN2 RUN1 F RUN2 S1 RUN4 J1 JHUMOEN5 OTEN08TD OTEN08TDE M JHUMOEN4 BKAHTELMENTDT2F JHUMOEN4RF JHUMOENS UNINEEN4 RUN3 UNINEEN1 CUT_SIMPLE UNINEEN2 UNINEEN3

Ad−Hoc TEL Monolingual English Task − Tukey T test with "top group" highlighted

arcsin(sqrt(R−Precision))

Experiments

Statistics for Number of relevant retrieved documents

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

451-AH 0.00 14.00 21.00 24.00 31.00 18.76 8.48 10.00 31.00 0.45 5.87 0.00 6.79 0.00 31.00 18.76 8.48 452-AH 9.00 16.00 17.00 18.00 18.00 16.62 1.66 2.00 9.00 0.10 16.52 16.38 1.05 14.00 18.00 16.83 1.06 453-AH 0.00 10.00 23.00 29.00 31.00 19.62 9.98 19.00 31.00 0.51 8.39 0.00 8.97 0.00 31.00 19.62 9.98 454-AH 0.00 11.00 15.00 15.00 16.00 12.00 4.99 4.00 16.00 0.42 7.38 0.00 4.05 5.00 16.00 12.97 3.90 455-AH 0.00 6.75 7.00 8.00 12.00 6.84 2.34 1.25 12.00 0.34 3.38 0.00 1.54 5.00 9.00 7.34 1.12 456-AH 0.00 1.00 7.00 15.75 22.00 8.97 7.80 14.75 22.00 0.87 0.62 0.00 6.56 0.00 22.00 8.97 7.80 457-AH 12.00 16.75 18.00 19.00 20.00 17.30 1.88 2.25 8.00 0.11 17.19 17.06 1.41 14.00 20.00 17.60 1.42 458-AH 5.00 20.75 22.00 22.25 23.00 20.49 4.21 1.50 18.00 0.21 19.67 18.01 2.62 20.00 23.00 22.00 0.89 459-AH 0.00 9.00 10.00 10.25 11.00 9.30 2.48 1.25 11.00 0.27 4.63 0.00 1.47 8.00 11.00 10.00 0.83 460-AH 8.00 19.25 34.00 35.00 36.00 27.68 11.54 15.75 28.00 0.42 23.85 18.93 9.82 8.00 36.00 27.68 11.54 461-AH 14.00 29.00 29.00 31.00 32.00 28.76 3.84 2.00 18.00 0.13 28.43 27.99 2.16 29.00 32.00 29.97 1.26 462-AH 5.00 8.00 8.00 9.00 10.00 8.41 0.98 1.00 5.00 0.12 8.34 8.27 0.75 7.00 10.00 8.50 0.81 463-AH 0.00 23.75 37.00 41.25 61.00 31.54 15.92 17.50 61.00 0.50 12.47 0.00 12.68 0.00 61.00 31.54 15.92 464-AH 33.00 37.00 38.00 39.00 41.00 37.49 1.99 2.00 8.00 0.05 37.43 37.38 1.51 34.00 41.00 37.61 1.87 465-AH 4.00 53.00 58.00 68.00 79.00 56.51 17.70 15.00 75.00 0.31 49.74 32.69 11.36 44.00 79.00 60.97 9.43 466-AH 1.00 45.00 51.00 58.00 67.00 49.32 14.06 13.00 66.00 0.28 43.86 20.57 9.53 34.00 67.00 51.83 9.41 467-AH 25.00 27.75 28.00 28.00 29.00 27.73 1.12 0.25 4.00 0.04 27.71 27.68 0.84 28.00 28.00 28.00 0.00 468-AH 0.00 78.75 83.00 90.00 98.00 77.70 22.05 11.25 98.00 0.28 34.35 0.00 13.76 64.00 98.00 84.97 7.51 469-AH 6.00 9.00 13.00 19.00 19.00 13.68 4.99 10.00 13.00 0.36 12.68 11.65 4.53 6.00 19.00 13.68 4.99 470-AH 0.00 39.75 50.00 63.25 68.00 48.00 18.65 23.50 68.00 0.39 14.48 0.00 14.27 21.00 68.00 52.24 12.30 471-AH 0.00 28.00 89.00 100.00 107.00 70.24 38.59 72.00 107.00 0.55 36.06 0.00 34.13 0.00 107.00 70.24 38.59 472-AH 0.00 152.00 161.00 166.25 182.00 153.84 28.86 14.25 182.00 0.19 100.69 0.00 14.83 142.00 182.00 160.94 8.75

473-AH 0.00 3.00 4.00 5.00 6.00 3.76 1.66 2.00 6.00 0.44 1.01 0.00 1.28 0.00 6.00 3.76 1.66

474-AH 0.00 28.75 37.00 47.25 84.00 40.35 20.91 18.50 84.00 0.52 23.41 0.00 15.21 3.00 74.00 35.39 13.86 475-AH 0.00 19.00 23.00 28.25 41.00 21.89 9.65 9.25 41.00 0.44 6.82 0.00 6.83 10.00 41.00 24.42 6.57 476-AH 0.00 27.75 32.00 35.25 51.00 29.24 13.13 7.50 51.00 0.45 11.54 0.00 9.21 19.00 45.00 32.97 7.07 477-AH 0.00 23.50 36.00 40.00 49.00 33.54 10.95 16.50 49.00 0.33 22.03 0.00 9.00 0.00 49.00 33.54 10.95 478-AH 0.00 4.00 11.00 19.25 32.00 12.73 9.48 15.25 32.00 0.74 6.89 0.00 7.86 0.00 32.00 12.73 9.48 479-AH 0.00 31.00 31.00 32.00 32.00 29.43 6.44 1.00 32.00 0.22 19.94 0.00 3.55 31.00 32.00 31.42 0.50 480-AH 0.00 24.75 27.00 27.00 28.00 23.78 6.36 2.25 28.00 0.27 15.98 0.00 4.50 23.00 28.00 26.53 1.20 481-AH 0.00 66.75 67.00 67.00 67.00 64.27 11.06 0.25 67.00 0.17 43.19 0.00 4.26 67.00 67.00 67.00 0.00 482-AH 0.00 151.00 168.00 168.00 168.00 151.19 35.99 17.00 168.00 0.24 97.14 0.00 21.72 126.00 168.00 161.76 10.88 483-AH 0.00 116.00 119.00 121.00 121.00 113.16 20.39 5.00 121.00 0.18 74.78 0.00 9.79 113.00 121.00 119.00 2.08 484-AH 0.00 3.00 30.00 30.25 35.00 21.32 13.32 27.25 35.00 0.62 1.39 0.00 11.36 0.00 35.00 21.32 13.32

485-AH 0.00 4.00 4.00 6.25 7.00 4.59 2.05 2.25 7.00 0.45 1.64 0.00 1.64 2.00 7.00 5.00 1.58

486-AH 0.00 34.00 49.00 54.25 59.00 40.78 19.40 20.25 59.00 0.48 11.58 0.00 15.76 10.00 59.00 44.38 15.69 487-AH 0.00 6.00 20.00 24.25 27.00 15.03 9.90 18.25 27.00 0.66 7.37 0.00 9.22 0.00 27.00 15.03 9.90

488-AH 0.00 5.00 5.00 6.00 7.00 4.89 1.66 1.00 7.00 0.34 1.81 0.00 0.94 4.00 7.00 5.32 0.81

489-AH 0.00 87.75 102.00 118.00 122.00 95.73 28.49 30.25 122.00 0.30 59.51 0.00 19.20 50.00 122.00 101.03 18.01 490-AH 0.00 17.00 18.00 18.00 18.00 17.22 2.96 1.00 18.00 0.17 11.99 0.00 1.14 16.00 18.00 17.69 0.58 491-AH 0.00 6.00 10.00 13.25 15.00 9.16 4.52 7.25 15.00 0.49 3.01 0.00 3.88 0.00 15.00 9.16 4.52

492-AH 0.00 3.00 4.00 7.00 8.00 4.59 2.28 4.00 8.00 0.50 1.62 0.00 1.81 0.00 8.00 4.59 2.28

493-AH 0.00 47.00 47.00 47.00 47.00 44.76 9.60 0.00 47.00 0.21 29.83 0.00 4.24 47.00 47.00 47.00 0.00 494-AH 0.00 106.00 113.00 118.00 121.00 102.22 31.96 12.00 121.00 0.31 29.75 0.00 18.89 88.00 121.00 111.97 8.02 495-AH 0.00 4.00 11.00 11.00 11.00 8.03 3.66 7.00 11.00 0.46 5.02 0.00 3.21 0.00 11.00 8.03 3.66 496-AH 0.00 111.75 126.00 129.00 132.00 113.16 28.36 17.25 132.00 0.25 73.29 0.00 19.33 88.00 132.00 121.39 12.52

497-AH 0.00 3.75 5.00 6.00 8.00 4.73 1.94 2.25 8.00 0.41 3.11 0.00 1.55 1.00 8.00 4.86 1.79

498-AH 0.00 8.75 14.00 15.00 17.00 11.43 4.65 6.25 17.00 0.41 3.85 0.00 3.80 0.00 17.00 11.43 4.65 499-AH 0.00 6.00 8.00 9.00 13.00 7.32 2.66 3.00 13.00 0.36 4.79 0.00 1.88 4.00 13.00 7.91 1.82 500-AH 0.00 11.00 11.00 11.00 11.00 10.59 1.85 0.00 11.00 0.17 7.47 0.00 0.75 11.00 11.00 11.00 0.00

AH-TEL-CLEF2008 Track Overview Results and Graphs AH-TEL-MONO-EN-CLEF2008

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

451-AH 0.0000 0.0448 0.0957 0.1472 0.2303 0.0939 0.0625 0.1024 0.2303 0.6652 0.0376 0.0001 0.0496 0.0000 0.2303 0.0939 0.0625 452-AH 0.0158 0.3331 0.4580 0.5113 0.6068 0.4076 0.1467 0.1781 0.5910 0.3598 0.3581 0.2240 0.1188 0.1061 0.6068 0.4185 0.1327 453-AH 0.0000 0.0110 0.0523 0.1729 0.3101 0.0935 0.0918 0.1619 0.3101 0.9820 0.0296 0.0002 0.0804 0.0000 0.3101 0.0935 0.0918 454-AH 0.0000 0.2462 0.3514 0.4346 0.5417 0.3324 0.1516 0.1884 0.5417 0.4562 0.1978 0.0004 0.1208 0.0000 0.5417 0.3324 0.1516 455-AH 0.0000 0.1131 0.1340 0.1867 0.2960 0.1400 0.0681 0.0736 0.2960 0.4865 0.0740 0.0002 0.0481 0.0041 0.2960 0.1481 0.0608 456-AH 0.0000 0.0003 0.0119 0.0409 0.1444 0.0276 0.0374 0.0406 0.1444 1.3542 0.0033 0.0001 0.0275 0.0000 0.0569 0.0163 0.0181 457-AH 0.0726 0.2024 0.2310 0.2594 0.2887 0.2235 0.0469 0.0570 0.2161 0.2097 0.2170 0.2077 0.0340 0.1407 0.2887 0.2310 0.0350 458-AH 0.0996 0.1560 0.2541 0.2997 0.3985 0.2334 0.0847 0.1438 0.2989 0.3630 0.2170 0.1999 0.0731 0.0996 0.3985 0.2334 0.0847 459-AH 0.0000 0.0237 0.0524 0.3522 0.6196 0.1814 0.2146 0.3285 0.6196 1.1830 0.0508 0.0002 0.1871 0.0000 0.6196 0.1814 0.2146 460-AH 0.0115 0.0531 0.2803 0.4370 0.6917 0.2666 0.2147 0.3839 0.6803 0.8055 0.1577 0.0762 0.1906 0.0115 0.6917 0.2666 0.2147 461-AH 0.0086 0.2563 0.4784 0.6335 0.7323 0.4488 0.2077 0.3771 0.7237 0.4627 0.3560 0.1391 0.1804 0.0086 0.7323 0.4488 0.2077 462-AH 0.0425 0.1969 0.3230 0.5383 0.6786 0.3591 0.1774 0.3414 0.6361 0.4940 0.3113 0.2535 0.1548 0.0425 0.6786 0.3591 0.1774 463-AH 0.0000 0.0128 0.0345 0.1719 0.4318 0.1030 0.1215 0.1591 0.4318 1.1795 0.0276 0.0002 0.1024 0.0000 0.3164 0.0939 0.1095 464-AH 0.1235 0.1704 0.4089 0.4805 0.5707 0.3521 0.1501 0.3101 0.4472 0.4262 0.3144 0.2744 0.1350 0.1235 0.5707 0.3521 0.1501 465-AH 0.0275 0.0360 0.0694 0.1343 0.2496 0.0898 0.0608 0.0982 0.2221 0.6777 0.0716 0.0578 0.0507 0.0275 0.2496 0.0898 0.0608 466-AH 0.0012 0.1343 0.2041 0.2867 0.4142 0.2154 0.1142 0.1524 0.4130 0.5301 0.1626 0.0342 0.0946 0.0012 0.4142 0.2154 0.1142 467-AH 0.1590 0.3138 0.3891 0.4394 0.5253 0.3715 0.0919 0.1256 0.3664 0.2473 0.3583 0.3423 0.0732 0.1590 0.5253 0.3715 0.0919 468-AH 0.0000 0.1994 0.2979 0.3267 0.4027 0.2675 0.1000 0.1273 0.4027 0.3739 0.1553 0.0002 0.0774 0.0985 0.4027 0.2828 0.0784 469-AH 0.0141 0.0481 0.1311 0.3190 0.5269 0.1779 0.1456 0.2709 0.5127 0.8180 0.1154 0.0690 0.1284 0.0141 0.5269 0.1779 0.1456 470-AH 0.0000 0.1176 0.1986 0.2910 0.4253 0.1976 0.1150 0.1735 0.4253 0.5820 0.0810 0.0001 0.0953 0.0000 0.4253 0.1976 0.1150 471-AH 0.0000 0.1797 0.6112 0.7108 0.8166 0.4521 0.2862 0.5310 0.8166 0.6331 0.2491 0.0004 0.2627 0.0000 0.8166 0.4521 0.2862 472-AH 0.0000 0.3959 0.4288 0.5134 0.6299 0.4280 0.1223 0.1174 0.6299 0.2857 0.3203 0.0004 0.0836 0.2418 0.6299 0.4532 0.0855 473-AH 0.0000 0.0130 0.0234 0.0378 0.1564 0.0329 0.0336 0.0248 0.1564 1.0213 0.0109 0.0001 0.0239 0.0000 0.0660 0.0206 0.0148 474-AH 0.0000 0.1009 0.1235 0.1704 0.4801 0.1499 0.1040 0.0695 0.4801 0.6939 0.0864 0.0004 0.0720 0.0000 0.2188 0.1152 0.0530 475-AH 0.0000 0.0238 0.0460 0.1054 0.3573 0.0691 0.0691 0.0816 0.3573 1.0001 0.0249 0.0001 0.0503 0.0000 0.2079 0.0611 0.0498 476-AH 0.0000 0.0667 0.0806 0.1769 0.2671 0.1112 0.0785 0.1103 0.2671 0.7057 0.0392 0.0001 0.0670 0.0000 0.2671 0.1112 0.0785 477-AH 0.0000 0.1147 0.1871 0.2638 0.4026 0.1947 0.0984 0.1491 0.4026 0.5056 0.1345 0.0004 0.0821 0.0000 0.4026 0.1947 0.0984 478-AH 0.0000 0.0049 0.0157 0.0616 0.4656 0.0666 0.1145 0.0567 0.4656 1.7184 0.0180 0.0004 0.0737 0.0000 0.1370 0.0299 0.0352 479-AH 0.0000 0.4882 0.7454 0.8338 0.9525 0.6358 0.2692 0.3456 0.9525 0.4234 0.4187 0.0004 0.2185 0.0000 0.9525 0.6358 0.2692 480-AH 0.0000 0.2829 0.4223 0.5524 0.6612 0.3964 0.1678 0.2695 0.6612 0.4233 0.2810 0.0004 0.1441 0.0000 0.6612 0.3964 0.1678 481-AH 0.0000 0.6389 0.7787 0.8270 0.8742 0.7042 0.1914 0.1881 0.8742 0.2717 0.5212 0.0004 0.1455 0.4378 0.8742 0.7345 0.1398 482-AH 0.0000 0.4669 0.8727 0.9428 0.9776 0.7156 0.2846 0.4759 0.9776 0.3978 0.4882 0.0004 0.2454 0.0000 0.9776 0.7156 0.2846 483-AH 0.0000 0.4609 0.5604 0.6131 0.6974 0.5174 0.1541 0.1522 0.6974 0.2979 0.3811 0.0004 0.1153 0.2400 0.6974 0.5425 0.1133 484-AH 0.0000 0.0789 0.3789 0.4774 0.5811 0.3083 0.2003 0.3984 0.5811 0.6498 0.0458 0.0001 0.1730 0.0000 0.5811 0.3083 0.2003 485-AH 0.0000 0.1089 0.1794 0.2984 0.3857 0.1804 0.1160 0.1894 0.3857 0.6430 0.0614 0.0001 0.0966 0.0000 0.3857 0.1804 0.1160 486-AH 0.0000 0.1189 0.1516 0.1850 0.3494 0.1529 0.0771 0.0661 0.3494 0.5044 0.0712 0.0001 0.0522 0.0700 0.2761 0.1553 0.0478 487-AH 0.0000 0.0033 0.0546 0.0985 0.4954 0.0704 0.0938 0.0952 0.4954 1.3319 0.0151 0.0003 0.0619 0.0000 0.2187 0.0586 0.0612 488-AH 0.0000 0.0481 0.1711 0.2154 0.4426 0.1669 0.1223 0.1673 0.4426 0.7332 0.0628 0.0001 0.0982 0.0000 0.4426 0.1669 0.1223 489-AH 0.0000 0.1754 0.5560 0.6635 0.7972 0.4536 0.2517 0.4880 0.7972 0.5550 0.2461 0.0004 0.2267 0.0000 0.7972 0.4536 0.2517 490-AH 0.0000 0.5534 0.7418 0.8086 0.8724 0.6538 0.2251 0.2552 0.8724 0.3443 0.4647 0.0004 0.1751 0.2000 0.8724 0.6869 0.1803 491-AH 0.0000 0.0160 0.0467 0.1075 0.2250 0.0709 0.0691 0.0915 0.2250 0.9748 0.0222 0.0001 0.0566 0.0000 0.2250 0.0709 0.0691 492-AH 0.0000 0.0850 0.2997 0.3841 0.5429 0.2549 0.1676 0.2991 0.5429 0.6575 0.0770 0.0001 0.1421 0.0000 0.5429 0.2549 0.1676 493-AH 0.0000 0.5136 0.6137 0.6820 0.9627 0.5926 0.2035 0.1684 0.9627 0.3433 0.3981 0.0004 0.1417 0.2693 0.8950 0.6164 0.1391 494-AH 0.0000 0.4177 0.4824 0.5727 0.7539 0.4487 0.2032 0.1550 0.7539 0.4529 0.1878 0.0001 0.1513 0.2133 0.7539 0.5242 0.1117 495-AH 0.0000 0.0734 0.1662 0.2548 0.3690 0.1645 0.1127 0.1814 0.3690 0.6852 0.0686 0.0004 0.0911 0.0000 0.3690 0.1645 0.1127 496-AH 0.0000 0.3651 0.6783 0.7230 0.7911 0.5602 0.2220 0.3579 0.7911 0.3964 0.3915 0.0004 0.1879 0.0000 0.7911 0.5602 0.2220 497-AH 0.0000 0.0082 0.0148 0.0297 0.0683 0.0224 0.0197 0.0215 0.0683 0.8793 0.0125 0.0004 0.0156 0.0000 0.0515 0.0173 0.0137 498-AH 0.0000 0.0615 0.0790 0.1002 0.2570 0.0892 0.0618 0.0387 0.2570 0.6934 0.0405 0.0001 0.0413 0.0294 0.1482 0.0784 0.0267 499-AH 0.0000 0.0639 0.0944 0.1104 0.1493 0.0822 0.0441 0.0465 0.1493 0.5369 0.0429 0.0004 0.0353 0.0000 0.1493 0.0822 0.0441 500-AH 0.0000 0.5682 0.6391 0.6995 0.7472 0.5967 0.1685 0.1313 0.7472 0.2824 0.4358 0.0004 0.1091 0.5214 0.7472 0.6496 0.0611

Statistics for R-Precision

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

451-AH 0.0000 0.0909 0.1212 0.1818 0.3030 0.1269 0.0735 0.0909 0.3030 0.5788 0.0465 0.0001 0.0560 0.0000 0.3030 0.1269 0.0735 452-AH 0.0526 0.3158 0.4211 0.5263 0.5789 0.4111 0.1375 0.2105 0.5263 0.3345 0.3787 0.3229 0.1120 0.0526 0.5789 0.4111 0.1375 453-AH 0.0000 0.0294 0.0882 0.1471 0.4706 0.1073 0.1036 0.1176 0.4706 0.9651 0.0220 0.0001 0.0773 0.0000 0.2647 0.0899 0.0734 454-AH 0.0000 0.2969 0.3750 0.4375 0.5000 0.3446 0.1402 0.1406 0.5000 0.4070 0.1919 0.0002 0.1105 0.1250 0.5000 0.3732 0.1049 455-AH 0.0000 0.0833 0.1667 0.2500 0.3333 0.1622 0.0920 0.1667 0.3333 0.5674 0.0579 0.0001 0.0692 0.0000 0.3333 0.1622 0.0920 456-AH 0.0000 0.0000 0.0417 0.0833 0.2083 0.0484 0.0625 0.0833 0.2083 1.2909 0.0010 0.0000 0.0497 0.0000 0.2083 0.0484 0.0625 457-AH 0.1154 0.2308 0.2692 0.2692 0.3077 0.2516 0.0369 0.0385 0.1923 0.1468 0.2483 0.2442 0.0284 0.1923 0.3077 0.2553 0.0293 458-AH 0.1071 0.1339 0.1786 0.2857 0.4286 0.2162 0.1017 0.1518 0.3214 0.4703 0.1938 0.1744 0.0891 0.1071 0.4286 0.2162 0.1017 459-AH 0.0000 0.0000 0.0000 0.3636 0.6364 0.1818 0.2526 0.3636 0.6364 1.3894 0.0009 0.0000 0.2211 0.0000 0.6364 0.1818 0.2526 460-AH 0.0263 0.0526 0.2895 0.4276 0.8158 0.2873 0.2367 0.3750 0.7895 0.8238 0.1707 0.0855 0.2028 0.0263 0.8158 0.2873 0.2367 461-AH 0.0000 0.2812 0.4688 0.5938 0.7188 0.4392 0.1933 0.3125 0.7188 0.4402 0.2411 0.0002 0.1637 0.0000 0.7188 0.4392 0.1933 462-AH 0.1000 0.2000 0.4000 0.5000 0.6000 0.3649 0.1531 0.3000 0.5000 0.4197 0.3305 0.2952 0.1388 0.1000 0.6000 0.3649 0.1531 463-AH 0.0000 0.0290 0.0580 0.3333 0.4928 0.1641 0.1782 0.3043 0.4928 1.0859 0.0526 0.0002 0.1594 0.0000 0.4928 0.1641 0.1782 464-AH 0.0465 0.2791 0.4884 0.5349 0.5581 0.4104 0.1506 0.2558 0.5116 0.3670 0.3702 0.3036 0.1334 0.0465 0.5581 0.4104 0.1506 465-AH 0.0000 0.0435 0.1196 0.1848 0.3370 0.1275 0.0972 0.1413 0.3370 0.7624 0.0450 0.0001 0.0834 0.0000 0.3370 0.1275 0.0972 466-AH 0.0149 0.1343 0.2836 0.3396 0.4925 0.2562 0.1254 0.2052 0.4776 0.4897 0.2145 0.1479 0.1048 0.0149 0.4925 0.2562 0.1254 467-AH 0.1379 0.2759 0.3103 0.3793 0.4483 0.3187 0.0733 0.1034 0.3103 0.2301 0.3091 0.2973 0.0594 0.1379 0.4483 0.3187 0.0733 468-AH 0.0000 0.2807 0.3509 0.3772 0.4474 0.3170 0.0993 0.0965 0.4474 0.3133 0.1871 0.0002 0.0700 0.1842 0.4474 0.3351 0.0648 469-AH 0.0500 0.1500 0.2000 0.3000 0.5000 0.2284 0.1115 0.1500 0.4500 0.4883 0.1986 0.1645 0.0917 0.0500 0.5000 0.2284 0.1115 470-AH 0.0000 0.1867 0.3067 0.3633 0.5067 0.2764 0.1353 0.1767 0.5067 0.4897 0.1175 0.0001 0.1061 0.0000 0.5067 0.2764 0.1353 471-AH 0.0000 0.1846 0.5981 0.7126 0.7944 0.4703 0.2723 0.5280 0.7944 0.5791 0.2854 0.0004 0.2542 0.0000 0.7944 0.4703 0.2723 472-AH 0.0000 0.3829 0.4421 0.5013 0.5684 0.4316 0.1019 0.1184 0.5684 0.2362 0.3278 0.0004 0.0711 0.2947 0.5684 0.4436 0.0722 473-AH 0.0000 0.0000 0.0000 0.1429 0.1429 0.0425 0.0662 0.1429 0.1429 1.5586 0.0002 0.0000 0.0597 0.0000 0.1429 0.0425 0.0662 474-AH 0.0000 0.2043 0.2366 0.2930 0.5161 0.2447 0.1120 0.0887 0.5161 0.4579 0.1650 0.0004 0.0798 0.0860 0.4194 0.2581 0.0699 475-AH 0.0000 0.0667 0.1167 0.1667 0.5000 0.1243 0.0946 0.1000 0.5000 0.7607 0.0427 0.0001 0.0659 0.0000 0.3000 0.1139 0.0711 476-AH 0.0000 0.1006 0.1829 0.3079 0.3659 0.1935 0.1231 0.2073 0.3659 0.6363 0.0511 0.0001 0.1043 0.0000 0.3659 0.1935 0.1231 477-AH 0.0000 0.1378 0.2041 0.2857 0.4286 0.2140 0.0971 0.1480 0.4286 0.4538 0.1542 0.0004 0.0786 0.0000 0.4286 0.2140 0.0971 478-AH 0.0000 0.0000 0.0625 0.1250 0.5312 0.0921 0.1303 0.1250 0.5312 1.4154 0.0040 0.0000 0.0857 0.0000 0.2812 0.0588 0.0652 479-AH 0.0000 0.3984 0.6562 0.8203 0.9062 0.6005 0.2630 0.4219 0.9062 0.4380 0.4039 0.0004 0.2196 0.0000 0.9062 0.6005 0.2630 480-AH 0.0000 0.2857 0.4286 0.4732 0.5714 0.4015 0.1227 0.1875 0.5714 0.3055 0.2990 0.0004 0.0978 0.1786 0.5714 0.4127 0.1037 481-AH 0.0000 0.5933 0.7761 0.8358 0.8657 0.6862 0.2009 0.2425 0.8657 0.2928 0.5042 0.0004 0.1563 0.3284 0.8657 0.7052 0.1664 482-AH 0.0000 0.4807 0.8036 0.8571 0.9167 0.6604 0.2643 0.3765 0.9167 0.4003 0.4553 0.0004 0.2273 0.0000 0.9167 0.6604 0.2643 483-AH 0.0000 0.4720 0.5760 0.6320 0.6880 0.5254 0.1598 0.1600 0.6880 0.3041 0.3806 0.0004 0.1158 0.3360 0.6880 0.5638 0.0924 484-AH 0.0000 0.0789 0.4474 0.5000 0.6316 0.3407 0.2201 0.4211 0.6316 0.6460 0.0493 0.0001 0.1952 0.0000 0.6316 0.3407 0.2201 485-AH 0.0000 0.1429 0.1429 0.2857 0.4286 0.1853 0.1254 0.1429 0.4286 0.6765 0.0320 0.0001 0.1046 0.0000 0.4286 0.1853 0.1254 486-AH 0.0000 0.1500 0.1833 0.2208 0.4167 0.1820 0.0863 0.0708 0.4167 0.4741 0.0844 0.0001 0.0591 0.0833 0.3167 0.1870 0.0538 487-AH 0.0000 0.0000 0.0690 0.1034 0.5517 0.0857 0.1116 0.1034 0.5517 1.3019 0.0060 0.0000 0.0749 0.0000 0.2069 0.0543 0.0532 488-AH 0.0000 0.1429 0.1429 0.2857 0.5714 0.1892 0.1391 0.1429 0.5714 0.7350 0.0404 0.0001 0.1089 0.0000 0.4286 0.1786 0.1249 489-AH 0.0000 0.2357 0.5820 0.6250 0.7541 0.4546 0.2144 0.3893 0.7541 0.4716 0.2438 0.0002 0.1907 0.0000 0.7541 0.4546 0.2144 490-AH 0.0000 0.5556 0.7222 0.7917 0.8889 0.6411 0.2142 0.2361 0.8889 0.3341 0.4602 0.0004 0.1636 0.2222 0.8889 0.6730 0.1698 491-AH 0.0000 0.0556 0.1111 0.1667 0.3333 0.1186 0.0927 0.1111 0.3333 0.7819 0.0169 0.0000 0.0772 0.0000 0.3333 0.1186 0.0927 492-AH 0.0000 0.2187 0.3750 0.3750 0.5000 0.2804 0.1570 0.1563 0.5000 0.5600 0.0463 0.0001 0.1311 0.0000 0.5000 0.2804 0.1570 493-AH 0.0000 0.4202 0.5319 0.7021 0.8723 0.5342 0.1984 0.2819 0.8723 0.3715 0.3788 0.0004 0.1566 0.0000 0.8723 0.5342 0.1984 494-AH 0.0000 0.4435 0.5726 0.6452 0.7097 0.4922 0.2133 0.2016 0.7097 0.4334 0.2072 0.0001 0.1645 0.1452 0.7097 0.5484 0.1439 495-AH 0.0000 0.0909 0.1818 0.2955 0.3636 0.1941 0.1341 0.2045 0.3636 0.6908 0.0259 0.0000 0.1122 0.0000 0.3636 0.1941 0.1341 496-AH 0.0000 0.3879 0.6324 0.6949 0.7794 0.5447 0.2039 0.3070 0.7794 0.3743 0.3885 0.0004 0.1705 0.0000 0.7794 0.5447 0.2039 497-AH 0.0000 0.0000 0.0000 0.1250 0.1250 0.0338 0.0563 0.1250 0.1250 1.6658 0.0001 0.0000 0.0493 0.0000 0.1250 0.0338 0.0563 498-AH 0.0000 0.1111 0.1481 0.1852 0.2963 0.1411 0.0724 0.0741 0.2963 0.5132 0.0656 0.0001 0.0556 0.0741 0.2222 0.1398 0.0435 499-AH 0.0000 0.1000 0.1333 0.1667 0.2000 0.1207 0.0590 0.0667 0.2000 0.4886 0.0372 0.0001 0.0463 0.0000 0.2000 0.1207 0.0590 500-AH 0.0000 0.4545 0.5455 0.5455 0.6364 0.4889 0.1292 0.0909 0.6364 0.2642 0.3663 0.0004 0.0924 0.3636 0.6364 0.5117 0.0856

AH-TEL-CLEF2008 Track Overview Results and Graphs AH-TEL-MONO-EN-CLEF2008

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

451-AH 0.0000 0.0640 0.0918 0.1391 0.2176 0.0979 0.0566 0.0751 0.2176 0.5784 0.0367 0.0001 0.0452 0.0000 0.2176 0.0979 0.0566 452-AH 0.0609 0.2555 0.4100 0.4931 0.5596 0.3773 0.1375 0.2375 0.4986 0.3645 0.3424 0.2910 0.1141 0.0609 0.5596 0.3773 0.1375 453-AH 0.0000 0.0197 0.0571 0.1174 0.3443 0.0837 0.0814 0.0978 0.3443 0.9719 0.0168 0.0001 0.0618 0.0000 0.1869 0.0698 0.0575 454-AH 0.0000 0.2500 0.3516 0.4150 0.5156 0.3157 0.1372 0.1650 0.5156 0.4347 0.1747 0.0002 0.1100 0.0625 0.5156 0.3337 0.1172 455-AH 0.0000 0.0903 0.1528 0.1684 0.2500 0.1331 0.0653 0.0781 0.2500 0.4904 0.0503 0.0001 0.0520 0.0000 0.2500 0.1331 0.0653 456-AH 0.0000 0.0000 0.0191 0.0473 0.1389 0.0311 0.0397 0.0473 0.1389 1.2776 0.0009 0.0000 0.0314 0.0000 0.1007 0.0252 0.0318 457-AH 0.0932 0.1805 0.1982 0.2193 0.2707 0.1992 0.0299 0.0388 0.1775 0.1502 0.1966 0.1934 0.0223 0.1553 0.2707 0.2022 0.0243 458-AH 0.0714 0.1071 0.1543 0.2261 0.3291 0.1746 0.0805 0.1189 0.2577 0.4613 0.1578 0.1434 0.0676 0.0714 0.3291 0.1746 0.0805 459-AH 0.0000 0.0000 0.0000 0.3079 0.6281 0.1660 0.2331 0.3079 0.6281 1.4047 0.0009 0.0000 0.2023 0.0000 0.6281 0.1660 0.2331 460-AH 0.0263 0.0296 0.2590 0.4288 0.7292 0.2607 0.2237 0.3992 0.7029 0.8580 0.1491 0.0744 0.1887 0.0263 0.7292 0.2607 0.2237 461-AH 0.0000 0.2356 0.5156 0.6101 0.7344 0.4283 0.2137 0.3745 0.7344 0.4990 0.2268 0.0002 0.1882 0.0000 0.7344 0.4283 0.2137 462-AH 0.0700 0.2000 0.3400 0.4925 0.6300 0.3441 0.1598 0.2925 0.5600 0.4644 0.3055 0.2656 0.1415 0.0700 0.6300 0.3441 0.1598 463-AH 0.0000 0.0158 0.0397 0.2846 0.5068 0.1425 0.1683 0.2689 0.5068 1.1806 0.0376 0.0002 0.1482 0.0000 0.5068 0.1425 0.1683 464-AH 0.0324 0.1685 0.4527 0.4999 0.5803 0.3627 0.1663 0.3314 0.5479 0.4585 0.3083 0.2311 0.1496 0.0324 0.5803 0.3627 0.1663 465-AH 0.0000 0.0400 0.0812 0.1665 0.2745 0.1009 0.0807 0.1265 0.2745 0.7999 0.0459 0.0004 0.0680 0.0000 0.2745 0.1009 0.0807 466-AH 0.0125 0.1195 0.2107 0.3062 0.4159 0.2187 0.1150 0.1868 0.4034 0.5260 0.1801 0.1228 0.0974 0.0125 0.4159 0.2187 0.1150 467-AH 0.1141 0.2227 0.2889 0.3478 0.4055 0.2849 0.0836 0.1251 0.2913 0.2936 0.2713 0.2560 0.0703 0.1141 0.4055 0.2849 0.0836 468-AH 0.0000 0.3029 0.3333 0.3822 0.4767 0.3235 0.0992 0.0793 0.4767 0.3067 0.1915 0.0002 0.0637 0.2189 0.4767 0.3420 0.0626 469-AH 0.0050 0.0969 0.1325 0.2531 0.4475 0.1719 0.1064 0.1562 0.4425 0.6188 0.1336 0.0734 0.0893 0.0050 0.4475 0.1719 0.1064 470-AH 0.0000 0.1805 0.2617 0.3436 0.5632 0.2472 0.1305 0.1631 0.5632 0.5281 0.1056 0.0001 0.1003 0.0000 0.5632 0.2472 0.1305 471-AH 0.0000 0.2430 0.7148 0.7728 0.8612 0.5447 0.2977 0.5298 0.8612 0.5466 0.3265 0.0004 0.2617 0.0000 0.8612 0.5447 0.2977 472-AH 0.0000 0.5917 0.6165 0.6544 0.8550 0.6113 0.1318 0.0627 0.8550 0.2156 0.4622 0.0004 0.0703 0.5135 0.7468 0.6236 0.0498 473-AH 0.0000 0.0000 0.0000 0.0306 0.1429 0.0254 0.0452 0.0306 0.1429 1.7826 0.0001 0.0000 0.0362 0.0000 0.0612 0.0054 0.0160 474-AH 0.0000 0.1892 0.1994 0.2468 0.5065 0.2166 0.0992 0.0576 0.5065 0.4581 0.1511 0.0004 0.0669 0.1626 0.2793 0.2152 0.0309 475-AH 0.0000 0.0370 0.0992 0.1276 0.4411 0.0987 0.0887 0.0906 0.4411 0.8992 0.0325 0.0001 0.0618 0.0000 0.2094 0.0826 0.0563 476-AH 0.0000 0.1102 0.1755 0.2600 0.3206 0.1715 0.0986 0.1498 0.3206 0.5751 0.0703 0.0001 0.0820 0.0000 0.3206 0.1715 0.0986 477-AH 0.0000 0.1182 0.1695 0.2567 0.3769 0.1896 0.0902 0.1385 0.3769 0.4757 0.1340 0.0004 0.0741 0.0000 0.3769 0.1896 0.0902 478-AH 0.0000 0.0000 0.0518 0.0935 0.4502 0.0742 0.1093 0.0935 0.4502 1.4737 0.0034 0.0000 0.0735 0.0000 0.2100 0.0466 0.0562 479-AH 0.0000 0.3835 0.6904 0.8389 0.9375 0.6045 0.2862 0.4553 0.9375 0.4734 0.3799 0.0004 0.2402 0.0000 0.9375 0.6045 0.2862 480-AH 0.0000 0.2864 0.3763 0.4726 0.5816 0.3685 0.1325 0.1862 0.5816 0.3596 0.2689 0.0004 0.1075 0.1365 0.5816 0.3788 0.1186 481-AH 0.0000 0.6352 0.8169 0.8670 0.8944 0.7163 0.2081 0.2317 0.8944 0.2906 0.5264 0.0004 0.1649 0.3582 0.8944 0.7362 0.1717 482-AH 0.0000 0.7606 0.9794 0.9914 0.9977 0.8571 0.2200 0.2307 0.9977 0.2567 0.6310 0.0004 0.1562 0.4989 0.9977 0.8988 0.1313 483-AH 0.0000 0.6318 0.6946 0.7314 0.8108 0.6528 0.1527 0.0996 0.8108 0.2338 0.4897 0.0004 0.1033 0.5021 0.8108 0.6930 0.0787 484-AH 0.0000 0.0789 0.4217 0.4811 0.6053 0.3210 0.2065 0.4022 0.6053 0.6432 0.0473 0.0001 0.1819 0.0000 0.6053 0.3210 0.2065 485-AH 0.0000 0.0969 0.1429 0.2857 0.3673 0.1594 0.1113 0.1888 0.3673 0.6985 0.0278 0.0001 0.0927 0.0000 0.3673 0.1594 0.1113 486-AH 0.0000 0.1351 0.1492 0.1876 0.3925 0.1616 0.0791 0.0526 0.3925 0.4893 0.0754 0.0001 0.0544 0.0733 0.2597 0.1612 0.0435 487-AH 0.0000 0.0098 0.0523 0.0892 0.5232 0.0706 0.0966 0.0794 0.5232 1.3682 0.0090 0.0000 0.0583 0.0000 0.1724 0.0479 0.0434 488-AH 0.0000 0.0816 0.1429 0.2092 0.4898 0.1572 0.1228 0.1276 0.4898 0.7813 0.0334 0.0001 0.0919 0.0000 0.3878 0.1405 0.1029 489-AH 0.0000 0.3888 0.6345 0.7782 0.8655 0.5833 0.2332 0.3894 0.8655 0.3998 0.3992 0.0004 0.1905 0.0000 0.8655 0.5833 0.2332 490-AH 0.0000 0.5363 0.7037 0.8025 0.8642 0.6353 0.2250 0.2662 0.8642 0.3542 0.4477 0.0004 0.1749 0.1698 0.8642 0.6681 0.1814 491-AH 0.0000 0.0316 0.0710 0.1427 0.2747 0.0882 0.0734 0.1111 0.2747 0.8330 0.0127 0.0000 0.0615 0.0000 0.2747 0.0882 0.0734 492-AH 0.0000 0.0977 0.3281 0.3750 0.5000 0.2542 0.1586 0.2773 0.5000 0.6237 0.0386 0.0001 0.1339 0.0000 0.5000 0.2542 0.1586 493-AH 0.0000 0.4378 0.5663 0.7239 0.9620 0.5607 0.2287 0.2861 0.9620 0.4079 0.3826 0.0004 0.1824 0.0290 0.9620 0.5763 0.2111 494-AH 0.0000 0.5316 0.6485 0.7221 0.8418 0.5841 0.2192 0.1905 0.8418 0.3753 0.2527 0.0001 0.1592 0.2904 0.8418 0.6356 0.1367 495-AH 0.0000 0.0579 0.1736 0.2521 0.3306 0.1617 0.1122 0.1942 0.3306 0.6937 0.0215 0.0000 0.0949 0.0000 0.3306 0.1617 0.1122 496-AH 0.0000 0.6105 0.7833 0.8268 0.8903 0.6993 0.1937 0.2162 0.8903 0.2770 0.5166 0.0004 0.1489 0.3525 0.8903 0.7187 0.1557 497-AH 0.0000 0.0000 0.0000 0.0234 0.1094 0.0228 0.0413 0.0234 0.1094 1.8099 0.0001 0.0000 0.0337 0.0000 0.0469 0.0022 0.0091 498-AH 0.0000 0.0796 0.0988 0.1553 0.2853 0.1165 0.0671 0.0758 0.2853 0.5760 0.0537 0.0001 0.0514 0.0000 0.2647 0.1072 0.0560 499-AH 0.0000 0.0883 0.1222 0.1419 0.1789 0.1059 0.0483 0.0536 0.1789 0.4563 0.0502 0.0001 0.0375 0.0300 0.1789 0.1152 0.0379 500-AH 0.0000 0.4545 0.5372 0.5744 0.6364 0.4851 0.1429 0.1198 0.6364 0.2946 0.3560 0.0004 0.1004 0.3636 0.6364 0.5257 0.0762

Statistics for Precision at the 0% interpolated recall level

Topic Min 1st Q 2nd Q 3rd Q Max Mean Std IQR Range C.Var Geom. Harm. MAD LOT UOT MNO SNO

451-AH 0.0000 0.2768 1.0000 1.0000 1.0000 0.6931 0.4002 0.7232 1.0000 0.5773 0.2460 0.0001 0.3649 0.0000 1.0000 0.6931 0.4002 452-AH 0.1429 1.0000 1.0000 1.0000 1.0000 0.9395 0.2085 0.0000 0.8571 0.2219 0.8889 0.7724 0.1111 1.0000 1.0000 1.0000 0.0000 453-AH 0.0000 0.0661 0.5000 0.6667 1.0000 0.4253 0.3292 0.6005 1.0000 0.7740 0.1514 0.0002 0.2812 0.0000 1.0000 0.4253 0.3292 454-AH 0.0000 0.8000 1.0000 1.0000 1.0000 0.8691 0.2366 0.2000 1.0000 0.2722 0.5693 0.0004 0.1492 0.6667 1.0000 0.9187 0.1114 455-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.8394 0.3304 0.0000 1.0000 0.3936 0.4113 0.0002 0.2517 1.0000 1.0000 1.0000 0.0000 456-AH 0.0000 0.0079 0.0714 0.2036 1.0000 0.1704 0.2517 0.1956 1.0000 1.4771 0.0151 0.0001 0.1760 0.0000 0.4000 0.0876 0.1076 457-AH 0.6000 1.0000 1.0000 1.0000 1.0000 0.9802 0.0844 0.0000 0.4000 0.0861 0.9755 0.9694 0.0375 1.0000 1.0000 1.0000 0.0000 458-AH 0.2656 1.0000 1.0000 1.0000 1.0000 0.9144 0.2222 0.0000 0.7344 0.2430 0.8694 0.7952 0.1481 1.0000 1.0000 1.0000 0.0000 459-AH 0.0000 0.0609 0.1250 1.0000 1.0000 0.4306 0.4555 0.9391 1.0000 1.0579 0.1157 0.0002 0.4309 0.0000 1.0000 0.4306 0.4555 460-AH 0.2500 1.0000 1.0000 1.0000 1.0000 0.9662 0.1463 0.0000 0.7500 0.1514 0.9453 0.9024 0.0639 1.0000 1.0000 1.0000 0.0000 461-AH 0.0294 1.0000 1.0000 1.0000 1.0000 0.9297 0.2433 0.0000 0.9706 0.2617 0.8071 0.3765 0.1292 1.0000 1.0000 1.0000 0.0000 462-AH 0.2500 1.0000 1.0000 1.0000 1.0000 0.9302 0.1858 0.0000 0.7500 0.1998 0.9007 0.8506 0.1208 1.0000 1.0000 1.0000 0.0000 463-AH 0.0000 0.0637 0.3333 0.6719 1.0000 0.3849 0.3389 0.6081 1.0000 0.8806 0.1343 0.0002 0.3009 0.0000 1.0000 0.3849 0.3389 464-AH 0.1985 0.3561 0.8182 1.0000 1.0000 0.7123 0.2881 0.6439 0.8015 0.4045 0.6362 0.5467 0.2504 0.1985 1.0000 0.7123 0.2881 465-AH 0.0585 0.1250 0.5000 1.0000 1.0000 0.5355 0.3983 0.8750 0.9415 0.7438 0.3393 0.1851 0.3655 0.0585 1.0000 0.5355 0.3983 466-AH 0.0833 1.0000 1.0000 1.0000 1.0000 0.9120 0.2450 0.0000 0.9167 0.2686 0.8371 0.6553 0.1521 1.0000 1.0000 1.0000 0.0000 467-AH 0.3000 0.5530 1.0000 1.0000 1.0000 0.8176 0.2610 0.4470 0.7000 0.3193 0.7651 0.7022 0.2366 0.3000 1.0000 0.8176 0.2610 468-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9343 0.2317 0.0000 1.0000 0.2480 0.5297 0.0002 0.1172 1.0000 1.0000 1.0000 0.0000 469-AH 0.0606 0.2727 0.5000 1.0000 1.0000 0.6277 0.3761 0.7273 0.9394 0.5991 0.4898 0.3495 0.3622 0.0606 1.0000 0.6277 0.3761 470-AH 0.0000 0.6475 1.0000 1.0000 1.0000 0.7545 0.3306 0.3525 1.0000 0.4382 0.3026 0.0001 0.2654 0.1429 1.0000 0.8429 0.2194 471-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9139 0.2061 0.0000 1.0000 0.2255 0.6805 0.0004 0.1397 1.0000 1.0000 1.0000 0.0000 472-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9443 0.2006 0.0000 1.0000 0.2125 0.7032 0.0004 0.1023 1.0000 1.0000 1.0000 0.0000 473-AH 0.0000 0.0326 0.0833 0.1571 1.0000 0.1451 0.1972 0.1246 1.0000 1.3594 0.0342 0.0001 0.1267 0.0000 0.2500 0.0869 0.0748 474-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.8902 0.2714 0.0000 1.0000 0.3048 0.6171 0.0004 0.1781 1.0000 1.0000 1.0000 0.0000 475-AH 0.0000 0.1721 1.0000 1.0000 1.0000 0.6331 0.4144 0.8279 1.0000 0.6546 0.2073 0.0001 0.3876 0.0000 1.0000 0.6331 0.4144 476-AH 0.0000 0.4848 0.6667 1.0000 1.0000 0.6406 0.3353 0.5152 1.0000 0.5234 0.2597 0.0002 0.2657 0.0000 1.0000 0.6406 0.3353 477-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9125 0.2566 0.0000 1.0000 0.2812 0.6449 0.0004 0.1513 1.0000 1.0000 1.0000 0.0000 478-AH 0.0000 0.0554 0.1034 0.7000 1.0000 0.3787 0.3969 0.6446 1.0000 1.0481 0.1479 0.0004 0.3535 0.0000 1.0000 0.3787 0.3969 479-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9058 0.2652 0.0000 1.0000 0.2928 0.6332 0.0004 0.1574 1.0000 1.0000 1.0000 0.0000 480-AH 0.0000 0.6667 1.0000 1.0000 1.0000 0.8315 0.2629 0.3333 1.0000 0.3162 0.6001 0.0004 0.2185 0.2917 1.0000 0.8546 0.2254 481-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9656 0.1651 0.0000 1.0000 0.1710 0.7270 0.0004 0.0614 1.0000 1.0000 1.0000 0.0000 482-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9582 0.1816 0.0000 1.0000 0.1896 0.7181 0.0004 0.0769 1.0000 1.0000 1.0000 0.0000 483-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9596 0.1690 0.0000 1.0000 0.1761 0.7219 0.0004 0.0721 1.0000 1.0000 1.0000 0.0000 484-AH 0.0000 0.7096 1.0000 1.0000 1.0000 0.7813 0.3960 0.2904 1.0000 0.5069 0.1091 0.0001 0.3191 0.5714 1.0000 0.9637 0.1139 485-AH 0.0000 0.2431 0.5000 1.0000 1.0000 0.5895 0.4062 0.7569 1.0000 0.6891 0.1692 0.0001 0.3772 0.0000 1.0000 0.5895 0.4062 486-AH 0.0000 0.5385 0.6154 1.0000 1.0000 0.6778 0.2984 0.4615 1.0000 0.4402 0.2836 0.0001 0.2355 0.0000 1.0000 0.6778 0.2984 487-AH 0.0000 0.0286 0.3333 1.0000 1.0000 0.4701 0.4409 0.9714 1.0000 0.9380 0.1343 0.0004 0.4043 0.0000 1.0000 0.4701 0.4409 488-AH 0.0000 0.2500 1.0000 1.0000 1.0000 0.6673 0.4071 0.7500 1.0000 0.6100 0.2264 0.0001 0.3777 0.0000 1.0000 0.6673 0.4071 489-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.8686 0.2885 0.0000 1.0000 0.3322 0.5693 0.0004 0.2132 1.0000 1.0000 1.0000 0.0000 490-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9696 0.1651 0.0000 1.0000 0.1703 0.7300 0.0004 0.0575 1.0000 1.0000 1.0000 0.0000 491-AH 0.0000 0.1607 0.3750 0.6786 1.0000 0.4334 0.3666 0.5179 1.0000 0.8459 0.1283 0.0001 0.3047 0.0000 1.0000 0.4334 0.3666 492-AH 0.0000 0.2813 1.0000 1.0000 1.0000 0.7044 0.4034 0.7187 1.0000 0.5727 0.2181 0.0001 0.3454 0.0000 1.0000 0.7044 0.4034 493-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9281 0.2265 0.0000 1.0000 0.2441 0.6673 0.0004 0.1244 1.0000 1.0000 1.0000 0.0000 494-AH 0.0000 0.7108 0.9737 1.0000 1.0000 0.7922 0.3021 0.2892 1.0000 0.3813 0.3310 0.0001 0.2206 0.5000 1.0000 0.8824 0.1555 495-AH 0.0000 0.2833 1.0000 1.0000 1.0000 0.6851 0.4190 0.7167 1.0000 0.6115 0.2737 0.0004 0.3745 0.0000 1.0000 0.6851 0.4190 496-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9730 0.1644 0.0000 1.0000 0.1690 0.7326 0.0004 0.0526 1.0000 1.0000 1.0000 0.0000 497-AH 0.0000 0.0174 0.0500 0.1354 0.5000 0.1210 0.1607 0.1180 0.5000 1.3277 0.0450 0.0004 0.1233 0.0000 0.2000 0.0492 0.0473 498-AH 0.0000 0.5000 1.0000 1.0000 1.0000 0.7033 0.3438 0.5000 1.0000 0.4889 0.2834 0.0001 0.3048 0.0000 1.0000 0.7033 0.3438 499-AH 0.0000 0.6667 1.0000 1.0000 1.0000 0.7589 0.3813 0.3333 1.0000 0.5024 0.3956 0.0004 0.3128 0.1818 1.0000 0.8990 0.2215 500-AH 0.0000 1.0000 1.0000 1.0000 1.0000 0.9527 0.2027 0.0000 1.0000 0.2128 0.7057 0.0004 0.0895 1.0000 1.0000 1.0000 0.0000