• Aucun résultat trouvé

Evaluating named entity recognition and disambiguation in news and tweets

N/A
N/A
Protected

Academic year: 2022

Partager "Evaluating named entity recognition and disambiguation in news and tweets"

Copied!
1
0
0

Texte intégral

(1)

Evaluating Named Entity Recognition and Disambiguation in News and Tweets

Giuseppe Rizzo

∗1,2

, Marieke van Erp

†3

, and Rapha¨ el Troncy

‡2

1

Universit` a di Torino, Turin, Italy

2

EURECOM, Biot, France

3

VU University Amsterdam, The Netherlands

Named entity recognition and disambiguation are important for information extraction and populating knowledge bases. Detecting and classifying named entities has traditionally been taken on by the natural language processing com- munity, whilst linking of entities to external resources, such as DBpedia and GeoNames, has been the domain of the Semantic Web community. As these tasks are treated in different communities, it is difficult to assess the perfor- mance of these tasks combined.

We conduct a thorough evaluation of the NERD-ML approach [2], an ap- proach that combines named entity recognition (NER) from the NLP community and named entity linking (NEL) from the SW community. We present experi- ments and results on the CoNLL 2003 English 20031 dataset for NER and the AIDA CoNLL-YAGO22 dataset for NEL in the newswire domain and on the MSM’133 corpus for NER and the Dercynski et al. [1] dataset for NEL in the twitter domain.

Our results indicate that combining approaches from the NLP and SW com- munities improves the performance for NER. As the NEL task is more recent, there is as yet no common agreement on the annotation level to adopt, which makes it difficult to assess the performance of different systems.

References

[1] Leon Derczynski, Diana Maynard, Giuseppe Rizzo, Niraj Aswani, Marieke van Erp, Rapha¨el Troncy, and Kalina Bontcheva. Named Entity Recognition and Linking for Microblogs. Currently under review, 2013.

[2] M. van Erp, G. Rizzo, and R. Troncy. Learning with the Web: Spotting Named Entities on the intersection of NERD and Machine Learning. In3rd Workshop on Making Sense of Microposts (#MSM2013), 2013.

giuseppe.rizzo@di.unito.it

marieke.van.erp@vu.nl

raphael.troncy@eurecom.fr

1http://www.cnts.ua.ac.be/conll2003/ner

2http://www.mpi-inf.mpg.de/yago-naga/aida/downloads.html

3http://oak.dcs.shef.ac.uk/msm2013

1

Références

Documents relatifs

The proposed pipeline, which represents an en- try level system, is composed of three main steps: (1) Named Entity Recog- nition using Conditional Random Fields, (2) Named

Both experiments are done on 4 training models: models 1 and 2 were trained on a 1 billion corpus (word forms and lexemes respec- tively) and models 3 and 4 were trained on a

In this work we have identified the mention by creating an entity recognition model on the given training data and link them to the DBpedia using DBpedia Spotlight.. The rest of

In this demo, we will present AGDISTIS deployed on three different languages (English, German and Chinese) and three different knowledge bases (DBpedia, the German DBpedia and

In this study, we try a simple approach to NER from microposts using existing, readily available Natural Lan- guage Processing (NLP) tools.. In order to circumvent the problem

We show that our SVM approach can improve disambiguation efficiency using syntactic fea- tures provided by the Fips parser and popularity score features extracted from the

The system expands the training set of annotated tweets with part-of- speech tags and seedlist information, and then generates a sequential memory-based tagger comprised of

Our contributions are :- 1) An approach which utilizes the titles, anchors and infoboxes contained in Wikipedia and a little information from Wordnet and the context information