webLyzard Publications

Introducing Orbis: An Extendable Evaluation Pipeline for Named Entity Linking Drill-Down Analysis

Odoni, Fabian and Brasoveanu, Adrian M.P. and Kuntschik, Philipp and Weichselbraun, Albert (2019) Introducing Orbis: An Extendable Evaluation Pipeline for Named Entity Linking Drill-Down Analysis. In: 82nd Annual Meeting of The Association for Information Science (ASIS&T 2019), 19-23 October 2019, Melbourne, Australia.

[thumbnail of Introducing Orbis: An Extendable Evaluation Pipeline for Named Entity Linking Performance Drill-Down Analyses] PDF (Introducing Orbis: An Extendable Evaluation Pipeline for Named Entity Linking Performance Drill-Down Analyses) - Published Version
304kB

Abstract

Most current evaluation tools are focused solely on benchmarking and comparative evaluations thus only provide aggregated statistics such as precision, recall and F1-measure to assess overall system performance. They do not offer comprehensive analyses up to the level of individual annotations. This paper introduces Orbis, an extendable evaluation pipeline framework developed to allow visual drill-down analyses of individual entities, computed by annotation services, in the context of the text they appear in, in reference to the entities specified in the gold standard.

Item Type:Conference or Workshop Item (Paper)
Subjects:Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions:Faculty of Engineering, Science and Mathematics > School of Electronics and Computer Science
ID Code:114
Deposited By: Dr Albert Weichselbraun
Deposited On:03 Mar 2020 08:11
Last Modified:03 Mar 2020 08:11

Repository Staff Only: item control page