The Methodology of Manual Assessment in the Evaluation of Link Discovery

From Wikipedia Quality
Jump to: navigation, search
The Methodology of Manual Assessment in the Evaluation of Link Discovery
Authors
Weiche Huang
Andrew Trotman
Shlomo Geva
Publication date
2009
ISBN
978-174210171-2
Links

The Methodology of Manual Assessment in the Evaluation of Link Discovery - scientific work about Wikipedia quality published in 2009, written by Weiche Huang, Andrew Trotman and Shlomo Geva.

Overview

The link graph extracted from the Wikipedia has often been used as the ground truth for measuring the performance of automated link discovery systems. Extensive manual assessments experiments at INEX 2008 recently showed that this is unsound and that manual assessment is essential. This paper describes the methodology for link discovery evaluation which was developed for use in the INEX 2009 Link-the-Wiki track. In this approach both manual and automatic assessment sets are generated and runs are evaluated using both. The approach offers a more reliable evaluation of link discovery methods than just automatic assessment. A new evaluation measure for focused link discovery is also introduced.

Embed

Wikipedia Quality

Huang, Weiche; Trotman, Andrew; Geva, Shlomo. (2009). "[[The Methodology of Manual Assessment in the Evaluation of Link Discovery]]". CEUR Workshop Proceedings Volume 449, 2009, 12p. ISBN: 978-174210171-2.

English Wikipedia

{{cite journal |last1=Huang |first1=Weiche |last2=Trotman |first2=Andrew |last3=Geva |first3=Shlomo |title=The Methodology of Manual Assessment in the Evaluation of Link Discovery |date=2009 |isbn=978-174210171-2 |url=https://wikipediaquality.com/wiki/The_Methodology_of_Manual_Assessment_in_the_Evaluation_of_Link_Discovery |journal=CEUR Workshop Proceedings Volume 449, 2009, 12p}}

HTML

Huang, Weiche; Trotman, Andrew; Geva, Shlomo. (2009). &quot;<a href="https://wikipediaquality.com/wiki/The_Methodology_of_Manual_Assessment_in_the_Evaluation_of_Link_Discovery">The Methodology of Manual Assessment in the Evaluation of Link Discovery</a>&quot;. CEUR Workshop Proceedings Volume 449, 2009, 12p. ISBN: 978-174210171-2.