The Methodology of Manual Assessment in the Evaluation of Link Discovery
Authors | Weiche Huang Andrew Trotman Shlomo Geva |
---|---|
Publication date | 2009 |
ISBN | 978-174210171-2 |
Links |
The Methodology of Manual Assessment in the Evaluation of Link Discovery - scientific work about Wikipedia quality published in 2009, written by Weiche Huang, Andrew Trotman and Shlomo Geva.
Overview
The link graph extracted from the Wikipedia has often been used as the ground truth for measuring the performance of automated link discovery systems. Extensive manual assessments experiments at INEX 2008 recently showed that this is unsound and that manual assessment is essential. This paper describes the methodology for link discovery evaluation which was developed for use in the INEX 2009 Link-the-Wiki track. In this approach both manual and automatic assessment sets are generated and runs are evaluated using both. The approach offers a more reliable evaluation of link discovery methods than just automatic assessment. A new evaluation measure for focused link discovery is also introduced.
Embed
Wikipedia Quality
Huang, Weiche; Trotman, Andrew; Geva, Shlomo. (2009). "[[The Methodology of Manual Assessment in the Evaluation of Link Discovery]]". CEUR Workshop Proceedings Volume 449, 2009, 12p. ISBN: 978-174210171-2.
English Wikipedia
{{cite journal |last1=Huang |first1=Weiche |last2=Trotman |first2=Andrew |last3=Geva |first3=Shlomo |title=The Methodology of Manual Assessment in the Evaluation of Link Discovery |date=2009 |isbn=978-174210171-2 |url=https://wikipediaquality.com/wiki/The_Methodology_of_Manual_Assessment_in_the_Evaluation_of_Link_Discovery |journal=CEUR Workshop Proceedings Volume 449, 2009, 12p}}
HTML
Huang, Weiche; Trotman, Andrew; Geva, Shlomo. (2009). "<a href="https://wikipediaquality.com/wiki/The_Methodology_of_Manual_Assessment_in_the_Evaluation_of_Link_Discovery">The Methodology of Manual Assessment in the Evaluation of Link Discovery</a>". CEUR Workshop Proceedings Volume 449, 2009, 12p. ISBN: 978-174210171-2.