A New Approach for Building Domain-Specific Corpus with Wikipedia

From Wikipedia Quality
Revision as of 11:05, 16 November 2019 by Zoe (talk | contribs) (+ wikilinks)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

A New Approach for Building Domain-Specific Corpus with Wikipedia - scientific work related to Wikipedia quality published in 2013, written by Xin Ye Zhang, Xiu Li and Zhi Jian Ruan.

Overview

Domain-specific corpus can be used to build domain ontology, which is used in many areas such as IR, NLP and web Mining. Authors propose a multi-root based method to build a domain-specific corpus making use of Wikipedia resources. First authors select some top-level nodes (Wikipedia category articles) as root nodes and traverse the Wikipedia using BFS-like algorithm. After the traverse, authors get a directed Wikipedia graph (Wiki-graph). Then an algorithm mainly based on Kosaraju Algorithm is proposed to remove the cycles in the Wiki-graph. Finally, topological sort algorithm is used to traverse the Wiki-graph, and ranking and filtering is done during the process. When computing a node’s ranking score, the in-degree of itself and the out-degree of its parents are both considered. The experimental evaluation shows that method could get a high-quality domain-specific corpus