Difference between revisions of "An Open-Source Toolkit for Mining Wikipedia"

From Wikipedia Quality
Jump to: navigation, search
(Basic information on An Open-Source Toolkit for Mining Wikipedia)
(No difference)

Latest revision as of 20:01, 14 June 2019

An Open-Source Toolkit for Mining Wikipedia - scientific work related to Wikipedia quality published in 2013, written by David N. Milne and Ian H. Witten.


The online encyclopedia Wikipedia is a vast, constantly evolving tapestry of interlinked articles. For developers and researchers it represents a giant multilingual database of concepts and semantic relations, a potential resource for natural language processing and many other research areas. This paper introduces the Wikipedia Miner toolkit, an open-source software system that allows researchers and developers to integrate Wikipedia@?s rich semantics into their own applications. The toolkit creates databases that contain summarized versions of Wikipedia@?s content and structure, and includes a Java API to provide access to them. Wikipedia@?s articles, categories and redirects are represented as classes, and can be efficiently searched, browsed, and iterated over. Advanced features include parallelized processing of Wikipedia dumps, machine-learned semantic relatedness measures and annotation features, and XML-based web services. Wikipedia Miner is intended to be a platform for sharing data mining techniques.