An Open-Source Toolkit for Mining Wikipedia

From Wikipedia Quality
Revision as of 09:53, 12 July 2019 by Lillian (talk | contribs) (Int.links)
Jump to: navigation, search

An Open-Source Toolkit for Mining Wikipedia - scientific work related to Wikipedia quality published in 2013, written by David N. Milne and Ian H. Witten.

Overview

The online encyclopedia Wikipedia is a vast, constantly evolving tapestry of interlinked articles. For developers and researchers it represents a giant multilingual database of concepts and semantic relations, a potential resource for natural language processing and many other research areas. This paper introduces the Wikipedia Miner toolkit, an open-source software system that allows researchers and developers to integrate Wikipedia@?s rich semantics into their own applications. The toolkit creates databases that contain summarized versions of Wikipedia@?s content and structure, and includes a Java API to provide access to them. Wikipedia@?s articles, categories and redirects are represented as classes, and can be efficiently searched, browsed, and iterated over. Advanced features include parallelized processing of Wikipedia dumps, machine-learned semantic relatedness measures and annotation features, and XML-based web services. Wikipedia Miner is intended to be a platform for sharing data mining techniques.