Language Resources Extracted from Wikipedia

From Wikipedia Quality
Revision as of 23:27, 5 July 2019 by Aaliyah (talk | contribs) (New study: Language Resources Extracted from Wikipedia)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Language Resources Extracted from Wikipedia - scientific work related to Wikipedia quality published in 2011, written by Denny Vrandecic, Philipp Sorg and Rudi Studer.

Overview

Wikipedia provides an interesting amount of text for more than hundred languages. This also includes languages where no reference corpora or other linguistic resources are easily available. Authors have extracted background language models built from the content of Wikipedia in various languages. The models generated from Simple and English Wikipedia are compared to language models derived from other established corpora. The differences between the models in regard to term coverage, term distribution and correlation are described and discussed. Authors provide access to the full dataset and create visualizations of the language models that can be used exploratory. The paper describes the newly released dataset for 33 languages, and the services that authors provide on top of them.