Concept-Based Document Classification Using Wikipedia and Value Function

Concept-Based Document Classification Using Wikipedia and Value Function - scientific work related to Wikipedia quality published in 2011, written by Pekka Malo, Ankur Sinha, Jyrki Wallenius and Pekka Korhonen.

Overview

In this article, authors propose a new concept-based method for document classification. The conceptual knowledge associated with the words is drawn from Wikipedia. The purpose is to utilize the abundant semantic relatedness information available in Wikipedia in an efficient value function-based query learning algorithm. The procedure learns the value function by solving a simple linear programming problem formulated using the training documents. The learning involves a step-wise iterative process that helps in generating a value function with an appropriate set of concepts (dimensions) chosen from a collection of concepts. Once the value function is formulated, it is utilized to make a decision between relevance and irrelevance. The value assigned to a particular document from the value function can be further used to rank the documents according to their relevance. Reuters newswire documents have been used to evaluate the efficacy of the procedure. An extensive comparison with other frameworks has been performed. The results are promising. © 2011 Wiley Periodicals, Inc.