Exploring Wikipedia and Query Log's Ability for Text Feature Representation

From Wikipedia Quality
Revision as of 00:19, 18 January 2021 by Agatha (talk | contribs) (Links)
Jump to: navigation, search

Exploring Wikipedia and Query Log's Ability for Text Feature Representation - scientific work related to Wikipedia quality published in 2007, written by Bing Li, Qingcai Chen, Daniel S. Yeung, Wing W. Y. Ng and Xiaolong Wang.

Overview

The rapid increase of Internet technology requires a better management of Web page contents. Many text mining researches has been conducted, like text categorization, information retrieval, text clustering. When machine learning methods or statistical models are applied to such a large scale of data, the first step authors have to solve is to represent a text document into the way that computers could handle. Traditionally, single words are always employed as features in vector space model, which make up the feature space for all text documents. The single-word based representation is based on the word independence and doesn't consider their relations, which may cause information missing. This paper proposes Wiki-Query segmented features to text classification, in hopes of better using the text information. The experiment results show that a much better F1 value has been achieved than that of classical single-word based text representation. This means that Wikipedia and query segmented feature could better represent a text document.