Concept-Based Feature Generation and Selection for Information Retrieval

From Wikipedia Quality
Jump to: navigation, search
Concept-Based Feature Generation and Selection for Information Retrieval
Authors
Ofer Egozi
Evgeniy Gabrilovich
Shaul Markovitch
Publication date
2008
ISBN
978-157735368-3
Links

Concept-Based Feature Generation and Selection for Information Retrieval - scientific work about Wikipedia quality published in 2008, written by Ofer Egozi, Evgeniy Gabrilovich and Shaul Markovitch.

Overview

Traditional information retrieval systems use query words to identify relevant documents. In difficult retrieval tasks, however, one needs access to a wealth of background knowledge. Authors present a method that uses Wikipedia-based feature generation to improve retrieval performance. Intuitively, authors expect that using extensive world knowledge is likely to improve recall but may adversely affect precision. High quality feature selection is necessary to maintain high precision, but here authors do not have the labeled training data for evaluating features, that authors have in supervised learning. Authors present a new feature selection method that is inspired by pseudo-relevance feedback. Authors use the top-ranked and bottom-ranked documents retrieved by the bag-of-words method as representative sets of relevant and non-relevant documents. The generated features are then evaluated and filtered on the basis of these sets. Experiments on TREC data confirm the superior performance of their method compared to the previous state of the art. Copyright © 2008, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved.

Embed

Wikipedia Quality

Egozi, Ofer; Gabrilovich, Evgeniy; Markovitch, Shaul. (2008). "[[Concept-Based Feature Generation and Selection for Information Retrieval]]". Proceedings of the National Conference on Artificial Intelligence Volume 2, 2008, pp. 1132-1137. ISBN: 978-157735368-3.

English Wikipedia

{{cite journal |last1=Egozi |first1=Ofer |last2=Gabrilovich |first2=Evgeniy |last3=Markovitch |first3=Shaul |title=Concept-Based Feature Generation and Selection for Information Retrieval |date=2008 |isbn=978-157735368-3 |url=https://wikipediaquality.com/wiki/Concept-Based_Feature_Generation_and_Selection_for_Information_Retrieval |journal=Proceedings of the National Conference on Artificial Intelligence Volume 2, 2008, pp. 1132-1137}}

HTML

Egozi, Ofer; Gabrilovich, Evgeniy; Markovitch, Shaul. (2008). &quot;<a href="https://wikipediaquality.com/wiki/Concept-Based_Feature_Generation_and_Selection_for_Information_Retrieval">Concept-Based Feature Generation and Selection for Information Retrieval</a>&quot;. Proceedings of the National Conference on Artificial Intelligence Volume 2, 2008, pp. 1132-1137. ISBN: 978-157735368-3.