Query Term Expansion by Automatic Learning of Morphological Equivalence Patterns from Wikipedia

From Wikipedia Quality
Revision as of 06:13, 13 June 2020 by Sophie (talk | contribs) (+ category)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search


Query Term Expansion by Automatic Learning of Morphological Equivalence Patterns from Wikipedia
Authors
Kareem Darwish
Ahmed M. Ali
Ahmed Abdelali
Publication date
2014
Links
Original

Query Term Expansion by Automatic Learning of Morphological Equivalence Patterns from Wikipedia - scientific work related to Wikipedia quality published in 2014, written by Kareem Darwish, Ahmed M. Ali and Ahmed Abdelali.

Overview

Retrieval in many languages would benefit from languagespecific processing, such as stemming or morphological analysis. However, many languages lack such processing tools, or they may be inadequate for retrieval due to language evolution. In this paper, authors explore the use of Wikipedia redirects to automatically learn morphological equivalence patterns. Character-level alignment of automatically found morphological variants from Wikipedia redirects is used to generate character-level transformations. Then, given a query word, character-level transformations are used to produce morphological equivalents. The proposed method is language independent and can be applied to new languages without need for linguistic knowledge. Though, the performance of this approach may in the aggregate lag behind state-of-the-art stemming (or morphological analysis) for languages with good existing processors, the approach is generally safer than stemming in the sense that if it degrades queries, the degradation is generally marginal. Stemming on the other hand can significantly degrade queries. Authors show its success for Arabic, English, Hungarian, and Portuguese.

Embed

Wikipedia Quality

Darwish, Kareem; Ali, Ahmed M.; Abdelali, Ahmed. (2014). "[[Query Term Expansion by Automatic Learning of Morphological Equivalence Patterns from Wikipedia]]". CEUR-WS.

English Wikipedia

{{cite journal |last1=Darwish |first1=Kareem |last2=Ali |first2=Ahmed M. |last3=Abdelali |first3=Ahmed |title=Query Term Expansion by Automatic Learning of Morphological Equivalence Patterns from Wikipedia |date=2014 |url=https://wikipediaquality.com/wiki/Query_Term_Expansion_by_Automatic_Learning_of_Morphological_Equivalence_Patterns_from_Wikipedia |journal=CEUR-WS}}

HTML

Darwish, Kareem; Ali, Ahmed M.; Abdelali, Ahmed. (2014). &quot;<a href="https://wikipediaquality.com/wiki/Query_Term_Expansion_by_Automatic_Learning_of_Morphological_Equivalence_Patterns_from_Wikipedia">Query Term Expansion by Automatic Learning of Morphological Equivalence Patterns from Wikipedia</a>&quot;. CEUR-WS.