Assessing Wikipedia-Based Cross-Language Retrieval Models

From Wikipedia Quality
Revision as of 20:03, 25 May 2019 by Olivia (talk | contribs) (Creating a new page - Assessing Wikipedia-Based Cross-Language Retrieval Models)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Assessing Wikipedia-Based Cross-Language Retrieval Models - scientific work related to Wikipedia quality published in 2014, written by Benjamin Roth.

Overview

This work compares concept models for cross-language retrieval: First, authors adapt probabilistic Latent Semantic Analysis (pLSA) for multilingual documents. Experiments with different weighting schemes show that a weighting method favoring documents of similar length in both language sides gives best results. Considering that both monolingual and multilingual Latent Dirichlet Allocation (LDA) behave alike when applied for such documents, authors use a training corpus built on Wikipedia where all documents are length-normalized and obtain improvements over previously reported scores for LDA. Another focus of work is on model combination. For this end authors include Explicit Semantic Analysis (ESA) in the experiments. Authors observe that ESA is not competitive with LDA in a query based retrieval task on CLEF 2000 data. The combination of machine translation with concept models increased performance by 21.1% map in comparison to machine translation alone. Machine translation relies on parallel corpora, which may not be available for many language pairs. Authors further explore how much cross-lingual information can be carried over by a specific information source in Wikipedia, namely linked text. The best results are obtained using a language modeling approach, entirely without information from parallel corpora. The need for smoothing raises interesting questions on soundness and efficiency. Link models capture only a certain kind of information and suggest weighting schemes to emphasize particular words. For a combined model, another interesting question is therefore how to integrate different weighting schemes. Using a very simple combination scheme, authors obtain results that compare favorably to previously reported results on the CLEF 2000 dataset.