Assessing Wikipedia-Based Cross-Language Retrieval Models

From Wikipedia Quality
Revision as of 12:21, 8 May 2020 by Camila (talk | contribs) (+ embed code)
Jump to: navigation, search


Assessing Wikipedia-Based Cross-Language Retrieval Models
Authors
Benjamin Roth
Publication date
2014
Links
Original Preprint

Assessing Wikipedia-Based Cross-Language Retrieval Models - scientific work related to Wikipedia quality published in 2014, written by Benjamin Roth.

Overview

This work compares concept models for cross-language retrieval: First, authors adapt probabilistic Latent Semantic Analysis (pLSA) for multilingual documents. Experiments with different weighting schemes show that a weighting method favoring documents of similar length in both language sides gives best results. Considering that both monolingual and multilingual Latent Dirichlet Allocation (LDA) behave alike when applied for such documents, authors use a training corpus built on Wikipedia where all documents are length-normalized and obtain improvements over previously reported scores for LDA. Another focus of work is on model combination. For this end authors include Explicit Semantic Analysis (ESA) in the experiments. Authors observe that ESA is not competitive with LDA in a query based retrieval task on CLEF 2000 data. The combination of machine translation with concept models increased performance by 21.1% map in comparison to machine translation alone. Machine translation relies on parallel corpora, which may not be available for many language pairs. Authors further explore how much cross-lingual information can be carried over by a specific information source in Wikipedia, namely linked text. The best results are obtained using a language modeling approach, entirely without information from parallel corpora. The need for smoothing raises interesting questions on soundness and efficiency. Link models capture only a certain kind of information and suggest weighting schemes to emphasize particular words. For a combined model, another interesting question is therefore how to integrate different weighting schemes. Using a very simple combination scheme, authors obtain results that compare favorably to previously reported results on the CLEF 2000 dataset.

Embed

Wikipedia Quality

Roth, Benjamin. (2014). "[[Assessing Wikipedia-Based Cross-Language Retrieval Models]]".

English Wikipedia

{{cite journal |last1=Roth |first1=Benjamin |title=Assessing Wikipedia-Based Cross-Language Retrieval Models |date=2014 |url=https://wikipediaquality.com/wiki/Assessing_Wikipedia-Based_Cross-Language_Retrieval_Models}}

HTML

Roth, Benjamin. (2014). &quot;<a href="https://wikipediaquality.com/wiki/Assessing_Wikipedia-Based_Cross-Language_Retrieval_Models">Assessing Wikipedia-Based Cross-Language Retrieval Models</a>&quot;.