Corpus-Based Translation Induction in Indian Languages Using Auxiliary Language Corpora from Wikipedia
Authors | Goutham Tholpadi Chiranjib Bhattacharyya Shirish Krishnaj Shevade |
|---|---|
Publication date | 2017 |
DOI | 10.1145/3038295 |
Links | Original |
Corpus-Based Translation Induction in Indian Languages Using Auxiliary Language Corpora from Wikipedia - scientific work related to Wikipedia quality published in 2017, written by Goutham Tholpadi, Chiranjib Bhattacharyya and Shirish Krishnaj Shevade.
Overview
Identifying translations from comparable corpora is a well-known problem with several applications. Existing methods rely on linguistic tools or high-quality corpora. Absence of such resources, especially in Indian languages, makes this problem hard; for example, state-of-the-art techniques achieve a mean reciprocal rank of 0.66 for English-Italian, and a mere 0.187 for Telugu-Kannada. In this work, authors address the problem of comparable corpora-based translation correspondence induction (CC-TCI) when the only resources available are small noisy comparable corpora extracted from Wikipedia. Authors observe that translations in the source and target languages have many topically related words in common in other “auxiliary” languages. To model this, authors define the notion of a translingual theme , a set of topically related words from auxiliary language corpora, and present a probabilistic framework for CC-TCI. Extensive experiments on 35 comparable corpora showed dramatic improvements in performance. Authors extend these ideas to propose a method for measuring cross-lingual semantic relatedness (CLSR) between words. To stimulate further research in this area, authors make publicly available two new high-quality human-annotated datasets for CLSR. Experiments on the CLSR datasets show more than 200% improvement in correlation on the CLSR task. Authors apply the method to the real-world problem of cross-lingual Wikipedia title suggestion and build the WikiTSu system. A user study on WikiTSu shows a 20% improvement in the quality of titles suggested.
Embed
Wikipedia Quality
Tholpadi, Goutham; Bhattacharyya, Chiranjib; Shevade, Shirish Krishnaj. (2017). "[[Corpus-Based Translation Induction in Indian Languages Using Auxiliary Language Corpora from Wikipedia]]".DOI: 10.1145/3038295.
English Wikipedia
{{cite journal |last1=Tholpadi |first1=Goutham |last2=Bhattacharyya |first2=Chiranjib |last3=Shevade |first3=Shirish Krishnaj |title=Corpus-Based Translation Induction in Indian Languages Using Auxiliary Language Corpora from Wikipedia |date=2017 |doi=10.1145/3038295 |url=https://wikipediaquality.com/wiki/Corpus-Based_Translation_Induction_in_Indian_Languages_Using_Auxiliary_Language_Corpora_from_Wikipedia}}
HTML
Tholpadi, Goutham; Bhattacharyya, Chiranjib; Shevade, Shirish Krishnaj. (2017). "<a href="https://wikipediaquality.com/wiki/Corpus-Based_Translation_Induction_in_Indian_Languages_Using_Auxiliary_Language_Corpora_from_Wikipedia">Corpus-Based Translation Induction in Indian Languages Using Auxiliary Language Corpora from Wikipedia</a>".DOI: 10.1145/3038295.
