View source for Integrated Parallel Sentence and Fragment Extraction from Comparable Corpora: a Case Study on Chinese--Japanese Wikipedia

{{Infobox work
| title = Integrated Parallel Sentence and Fragment Extraction from Comparable Corpora: a Case Study on Chinese--Japanese Wikipedia
| date = 2016
| authors = [[Chenhui Chu]]<br />[[Toshiaki Nakazawa]]<br />[[Sadao Kurohashi]]
| doi = 10.1145/2833089
| link = http://dl.acm.org/citation.cfm?id=2833089
}}
'''Integrated Parallel Sentence and Fragment Extraction from Comparable Corpora: a Case Study on Chinese--Japanese Wikipedia''' - scientific work related to [[Wikipedia quality]] published in 2016, written by [[Chenhui Chu]], [[Toshiaki Nakazawa]] and [[Sadao Kurohashi]].

== Overview ==
Parallel corpora are crucial for statistical [[machine translation]] (SMT); however, they are quite scarce for most language pairs and domains. As comparable corpora are far more available, many studies have been conducted to extract either parallel sentences or fragments from them for SMT. In this article, authors propose an integrated system to extract both parallel sentences and fragments from comparable corpora. Authors first apply parallel sentence extraction to identify parallel sentences from comparable sentences. Authors then extract parallel fragments from the comparable sentences. Parallel sentence extraction is based on a parallel sentence candidate filter and classifier for parallel sentence identification. Authors improve it by proposing a novel filtering strategy and three novel feature sets for classification. Previous studies have found it difficult to accurately extract parallel fragments from comparable sentences. Authors propose an accurate parallel fragment extraction method that uses an alignment model to locate the parallel fragment candidates and an accurate lexicon-based filter to identify the truly parallel fragments. A case study on the Chinese--Japanese [[Wikipedia]] indicates that proposed methods outperform previously proposed methods, and the parallel data extracted by system significantly improves SMT performance.

== Embed ==
=== Wikipedia Quality ===
<code>
<nowiki>
Chu, Chenhui; Nakazawa, Toshiaki; Kurohashi, Sadao. (2016). "[[Integrated Parallel Sentence and Fragment Extraction from Comparable Corpora: a Case Study on Chinese--Japanese Wikipedia]]".DOI: 10.1145/2833089. 
</nowiki>
</code>

=== English Wikipedia ===
<code>
<nowiki>
{{cite journal |last1=Chu |first1=Chenhui |last2=Nakazawa |first2=Toshiaki |last3=Kurohashi |first3=Sadao |title=Integrated Parallel Sentence and Fragment Extraction from Comparable Corpora: a Case Study on Chinese--Japanese Wikipedia |date=2016 |doi=10.1145/2833089 |url=https://wikipediaquality.com/wiki/Integrated_Parallel_Sentence_and_Fragment_Extraction_from_Comparable_Corpora:_a_Case_Study_on_Chinese--Japanese_Wikipedia}}
</nowiki>
</code>

=== HTML ===
<code>
<nowiki>
Chu, Chenhui; Nakazawa, Toshiaki; Kurohashi, Sadao. (2016). &amp;quot;<a href="https://wikipediaquality.com/wiki/Integrated_Parallel_Sentence_and_Fragment_Extraction_from_Comparable_Corpora:_a_Case_Study_on_Chinese--Japanese_Wikipedia">Integrated Parallel Sentence and Fragment Extraction from Comparable Corpora: a Case Study on Chinese--Japanese Wikipedia</a>&amp;quot;.DOI: 10.1145/2833089. 
</nowiki>
</code>



[[Category:Scientific works]]
[[Category:Japanese Wikipedia]]
[[Category:Chinese Wikipedia]]