Difference between revisions of "Atomicwikiedits: a Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse"
(+ infobox) |
(Adding embed) |
||
| Line 10: | Line 10: | ||
== Overview == | == Overview == | ||
Authors release a corpus of 43 million atomic edits across 8 languages. These edits are mined from [[Wikipedia]] edit history and consist of instances in which a human editor has inserted a single contiguous phrase into, or deleted a single contiguous phrase from, an existing sentence. Authors use the collected data to show that the language generated during editing differs from the language that authors observe in standard corpora, and that models trained on edits encode different aspects of semantics and discourse than models trained on raw, unstructured text. Authors release the full corpus as a resource to aid ongoing research in semantics, discourse, and representation learning. | Authors release a corpus of 43 million atomic edits across 8 languages. These edits are mined from [[Wikipedia]] edit history and consist of instances in which a human editor has inserted a single contiguous phrase into, or deleted a single contiguous phrase from, an existing sentence. Authors use the collected data to show that the language generated during editing differs from the language that authors observe in standard corpora, and that models trained on edits encode different aspects of semantics and discourse than models trained on raw, unstructured text. Authors release the full corpus as a resource to aid ongoing research in semantics, discourse, and representation learning. | ||
| + | |||
| + | == Embed == | ||
| + | === Wikipedia Quality === | ||
| + | <code> | ||
| + | <nowiki> | ||
| + | Faruqui, Manaal; Pavlick, Ellie; Tenney, Ian; Das, Dipanjan. (2018). "[[Atomicwikiedits: a Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse]]". | ||
| + | </nowiki> | ||
| + | </code> | ||
| + | |||
| + | === English Wikipedia === | ||
| + | <code> | ||
| + | <nowiki> | ||
| + | {{cite journal |last1=Faruqui |first1=Manaal |last2=Pavlick |first2=Ellie |last3=Tenney |first3=Ian |last4=Das |first4=Dipanjan |title=Atomicwikiedits: a Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse |date=2018 |url=https://wikipediaquality.com/wiki/Atomicwikiedits:_a_Multilingual_Corpus_of_Wikipedia_Edits_for_Modeling_Language_and_Discourse}} | ||
| + | </nowiki> | ||
| + | </code> | ||
| + | |||
| + | === HTML === | ||
| + | <code> | ||
| + | <nowiki> | ||
| + | Faruqui, Manaal; Pavlick, Ellie; Tenney, Ian; Das, Dipanjan. (2018). &quot;<a href="https://wikipediaquality.com/wiki/Atomicwikiedits:_a_Multilingual_Corpus_of_Wikipedia_Edits_for_Modeling_Language_and_Discourse">Atomicwikiedits: a Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse</a>&quot;. | ||
| + | </nowiki> | ||
| + | </code> | ||
Revision as of 11:58, 9 January 2020
Authors | Manaal Faruqui Ellie Pavlick Ian Tenney Dipanjan Das |
|---|---|
Publication date | 2018 |
Links | Original Preprint |
Atomicwikiedits: a Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse - scientific work related to Wikipedia quality published in 2018, written by Manaal Faruqui, Ellie Pavlick, Ian Tenney and Dipanjan Das.
Overview
Authors release a corpus of 43 million atomic edits across 8 languages. These edits are mined from Wikipedia edit history and consist of instances in which a human editor has inserted a single contiguous phrase into, or deleted a single contiguous phrase from, an existing sentence. Authors use the collected data to show that the language generated during editing differs from the language that authors observe in standard corpora, and that models trained on edits encode different aspects of semantics and discourse than models trained on raw, unstructured text. Authors release the full corpus as a resource to aid ongoing research in semantics, discourse, and representation learning.
Embed
Wikipedia Quality
Faruqui, Manaal; Pavlick, Ellie; Tenney, Ian; Das, Dipanjan. (2018). "[[Atomicwikiedits: a Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse]]".
English Wikipedia
{{cite journal |last1=Faruqui |first1=Manaal |last2=Pavlick |first2=Ellie |last3=Tenney |first3=Ian |last4=Das |first4=Dipanjan |title=Atomicwikiedits: a Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse |date=2018 |url=https://wikipediaquality.com/wiki/Atomicwikiedits:_a_Multilingual_Corpus_of_Wikipedia_Edits_for_Modeling_Language_and_Discourse}}
HTML
Faruqui, Manaal; Pavlick, Ellie; Tenney, Ian; Das, Dipanjan. (2018). "<a href="https://wikipediaquality.com/wiki/Atomicwikiedits:_a_Multilingual_Corpus_of_Wikipedia_Edits_for_Modeling_Language_and_Discourse">Atomicwikiedits: a Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse</a>".
