Shared Task: Crowdsourced Accessibility Elicitation of Wikipedia Articles
Authors | Scott Novotney Chris Callison-Burch |
|---|---|
Publication date | 2010 |
Links | Original |
Shared Task: Crowdsourced Accessibility Elicitation of Wikipedia Articles - scientific work related to Wikipedia quality published in 2010, written by Scott Novotney and Chris Callison-Burch.
Overview
Mechanical Turk is useful for generating complex speech resources like conversational speech transcription. In this work, authors explore the next step of eliciting narrations of Wikipedia articles to improve accessibility for low-literacy users. This task proves a useful test-bed to implement qualitative vetting of workers based on difficult to define metrics like narrative quality. Working with the Mechanical Turk API, authors collected sample narrations, had other Turkers rate these samples and then granted access to full narration HITs depending on aggregate quality. While narrating full articles proved too onerous a task to be viable, using other Turkers to perform vetting was very successful. Elicitation is possible on Mechanical Turk, but it should conform to suggested best practices of simple tasks that can be completed in a streamlined workflow.
Embed
Wikipedia Quality
Novotney, Scott; Callison-Burch, Chris. (2010). "[[Shared Task: Crowdsourced Accessibility Elicitation of Wikipedia Articles]]". Association for Computational Linguistics.
English Wikipedia
{{cite journal |last1=Novotney |first1=Scott |last2=Callison-Burch |first2=Chris |title=Shared Task: Crowdsourced Accessibility Elicitation of Wikipedia Articles |date=2010 |url=https://wikipediaquality.com/wiki/Shared_Task:_Crowdsourced_Accessibility_Elicitation_of_Wikipedia_Articles |journal=Association for Computational Linguistics}}
HTML
Novotney, Scott; Callison-Burch, Chris. (2010). "<a href="https://wikipediaquality.com/wiki/Shared_Task:_Crowdsourced_Accessibility_Elicitation_of_Wikipedia_Articles">Shared Task: Crowdsourced Accessibility Elicitation of Wikipedia Articles</a>". Association for Computational Linguistics.
