An Annotation Scheme for Automated Bias Detection in Wikipedia
Authors | Livnat Herzig Alex Nunes Batia Snir |
|---|---|
Publication date | 2011 |
Links | Original |
An Annotation Scheme for Automated Bias Detection in Wikipedia - scientific work related to Wikipedia quality published in 2011, written by Livnat Herzig, Alex Nunes and Batia Snir.
Overview
BiasML is a novel annotation scheme with the purpose of identifying the presence as well as nuances of biased language within the subset of Wikipedia articles dedicated to service providers. Whereas Wikipedia currently uses only manual flagging to detect possible bias, scheme provides a foundation for the automating of bias flagging by improving upon the methodology of annotation schemes in classic sentiment analysis. Authors also address challenges unique to the task of identifying biased writing within the specific context of Wikipedia's neutrality policy. Authors perform a detailed analysis of inter-annotator agreement, which shows that although the agreement scores for intra-sentential tags were relatively low, the agreement scores on the sentence and entry levels were encouraging (74.8% and 66.7%, respectively). Based on an analysis of first implementation of scheme, authors suggest possible improvements to guidelines, in hope that further rounds of annotation after incorporating them could provide appropriate data for use within a machine learning framework for automated detection of bias within Wikipedia.
Embed
Wikipedia Quality
Herzig, Livnat; Nunes, Alex; Snir, Batia. (2011). "[[An Annotation Scheme for Automated Bias Detection in Wikipedia]]". Association for Computational Linguistics.
English Wikipedia
{{cite journal |last1=Herzig |first1=Livnat |last2=Nunes |first2=Alex |last3=Snir |first3=Batia |title=An Annotation Scheme for Automated Bias Detection in Wikipedia |date=2011 |url=https://wikipediaquality.com/wiki/An_Annotation_Scheme_for_Automated_Bias_Detection_in_Wikipedia |journal=Association for Computational Linguistics}}
HTML
Herzig, Livnat; Nunes, Alex; Snir, Batia. (2011). "<a href="https://wikipediaquality.com/wiki/An_Annotation_Scheme_for_Automated_Bias_Detection_in_Wikipedia">An Annotation Scheme for Automated Bias Detection in Wikipedia</a>". Association for Computational Linguistics.
