Parsimonious Argument Annotations for Hate Speech Counter-narratives

We present an enrichment of the Hateval corpus of hate speech tweets (Basile et. al 2019) aimed to facilitate automated counter-narrative generation. Comparably to previous work (Chung et. al. 2019), manually written counter-narratives are associated to tweets. However, this information alone seems...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Furman, Damian A, Torres, Pablo, Rodriguez, Jose A, Martinez, Lautaro, Laura Alonso Alemany, Letzen, Diego, Martinez, Maria Vanina
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 01.08.2022
Subjects
Annotations
Human performance
Narratives
Natural language processing
Online AccessGet full text

Cover

More Information
Summary:We present an enrichment of the Hateval corpus of hate speech tweets (Basile et. al 2019) aimed to facilitate automated counter-narrative generation. Comparably to previous work (Chung et. al. 2019), manually written counter-narratives are associated to tweets. However, this information alone seems insufficient to obtain satisfactory language models for counter-narrative generation. That is why we have also annotated tweets with argumentative information based on Wagemanns (2016), that we believe can help in building convincing and effective counter-narratives for hate speech against particular groups. We discuss adequacies and difficulties of this annotation process and present several baselines for automatic detection of the annotated elements. Preliminary results show that automatic annotators perform close to human annotators to detect some aspects of argumentation, while others only reach low or moderate level of inter-annotator agreement.
ISSN:2331-8422