You Don't Know How I Feel: Insider-Outsider Perspective Gaps in Cyberbullying Risk Detection

• Published in: Proceedings of the International AAAI Conference on Web and Social Media Vol. 15; pp. 290 - 302
• Main Authors: Kim, Seunghyun, Razi, Afsaneh, Stringhini, Gianluca, Wisniewski, Pamela J., De Choudhury, Munmun
• Format: Journal Article
• Language: English
• Published: 22.05.2021
• ISSN: 2162-3449; 2334-0770
• DOI: 10.1609/icwsm.v15i1.18061

Cyberbullying is a prevalent concern within social computing research that has led to the development of several supervised machine learning (ML) algorithms for automated risk detection. A critical aspect of ML algorithm development is how to establish ground truth that is representative of the phenomenon of interest in the real world. Often, ground truth is determined by third-party annotators (i.e., “outsiders”) who are removed from the situational context of the interaction; therefore, they cannot fully understand the perspective of the individuals involved (i.e., “insiders”). To understand the extent of this problem, we compare “outsider” versus “insider” perspectives when annotating 2,000 posts from an online peer-support platform. We interpolate this analysis to a corpus containing over 2.3 million posts on bullying and related topics, and reveal significant gaps in ML models that use third-party annotators to detect bullying incidents. Our results indicate that models based on the insiders’ perspectives yield a significantly higher recall in identifying bullying posts and are able to capture a range of explicit and implicit references and linguistic framings, including person-specific impressions of the incidents. Our study highlights the importance of incorporating the victim’s point of view in establishing effective tools for cyberbullying risk detection. As such, we advocate for the adoption of human-centered and value-sensitive approaches for algorithm development that bridge insider-outsider perspective gaps in a way that empowers the most vulnerable.