Combating Online Misinformation Videos: Characterization, Detection, and Future Directions

• Published in: arXiv.org
• Main Authors: Bu, Yuyan, Sheng, Qiang, Cao, Juan, Peng Qi, Wang, Danding, Li, Jintao
• Format: Paper Journal Article
• Language: English
• Published: Ithaca Cornell University Library, arXiv.org 06.08.2023
• Subjects: Computer Science - Computer Vision and Pattern Recognition; Computer Science - Multimedia; Computer Science - Social and Information Networks; False information; Heterogeneity; Recommender systems; Semantics; Video transmission
• ISSN: 2331-8422
• DOI: 10.48550/arxiv.2302.03242

With information consumption via online video streaming becoming increasingly popular, misinformation video poses a new threat to the health of the online information ecosystem. Though previous studies have made much progress in detecting misinformation in text and image formats, video-based misinformation brings new and unique challenges to automatic detection systems: 1) high information heterogeneity brought by various modalities, 2) blurred distinction between misleading video manipulation and nonmalicious artistic video editing, and 3) new patterns of misinformation propagation due to the dominant role of recommendation systems on online video platforms. To facilitate research on this challenging task, we conduct this survey to present advances in misinformation video detection. We first analyze and characterize the misinformation video from three levels including signals, semantics, and intents. Based on the characterization, we systematically review existing works for detection from features of various modalities to techniques for clue integration. We also introduce existing resources including representative datasets and useful tools. Besides summarizing existing studies, we discuss related areas and outline open issues and future directions to encourage and guide more research on misinformation video detection. The corresponding repository is at https://github.com/ICTMCG/Awesome-Misinfo-Video-Detection.