Visual Analytics of Political Networks From Face-Tracking of News Video

• Published in: IEEE transactions on multimedia Vol. 18; no. 11; pp. 2184 - 2195
• Main Authors: Renoust, Benjamin, Duy-Dinh Le, Satoh, Shin'Ichi
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.11.2016; The Institute of Electrical and Electronics Engineers, Inc. (IEEE); Institute of Electrical and Electronics Engineers
• Subjects: Archives & records; Computer Science; Data visualization; Face; Face detection; face recognition; Government; graph; Media; Multimedia; multimedia database; Social and Information Networks; Social network services; Visual analytics; Multimedia database; Graph; Face recognition; Data visualization
• ISSN: 1520-9210; 1941-0077
• DOI: 10.1109/TMM.2016.2614224

The rich nature of news makes it a classic subject of visual analytics research. Such analysis is often based on rich textual data. However, we want to test how much we can understand the news from video information through face detection and tracking. Towards this goal, we propose a visual analytics system and discuss its design and implementation to support media experts in understanding political interactions in an archive of 12 years of the Japanese public broadcaster NHK's News 7 program. After identifying the tasks and abstraction required for our analysis, we construct links from face detection and tracking to derive multiple political networks. Our proposed design embeds this rich data into a visual analytics framework that presents four levels of abstraction: time period, network, timeline, and face-tracks within video. We present how the exploration of the archive with our system results in good understanding of the Japanese politico-media scene during these 12 years while finding evidence of "presidentialization" of the media.