VideoMap: An interactive and scalable visualization for exploring video content

• Published in: Computational visual media (Beijing) Vol. 2; no. 3; pp. 291 - 304
• Main Authors: Ma, Cui-Xia, Guo, Yang, Wang, Hong-An
• Format: Journal Article
• Language: English
• Published: Beijing Tsinghua University Press 01.09.2016; Springer Nature B.V
• Subjects: Artificial Intelligence; Browsing; Computer Graphics; Computer Science; Image Processing and Computer Vision; Interactive systems; Multimedia; Representations; Research Article; Scientific visualization; Spatial data; User Interfaces and Human Computer Interaction; Video data; Visualization; map metaphor; sketch-based interaction; association analysis; video content visualization
• ISSN: 2096-0433; 2096-0662
• DOI: 10.1007/s41095-016-0049-1

Large-scale dynamic relational data visualization has attracted considerable research attention recently. We introduce dynamic data visualization into the multimedia domain, and present an interactive and scalable system, VideoMap, for exploring large-scale video content. A long video or movie has much content; the associations between the content are complicated. VideoMap uses new visual representations to extract meaningful information from video content. Map-based visualization naturally and easily summarizes and reveals important features and events in video. Multi-scale descriptions are used to describe the layout and distribution of temporal information, spatial information, and associations between video content. Firstly, semantic associations are used in which map elements correspond to video contents. Secondly, video contents are visualized hierarchically from a large scale to a fine-detailed scale. VideoMap uses a small set of sketch gestures to invoke analysis, and automatically completes charts by synthesizing visual representations from the map and binding them to the underlying data. Furthermore, VideoMap allows users to use gestures to move and resize the view, as when using a map, facilitating interactive exploration. Our experimental evaluation of VideoMap demonstrates how the system can assist in exploring video content as well as significantly reducing browsing time when trying to understand and find events of interest.