Interactive Screen Video Streaming-Based Pervasive Mobile Workstyle

• Published in: IEEE transactions on multimedia Vol. 19; no. 10; pp. 2322 - 2332
• Main Authors: Ma, Zhan, Yue, Tao, Cao, Xun, Xu, Yiling, Li, Xin, Wang, Yongjin
• Format: Journal Article
• Language: English
• Published: IEEE 01.10.2017
• Subjects: Bandwidth; High-efficiency video coding; Mobile communication; pervasive computing; Protocols; Rendering (computer graphics); screen content coding; Servers; SPICE; Streaming media; virtual desktop infrastructure
• ISSN: 1520-9210; 1941-0077
• DOI: 10.1109/TMM.2017.2737944

In this paper, we develop an interactive screen video streaming-based system to enable the ubiquitous mobile workstyle, which is referred to as personal computer to pervasive computing (PC2PC). The desktop screens of virtualized systems are compressed in the PC2PC servers and delivered to remote end users for stream decoding, rendering, and interactions. We have implemented a system from the scratch, where the emerging screen content coding extension of high-efficiency video coding is implemented to compress and stream the desktop screens of the virtualized system in real time. Three core asset channels, system, display, and inputs, are defined to enable systematic end-to-end communication. Compared with Red Hat SPICE virtual desktop infrastructure scheme, the proposed PC2PC could save network bandwidth consumption by a factor of 2, 7, and 4, respectively, in terms of typical video streaming, web browsing, and stationary office applications at the same visual quality. Meanwhile, we have also measured the delays of the system and presented preliminary results on the user experience aspect. A simple network estimation is applied to optimize the quality bandwidth adaptation for both single user and multiuser scenarios to consider the network dynamics.