Streaming Mobile Cloud Gaming Video Over TCP With Adaptive Source-FEC Coding

• Published in: IEEE transactions on circuits and systems for video technology Vol. 27; no. 1; pp. 32 - 48
• Main Authors: Wu, Jiyan, Yuen, Chau, Cheung, Ngai-Man, Chen, Junliang, Chen, Chang Wen
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.01.2017; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Bandwidth; Cloud gaming; Coding; Computer & video games; Delays; Encoding; Error correction; Forward error correction; forward error correction (FEC); Mobile communication; mobile video streaming; rate control; Streaming media; stringent delay constraint; TCP (protocol); transmission control protocol (TCP); Video transmission
• ISSN: 1051-8215; 1558-2205
• DOI: 10.1109/TCSVT.2016.2527398

Cloud gaming has emerged as a promising application to enable high-end game playing with thin clients. Transmission control protocol (TCP) is pervasively adopted as the transport-layer protocol in the mainstream cloud gaming systems for video communication. However, streaming mobile cloud gaming video using the TCP is challenged with several key technical barriers: (1) the performance limitations of wireless networks in bandwidth and reliability; (2) the high throughput demand and stringent delay constraint imposed by high-quality gaming video transmission; and (3) the deadline violations and throughput fluctuations caused by the packet retransmission and congestion control mechanisms in the TCP. To address these critical problems, this paper proposes an application-layer source-forward error correction (FEC) coding framework dubbed adaptive source-FEC coding over TCP (ESCOT). First, we analytically formulate the optimization problem of joint source-FEC coding to minimize the end-to-end distortion of real-time video communication over TCP. Second, we develop a heuristic solution for effective loss rate approximation, source rate control, and FEC coding adaptation. ESCOT is distinct from existing source-FEC coding schemes in proactively analyzing and leveraging the TCP characteristics. The proposed solution is able to effectively mitigate both consecutive and sporadic video frame drops caused by congestion and random packet losses. We conduct the performance evaluation through extensive emulations in the Exata platform using real-time gaming video encoded by the H.264 codec. Experimental results show that the ESCOT advances the state of the art with noticeable improvements in video peak signal-to-noise ratio, end-to-end delay, goodput, and frame success rate.