Frame Interpolation for Cloud-Based Mobile Video Streaming

• Published in: IEEE transactions on multimedia Vol. 18; no. 5; pp. 831 - 839
• Main Authors: Usman, Muhammad, Xiangjian He, Kin-Man Lam, Min Xu, Bokhari, Syed Mohsin Matloob, Jinjun Chen
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.05.2016; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Block Matching Algorithm; Blocking; Cloud computing; Error Concealment; Errors; Frames; H.265/HEVC; High Definition; High definition video; Intra Frame; Media; Motion Vectors; Networks; Packet loss; Packet Loss Rate; Packet Retransmission; Quality of Experience; Quantization Parameter; Searching; Servers; Streaming media; Video transmission; Error Concealment (EC); packet loss rate; Quantization Parameters (QPs); Block Matching Algorithm (BMA); Quality of Experience (QoE); Motion Vectors (MVs); High Definition (HD); H.265/HEVC; Intra-frame; packet retransmission
• ISSN: 1520-9210; 1941-0077
• DOI: 10.1109/TMM.2016.2537200

Cloud-based High Definition (HD) video streaming is becoming popular day by day. On one hand, it is important for both end users and large storage servers to store their huge amount of data at different locations and servers. On the other hand, it is becoming a big challenge for network service providers to provide reliable connectivity to the network users. There have been many studies over cloud-based video streaming for Quality of Experience (QoE) for services like YouTube. Packet losses and bit errors are very common in transmission networks, which affect the user feedback over cloud-based media services. To cover up packet losses and bit errors, Error Concealment (EC) techniques are usually applied at the decoder/receiver side to estimate the lost information. This paper proposes a time-efficient and quality-oriented EC method. The proposed method considers H.265/HEVC based intra-encoded videos for the estimation of whole intra-frame loss. The main emphasis in the proposed approach is the recovery of Motion Vectors (MVs) of a lost frame in real-time. To boost-up the search process for the lost MVs, a bigger block size and searching in parallel are both considered. The simulation results clearly show that our proposed method outperforms the traditional Block Matching Algorithm (BMA) by approximately 2.5 dB and Frame Copy (FC) by up to 12 dB at a packet loss rate of 1%, 3%, and 5% with different Quantization Parameters (QPs). The computational time of the proposed approach outperforms the BMA by approximately 1788 seconds.