Merge Frame Design for Video Stream Switching Using Piecewise Constant Functions

• Published in: IEEE transactions on image processing Vol. 25; no. 8; pp. 3489 - 3504
• Main Authors: Wei Dai, Cheung, Gene, Ngai-Man Cheung, Ortega, Antonio, Au, Oscar C.
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.08.2016; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Channels; Coding; Constants; Decoders; Encoding; Frames; Image coding; Image reconstruction; Merging; Reconstruction; Silicon; Streaming media; Switches; Switching; Video data; video compression; streaming media
• ISSN: 1057-7149; 1941-0042
• DOI: 10.1109/TIP.2016.2571564

The ability to efficiently switch from one pre-encoded video stream to another (e.g., for bitrate adaptation or view switching) is important for many interactive streaming applications. Recently, stream-switching mechanisms based on distributed source coding (DSC) have been proposed. In order to reduce the overall transmission rate, these approaches provide a merge mechanism, where information is sent to the decoder, such that the exact same frame can be reconstructed given that any one of a known set of side information (SI) frames is available at the decoder (e.g., each SI frame may correspond to a different stream from which we are switching). However, the use of bit-plane coding and channel coding in many DSC approaches leads to complex coding and decoding. In this paper, we propose an alternative approach for merging multiple SI frames, using a piecewise constant (PWC) function as the merge operator. In our approach, for each block to be reconstructed, a series of parameters of these PWC merge functions are transmitted in order to guarantee identical reconstruction given the known SI blocks. We consider two different scenarios. In the first case, a target frame is first given, and then merge parameters are chosen, so that this frame can be reconstructed exactly at the decoder. In contrast, in the second scenario, the reconstructed frame and the merge parameters are jointly optimized to meet a rate-distortion criteria. Experiments show that for both scenarios, our proposed merge techniques can outperform both a recent approach based on DSC and the SP-frame approach in H.264, in terms of compression efficiency and decoder complexity.