Subjective preference of spatio-temporal rate in video adaptation using multi-dimensional scalable coding

• Published in: 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763) Vol. 3; pp. 1719 - 1722 Vol.3
• Main Authors: Yong Wang, Shih-Fu Chang, Loui, A.C.
• Format: Conference Proceeding
• Language: English
• Published: Piscataway NJ IEEE 2004
• Subjects: Analytical models; Applied sciences; Artificial intelligence; Availability; Bandwidth; Bit rate; Computer science; control theory; systems; Exact sciences and technology; Handheld computers; Image resolution; Pattern recognition. Digital image processing. Computational geometry; PSNR; Robustness; Statistical analysis; Streaming media; Multimedia; Streaming; Statistical test; Subband decomposition; Preference; Bandwidth; Video signal; Subband; Subjective evaluation; Content analysis
• ISBN: 9780780386037; 0780386035
• DOI: 10.1109/ICME.2004.1394585

Video adaptation allows for direct manipulation of existing encoded video streams to meet new resource constraints without having to encode the video from scratch. Multi-dimensional scalable coding, such as motion-compensated subband coding (MCSBC), offers an effective and flexible representation for video adaptation. In order to develop robust criteria for selecting optimal spatio-temporal rates used in adaptation, knowledge about subjective preference of spatio-temporal rates is needed. We study the optimal temporal frame rate over a wide range of bandwidth (50 kbps to 1 Mbps) using subjective quality evaluation with 128 clips and 31 subjects. We analyze the results using statistical testing methods and investigate the dependence of optimal frame rate on user, bandwidth, and video content characteristics. Our findings indicate agreement among most users and the existence of switching bandwidths at which preferred frame rates change. Dependence of the preference on video content types is also revealed.