MobileCodec: Neural Inter-frame Video Compression on Mobile Devices

Realizing the potential of neural video codecs on mobile devices is a big technological challenge due to the computational complexity of deep networks and the power-constrained mobile hardware. We demonstrate practical feasibility by leveraging Qualcomm's technology and innovation, bridging the...

Full description

Saved in:
Bibliographic Details
Main Authors Le, Hoang, Zhang, Liang, Said, Amir, Sautiere, Guillaume, Yang, Yang, Shrestha, Pranav, Yin, Fei, Pourreza, Reza, Wiggers, Auke
Format Journal Article
LanguageEnglish
Published 17.07.2022
Subjects
Computer Science - Computer Vision and Pattern Recognition
Computer Science - Multimedia
Online AccessGet full text

Cover

More Information
Summary:Realizing the potential of neural video codecs on mobile devices is a big technological challenge due to the computational complexity of deep networks and the power-constrained mobile hardware. We demonstrate practical feasibility by leveraging Qualcomm's technology and innovation, bridging the gap from neural network-based codec simulations running on wall-powered workstations, to real-time operation on a mobile device powered by Snapdragon technology. We show the first-ever inter-frame neural video decoder running on a commercial mobile phone, decoding high-definition videos in real-time while maintaining a low bitrate and high visual quality.
DOI:10.48550/arxiv.2207.08338