Video Coding for Machines: Partial transmission of SIFT features

The paper deals with Video Coding for Machines that is a new paradigm in video coding related to consumption of decoded video by humans and machines. For such tasks, joint transmission of compressed video and features is considered. In this paper, we focus our considerations of features on SIFT keyp...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Maćkowiak, Sławomir, Domański, Marek, Różek, Sławomir, Cywiński, Dominik, Szkiełda, Jakub
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 07.01.2022
Subjects
Coding
Feature extraction
Parameters
Video compression
Video transmission
Online AccessGet full text

Cover

More Information
Summary:The paper deals with Video Coding for Machines that is a new paradigm in video coding related to consumption of decoded video by humans and machines. For such tasks, joint transmission of compressed video and features is considered. In this paper, we focus our considerations of features on SIFT keypoints. They can be extracted from the decoded video with losses in number of keypoints and their parameters as compared to the SIFT keypoints extracted from the original video. Such losses are studied for HEVC and VVC as functions of the quantization parameter and the bitrate. In the paper, we propose to transmit the residual feature data together with the compressed video. Therefore, even for strongly compressed video, the transmission of whole all SIFT keypoint information is avoided.
ISSN:2331-8422