CONTENT-AWARE, MACHINE-LEARNING-BASED RATE CONTROL

• Main Authors: Weissman, Assaf, Ram, Eshed, Levi, Dotan David, Markus, Ohad, Hallak, Assaf, Mannor, Shie, Frishman, Eyal, Porat, Dror, Chechik, Gal
• Format: Patent
• Language: English
• Published: 18.07.2024
• Subjects: ELECTRIC COMMUNICATION TECHNIQUE; ELECTRICITY; PICTORIAL COMMUNICATION, e.g. TELEVISION

A system includes a processing device to receive video content, metadata related to the video content, and a target bit rate for encoding the video content. The processing device further detects a content type of the video content based on the metadata and encodes hardware to perform frame encoding on the video content. The system further includes a controller coupled between the processing device and the encoding hardware. The controller is programmed with machine instructions to generate first QP values on a per-frame basis using a frame machine learning model with a first plurality of weights. The first plurality of weights depends at least in part on the content type and the target bit rate. The controller further provides the first QP values to the encoding hardware for rate control of the frame encoding.