Super-resolution live broadcast system based on online training

• Main Authors: XU YUEDONG, XING WANYONG, LIU XUDONG, DAI LIANGUI, XU GUANGNING, ZHANG YUNXIA
• Format: Patent
• Language: Chinese; English
• Published: 13.09.2022
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; ELECTRIC COMMUNICATION TECHNIQUE; ELECTRICITY; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; PHYSICS; PICTORIAL COMMUNICATION, e.g. TELEVISION

The invention belongs to the technical field of live broadcast streaming media, and particularly relates to a super-resolution live broadcast system based on online training, which is suitable for video live broadcast application of a PC (Personal Computer), a mobile terminal and an intelligent automobile equipped with GPU (Graphics Processing Unit) computing power. According to the system, under the condition that the uplink bandwidth of a stream pushing end is insufficient, a live broadcaster uploads a low-resolution video stream to a server at the stream pushing end through an RTMP protocol, and meanwhile, an original high-definition video is utilized to adaptively train an airspace super-resolution network F-EDSR and uploads the low-resolution video stream to a far-end server; and the server side receives the low-resolution video stream and the F-EDSR network, and processes the video stream in real time by cascading the space domain super-resolution network F-EDSR and the time domain super-resolution netw