Autonomous video conferencing system with virtual director assistance

• Main Authors: You, Elena, Wig, Kai Alexander, Nilssen, Vebjørn Boge, Jakobsen, Oleg, Byhring, Therese, Korneliussen, Jan Tore, Hansen, Patrik Kvarme, Schmidt, Niklas, Becsei, Tamás, Hammer, Vegard, Alstad, Håvard Pederson, Lauritzen, Mona Kleven, Hafstad, Jon Tore, Teppan, Knut Helge, Lopez, Aida C, Stensen, Lars Erling, Eriksen, Stein Ove, Selbek, Stian, Kvamstad, Bendik
• Format: Patent
• Language: English
• Published: 16.07.2024
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; ELECTRIC COMMUNICATION TECHNIQUE; ELECTRICITY; PHYSICS; PICTORIAL COMMUNICATION, e.g. TELEVISION

Systems and methods are provided to power video conferencing and remote collaboration with subsymbolic and symbolic artificial intelligence. The autonomous video conferencing systems of this disclosure include one main smart camera and multiple peripheral smart cameras, optionally coupled with one or more smart sensors. Each smart camera is equipped with a vision pipeline supported by machine learning to detect objects and their interactions as well as related changes in gesture and posture, and a virtual director adapted to apply a predetermined rule set consistent with television studio production principles. The main camera is adapted to select and update a focus video stream in real time under the direction of its virtual director and stream the updated focus stream to a user computer. Methods for creating an automated television studio production for a variety of conferencing spaces and special-purpose scenarios with virtual director assistance are provided.