Visual Expansion and Real‐Time Calibration for Pan‐Tilt‐Zoom Cameras Assisted by Panoramic Models

• Published in: Computer animation and virtual worlds Vol. 36; no. 1
• Main Authors: Cai, Liangliang, Zhou, Zhong
• Format: Journal Article
• Language: English
• Published: Hoboken, USA John Wiley & Sons, Inc 01.01.2025; Wiley Subscription Services, Inc
• Subjects: Accuracy; augmented virtual environment; Calibration; camera calibration; Cameras; Field of view; key‐ray collection; Motion simulation; panorama; Point pairs; PTZ camera; Railway stations; Research projects
• DOI: 10.1002/cav.70015
• ISSN: 1546-4261

ABSTRACT Pan‐tilt‐zoom (PTZ) cameras, which dynamically adjust their field of view (FOV), are pervasive in large‐scale scenes, such as train stations, squares, and airports. In real scenarios, PTZ cameras are required to quickly judge their directions using contextual clues from the surrounding environment. To achieve this goal, some research projects camera videos into three‐dimensional (3D) models or panoramas and allows operators to establish spatial relationships. However, these works face several challenges in terms of real‐time processing, localization accuracy, and realistic reference. To address this problem, a visual expansion and real‐time calibration for PTZ cameras assisted by panoramic models is proposed. The calibration method consists of three parts: Providing a real environment background by building a panoramic model, meeting the needs of real‐time processing by establishing a PTZ camera motion estimation model and achieving high‐precision alignment between PTZ images and panoramic models using only two feature point pairs. Our methods were validated using both the public and our Scene dataset. The experimental results indicate that our method outperforms other state‐of‐the‐art methods in terms of real‐time processing, accuracy, and robustness. We propose a visual expansion and real‐time calibration for PTZ cameras assisted by panoramic models. The calibration method consists of three parts: Providing a real environment background by building a panoramic model, establishing a PTZ camera motion estimation model for meeting the needs of real‐time processing, and achieving high‐precision alignment between PTZ images and panoramic models using only two feature point pairs.