Soccer match broadcast video analysis method based on detection and tracking

• Published in: Computer animation and virtual worlds Vol. 35; no. 3
• Main Authors: Li, Hongyu, Yang, Meng, Yang, Chao, Kang, Jianglang, Suo, Xiang, Meng, Weiliang, Li, Zhen, Mao, Lijuan, Sheng, Bin, Qi, Jun
• Format: Journal Article
• Language: English
• Published: Chichester Wiley Subscription Services, Inc 01.05.2024
• Subjects: Cameras; field localization; player tracking; Soccer; soccer ball detection; Tracking; video analysis; Video broadcasting; visualizations
• ISSN: 1546-4261; 1546-427X
• DOI: 10.1002/cav.2259

We propose a comprehensive soccer match video analysis pipeline tailored for broadcast footage, which encompasses three pivotal stages: soccer field localization, player tracking, and soccer ball detection. Firstly, we introduce sports camera calibration to seamlessly map soccer field images from match videos onto a standardized two‐dimensional soccer field template. This addresses the challenge of consistent analysis across video frames amid continuous camera angle changes. Secondly, given challenges such as occlusions, high‐speed movements, and dynamic camera perspectives, obtaining accurate position data for players and the soccer ball is non‐trivial. To mitigate this, we curate a large‐scale, high‐precision soccer ball detection dataset and devise a robust detection model, which achieved the mAP50−95$$ mA{P}_{50-95} $$ of 80.9%. Additionally, we develop a high‐speed, efficient, and lightweight tracking model to ensure precise player tracking. Through the integration of these modules, our pipeline focuses on real‐time analysis of the current camera lens content during matches, facilitating rapid and accurate computation and analysis while offering intuitive visualizations.