Soccer match broadcast video analysis method based on detection and tracking

被引:5
|
作者
Li, Hongyu [1 ]
Yang, Meng [1 ,2 ]
Yang, Chao [1 ]
Kang, Jianglang [1 ]
Suo, Xiang [3 ]
Meng, Weiliang [4 ,5 ]
Li, Zhen [3 ]
Mao, Lijuan [3 ]
Sheng, Bin [6 ]
Qi, Jun [7 ]
机构
[1] Beijing Forestry Univ, Sch Informat Sci & Technol, Beijing, Peoples R China
[2] Natl Forestry & Grassland Adm, Engn Res Ctr Forestry Oriented Intelligent Informa, Beijing, Peoples R China
[3] Shanghai Univ Sport, Sch Athlet Performance, Shanghai, Peoples R China
[4] Chinese Acad Sci, Inst Automat, State Key Lab Multimodal Artificial Intelligence S, Beijing, Peoples R China
[5] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
[6] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
[7] Xian JiaoTong Liverpool Univ, Dept Comp, Suzhou, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
field localization; player tracking; soccer ball detection; video analysis; visualizations;
D O I
10.1002/cav.2259
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We propose a comprehensive soccer match video analysis pipeline tailored for broadcast footage, which encompasses three pivotal stages: soccer field localization, player tracking, and soccer ball detection. Firstly, we introduce sports camera calibration to seamlessly map soccer field images from match videos onto a standardized two-dimensional soccer field template. This addresses the challenge of consistent analysis across video frames amid continuous camera angle changes. Secondly, given challenges such as occlusions, high-speed movements, and dynamic camera perspectives, obtaining accurate position data for players and the soccer ball is non-trivial. To mitigate this, we curate a large-scale, high-precision soccer ball detection dataset and devise a robust detection model, which achieved the mAP50-95$$ mA{P}_{50-95} $$ of 80.9%. Additionally, we develop a high-speed, efficient, and lightweight tracking model to ensure precise player tracking. Through the integration of these modules, our pipeline focuses on real-time analysis of the current camera lens content during matches, facilitating rapid and accurate computation and analysis while offering intuitive visualizations.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Trajectory-based ball detection and tracking in broadcast soccer video
    Yu, Xinguo
    Leong, Hon Wai
    Xu, Changsheng
    Tian, Qi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2006, 8 (06) : 1164 - 1178
  • [2] An MLP-Based Player Detection and Tracking in Broadcast Soccer Video
    Heydari, Mohammad
    Moghadam, Amir Masoud Eftekhari
    2012 INTERNATIONAL CONFERENCE ON ROBOTICS AND ARTIFICIAL INTELLIGENCE (ICRAI), 2012, : 195 - 199
  • [3] A scheme for ball detection and tracking in broadcast soccer video
    Liang, DW
    Liu, Y
    Huang, QM
    Gao, W
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2005, PT 1, 2005, 3767 : 864 - 875
  • [4] Automatic player detection, labeling and tracking in broadcast soccer video
    Liu, Jia
    Tong, Xiaofeng
    Li, Wenlong
    Wang, Tao
    Zhang, Yimin
    Wang, Hongqi
    PATTERN RECOGNITION LETTERS, 2009, 30 (02) : 103 - 113
  • [5] Robust player detection and tracking in broadcast soccer video based on enhanced particle filter
    Yang, Ying
    Li, Danyang
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 46 : 81 - 94
  • [6] A ball tracking framework for broadcast soccer video
    Yu, XG
    Xu, CS
    Tian, Q
    Leong, HW
    2003 INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOL II, PROCEEDINGS, 2003, : 273 - 276
  • [7] Tracking soccer ball in TV broadcast video
    Choi, K
    Seo, Y
    IMAGE ANALYSIS AND PROCESSING - ICIAP 2005, PROCEEDINGS, 2005, 3617 : 661 - 668
  • [8] Trajectory-based ball detection and tracking in broadcast soccer video with the aid of camera motion recovery
    Yu, Xinguo
    Tu, Xiaoying
    Ang, Ee Luang
    2007 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-5, 2007, : 1543 - +
  • [9] Graph-based multiplayer detection and tracking in broadcast soccer videos
    Pallavi, V.
    Mukherjee, Jayanta
    Majumdar, Arun K.
    Sural, Shamik
    IEEE TRANSACTIONS ON MULTIMEDIA, 2008, 10 (05) : 794 - 805
  • [10] Toward a more practical offside line detection method in broadcast soccer video
    Li, Q. (qiong.li@hit.edu.cn), 1600, Binary Information Press, P.O. Box 162, Bethel, CT 06801-0162, United States (09):