AI-Based Video Clipping of Soccer Events

被引:3
|
作者
Valand, Joakim Olav [1 ,2 ]
Kadragic, Haris [1 ,2 ]
Hicks, Steven Alexander [1 ,3 ]
Thambawita, Vajira Lasantha [1 ,3 ]
Midoglu, Cise [1 ]
Kupka, Tomas [4 ]
Johansen, Dag [5 ]
Riegler, Michael Alexander [1 ,5 ]
Halvorsen, Pal [1 ,3 ,4 ]
机构
[1] SimulaMet, N-0167 Oslo, Norway
[2] Univ Oslo, Dept Informat, N-0373 Oslo, Norway
[3] Oslo Metropolitan Univ, Dept Comp Sci, N-0167 Oslo, Norway
[4] Forzasys, N-0167 Oslo, Norway
[5] UIT Arctic Univ Norway, Dept Comp Sci, N-9037 Tromso, Norway
来源
关键词
event clipping; deep learning; logo transition; scene boundary detection; soccer; sports analysis; video;
D O I
10.3390/make3040049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The current gold standard for extracting highlight clips from soccer games is the use of manual annotations and clippings, where human operators define the start and end of an event and trim away the unwanted scenes. This is a tedious, time-consuming, and expensive task, to the extent of being rendered infeasible for use in lower league games. In this paper, we aim to automate the process of highlight generation using logo transition detection, scene boundary detection, and optional scene removal. We experiment with various approaches, using different neural network architectures on different datasets, and present two models that automatically find the appropriate time interval for extracting goal events. These models are evaluated both quantitatively and qualitatively, and the results show that we can detect logo and scene transitions with high accuracy and generate highlight clips that are highly acceptable for viewers. We conclude that there is considerable potential in automating the overall soccer video clipping process.
引用
收藏
页码:990 / 1008
页数:19
相关论文
共 50 条
  • [1] AI-based video analysis for traffic monitoring
    Tung, Bui Son
    Ngoc, Phung The
    Thanh, Do Duy
    Thinh, Nguyen Hong
    PROCEEDINGS OF 2022 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2022, : 2035 - 2040
  • [2] Multimodal AI-Based Summarization and Storytelling for Soccer on Social Media
    Sarkhoosh, Mehdi Houshmand
    Gautam, Sushant
    Midoglu, Cise
    Sabet, Saeed Shafiee
    Halvorsen, Pal
    PROCEEDINGS OF THE 2024 15TH ACM MULTIMEDIA SYSTEMS CONFERENCE 2024, MMSYS 2024, 2024, : 485 - 491
  • [3] AI-Based Saliency-Aware Video Coding
    Pelurson S.
    Cozanet J.
    Guionnet T.
    Abdoli M.
    Biatek T.
    SMPTE Motion Imaging Journal, 2022, 131 (04): : 21 - 29
  • [4] AI-based Video Processing and Its Application to Wireless Transmission
    Yue, Li
    Maeda, Naoki
    Toyoda, Shigeharu
    Ogawa, Shouhei
    Handa, Kazuya
    Fujita, Yasuhito
    SEI Technical Review, 2023, (96): : 81 - 84
  • [5] AI-Based Video Segmentation: Procedural Steps or Basic Maneuvers?
    Perumalla, Calvin
    Kearse, LaDonna
    Peven, Michael
    Laufer, Shlomi
    Goll, Cassidi
    Wise, Brett
    Yang, Su
    Pugh, Carla
    JOURNAL OF SURGICAL RESEARCH, 2023, 283 : 500 - 506
  • [6] Edge HPC Architectures for AI-Based Video Surveillance Applications
    Rossi, Federico
    Saponara, Sergio
    ELECTRONICS, 2024, 13 (09)
  • [7] The key events extraction algorithm based on shot events in soccer video
    Zhai X.
    Zhai, Xiang (597390959@qq.com), 1600, Science and Engineering Research Support Society (11): : 33 - 42
  • [8] Automated Clipping of Soccer Events using Machine Learning
    Valand, Joakim O.
    Kadragic, Haris
    Hicks, Steven A.
    Thambawita, Vajira
    Midoglu, Cise
    Kupka, Tomas
    Johansen, Dag
    Riegler, Michael A.
    Halvorsen, Pal
    23RD IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2021), 2021, : 210 - 214
  • [9] Hardware Accelerators for AI-based Video Enhancement and Optimization in Video ASICs for Data Center
    Lee, Ungwon
    Kim, Jungtae
    Kim, Sijung
    Kim, Dong-gyu
    Jeon, Minyong
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XLVII, 2024, 13137
  • [10] Development of AI-Based Multisensory System for Monitoring Quay Wall Events
    Shin, Junsik
    Park, Junyoung
    Won, Jongbin
    Park, Jongwoong
    Min, Jiyoung
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2024, 12 (11)