An Unsupervised Method for Summarizing Egocentric Sport Videos

被引:0
|
作者
Habibi Aghdam, Hamed [1 ]
Jahani Heravi, Elnaz [1 ]
Puig, Domenec [1 ]
机构
[1] Univ Rovira & Virgili, Comp Engn & Math Dept, Tarragona, Spain
关键词
Video Summarizing; Egocentric Video; Temporal Segmentation; Sparse Coding; ONLINE;
D O I
10.1117/12.2228883
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
People are getting more interested to record their sport activities using head-worn or hand-held cameras. This type of videos which is called egocentric sport videos has different motion and appearance patterns compared with life-logging videos. While a life-logging video can be defined in terms of well-defined human-object interactions, notwithstanding, it is not trivial to describe egocentric sport videos using well-defined activities. For this reason, summarizing egocentric sport videos based on human-object interaction might fail to produce meaningful results. In this paper, we propose an unsupervised method for summarizing egocentric videos by identifying the key frames of the video. Our method utilizes both appearance and motion information and it automatically finds the number of the key-frames. Our blind user study on the new dataset collected from YouTube shows that in 93.5% cases, the users choose the proposed method as their first video summary choice. In addition, our method is within the top 2 choices of the users in 99% of studies.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Together Recognizing, Localizing and Summarizing Actions in Egocentric Videos
    Sahu, Abhimanyu
    Chowdhury, Ananda S.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4330 - 4340
  • [2] Summarizing egocentric videos using deep features and optimal clustering
    Sahu, Abhimanyu
    Chowdhury, Ananda S.
    NEUROCOMPUTING, 2020, 398 : 209 - 221
  • [3] Unsupervised understanding of location and illumination changes in egocentric videos
    Betancourt, Alejandro
    Diaz-Rodriguez, Natalia
    Barakova, Emilia
    Marcenaro, Lucio
    Rauterberg, Matthias
    Regazzoni, Carlo
    PERVASIVE AND MOBILE COMPUTING, 2017, 40 : 414 - 429
  • [4] A RESOURCE ALLOCATION FRAMEWORK FOR SUMMARIZING TEAM SPORT VIDEOS
    Chen, Fan
    De Vleeschouwer, Christophe
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 4349 - 4352
  • [5] Summarizing While Recording: Context-Based Highlight Detection for Egocentric Videos
    Lin, Yen-Liang
    Morariu, Vlad I.
    Hsu, Winston
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOP (ICCVW), 2015, : 443 - 451
  • [6] Unsupervised Segmentation of Action Segments in Egocentric Videos using Gaze
    Hipiny
    Ujir, H.
    Minoi, J. L.
    Juan, S. F. Samson
    Khairuddin, M. A.
    Sunar, M. S.
    2017 IEEE INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING APPLICATIONS (ICSIPA), 2017, : 351 - 356
  • [7] Unsupervised Gaze Prediction in Egocentric Videos by Energy-based Surprise Modeling
    Aakur, Sathyanarayanan N.
    Bagavathi, Arunkumar
    VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 935 - 942
  • [8] Summarizing Videos with Attention
    Fajtl, Jiri
    Sokeh, Hajar Sadeghi
    Argyriou, Vasileios
    Monekosso, Dorothy
    Remagnino, Paolo
    COMPUTER VISION - ACCV 2018 WORKSHOPS, 2019, 11367 : 39 - 54
  • [9] Anonymizing Egocentric Videos
    Thapar, Daksh
    Nigam, Aditya
    Arora, Chetan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 2300 - 2309
  • [10] A Novel Unsupervised Method for Temporal Segmentation of Videos
    Shi, Xiangbin
    Lu, Yaguang
    Liu, Cuiwei
    Zhang, Deyuan
    Liu, Fang
    2017 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND VISUALIZATION (ICVRV 2017), 2017, : 41 - 42