Bayesian fuzzy clustering and deep CNN-based automatic video summarization

被引:6
|
作者
Singh, Anshy [1 ]
Kumar, Manoj [1 ]
机构
[1] GLA Univ, Mathura, India
关键词
Deep convolution neural network; Video summarization; Bayesian Fuzzy clustering; Segmentation; Videos;
D O I
10.1007/s11042-023-15431-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The expansion of growth in the generation of video data in various organizations causes an urgent requirement for effectual video summarization methods. This paper devises a novel optimization-driven deep learning technique for video summarization. The aim is to give an automated video summarization. Initially, the video data is extracted from the database. Then, the representative frame selection is done using Bayesian fuzzy clustering (BFC). After that, the frames are then temporally segmented, wherein each segment is modelled as a representative frame, which is generated by clustering the temporal segment into clusters. These segments are selected from each cluster closest to the cluster center. The next step is fine refining that is performed using Deep convolution neural network (Deep CNN), which helps to refine the final frame set. The Deep CNN is trained using the proposed Lion deer hunting (LDH) algorithm. The LDH algorithm is the integration of the Deer hunting optimization algorithm (DHOA) and Lion optimization algorithm (LOA). Thus, the final frames obtained by the proposed LDH-based Deep CNN are employed for video summarization. Here, the final frames are adapted to play as a continuous output video. The developed LDH-based Deep CNN offered enhanced performance than other techniques with the highest precision of 0.841, highest recall of 0.810, and highest F1-Score of 0.888.
引用
收藏
页码:963 / 1000
页数:38
相关论文
共 50 条
  • [21] CNN-Based Shot Boundary Detection and Video Annotation
    Tong, Wenjing
    Song, Li
    Yang, Xiaokang
    Qu, Hui
    Xie, Rong
    2015 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2015,
  • [22] CNN-BASED VIDEO CODEC CLASSIFIER FOR MULTIMEDIA FORENSICS
    Pessoa, Rodrigo
    Kokaram, Anil
    Pitie, Francois
    Sugrue, Mark
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3033 - 3037
  • [23] CNN-Based Automatic Modulation Classification in OFDM Systems
    Song, Geonho
    Jang, Mingyu
    Yoon, Dongweon
    2022 INTERNATIONAL CONFERENCE ON COMPUTER, INFORMATION AND TELECOMMUNICATION SYSTEMS, CITS, 2022, : 101 - 104
  • [24] Fusion Methods for CNN-Based Automatic Modulation Classification
    Zheng, Shilian
    Qi, Peihan
    Chen, Shichuan
    Yang, Xiaoniu
    IEEE ACCESS, 2019, 7 : 66496 - 66504
  • [25] Automatic video summarization by discovering frequent patterns with support vector clustering
    Xiao, Ruo-Gui
    Zhuang, Yue-Ting
    Wu, Fei
    PROCEEDINGS OF 2006 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2006, : 1174 - 1177
  • [26] Automatic Video Summarization by Affinity Propagation Clustering and Semantic Content Mining
    Xie, Xiao-neng
    Wu, Fei
    PROCEEDINGS OF THE INTERNATIONAL SYMPOSIUM ON ELECTRONIC COMMERCE AND SECURITY, 2008, : 203 - +
  • [27] Automatic Text Summarization using Fuzzy C-Means Clustering
    Anam, Shakil Ashraful
    Rahman, A. M. Muntasir
    Saleheen, Nasif Noor
    Arif, Hossain
    2018 JOINT 7TH INTERNATIONAL CONFERENCE ON INFORMATICS, ELECTRONICS & VISION (ICIEV) AND 2018 2ND INTERNATIONAL CONFERENCE ON IMAGING, VISION & PATTERN RECOGNITION (ICIVPR), 2018, : 180 - 184
  • [28] A Bayesian CNN-based fusion framework of sensor fault diagnosis
    He, Beiyan
    Zhu, Chunli
    Li, Zhongxiang
    Hu, Chun
    Zheng, Dezhi
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (04)
  • [29] Entropy Based Fuzzy C Means Clustering and Key Frame Extraction for Sports Video Summarization
    Angadi, Shanmukhappa
    Naik, Vilas
    2014 FIFTH INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP 2014), 2014, : 271 - 279
  • [30] Efficinet video summarization based on a fuzzy video content representation
    Doulamis, AD
    Doulamis, ND
    Kollias, SD
    ISCAS 2000: IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS - PROCEEDINGS, VOL IV: EMERGING TECHNOLOGIES FOR THE 21ST CENTURY, 2000, : 301 - 304