Bayesian fuzzy clustering and deep CNN-based automatic video summarization

被引:6
|
作者
Singh, Anshy [1 ]
Kumar, Manoj [1 ]
机构
[1] GLA Univ, Mathura, India
关键词
Deep convolution neural network; Video summarization; Bayesian Fuzzy clustering; Segmentation; Videos;
D O I
10.1007/s11042-023-15431-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The expansion of growth in the generation of video data in various organizations causes an urgent requirement for effectual video summarization methods. This paper devises a novel optimization-driven deep learning technique for video summarization. The aim is to give an automated video summarization. Initially, the video data is extracted from the database. Then, the representative frame selection is done using Bayesian fuzzy clustering (BFC). After that, the frames are then temporally segmented, wherein each segment is modelled as a representative frame, which is generated by clustering the temporal segment into clusters. These segments are selected from each cluster closest to the cluster center. The next step is fine refining that is performed using Deep convolution neural network (Deep CNN), which helps to refine the final frame set. The Deep CNN is trained using the proposed Lion deer hunting (LDH) algorithm. The LDH algorithm is the integration of the Deer hunting optimization algorithm (DHOA) and Lion optimization algorithm (LOA). Thus, the final frames obtained by the proposed LDH-based Deep CNN are employed for video summarization. Here, the final frames are adapted to play as a continuous output video. The developed LDH-based Deep CNN offered enhanced performance than other techniques with the highest precision of 0.841, highest recall of 0.810, and highest F1-Score of 0.888.
引用
收藏
页码:963 / 1000
页数:38
相关论文
共 50 条
  • [1] Bayesian fuzzy clustering and deep CNN-based automatic video summarization
    Anshy Singh
    Manoj Kumar
    Multimedia Tools and Applications, 2024, 83 : 963 - 1000
  • [2] CNN-Based Prediction of Frame-Level Shot Importance for Video Summarization
    Al Nahian, Mohaiminul
    Iftekhar, A. S. M.
    Islam, Mohammad Tariqul
    Rahman, S. M. Mahbubur
    Hatzinakos, Dimitrios
    2017 INTERNATIONAL CONFERENCE ON NEW TRENDS IN COMPUTING SCIENCES (ICTCS), 2017, : 24 - 29
  • [3] Automatic CNN-Based Enhancement of 360° Video Experience With Multisensorial Effects
    Sexton, John Patrick
    Simiscuka, Anderson Augusto
    Mcguinness, Kevin
    Muntean, Gabriel-Miro
    IEEE ACCESS, 2021, 9 : 133156 - 133169
  • [4] Fuzzy C-mean clustering technique based visual features fusion for automatic video summarization method
    Khalid E.T.
    Jassim S.A.
    Saqaeeyan S.
    Multimedia Tools and Applications, 2024, 83 (40) : 87673 - 87696
  • [5] A CNN-based automatic vulnerability detection
    Jung Hyun An
    Zhan Wang
    Inwhee Joe
    EURASIP Journal on Wireless Communications and Networking, 2023
  • [6] Video Compression With CNN-Based Postprocessing
    Zhang, Fan
    Ma, Di
    Feng, Chen
    Bull, David R.
    IEEE MULTIMEDIA, 2021, 28 (04) : 74 - 83
  • [7] A CNN-based automatic vulnerability detection
    An, Jung Hyun
    Wang, Zhan
    Joe, Inwhee
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2023, 2023 (01)
  • [8] Efficient Deep CNN-Based Fire Detection and Localization in Video Surveillance Applications
    Muhammad, Khan
    Ahmad, Jamil
    Lv, Zhihan
    Bellavista, Paolo
    Yang, Po
    Baik, Sung Wook
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (07): : 1419 - 1434
  • [9] Improving Query-Focused Summarization with CNN-Based Similarity
    Ying W.
    Xiao X.
    Li S.
    Lü Y.
    Sui Z.
    Li, Sujian (lisujian@pku.edu.cn), 1600, Peking University (53): : 197 - 203
  • [10] Sentences clustering based automatic summarization
    Wang, JH
    Zhou, SG
    Hu, YF
    2003 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-5, PROCEEDINGS, 2003, : 57 - 62