Transfer Learning to Timed Text Based Video Classification Using CNN

被引:0
|
作者
Kastrati, Zenun [1 ]
Imran, Ali Shariq [2 ]
Kurti, Arianit [1 ]
机构
[1] Linnaeus Univ, Dept Comp Sci & Media Technol, Vaxjo, Sweden
[2] Norwegian Univ Sci & Technol, Dept Elect Syst, Trondheim, Norway
关键词
Video Classification; CNN; DNN; Transfer Learning; Embedding; Machine Learning; MOOC;
D O I
10.1145/3326467.3326483
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Open educational video resources are gaining popularity with a growing number of massive open online courses (MOOCs). This has created a niche for content providers to adopt effective solutions in automatically organizing and structuring of educational resources for maximum visibility. Recent advances in deep learning techniques are proving useful in managing and classifying resources into appropriate categories. This paper proposes one such convolutional neural network (CNN) model for classifying video lectures in a MOOC setting using a transfer learning approach. The model uses a time-aligned text transcripts corresponding to video lectures from six broader subject categories. Video lectures and their corresponding transcript dataset is gathered from the Coursera MOOC platform. Two different CNN models are proposed: i) CNN based classification using embeddings learned from our MOOC dataset, ii) CNN based classification using transfer learning. Word embeddings generated from two well known state-of-the-art pre-trained models Word2Vec and GloVe, are used in the transfer learning approach for the second case. The proposed CNN models are evaluated using precision, recall, and F1 score and the obtained performance is compared with both conventional and deep learning classifiers. The proposed CNN models have an F1 score improvement of 10-22 percentage points over DNN and conventional classifiers.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Classification of Dental Diseases Using CNN and Transfer Learning
    Prajapati, Shreyansh A.
    Nagaraj, R.
    Mitra, Suman
    2017 5TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL AND BUSINESS INTELLIGENCE (ISCBI), 2017, : 70 - 74
  • [2] Skin Lesion Classification Using CNN-based Transfer Learning Model
    Dimililer, Kamil
    Sekeroglu, Boran
    GAZI UNIVERSITY JOURNAL OF SCIENCE, 2023, 36 (02): : 660 - 673
  • [3] Active Learning Based on Transfer Learning Techniques for Text Classification
    Onita, Daniela
    IEEE ACCESS, 2023, 11 : 28751 - 28761
  • [4] Automatic Fruits Freshness Classification Using CNN and Transfer Learning
    Amin, Umer
    Shahzad, Muhammad Imran
    Shahzad, Aamir
    Shahzad, Mohsin
    Khan, Uzair
    Mahmood, Zahid
    APPLIED SCIENCES-BASEL, 2023, 13 (14):
  • [5] Rice Leaf Diseases Classification Using CNN With Transfer Learning
    Ghosal, Shreya
    Sarkar, Kamal
    2020 IEEE CALCUTTA CONFERENCE (CALCON), 2020, : 230 - 235
  • [6] Fresh and rotten fruits classification using CNN and transfer learning
    Palakodati S.S.S.
    Chirra V.R.
    Dasari Y.
    Bulla S.
    Revue d'Intelligence Artificielle, 2020, 34 (05) : 617 - 622
  • [7] An Efficient Brain tumor classification using CNN and transfer learning
    Sasikumar, P.
    Cherukuvada, Srikanth
    Balmurugan, P.
    Anand, Vijay P.
    Brindasri, S.
    Nareshkumar, R.
    2024 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATION AND APPLIED INFORMATICS, ACCAI 2024, 2024,
  • [8] Microseismic event waveform classification using CNN-based transfer learning models
    Dong, Longjun
    Shu, Hongmei
    Tang, Zheng
    Yan, Xianhang
    INTERNATIONAL JOURNAL OF MINING SCIENCE AND TECHNOLOGY, 2023, 33 (10) : 1203 - 1216
  • [9] Effective Spam Image Classification Using CNN and Transfer Learning
    Rao, Shrihari
    Gopalapillai, Radhakrishan
    COMPUTATIONAL VISION AND BIO-INSPIRED COMPUTING, 2020, 1108 : 1378 - 1385
  • [10] Breakthrough Conventional Based Approach for Dog Breed Classification Using CNN with Transfer Learning
    Borwarnginn, Punyanuch
    Thongkanchorn, Kittikhun
    Kanchanapreechakorn, Sarattha
    Kusakunniran, Worapan
    2019 11TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND ELECTRICAL ENGINEERING (ICITEE 2019), 2019,