Transfer Learning to Timed Text Based Video Classification Using CNN

被引:0
|
作者
Kastrati, Zenun [1 ]
Imran, Ali Shariq [2 ]
Kurti, Arianit [1 ]
机构
[1] Linnaeus Univ, Dept Comp Sci & Media Technol, Vaxjo, Sweden
[2] Norwegian Univ Sci & Technol, Dept Elect Syst, Trondheim, Norway
关键词
Video Classification; CNN; DNN; Transfer Learning; Embedding; Machine Learning; MOOC;
D O I
10.1145/3326467.3326483
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Open educational video resources are gaining popularity with a growing number of massive open online courses (MOOCs). This has created a niche for content providers to adopt effective solutions in automatically organizing and structuring of educational resources for maximum visibility. Recent advances in deep learning techniques are proving useful in managing and classifying resources into appropriate categories. This paper proposes one such convolutional neural network (CNN) model for classifying video lectures in a MOOC setting using a transfer learning approach. The model uses a time-aligned text transcripts corresponding to video lectures from six broader subject categories. Video lectures and their corresponding transcript dataset is gathered from the Coursera MOOC platform. Two different CNN models are proposed: i) CNN based classification using embeddings learned from our MOOC dataset, ii) CNN based classification using transfer learning. Word embeddings generated from two well known state-of-the-art pre-trained models Word2Vec and GloVe, are used in the transfer learning approach for the second case. The proposed CNN models are evaluated using precision, recall, and F1 score and the obtained performance is compared with both conventional and deep learning classifiers. The proposed CNN models have an F1 score improvement of 10-22 percentage points over DNN and conventional classifiers.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] A CNN-based Transfer Learning Method for Defect Classification in Semiconductor Manufacturing
    Imoto, Kazunori
    Nakai, Tomohiro
    Ike, Tsukasa
    Haruki, Kosuke
    Sato, Yoshiyuki
    2018 INTERNATIONAL SYMPOSIUM ON SEMICONDUCTOR MANUFACTURING (ISSM), 2018,
  • [42] Cluster and Dynamic-TrAdaBoost- Based Transfer Learning for Text Classification
    Li, Zibin
    Liu, Bo
    Xiao, Yanshan
    2017 13TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2017, : 2291 - 2295
  • [43] Text Classification Method Based On Semi-Supervised Transfer Learning
    Yu, Xiaosheng
    Zhang, Hehuan
    Li, Jing
    2021 21ST INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY COMPANION (QRS-C 2021), 2021, : 388 - 394
  • [44] Leveraging CNN and Transfer Learning for Classification of Histopathology Images
    Dubey, Achyut
    Singh, Satish Kumar
    Jiang, Xiaoyi
    MACHINE LEARNING, IMAGE PROCESSING, NETWORK SECURITY AND DATA SCIENCES, MIND 2022, PT II, 2022, 1763 : 3 - 13
  • [45] Source Free Transfer Learning for Text Classification
    Lu, Zhongqi
    Zhu, Yin
    Pan, Sinno Jialin
    Xiang, Evan Wei
    Wang, Yujing
    Yang, Qiang
    PROCEEDINGS OF THE TWENTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2014, : 122 - 128
  • [46] The Effect of Transfer Learning on Turkish Text Classification
    Sahin, Gurkan
    Diri, Banu
    29TH IEEE CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS (SIU 2021), 2021,
  • [47] Video Stream Gender Classification Using Shallow CNN
    Gorokhovatskyi, Oleksii
    Peredrii, Olena
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2021, 35 (01)
  • [48] Video Summarization using Text Subjectivity Classification
    Moraes, Leonardo
    Marcacini, Ricardo Marcondes
    Goularte, Rudinei
    PROCEEDINGS OF THE 28TH BRAZILIAN SYMPOSIUM ON MULTIMEDIA AND THE WEB, WEBMEDIA 2022, 2022, : 133 - 141
  • [49] Abstractive text summarization using LSTM-CNN based deep learning
    Shengli Song
    Haitao Huang
    Tongxiao Ruan
    Multimedia Tools and Applications, 2019, 78 : 857 - 875
  • [50] Brain tumor segmentation and classification using transfer learning based CNN model with model agnostic concept interpretation
    A. Maria Nancy
    R. Maheswari
    Multimedia Tools and Applications, 2025, 84 (5) : 2509 - 2538