Multimodal topic segmentation and classification of news video

被引:0
|
作者
Raaijmakers, S [1 ]
den Hartog, J [1 ]
Baan, J [1 ]
机构
[1] TNO, Netherlands Org Appl Sci Res, Inst Appl Phys & MediaMill, Delft, Netherlands
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper we describe a model for multimodal topic segmentation and classification of Dutch news video. A focal topic of interest for the research reported here is the interaction between three different modalities (visual, auditory and textual information) in an integrated model for video analysis. We present a fully automated sequential feedback model for video analysis, where linguistic analysis is combined with visual information for the purposes of both segmentation and classification.
引用
收藏
页码:A33 / A36
页数:4
相关论文
共 50 条
  • [41] Decoupling Multimodal Transformers for Referring Video Object Segmentation
    Gao, Mingqi
    Yang, Jinyu
    Han, Jungong
    Lu, Ke
    Zheng, Feng
    Montana, Giovanni
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (09) : 4518 - 4528
  • [42] Multimodal video classification with stacked contractive autoencoders
    Liu, Yanan
    Feng, Xiaoqing
    Zhou, Zhiguang
    SIGNAL PROCESSING, 2016, 120 : 761 - 766
  • [43] Multimodal deep representation learning for video classification
    Haiman Tian
    Yudong Tao
    Samira Pouyanfar
    Shu-Ching Chen
    Mei-Ling Shyu
    World Wide Web, 2019, 22 : 1325 - 1341
  • [44] Multimodal Sentiment and Gender Classification for Video Logs
    Al-Azani, Sadam
    El-Alfy, El-Sayed M.
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE (ICAART), VOL 2, 2019, : 907 - 914
  • [45] Multimodal deep representation learning for video classification
    Tian, Haiman
    Tao, Yudong
    Pouyanfar, Samira
    Chen, Shu-Ching
    Shyu, Mei-Ling
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2019, 22 (03): : 1325 - 1341
  • [46] Video genre classification using multimodal features
    Jin, SH
    Bae, TM
    Choo, JH
    Ro, YM
    STORAGE AND RETRIEVAL METHODS AND APPLICATIONS FOR MULTIMEDIA 2004, 2004, 5307 : 307 - 318
  • [47] Using topic concepts for semantic video shots classification
    Ayache, Stephane
    Quenot, Georges
    Gensel, Jerome
    Satoh, Shin'ichi
    IMAGE AND VIDEO RETRIEVAL, PROCEEDINGS, 2006, 4071 : 300 - 309
  • [48] Topic Segmentation of Educational Video Lectures Using Audio and Text
    Dimitsas, Markos
    Leidner, Jochen L.
    ARTIFICIAL INTELLIGENCE-ECAI 2023 INTERNATIONAL WORKSHOPS, PT 2, XAI3, TACTIFUL, XI-ML, SEDAMI, RAAIT, AI4S, HYDRA, AI4AI, 2023, 2024, 1948 : 447 - 458
  • [49] Sequential Bayesian Nonparametric Multimodal Topic Models for Video Data Analysis
    Xue, Jianfei
    Eguchi, Koji
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (04): : 1079 - 1087
  • [50] Multi-criteria video segmentation for TV news
    Chen, L
    Faudemay, P
    1997 IEEE FIRST WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, 1997, : 319 - 324