Video Saliency Object Detection with Motion Quality Compensation

被引:1
|
作者
Wang, Hengsen [1 ]
Chen, Chenglizhao [2 ]
Li, Linfeng [1 ]
Peng, Chong [1 ]
机构
[1] Qingdao Univ, Sch Comp Sci & Technol, Qingdao 266071, Peoples R China
[2] China Univ Petr, Sch Comp Sci & Technol, Qingdao 266580, Peoples R China
基金
中国国家自然科学基金;
关键词
optical flow map; motion quality; long-term; video saliency object detection; FLOW;
D O I
10.3390/electronics12071618
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Video saliency object detection is one of the classic research problems in computer vision, yet existing works rarely focus on the impact of input quality on model performance. As optical flow is a key input for video saliency detection models, its quality significantly affects model performance. Traditional optical flow models only calculate the optical flow between two consecutive video frames, ignoring the motion state of objects over a period of time, leading to low-quality optical flow and reduced performance of video saliency object detection models. Therefore, this paper proposes a new optical flow model that improves the quality of optical flow by expanding the flow perception range and uses high-quality optical flow to enhance the performance of video saliency object detection models. Experimental results on the datasets show that the proposed optical flow model can significantly improve optical flow quality, with the S-M values on the DAVSOD dataset increasing by about 39%, 49%, and 44% compared to optical flow models such as PWCNet, SpyNet, and LFNet. In addition, experiments that fine-tuning the benchmark model LIMS demonstrate that improving input quality can further improve model performance.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] A VIDEO SALIENCY DETECTION METHOD BASED ON SPATIAL AND MOTION INFORMATION
    Xue, Kang
    Wang, Xiying
    Ma, Gengyu
    Wang, Haitao
    Nam, Dongkyung
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 412 - 416
  • [22] Video Saliency Map Detection by Dominant Camera Motion Removal
    Huang, Chun-Rong
    Chang, Yun-Jung
    Yang, Zhi-Xiang
    Lin, Yen-Yu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (08) : 1336 - 1349
  • [23] VIDEO SALIENCY MAP DETECTION BASED ON GLOBAL MOTION ESTIMATION
    Xu, Jun
    Tu, Qin
    Li, Cuiwei
    Gao, Ran
    Men, Aidong
    2015 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2015,
  • [24] Spatiotemporal Saliency Detection based Video Quality Assessment
    Jia, Changcheng
    Lu, Wen
    He, Lihuo
    He, Ran
    8TH INTERNATIONAL CONFERENCE ON INTERNET MULTIMEDIA COMPUTING AND SERVICE (ICIMCS2016), 2016, : 340 - 343
  • [25] Video object segmentation based on global motion estimation/compensation
    Hsu, CT
    Tsai, YS
    Hsieh, MH
    Chien, YN
    ICCE: 2001 INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, DIGEST OF TECHNICAL PAPERS, 2001, : 168 - 169
  • [26] A scalable affine core for meshased video object motion compensation
    Badawy, W
    Bayoumi, M
    ICECS 2000: 7TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS & SYSTEMS, VOLS I AND II, 2000, : 663 - 666
  • [27] A Unified Video Semantics Extraction and Noise Object Suppression Network for Video Saliency Detection
    Tan, Zhenshan
    Gu, Xiaodong
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VII, 2023, 14260 : 337 - 348
  • [28] Saliency and Object Detection
    Kong, Phutphalla
    Mancas, Matei
    Kheang, Seng
    Gosselin, Bernard
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE (ICPRAI 2018), 2018, : 523 - 528
  • [29] Motion Vector Extrapolation for Video Object Detection
    True, Julian
    Khan, Naimul
    JOURNAL OF IMAGING, 2023, 9 (07)
  • [30] Unsupervised Video Object Segmentation Based on Mixture Models and Saliency Detection
    Lin, Guofeng
    Fan, Wentao
    NEURAL PROCESSING LETTERS, 2020, 51 (01) : 657 - 674