Video Saliency Object Detection with Motion Quality Compensation

被引:1
|
作者
Wang, Hengsen [1 ]
Chen, Chenglizhao [2 ]
Li, Linfeng [1 ]
Peng, Chong [1 ]
机构
[1] Qingdao Univ, Sch Comp Sci & Technol, Qingdao 266071, Peoples R China
[2] China Univ Petr, Sch Comp Sci & Technol, Qingdao 266580, Peoples R China
基金
中国国家自然科学基金;
关键词
optical flow map; motion quality; long-term; video saliency object detection; FLOW;
D O I
10.3390/electronics12071618
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Video saliency object detection is one of the classic research problems in computer vision, yet existing works rarely focus on the impact of input quality on model performance. As optical flow is a key input for video saliency detection models, its quality significantly affects model performance. Traditional optical flow models only calculate the optical flow between two consecutive video frames, ignoring the motion state of objects over a period of time, leading to low-quality optical flow and reduced performance of video saliency object detection models. Therefore, this paper proposes a new optical flow model that improves the quality of optical flow by expanding the flow perception range and uses high-quality optical flow to enhance the performance of video saliency object detection models. Experimental results on the datasets show that the proposed optical flow model can significantly improve optical flow quality, with the S-M values on the DAVSOD dataset increasing by about 39%, 49%, and 44% compared to optical flow models such as PWCNet, SpyNet, and LFNet. In addition, experiments that fine-tuning the benchmark model LIMS demonstrate that improving input quality can further improve model performance.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] Unsupervised Video Object Segmentation Based on Mixture Models and Saliency Detection
    Guofeng Lin
    Wentao Fan
    Neural Processing Letters, 2020, 51 : 657 - 674
  • [32] SALIENCY-DRIVEN VERSATILE VIDEO CODING FOR NEURAL OBJECT DETECTION
    Fischer, Kristian
    Fleckenstein, Felix
    Herglotz, Christian
    Kaup, Andre
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1505 - 1509
  • [33] A Novel Video Salient Object Detection Method via Semisupervised Motion Quality Perception
    Chen, Chenglizhao
    Song, Jia
    Peng, Chong
    Wang, Guodong
    Fang, Yuming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (05) : 2732 - 2745
  • [34] Video Saliency Detection Using Motion Distinctiveness and Uniform Contrast Measure
    Kalboussi, Rahma
    Abdellaoui, Mehrez
    Douik, Ali
    INFORMATICA, 2019, 30 (01) : 53 - 72
  • [35] Evaluating quality of motion for unsupervised video object segmentation
    Cheng, Guanjun
    Song, Huihui
    OPTOELECTRONICS LETTERS, 2024, 20 (06) : 379 - 384
  • [36] Evaluating quality of motion for unsupervised video object segmentation
    CHENG Guanjun
    SONG Huihui
    Optoelectronics Letters, 2024, 20 (06) : 379 - 384
  • [37] Implicit Motion Handling for Video Camouflaged Object Detection
    Cheng, Xuelian
    Xiong, Huan
    Fan, Deng-Ping
    Zhong, Yiran
    Harandi, Mehrtash
    Drummond, Tom
    Ge, Zongyuan
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 13854 - 13863
  • [38] SALISA: Saliency-Based Input Sampling for Efficient Video Object Detection
    Bejnordi, Babak Ehteshami
    Habibian, Amirhossein
    Porikli, Fatih
    Ghodrati, Amir
    COMPUTER VISION, ECCV 2022, PT X, 2022, 13670 : 300 - 316
  • [39] Coherency Based Spatio-Temporal Saliency Detection for Video Object Segmentation
    Mahapatra, Dwarikanath
    Gilani, Syed Omer
    Saini, Mukesh Kumar
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2014, 8 (03) : 454 - 462
  • [40] OBJECT TRACKING AND ANOMALY DETECTION IN FULL MOTION VIDEO
    Zakharov, Igor
    Ma, Yue
    Henschel, Michael D.
    Bennett, John
    Parsons, Garrett
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 7910 - 7913