Video Saliency Object Detection with Motion Quality Compensation

被引:1
|
作者
Wang, Hengsen [1 ]
Chen, Chenglizhao [2 ]
Li, Linfeng [1 ]
Peng, Chong [1 ]
机构
[1] Qingdao Univ, Sch Comp Sci & Technol, Qingdao 266071, Peoples R China
[2] China Univ Petr, Sch Comp Sci & Technol, Qingdao 266580, Peoples R China
基金
中国国家自然科学基金;
关键词
optical flow map; motion quality; long-term; video saliency object detection; FLOW;
D O I
10.3390/electronics12071618
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Video saliency object detection is one of the classic research problems in computer vision, yet existing works rarely focus on the impact of input quality on model performance. As optical flow is a key input for video saliency detection models, its quality significantly affects model performance. Traditional optical flow models only calculate the optical flow between two consecutive video frames, ignoring the motion state of objects over a period of time, leading to low-quality optical flow and reduced performance of video saliency object detection models. Therefore, this paper proposes a new optical flow model that improves the quality of optical flow by expanding the flow perception range and uses high-quality optical flow to enhance the performance of video saliency object detection models. Experimental results on the datasets show that the proposed optical flow model can significantly improve optical flow quality, with the S-M values on the DAVSOD dataset increasing by about 39%, 49%, and 44% compared to optical flow models such as PWCNet, SpyNet, and LFNet. In addition, experiments that fine-tuning the benchmark model LIMS demonstrate that improving input quality can further improve model performance.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Video motion forgery detection using motion residual and object tracking
    Oliaei, Hayde
    Azghani, Masoumeh
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (05) : 12651 - 12668
  • [42] Motion Guided Attention for Video Salient Object Detection
    Li, Haofeng
    Chen, Guanqi
    Li, Guanbin
    Yu, Yizhou
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7273 - 7282
  • [43] Video motion forgery detection using motion residual and object tracking
    Hayde Oliaei
    Masoumeh Azghani
    Multimedia Tools and Applications, 2024, 83 : 12651 - 12668
  • [44] Object motion detection using information theoretic spatio-temporal saliency
    Liu, Chang
    Yuen, Pong C.
    Qiu, Guoping
    PATTERN RECOGNITION, 2009, 42 (11) : 2897 - 2906
  • [45] A fast DGPSO-motion saliency map based moving object detection
    Midhula Vijayan
    Mohan Ramasundaram
    Multimedia Tools and Applications, 2019, 78 : 7055 - 7075
  • [46] A fast DGPSO-motion saliency map based moving object detection
    Vijayan, Midhula
    Ramasundaram, Mohan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (06) : 7055 - 7075
  • [47] Object detection based on local motion compensation in complex scenes
    Li, Xiang
    Tan, Nanlin
    Wang, Tianlei
    Su, Shuqiang
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2014, 35 (07): : 1555 - 1563
  • [48] Predictive Video Saliency Detection
    Li, Qian
    Chen, Shifeng
    Zhang, Beiwei
    PATTERN RECOGNITION, 2012, 321 : 178 - +
  • [49] Impact of reference distance for motion compensation prediction on video quality
    Wang, Yubing
    Claypool, Mark
    Kinicki, Robert
    MULTIMEDIA COMPUTING AND NETWORKING 2007, 2007, 6504
  • [50] Video Saliency Detection via Graph Clustering With Motion Energy and Spatiotemporal Objectness
    Xu, Mingzhu
    Liu, Bing
    Fu, Ping
    Li, Junbao
    Hu, Yu Hen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (11) : 2790 - 2805