Video Saliency Object Detection with Motion Quality Compensation

被引:1
|
作者
Wang, Hengsen [1 ]
Chen, Chenglizhao [2 ]
Li, Linfeng [1 ]
Peng, Chong [1 ]
机构
[1] Qingdao Univ, Sch Comp Sci & Technol, Qingdao 266071, Peoples R China
[2] China Univ Petr, Sch Comp Sci & Technol, Qingdao 266580, Peoples R China
基金
中国国家自然科学基金;
关键词
optical flow map; motion quality; long-term; video saliency object detection; FLOW;
D O I
10.3390/electronics12071618
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Video saliency object detection is one of the classic research problems in computer vision, yet existing works rarely focus on the impact of input quality on model performance. As optical flow is a key input for video saliency detection models, its quality significantly affects model performance. Traditional optical flow models only calculate the optical flow between two consecutive video frames, ignoring the motion state of objects over a period of time, leading to low-quality optical flow and reduced performance of video saliency object detection models. Therefore, this paper proposes a new optical flow model that improves the quality of optical flow by expanding the flow perception range and uses high-quality optical flow to enhance the performance of video saliency object detection models. Experimental results on the datasets show that the proposed optical flow model can significantly improve optical flow quality, with the S-M values on the DAVSOD dataset increasing by about 39%, 49%, and 44% compared to optical flow models such as PWCNet, SpyNet, and LFNet. In addition, experiments that fine-tuning the benchmark model LIMS demonstrate that improving input quality can further improve model performance.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Video Saliency Detection Using Motion Saliency Filter
    Luo, Lei
    Jiang, Rongxin
    Tian, Xiang
    Chen, Yaowu
    2013 3RD INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT), 2013, : 1045 - 1049
  • [2] Video Saliency Detection Using Object Proposals
    Guo, Fang
    Wang, Wenguan
    Shen, Jianbing
    Shao, Ling
    Yang, Jian
    Tao, Dacheng
    Tang, Yuan Yan
    IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (11) : 3159 - 3170
  • [3] Fast Video Saliency Detection via Maximally Stable Region Motion and Object Repeatability
    Huang, Xiaoming
    Zhang, Yu-Jin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 4458 - 4470
  • [4] Automatic Video Object Segmentation Based on Visual and Motion Saliency
    Peng, Qinmu
    Cheung, Yiu-Ming
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (12) : 3083 - 3094
  • [5] Exploring Visual and Motion Saliency for Automatic Video Object Extraction
    Li, Wei-Te
    Chang, Haw-Shiuan
    Lien, Kuo-Chin
    Chang, Hui-Tang
    Wang, Yu-Chiang Frank
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (07) : 2600 - 2610
  • [6] Motion-Aware Rapid Video Saliency Detection
    Guo, Fang
    Wang, Wenguan
    Shen, Ziyi
    Shen, Jianbing
    Shao, Ling
    Tao, Dacheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (12) : 4887 - 4898
  • [7] Fusion hierarchy motion feature for video saliency detection
    Fen Xiao
    Huiyu Luo
    Wenlei Zhang
    Zhen Li
    Xieping Gao
    Multimedia Tools and Applications, 2024, 83 : 32301 - 32320
  • [8] Fusion hierarchy motion feature for video saliency detection
    Xiao, Fen
    Luo, Huiyu
    Zhang, Wenlei
    Li, Zhen
    Gao, Xieping
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (11) : 32301 - 32320
  • [9] A scalable affine core for video object motion compensation
    Badawy, W
    Bayoumi, M
    5TH INTERNATIONAL WORKSHOP ON COMPUTER ARCHITECTURES FOR MACHINE PERCEPTION, PROCEEDINGS, 2000, : 142 - 146
  • [10] Moving object detection in aerial video based on spatiotemporal saliency
    Shen Hao
    Li Shuxiao
    Zhu Chengfei
    Chang Hongxing
    Zhang Jinglan
    Chinese Journal of Aeronautics, 2013, (05) : 1211 - 1217