Video object segmentation based on dynamic perception update and feature fusion

被引:0
|
作者
Hou, Zhiqiang [1 ,2 ]
Li, Fucheng [1 ,2 ]
Dong, Jiale [1 ,2 ]
Dai, Nan [1 ,2 ]
Ma, Sugang [1 ,2 ]
Fan, Jiulun [3 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Xian 710121, Peoples R China
[2] Key Lab Network Data Anal & Intelligent Proc Shaan, Xian 710121, Peoples R China
[3] Xian Univ Posts & Telecommun, Sch Commun & Informat Engn, Xian 710121, Peoples R China
基金
中国国家自然科学基金;
关键词
Memory network; History frames; Dynamic perception update; Feature fusion; Mask refinement;
D O I
10.1016/j.imavis.2024.105156
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The current popular video object segmentation algorithms based on memory network indiscriminately update the frame information to the memory pool, fails to make reasonable use of the historical frame information, causing frame information redundancy in the memory pool, resulting in the increase of the computation amount. At the same time, the mask refinement method is relatively rough, resulting in blurred edges of the generated mask. To solve these problems, This paper proposes a video object segmentation algorithm based on dynamic perception update and feature fusion. In order to reasonably utilize the historical frame information, a dynamic perception update module is proposed to selectively update the segmentation frame mask. Meanwhile, a mask refinement module is established to enhance the detail information of the shallow features of the backbone network. This module uses a double kernels fusion block to fuse the different scale information of the features, and finally uses the Laplacian operator to sharpen the edges of the mask. The experimental results show that on the public datasets DAVIS2016, DAVIS2017 and YouTube-VOS18, the comprehensive performance of the algorithm in this paper reaches 86.9%, 79.3% and 71.6%, respectively, and the segmentation speed reaches 15FPS on the DAVIS2016 dataset. Compared with many mainstream algorithms in recent years, it has obvious advantages in performance.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Dynamic Feature Fusion for Visual Object Detection and Segmentation
    Hu, Yu-Ming
    Xie, Jia-Jin
    Shuai, Hong-Han
    Huang, Ching-Chun
    Chou, I. -Fan
    Cheng, Wen-Huang
    2023 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, ICCE, 2023,
  • [2] Feature Fusion and Label Propagation for Textured Object Video Segmentation
    Prasath, V. B. Surya
    Pelapur, Rengarajan
    Palaniappan, Kannappan
    Seetharaman, Gunasekaran
    GEOSPATIAL INFOFUSION AND VIDEO ANALYTICS IV; AND MOTION IMAGERY FOR ISR AND SITUATIONAL AWARENESS II, 2014, 9089
  • [3] Mesh based segmentation and update for object based video
    Gökçetekin, MH
    Harmanci, MD
    Celasun, I
    Tekalp, AM
    2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL I, PROCEEDINGS, 2000, : 343 - 346
  • [4] Video object segmentation based on temporal frame context information fusion and feature enhancement
    Hou, Zhiqiang
    Li, Fucheng
    Wang, Shuiyuan
    Dai, Nan
    Ma, Sugang
    Fan, Jiulun
    APPLIED INTELLIGENCE, 2023, 53 (06) : 6496 - 6510
  • [5] Video object segmentation based on temporal frame context information fusion and feature enhancement
    Zhiqiang Hou
    Fucheng Li
    Shuiyuan Wang
    Nan Dai
    Sugang Ma
    Jiulun Fan
    Applied Intelligence, 2023, 53 : 6496 - 6510
  • [6] Video Object Segmentation Based on Guided Feature Transfer Learning
    Fiaz, Mustansar
    Mahmood, Arif
    Farooq, Sehar Shahzad
    Ali, Kamran
    Shaheryar, Muhammad
    Jung, Soon Ki
    FRONTIERS OF COMPUTER VISION (IW-FCV 2022), 2022, 1578 : 197 - 210
  • [7] Video Object Segmentation Based on Multi-Feature Clustering
    Hu, Shuangyan
    Li, Junshan
    Li, Xuhui
    Huang, Baigang
    2008 7TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-23, 2008, : 5946 - 5949
  • [8] Camouflaged object segmentation based on edge enhancement and feature fusion
    Li, Mingyan
    Wu, Chuan
    Zhu, Ming
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (01) : 48 - 58
  • [9] GENERIC OBJECT RECOGNITION BASED ON FEATURE FUSION IN ROBOT PERCEPTION
    Li, Xinde
    Luo, Chaomin
    Dezert, Jean
    Tan, Yingzi
    INTERNATIONAL JOURNAL OF ROBOTICS & AUTOMATION, 2016, 31 (05): : 409 - 415
  • [10] Generic object recognition based on feature fusion in robot perception
    1600, Acta Press, Building B6, Suite 101, 2509 Dieppe Avenue S.W., Calgary, AB, T3E 7J9, Canada (31):