Camouflaged object detection with counterfactual intervention

被引:8
|
作者
Li, Xiaofei [1 ]
Li, Hongying [1 ]
Zhou, Hao [2 ]
Yu, Miaomiao [1 ]
Chen, Dong [3 ]
Li, Shuohao [1 ]
Zhang, Jun [1 ]
机构
[1] Natl Univ Def Technol, Lab Big Data & Decis, 109 Deya Rd, Changsha 410003, Hunan, Peoples R China
[2] Naval Univ Engn, Dept Operat & Planning, 717 Jianshe Ave, Wuhan 430033, Hubei, Peoples R China
[3] Natl Univ Def Technol, Sci & Technol Informat Syst Engn Lab, 109 Deya Rd, Changsha 410003, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
Camouflaged object detection; Texture-aware; Context-aware; Counterfactual intervention; SEGMENTATION; NETWORK;
D O I
10.1016/j.neucom.2023.126530
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Camouflaged object detection (COD) aims to identify camouflaged objects hiding in their surroundings, which is a valuable yet challenging task. The main challenge is that there are ambiguous semantic biases in the camouflaged object datasets, which affect the results of COD. To address this challenge, we design a counter-factual intervention network (CINet) to mitigate the influences of ambiguous semantic biases and obtain accurate COD. Specifically, our CINet consists of three key modules, i.e., texture-aware interaction module (TIM), context-aware fusion module (CFM), and counterfactual intervention module (CIM). The TIM is designed to extract the refined textures for accurate localization, the CFM is proposed to fuse the multi-scale contextual features to enhance the detection performance, and the CIM is presented to learn more effective textures and make unbiased predictions. Unlike most existing COD methods that directly capture contextual features through the final loss function, we develop a counterfactual intervention strategy to learn more effective contextual textures. Extensive experiments on four challenging benchmark datasets demonstrate that our CINet significantly outperforms 31 state-of-the-art methods.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Decoupling and Integration Network for Camouflaged Object Detection
    Zhou, Xiaofei
    Wu, Zhicong
    Cong, Runmin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7114 - 7129
  • [22] Search and recovery network for camouflaged object detection
    Liu, Guangrui
    Wu, Wei
    IMAGE AND VISION COMPUTING, 2024, 151
  • [23] A MULTICHANNEL LOCALIZATION METHOD FOR CAMOUFLAGED OBJECT DETECTION
    Rahman, Md. Rakibur
    Chowdhury, Md. Mafri
    Sarkar, Md. Shohanur Rahaman
    Karim, Md. Shahriar
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3389 - 3393
  • [24] Camouflaged object detection for machine vision applications
    Rao, Chennamsetty Pulla
    Reddy, A. Guruva
    Rao, C. B. Rama
    INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY, 2020, 23 (02) : 327 - 335
  • [25] A Bayesian Approach to Camouflaged Moving Object Detection
    Zhang, Xiang
    Zhu, Ce
    Wang, Shuai
    Liu, Yipeng
    Ye, Mao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2017, 27 (09) : 2001 - 2013
  • [26] Rethinking Camouflaged Object Detection: Models and Datasets
    Bi, Hongbo
    Zhang, Cong
    Wang, Kang
    Tong, Jinghui
    Zheng, Feng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (09) : 5708 - 5724
  • [27] Modeling Aleatoric Uncertainty for Camouflaged Object Detection
    Liu, Jiawei
    Zhang, Jing
    Barnes, Nick
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 2613 - 2622
  • [28] Uncertainty-aware Joint Salient Object and Camouflaged Object Detection
    Li, Aixuan
    Zhang, Jing
    Lv, Yunqiu
    Liu, Bowen
    Zhang, Tong
    Dai, Yuchao
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 10066 - 10076
  • [29] Integrating Part-Object Relationship and Contrast for Camouflaged Object Detection
    Liu, Yi
    Zhang, Dingwen
    Zhang, Qiang
    Han, Jungong
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2021, 16 : 5154 - 5166
  • [30] Boundary enhancement and refinement network for camouflaged object detection
    Xia, Chenxing
    Cao, Huizhen
    Gao, Xiuju
    Ge, Bin
    Li, Kuan-Ching
    Fang, Xianjin
    Zhang, Yan
    Liang, Xingzhu
    MACHINE VISION AND APPLICATIONS, 2024, 35 (05)