Topology-Aware Focal Loss for 3D Image Segmentation

被引:3
|
作者
Demir, Andac [1 ]
Massaad, Elie [2 ]
Kiziltan, Bulent [1 ]
机构
[1] Novartis, Basel, Switzerland
[2] Massachusetts Gen Hosp, Boston, MA USA
关键词
U-NET; CLASSIFICATION;
D O I
10.1109/CVPRW59228.2023.00065
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The efficacy of segmentation algorithms is frequently compromised by topological errors like overlapping regions, disrupted connections, and voids. To tackle this problem, we introduce a novel loss function, namely TopologyAware Focal Loss (TAFL), that incorporates the conventional Focal Loss with a topological constraint term based on the Wasserstein distance between the ground truth and predicted segmentation masks' persistence diagrams. By enforcing identical topology as the ground truth, the topological constraint can effectively resolve topological errors, while Focal Loss tackles class imbalance. We begin by constructing persistence diagrams from filtered cubical complexes of the ground truth and predicted segmentation masks. We subsequently utilize the Sinkhorn-Knopp algorithm to determine the optimal transport plan between the two persistence diagrams. The resultant transport plan minimizes the cost of transporting mass from one distribution to the other and provides a mapping between the points in the two persistence diagrams. We then compute the Wasserstein distance based on this travel plan to measure the topological dissimilarity between the ground truth and predicted masks. We evaluate our approach by training a 3D U-Net with the MICCAI Brain Tumor Segmentation (BraTS) challenge validation dataset, which requires accurate segmentation of 3D MRI scans that integrate various modalities for the precise identification and tracking of malignant brain tumors. Then, we demonstrate that the quality of segmentation performance is enhanced by regularizing the focal loss through the addition of a topological constraint as a penalty term.
引用
收藏
页码:580 / 589
页数:10
相关论文
共 50 条
  • [1] Topology-Aware Uncertainty for Image Segmentation
    Gupta, Saumya
    Zhang, Yikai
    Hu, Xiaoling
    Prasanna, Prateek
    Chen, Chao
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [2] Topology-Aware Single-Image 3D Shape Reconstruction
    Chen, Qimin
    Nguyen, Vincent
    Han, Feng
    Kiveris, Raimondas
    Tu, Zhuowen
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 1089 - 1097
  • [3] Topology-Aware Activation Layer for Neural Network Image Segmentation
    Baxter, John S. H.
    Jannin, Pierre
    MEDICAL IMAGING 2020: IMAGE PROCESSING, 2021, 11313
  • [4] Topology-aware universal adversarial attack on 3D object tracking
    Riran Cheng
    Xupeng Wang
    Ferdous Sohel
    Hang Lei
    Visual Intelligence, 1 (1):
  • [5] Topology-aware mamba for crack segmentation in structures
    Zuo, Xin
    Sheng, Yu
    Shen, Jifeng
    Shan, Yongwei
    AUTOMATION IN CONSTRUCTION, 2024, 168
  • [6] TopoSeg: Topology-Aware Nuclear Instance Segmentation
    He, Hongliang
    Wang, Jun
    Wei, Pengxu
    Xu, Fan
    Ji, Xiangyang
    Liu, Chang
    Chen, Jie
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 21250 - 21259
  • [7] TOPOLOGY-AWARE LEARNING FOR VOLUMETRIC CEREBROVASCULAR SEGMENTATION
    Banerjee, Subhashis
    Toumpanakis, Dimitrios
    Dhara, Ashis Kumar
    Wikstrom, Johan
    Strand, Robin
    2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [8] Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshes
    Hui, Ka-Hei
    Li, Ruihui
    Hu, Jingyu
    Fu, Chi-Wing
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18551 - 18561
  • [9] Chart Point Flow for Topology-Aware 3D Point Cloud Generation
    Kimura, Takumi
    Matsubara, Takashi
    Uehara, Kuniaki
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 1396 - 1404
  • [10] Topology-aware Image Compositing using NVLink
    Christensen, Cameron
    Fogal, Thomas
    Luehr, Nathan
    Woolley, Cliff
    2016 IEEE 6TH SYMPOSIUM ON LARGE DATA ANALYSIS AND VISUALIZATION (LDAV), 2016, : 93 - 94