Multi-stage stacked temporal convolution neural networks (MS-S-TCNs) for biosignal segmentation and anomaly localization

被引:4
|
作者
Dissanayake, Theekshana [1 ]
Fernando, Tharindu [1 ]
Denman, Simon [1 ]
Sridharan, Sridha [1 ]
Fookes, Clinton [1 ]
机构
[1] Queensland Univ Technol, Signal Proc Artifinal Intelligence & Vis Technol S, Brisbane, Australia
基金
澳大利亚研究理事会;
关键词
Deep learning; Electrocardiogram; Heart sounds; Lung sounds; Segmentation; Model interpretation;
D O I
10.1016/j.patcog.2023.109440
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the computer vision domain, temporal convolution networks (TCN) have gained traction due to their lightweight, robust architectures for sequence-to-sequence prediction tasks. With that insight, in this study, we propose a novel deep learning architecture for biosignal segmentation and anomaly localiza-tion based on TCNs, named the multi-stage stacked TCN, which employs multiple TCN modules with varying dilation factors. More precisely, for each stage, our architecture uses TCN modules with multiple dilation factors, and we use convolution-based fusion to combine predictions returned from each stage. Furthermore, aiming smoothed predictions, we introduce a novel loss function based on the first-order derivative. To demonstrate the robustness of our architecture, we evaluate our model on five different tasks related to three 1D biosignal modalities (heart sounds, lung sounds and electrocardiogram). Our proposed framework achieves state-of-the-art performance for all tasks, significantly outperforming the respective state-of-the-art models having F1 score gains up to approximate to 9 %. Furthermore, the framework demon-strates competitive performance gains compared to traditional multi-stage TCN models with similar con-figurations yielding F1 score gains up to approximate to 5 %. Our model is also interpretable. Using neural conductance, we demonstrate the effectiveness of having TCNs with varying dilation factors. Our visualizations show that the model benefits from feature maps captured at multiple dilation factors, and the information is effectively propagated through the network such that the final stage produces the most accurate result.(c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 13 条
  • [1] MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentation
    Abu Farha, Yazan
    Gall, Juergen
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3570 - 3579
  • [2] Skeleton-Based Action Segmentation With Multi-Stage Spatial-Temporal Graph Convolutional Neural Networks
    Filtjens, Benjamin
    Vanrumste, Bart
    Slaets, Peter
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2024, 12 (01) : 202 - 212
  • [3] MS-TCN plus plus : Multi-Stage Temporal Convolutional Network for Action Segmentation
    Li, Shijie
    Abu Farha, Yazan
    Liu, Yun
    Cheng, Ming-Ming
    Gall, Juergen
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (06) : 6647 - 6658
  • [4] MS-TCRNet: Multi-Stage Temporal Convolutional Recurrent Networks for action segmentation using sensor-augmented kinematics
    Goldbraikh, Adam
    Shubi, Omer
    Rubin, Or
    Pugh, Carla M.
    Laufer, Shlomi
    PATTERN RECOGNITION, 2024, 156
  • [5] Automated Craniotomy Phase Detection Using Multi-Stage Temporal Convolutional Neural Networks
    Leong, Ariel
    Porras, Jose Luis
    Soberanis-Mukul, Roger
    Shankar, Rohit
    Cullen, Mackenzie
    Vedula, Swaroop
    Judy, Brendan F.
    Abu-Bonsrah, Nancy A.
    Hung, Alice L.
    Luksik, Andrew
    Torroella, Jordina N. Rincon
    Xu, Risheng
    Bettegowda, Chetan
    Jackson, Christopher Mitchell
    Weingart, Jon
    Gallia, Gary L.
    Huang, Judy
    Brem, Henry
    Unberath, Mathias
    Ishii, Masaru
    NEUROSURGERY, 2025, 71 : 47 - 47
  • [6] MULTI-STAGE SEGMENTATION OF THE FOVEA IN RETINAL FUNDUS IMAGES USING FULLY CONVOLUTIONAL NEURAL NETWORKS
    Sedai, Suman
    Tennakoon, Ruwan
    Roy, Pallab
    Cao, Khoa
    Garnavi, Rahil
    2017 IEEE 14TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2017), 2017, : 1083 - 1086
  • [7] In-situ fault detection for the spindle motor of CNC machines via multi-stage residual fusion convolution neural networks
    He, Yiming
    Xiang, Hua
    Zhou, Hao
    Chen, Jihong
    COMPUTERS IN INDUSTRY, 2023, 145
  • [8] Automatic knee cartilage and bone segmentation using multi-stage convolutional neural networks: data from the osteoarthritis initiative
    Anthony A. Gatti
    Monica R. Maly
    Magnetic Resonance Materials in Physics, Biology and Medicine, 2021, 34 : 859 - 875
  • [9] Automatic knee cartilage and bone segmentation using multi-stage convolutional neural networks: data from the osteoarthritis initiative
    Gatti, Anthony A.
    Maly, Monica R.
    MAGNETIC RESONANCE MATERIALS IN PHYSICS BIOLOGY AND MEDICINE, 2021, 34 (06) : 859 - 875
  • [10] Multi-Stage Burst Localization Based on Spatio-Temporal Information Analysis for District Metered Areas in Water Distribution Networks
    Zhang, Xiangqiu
    Fang, Yongjun
    Zhou, Xinhong
    Shao, Yu
    Yu, Tingchao
    WATER, 2024, 16 (16)