Graph convolutional network with STC attention and adaptive normalization for skeleton-based action recognition

被引:3
|
作者
Zhou, Haiyun [1 ]
Xiang, Xuezhi [2 ,3 ]
Qiu, Yujian [2 ]
Liu, Xuzhao [2 ]
机构
[1] Nanjing Forest Police Coll, Coll Publ Secur, Nanjing, Peoples R China
[2] Harbin Engn Univ, Sch Informat & Commun Engn, Harbin 150001, Peoples R China
[3] Minist Ind & Informat Technol, Key Lab Adv Marine Commun & Informat Technol, Harbin 150001, Peoples R China
来源
IMAGING SCIENCE JOURNAL | 2023年 / 71卷 / 07期
基金
中国国家自然科学基金;
关键词
Skeleton-based action recognition; Skeleton features; graph convolutional network; STC attention module; Spatial attention; Temporal attention; Channel attention; adaptive normalization;
D O I
10.1080/13682199.2023.2190927
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Graph Convolutional Network (GCN) have been widely used in the field of skeleton-based action recognition and have achieved exciting results. Introducing attention mechanism in the process of extracting skeleton features has always been a hot spot in GCN-related research. In this article, we design a new graph convolutional network, which combines the advanced decoupling graph convolutional network (DC-GCN) with spatial, temporal, channel (STC) series attention module and adaptive normalization (AN). The STC attention module helps the network tend to extract important information from skeleton features. In addition, in order to improve the adaptability of the normalization method to GCN, we design the AN module instead of the BN module, which can train the weights of different normalization methods, so that each normalization layer in the network adopts the most suitable normalization operation. The experimental results show that the accuracy of our method is competitive with the state-of-the-art action recognition methods.
引用
收藏
页码:636 / 646
页数:11
相关论文
共 50 条
  • [31] EchoGCN: An Echo Graph Convolutional Network for Skeleton-Based Action Recognition
    Qian, Weiwen
    Huang, Qian
    Li, Chang
    Chen, Zhongqi
    Mao, Yingchi
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), (245-261):
  • [32] Pyramidal Graph Convolutional Network for Skeleton-Based Human Action Recognition
    Li, Fanjia
    Zhu, Aichun
    Liu, Zhongyu
    Huo, Yu
    Xu, Yonggang
    Hua, Gang
    IEEE SENSORS JOURNAL, 2021, 21 (14) : 16183 - 16191
  • [33] Pose Refinement Graph Convolutional Network for Skeleton-Based Action Recognition
    Li, Shijie
    Yi, Jinhui
    Abu Farha, Yazan
    Gall, Juergen
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02): : 1028 - 1035
  • [34] Multi-Scale Adaptive Aggregate Graph Convolutional Network for Skeleton-Based Action Recognition
    Zheng, Zhiyun
    Wang, Yizhou
    Zhang, Xingjin
    Wang, Junfeng
    APPLIED SCIENCES-BASEL, 2022, 12 (03):
  • [35] Enhanced discriminative graph convolutional network with adaptive temporal modelling for skeleton-based action recognition
    Alsarhan, Tamam
    Ali, Usman
    Lu, Hongtao
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 216
  • [36] Part-Wise Adaptive Topology Graph Convolutional Network for Skeleton-Based Action Recognition
    Wang, Jiale
    Zou, Lian
    Fan, Cien
    Chi, Ruan
    ELECTRONICS, 2023, 12 (09)
  • [37] Lightweight channel-topology based adaptive graph convolutional network for skeleton-based action recognition
    Wang K.
    Deng H.
    Zhu Q.
    Neurocomputing, 2023, 560
  • [38] Attention adjacency matrix based graph convolutional networks for skeleton-based action recognition
    Xie, Jun
    Miao, Qiguang
    Liu, Ruyi
    Xin, Wentian
    Tang, Lei
    Zhong, Sheng
    Gao, Xuesong
    NEUROCOMPUTING, 2021, 440 (440) : 230 - 239
  • [39] A Graph Convolutional Network with Early Attention Module for Skeleton-based Action Prediction
    Liu, Cuiwei
    Zhao, Xiaoxue
    Yan, Zhuo
    Jiang, Youzhi
    Shi, Xiangbin
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 1266 - 1272
  • [40] Triplet attention multiple spacetime-semantic graph convolutional network for skeleton-based action recognition
    Yanjing Sun
    Han Huang
    Xiao Yun
    Bin Yang
    Kaiwen Dong
    Applied Intelligence, 2022, 52 : 113 - 126