DGC-TnT: Enhancing Point Cloud Object Classification by Dynamic Graph Convolutions With Transformer in Transformer

被引:0
|
作者
Lin, Chien-Chou [1 ]
Chen, Po-Yu [1 ]
机构
[1] Natl Yunlin Univ Sci & Technol, Dept Comp Sci & Informat Engn, Touliu 64002, Taiwan
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Transformers; Point cloud compression; Feature extraction; Three-dimensional displays; Computer architecture; Task analysis; Accuracy; Object detection; Object classification; dynamic graph convolution (DGC); global feature; local feature; transformer in transformer (TnT); edge-convolution (EdgeConv);
D O I
10.1109/ACCESS.2024.3442928
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, deep learning neural networks have been widely used in object classification. The process of object classification typically involves extracting features from the point cloud using neural networks and integrating these features into a global feature for recognizing the object. However, most existing methods perform well in global feature extraction but still fall short in capturing local details, or lack an attention mechanism to focus on informative feature signals. This paper presents DGC-TnT which combines dynamic graph convolution (DGC) structure with the Point-TnT module. Employing a two-stage TnT architecture, DGC-TnT utilizes a self-attention mechanism to deeply analyze local features derived from dynamic graph convolution, expanding their scope globally. This mechanism effectively operates between individual points and clusters of points, thereby enhancing overall object classification performance. DGC-TnT facilitates enhanced feature communication between points and point clusters within the point cloud through the Transformer module. On the ModelNet40 and ScanobjectNN datasets, DGC-TnT has a significant improvement in accuracy.
引用
收藏
页码:111924 / 111931
页数:8
相关论文
共 50 条
  • [1] Point cloud classification based on transformer
    Wu, Xianfeng
    Liu, Xinyi
    Wang, Junfei
    Lai, Zhongyuan
    Zhou, Jing
    Liu, Xia
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 104
  • [2] Transformer-Based Point Cloud Classification
    Wu, Xianfeng
    Liu, Xinyi
    Wang, Junfei
    Wu, Xianzu
    Lai, Zhongyuan
    Zhou, Jing
    Liu, Xia
    ARTIFICIAL INTELLIGENCE AND ROBOTICS, ISAIR 2022, PT I, 2022, 1700 : 218 - 225
  • [3] Object Detection of Occlusion Point Cloud based on Transformer
    Zhou, Jing
    Zhou, Jian
    Lin, Teng Xing
    Gong, Zi Xin
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [4] SparseFormer: Sparse transformer network for point cloud classification
    Wang, Yong
    Liu, Yangyang
    Zhou, Pengbo
    Geng, Guohua
    Zhang, Qi
    COMPUTERS & GRAPHICS-UK, 2023, 116 : 24 - 32
  • [5] GTPCR: Graph-Enhanced Transformer for Point Cloud Registration
    Chen, Kai
    Yao, Junfeng
    Li, Yuanhang
    Zhang, Han
    Shen, Huabo
    Qian, Quan
    Wu, Xing
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 1304 - 1309
  • [6] Dynamic clustering transformer network for point cloud segmentation
    Lu, Dening
    Zhou, Jun
    Gao, Kyle
    Du, Jing
    Xu, Linlin
    Li, Jonathan
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 128
  • [7] Dynamic graph transformer for 3D object detection
    Ren, Siyuan
    Pan, Xiao
    Zhao, Wenjie
    Nie, Binling
    Han, Bo
    KNOWLEDGE-BASED SYSTEMS, 2023, 259
  • [8] MO-Transformer: A Transformer-Based Multi-Object Point Cloud Reconstruction Network
    Lyu, Erli
    Zhang, Zhengyan
    Liu, Wei
    Wang, Jiaole
    Song, Shuang
    Meng, Max Q. -H.
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 1024 - 1030
  • [9] MULTISCALE REPRESENTATIONS LEARNING TRANSFORMER FRAMEWORK FOR POINT CLOUD CLASSIFICATION
    Sun, Yajie
    Zia, Ali
    Zhou, Jun
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3354 - 3358
  • [10] F-Transformer: Point Cloud Fusion Transformer for Cooperative 3D Object Detection
    Wang, Jie
    Luo, Guiyang
    Yuan, Quan
    Li, Jinglin
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT I, 2022, 13529 : 171 - 182