FAGD-Net: Feature-Augmented Grasp Detection Network Based on Efficient Multi-Scale Attention and Fusion Mechanisms

被引:3
|
作者
Zhong, Xungao [1 ,2 ]
Liu, Xianghui [1 ]
Gong, Tao [1 ]
Sun, Yuan [1 ,2 ]
Hu, Huosheng [3 ]
Liu, Qiang [4 ]
机构
[1] Xiamen Univ Technol, Sch Elect Engn & Automat, Xiamen 361024, Peoples R China
[2] Xiamen Key Lab Frontier Elect Power Equipment & In, Xiamen 361024, Peoples R China
[3] Univ Essex, Sch Comp Sci & Elect Engn, Colchester CO4 3SQ, England
[4] Univ Bristol, Fac Engn, Sch Engn Math & Technol, Beacon House,Queens Rd, Bristol BS8 1QU, England
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 12期
基金
中国国家自然科学基金;
关键词
robotic grasping; deep network model; attention mechanism; feature fusion;
D O I
10.3390/app14125097
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Grasping robots always confront challenges such as uncertainties in object size, orientation, and type, necessitating effective feature augmentation to improve grasping detection performance. However, many prior studies inadequately emphasize grasp-related features, resulting in suboptimal grasping performance. To address this limitation, this paper proposes a new grasping approach termed the Feature-Augmented Grasp Detection Network (FAGD-Net). The proposed network incorporates two modules designed to enhance spatial information features and multi-scale features. Firstly, we introduce the Residual Efficient Multi-Scale Attention (Res-EMA) module, which effectively adjusts the importance of feature channels while preserving precise spatial information within those channels. Additionally, we present a Feature Fusion Pyramidal Module (FFPM) that serves as an intermediary between the encoder and decoder, effectively addressing potential oversights or losses of grasp-related features as the encoder network deepens. As a result, FAGD-Net achieved advanced levels of grasping accuracy, with 98.9% and 96.5% on the Cornell and Jacquard datasets, respectively. The grasp detection model was deployed on a physical robot for real-world grasping experiments, where we conducted a series of trials in diverse scenarios. In these experiments, we randomly selected various unknown household items and adversarial objects. Remarkably, we achieved high success rates, with a 95.0% success rate for single-object household items, 93.3% for multi-object scenarios, and 91.0% for cluttered scenes.
引用
收藏
页数:26
相关论文
共 50 条
  • [41] MFF-Net: A multi-scale feature fusion network for birdsong classification
    Zhou, Hongfang
    Zheng, Kangyun
    Zhu, Wenjing
    Tong, Jiahao
    Cao, Chenhui
    Pan, Heng
    Li, Junhuai
    APPLIED ACOUSTICS, 2025, 232
  • [42] Multi-scale Convolutional Feature Fusion Network Based on Attention Mechanism for IoT Traffic Classification
    Niandong Liao
    Jiayu Guan
    International Journal of Computational Intelligence Systems, 17
  • [43] Audio steganalysis using multi-scale feature fusion-based attention neural network
    Peng, Jinghui
    Liao, Yi
    Tang, Shanyu
    IET COMMUNICATIONS, 2025, 19 (01)
  • [44] Multi-scale Convolutional Feature Fusion Network Based on Attention Mechanism for IoT Traffic Classification
    Liao, Niandong
    Guan, Jiayu
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2024, 17 (01)
  • [45] Dual Attention Based Multi-scale Feature Fusion Network for Indoor RGBD Semantic Segmentation
    Hua, Zhongwei
    Qi, Lizhe
    Du, Daming
    Jiang, Wenxuan
    Sun, Yunquan
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 3639 - 3644
  • [46] Multi-Scale Feature Fusion with Attention Mechanism Based on CGAN Network for Infrared Image Colorization
    Ai, Yibo
    Liu, Xiaoxi
    Zhai, Haoyang
    Li, Jie
    Liu, Shuangli
    An, Huilong
    Zhang, Weidong
    APPLIED SCIENCES-BASEL, 2023, 13 (08):
  • [47] Self-Attention-based Multi-Scale Feature Fusion Network for Road Ponding Segmentation
    Yang, Shangyu
    Zhang, Ronghui
    Sun, Wencai
    Chen, Shengru
    Ye, Cong
    Wu, Hao
    Li, Mengran
    2024 2ND ASIA CONFERENCE ON COMPUTER VISION, IMAGE PROCESSING AND PATTERN RECOGNITION, CVIPPR 2024, 2024,
  • [48] Daytime sea fog detection based on multi-scale feature fusion of generated adversarial network under attention mechanism
    Fang X.
    Jin W.
    Fu R.
    Li G.
    He C.
    Yi C.
    National Remote Sensing Bulletin, 2023, 27 (12) : 2736 - 2747
  • [49] SGMFNet: a remote sensing image object detection network based on spatial global attention and multi-scale feature fusion
    Gong, Xiaolin
    Liu, Daqing
    REMOTE SENSING LETTERS, 2024, 15 (05) : 466 - 477
  • [50] Fusion of Geometric Attention and Multi-Scale Feature Network for Point Cloud Registration
    Du, Jiajin
    Bai, Zhengyao
    Liu, Xuheng
    Li, Zekai
    Xiao, Xiao
    You, Yilin
    Computer Engineering and Applications, 2024, 60 (12) : 234 - 244