FAGD-Net: Feature-Augmented Grasp Detection Network Based on Efficient Multi-Scale Attention and Fusion Mechanisms

被引:3
|
作者
Zhong, Xungao [1 ,2 ]
Liu, Xianghui [1 ]
Gong, Tao [1 ]
Sun, Yuan [1 ,2 ]
Hu, Huosheng [3 ]
Liu, Qiang [4 ]
机构
[1] Xiamen Univ Technol, Sch Elect Engn & Automat, Xiamen 361024, Peoples R China
[2] Xiamen Key Lab Frontier Elect Power Equipment & In, Xiamen 361024, Peoples R China
[3] Univ Essex, Sch Comp Sci & Elect Engn, Colchester CO4 3SQ, England
[4] Univ Bristol, Fac Engn, Sch Engn Math & Technol, Beacon House,Queens Rd, Bristol BS8 1QU, England
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 12期
基金
中国国家自然科学基金;
关键词
robotic grasping; deep network model; attention mechanism; feature fusion;
D O I
10.3390/app14125097
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Grasping robots always confront challenges such as uncertainties in object size, orientation, and type, necessitating effective feature augmentation to improve grasping detection performance. However, many prior studies inadequately emphasize grasp-related features, resulting in suboptimal grasping performance. To address this limitation, this paper proposes a new grasping approach termed the Feature-Augmented Grasp Detection Network (FAGD-Net). The proposed network incorporates two modules designed to enhance spatial information features and multi-scale features. Firstly, we introduce the Residual Efficient Multi-Scale Attention (Res-EMA) module, which effectively adjusts the importance of feature channels while preserving precise spatial information within those channels. Additionally, we present a Feature Fusion Pyramidal Module (FFPM) that serves as an intermediary between the encoder and decoder, effectively addressing potential oversights or losses of grasp-related features as the encoder network deepens. As a result, FAGD-Net achieved advanced levels of grasping accuracy, with 98.9% and 96.5% on the Cornell and Jacquard datasets, respectively. The grasp detection model was deployed on a physical robot for real-world grasping experiments, where we conducted a series of trials in diverse scenarios. In these experiments, we randomly selected various unknown household items and adversarial objects. Remarkably, we achieved high success rates, with a 95.0% success rate for single-object household items, 93.3% for multi-object scenarios, and 91.0% for cluttered scenes.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] AMFF-Net: An attention-based multi-scale feature fusion network for allergic pollen detection
    Li, Jianqiang
    Wang, Quanzeng
    Xiong, Chengyao
    Zhao, Linna
    Cheng, Wenxiu
    Xu, Xi
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 235
  • [2] AMFF-Net: An attention-based multi-scale feature fusion network for allergic pollen detection
    Li, Jianqiang
    Wang, Quanzeng
    Xiong, Chengyao
    Zhao, Linna
    Cheng, Wenxiu
    Xu, Xi
    Expert Systems with Applications, 2024, 235
  • [3] Pixel-Level Grasp Detection based on EfficientNet and Multi-scale Feature Fusion Network
    Gao, Junli
    Luo, Yinming
    Huang, Xianxin
    2024 IEEE INTERNATIONAL CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEMS, CIS AND IEEE INTERNATIONAL CONFERENCE ON ROBOTICS, AUTOMATION AND MECHATRONICS, RAM, CIS-RAM 2024, 2024, : 486 - 491
  • [4] Pyramid attention object detection network with multi-scale feature fusion
    Chen, Xiu
    Li, Yujie
    Nakatoh, Yoshihisa
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 104
  • [5] MAFA-net: pedestrian detection network based on multi-scale attention feature aggregation
    Hao Xia
    Honglin Wan
    Jiayu Ou
    Jun Ma
    Xinyao Lv
    Chengjie Bai
    Applied Intelligence, 2022, 52 : 7686 - 7699
  • [6] MAFA-net: pedestrian detection network based on multi-scale attention feature aggregation
    Xia, Hao
    Wan, Honglin
    Ou, Jiayu
    Ma, Jun
    Lv, Xinyao
    Bai, Chengjie
    APPLIED INTELLIGENCE, 2022, 52 (07) : 7686 - 7699
  • [7] Text Detection Algorithm Based on Multi-Scale Attention Feature Fusion
    She, Xiangyang
    Liu, Zhe
    Dong, Lihong
    Computer Engineering and Applications, 2024, 60 (01) : 198 - 206
  • [8] Multi-Scale Feature Fusion Attention Network for Infrared Small Target Detection
    Zhang, Yidan
    Li, Chunlei
    Liu, Yundong
    Liu, Zhoufeng
    Yang, Ruimin
    FOURTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING, ICGIP 2022, 2022, 12705
  • [9] AAGDN: Attention-Augmented Grasp Detection Network Based on Coordinate Attention and Effective Feature Fusion Method
    Zhou, Zhenning
    Zhu, Xiaoxiao
    Cao, Qixin
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (06) : 3462 - 3469
  • [10] Pedestrian detection algorithm based on multi-scale feature extraction and attention feature fusion
    Xia, Hao
    Ma, Jun
    Ou, Jiayu
    Lv, Xinyao
    Bai, Chengjie
    DIGITAL SIGNAL PROCESSING, 2022, 121