Learning to Prevent Grasp Failure with Soft Hands: From Online Prediction to Dual-Arm Grasp Recovery

被引:5
|
作者
Averta, Giuseppe [1 ,2 ]
Barontini, Federica [1 ,2 ]
Valdambrini, Irene [1 ,2 ]
Cheli, Paolo [1 ,2 ]
Bacciu, Davide [3 ]
Bianchi, Matteo [1 ,2 ]
机构
[1] Univ Pisa, Ctr Ric Enrico Piaggio, Largo Lucio Lazzarino 1, I-56126 Pisa, Italy
[2] Univ Pisa, Dipartimento Ingn Informaz, Largo Lucio Lazzarino 1, I-56126 Pisa, Italy
[3] Univ Pisa, Dipartimento Informat, I-56127 Pisa, Italy
基金
欧盟地平线“2020”;
关键词
autonomous grasp; deep learning; dual arm; grasp failure prediction; inertial measurement units; regrasp and recovery action implementation; soft robotic hands; MANIPULATION; SYNERGIES;
D O I
10.1002/aisy.202100146
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Soft hands allow to simplify the grasp planning to achieve a successful grasp, thanks to their intrinsic adaptability. At the same time, their usage poses new challenges, related to the adoption of classical sensing techniques originally developed for rigid end defectors, which provide fundamental information, such as to detect object slippage. Under this regard, model-based approaches for the processing of the gathered information are hard to use, due to the difficulties in modeling hand-object interaction when softness is involved. To overcome these limitations, in this article, we proposed to combine distributed tactile sensing and machine learning (recurrent neural network) to detect sliding conditions for a soft robotic hand mounted on a robotic manipulator, targeting the prediction of the grasp failure event and the direction of sliding. The outcomes of these predictions allow for an online triggering of a compensatory action performed with a second robotic arm-hand system, to prevent the failure. Despite the fact that the network is trained only with spherical and cylindrical objects, we demonstrate high generalization capabilities of our framework, achieving a correct prediction of the failure direction in 75 % of cases, and a 85 % of successful regrasps, for a selection of 12 objects of common use.
引用
收藏
页数:9
相关论文
共 21 条
  • [21] Prediction of vertebral failure loads from spinal and femoral dual-energy X-ray absorptiometry, and calcaneal ultrasound:: An in situ analysis with intact soft tissues
    Lochmüller, EM
    Eckstein, F
    Kaiser, D
    Zeller, JB
    Landgraf, J
    Putz, R
    Steldinger, R
    BONE, 1998, 23 (05) : 417 - 424