Shared Intelligence for Robot Teleoperation via BMI

被引:16
|
作者
Beraldo, Gloria [1 ,2 ]
Tonin, Luca [1 ]
Millan, Jose del R. [3 ,4 ,5 ]
Menegatti, Emanuele [1 ]
机构
[1] Univ Padua, Dept Informat Engn, Intelligent Autonomous Syst Lab IAS Lab, I-35131 Padua, Italy
[2] CNR, Inst Cognit Sci & Technol, I-00185 Rome, Italy
[3] Univ Texas Austin, Dept Elect & Comp Engn, Austin, TX 78712 USA
[4] Univ Texas Austin, Dept Neurol, Austin, TX 78712 USA
[5] Ecole Polytech Fed Lausanne, Defitech Chair Brain Machine Interface, Campus Biotech, CH-1202 Geneva, Switzerland
关键词
Robots; Navigation; Mobile robots; Robot sensing systems; Task analysis; Trajectory; Decoding; Behavior based architecture; brain-machine interface (BMI); motor imagery; neurorobotics; shared intelligence; teleoperation; BRAIN-COMPUTER INTERFACES; ACTUATED WHEELCHAIR; COMMUNICATION; PEOPLE; BCI;
D O I
10.1109/THMS.2021.3137035
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article proposes a novel shared intelligence system for brain-machine interface (BMI) teleoperated mobile robots where user's intention and robot's intelligence are concurrent elements equally participating in the decision process. We designed the system to rely on policies guiding the robot's behavior according to the current situation. We hypothesized that the fusion of these policies would lead to the identification of the next, most probable, location of the robot in accordance with the user's expectations. We asked 13 healthy subjects to evaluate the system during teleoperated navigation tasks in a crowded office environment with a keyboard (reliable interface) and with 2-class motor imagery (MI) BMI (uncertain control channel). Experimental results show that our shared intelligence system 1) allows users to efficiently teleoperate the robot in both control modalities; 2) it ensures a level of BMI navigation performances comparable to the keyboard control; 3) it actively assists BMI users in accomplishing the tasks. These results highlight the importance of investigating advanced human-machine interaction (HMI) strategies and introducing robotic intelligence to improve the performances of BMI actuated devices.
引用
收藏
页码:400 / 409
页数:10
相关论文
共 50 条
  • [31] Continuous Teleoperation of a Robotic Manipulator via Brain-Machine Interface with Shared Control
    Tortora, Stefano
    Gottardi, Alberto
    Menegatti, Emanuele
    Tonin, Luca
    2022 IEEE 27TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2022,
  • [32] Teleoperation of a surgical robot via airborne wireless radio and transatlantic internet links
    Lum, Mitchell J. H.
    Friedman, Diana C. W.
    King, Hawkeye H. I.
    Donlin, Regina
    Sankaranarayanan, Ganesh
    Broderick, Timoty J.
    Sinanan, Mika N.
    Rosen, Jacob
    Hannafordl, Blake
    FIELD AND SERVICE ROBOTICS: RESULTS OF THE 6TH INTERNATIONAL CONFERENCE, 2008, 42 : 305 - +
  • [33] Teleoperation of a Robot through Audio-Visual Signal via Video Chat
    Fukuda, Hisato
    Kobayashi, Yoshinori
    Kuno, Yoshinori
    COMPANION OF THE 2018 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION (HRI'18), 2018, : 111 - 112
  • [34] Human-robot shared control system based on 3D point cloud and teleoperation
    YANG ChenGuang
    ZHANG Ying
    ZHAO GuanYi
    CHENG Long
    Science China(Technological Sciences), 2023, (08) : 2406 - 2414
  • [35] From Remote Tool to Shared Roles Human-Robot Interaction in Teleoperation for Remote Presence Applications
    Murphy, Robin R.
    Burke, Jennifer L.
    IEEE ROBOTICS & AUTOMATION MAGAZINE, 2008, 15 (04) : 39 - 49
  • [36] Shared Control Teleoperation for Targets Acquisition
    Wang Dongli
    Liu Huaping
    Sun Fuchun
    Du Yonggui
    PROCEEDINGS OF THE 2012 24TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2012, : 3649 - 3654
  • [37] Teleoperation in robot-assisted MIS with adaptive RCM via admittance control
    Nasiri, Ehsan
    Sowrirajan, Srikarran
    Wang, Long
    INTERNATIONAL JOURNAL OF INTELLIGENT ROBOTICS AND APPLICATIONS, 2024, 8 (04) : 827 - 839
  • [38] Human-robot shared control system based on 3D point cloud and teleoperation
    YANG ChenGuang
    ZHANG Ying
    ZHAO GuanYi
    CHENG Long
    Science China(Technological Sciences), 2023, 66 (08) : 2406 - 2414
  • [39] Dynamic Movement Primitives-Based Human Action Prediction and Shared Control for Bilateral Robot Teleoperation
    Lu, Zhenyu
    Si, Weiyong
    Wang, Ning
    Yang, Chenguang
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2024, 71 (12) : 16654 - 16663
  • [40] Internet-based teleoperation of a mobile robot using shared impedance control scheme: A pilot study
    Hassan-Zadeh, I
    Janabi-Sharifi, F
    Akhavan, MR
    Yang, X
    2005 IEEE INTERNATIONAL CONFERENCE ON CONTROL APPLICATIONS (CCA), VOLS 1AND 2, 2005, : 346 - 351