Shared Intelligence for Robot Teleoperation via BMI

被引:16
|
作者
Beraldo, Gloria [1 ,2 ]
Tonin, Luca [1 ]
Millan, Jose del R. [3 ,4 ,5 ]
Menegatti, Emanuele [1 ]
机构
[1] Univ Padua, Dept Informat Engn, Intelligent Autonomous Syst Lab IAS Lab, I-35131 Padua, Italy
[2] CNR, Inst Cognit Sci & Technol, I-00185 Rome, Italy
[3] Univ Texas Austin, Dept Elect & Comp Engn, Austin, TX 78712 USA
[4] Univ Texas Austin, Dept Neurol, Austin, TX 78712 USA
[5] Ecole Polytech Fed Lausanne, Defitech Chair Brain Machine Interface, Campus Biotech, CH-1202 Geneva, Switzerland
关键词
Robots; Navigation; Mobile robots; Robot sensing systems; Task analysis; Trajectory; Decoding; Behavior based architecture; brain-machine interface (BMI); motor imagery; neurorobotics; shared intelligence; teleoperation; BRAIN-COMPUTER INTERFACES; ACTUATED WHEELCHAIR; COMMUNICATION; PEOPLE; BCI;
D O I
10.1109/THMS.2021.3137035
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article proposes a novel shared intelligence system for brain-machine interface (BMI) teleoperated mobile robots where user's intention and robot's intelligence are concurrent elements equally participating in the decision process. We designed the system to rely on policies guiding the robot's behavior according to the current situation. We hypothesized that the fusion of these policies would lead to the identification of the next, most probable, location of the robot in accordance with the user's expectations. We asked 13 healthy subjects to evaluate the system during teleoperated navigation tasks in a crowded office environment with a keyboard (reliable interface) and with 2-class motor imagery (MI) BMI (uncertain control channel). Experimental results show that our shared intelligence system 1) allows users to efficiently teleoperate the robot in both control modalities; 2) it ensures a level of BMI navigation performances comparable to the keyboard control; 3) it actively assists BMI users in accomplishing the tasks. These results highlight the importance of investigating advanced human-machine interaction (HMI) strategies and introducing robotic intelligence to improve the performances of BMI actuated devices.
引用
收藏
页码:400 / 409
页数:10
相关论文
共 50 条
  • [41] Tangible Interfaces for Robot Teleoperation
    Randelli, Gabriele
    Venanzi, Matteo
    Nardi, Daniele
    PROCEEDINGS OF THE 6TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTIONS (HRI 2011), 2011, : 231 - 232
  • [42] Multimedia interface for robot teleoperation
    Ferre, M
    Aracil, R
    Penin, LF
    Barrientos, A
    TELEMANIPULATOR AND TELEPRESENCE TECHNOLOGIES III, 1996, 2901 : 126 - 137
  • [43] Human and robot integrated teleoperation
    Lee, S
    Choi, DS
    Kim, M
    Lee, CW
    Song, JB
    1998 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5, 1998, : 1213 - 1218
  • [44] Human-robot shared control system based on 3D point cloud and teleoperation
    Yang, ChenGuang
    Zhang, Ying
    Zhao, GuanYi
    Cheng, Long
    SCIENCE CHINA-TECHNOLOGICAL SCIENCES, 2023, 66 (08) : 2406 - 2414
  • [45] Haptic Feedback Improves Human-Robot Agreement and User Satisfaction in Shared-Autonomy Teleoperation
    Zhang, Dawei
    Tron, Roberto
    Khurshid, Rebecca P.
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 3306 - 3312
  • [46] Assistive Control of Robot Arms via Adaptive Shared Autonomy
    Atan, Umur
    Bharadwaj, Varun R.
    Jiang, Chao
    2024 IEEE INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS, AIM 2024, 2024, : 1096 - 1102
  • [47] Assistive Teleoperation of Robot Arms via Automatic Time-Optimal Mode Switching
    Herlant, Laura V.
    Holladay, Rachel M.
    Srinivasa, Siddhartha S.
    ELEVENTH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN ROBOT INTERACTION (HRI'16), 2016, : 35 - 42
  • [48] Semi-Autonomous Robot Teleoperation with Obstacle Avoidance via Model Predictive Control
    Rubagotti, Matteo
    Taunyazov, Tasbolat
    Omarali, Bukeikhan
    Shintemirov, Almas
    ROBOTICS: SCIENCE AND SYSTEMS XV, 2019,
  • [49] Dynamic locomotion synchronization of bipedal robot and human operator via bilateral feedback teleoperation
    Ramos, Joao
    Kim, Sangbae
    SCIENCE ROBOTICS, 2019, 4 (35)
  • [50] Facilitating Human-Mobile Robot Communication via Haptic Feedback and Gesture Teleoperation
    Che, Yuhang
    Culbertson, Heather
    Tang, Chih-Wei
    Aich, Sudipto
    Okamura, Allison M.
    ACM TRANSACTIONS ON HUMAN-ROBOT INTERACTION, 2018, 7 (03)