Human-robot interaction for robotic manipulator programming in Mixed Reality

被引：0
|
作者：
Ostanin, Mikhail [1 ]
Mikhel, Stanislav [1 ]
Evlampiev, Alexey [1 ]
Skvortsova, Valeria [1 ]
Klimchik, Alexandr [1 ]
机构：
[1] Innopolis Univ, Ctr Technol Robot & Mechatron Components, Innopolis, Russia
来源：
2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA) | 2020年
基金：
俄罗斯科学基金会;
关键词：
D O I：
10.1109/icra40945.2020.9196965
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
The paper presents an approach for interactive programming of the robotic manipulator using mixed reality. The developed system is based on the HoloLens glasses connected through Robotic Operation System to Unity engine and robotic manipulators. The system gives a possibility to recognize the real robot location by the point cloud analysis, to use virtual markers and menus for the task creation, to generate a trajectory for execution in the simulator or on the real manipulator. It also provides the possibility of scaling virtual and real worlds for more accurate planning. The proposed framework has been tested on pick-and-place and contact operations execution by UR10e and KUKA iiwa robots.
引用
收藏
页码：2805 / 2811
页数：7
相关论文
共 50 条
  • [31] Expressive Robotic Head for Human-Robot Interaction Studies
    Pereira, Ricardo
    Garrote, Luis
    Barros, Tiago
    Carona, Carlos
    Bento, Luis C.
    Nunes, Urbano J.
    XV MEDITERRANEAN CONFERENCE ON MEDICAL AND BIOLOGICAL ENGINEERING AND COMPUTING - MEDICON 2019, 2020, 76 : 1627 - 1637
  • [32] Investigating Human-Robot Interaction: A User-Centered Approach to Robotic System Setup and Programming
    Bergner, C.
    Hlatky, M.
    Mueller, S.
    Schmidt-Vollus, R.
    2024 33RD IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION, ROMAN 2024, 2024, : 1078 - 1083
  • [33] Human-Robot Interaction in a Shared Augmented Reality Workspace
    Qiu, Shuwen
    Liu, Hangxin
    Zhang, Zeyu
    Zhu, Yixin
    Zhu, Song-Chun
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 11413 - 11418
  • [34] A Taxonomy of Functional Augmented Reality for Human-Robot Interaction
    Phaijit, Ornnalin
    Obaid, Mohammad
    Sammut, Claude
    Johal, Wafa
    PROCEEDINGS OF THE 2022 17TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION (HRI '22), 2022, : 294 - 303
  • [35] Virtual reality in human-robot interaction: Challenges and benefits
    Lei, Yu
    Su, Zhi
    Cheng, Chao
    ELECTRONIC RESEARCH ARCHIVE, 2023, 31 (05): : 2374 - 2408
  • [36] Programming by touch:: The different way of human-robot interaction
    Grunwald, G
    Schreiber, G
    Albu-Schäffer, A
    Hirzinger, G
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2003, 50 (04) : 659 - 666
  • [37] From 2D to 3D Mixed Reality Human-Robot Interface in Hazardous Robotic Interventions with the Use of Redundant Mobile Manipulator
    Szczurek, Krzysztof Adam
    Prades, Raul Marin
    Matheson, Eloise
    Perier, Hugo
    Buonocore, Luca Rosario
    Di Castro, Mario
    PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS (ICINCO), 2021, : 388 - 395
  • [38] Multimodal Object Categorization with Reduced User Load through Human-Robot Interaction in Mixed Reality
    Nakamura, Hitoshi
    El Hafi, Lotfi
    Taniguchi, Akira
    Hagiwara, Yoshinobu
    Taniguchi, Tadahiro
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 2143 - 2150
  • [39] Human-robot interaction: the impact of robotic aesthetics on anticipated human trust
    Pinney, Joel
    Carroll, Fiona
    Newbury, Paul
    PEERJ COMPUTER SCIENCE, 2022, 8
  • [40] Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfaces
    Suzuki, Ryo
    Karim, Adnan
    Xia, Tian
    Hedayati, Hooman
    Marquardt, Nicolai
    PROCEEDINGS OF THE 2022 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI' 22), 2022,
12345