Recent Advancements in Augmented Reality for Robotic Applications: A Survey

被引:14
|
作者
Fu, Junling [1 ]
Rota, Alberto [1 ,2 ]
Li, Shufei [3 ]
Zhao, Jianzhuang [1 ]
Liu, Qingsheng [1 ,4 ]
Iovene, Elisa [1 ]
Ferrigno, Giancarlo [1 ]
De Momi, Elena [1 ]
机构
[1] Politecn Milan, Dept Elect Informat & Bioengn, I-20133 Milan, Italy
[2] Asensus Surg Inc, Durham, NC 27703 USA
[3] Hong Kong Polytech Univ, Dept Ind & Syst Engn, Hong Kong, Peoples R China
[4] Ocean Univ China, Coll Informat Sci & Engn, Qingdao 266100, Peoples R China
关键词
augmented reality; medical robot; robot-assisted surgery; industrial robot; human-robot interaction and collaboration; HEAD-MOUNTED DISPLAY; FEEDBACK; SYSTEM; PERCEPTION; SIMULATION; FRAMEWORK; ACCURACY;
D O I
10.3390/act12080323
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Robots are expanding from industrial applications to daily life, in areas such as medical robotics, rehabilitative robotics, social robotics, and mobile/aerial robotics systems. In recent years, augmented reality (AR) has been integrated into many robotic applications, including medical, industrial, human-robot interactions, and collaboration scenarios. In this work, AR for both medical and industrial robot applications is reviewed and summarized. For medical robot applications, we investigated the integration of AR in (1) preoperative and surgical task planning; (2) image-guided robotic surgery; (3) surgical training and simulation; and (4) telesurgery. AR for industrial scenarios is reviewed in (1) human-robot interactions and collaborations; (2) path planning and task allocation; (3) training and simulation; and (4) teleoperation control/assistance. In addition, the limitations and challenges are discussed. Overall, this article serves as a valuable resource for working in the field of AR and robotic research, offering insights into the recent state of the art and prospects for improvement.
引用
收藏
页数:29
相关论文
共 50 条
  • [41] Industrial applications of virtual reality environments and augmented reality
    Martin-Erro, Alfonso
    Espinosa Escudero, Mara del Mar
    Dominguez, Manuel
    Dyna, 2014, 89 (04): : 382 - 386
  • [42] Modeling Reality for Camera Registration in Augmented Reality Applications
    Pagani, Alain
    KI - Kunstliche Intelligenz, 2014, 28 (04): : 321 - 324
  • [43] Augmented reality user interface for reconnaissance robotic missions
    Zalud, L.
    2007 RO-MAN: 16TH IEEE INTERNATIONAL SYMPOSIUM ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION, VOLS 1-3, 2007, : 967 - 972
  • [44] Study on augmented reality for robotic surgery bedside assistants
    Camille Linick Stewart
    Abigail Fong
    Govinda Payyavula
    Simon DiMaio
    Kelly Lafaro
    Kirsten Tallmon
    Sherry Wren
    Jonathan Sorger
    Yuman Fong
    Journal of Robotic Surgery, 2022, 16 : 1019 - 1026
  • [45] Study on augmented reality for robotic surgery bedside assistants
    Stewart, Camille Linick
    Fong, Abigail
    Payyavula, Govinda
    DiMaio, Simon
    Lafaro, Kelly
    Tallmon, Kirsten
    Wren, Sherry
    Sorger, Jonathan
    Fong, Yuman
    JOURNAL OF ROBOTIC SURGERY, 2022, 16 (05) : 1019 - 1026
  • [46] Augmented reality for image guidance in transoral robotic surgery
    Jason Y. K. Chan
    F. Christopher Holsinger
    Stanley Liu
    Jonathan M. Sorger
    Mahdi Azizian
    Raymond K. Y. Tsang
    Journal of Robotic Surgery, 2020, 14 : 579 - 583
  • [47] RAMPA: Robotic Augmented Reality for Machine Programming by DemonstrAtion
    Dogangun, Fatih
    Bahar, Serdar
    Yildirim, Yigit
    Temir, Bora Toprak
    Ugur, Emre
    Dogan, Mustafa Doga
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (04): : 3795 - 3802
  • [48] First robotic CME in Europe with augmented reality tools
    Petropoulou, T.
    Polydorou, A.
    Amin, S.
    TECHNIQUES IN COLOPROCTOLOGY, 2021, 25 (07) : 887 - 888
  • [49] A Review of Augmented Reality in Robotic-Assisted Surgery
    Qian, Long
    Wu, Jie Ying
    DiMaio, Simon P.
    Navab, Nassir
    Kazanzides, Peter
    IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2020, 2 (01): : 1 - 16
  • [50] Transoral Robotic Surgery: Image Guidance and Augmented Reality
    Pratt, Philip
    Arora, Asit
    ORL-JOURNAL FOR OTO-RHINO-LARYNGOLOGY HEAD AND NECK SURGERY, 2018, 80 (3-4): : 204 - 212