Soft Wearable Haptic Display and Flexible 3D Force Sensor for Teleoperated Surgical Systems

被引:3
|
作者
Thai, Mai Thanh [1 ,2 ]
Davies, James [1 ]
Nguyen, Chi Cong [1 ]
Phan, Phuoc Thien [1 ]
Hoang, Trung Thien [1 ]
Ji, Adrienne [1 ]
Zhu, Kefan [1 ]
Sharma, Bibhu [1 ]
Nicotra, Emanuele [1 ]
Vo-Doan, Tat Thang [3 ]
Phan, Hoang-Phuong [4 ,5 ]
Lovell, Nigel Hamilton [1 ,4 ]
Do, Thanh Nho [1 ,4 ]
机构
[1] UNSW Sydney, Fac Engn, Grad Sch Biomed Engn, Kensington Campus, Sydney, NSW 2052, Australia
[2] VinUniv, Coll Engn & Comp Sci, Hanoi, Vietnam
[3] Univ Queensland, Sch Mech & Min Engn, St Lucia, Qld 4072, Australia
[4] UNSW Sydney, Tyree Inst Hlth Engn, Sydney, NSW 2052, Australia
[5] UNSW Sydney, Fac Engn, Sch Mech & Mfg Engn, Kensington Campus, Sydney, NSW 2052, Australia
来源
ADVANCED SENSOR RESEARCH | 2024年 / 3卷 / 01期
关键词
3D force sensor; endoscopic surgery; feedforward control; soft robotics; telesurgery; wearable haptic display; TACTILE SENSOR; DESIGN; FEEDBACK; DEVICE;
D O I
10.1002/adsr.202300105
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Haptic (touch) is important for effective interaction with the surroundings. In teleoperated surgical systems, its absence leads to reduced perception, making delicate tasks difficult and resulting in unexpected damage to surrounding tissues. To enhance safety, a force-feedback system and haptic device are needed. However, existing haptic prototypes are associated with rigid, bulky, and heavy components, making effective communication with the skin problematic. This paper presents a teleoperated endoscopic surgical system with an integrated 3D force sensor and real-time haptic feedback. A surgical robotic arm is remotely controlled by a soft haptic glove incorporated 3-axis cutaneous device and a finger kinesthetic module. The 3D force sensor is constructed from hydraulic filament soft sensors that can induce pressure change under strain. To enable precise motion, the haptic glove is operated by a feedforward controller and a master-slave architecture. Experiments with human subjects (n = 15) show that cutaneous and kinesthetic feedback significantly improves the user's performance (9.4 out of 10) compared to no haptic feedback (2.27 out of 10). Finally, subjects rank the new system as highly wearable, comfortable, and effective, which is expected to bridge a gap in the surgical field and support the future development of advanced teleoperated systems. This work introduces a teleoperated surgical system with integrated 3D force sensor and a soft wearable haptic display. The new system is expected to bridge a gap in the field of wearable haptic devices and support the future development of remote surgery. image
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Flexible Tactile Sensors for 3D Force Detection
    Han, Chengcheng
    Cao, Zhi
    Hu, Yiran
    Zhang, Zhiwei
    Li, Chengyu
    Wang, Zhong Lin
    Wu, Zhiyi
    NANO LETTERS, 2024, 24 (17) : 5277 - 5283
  • [42] 3D Display with No Physical Constraints Force Feedback Function
    Tsuboi, Masashi
    Kimura, Shinji
    Fukumoto, Masaaki
    Horikoshi, Tsutomu
    IDW'10: PROCEEDINGS OF THE 17TH INTERNATIONAL DISPLAY WORKSHOPS, VOLS 1-3, 2010, : 1327 - 1328
  • [43] SoftPrint: Investigating Haptic Softness Perception of 3D Printed Soft Object in FDM 3D Printers
    Miyoshi, Motoki
    Punpongsanon, Parinya
    Iwai, Daisuke
    Sato, Kosuke
    JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2021, 65 (04)
  • [44] 3D Simulation Environment for Haptic Sensor and Actor Components in the Cockpit
    Karlsruhe University of Applied Sciences, Karlsruhe, Germany
    ATZ Worldw., 2009, 3 (40-45):
  • [45] A new 3D, microfluidic-oriented, multi-functional, and highly stretchable soft wearable sensor
    Mohsen Annabestani
    Pouria Esmaeili-Dokht
    Ali Olyanasab
    Nooshin Orouji
    Zeynab Alipour
    Mohammad Hossein Sayad
    Kimia Rajabi
    Barbara Mazzolai
    Mehdi Fardmanesh
    Scientific Reports, 12
  • [46] A new 3D, microfluidic-oriented, multi-functional, and highly stretchable soft wearable sensor
    Annabestani, Mohsen
    Esmaeili-Dokht, Pouria
    Olyanasab, Ali
    Orouji, Nooshin
    Alipour, Zeynab
    Sayad, Mohammad Hossein
    Rajabi, Kimia
    Mazzolai, Barbara
    Fardmanesh, Mehdi
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [47] A Flexible 3D Organic Preamplifier for a Lactate Sensor
    Baek, Sanghoon
    Kwon, Jimin
    Mano, Taisei
    Tokito, Shizuo
    Jung, Sungjune
    MACROMOLECULAR BIOSCIENCE, 2020, 20 (11)
  • [48] 3D PRINTED FLEXIBLE TACTILE SENSOR FOR REHABILITATION
    Moreno-Rueda, David
    Narvaez, Diana
    McCarthy, Evelyn
    McCormack, Liam
    Newell, Brittany
    PROCEEDINGS OF ASME 2024 CONFERENCE ON SMART MATERIALS, ADAPTIVE STRUCTURES AND INTELLIGENT SYSTEMS, SMASIS 2024, 2024,
  • [49] An optical 3D force sensor for biomedical devices
    Lincoln, Lucas Samuel
    Quigley, Morgan
    Rohrer, Brandon
    Salisbury, Curt
    Wheeler, Jason
    2012 4TH IEEE RAS & EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL ROBOTICS AND BIOMECHATRONICS (BIOROB), 2012, : 1500 - 1505
  • [50] On Making Projector Both a Display Device and a 3D Sensor
    Dai, Jingwen
    Chung, Ronald
    ADVANCES IN VISUAL COMPUTING, ISVC 2012, PT I, 2012, 7431 : 654 - 664