Improving Robot-Assisted Virtual Teaching Using Transformers, GANs, and Computer Vision

被引:0
|
作者
Xiong, Li [1 ,2 ]
Chen, Yuanyuan [1 ]
Peng, Yi [2 ]
Ghadi, Yazeed Yasin [3 ]
机构
[1] Cent China Normal Univ, Wuhan, Peoples R China
[2] Yangtze Univ, Jingzhou, Peoples R China
[3] Al Ain Univ, Al Ain, U Arab Emirates
关键词
computer vision assistance; multimodal perception; personalized learning path planning; robot decision making; transformer model; virtual robot teaching assistant;
D O I
10.4018/JOEUC.336481
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study aims to enhance the efficacy of personalized learning paths by amalgamating transformer models, generative adversarial networks (GANs), and reinforcement learning techniques. To refine personalized learning trajectories, the authors integrated the transformer model for enhanced information assimilation and learning path planning. Through generative adversarial networks, the authors simulated the fusion and interaction of multi-modal information, refining the training of virtual teaching assistants. Lastly, reinforcement learning was employed to optimize the interaction strategies of these assistants, aligning them better with student needs. In the experimental phase, the authors benchmarked their approach against six state-of-the-art models to assess its effectiveness. The experimental outcomes highlight significant enhancements achieved by the authors' virtual teaching assistant compared to traditional methods. Precision improved to 95% and recall to 96%, and an F1 score exceeding 95% was attained.
引用
收藏
页数:32
相关论文
共 50 条
  • [21] Vision-based Robot-assisted Biological Cell Micromanipulation
    Karimirad, Fatemeh
    Chauhan, Sunita
    Shirinzadeh, Bijan
    Drummond, Tom
    Nahavandi, Saeid
    2014 23RD IEEE INTERNATIONAL SYMPOSIUM ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (IEEE RO-MAN), 2014, : 347 - 352
  • [22] DEVELOPMENT OF VIRTUAL REALITY (VR) SIMULATION OF ROBOT-ASSISTED PARTIAL NEPHRECTOMY USING METAVERSE
    Okada, Atsushi
    Ohashi, Kazuya
    Ota, Yuya
    Sugino, Teruaki
    Iwatsuki, Shoichiro
    Etani, Toshiki
    Taguchi, Kazumi
    Naiki, Taku
    Hamamoto, Shuzo
    Ando, Ryosuke
    Kawai, Noriyasu
    Tozawa, Keiichi
    Yasui, Takahiro
    JOURNAL OF UROLOGY, 2023, 209 : E353 - E353
  • [23] A Systematic Review of Virtual Reality Simulators for Robot-assisted Surgery
    Moglia, Andrea
    Ferrari, Vincenzo
    Morelli, Luca
    Ferrari, Mauro
    Mosca, Franco
    Cuschieri, Alfred
    EUROPEAN UROLOGY, 2016, 69 (06) : 1065 - 1080
  • [24] ROBOT GUIDANCE USING COMPUTER VISION
    COURTNEY, JW
    MAGEE, MJ
    AGGARWAL, JK
    PATTERN RECOGNITION, 1984, 17 (06) : 585 - 592
  • [25] Virtual Reality Robot-Assisted SEEG Monitoring Surgery Prototype
    Sharma, Akshay
    Ana, Clayton Sant
    Uribe-Quevedo, Alvaro
    Caurin, Glauco
    Rondinoni, Carlo
    2023 IEEE 3RD COLOMBIAN BIOCAS WORKSHOP, 2023,
  • [26] Applications for Augmented and Virtual Reality in Robot-Assisted Spine Surgery
    Karen Eliahu
    Jason Liounakos
    Michael Y. Wang
    Current Robotics Reports, 2022, 3 (2): : 33 - 37
  • [27] Development of a Robot-assisted Virtual Rehabilitation System with Haptic Feedback
    Liou, Yan-Bo
    Luo, Shan
    Liu, Yen-Chen
    2023 32ND IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION, RO-MAN, 2023, : 1956 - 1961
  • [28] Consistency of Performance of Robot-Assisted Surgical Tasks in Virtual Reality
    Suh, I. H.
    Siu, K-C
    Mukherjee, M.
    Monk, E.
    Oleynikov, D.
    Stergiou, N.
    MEDICINE MEETS VIRTUAL REALITY 17 - NEXTMED: DESIGN FOR/THE WELL BEING, 2009, 142 : 369 - 373
  • [29] Evaluation of Virtual Fixtures for Robot-Assisted Cochlear Implant Insertion
    Wilkening, Paul
    Chien, Wade
    Gonenc, Berk
    Niparko, John
    Kang, Jin U.
    Iordachita, Iulian
    Taylor, Russell H.
    2014 5th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), 2014, : 332 - 338
  • [30] Initial Experience and Surgical Setup of Robot-Assisted Nephroureterectomy Using the Hugo Robot-Assisted Surgery System
    Morizane, Shuichi
    Hussein, Ahmed A.
    Yamane, Hiroshi
    Shimizu, Ryutaro
    Nishikawa, Ryoma
    Kimura, Yusuke
    Yamaguchi, Noriya
    Hikita, Katsuya
    Honda, Masashi
    Guru, Khurshid A.
    Takenaka, Atsushi
    JOURNAL OF ENDOUROLOGY, 2024, 38 (10) : 1004 - 1012