A rapid generation method of models in machining processes for real-time human-machine interaction with virtual-real fusion

被引:0
|
作者
Xu, Hanzhong [1 ]
Wu, Dianliang [1 ]
Zheng, Yu [1 ]
Yu, Haiwen [1 ]
Yu, Qihang [1 ]
Zou, Kai [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Mech Engn, Shanghai 200240, Peoples R China
基金
国家重点研发计划;
关键词
Digital twin machine tool; Dexel model; Augmented reality; Human-machine interaction; AUGMENTED REALITY; SYSTEM; TWIN; SIMULATION;
D O I
10.1007/s00170-024-13736-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The intelligent service of the digital twin machine tool provides convenience for the human operation interaction in the machine tool, and the real-time operation interaction between the human and the machine tool has high requirements for the real-time machining model simulation algorithm. Firstly, this paper proposes a simulation method based on the combination of augmented reality (AR) and digital twin of machine tool machining virtual-real fusion. Secondly, to improve the real-time interoperability between human and machine tools in the AR virtual-real fusion machining process, this paper proposes a fast Dexel model generation method based on binary tree space segmentation. The method is based on the 3D model of the workpiece preprocessing to generate a one-way Dexel model of the binary tree storage structure, using the tool and the workpiece overlap envelope in the binary tree structure to determine the interference region, and ultimately calculating the intersection line between the one-way generation line and the tool geometry to get the model of the workpiece after cutting. By analyzing the real-time performance of the algorithm, the algorithm satisfies the simulation calculation of Dexel models of different scales. Finally, through the example of real-time interactive operation between human and machine tool AR, the results show that the average display frame rate of this algorithm in the machining process reaches 55-60 frames, and the parameter error between the model after virtual machining and the actual machining model is within 1.3%. At the same time, 100 people were randomly selected to carry out AR interaction training, and the real-time performance experience of AR virtual-real fusion machining was comprehensively evaluated, and the results showed that the system can meet the real-time demand of interaction operation of most participants.
引用
收藏
页码:6115 / 6130
页数:16
相关论文
共 50 条
  • [1] Real-time simulation of ship structure based on virtual-real fusion interaction
    Wei, Pengyu
    Li, Chuntong
    Jiang, Ze
    Wang, Deyu
    OCEAN ENGINEERING, 2024, 295
  • [2] Real-time interaction method in human-machine interface design evaluation
    Yan, Sheng-Yuan
    Zhang, Zhi-Jian
    Peng, Min-Jun
    Xu, Yu-Qing
    Harbin Gongcheng Daxue Xuebao/Journal of Harbin Engineering University, 2005, 26 (02): : 189 - 191
  • [3] Real-Time 3D Road Scene Based on Virtual-Real Fusion Method
    Wu, Yuezhou
    Liu, Changjiang
    Lan, Shiyong
    Yang, Menglong
    IEEE SENSORS JOURNAL, 2015, 15 (02) : 750 - 756
  • [4] Human-Machine Interaction for Real-time Linear Optimization
    Hamel, Simon
    Gaudreault, Jonathan
    Quimper, Claude-Guy
    Bouchard, Mathieu
    Marier, Philippe
    PROCEEDINGS 2012 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2012, : 673 - 680
  • [5] Real-time humanoid avatar for multimodal human-machine interaction
    Fu, Yun
    Li, Renxiang
    Huang, Thomas S.
    Danielsen, Mike
    2007 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-5, 2007, : 991 - +
  • [6] Neurointerfaces for human-machine real time interaction
    Widrow, B
    Ferreira, EP
    Lamego, MM
    ALGORITHMS AND ARCHITECTURES FOR REAL-TIME CONTROL 1998 (AARTC'98), 1998, : 101 - 106
  • [7] RMVP: A Real-Time Method to Monitor Random Processes of Virtual Machine
    Li, Yonggang
    Wu, Yun
    Cui, Chaoyuan
    Wang, Licheng
    IEEE ACCESS, 2019, 7 (15845-15860): : 15845 - 15860
  • [8] A Fast Gesture Recognition Scheme for Real-Time Human-Machine Interaction Systems
    Lai, Ching-Hao
    2011 INTERNATIONAL CONFERENCE ON TECHNOLOGIES AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE (TAAI 2011), 2011, : 212 - 217
  • [9] VHDL described Finger Tracking System for Real-Time Human-Machine Interaction
    Iturbe, Xabier
    Altuna, Andoni
    Ruiz de Olano, Alberto
    Martinez, Imanol
    ICSES 2008 INTERNATIONAL CONFERENCE ON SIGNALS AND ELECTRONIC SYSTEMS, CONFERENCE PROCEEDINGS, 2008, : 171 - 176
  • [10] Real-Time Sensing of Trust in Human-Machine Interactions
    Hu, Wan-Lin
    Akash, Kumar
    Jain, Neera
    Reid, Tahira
    IFAC PAPERSONLINE, 2016, 49 (32): : 48 - 53