Development of a digital twin environment for smart collision avoidance algorithms for mobile robots using reinforcement learning

被引:1
|
作者
Matsumoto, Natsumi [1 ]
Kobayashi, Kazuyuki [1 ]
Ohkubo, Tomoyuki [2 ]
Tian, Kaiqiao [3 ]
Sebi, Nashwan J. [3 ]
Cheok, Ka C. [3 ]
Cai, Changqing [4 ]
机构
[1] Hosei Univ, Grad Sch Sci & Engn, Tokyo, Japan
[2] Nippon Inst Technol, Fac Adv Engn, Saitama, Japan
[3] Oakland Univ, Sch Engn & Comp Sci, Elect & Comp Engn Dept, Rochester, MI 48309 USA
[4] Changchun Inst Technol, Sch Elect Engn & Informat Technol, Changchun, Peoples R China
来源
2023 62ND ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS, SICE | 2023年
关键词
Digital Twin; Point Cloud Data; Mobile Robot; Reinforce Learning;
D O I
10.23919/SICE59929.2023.10354094
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper describes a study on building a digital twin environment using point cloud data for mobile robots. A digital twin environment for mobile robots is a method to reproduce almost the same environment in a simulation space as if it were a twin, using data from an actual natural environment. In fact, in the development of mobile robots, experiments on public urban area are conducted, however, they are incredibly time-consuming and labor-intensive, so it would be helpful if a realistic simulation environment could be created. This study focuses on building a digital twin environment using point-cloud-data for mobile robots. In order to verify the effectiveness of this approach, we constructed the environment using data from a real mobile robot that has been driven. The navigation of the mobile robot was performed in the constructed simulation environment, and it was possible to realize a navigation run in the driving environment that was almost the same as the run of the real mobile robot.
引用
收藏
页码:1376 / 1381
页数:6
相关论文
共 50 条
  • [41] COLLISION-AVOIDANCE FOR MOBILE ROBOTS USING REGION OF CERTAINTY: A PREDICTIVE APPROACH
    Manup, B.
    Raja, P.
    JOURNAL OF ENGINEERING SCIENCE AND TECHNOLOGY, 2016, 11 (01) : 18 - 28
  • [42] Autonomous collision avoidance for wheeled mobile robots using a differential game approach
    Mylvaganam, Thulasi
    Sassano, Mario
    EUROPEAN JOURNAL OF CONTROL, 2018, 40 : 53 - 61
  • [43] Intelligent collision avoidance algorithms for USVs via deep reinforcement learning under COLREGs
    Xu, Xinli
    Lu, Yu
    Liu, Xiaocheng
    Zhang, Weidong
    OCEAN ENGINEERING, 2020, 217
  • [44] A Deep Reinforcement Learning Method for Mobile Robot Collision Avoidance based on Double DQN
    Xue, Xidi
    Li, Zhan
    Zhang, Dongsheng
    Yan, Yingxin
    2019 IEEE 28TH INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2019, : 2131 - 2136
  • [45] Collision avoidance for an unmanned surface vehicle using deep reinforcement learning
    Woo, Joohyun
    Kim, Nakwan
    OCEAN ENGINEERING, 2020, 199
  • [46] Space Manipulator Collision Avoidance Using a Deep Reinforcement Learning Control
    Blaise, James
    Bazzocchi, Michael C. F.
    AEROSPACE, 2023, 10 (09)
  • [47] Collision Avoidance in IEEE 802.11 DCF using a Reinforcement Learning Method
    Lee, Chang Kyu
    Rhee, Seung Hyong
    11TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE: DATA, NETWORK, AND AI IN THE AGE OF UNTACT (ICTC 2020), 2020, : 898 - 901
  • [48] Unexpected Collision Avoidance Driving Strategy Using Deep Reinforcement Learning
    Kim, Myounghoe
    Lee, Seongwon
    Lim, Jaehyun
    Choi, Jongeun
    Kang, Seong Gu
    IEEE ACCESS, 2020, 8 : 17243 - 17252
  • [49] Vehicles Control: Collision Avoidance using Federated Deep Reinforcement Learning
    Ben Elallid, Badr
    Abouaomar, Amine
    Benamar, Nabil
    Kobbane, Abdellatif
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 4369 - 4374
  • [50] Aircraft collision avoidance modeling and optimization using deep reinforcement learning
    Park K.-W.
    Kim J.-H.
    Journal of Institute of Control, Robotics and Systems, 2021, 27 (09) : 652 - 659