Development of a digital twin environment for smart collision avoidance algorithms for mobile robots using reinforcement learning

被引:1
|
作者
Matsumoto, Natsumi [1 ]
Kobayashi, Kazuyuki [1 ]
Ohkubo, Tomoyuki [2 ]
Tian, Kaiqiao [3 ]
Sebi, Nashwan J. [3 ]
Cheok, Ka C. [3 ]
Cai, Changqing [4 ]
机构
[1] Hosei Univ, Grad Sch Sci & Engn, Tokyo, Japan
[2] Nippon Inst Technol, Fac Adv Engn, Saitama, Japan
[3] Oakland Univ, Sch Engn & Comp Sci, Elect & Comp Engn Dept, Rochester, MI 48309 USA
[4] Changchun Inst Technol, Sch Elect Engn & Informat Technol, Changchun, Peoples R China
关键词
Digital Twin; Point Cloud Data; Mobile Robot; Reinforce Learning;
D O I
10.23919/SICE59929.2023.10354094
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper describes a study on building a digital twin environment using point cloud data for mobile robots. A digital twin environment for mobile robots is a method to reproduce almost the same environment in a simulation space as if it were a twin, using data from an actual natural environment. In fact, in the development of mobile robots, experiments on public urban area are conducted, however, they are incredibly time-consuming and labor-intensive, so it would be helpful if a realistic simulation environment could be created. This study focuses on building a digital twin environment using point-cloud-data for mobile robots. In order to verify the effectiveness of this approach, we constructed the environment using data from a real mobile robot that has been driven. The navigation of the mobile robot was performed in the constructed simulation environment, and it was possible to realize a navigation run in the driving environment that was almost the same as the run of the real mobile robot.
引用
收藏
页码:1376 / 1381
页数:6
相关论文
共 50 条
  • [21] Neural networks based reinforcement learning for mobile robots obstacle avoidance
    Duguleana, Mihai
    Mogan, Gheorghe
    EXPERT SYSTEMS WITH APPLICATIONS, 2016, 62 : 104 - 115
  • [22] Obstacle avoidance of multi mobile robots based on hierarchical reinforcement learning
    Zu, Li-Nan
    Tian, Yan-Tao
    Mei, Hao
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2006, 36 (SUPPL. 2): : 108 - 112
  • [23] Deep-Reinforcement-Learning-Based Collision Avoidance in UAV Environment
    Ouahouah, Sihem
    Bagaa, Miloud
    Prados-Garzon, Jonathan
    Taleb, Tarik
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (06) : 4015 - 4030
  • [24] Reinforcement Learning Training Environment for Fixed Wing UAV Collision Avoidance
    D'Apolito, Francesco
    IFAC PAPERSONLINE, 2022, 55 (39): : 281 - 285
  • [25] Collision avoidance of mobile robots using multi-agent systems
    Soriano, Angel
    Bernabeu, Enrique J.
    Valera, Angel
    Vallés, Marina
    Advances in Intelligent Systems and Computing, 2013, 217 : 429 - 437
  • [26] Cooperative mobile robots with obstacle and collision avoidance using fuzzy logic
    Dadios, EP
    Maravillas, OA
    PROCEEDINGS OF THE 2002 IEEE INTERNATIONAL SYMPOSIUM ON INTELLIGENT CONTROL, 2002, : 75 - 80
  • [27] Collision avoidance for a small drone with a monocular camera using deep reinforcement learning in an indoor environment
    Kim M.
    Kim J.
    Jung M.
    Oh H.
    Journal of Institute of Control, Robotics and Systems, 2020, 26 (06) : 399 - 411
  • [28] Collision Avoidance for Wheeled Mobile Robots in Smart Agricultural Systems Using Control Barrier Function Quadratic Programming
    Amertet, Sairoel
    Gebresenbet, Girma
    APPLIED SCIENCES-BASEL, 2025, 15 (05):
  • [29] A digital twin to train deep reinforcement learning agent for smart manufacturing plants: Environment, interfaces and intelligence
    Xia, Kaishu
    Sacco, Christopher
    Kirkpatrick, Max
    Saidy, Clint
    Nguyen, Lam
    Kircaliali, Anil
    Harik, Ramy
    JOURNAL OF MANUFACTURING SYSTEMS, 2021, 58 : 210 - 230
  • [30] Globally Perceived Obstacle Avoidance for Robots Based on Virtual Twin and Deep Reinforcement Learning
    Jiang, Rongxin
    Ying, Fengkang
    Zhang, Guojing
    Xing, Yifei
    Liu, Huashan
    2023 7TH INTERNATIONAL CONFERENCE ON ROBOTICS, CONTROL AND AUTOMATION, ICRCA, 2023, : 45 - 49