MixNet: Physics Constrained Deep Neural Motion Prediction for Autonomous Racing

被引:2
|
作者
Karle, Phillip [1 ]
Toeroek, Ferenc [1 ]
Geisslinger, Maximilian [1 ]
Lienkamp, Markus [1 ]
机构
[1] Tech Univ Munich TUM, Inst Automot Technol, TUM Sch Engn & Design, Dept Mobil Syst Engn, D-85748 Munich, Germany
关键词
Autonomous racing; hybrid deep neural networks; motion prediction; scenario understanding; TRAJECTORY PREDICTION; CLASSIFICATION; VEHICLES;
D O I
10.1109/ACCESS.2023.3303841
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Reliably predicting the motion of contestant vehicles surrounding an autonomous racecar is crucial for effective and performant ego-motion planning. Although highly expressive, deep neural networks are black-box models, making their usage challenging in this safety-critical applications of autonomous racing. On the other hand, physics-based models provide high safety guarantees for the predicted trajectory but lack accuracy. The method presented in this paper targets this trade-off. We introduce a method to predict the trajectories of opposing racecars with deep neural networks considering physical constraints to restrict the output and to improve its feasibility. We report the method's performance against an LSTM-based encoder-decoder architecture on data acquired from multi-agent racing simulations. The proposed method outperforms the baseline model in prediction accuracy and robustness. Still, it fulfills quality guarantees of smoothness and consistency of the predicted trajectory and prevents out-of-track predictions. Thus, a robust real-world application of the model with high prediction accuracy is proven. The presented model was deployed on the racecar of the Technical University of Munich for the Indy Autonomous Challenge 2021. The code used in this research is available as open-source software at https://www.github.com/TUMFTM/MixNet.
引用
收藏
页码:85914 / 85926
页数:13
相关论文
共 50 条
  • [1] Deep Dynamics: Vehicle Dynamics Modeling With a Physics-Constrained Neural Network for Autonomous Racing
    Chrosniak, John
    Ning, Jingyun
    Behl, Madhur
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (06) : 5292 - 5297
  • [2] Incremental Learning with Memory Regressors for Motion Prediction in Autonomous Racing
    Yang, Yahan
    Dutta, Souradeep
    Jang, Kuk Jin
    Sokolsky, Oleg
    Lee, Insup
    PROCEEDINGS OF THE 2023 ACM/IEEE 14TH INTERNATIONAL CONFERENCE ON CYBER-PHYSICAL SYSTEMS, WITH CPS-IOTWEEK 2023, 2023, : 264 - 265
  • [3] Physics Constrained Motion Prediction with Uncertainty Quantification
    Tumu, Renukanandan
    Lindemann, Lars
    Truong Nghiem
    Mangharam, Rahul
    2023 IEEE INTELLIGENT VEHICLES SYMPOSIUM, IV, 2023,
  • [4] Learning a Deep Cascaded Neural Network for Multiple Motion Commands Prediction in Autonomous Driving
    Hu, Xuemin
    Tang, Bo
    Chen, Long
    Song, Sheng
    Tong, Xiuchi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (12) : 7585 - 7596
  • [5] The Usage of Neural Networks for Motion Prediction of Autonomous Objects
    Ilyichenkova, Z., V
    Ivanova, S. M.
    Volkov, A., I
    Ermakova, A. Yu
    2019 SYSTEMS OF SIGNALS GENERATING AND PROCESSING IN THE FIELD OF ON BOARD COMMUNICATIONS, 2019,
  • [6] Autonomous Drone Racing with Deep Reinforcement Learning
    Song, Yunlong
    Steinweg, Mats
    Kaufmann, Elia
    Scaramuzza, Davide
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 1205 - 1212
  • [7] A Hierarchical Approach for Strategic Motion Planning in Autonomous Racing
    Reiter, Rudolf
    Hoffmann, Jasper
    Boedecker, Joschka
    Diehl, Moritz
    2023 EUROPEAN CONTROL CONFERENCE, ECC, 2023,
  • [8] A novel physics-constrained neural network: An illustration of ground motion models
    Ji, Duofa
    Li, Chenxi
    Zhai, Changhai
    Dong, You
    SOIL DYNAMICS AND EARTHQUAKE ENGINEERING, 2025, 188
  • [9] Illusory Motion Reproduced by Deep Neural NetworksTrained for Prediction
    Watanabe, Eiji
    Kitaoka, Akiyoshi
    Sakamoto, Kiwako
    Yasugi, Masaki
    Tanaka, Kenta
    FRONTIERS IN PSYCHOLOGY, 2018, 9
  • [10] Comparing deep reinforcement learning architectures for autonomous racing
    Evans, Benjamin David
    Jordaan, Hendrik Willem
    Engelbrecht, Herman Arnold
    MACHINE LEARNING WITH APPLICATIONS, 2023, 14