MMTP: Multi-Modal Trajectory Prediction with Interaction Attention and Adaptive Task Weighting

被引:1
|
作者
Chen, Sihan [1 ]
Ma, Zhixiong [1 ]
Zhu, Xichan [1 ]
Wang, Chengkang [1 ]
Zheng, Lianqing [1 ]
Huang, Libo [2 ]
Bai, Jie [2 ]
机构
[1] Tongji Univ, Sch Automot Studies, Shanghai, Peoples R China
[2] Zhejiang Univ City Coll, Sch Informat & Elect, Hangzhou, Zhejiang, Peoples R China
基金
国家重点研发计划;
关键词
D O I
10.1109/ITSC55140.2022.9922397
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate prediction of the driving intentions and trajectories of other vehicles is critical to the planning and control subsystem of the autonomous driving system. In addition to the driver's driving habits, the future driving intention and trajectory of a vehicle are the result of dynamic interactions with others around it, and the driver should have multiple executable driving trajectories to choose from at a given moment. In this paper, we propose a new interaction attention mechanism and a lightweight multi-modal maneuver-based trajectory prediction model. In addition, we consider it as multi-task model and put forward an adaptive task loss weighting scheme for further performance improving. We evaluate our method on dataset NGSIM US101, and the results show that the proposed model achieves the optimal performance, the lowest model complexity and our task loss weighting scheme can further improve the model performance compared to the original task loss scheme.
引用
收藏
页码:486 / 492
页数:7
相关论文
共 50 条
  • [1] Probabilistic Multi-modal Trajectory Prediction with Lane Attention for Autonomous Vehicles
    Luo, Chenxu
    Sun, Lin
    Dabiri, Dariush
    Yuille, Alan
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 2370 - 2376
  • [2] Multi-Modal Trajectory Prediction of NBA Players
    Hauri, Sandro
    Djuric, Nemanja
    Radosavljevic, Vladan
    Vucetic, Slobodan
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 1639 - 1648
  • [3] A Lightweight Multi-Modal Vehicle Trajectory Prediction Algorithm
    Li Z.
    Sun H.
    Hao Z.
    Xiao D.
    Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2024, 58 (06): : 14 - 23
  • [4] Exploring Complex Dependencies for Multi-modal Semantic Trajectory Prediction
    Liu, Jie
    Zhang, Lei
    Zhu, Shaojie
    Liu, Bailong
    Liang, Zhizheng
    Yang, Susong
    NEURAL PROCESSING LETTERS, 2022, 54 (02) : 961 - 985
  • [5] Learning Pedestrian Group Representations for Multi-modal Trajectory Prediction
    Bae, Inhwan
    Park, Jin-Hwi
    Jeon, Hae-Gon
    COMPUTER VISION, ECCV 2022, PT XXII, 2022, 13682 : 270 - 289
  • [6] Kernel Trajectory Maps for Multi-Modal Probabilistic Motion Prediction
    Zhi, Weiming
    Ott, Lionel
    Ramos, Fabio
    CONFERENCE ON ROBOT LEARNING, VOL 100, 2019, 100
  • [7] Multi-modal vehicle trajectory prediction based on mutual information
    Fei, Cong
    He, Xiangkun
    Ji, Xuewu
    IET INTELLIGENT TRANSPORT SYSTEMS, 2020, 14 (03) : 148 - 153
  • [8] Exploring Complex Dependencies for Multi-modal Semantic Trajectory Prediction
    Jie Liu
    Lei Zhang
    Shaojie Zhu
    Bailong Liu
    Zhizheng Liang
    Susong Yang
    Neural Processing Letters, 2022, 54 : 961 - 985
  • [9] Multi-Modal Vehicle Trajectory Prediction by Collaborative Learning of Lane Orientation, Vehicle Interaction, and Intention
    Tian, Wei
    Wang, Songtao
    Wang, Zehan
    Wu, Mingzhi
    Zhou, Sihong
    Bi, Xin
    SENSORS, 2022, 22 (11)
  • [10] Multi-modal Conditional Attention Fusion for Dimensional Emotion Prediction
    Chen, Shizhe
    Jin, Qin
    MM'16: PROCEEDINGS OF THE 2016 ACM MULTIMEDIA CONFERENCE, 2016, : 571 - 575