MMTP: Multi-Modal Trajectory Prediction with Interaction Attention and Adaptive Task Weighting

被引:1
|
作者
Chen, Sihan [1 ]
Ma, Zhixiong [1 ]
Zhu, Xichan [1 ]
Wang, Chengkang [1 ]
Zheng, Lianqing [1 ]
Huang, Libo [2 ]
Bai, Jie [2 ]
机构
[1] Tongji Univ, Sch Automot Studies, Shanghai, Peoples R China
[2] Zhejiang Univ City Coll, Sch Informat & Elect, Hangzhou, Zhejiang, Peoples R China
基金
国家重点研发计划;
关键词
D O I
10.1109/ITSC55140.2022.9922397
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate prediction of the driving intentions and trajectories of other vehicles is critical to the planning and control subsystem of the autonomous driving system. In addition to the driver's driving habits, the future driving intention and trajectory of a vehicle are the result of dynamic interactions with others around it, and the driver should have multiple executable driving trajectories to choose from at a given moment. In this paper, we propose a new interaction attention mechanism and a lightweight multi-modal maneuver-based trajectory prediction model. In addition, we consider it as multi-task model and put forward an adaptive task loss weighting scheme for further performance improving. We evaluate our method on dataset NGSIM US101, and the results show that the proposed model achieves the optimal performance, the lowest model complexity and our task loss weighting scheme can further improve the model performance compared to the original task loss scheme.
引用
收藏
页码:486 / 492
页数:7
相关论文
共 50 条
  • [31] Multi-modal Air Trajectory Traffic Management
    Henderson, Thomas C.
    Marston, Vista
    Sacharny, David
    INTELLIGENT AUTONOMOUS SYSTEMS 18, VOL 2, IAS18-2023, 2024, 794 : 247 - 255
  • [32] Hilbert Space Embedding-based Trajectory Optimization for Multi-Modal Uncertain Obstacle Trajectory Prediction
    Sharma, Basant
    Sharma, Aditya
    Krishna, K. Madhava
    Singh, Arun Kumar
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 7448 - 7455
  • [33] Pay Attention to Implicit Attribute Values: A Multi-modal Generative Framework for AVE Task
    Zhang, Yupeng
    Wang, Shensi
    Lie, Peiguang
    Dong, Guanting
    Wang, Sirui
    Xiang, Yunsen
    Li, Zhoujun
    Zhang, Hongzhi
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023), 2023, : 13139 - 13151
  • [34] Multi-Modal Interaction-Aware Motion Prediction at Unsignalized Intersections
    Trentin, Vinicius
    Artunedo, Antonio
    Godoy, Jorge
    Villagra, Jorge
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (05): : 3349 - 3365
  • [35] Pretraining Multi-modal Representations for Chinese NER Task with Cross-Modality Attention
    Mai, Chengcheng
    Qiu, Mengchuan
    Luo, Kaiwen
    Peng, Ziyan
    Liu, Jian
    Yuan, Chunfeng
    Huang, Yihua
    WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, : 726 - 734
  • [36] Multi-modal Quality Prediction Algorithm Based on Anomalous Energy Tracking Attention
    Li, Haoyong
    Zhang, Qifei
    Li, Wenjuan
    Liang, Xiubo
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT II, ICIC 2024, 2024, 14876 : 150 - 162
  • [37] Adaptive Remediation with Multi-modal Content
    Tu, Yuwei
    Brinton, Christopher G.
    Lan, Andrew S.
    Chiang, Mung
    ADAPTIVE INSTRUCTIONAL SYSTEMS, AIS 2019, 2019, 11597 : 455 - 468
  • [38] MIA-Net: Multi-Modal Interactive Attention Network for Multi-Modal Affective Analysis
    Li, Shuzhen
    Zhang, Tong
    Chen, Bianna
    Chen, C. L. Philip
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (04) : 2796 - 2809
  • [39] Cross-modal attention for multi-modal image registration
    Song, Xinrui
    Chao, Hanqing
    Xu, Xuanang
    Guo, Hengtao
    Xu, Sheng
    Turkbey, Baris
    Wood, Bradford J.
    Sanford, Thomas
    Wang, Ge
    Yan, Pingkun
    MEDICAL IMAGE ANALYSIS, 2022, 82
  • [40] Adversarial Multi-Task Learning for Mandarin Prosodic Boundary Prediction With Multi-Modal Embeddings
    Yi, Jiangyan
    Tao, Jianhua
    Fu, Ruibo
    Wang, Tao
    Zhang, Chu Yuan
    Wang, Chenglong
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 : 2963 - 2973