Highly Interactive Self-Supervised Learning for Multi-Modal Trajectory Prediction

被引:0
|
作者
Xie, Wenda [1 ]
Liu, Yahui [1 ]
Zhao, Hongxia [1 ]
Guo, Chao [1 ]
Dai, Xingyuan [1 ,2 ]
Lv, Yisheng [1 ,3 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Multimodal Artificial Intelligence, Beijing 100190, Peoples R China
[2] Shanghai Artificial Intelligence Lab, Shanghai 200232, Peoples R China
[3] Changan Univ, Minist Educ, Engn Res Ctr Highway Infrastruct Digitalizat, Xian 710064, Peoples R China
来源
IFAC PAPERSONLINE | 2024年 / 58卷 / 10期
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Automatic driving; Self-supervised learning; Trajectory prediction; Deep learning; Intelligent Transportation;
D O I
10.1016/j.ifacol.2024.07.345
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To ensure the safety of autonomous vehicles, trajectory prediction is critical as it enables vehicles to anticipate the movements of surrounding agents, thereby facilitating the planning of secure and strategic driving routes. However, striking a trade-off between predictive accuracy and training costs has always been an intricate challenge. This paper introduces a groundbreaking framework for trajectory prediction known as Highly Interactive Self-Supervised Learning (HI-SSL), a methodology based on self-supervised learning (SSL) that has yet to be thoroughly investigated in the realm of trajectory prediction. The cornerstone of the aforementioned framework is Interactive Masking, which leverages a novel trajectory masking strategy facilitating self-supervised learning tasks that not only enhance prediction accuracy but also eliminate the need for manual annotations. Experiments conducted on the Argoverse motion forecasting dataset demonstrate that our approach achieves competitive performance to prior methods that depend on supervised learning without additional annotation costs. Copyright (C) 2024 The Authors. This is an open access article under the CC BY-NC-ND license (https://creativecommons.org/licenses/by-nc-nd/4.0/)
引用
收藏
页码:231 / 236
页数:6
相关论文
共 50 条
  • [31] Self-supervised 3D Patient Modeling with Multi-modal Attentive Fusion
    Zheng, Meng
    Planche, Benjamin
    Gong, Xuan
    Yang, Fan
    Chen, Terrence
    Wu, Ziyan
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VII, 2022, 13437 : 115 - 125
  • [32] Self-supervised multi-modal feature fusion for predicting early recurrence of hepatocellular carcinoma
    Wang, Sen
    Zhao, Ying
    Li, Jiayi
    Yi, Zongmin
    Li, Jun
    Zuo, Can
    Yao, Yu
    Liu, Ailian
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2024, 118
  • [33] Self-Supervised Depth Completion Based on Multi-Modal Spatio-Temporal Consistency
    Zhang, Quan
    Chen, Xiaoyu
    Wang, Xingguo
    Han, Jing
    Zhang, Yi
    Yue, Jiang
    REMOTE SENSING, 2023, 15 (01)
  • [34] Multi-Modal Trajectory Prediction of NBA Players
    Hauri, Sandro
    Djuric, Nemanja
    Radosavljevic, Vladan
    Vucetic, Slobodan
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 1639 - 1648
  • [35] IDSSL: Intent Detection Module Based on Self-Supervised Learning for Trajectory Prediction
    Jin, Chenyan
    Kuang, Sipeng
    Cui, Peng
    Zhang, Ya
    UNMANNED SYSTEMS, 2023,
  • [36] Self-supervised human mobility learning for next location prediction and trajectory classification
    Zhou, Fan
    Dai, Yurou
    Gao, Qiang
    Wang, Pengyu
    Zhong, Ting
    KNOWLEDGE-BASED SYSTEMS, 2021, 228
  • [37] Multi-modal emotion recognition using tensor decomposition fusion and self-supervised multi-tasking
    Wang, Rui
    Zhu, Jiawei
    Wang, Shoujin
    Wang, Tao
    Huang, Jingze
    Zhu, Xianxun
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2024, 13 (04)
  • [38] Exploring Self-Supervised Learning for Multi-Modal Remote Sensing Pre-Training via Asymmetric Attention Fusion
    Xu, Guozheng
    Jiang, Xue
    Li, Xiangtai
    Zhang, Ze
    Liu, Xingzhao
    REMOTE SENSING, 2023, 15 (24)
  • [39] Trajectory Prediction Method Enhanced by Self-supervised Pretraining
    Li, Linhui
    Fu, Yifan
    Wang, Ting
    Wang, Xuecheng
    Lian, Jing
    Qiche Gongcheng/Automotive Engineering, 2024, 46 (07): : 1219 - 1227
  • [40] Heterogeneous self-supervised interest point matching for multi-modal remote sensing image registration
    Zhao, Ming
    Zhang, Guixiang
    Ding, Min
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (03) : 915 - 931