Pedestrian Trajectory Prediction Method Based on Multi-information Fusion Network

被引:0
|
作者
Gao, Song [1 ,2 ]
Zhou, Jianglin [2 ]
Gao, Bolin [1 ,3 ]
Lu, Jian [2 ]
Wang, He [2 ]
Xu, Yueyun [2 ]
机构
[1] School of Vehicles and Mobility, Tsinghua University, Beijing,10000, China
[2] National Innovation Center of Intelligent and Connected Vehicles, Beijing,102600, China
[3] China
来源
关键词
Data fusion - Magnetic levitation vehicles - Time difference of arrival;
D O I
10.19562/j.chinasae.qcgc.2024.11.004
中图分类号
学科分类号
摘要
With the continuous development of autonomous driving technology,accurately predicting the future trajectories of pedestrians has become a critical element in ensuring system safety and reliability. However, most existing studies on pedestrian trajectory prediction rely on fixed camera perspectives,which limits the compre⁃ hensive observation of pedestrian movement and thus makes them unsuitable for direct application to pedestrian tra⁃ jectory prediction under the ego-vehicle perspective in autonomous vehicles. To solve the problem,in this paper a pedestrian trajectory prediction method under the ego-vehicle perspective based on the Multi-Pedestrian Information Fusion Network(MPIFN)is proposed,which achieves accurate prediction of pedestrians' future trajectories by inte⁃ grating social information,local environmental information,and temporal information of pedestrians. In this paper, a Local Environmental Information Extraction Module that combines deformable convolution with traditional convo⁃ lutional and pooling operations is constructed,aiming to more effectively extract local information from complex en⁃ vironment. By dynamically adjusting the position of convolutional kernels,this module enhances the model’s adapt⁃ ability to irregular and complex shapes. Meanwhile,the pedestrian spatiotemporal information extraction module and multimodal feature fusion module are developed to facilitate comprehensive integration of social and environ⁃ mental information. The experimental results show that the proposed method achieves advanced performance on two ego-vehicle driving datasets,JAAD and PSI. Specifically,on the JAAD dataset,the Center Final Mean Squared Er⁃ ror(CF_MSE)is 4 063,and the Center Mean Squared Error(C_MSE)is 829. On the PSI dataset,the Average Root Mean Square Error(ARB)and Final Root Mean Square Error(FRB)also achieve outstanding performance with values of 18.08/29.21/44.98 and 25.27/54.62/93.09 for prediction horizons of 0.5 s,1.0 s,and 1.5 s,respec⁃ tively. © 2024 SAE-China. All rights reserved.
引用
收藏
页码:1973 / 1982
相关论文
共 50 条
  • [1] A multi-object tracking method based on multi-information fusion and trajectory correlation correction
    Tian J.-Y.
    Li H.
    Li S.-Y.
    Chen S.-M.
    Liu Y.
    Kongzhi yu Juece/Control and Decision, 2024, 39 (06): : 1888 - 1896
  • [2] An urban road traffic flow prediction method based on multi-information fusion
    Wu, Xiao
    Huang, Hua
    Zhou, Tong
    Tian, Yudan
    Wang, Shisen
    Wang, Jingting
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [3] Pedestrian Trajectory Prediction Method Based on Feature Fusion
    Yang, Tian
    Wang, Gang
    Lai, Jian
    Wang, Yang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [4] Pedestrian Trajectory Prediction Method Based on Information Fractals
    Yang T.
    Wang G.
    Lai J.
    Wang Y.
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (02): : 527 - 537
  • [5] IMAGE DEBLURRING BASED ON LIGHTWEIGHT MULTI-INFORMATION FUSION NETWORK
    Zhang, Yanni
    Liu, Yiming
    Li, Qiang
    Qi, Miao
    Xu, Dahong
    Kong, Jun
    Wang, Jianzhong
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1724 - 1728
  • [6] Fault Diagnosis Method of Equipment based on Multi-information Fusion
    QI Jiyang
    WANG Lingyun
    InternationalJournalofPlantEngineeringandManagement, 2020, 25 (02) : 77 - 97
  • [7] Prediction of Pedestrian Intention and Trajectory Based on Multi-feature Fusion
    Cao H.-T.
    Shi H.-J.
    Song X.-L.
    Li M.-J.
    Dai H.-L.
    Huang Z.
    Zhongguo Gonglu Xuebao/China Journal of Highway and Transport, 2022, 35 (10): : 308 - 318
  • [8] Multi-information-based convolutional neural network with attention mechanism for pedestrian trajectory prediction
    Wang, Ruiping
    Cui, Yong
    Song, Xiao
    Chen, Kai
    Fang, Hong
    IMAGE AND VISION COMPUTING, 2021, 107 (107)
  • [9] A pedestrian trajectory prediction method based on improved LSTM network
    Liu, Fugang
    Duan, Songnan
    Juan, Wang
    IET IMAGE PROCESSING, 2024, 18 (02) : 379 - 387
  • [10] DETECTION METHOD OF SPOT WELDING BASED ON MULTI-INFORMATION FUSION AND FRACTAL
    LIU Pengfei Luoyang Ship Material Research Institute
    Chinese Journal of Mechanical Engineering, 2008, 21 (06) : 76 - 81