Pedestrian Trajectory Prediction Method Based on Multi-information Fusion Network

被引:0
|
作者
Gao, Song [1 ,2 ]
Zhou, Jianglin [2 ]
Gao, Bolin [1 ,3 ]
Lu, Jian [2 ]
Wang, He [2 ]
Xu, Yueyun [2 ]
机构
[1] School of Vehicles and Mobility, Tsinghua University, Beijing,10000, China
[2] National Innovation Center of Intelligent and Connected Vehicles, Beijing,102600, China
[3] China
来源
关键词
Data fusion - Magnetic levitation vehicles - Time difference of arrival;
D O I
10.19562/j.chinasae.qcgc.2024.11.004
中图分类号
学科分类号
摘要
With the continuous development of autonomous driving technology,accurately predicting the future trajectories of pedestrians has become a critical element in ensuring system safety and reliability. However, most existing studies on pedestrian trajectory prediction rely on fixed camera perspectives,which limits the compre⁃ hensive observation of pedestrian movement and thus makes them unsuitable for direct application to pedestrian tra⁃ jectory prediction under the ego-vehicle perspective in autonomous vehicles. To solve the problem,in this paper a pedestrian trajectory prediction method under the ego-vehicle perspective based on the Multi-Pedestrian Information Fusion Network(MPIFN)is proposed,which achieves accurate prediction of pedestrians' future trajectories by inte⁃ grating social information,local environmental information,and temporal information of pedestrians. In this paper, a Local Environmental Information Extraction Module that combines deformable convolution with traditional convo⁃ lutional and pooling operations is constructed,aiming to more effectively extract local information from complex en⁃ vironment. By dynamically adjusting the position of convolutional kernels,this module enhances the model’s adapt⁃ ability to irregular and complex shapes. Meanwhile,the pedestrian spatiotemporal information extraction module and multimodal feature fusion module are developed to facilitate comprehensive integration of social and environ⁃ mental information. The experimental results show that the proposed method achieves advanced performance on two ego-vehicle driving datasets,JAAD and PSI. Specifically,on the JAAD dataset,the Center Final Mean Squared Er⁃ ror(CF_MSE)is 4 063,and the Center Mean Squared Error(C_MSE)is 829. On the PSI dataset,the Average Root Mean Square Error(ARB)and Final Root Mean Square Error(FRB)also achieve outstanding performance with values of 18.08/29.21/44.98 and 25.27/54.62/93.09 for prediction horizons of 0.5 s,1.0 s,and 1.5 s,respec⁃ tively. © 2024 SAE-China. All rights reserved.
引用
收藏
页码:1973 / 1982
相关论文
共 50 条
  • [21] Pedestrian trajectory prediction method based on pedestrian pose
    Wang R.
    Song X.
    Chen K.
    Gong K.
    Zhang J.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2023, 49 (07): : 1743 - 1754
  • [22] Diffuse Optical Tomography Method Based on Multi-information Fusion and Stacked Auto-encoder Network
    Sun Zhilong
    Zhang Jie
    Liu Zongyang
    Gao Feng
    Zhang Limin
    ACTA PHOTONICA SINICA, 2022, 51 (12)
  • [23] INSHORE SHIP DETECTION BASED ON MULTI-INFORMATION FUSION NETWORK AND INSTANCE SEGMENTATION
    Tian, Tian
    Gao, Peng
    Pan, Zhihong
    Li, Hang
    Wang, Lizhe
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 972 - 975
  • [24] Pedestrian Trajectory Prediction Method Using Dynamic Scene Information Based Transformer Generative Adversarial Network
    Pei, Zhao
    Qiu, Wen-Tao
    Wang, Miao
    Ma, Miao
    Zhang, Yan-Ning
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (07): : 1537 - 1547
  • [25] A multi-step attack identification and correlation method based on multi-information fusion
    Liao, Niandong
    Wang, Jiaxun
    Guan, Jiayu
    Fan, Hejun
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 117
  • [26] Shadow Extraction Method Based on Multi-Information Fusion and Discrete Wavelet Transform
    Shi, Bo
    Ma, Ziji
    Liu, Jianwei
    Ni, Xuefeng
    Xiao, Weichu
    Liu, Hongli
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [27] Traffic accident reconstruction based on multi-information fusion
    Zhang, Xiao-Yun
    Jin, Xian-Long
    Shen, Jie
    Guo, Lei
    Chen, Yi-Jiu
    Chen, Jian-Guo
    Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University, 2007, 41 (09): : 1397 - 1401
  • [28] Real-Time Information Acquisition and Processing Method for Penetration Information Based on Multi-Information Fusion
    Yang, Zheyu
    He, Yao
    Sui, Li
    Wang, Dongya
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2024,
  • [29] A Multi-Information Fusion Method for Repetitive Tunnel Disease Detection
    Gan, Zhiyuan
    Teng, Li
    Chang, Ying
    Feng, Xinyang
    Gao, Mengnan
    Gao, Xinwen
    SUSTAINABILITY, 2024, 16 (10)
  • [30] Weapon equipment performance evaluation method with multi-information fusion
    Chen L.
    Zhou Z.
    Tang S.
    Cao Y.
    1600, Chinese Institute of Electronics (42): : 1527 - 1533