Social Self-Attention Generative Adversarial Networks for Human Trajectory Prediction

被引:2
|
作者
Yang C. [1 ]
Pan H. [1 ]
Sun W. [1 ]
Gao H. [1 ]
机构
[1] Harbin Institute of Technology, Research Institute of Intelligent Control and Systems, Harbin
来源
关键词
Generative adversarial networks (GANs); self-attention; social interactions; trajectory prediction;
D O I
10.1109/TAI.2023.3299899
中图分类号
学科分类号
摘要
Predicting accurate human future trajectories is of critical importance for self-driving vehicles if they are to navigate complex scenarios. Trajectories of humans are not only dependent on the humans themselves, but also the interactions with surrounding agents. Previous works mainly model interactions among agents by using a diversity of polymerization methods that integrate various learned agent states hit or miss. In this article, we propose social self-attention generative adversarial networks (Social SAGAN), which generate socially acceptable multimodal trajectory predictions. Social SAGAN incorporates a generator that predicts future trajectories of pedestrians, a discriminator that classifies trajectory predictions as real or fake, and a social self-attention mechanism that selectively refines the most interactive information and helps the overall model to capture what to pay attention to. Through extensive experiments, we demonstrate that our model achieves competitive prediction accuracy and computational complexity compared with previous state-of-the-art methods on all trajectory forecasting benchmarks. © 2020 IEEE.
引用
收藏
页码:1805 / 1815
页数:10
相关论文
共 50 条
  • [41] Maneuver Conditioned Vehicle Trajectory Prediction Using Self-Attention
    Huang, Junan
    Huang, Zhiqiu
    Shen, Guohua
    Wang, Jinyong
    Yin, Xiaohua
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS, 2023, 22 (02)
  • [42] A froth image segmentation method via generative adversarial networks with multi-scale self-attention mechanism
    Yuze Zhong
    Zhaohui Tang
    Hu Zhang
    Yongfang Xie
    Xiaoliang Gao
    Multimedia Tools and Applications, 2024, 83 : 19663 - 19682
  • [43] Adversarial Self-Attention for Language Understanding
    Wu, Hongqiu
    Ding, Ruixue
    Zhao, Hai
    Xie, Pengjun
    Huang, Fei
    Zhang, Min
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 11, 2023, : 13727 - 13735
  • [44] Missing Data Repairs for Traffic Flow With Self-Attention Generative Adversarial Imputation Net
    Zhang, Weibin
    Zhang, Pulin
    Yu, Yinghao
    Li, Xiying
    Biancardo, Salvatore Antonio
    Zhang, Junyi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 7919 - 7930
  • [45] Generative Adversarial Network Based on Self-Attention Mechanism for Automatic Page Layout Generation
    Sun, Peng
    Liu, Xiaomei
    Weng, Liguo
    Liu, Ziheng
    APPLIED SCIENCES-BASEL, 2025, 15 (05):
  • [46] Multi-scale self-attention generative adversarial network for pathology image restoration
    Liang, Meiyan
    Zhang, Qiannan
    Wang, Guogang
    Xu, Na
    Wang, Lin
    Liu, Haishun
    Zhang, Cunlin
    VISUAL COMPUTER, 2023, 39 (09): : 4305 - 4321
  • [47] Improved self-attention generative adversarial adaptation network-based melanoma classification
    Gowthami, S.
    Harikumar, R.
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 44 (03) : 4113 - 4122
  • [48] BaMSGAN: Self-Attention Generative Adversarial Network with Blur and Memory for Anime Face Generation
    Li, Xu
    Li, Bowei
    Fang, Minghao
    Huang, Rui
    Huang, Xiaoran
    MATHEMATICS, 2023, 11 (20)
  • [49] Multi-scale self-attention generative adversarial network for pathology image restoration
    Meiyan Liang
    Qiannan Zhang
    Guogang Wang
    Na Xu
    Lin Wang
    Haishun Liu
    Cunlin Zhang
    The Visual Computer, 2023, 39 : 4305 - 4321
  • [50] Application of Self-Attention Generative Adversarial Network for Electromagnetic Imaging in Half-Space
    Chiu, Chien-Ching
    Lee, Yang-Han
    Chen, Po-Hsiang
    Shih, Ying-Chen
    Hao, Jiang
    SENSORS, 2024, 24 (07)