DAP: A Framework for Driver Attention Prediction

被引:0
|
作者
Kamel, Ahmed [1 ,2 ]
Sobh, Ibrahim [1 ,2 ]
Al-Atabany, Walid
机构
[1] Nile Univ, Giza, Egypt
[2] Valeo, Giza, Egypt
关键词
Attention prediction; Transformer; Deep learning; Driver attention; DATASETS;
D O I
10.1007/978-3-031-47715-7_6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human drivers employ their attentional systems during driving to focus on critical items and make judgments. Because gaze data can indicate human attention, collecting and analyzing gaze data has emerged in recent years to improve autonomous driving technologies. In safety-critical situations, it is important to predict not only where the driver focuses his attention but also on which objects. In this work, we propose DAP, a novel framework for driver attention prediction that bridges the attention prediction gap between pixels and objects. The DAP Framework is evaluated on the Berkeley DeepDrive Attention (BDD-A) dataset. DAP achieves state-of-the-art performance in both pixel-level and object-level attention prediction, especially improving object detection accuracy from 78 to 90%.
引用
收藏
页码:70 / 80
页数:11
相关论文
共 50 条
  • [31] A Novel Protein Interface Prediction Framework via Hybrid Attention Mechanism
    Wu, Haifang
    Luo, Shujie
    Zhao, Weizhong
    Jiang, Xingpeng
    He, Tingting
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2022, PT III, 2022, 13282 : 365 - 378
  • [32] Skip-attention encoder–decoder framework for human motion prediction
    Ruipeng Zhang
    Xiangbo Shu
    Rui Yan
    Jiachao Zhang
    Yan Song
    Multimedia Systems, 2022, 28 : 413 - 422
  • [33] Prediction of the driver's focus of attention based on feature visualization of a deep autonomous driving model
    Huang, Tao
    Fu, Rui
    KNOWLEDGE-BASED SYSTEMS, 2022, 251
  • [34] Driver's visual fixation attention prediction in dynamic scenes using hybrid neural networks
    Xu, Chuan
    Liu, Han
    Li, Qinghao
    Su, Yan
    DIGITAL SIGNAL PROCESSING, 2023, 142
  • [35] Real-Time Driver's Focus of Attention Extraction and Prediction using Deep Learning
    Hong, Pei-heng
    Wang, Yuehua
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (06) : 1 - 10
  • [36] MTSF: Multi-Scale Temporal-Spatial Fusion Network for Driver Attention Prediction
    Jin, Lisheng
    Ji, Bingdong
    Guo, Baicang
    Wang, Huanhuan
    Han, Zhuotong
    Liu, Xingchen
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025, 26 (02) : 1494 - 1509
  • [37] Driver attention level estimation using driver model identification
    Nishigaki, Morimichi
    Shirakata, Tetsuro
    2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 3520 - 3525
  • [38] A unified evolution-driven deep learning framework for virus variation driver prediction
    Nie, Zhiwei
    Liu, Xudong
    Chen, Jie
    Wang, Zhennan
    Liu, Yutian
    Si, Haorui
    Dong, Tianyi
    Xu, Fan
    Song, Guoli
    Wang, Yu
    Zhou, Peng
    Gao, Wen
    Tian, Yonghong
    NATURE MACHINE INTELLIGENCE, 2025, 7 (01) : 131 - 144
  • [39] A heterogeneous graph transformer framework for accurate cancer driver gene prediction and downstream analysis
    Xiong, Shuwen
    Zhang, Junming
    Luo, Hong
    Zhang, Yongqing
    Xiao, Qinyin
    METHODS, 2024, 232 : 9 - 17
  • [40] A framework for driver-in-the-loop driver assistance systems
    Petersson, L
    Fletcher, L
    Zelinsky, A
    2005 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2005, : 771 - 776