An End-to-End solution to Autonomous Driving based on Xilinx FPGAd

被引:6
|
作者
Wu, Tianze [1 ]
Liu, Weiyi [2 ]
Jin, Yongwei [3 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Univ Chinese Acad Sci, Beijing, Peoples R China
[2] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
[3] Xidian Univ, Xian, Peoples R China
关键词
Autonomous Driving; Machine Learning; Pynq-Z2; Field programmable gate arrays; Deep Learning Processing Unit;
D O I
10.1109/ICFPT47387.2019.00084
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Nowadays, the autonomous driving topic is very hot, many people are trying to provide a solution to this problem. This time we build our own auto-driving car based on Xilinx Pynq-Z2, it provides an end-to-end solution which inputs images from camera and outputs control instructions directly. The platform also uses the power of Deep learning Processing Unit(DPU) to accelerate the inference process and provides a simulator for training and testing in virtual environment. If the car meets some situations which cannot be handled by AI model, it's easy to add extra traditional computer vision functions to our control system. So our platform can help people who want to try autonomous driving build their own model and test it efficiently. We hope that our platform can be easy to use and extend.
引用
收藏
页码:427 / 430
页数:4
相关论文
共 50 条
  • [41] Performance optimization of autonomous driving control under end-to-end deadlines
    Bai, Yunhao
    Li, Li
    Wang, Zejiang
    Wang, Xiaorui
    Wang, Junmin
    REAL-TIME SYSTEMS, 2022, 58 (04) : 509 - 547
  • [42] On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Driving
    Feng, Kaituo
    Li, Changsheng
    Ren, Dongchun
    Yuan, Ye
    Wang, Guoren
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 15099 - 15108
  • [43] Uncertainty Quantification with Statistical Guarantees in End-to-End Autonomous Driving Control
    Michelmore, Rhiannon
    Wicker, Matthew
    Laurenti, Luca
    Cardelli, Luca
    Gal, Yarin
    Kwiatkowska, Marta
    2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 7344 - 7350
  • [44] Multi-task Learning with Attention for End-to-end Autonomous Driving
    Ishihara, Keishi
    Kanervisto, Anssi
    Miura, Jun
    Hautamaki, Ville
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 2896 - 2905
  • [45] End-to-End Learning of Behavioural Inputs for Autonomous Driving in Dense Traffic
    Shrestha, Jatan
    Idoko, Simon
    Sharma, Basant
    Singh, Arun Kumar
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 10020 - 10027
  • [46] An End-to-End Motion Planner Using Sensor Fusion for Autonomous Driving
    Thu, Nguyen Thi Hoai
    Han, Dong Seog
    2023 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE IN INFORMATION AND COMMUNICATION, ICAIIC, 2023, : 678 - 683
  • [47] PPAD: Iterative Interactions of Prediction and Planning for End-to-End Autonomous Driving
    Chen, Zhili
    Ye, Maosheng
    Xu, Shuangjie
    Cao, Tongyi
    Chen, Qifeng
    COMPUTER VISION-ECCV 2024, PT XXXV, 2025, 15093 : 239 - 256
  • [48] Multi-modal policy fusion for end-to-end autonomous driving
    Huang, Zhenbo
    Sun, Shiliang
    Zhao, Jing
    Mao, Liang
    INFORMATION FUSION, 2023, 98
  • [49] End-to-end Autonomous Driving Perception with Sequential Latent Representation Learning
    Chen, Jianyu
    Xu, Zhuo
    Tomizuka, Masayoshi
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 1999 - 2006
  • [50] Smooth Actor-Critic Algorithm for End-to-End Autonomous Driving
    Song, Wenjie
    Liu, Shixian
    Li, Yujun
    Yang, Yi
    Xiang, Changle
    2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 3242 - 3248