An End-to-End solution to Autonomous Driving based on Xilinx FPGAd

被引:6
|
作者
Wu, Tianze [1 ]
Liu, Weiyi [2 ]
Jin, Yongwei [3 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Univ Chinese Acad Sci, Beijing, Peoples R China
[2] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
[3] Xidian Univ, Xian, Peoples R China
关键词
Autonomous Driving; Machine Learning; Pynq-Z2; Field programmable gate arrays; Deep Learning Processing Unit;
D O I
10.1109/ICFPT47387.2019.00084
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Nowadays, the autonomous driving topic is very hot, many people are trying to provide a solution to this problem. This time we build our own auto-driving car based on Xilinx Pynq-Z2, it provides an end-to-end solution which inputs images from camera and outputs control instructions directly. The platform also uses the power of Deep learning Processing Unit(DPU) to accelerate the inference process and provides a simulator for training and testing in virtual environment. If the car meets some situations which cannot be handled by AI model, it's easy to add extra traditional computer vision functions to our control system. So our platform can help people who want to try autonomous driving build their own model and test it efficiently. We hope that our platform can be easy to use and extend.
引用
收藏
页码:427 / 430
页数:4
相关论文
共 50 条
  • [21] Attacking vision-based perception in end-to-end autonomous driving models
    Boloor, Adith
    Garimella, Karthik
    He, Xin
    Gill, Christopher
    Vorobeychik, Yevgeniy
    Zhang, Xuan
    JOURNAL OF SYSTEMS ARCHITECTURE, 2020, 110
  • [22] Incremental End-to-End Learning for Lateral Control in Autonomous Driving
    Kwon, Jaerock
    Khalil, Aws
    Kim, Donghyun
    Nam, Haewoon
    IEEE ACCESS, 2022, 10 : 33771 - 33786
  • [23] End-to-End Autonomous Driving: An Angle Branched Network Approach
    Wang, Qing
    Chen, Long
    Tian, Bin
    Tian, Wei
    Li, Lingxi
    Cao, Dongpu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (12) : 11599 - 11610
  • [24] NEAT: Neural Attention Fields for End-to-End Autonomous Driving
    Chitta, Kashyap
    Prakash, Aditya
    Geiger, Andreas
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 15773 - 15783
  • [25] Minimizing Probabilistic End-to-end Latencies of Autonomous Driving Systems
    Han, Taeho
    Kim, Kanghee
    2023 IEEE 29TH REAL-TIME AND EMBEDDED TECHNOLOGY AND APPLICATIONS SYMPOSIUM, RTAS, 2023, : 27 - 39
  • [26] Hierarchical Interpretable Imitation Learning for End-to-End Autonomous Driving
    Teng, Siyu
    Chen, Long
    Ai, Yunfeng
    Zhou, Yuanye
    Xuanyuan, Zhe
    Hu, Xuemin
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (01): : 673 - 683
  • [27] End-to-End Deep Conditional Imitation Learning for Autonomous Driving
    Abdou, Mohammed
    Kamal, Hanan
    El-Tantawy, Samah
    Abdelkhalek, Ali
    Adel, Omar
    Hamdy, Karim
    Abaas, Mustafa
    31ST INTERNATIONAL CONFERENCE ON MICROELECTRONICS (IEEE ICM 2019), 2019, : 346 - 350
  • [28] Integrating End-to-End Learned Steering into Probabilistic Autonomous Driving
    Huhschneider, Christian
    Bauer, Andre
    Doll, Jens
    Weber, Michael
    Klemm, Sebastian
    Kuhnt, Florian
    Zoellner, J. Marius
    2017 IEEE 20TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2017,
  • [29] Autonomous Driving Control Using End-to-End Deep Learning
    Lee, Myoung-jae
    Ha, Young-guk
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2020), 2020, : 470 - 473
  • [30] An End-to-End Curriculum Learning Approach for Autonomous Driving Scenarios
    Anzalone, Luca
    Barra, Paola
    Barra, Silvio
    Castiglione, Aniello
    Nappi, Michele
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 19817 - 19826