Traffic Network Flow Prediction Using Parallel Training for Deep Convolutional Neural Networks on Spark Cloud

被引:32
|
作者
Zhang, Yongnan [1 ]
Zhou, Yonghua [1 ]
Lu, Huapu [2 ]
Fujita, Hamido [3 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] Tsinghua Univ, Inst Transportat Engn, Beijing 100084, Peoples R China
[3] Iwate Prefectural Univ, Fac Software & Informat Sci, Takizawa 0200193, Japan
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Training; Predictive models; Data models; Feature extraction; Computational modeling; Cloud computing; Prediction algorithms; Deep convolutional neural networks (DCNNs); parallel training; Spark cloud computing; traffic big data; traffic network flow prediction; SYSTEM; MODEL; SVR;
D O I
10.1109/TII.2020.2976053
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traffic flow in a road network is mutually interactive and interdependent with each other. It is challenging to describe the dynamics of traffic network flow by using analytical methods. In this article, the deep convolutional neural network (DCNN) model is employed to address traffic network flow prediction. To improve the parameter learning efficiency confronting traffic big data, a parallel training approach is developed for the DCNN prediction model. The theoretical foundation is developed for the parallel training algorithm of the DCNN model. A master-slave parallel computing solution for traffic network flow prediction is implemented on the Spark cloud. Real data of traffic network flow are applied to verify the effectiveness of the DCNN prediction model and the parallel training algorithm. The experimental results demonstrate that the DCNN prediction model for traffic network flow outperforms the typical prediction models based on backpropagation neural networks, support vector regressions, radial basis functions, and decision tree regressions. The proposed parallel training method can improve the training efficiency and obtain global features of the entire dataset from local learning with regard to the respective data subsets.
引用
收藏
页码:7369 / 7380
页数:12
相关论文
共 50 条
  • [21] Asynchronous, Data-Parallel Deep Convolutional Neural Network Training with Linear Prediction Model for Parameter Transition
    Sato, Ikuro
    Fujisaki, Ryo
    Oyama, Yosuke
    Nomura, Akihiro
    Matsuoka, Satoshi
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT II, 2017, 10635 : 305 - 314
  • [22] Performance Prediction for Convolutional Neural Network on Spark Cluster
    Myung, Rohyoung
    Yu, Heonchang
    ELECTRONICS, 2020, 9 (09) : 1 - 22
  • [23] Prediction to Atrial Fibrillation Using Deep Convolutional Neural Networks
    Cho, Jungrae
    Kim, Yoonnyun
    Lee, Minho
    PREDICTIVE INTELLIGENCE IN MEDICINE, 2018, 11121 : 164 - 171
  • [24] Move Prediction Using Deep Convolutional Neural Networks in Hex
    Gao, Chao
    Hayward, Ryan
    Mueller, Martin
    IEEE TRANSACTIONS ON GAMES, 2018, 10 (04) : 336 - 343
  • [25] Prediction of Heart Disease Using Deep Convolutional Neural Networks
    Awais Mehmood
    Munwar Iqbal
    Zahid Mehmood
    Aun Irtaza
    Marriam Nawaz
    Tahira Nazir
    Momina Masood
    Arabian Journal for Science and Engineering, 2021, 46 : 3409 - 3422
  • [26] Prediction of Heart Disease Using Deep Convolutional Neural Networks
    Mehmood, Awais
    Iqbal, Munwar
    Mehmood, Zahid
    Irtaza, Aun
    Nawaz, Marriam
    Nazir, Tahira
    Masood, Momina
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2021, 46 (04) : 3409 - 3422
  • [27] Deep Spatio-temporal Adaptive 3D Convolutional Neural Networks for Traffic Flow Prediction
    Li, He
    Li, Xuejiao
    Su, Liangcai
    Jin, Duo
    Huang, Jianbin
    Huang, Deshuang
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2022, 13 (02)
  • [28] Network Traffic Identification with Convolutional Neural Networks
    Jain, Akshit V.
    2018 16TH IEEE INT CONF ON DEPENDABLE, AUTONOM AND SECURE COMP, 16TH IEEE INT CONF ON PERVAS INTELLIGENCE AND COMP, 4TH IEEE INT CONF ON BIG DATA INTELLIGENCE AND COMP, 3RD IEEE CYBER SCI AND TECHNOL CONGRESS (DASC/PICOM/DATACOM/CYBERSCITECH), 2018, : 1001 - 1007
  • [29] Internet Traffic Classification Using an Ensemble of Deep Convolutional Neural Networks
    Shahraki, Amin
    Abbasi, Mahmoud
    Taherkordi, Amir
    Kaosar, Mohammed
    PROCEEDINGS OF THE 4TH FLEXNETS WORKSHOP ON FLEXIBLE NETWORKS, ARTIFICIAL INTELLIGENCE SUPPORTED NETWORK FLEXIBILITY AND AGILITY (FLEXNETS'21), 2021, : 38 - 43
  • [30] VEHICLE ACCIDENT AND TRAFFIC CLASSIFICATION USING DEEP CONVOLUTIONAL NEURAL NETWORKS
    Kumeda, Bulbula
    Zhang Fengli
    Oluwasanmi, Ariyo
    Owusu, Forster
    Assefa, Maregu
    Amenu, Temesgen
    2019 16TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICWAMTIP), 2019, : 323 - 328