Traffic Network Flow Prediction Using Parallel Training for Deep Convolutional Neural Networks on Spark Cloud

被引:32
|
作者
Zhang, Yongnan [1 ]
Zhou, Yonghua [1 ]
Lu, Huapu [2 ]
Fujita, Hamido [3 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] Tsinghua Univ, Inst Transportat Engn, Beijing 100084, Peoples R China
[3] Iwate Prefectural Univ, Fac Software & Informat Sci, Takizawa 0200193, Japan
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Training; Predictive models; Data models; Feature extraction; Computational modeling; Cloud computing; Prediction algorithms; Deep convolutional neural networks (DCNNs); parallel training; Spark cloud computing; traffic big data; traffic network flow prediction; SYSTEM; MODEL; SVR;
D O I
10.1109/TII.2020.2976053
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traffic flow in a road network is mutually interactive and interdependent with each other. It is challenging to describe the dynamics of traffic network flow by using analytical methods. In this article, the deep convolutional neural network (DCNN) model is employed to address traffic network flow prediction. To improve the parameter learning efficiency confronting traffic big data, a parallel training approach is developed for the DCNN prediction model. The theoretical foundation is developed for the parallel training algorithm of the DCNN model. A master-slave parallel computing solution for traffic network flow prediction is implemented on the Spark cloud. Real data of traffic network flow are applied to verify the effectiveness of the DCNN prediction model and the parallel training algorithm. The experimental results demonstrate that the DCNN prediction model for traffic network flow outperforms the typical prediction models based on backpropagation neural networks, support vector regressions, radial basis functions, and decision tree regressions. The proposed parallel training method can improve the training efficiency and obtain global features of the entire dataset from local learning with regard to the respective data subsets.
引用
收藏
页码:7369 / 7380
页数:12
相关论文
共 50 条
  • [1] Network Prediction with Traffic Gradient Classification using Convolutional Neural Networks
    Ko, Taejin
    Raza, Syed M.
    Dang Thien Binh
    Kim, Moonseong
    Choo, Hyunseung
    PROCEEDINGS OF THE 2020 14TH INTERNATIONAL CONFERENCE ON UBIQUITOUS INFORMATION MANAGEMENT AND COMMUNICATION (IMCOM), 2020,
  • [2] Deep Neural Networks for Traffic Flow Prediction
    Yi, Hongsuk
    Jung, HeeJin
    Bae, Sanghoon
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2017, : 328 - 331
  • [3] Cellular Traffic Prediction Using Deep Convolutional Neural Network with Attention Mechanism
    Wang, Zihuan
    Wong, Vincent W. S.
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 2339 - 2344
  • [4] Traffic State Prediction using Convolutional Neural Network
    Toncharoen, Ratchanon
    Piantanakulchai, Mongkut
    2018 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER SCIENCE AND SOFTWARE ENGINEERING (JCSSE), 2018, : 250 - 255
  • [5] Urban Traffic Flow Prediction with Deep Neural Network
    Yang, Jin
    SECURITY AND COMMUNICATION NETWORKS, 2022, 2022
  • [6] City-Wide Traffic Flow Forecasting Using a Deep Convolutional Neural Network
    Sun, Shangyu
    Wu, Huayi
    Xiang, Longgang
    SENSORS, 2020, 20 (02)
  • [7] Traffic Flow Prediction Using Neural Network
    Jiber, Mouna
    Lamouik, Imad
    Ali, Yahyaouy
    Sabri, My Abdelouahed
    2018 INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND COMPUTER VISION (ISCV2018), 2018,
  • [8] Traffic Data Imputation Using Deep Convolutional Neural Networks
    Benkraouda, Ouafa
    Thodi, Bilal Thonnam
    Yeo, Hwasoo
    Menendez, Monica
    Jabari, Saif Eddin
    IEEE ACCESS, 2020, 8 (08): : 104740 - 104752
  • [9] Network Traffic Prediction based on Diffusion Convolutional Recurrent Neural Networks
    Andreoletti, Davide
    Troia, Sebastian
    Musumeci, Francesco
    Giordano, Silvia
    Maier, Guido
    Tornatore, Massimo
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM 2019 WKSHPS), 2019, : 246 - 251
  • [10] Optical Network Traffic Prediction Based on Graph Convolutional Neural Networks
    Gui, Yihan
    Wang, Danshi
    Guan, Luyao
    Zhang, Min
    2020 OPTO-ELECTRONICS AND COMMUNICATIONS CONFERENCE (OECC 2020), 2020,