Traffic Network Flow Prediction Using Parallel Training for Deep Convolutional Neural Networks on Spark Cloud

被引:32
|
作者
Zhang, Yongnan [1 ]
Zhou, Yonghua [1 ]
Lu, Huapu [2 ]
Fujita, Hamido [3 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] Tsinghua Univ, Inst Transportat Engn, Beijing 100084, Peoples R China
[3] Iwate Prefectural Univ, Fac Software & Informat Sci, Takizawa 0200193, Japan
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Training; Predictive models; Data models; Feature extraction; Computational modeling; Cloud computing; Prediction algorithms; Deep convolutional neural networks (DCNNs); parallel training; Spark cloud computing; traffic big data; traffic network flow prediction; SYSTEM; MODEL; SVR;
D O I
10.1109/TII.2020.2976053
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traffic flow in a road network is mutually interactive and interdependent with each other. It is challenging to describe the dynamics of traffic network flow by using analytical methods. In this article, the deep convolutional neural network (DCNN) model is employed to address traffic network flow prediction. To improve the parameter learning efficiency confronting traffic big data, a parallel training approach is developed for the DCNN prediction model. The theoretical foundation is developed for the parallel training algorithm of the DCNN model. A master-slave parallel computing solution for traffic network flow prediction is implemented on the Spark cloud. Real data of traffic network flow are applied to verify the effectiveness of the DCNN prediction model and the parallel training algorithm. The experimental results demonstrate that the DCNN prediction model for traffic network flow outperforms the typical prediction models based on backpropagation neural networks, support vector regressions, radial basis functions, and decision tree regressions. The proposed parallel training method can improve the training efficiency and obtain global features of the entire dataset from local learning with regard to the respective data subsets.
引用
收藏
页码:7369 / 7380
页数:12
相关论文
共 50 条
  • [41] Video source traffic flow prediction using neural networks
    Bhattacharya, A
    Parlos, AG
    Atiya, AF
    PROCEEDINGS OF THE 46TH IEEE INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS & SYSTEMS, VOLS 1-3, 2003, : 33 - 38
  • [42] Traffic Flow Prediction Using Graph Convolution Neural Networks
    Agafonov, Anton
    2020 10TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST), 2020, : 91 - 95
  • [43] Deep Convolutional Neural Networks with Random Subspace Learning for Short-term Traffic Flow Prediction with Incomplete Data
    Liao, Shijie
    Chen, Jing
    Hou, Jiaxin
    Xiong, Qingyu
    Wen, Junhao
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [44] Exploring spatial-temporal relations via deep convolutional neural networks for traffic flow prediction with incomplete data
    Deng, Shaojiang
    Jia, Shuyuan
    Chen, Jing
    APPLIED SOFT COMPUTING, 2019, 78 : 712 - 721
  • [45] Dynamic prediction of traffic flow by using backpropagation neural network
    Zhu, Z
    Yang, ZS
    TRAFFIC AND TRANSPORTATION STUDIES, 1998, : 548 - 555
  • [46] Study on traffic flow prediction using RBF neural network
    Xiao, JM
    Wang, XH
    PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2004, : 2672 - 2675
  • [47] Traffic Scene Semantic Segmentation by Using Several Deep Convolutional Neural Networks
    Kherraki, Amine
    Maqbool, Muaz
    El Ouazzani, Rajae
    2021 3RD IEEE MIDDLE EAST AND NORTH AFRICA COMMUNICATIONS CONFERENCE (MENACOMM), 2021, : 1 - 6
  • [48] Tropical Cyclone Intensity Prediction Using Deep Convolutional Neural Network
    Xu, Xiao-Yan
    Shao, Min
    Chen, Pu-Long
    Wang, Qin-Geng
    ATMOSPHERE, 2022, 13 (05)
  • [49] Deep spatio-temporal dependent convolutional LSTM network for traffic flow prediction
    Tang, Jie
    Zhu, Rong
    Wu, Fengyun
    He, Xuansen
    Huang, Jing
    Zhou, Xianlai
    Sun, Yishuai
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [50] Traffic Speed Prediction under Weekday Using Convolutional Neural Networks Concepts
    Song, Changhee
    Lee, Heeyun
    Kang, Changbeom
    Lee, Wonyoung
    Kim, Young B.
    Cha, Suk W.
    2017 28TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV 2017), 2017, : 1293 - 1298