A big-data processing framework for uncertainties in transportation data

被引:0
|
作者
Yang, Jie [1 ]
Ma, Jun [1 ]
机构
[1] Univ Wollongong, SMART Infrastruct Facil, Fac Engn & Informat Sci, Northfields Ave, Wollongong, NSW 2522, Australia
关键词
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Transportation infrastructure takes a primary role in urban development planning. To better facilitate or understand the infrastructure status and demands, a huge amount of transportation data such as traffic flow counts has been collected from numerous transportation monitoring systems. Making full use of harvested data samples to discover important patterns has become an increasingly appealing research topic, in which a sophisticated and uncertainty-processing framework is required. In this paper, a big-data processing framework is introduced to analyse the transportation data, particularly taking the classification problem of the parking occupation status as an illustrative example. Three modules are implemented to crawl the raw records, generate high-level features, and apply the machine learning algorithm for classification. In addition, the fuzzification algorithm is also introduced to quantify the key attributes of the data, which helps in removing the data redundancy and inconsistency. The proposed framework then is evaluated using a real-world dataset collected from twelve car parks in a university. Simulation results show that the proposed framework performs well with a convincing classification accuracy.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Data Modifications in Blockchain Architecture for Big-Data Processing
    Tulkinbekov, Khikmatullo
    Kim, Deok-Hwan
    SENSORS, 2023, 23 (21)
  • [2] Parallel Job Processing Technique for Real-time Big-Data Processing Framework
    Son, Jae Gi
    Kang, Ji-Woo
    An, Jae-Hoon
    Ahn, Hyung-Joo
    Chun, Hyo-Jung
    Kim, Jung-Guk
    2016 RESEARCH IN ADAPTIVE AND CONVERGENT SYSTEMS, 2016, : 226 - 229
  • [3] Enabling Scientific Data Storage and Processing on Big-data Systems
    Biookaghazadeh, Saman
    Xu, Yiqi
    Zhou, Shujia
    Zhao, Ming
    PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 1978 - 1984
  • [4] Application of Open-Source Big-Data Framework in Marine Information Processing
    Gao, Xiaoxing
    Wang, Hanxin
    Li, Xiaoxia
    JOURNAL OF COASTAL RESEARCH, 2019, : 187 - 190
  • [5] Analysis and Optimization of Big-Data Stream Processing
    Vakilinia, Shahin
    Zhang, Xinyao
    Qiu, Dongyu
    2016 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2016,
  • [6] Kaleido: Enabling Efficient Scientific Data Processing on Big-Data Systems
    Biookaghazadeh, Saman
    Zhou, Shujia
    Zhao, Ming
    2017 INTERNATIONAL CONFERENCE ON NETWORKING, ARCHITECTURE, AND STORAGE (NAS), 2017, : 121 - 130
  • [7] SPBD:Streamlining Big-Data Processing in Cloud Environments
    Tung Nguyen
    Jingwen Zhang
    Weisong Shi
    ZTECommunications, 2013, 11 (02) : 30 - 37
  • [8] Big-Data Framework for Electric Vehicle Range Estimation
    Rahimi-Eichi, Habiballah
    Chow, Mo-Yuen
    IECON 2014 - 40TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2014, : 5628 - 5634
  • [9] Big-Data Processing Techniques and Their Challenges in Transport Domain
    Aftab Ahmed Chandio
    Nikos Tziritas
    Cheng-Zhong Xu
    ZTE Communications, 2015, 13 (01) : 50 - 59
  • [10] A Framework for Aligning Big-Data Projects with Organizational Strategy
    Lakoju, Mike
    Serrano, Alan
    AMCIS 2017 PROCEEDINGS, 2017,