Real-time identification of urban rainstorm waterlogging disasters based on Weibo big data

被引:0
|
作者
Yang Xiao
Beiqun Li
Zaiwu Gong
机构
[1] Nanjing University of Information Science and Technology,School of Management and Engineering
来源
Natural Hazards | 2018年 / 94卷
关键词
Urban rainstorm waterlogging disaster; Real-time identification; Micro-blogging data; Text classification;
D O I
暂无
中图分类号
学科分类号
摘要
With the acceleration of urbanisation in China, preventing and reducing the economic losses and casualties caused by urban rainstorm waterlogging disasters have become a critical and difficult issue that the government is concerned about. As urban storms are sudden, clustered, continuous, and cause huge economic losses, it is difficult to conduct emergency management. Developing a more scientific method for real-time disaster identification will help prevent losses over time. Examining social media big data is a feasible method for obtaining on-site disaster data and carrying out disaster risk assessments. This paper presents a real-time identification method for urban-storm disasters using Weibo data. Taking the June 2016 heavy rainstorm in Nanjing as an example, the obtained Weibo data are divided into eight parts for the training data set and two parts for the testing data set. It then performs text pre-processing using the Jieba segmentation module for word segmentation. Then, the term frequency–inverse document frequency method is used to calculate the feature items weights and extract the features. Hashing algorithms are introduced for processing high-dimensional sparse vector matrices. Finally, the naive Bayes, support vector machine, and random forest text classification algorithms are used to train the model, and a test set sample is introduced for testing the model to select the optimal classification algorithm. The experiments showed that the naive Bayes algorithm had the highest macro-average accuracy.
引用
收藏
页码:833 / 842
页数:9
相关论文
共 50 条
  • [11] Railway Big Data Real-time Processing Based on Storm
    Guo, Shihang
    Zhang, Lichen
    PROCEEDINGS OF THE 2016 2ND WORKSHOP ON ADVANCED RESEARCH AND TECHNOLOGY IN INDUSTRY APPLICATIONS, 2016, 81 : 536 - 539
  • [12] Real-Time Waterlogging Monitoring on Urban Roads Using Edge Computing
    Sheng, Zheng
    Chen, Fan
    Liu, QiCheng
    Gao, BaoHua
    Zhang, Jiajun
    Zhao, Kang
    Liu, QingShan
    Zang, Ying
    WATER RESOURCES MANAGEMENT, 2025,
  • [13] Deriving Real-time City Crowd Flows by Heterogeneous Big Urban Data
    Tang, Bo
    Yang, Chuan
    Xiang, Long
    Zeng, Jian
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 3485 - 3494
  • [14] Real-time Driver Identification using Vehicular Big Data and Deep Learning
    Jeong, Daun
    Kim, MinSeok
    Kim, KyungTaek
    Kim, TaeWang
    Jin, JiHun
    Lee, ChungSu
    Lim, Sejoon
    2018 21ST INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2018, : 123 - 130
  • [15] A survey on data stream, big data and real-time
    Gomes E.H.A.
    Plentz P.D.M.
    De Rolt C.R.
    Dantas M.A.R.
    International Journal of Networking and Virtual Organisations, 2019, 20 (02) : 143 - 167
  • [16] Platform for real-time data analysis and visualization based on Big Data methods
    Ferreira, Gabriel
    Alves, Paulo
    de Almeida, Simone
    PROCEEDINGS OF 2021 16TH IBERIAN CONFERENCE ON INFORMATION SYSTEMS AND TECHNOLOGIES (CISTI'2021), 2021,
  • [17] Urban rainstorm waterlogging risk assessment based on grey-AHP
    1600, AMSE Press, 16 Avenue Grauge Blanche, Tassin-la-Demi-Lune, 69160, France (78):
  • [18] Risk Assessment of Rainstorm Waterlogging in New District Based on MIKE Urban
    Wang, Ying
    Luan, Qinghua
    Wang, Haichao
    Liu, Jiahong
    Ma, Jun
    SUSTAINABLE DEVELOPMENT OF WATER RESOURCES AND HYDRAULIC ENGINEERING IN CHINA, 2019, : 29 - 40
  • [19] Real-time stream processing for Big Data
    Wingerath, Wolfram
    Gessert, Felix
    Friedrich, Steffen
    Ritter, Norbert
    IT-INFORMATION TECHNOLOGY, 2016, 58 (04): : 186 - 194
  • [20] Real-time processing of streaming big data
    Safaei, Ali A.
    REAL-TIME SYSTEMS, 2017, 53 (01) : 1 - 44