SbMBR Tree-A Spatiotemporal Data Indexing and Compression Algorithm for Data Analysis and Mining

被引:1
|
作者
Guan, Runda [1 ]
Wang, Ziyu [1 ]
Pan, Xiaokang [1 ]
Zhu, Rongjie [2 ]
Song, Biao [3 ]
Zhang, Xinchang [4 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp Sci, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Teacher Educ, Nanjing 210044, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Software, Nanjing 210044, Peoples R China
[4] Nanjing Univ Informat Sci & Technol, Dept Sci & Technol, Nanjing 210044, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 19期
基金
美国国家科学基金会;
关键词
spatiotemporal data; lossy compression; data indexing; clustering; IMAGE;
D O I
10.3390/app131910562
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
In the field of data analysis and mining, adopting efficient data indexing and compression techniques to spatiotemporal data can significantly reduce computational and storage overhead for the abilities to control the volume of data and exploit the spatiotemporal characteristics. However, traditional lossy compression techniques are hardly suitable due to their inherently random nature. They often impose unpredictable damage to scientific data, which affects the results of data mining and analysis tasks that require certain precision. In this paper, we propose a similarity-based minimum bounding rectangle (SbMBR) tree, a tree-based indexing and compression method, to address the aforementioned problem. Our method can hierarchically select appropriate minimum bounding rectangles according to the given maximum acceptable errors and use the average value contained in each selected MBR to replace the original data to achieve data compression with multi-layer loss control. This paper also provides the corresponding tree construction algorithm and range query processing algorithm for the indexing structure mentioned above. To evaluate the data quality preservation in cross-domain data analysis and mining scenarios, we use mutual information as the estimation metric. Experimental results emphasize the superiority of our method over some of the typical indexing and compression algorithms.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Novel Data Compression Algorithm for Process Data
    Purohit, Amit
    2014 IEEE CONFERENCE ON CONTROL APPLICATIONS (CCA), 2014, : 784 - 789
  • [42] A Novel Data Compression Algorithm for Dynamic Data
    Gupta, Rahul
    Gupta, Ashutosh
    Agarwal, Suneeta
    2008 IEEE REGION 8 INTERNATIONAL CONFERENCE ON COMPUTATIONAL TECHNOLOGIES IN ELECTRICAL AND ELECTRONICS ENGINEERING: SIBIRCON 2008, PROCEEDINGS, 2008, : 266 - +
  • [43] A data mining algorithm for fuzzy transaction data
    Chin-Yuan Chen
    Gin-Shuh Liang
    Yuhling Su
    Mao-Sheng Liao
    Quality & Quantity, 2014, 48 : 2963 - 2971
  • [44] A data mining algorithm for fuzzy transaction data
    Chen, Chin-Yuan
    Liang, Gin-Shuh
    Su, Yuhling
    Liao, Mao-Sheng
    QUALITY & QUANTITY, 2014, 48 (06) : 2963 - 2971
  • [45] Data Mining And Analysis Of Our Agriculture Based On The Decision Tree
    Gao Yi-yang
    Ren Nan-ping
    2009 ISECS INTERNATIONAL COLLOQUIUM ON COMPUTING, COMMUNICATION, CONTROL, AND MANAGEMENT, VOL II, 2009, : 134 - +
  • [46] Case study: Visualization for decision tree analysis in data mining
    Barlow, T
    Neville, P
    IEEE SYMPOSIUM ON INFORMATION VISUALIZATION 2001, PROCEEDINGS, 2001, : 149 - 152
  • [47] Spatiotemporal Clustering Analysis of Bicycle Sharing System with Data Mining Approach
    Ma, Xinwei
    Cao, Ruiming
    Jin, Yuchuan
    INFORMATION, 2019, 10 (05):
  • [48] Efficient data compression algorithm for data loggers, measurement equipment and remote data analysis applications
    Kovac, M
    PROCEEDINGS IEEE SOUTHEASTCON '98: ENGINEERING FOR A NEW ERA, 1998, : 47 - 48
  • [49] The improvement of fuzzy cluster analysis algorithm in data mining
    Xia, Xiaogang
    Yang, Yunfeng
    International Journal of Applied Mathematics and Statistics, 2013, 51 (21): : 254 - 261
  • [50] Study on Data Compression Algorithm Based on Semantic Analysis
    Hong, Qi
    Lu, Xiaolei
    MATERIALS, MECHANICAL AND MANUFACTURING ENGINEERING, 2014, 842 : 712 - 716