Cocv: A compression algorithm for time-series data with continuous constant values in IoT-based monitoring systems

被引:2
|
作者
Lin, Shengsheng [1 ]
Lin, Weiwei [1 ,2 ]
Wu, Keyi [3 ]
Wang, Songbo [1 ]
Xu, Minxian [4 ]
Wang, James Z. [5 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[3] South China Normal Univ, Guangzhou 510631, Peoples R China
[4] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen, Peoples R China
[5] Clemson Univ, Sch Comp, Clemson, SC USA
基金
中国国家自然科学基金;
关键词
Compression algorithm; Internet of things; Time-series data; Continuous constant values; Gas-leak monitoring systems;
D O I
10.1016/j.iot.2023.101049
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sensor-generated time-series data now constitutes a significant and growing portion of the world's data due to the rapid proliferation of the Internet of Things (IoT). The transmission and storage of such voluminous data have emerged as enormous challenges. Data compression and reduction strategies have been instrumental in mitigating these challenges to some extent. However, they have exhibited limitations when applied to real-time IoT-based monitoring systems. This stems from their failure to adequately consider the stringent requirements of real-time data transmission and the continuous constant-value redundancy within periodic monitoring data. Consequently, we introduce a dedicated compression algorithm tailored specifically for time-series data within periodic IoT-based monitoring systems, namely Cocv. It takes advantage of the continuous constant-value repetition of the time-series data to compress data by discarding redundant data points. It can not only compress static batches of data but also dynamically compress data streams to improve system performance in real-time IoT-based monitoring systems. The offline Cocv outperforms traditional compressors on gas-leak monitoring data with a compression ratio of 98.5%, maintaining a decent speed for both compression and decompression. In an actual IoT-based gas-leak monitoring system, the online Cocv improves handling capacity by 255%, reading speed by 728%, reduces bandwidth consumption by 94%, and storage space consumption by 98% compared to the original scheme.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] IFRAT: An IoT Field Recognition Algorithm based on Time-series Data
    Guo, Shuai
    Guo, Zhongwen
    Qiu, Zhijin
    Liu, Yingjian
    Wang, Yu
    2017 3RD INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING AND COMMUNICATIONS (BIGCOM), 2017, : 251 - 255
  • [2] A new compression algorithm for spectral and time-series data
    Hawkins, SE
    Darlington, EH
    Cheng, AF
    Hayes, JR
    ACTA ASTRONAUTICA, 2003, 52 (2-6) : 487 - 492
  • [3] A novel clustering algorithm for time-series data based on precise correlation coefficient matching in the IoT
    Li, Haibo
    Tong, Juncheng
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2019, 16 (06) : 6654 - 6671
  • [4] Real-Time AI and IoT-Based Systems for Home Monitoring
    Alex, Adoumadji Benoudjita
    Hanyurwimfura, Damien
    Bakunzibake, Pierre
    PROCEEDINGS OF NINTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, VOL 10, ICICT 2024, 2025, 1055 : 415 - 426
  • [5] Detection of compression artifacts in time-series data from continuous glucose monitoring sensors using matched filters
    Idi, Elena
    Prendin, Francesco
    Facchinetti, Andrea
    Sparacino, Giovanni
    Del Favero, Simone
    2023 IEEE 19TH INTERNATIONAL CONFERENCE ON BODY SENSOR NETWORKS, BSN, 2023,
  • [6] Research on Monitoring Data Anomaly Recognition Algorithm Based on Time Series Compression and Segmentation
    Pu, Qianhui
    Zhang, Ziyi
    Xiao, Tugang
    Hong, Yu
    Wen, Xuguang
    Bridge Construction, 2024, 54 (03) : 15 - 23
  • [7] LSTM with spatiotemporal attention for IoT-based wireless sensor collected hydrological time-series forecasting
    Huang, Jianying
    Li, Jinhui
    Oh, Jeill
    Kang, Hoon
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (10) : 3337 - 3352
  • [8] LSTM with spatiotemporal attention for IoT-based wireless sensor collected hydrological time-series forecasting
    Jianying Huang
    Jinhui Li
    Jeill Oh
    Hoon Kang
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 3337 - 3352
  • [9] A clustering algorithm for detecting differential deviations in the multivariate time-series IoT data based on sensor relationship
    Idrees, Rabbia
    Maiti, Ananda
    Garg, Saurabh
    KNOWLEDGE AND INFORMATION SYSTEMS, 2025, 67 (03) : 2641 - 2690
  • [10] Multiple time series database on microservice architecture for IoT-based sleep monitoring system
    Eko Simanjuntak
    Nico Surantha
    Journal of Big Data, 9