AQUAdexIM: highly efficient in-memory indexing and querying of astronomy time series images

被引:7
|
作者
Hong, Zhi [2 ]
Yu, Ce [1 ]
Wang, Jie [1 ]
Xiao, Jian [2 ]
Cui, Chenzhou [3 ]
Sun, Jizhou [1 ]
机构
[1] Tianjin Univ, Sch Comp Sci & Technol, Tianjin 300350, Peoples R China
[2] Tianjin Univ, Sch Comp Software, Tianjin 300350, Peoples R China
[3] Chinese Acad Sci, Natl Astron Observ, Beijing 100012, Peoples R China
基金
中国国家自然科学基金;
关键词
Pseudo-sphere index; Astronomy big data; Time series images; FITS file; In-memory database;
D O I
10.1007/s10686-016-9515-0
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
Astronomy has always been, and will continue to be, a data-based science, and astronomers nowadays are faced with increasingly massive datasets, one key problem of which is to efficiently retrieve the desired cup of data from the ocean. AQUAdexIM, an innovative spatial indexing and querying method, performs highly efficient on-the-fly queries under users' request to search for Time Series Images from existing observation data on the server side and only return the desired FITS images to users, so users no longer need to download entire datasets to their local machines, which will only become more and more impractical as the data size keeps increasing. Moreover, AQUAdexIM manages to keep a very low storage space overhead and its specially designed in-memory index structure enables it to search for Time Series Images of a given area of the sky 10 times faster than using Redis, a state-of-the-art in-memory database.
引用
收藏
页码:387 / 405
页数:19
相关论文
共 50 条
  • [1] AQUAdexIM: highly efficient in-memory indexing and querying of astronomy time series images
    Zhi Hong
    Ce Yu
    Jie Wang
    Jian Xiao
    Chenzhou Cui
    Jizhou Sun
    Experimental Astronomy, 2016, 42 : 387 - 405
  • [2] MESSI: In-Memory Data Series Indexing
    Peng, Botao
    Fatourou, Panagiota
    Palpanas, Themis
    2020 IEEE 36TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2020), 2020, : 337 - 348
  • [3] Fast data series indexing for in-memory data
    Botao Peng
    Panagiota Fatourou
    Themis Palpanas
    The VLDB Journal, 2021, 30 : 1041 - 1067
  • [4] Fast data series indexing for in-memory data
    Peng, Botao
    Fatourou, Panagiota
    Palpanas, Themis
    VLDB JOURNAL, 2021, 30 (06): : 1041 - 1067
  • [5] Massively Distributed Time Series Indexing and Querying
    Yagoubi, Djamel-Edine
    Akbarinia, Reza
    Masseglia, Florent
    Palpanas, Themis
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2020, 32 (01) : 108 - 120
  • [6] Efficient In-Memory Indexing of Network-Constrained Trajectories
    Krogh, Benjamin
    Jensen, Christian S.
    Torp, Kristian
    24TH ACM SIGSPATIAL INTERNATIONAL CONFERENCE ON ADVANCES IN GEOGRAPHIC INFORMATION SYSTEMS (ACM SIGSPATIAL GIS 2016), 2016,
  • [7] In-Memory Search for Highly Efficient Image Retrieval
    Yu, Yingjie
    Yang, Ling
    Zhou, Houji
    Zhao, Ruizhe
    Li, Yi
    Tong, Hao
    Miao, Xiangshui
    ADVANCED INTELLIGENT SYSTEMS, 2023, 5 (03)
  • [8] FluteDB: An efficient and scalable in-memory time series database for sensor-cloud
    Li, Chen
    Li, Bo
    Bhuiyan, Md Zakirul Alam
    Wang, Lihong
    Si, Jinghui
    Wei, Guanyu
    Li, Jianxin
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2018, 122 : 95 - 108
  • [9] Indexing and querying constantly evolving data using time series analysis
    Xia, YN
    Prabhakar, S
    Sun, JZ
    Lei, S
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, PROCEEDINGS, 2005, 3453 : 637 - 648
  • [10] Indexing high-dimensional data for efficient in-memory similarity search
    Cui, B
    Ooi, BC
    Su, JW
    Tan, KL
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (03) : 339 - 353