Ganos Aero: A Cloud-Native System for Big Raster Data Management and Processing

被引:1
|
作者
Xiao, Fei [1 ]
Xie, Jiong [1 ]
Chen, Zhida [1 ]
Li, Feifei [1 ]
Chen, Zhen [1 ]
Liu, Jianwei [1 ]
Liu, Yinpei [1 ]
机构
[1] Alibaba Grp, Hangzhou, Peoples R China
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2023年 / 16卷 / 12期
关键词
D O I
10.14778/3611540.3611597
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The development of Earth Observation technology contributes to the production of massive raster data. It is vital to manage and conduct analytical tasks on the raster data. Existing solutions employ dedicated systems for the raster data management and processing, respectively, incurring problems such as data redundancy, difficulty in updating, expensive data transferring and transformation, etc. To cope with these limitations, this demonstration presents Ganos Aero, a cloud-native system for big raster data management and processing. Ganos Aero proposes a unified raster data model for both the data management and processing, which stores a single copy of the raster data and without performing an expensive tiling procedure, and thus achieves significant improvement in the storage and updating efficiency. To enable efficient query and batch task processing, Ganos Aero implements an on-the-fly tile production mechanism, and optimizes its performance using the cloud features including decoupling compute from storage and pushing costly operations closer to the storage layer. Since deployed in Alibaba Cloud in 2022, Ganos Aero has been playing a critical role in many real applications including the modern agriculture, environment monitoring and protection, et al.
引用
收藏
页码:3966 / 3969
页数:4
相关论文
共 50 条
  • [1] Cloud-Native Repositories for Big Scientific Data
    Abernathey, Ryan P.
    Blackmon-Luca, Charles C.
    Crone, Timothy J.
    Henderson, Naomi
    Lepore, Chiara
    Augspurger, Tom
    Banihirwe, Anderson
    Gentemann, Chelle L.
    Hamman, Joseph J.
    Henderson, Naomi
    Lepore, Chiara
    McCaie, Theo A.
    Robinson, Niall H.
    Signell, Richard P.
    COMPUTING IN SCIENCE & ENGINEERING, 2021, 23 (02) : 26 - 35
  • [2] Cloud-Native Repositories for Big Scientific Data
    Abernathey, Ryan P.
    Augspurger, Tom
    Banihirwe, Anderson
    Blackmon-Luca, Charles C.
    Crone, Timothy J.
    Gentemann, Chelle L.
    Hamman, Joseph J.
    Henderson, Naomi
    Lepore, Chiara
    McCaie, Theo A.
    Robinson, Niall H.
    Signell, Richard P.
    Computing in Science and Engineering, 2021, 23 (02): : 26 - 35
  • [3] Distributed In Situ Processing of Big Raster Data in the Cloud
    Zalipynis, Ramon Antonio Rodriges
    PERSPECTIVES OF SYSTEM INFORMATICS, PSI 2017, 2018, 10742 : 337 - 351
  • [4] Ganos: A Multidimensional, Dynamic, and Scene-Oriented Cloud-Native Spatial Database Engine
    Xie, Jiong
    Chen, Zhen
    Liu, Jianwei
    Wang, Fang
    Li, Feifei
    Chen, Zhida
    Liu, Yinpei
    Cai, Songlu
    Fan, Zhenhua
    Xiao, Fei
    Chen, Yue
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2022, 15 (12): : 3483 - 3495
  • [5] State Management for Cloud-Native Applications
    Szalay, Mark
    Matray, Peter
    Toka, Laszlo
    ELECTRONICS, 2021, 10 (04) : 1 - 27
  • [6] A Cloud-Native Online Judge System
    Pan, Guan-Chen
    Liu, Pangfeng
    Wu, Jan-Jan
    2022 IEEE 46TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE (COMPSAC 2022), 2022, : 1293 - 1298
  • [7] Enabling Cloud-native IoT Device Management
    Nanos, Anastassios
    Plakas, Ioannis
    Ntoutsos, Georgios
    Mainas, Charalampos
    PROCEEDINGS OF THE 1ST INTERNATIONAL WORKSHOP ON METAOS FOR THE CLOUD-EDGE-IOT CONTINUUM, MECC 2024, 2024, : 42 - 47
  • [8] Autonomic Management Framework for Cloud-Native Applications
    Kosinska, Joanna
    Zielinski, Krzysztof
    JOURNAL OF GRID COMPUTING, 2020, 18 (04) : 779 - 796
  • [9] Autonomic Management Framework for Cloud-Native Applications
    Joanna Kosińska
    Krzysztof Zieliński
    Journal of Grid Computing, 2020, 18 : 779 - 796
  • [10] Ursa: Lightweight Resource Management for Cloud-Native Microservices
    Zhang, Yanqi
    Zhou, Zhuangzhuang
    Elnikety, Sameh
    Delimitrou, Christina
    2024 IEEE INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE COMPUTER ARCHITECTURE, HPCA 2024, 2024, : 954 - 969