Ganos Aero: A Cloud-Native System for Big Raster Data Management and Processing

被引:1
|
作者
Xiao, Fei [1 ]
Xie, Jiong [1 ]
Chen, Zhida [1 ]
Li, Feifei [1 ]
Chen, Zhen [1 ]
Liu, Jianwei [1 ]
Liu, Yinpei [1 ]
机构
[1] Alibaba Grp, Hangzhou, Peoples R China
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2023年 / 16卷 / 12期
关键词
D O I
10.14778/3611540.3611597
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The development of Earth Observation technology contributes to the production of massive raster data. It is vital to manage and conduct analytical tasks on the raster data. Existing solutions employ dedicated systems for the raster data management and processing, respectively, incurring problems such as data redundancy, difficulty in updating, expensive data transferring and transformation, etc. To cope with these limitations, this demonstration presents Ganos Aero, a cloud-native system for big raster data management and processing. Ganos Aero proposes a unified raster data model for both the data management and processing, which stores a single copy of the raster data and without performing an expensive tiling procedure, and thus achieves significant improvement in the storage and updating efficiency. To enable efficient query and batch task processing, Ganos Aero implements an on-the-fly tile production mechanism, and optimizes its performance using the cloud features including decoupling compute from storage and pushing costly operations closer to the storage layer. Since deployed in Alibaba Cloud in 2022, Ganos Aero has been playing a critical role in many real applications including the modern agriculture, environment monitoring and protection, et al.
引用
收藏
页码:3966 / 3969
页数:4
相关论文
共 50 条
  • [31] A Cloud-Native Monitoring System Enabling Scalable and Distributed Management of 5G Network Slices
    Sanabria-Russo, Luis
    Verikoukis, Christos
    2021 IEEE INTERNATIONAL MEDITERRANEAN CONFERENCE ON COMMUNICATIONS AND NETWORKING (IEEE MEDITCOM 2021), 2021, : 42 - 46
  • [32] Array DBMS and Satellite Imagery: Towards Big Raster Data in the Cloud
    Zalipynis, Ramon Antonio Rodriges
    Pozdeev, Evgeniy
    Bryukhov, Anton
    ANALYSIS OF IMAGES, SOCIAL NETWORKS AND TEXTS, AIST 2017, 2018, 10716 : 267 - 279
  • [33] Big Data Processing in Cloud Environments
    Tsuchiya, Satoshi
    Sakamoto, Yoshinori
    Tsuchimoto, Yuichi
    Lee, Vivian
    FUJITSU SCIENTIFIC & TECHNICAL JOURNAL, 2012, 48 (02): : 159 - 168
  • [34] Architecture of a time-sensitive provisioning system for cloud-native software
    Venkateswaran, Sreekrishnan
    Bauskar, Adwait
    Sarkar, Santonu
    SOFTWARE-PRACTICE & EXPERIENCE, 2022, 52 (05): : 1170 - 1198
  • [35] Building a modern data platform based on the data lakehouse architecture and cloud-native ecosystem
    Abouzaid, Ahmed
    Barclay, Peter J.
    Chrysoulas, Christos
    Pitropakis, Nikolaos
    DISCOVER APPLIED SCIENCES, 2025, 7 (03)
  • [36] SliceSphere: Agile Service Orchestration and Management Framework for Cloud-Native Application Slices
    Habibi, Pooyan
    Leon-Garcia, Alberto
    IEEE ACCESS, 2024, 12 : 169024 - 169049
  • [37] Critical Technologies and Service Approaches for Cloud-Native Geospatial Knowledge Base Management
    Zhong, Teng
    Zhang, Xueying
    Xu, Pei
    Cao, Min
    Chen, Biyu
    Liu, Qiliang
    Wang, Shu
    Yang, Yizhou
    Journal of Geo-Information Science, 2024, 26 (09) : 2013 - 2025
  • [38] Toward Cloud-Native VNFs: An ETSI NFV Management and Orchestration Standards Approach
    Aelken J.
    Triay J.
    Chatras B.
    De Nicolas A.M.
    IEEE Communications Standards Magazine, 2024, 8 (02): : 12 - 19
  • [39] Dataset Placement and Data Loading Optimizations for Cloud-Native Deep Learning Workloads
    Kang, Zhuangwei
    Min, Ziran
    Zhou, Shuang
    Barve, Yogesh D.
    Gokhale, Aniruddha
    2023 IEEE 26TH INTERNATIONAL SYMPOSIUM ON REAL-TIME DISTRIBUTED COMPUTING, ISORC, 2023, : 107 - 116
  • [40] Big Data Management and Processing in the Context of the System Wide Information Management
    Leite, Alessandro Ferreira
    Li Weigang
    Fregnani, Jose Alexandre
    de Oliveira, Italo Romani
    2017 IEEE 20TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2017,