Ganos Aero: A Cloud-Native System for Big Raster Data Management and Processing

被引:1
|
作者
Xiao, Fei [1 ]
Xie, Jiong [1 ]
Chen, Zhida [1 ]
Li, Feifei [1 ]
Chen, Zhen [1 ]
Liu, Jianwei [1 ]
Liu, Yinpei [1 ]
机构
[1] Alibaba Grp, Hangzhou, Peoples R China
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2023年 / 16卷 / 12期
关键词
D O I
10.14778/3611540.3611597
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The development of Earth Observation technology contributes to the production of massive raster data. It is vital to manage and conduct analytical tasks on the raster data. Existing solutions employ dedicated systems for the raster data management and processing, respectively, incurring problems such as data redundancy, difficulty in updating, expensive data transferring and transformation, etc. To cope with these limitations, this demonstration presents Ganos Aero, a cloud-native system for big raster data management and processing. Ganos Aero proposes a unified raster data model for both the data management and processing, which stores a single copy of the raster data and without performing an expensive tiling procedure, and thus achieves significant improvement in the storage and updating efficiency. To enable efficient query and batch task processing, Ganos Aero implements an on-the-fly tile production mechanism, and optimizes its performance using the cloud features including decoupling compute from storage and pushing costly operations closer to the storage layer. Since deployed in Alibaba Cloud in 2022, Ganos Aero has been playing a critical role in many real applications including the modern agriculture, environment monitoring and protection, et al.
引用
收藏
页码:3966 / 3969
页数:4
相关论文
共 50 条
  • [21] Research of Cloud-Native AS/RS Warehouse Management and Control Platform Architecture
    Chen, Chuanjun
    Liu, Junjie
    2024 5TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATION, ICCEA 2024, 2024, : 277 - 285
  • [22] Dynamic Resource Management Scheme for Digital Twin on Cloud-Native Computing
    Kim, Gi Tae
    Jeong, Byeonghui
    Jeong, Young-Sik
    HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES, 2025, 15
  • [23] Dynamic Resource Management for Cloud-native Bulk Synchronous Parallel Applications
    Wang, Evan
    Barve, Yogesh
    Gokhale, Aniruddha
    Sun, Hongyang
    2023 IEEE 26TH INTERNATIONAL SYMPOSIUM ON REAL-TIME DISTRIBUTED COMPUTING, ISORC, 2023, : 152 - 157
  • [24] A Memory Management Method for Raster Data Processing
    Wang, Chao
    Yan, Zeyu
    Chen, Jizhou
    PROCEEDINGS OF 2014 IEEE INTERNATIONAL CONFERENCE ON PROGRESS IN INFORMATICS AND COMPUTING (PIC), 2014, : 390 - 394
  • [25] A Retrospective on Workload Identifiers: From Data Center to Cloud-Native Networks
    Babakian, Andrew
    Monclus, Pere
    Braun, Robin
    Lipman, Justin
    IEEE ACCESS, 2022, 10 : 105518 - 105527
  • [26] A Holistic Approach to Data Access for Cloud-Native Analytics and Machine Learning
    Koutsovasilis, Panos
    Venugopal, Srikumar
    Gkoufas, Yiannis
    Pinto, Christian
    2021 IEEE 14TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD 2021), 2021, : 654 - 659
  • [27] AMANOS: An Intent-Driven Management and Orchestration System for Next-Generation Cloud-Native Networks
    Boutouchent, Akram
    Meridja, Abdellah N.
    Kardjadja, Youcef
    Maia, Adyson M.
    Ghamri-Doudane, Yacine
    Koudil, Mouloud
    Glitho, Roch H.
    Elbiaze, Halima
    IEEE COMMUNICATIONS MAGAZINE, 2024, 62 (06) : 42 - 49
  • [28] BIG DATA PROCESSING TUNING IN THE CLOUD
    Sabharwal, Satwik
    Malhotra, Nishchay
    Singh, Ajay Shanker
    2015 INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION & AUTOMATION (ICCCA), 2015, : 699 - 703
  • [29] Model of Point Cloud Data Management System in Big Data Paradigm
    Pajic, Vladimir
    Govedarica, Miro
    Amovic, Mladen
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2018, 7 (07)
  • [30] Cloud Computing for Big Data Processing
    Li, Xiaofang
    Zhuang, Yanbin
    Yang, Simon X.
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2017, 23 (04): : 545 - 546