StructMesh: A storage framework for serverless computing continuum

被引:2
|
作者
Carrizales-Espinoza, Diana [1 ]
Sanchez-Gallegos, DanteD. [2 ]
Gonzalez-Compean, J. L. [2 ]
Carretero, Jesus [2 ]
机构
[1] Cinvestav Tamaulipas, Carretera Victoria Soto Marina KM 5-5, Victoria 87130, Tamaulipas, Mexico
[2] Univ Carlos III Madrid, Ave Univ 30, Leganes 28911, Madrid, Spain
关键词
Storage services; Serverless; Computing continuum; Non-functional requirements; Cloud storage; HEALTH DATA; SCIENCE; SERVICE;
D O I
10.1016/j.future.2024.05.033
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Computing continuum is becoming a solution for organizations to process and analyze data for supporting decision -making processes. In this context, serverless paradigm is arising as a solution to manage continuum computing. However, the management of data storage still represents an obstacle for integrating continuum computing and serverless paradigms into a single solution, as this has to be performed transparently to users through multiple infrastructures. This paper presents StructMesh, a storage framework for serverless continuum systems. This framework is based on a processing plane where functions are managed as patterns, and a data plane based on storage meshes that represent maps of storage resources available in a given infrastructure. The logical interconnection of storage meshes enables organizations to integrate storage resources into a single unified storage service, which creates data exchange channels for continuum processing throughout multiple infrastructures. These meshes include load -balancing and data allocation/location algorithms for transparently and automatically managing the inputs/outputs of functions throughout these channels, as well as non-functional requirement schemes for organizations to manage sensitive data. We developed a framework prototype that harmonizes processing serverless functions with storage functions for building serverless pipeline services. A case study was conducted by using these services for processing meteorological and earth observation data throughout multiple infrastructures. The evaluation revealed the efficiency of StructMesh when managing data through fog and cloud infrastructures. It also showed the feasibility of StructMesh to create and enable continuum data exchange channels for serverless pipelines.
引用
收藏
页码:353 / 369
页数:17
相关论文
共 50 条
  • [1] Serverless computing in the cloud-to-edge continuum
    Puliafito, Carlo
    Rana, Omer
    Bittencourt, Luiz F.
    Wu, Hao
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 161 : 514 - 517
  • [2] GPU Enabled Serverless Computing Framework
    Kim, Jaewook
    Jun, Tae Joon
    Kang, Daeyoun
    Kim, Dohyeun
    Kim, Daeyoung
    2018 26TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP 2018), 2018, : 533 - 540
  • [3] Enhancing Observability of Serverless Computing with the Serverless Application Analytics Framework
    Cordingly, Robert
    Heydari, Navid
    Yu, Hanfei
    Hoang, Varik
    Sadeghi, Zohreh
    Lloyd, Wes
    COMPANION OF THE ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING, ICPE 2021, 2021, : 161 - 164
  • [4] Serverless Workflow Management on the Computing Continuum: A Mini-Survey
    Farahani, Reza
    Loh, Frank
    Roman, Dumitru
    Prodan, Radu
    COMPANION OF THE 15TH ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING, ICPE COMPANION 2024, 2024, : 146 - 150
  • [5] Designing a Sustainable Serverless Graph Processing Tool on the Computing Continuum
    Farahani, Reza
    Ristov, Sashko
    Prodan, Radu
    EURO-PAR 2023: PARALLEL PROCESSING WORKSHOPS, PT II, EURO-PAR 2023, 2024, 14352 : 210 - 214
  • [6] Intent-driven orchestration of serverless applications in the computing continuum
    Filinis, Nikos
    Tzanettis, Ioannis
    Spatharakis, Dimitrios
    Fotopoulou, Eleni
    Dimolitsas, Ioannis
    Zafeiropoulos, Anastasios
    Vassilakis, Constantinos
    Papavassiliou, Symeon
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 154 : 72 - 86
  • [7] Practical cloud storage auditing using serverless computing
    Fei CHEN
    Jianquan CAI
    Tao XIANG
    Xiaofeng LIAO
    Science China(Information Sciences), 2024, 67 (03) : 33 - 47
  • [8] YASF: A Vendor-Agnostic Framework for Serverless Computing
    Giacomini, Mikael
    Ullah, Amjad
    PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND SERVICES SCIENCE, CLOSER 2023, 2023, : 46 - 56
  • [9] Serverless Management of Sensing Systems for Fog Computing Framework
    Sarkar, Suvajit
    Wankar, Rajeev
    Srirama, Satish Narayana
    Suryadevara, Nagender Kumar
    IEEE SENSORS JOURNAL, 2020, 20 (03) : 1564 - 1572
  • [10] Practical cloud storage auditing using serverless computing
    Chen, Fei
    Cai, Jianquan
    Xiang, Tao
    Liao, Xiaofeng
    SCIENCE CHINA-INFORMATION SCIENCES, 2024, 67 (03)