Cost-Effective Data Analytics across Multiple Cloud Regions

被引:0
|
作者
Shu, Junyi [1 ]
Jin, Xin [1 ]
Ma, Yun [1 ]
Liu, Xuanzhe [1 ]
Huang, Gang [1 ]
机构
[1] Peking Univ, Beijing, Peoples R China
关键词
data analytics; cost optimization; job scheduling; multi-cloud;
D O I
10.1145/3472716.3472842
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose a cloud-native data analytics engine for processing data stored among geographically distributed cloud regions with reduced cost. A job is split into subtasks and placed across regions based on factors including prices of compute resources and data transmission. We present its architecture which leverages existing cloud infrastructures and discuss major challenges of its system design. Preliminary experiments show that the cost is reduced by 15.1% for a decision support query on a four-region public cloud setup.
引用
收藏
页码:1 / 3
页数:3
相关论文
共 50 条
  • [41] Combination Replicas Placements Strategy for Data sets from Cost-effective View in the Cloud
    Wu, Xiuguo
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2017, 10 (01) : 521 - 539
  • [42] On Achieving Cost-Effective Adaptive Cloud Gaming in Geo-Distributed Data Centers
    Tian, Hao
    Wu, Di
    He, Jian
    Xu, Yuedong
    Chen, Min
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2015, 25 (12) : 2064 - 2077
  • [43] A new cost-effective mechanism for VM-to-user mapping in cloud data centers
    Sepideh Adabi
    Zahra Hossein-Haje
    Sahar Adabi
    Cluster Computing, 2020, 23 : 2425 - 2451
  • [44] Cost-Effective Traffic Scheduling For Cloud Resource Management
    Shareef, Zayd Ashraf
    Hussin, Masnida
    Abdullah, Azizol
    Muhammed, Abdullah
    2015 IEEE STUDENT CONFERENCE ON RESEARCH AND DEVELOPMENT (SCORED), 2015, : 189 - 194
  • [45] Cost-effective Reconfiguration for Multi-cloud Applications
    Parlavantzas, Nikos
    Linh Manh Pham
    Sinha, Arnab
    Morin, Christine
    2018 26TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP 2018), 2018, : 521 - 528
  • [46] Cost-Effective Service Provisioning for Hybrid Cloud Applications
    Liu, Fangming
    Luo, Bin
    Niu, Yipei
    MOBILE NETWORKS & APPLICATIONS, 2017, 22 (02): : 153 - 160
  • [47] A secure cost-effective migration of enterprise applications to the cloud
    Huang, Daochao
    Yi, Li
    Song, Fei
    Yang, Dong
    Zhang, Hongke
    INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2014, 27 (12) : 3996 - 4013
  • [48] Cost-Effective Cloud Edge Traffic Engineering with CASCARA
    Singh, Rachee
    Agarwal, Sharad
    Calder, Matt
    Bahl, Paramvir
    PROCEEDINGS OF THE 18TH USENIX SYMPOSIUM ON NETWORKED SYSTEM DESIGN AND IMPLEMENTATION, 2021, : 201 - 216
  • [49] ESTELLE: An Efficient and Cost-effective Cloud Log Engine
    Zhang, Yupu
    Cong, Guanglin
    Qu, Jihan
    Xu, Ran
    Fu, Yuan
    Li, Weiqi
    Hu, Feiran
    Liu, Jing
    Zhang, Wenliang
    Zheng, Kai
    COMPANION OF THE 2024 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, SIGMOD-COMPANION 2024, 2024, : 201 - 213
  • [50] Cost-effective routing as a service in sensor-cloud
    Sen, Biplab Kanti
    Sarkar, Anupam
    Khatua, Sunirmal
    Das, Rajib K.
    INTERNATIONAL JOURNAL OF SENSOR NETWORKS, 2020, 32 (01) : 42 - 53