Cost-Effective Data Analytics across Multiple Cloud Regions

被引:0
|
作者
Shu, Junyi [1 ]
Jin, Xin [1 ]
Ma, Yun [1 ]
Liu, Xuanzhe [1 ]
Huang, Gang [1 ]
机构
[1] Peking Univ, Beijing, Peoples R China
关键词
data analytics; cost optimization; job scheduling; multi-cloud;
D O I
10.1145/3472716.3472842
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose a cloud-native data analytics engine for processing data stored among geographically distributed cloud regions with reduced cost. A job is split into subtasks and placed across regions based on factors including prices of compute resources and data transmission. We present its architecture which leverages existing cloud infrastructures and discuss major challenges of its system design. Preliminary experiments show that the cost is reduced by 15.1% for a decision support query on a four-region public cloud setup.
引用
收藏
页码:1 / 3
页数:3
相关论文
共 50 条
  • [31] A cost-effective scheme supporting adaptive service migration in cloud data center
    Bing YU
    Yanni HAN
    Hanning YUAN
    Xu ZHOU
    Zhen XU
    Frontiers of Computer Science, 2015, 9 (06) : 875 - 886
  • [32] SPANStore: Cost-Effective Geo-Replicated Storage Spanning Multiple Cloud Services
    Wu, Zhe
    Butkiewicz, Michael
    Perkins, Dorian
    Katz-Bassett, Ethan
    Madhyastha, Harsha, V
    SOSP'13: PROCEEDINGS OF THE TWENTY-FOURTH ACM SYMPOSIUM ON OPERATING SYSTEMS PRINCIPLES, 2013, : 292 - 308
  • [33] CSPAN: Cost-Effective Geo-Replicated Storage Spanning Multiple Cloud Services
    Wu, Zhe
    Butkiewicz, Michael
    Perkins, Dorian
    Katz-Bassett, Ethan
    Madhyastha, Harsha V.
    ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2013, 43 (04) : 545 - 546
  • [34] Co-design Implications of Cost-effective On-demand Acceleration for Cloud Healthcare Analytics: The AEGLE approach
    Masouros, Dimosthenis
    Koliogeorgi, Konstantina
    Zervakis, Georgios
    Kosvyra, Alexandra
    Chytas, Achilleas
    Xydis, Sotirios
    Chouvarda, Ioanna
    Soudris, Dimitrios
    2019 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE), 2019, : 622 - 625
  • [35] Toward Cost-Effective Data Utopia
    Furnary, Anthony P.
    Grunkemeier, Gary L.
    ANNALS OF THORACIC SURGERY, 2010, 90 (04): : 1065 - 1066
  • [36] COST-EFFECTIVE CHROMATOGRAPHY DATA MANAGEMENT
    KOONTZ, AE
    AMERICAN LABORATORY, 1990, 22 (05) : 66 - &
  • [37] Cost-effective data center cooling
    Blough, Bob
    COMMUNICATIONS NEWS, 2008, 45 (10): : 10 - 10
  • [38] Combination Replicas Placements Strategy for Data sets from Cost-effective View in the Cloud
    Wu X.
    International Journal of Computational Intelligence Systems, 2017, 10 (1) : 521 - 539
  • [39] A new cost-effective mechanism for VM-to-user mapping in cloud data centers
    Adabi, Sepideh
    Hossein-Haje, Zahra
    Adabi, Sahar
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2020, 23 (04): : 2425 - 2451
  • [40] Cost-effective Big Data Mining in the Cloud: A Case Study with K-means
    He, Qiang
    Zhu, Xiaodong
    Li, Dongwei
    Wang, Shuliang
    Shen, Jun
    Yang, Yun
    2017 IEEE 10TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2017, : 74 - 81