Cost-Effective Data Analytics across Multiple Cloud Regions

被引：0

作者：

Shu, Junyi ^{[1
]}

Jin, Xin ^{[1
]}

Ma, Yun ^{[1
]}

Liu, Xuanzhe ^{[1
]}

Huang, Gang ^{[1
]}

机构：

[1] Peking Univ, Beijing, Peoples R China

来源：

PROCEEDINGS OF THE 2021 SIGCOMM 2021 POSTER AND DEMO SESSIONS, SIGCOMM 2021 DEMOS AND POSTERS | 2024年

关键词：

data analytics; cost optimization; job scheduling; multi-cloud;

D O I：

10.1145/3472716.3472842

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

We propose a cloud-native data analytics engine for processing data stored among geographically distributed cloud regions with reduced cost. A job is split into subtasks and placed across regions based on factors including prices of compute resources and data transmission. We present its architecture which leverages existing cloud infrastructures and discuss major challenges of its system design. Preliminary experiments show that the cost is reduced by 15.1% for a decision support query on a four-region public cloud setup.

引用

页码：1 / 3

页数：3

共 50 条

[21] PolarDBMS: Towards a Cost-Effective and Policy-Based Data Management in the Cloud
Fetai, Ilir
Brinkmann, Filip-M.
Schuldt, Heiko
2014 IEEE 30TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOPS (ICDEW), 2014, : 170 - 177
[22] A cost-effective scheme supporting adaptive service migration in cloud data center
Bing Yu
Yanni Han
Hanning Yuan
Xu Zhou
Zhen Xu
Frontiers of Computer Science, 2015, 9 : 875 - 886
[23] Achieving query performance in the cloud via a cost-effective data replication strategy
Tos, Uras
Mokadem, Riad
Hameurlain, Abdelkader
Ayav, Tolga
SOFT COMPUTING, 2021, 25 (07) : 5437 - 5454
[24] Cost-Effective, Workload-Adaptive Migration of Big Data Applications to the Cloud
Giannakouris, Victor
Fernandez, Alejandro
Simitsis, Alkis
Babu, Shivnath
SIGMOD '19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2019, : 1909 - 1912
[25] Achieving query performance in the cloud via a cost-effective data replication strategy
Uras Tos
Riad Mokadem
Abdelkader Hameurlain
Tolga Ayav
Soft Computing, 2021, 25 : 5437 - 5454
[26] Cost-Effective and Energy-Aware Resource Allocation in Cloud Data Centers
Sabyasachi, Abadhan Saumya
Muppala, Jogesh K.
ELECTRONICS, 2022, 11 (21)
[27] A cost-effective scheme supporting adaptive service migration in cloud data center
Yu, Bing
Han, Yanni
Yuan, Hanning
Zhou, Xu
Xu, Zhen
FRONTIERS OF COMPUTER SCIENCE, 2015, 9 (06) : 875 - 886
[28] Cost-effective Virtual Machine Image Replication Management for Cloud Data Centers
Shen, Dian
Dong, Fang
Zhang, Junxue
Luo, Junzhou
2014 IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, 2014 IEEE 6TH INTL SYMP ON CYBERSPACE SAFETY AND SECURITY, 2014 IEEE 11TH INTL CONF ON EMBEDDED SOFTWARE AND SYST (HPCC,CSS,ICESS), 2014, : 229 - 236
[29] Cutting the Unnecessary Long Tail: Cost-Effective Big Data Clustering in the Cloud
Li, Dongwei
Wang, Shuliang
Gao, Nan
He, Qiang
Yang, Yun
IEEE TRANSACTIONS ON CLOUD COMPUTING, 2022, 10 (01) : 292 - 303
[30] Data Sets Replicas Placements Strategy from Cost-Effective View in the Cloud
Wu, Xiuguo
SCIENTIFIC PROGRAMMING, 2016, 2016

← 1 2 3 4 5 →