Cost-Effective Data Analytics across Multiple Cloud Regions

被引：0

作者：

Shu, Junyi ^{[1
]}

Jin, Xin ^{[1
]}

Ma, Yun ^{[1
]}

Liu, Xuanzhe ^{[1
]}

Huang, Gang ^{[1
]}

机构：

[1] Peking Univ, Beijing, Peoples R China

来源：

PROCEEDINGS OF THE 2021 SIGCOMM 2021 POSTER AND DEMO SESSIONS, SIGCOMM 2021 DEMOS AND POSTERS | 2024年

关键词：

data analytics; cost optimization; job scheduling; multi-cloud;

D O I：

10.1145/3472716.3472842

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

We propose a cloud-native data analytics engine for processing data stored among geographically distributed cloud regions with reduced cost. A job is split into subtasks and placed across regions based on factors including prices of compute resources and data transmission. We present its architecture which leverages existing cloud infrastructures and discuss major challenges of its system design. Preliminary experiments show that the cost is reduced by 15.1% for a decision support query on a four-region public cloud setup.

引用

页码：1 / 3

页数：3

共 50 条

[1] Cost-Effective Cloud Server Provisioning for Predictable Performance of Big Data Analytics
Xu, Fei
Zheng, Haoyue
Jiang, Huan
Shao, Wujie
Liu, Haikun
Zhou, Zhi
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (05) : 1036 - 1051
[2] Needle in A Haystack: Cost-Effective Data Analytics for Real-Time Cloud Sharing
Hua, Yu
Feng, Dan
2014 IEEE 22ND INTERNATIONAL SYMPOSIUM OF QUALITY OF SERVICE (IWQOS), 2014, : 159 - 167
[3] Online algorithms for cost-effective cloud selection with multiple demands
Jin, Youngmi
Hayashi, Michiaki
Tagami, Atsushi
PROCEEDINGS OF THE 2018 30TH INTERNATIONAL TELETRAFFIC CONGRESS (ITC 30), VOL 1, 2018, : 37 - 45
[4] OCEDS: Optimal Cost-Effective Data Storage in Cloud Data Centers
Arunambika, T.
Vadivu, Senthil P.
INTERNATIONAL JOURNAL OF DISTRIBUTED SYSTEMS AND TECHNOLOGIES, 2021, 12 (03) : 48 - 63
[5] Cost-Effective Acquisition of First-Party Data for Business Analytics
Liu, Xiaoping
Li, Xiao-Bai
INFORMS JOURNAL ON COMPUTING, 2024, 36 (05) : 1242 - 1260
[6] Towards Cost-Effective Cloud Downloading with Tencent Big Data
Li, Zhen-Hua
Liu, Gang
Ji, Zhi-Yuan
Zimmermann, Roger
JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2015, 30 (06) : 1163 - 1174
[7] Cost-effective data replication mechanism modelling for cloud storage
Zaman, Khalid
Hussain, Altaf
Imran, Muhammad
Sohail, Muhammad
INTERNATIONAL JOURNAL OF GRID AND UTILITY COMPUTING, 2022, 13 (06) : 652 - 669
[8] Challenges of Crowd Sensing for Cost-Effective Data Management in the Cloud
Alkhelaiwi, Aseel
Grigoras, Dan
CLOUD COMPUTING AND BIG DATA: TECHNOLOGIES, APPLICATIONS AND SECURITY, 2019, 49 : 73 - 88
[9] Cost-Effective Request Scheduling for Greening Cloud Data Centers
Chen, Ying
Lin, Chuang
Huang, Jiwei
Shen, Xuemin
PROCEEDINGS 2016 IEEE INTERNATIONAL CONFERENCE ON SERVICES COMPUTING (SCC 2016), 2016, : 50 - 57
[10] Towards Cost-Effective Cloud Downloading with Tencent Big Data
Zhen-Hua Li
Gang Liu
Zhi-Yuan Ji
Roger Zimmermann
Journal of Computer Science and Technology, 2015, 30 : 1163 - 1174

← 1 2 3 4 5 →