Geo-distributed BigData Processing for Maximizing Profit in Federated clouds environment

被引:3
|
作者
Gouasmi, Thouraya [1 ]
Louati, Wajdi [1 ]
Kacem, Ahmed Hadj [1 ]
机构
[1] Univ Sfax, ReDCAD Lab, Sfax, Tunisia
关键词
Federated clouds; Geo-distributed MapReduce; Profit Maximizing; MAPREDUCE;
D O I
10.1109/PDP2018.2018.00020
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Managing and processing BigData in geo-distributed datacenters gain much attention in recent years. Despite the increasing attention on this topic, most efforts have been focused on user-centric solutions, and unfortunately much less on the difficulties encountered by Cloud providers to improve their profits. Highly efficient framework for geo-distributed BigData processing in cloud federation environment is a crucial solution to maximize profit of the cloud providers. The objective of this paper is to maximize the profit for cloud providers by minimizing costs and penalty. This work proposes to transfer compute (computations) to geo-distributed data and outsourcing only the desired data to idles resources of federated clouds in order to minimize job costs; and proposes a jobs reordering dynamic approach to minimize the penalties costs. The performance evaluation proves that our proposed algorithm can maximize profit, reduce the MapReduce jobs costs and improve utilization of clusters resources.
引用
收藏
页码:85 / 92
页数:8
相关论文
共 50 条
  • [31] An Online Auction Mechanism for Dynamic Virtual Cluster Provisioning in Geo-Distributed Clouds
    Shi, Weijie
    Wu, Chuan
    Li, Zongpeng
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2017, 28 (03) : 677 - 688
  • [32] Scalable Data Placement of Data-intensive Services in Geo-distributed Clouds
    Atrey, Ankita
    Van Seghbroeck, Gregory
    Volckaert, Bruno
    De Turck, Filip
    CLOSER: PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND SERVICES SCIENCE, 2018, : 497 - 508
  • [33] Characterizing and Orchestrating VM Reservation in Geo-distributed Clouds to Improve the Resource Efficiency
    Shi, Jiuchen
    Fu, Kaihua
    Chen, Quan
    Yang, Changpeng
    Huang, Pengfei
    Zhou, Mosong
    Zhao, Jieru
    Chen, Chen
    Guo, Minyi
    PROCEEDINGS OF THE 13TH SYMPOSIUM ON CLOUD COMPUTING, SOCC 2022, 2022, : 94 - 109
  • [34] GA-Par: Dependable Microservice Orchestration Framework for Geo-Distributed Clouds
    Wen, Zhenyu
    Lin, Tao
    Yang, Renyu
    Ji, Shouling
    Ranjan, Rajiv
    Romanovsky, Alexander
    Lin, Changting
    Xu, Jie
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2020, 31 (01) : 129 - 143
  • [35] Cost-Sensitive Task Routing and Resource Provisioning in Geo-distributed Clouds
    Yuan, Haitao
    Bi, Jing
    Zhou, MengChu
    PROCEEDINGS OF THE 2017 IEEE 14TH INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL (ICNSC 2017), 2017, : 507 - 512
  • [36] A Declarative Optimization Engine for Resource Provisioning of Scientific Workflows in Geo-Distributed Clouds
    Zhou, Amelie Chi
    He, Bingsheng
    Cheng, Xuntao
    Lau, Chiew Tong
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2017, 28 (03) : 647 - 661
  • [37] On Achieving Efficient Data Transfer for Graph Processing in Geo-Distributed Datacenters
    Zhou, Amelie Chi
    Ibrahim, Shadi
    He, Bingsheng
    2017 IEEE 37TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2017), 2017, : 1397 - 1407
  • [38] RAGraph: A Region-Aware Framework for Geo-Distributed Graph Processing
    Yao, Feng
    Tao, Qian
    Yu, Wenyuan
    Zhang, Yanfeng
    Gong, Shufeng
    Wang, Qiange
    Yu, Ge
    Zhou, Jingren
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2023, 17 (03): : 264 - 277
  • [39] Harmony: An Approach for Geo-distributed Processing of Big-Data Applications
    Zhang, Han
    Ramapantulu, Lavanya
    Teo, Yong Meng
    2019 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER), 2019, : 160 - 170
  • [40] Cost-efficient flow migration for SFC dynamical scheduling in geo-distributed clouds
    Chen, Weihan
    Wang, Zhiliang
    Zhang, Han
    Yin, Xia
    Shi, Xingang
    COMPUTER NETWORKS, 2024, 249