Geo-distributed BigData Processing for Maximizing Profit in Federated clouds environment

被引:3
|
作者
Gouasmi, Thouraya [1 ]
Louati, Wajdi [1 ]
Kacem, Ahmed Hadj [1 ]
机构
[1] Univ Sfax, ReDCAD Lab, Sfax, Tunisia
关键词
Federated clouds; Geo-distributed MapReduce; Profit Maximizing; MAPREDUCE;
D O I
10.1109/PDP2018.2018.00020
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Managing and processing BigData in geo-distributed datacenters gain much attention in recent years. Despite the increasing attention on this topic, most efforts have been focused on user-centric solutions, and unfortunately much less on the difficulties encountered by Cloud providers to improve their profits. Highly efficient framework for geo-distributed BigData processing in cloud federation environment is a crucial solution to maximize profit of the cloud providers. The objective of this paper is to maximize the profit for cloud providers by minimizing costs and penalty. This work proposes to transfer compute (computations) to geo-distributed data and outsourcing only the desired data to idles resources of federated clouds in order to minimize job costs; and proposes a jobs reordering dynamic approach to minimize the penalties costs. The performance evaluation proves that our proposed algorithm can maximize profit, reduce the MapReduce jobs costs and improve utilization of clusters resources.
引用
收藏
页码:85 / 92
页数:8
相关论文
共 50 条
  • [21] Accelerating Geo-Distributed Transaction Processing with Fast Logging
    Ogura, Takuto
    Akita, Yoshiki
    Miyazawa, Yuki
    Kawashima, Hideyuki
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 2390 - 2399
  • [22] Dynamic Pricing and Profit Maximization for the Cloud with Geo-distributed Data Centers
    Zhao, Jian
    Li, Flongxing
    Wu, Chuan
    Li, Zongpeng
    Zhang, Zhizhong
    Lau, Francis C. M.
    2014 PROCEEDINGS IEEE INFOCOM, 2014, : 118 - 126
  • [23] Achieving Cost Optimization for Tenant Task Placement in Geo-Distributed Clouds
    Luo, Luyao
    Zhao, Gongming
    Xu, Hongli
    Yu, Zhuolong
    Xie, Liguang
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (02) : 1391 - 1406
  • [24] Towards optimization of Availability and Cost in Selection of Geo-distributed Clouds Datacenter
    Ziafat, Hasan
    Babamir, Seyed Morteza
    2016 IEEE 10TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT), 2016, : 580 - 584
  • [25] GeoScale: Microservice Autoscaling With Cost Budget in Geo-Distributed Edge Clouds
    Cheng, Ke
    Zhang, Sheng
    Liu, Meizhao
    Gu, Yingcheng
    Wei, Liu
    Cheng, Huanyu
    Liu, Kai
    Song, Yu
    Shi, Xiaohang
    Zhu, Andong
    Tang, Lei
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2024, 35 (04) : 646 - 662
  • [26] An Online Mechanism for Dynamic Virtual Cluster Provisioning in Geo-Distributed Clouds
    Shi, Weijie
    Wu, Chuan
    Li, Zongpeng
    IEEE INFOCOM 2016 - THE 35TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS, 2016,
  • [27] Scheduling Stream Processing Tasks on Geo-Distributed Heterogeneous Resources
    Janssen, Gerrit
    Verbitskiy, Ilya
    Renner, Thomas
    Thamsen, Lauritz
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 5159 - 5164
  • [28] Efficient Graph Query Processing over Geo-Distributed Datacenters
    Yuan, Ye
    Ma, Delong
    Wen, Zhenyu
    Ma, Yuliang
    Wang, Guoren
    Chen, Lei
    PROCEEDINGS OF THE 43RD INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '20), 2020, : 619 - 628
  • [29] Towards Efficient Graph Processing in Geo-Distributed Data Centers
    Yao, Feng
    Tao, Qian
    Lin, Shengyuan
    Zhang, Yanfeng
    Yu, Wenyuan
    Gong, Shufeng
    Wang, Qiange
    Yu, Ge
    Zhou, Jingren
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2024, 35 (11) : 2147 - 2160
  • [30] LEO Satellite Networks Assisted Geo-Distributed Data Processing
    Zhao, Zhiyuan
    Chen, Zhe
    Lin, Zheng
    Zhu, Wenjun
    Qiu, Kun
    You, Chaoqun
    Gao, Yue
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2025, 14 (02) : 405 - 409