Geo-distributed BigData Processing for Maximizing Profit in Federated clouds environment

被引:3
|
作者
Gouasmi, Thouraya [1 ]
Louati, Wajdi [1 ]
Kacem, Ahmed Hadj [1 ]
机构
[1] Univ Sfax, ReDCAD Lab, Sfax, Tunisia
关键词
Federated clouds; Geo-distributed MapReduce; Profit Maximizing; MAPREDUCE;
D O I
10.1109/PDP2018.2018.00020
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Managing and processing BigData in geo-distributed datacenters gain much attention in recent years. Despite the increasing attention on this topic, most efforts have been focused on user-centric solutions, and unfortunately much less on the difficulties encountered by Cloud providers to improve their profits. Highly efficient framework for geo-distributed BigData processing in cloud federation environment is a crucial solution to maximize profit of the cloud providers. The objective of this paper is to maximize the profit for cloud providers by minimizing costs and penalty. This work proposes to transfer compute (computations) to geo-distributed data and outsourcing only the desired data to idles resources of federated clouds in order to minimize job costs; and proposes a jobs reordering dynamic approach to minimize the penalties costs. The performance evaluation proves that our proposed algorithm can maximize profit, reduce the MapReduce jobs costs and improve utilization of clusters resources.
引用
收藏
页码:85 / 92
页数:8
相关论文
共 50 条
  • [41] Optimizing Geo-Distributed Data Processing with Resource Heterogeneity over the Internet
    Marzuni, Saeed mirpour
    Toosi, Adel
    Savadi, Abdorreza
    Naghibzadeh, Mahmud
    Taniar, David
    ACM TRANSACTIONS ON INTERNET TECHNOLOGY, 2025, 25 (01)
  • [42] Cost Minimization for Big Data Processing in Geo-Distributed Data Centers
    Gu, Lin
    Zeng, Deze
    Li, Peng
    Guo, Song
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2014, 2 (03) : 314 - 323
  • [43] Nitro: Network-Aware Virtual Machine Image Management in Geo-Distributed Clouds
    Darrous, Jad
    Ibrahim, Shadi
    Zhou, Amelie Chi
    Perez, Christian
    2018 18TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2018, : 553 - 562
  • [44] Federated Geo-Distributed Clouds: Optimizing Resource Allocation Based on Request Type Using Autonomous and Multi-objective Resource Sharing Model
    Ebadifard, Fatemeh
    Babamir, Seyed Morteza
    BIG DATA RESEARCH, 2021, 24
  • [45] Towards Geo-Distributed Training of ML Models in a Multi-Cloud Environment
    Phalak, Chetan
    Chahal, Dheeraj
    Ramesh, Manju
    Singhal, Rekha
    COMPANION OF THE 15TH ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING, ICPE COMPANION 2024, 2024, : 211 - 217
  • [46] Cost-Aware Big Data Processing Across Geo-Distributed Datacenters
    Xiao, Wenhua
    Bao, Weidong
    Zhu, Xiaomin
    Liu, Ling
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2017, 28 (11) : 3114 - 3127
  • [47] Performance Prediction of Sparse Matrix Multiplication on a Distributed BigData Processing Environment
    Park, Jueon
    Lee, Kyungyong
    2020 IEEE INTERNATIONAL CONFERENCE ON AUTONOMIC COMPUTING AND SELF-ORGANIZING SYSTEMS COMPANION (ACSOS-C 2020), 2020, : 30 - 35
  • [48] A game theory-based dynamic resource allocation strategy in Geo-distributed Datacenter Clouds
    Yuan, Xiaoqun
    Min, Geyong
    Yang, Laurence T.
    Ding, Yi
    Fang, Qing
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2017, 76 : 63 - 72
  • [49] Intent-Driven Multi-Engine Observability Dataflows For Heterogeneous Geo-Distributed Clouds
    Chakraborty, Aishwariya
    Eswaran, Anand
    Thorat, Pankaj
    Verma, Mudit
    Gupta, Pranjal
    Jayachandran, Praveen
    2024 IEEE 17TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, CLOUD 2024, 2024, : 30 - 41
  • [50] SpeCH: A scalable framework for data placement of data-intensive services in geo-distributed clouds
    Atrey, Ankita
    Van Seghbroeck, Gregory
    Mora, Higinio
    De Turck, Filip
    Volckaert, Bruno
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2019, 142 : 1 - 14