QoS-aware and multi-objective virtual machine dynamic scheduling for big data centers in clouds

被引:8
|
作者
Li, Jirui [1 ]
Zhang, Rui [2 ]
Zheng, Yafeng [3 ]
机构
[1] Henan Univ Chinese Med, Sch Informat Technol, Zhengzhou 450008, Henan, Peoples R China
[2] Arizona State Univ, Sch Comp Informat & Decis Syst Engn, Tempe, AZ 85281 USA
[3] Henan Univ Econ & Law, Sch Comp & Informat Engn, Zhengzhou 450008, Henan, Peoples R China
基金
中国国家自然科学基金;
关键词
Load balancing; Migration cost; QoS; Big data center; Scheduling; Cloud; MIGRATION COST; ENERGY; CONSOLIDATION; ALGORITHM; SELECTION;
D O I
10.1007/s00500-022-07327-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Efficient resource scheduling is one of the most critical issues for big data centers in clouds to provide continuous services for users. Many existing scheduling schemes based on tasks on virtual machine (VM), pursued either load balancing or migration cost under certain response time or energy efficiency, which cannot meet the true balance of the supply and demand between users and cloud providers. The paper focuses on the following multi-objective optimization problem: how to pay little migration cost as much as possible to keep system load balancing under meeting certain quality of service (QoS) via dynamic VM scheduling between limited physical nodes in a heterogeneous cloud cluster. To make these conflicting objectives coexist, a joint optimization function is designed for an overall evaluation on the basis of a load balancing estimation method, a migration cost estimation method and a QoS estimation method. To optimize the consolidation score, an array mapping and a tree crossover model are introduced, and an improved genetic algorithm (GA) based on them is proposed. Finally, empirical results based on Eucalyptus platform demonstrate the proposed scheme outperforms exiting VM scheduling models.
引用
收藏
页码:10239 / 10252
页数:14
相关论文
共 50 条
  • [31] Provision of Data-Intensive Services Through Energy- and QoS-Aware Virtual Machine Placement in National Cloud Data Centers
    Wang, Shangguang
    Zhou, Ao
    Hsu, Ching-Hsien
    Xiao, Xuanyu
    Yang, Fanchun
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2016, 4 (02) : 290 - 300
  • [32] Multi-objective scheduling of MapReduce jobs in big data processing
    Hashem, Ibrahim Abaker Targio
    Anuar, Nor Badrul
    Marjani, Mohsen
    Gani, Abdullah
    Sangaiah, Arun Kumar
    Sakariyah, Adewole Kayode
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (08) : 9979 - 9994
  • [33] Multi-objective scheduling of MapReduce jobs in big data processing
    Ibrahim Abaker Targio Hashem
    Nor Badrul Anuar
    Mohsen Marjani
    Abdullah Gani
    Arun Kumar Sangaiah
    Adewole Kayode Sakariyah
    Multimedia Tools and Applications, 2018, 77 : 9979 - 9994
  • [34] Dynamic QoS-Aware Scheduling for Concurrent Traffic in Smart Home
    Ben Attia, Maroua
    Nguyen, Kim Khoa
    Cheriet, Mohamed
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (06) : 5412 - 5425
  • [35] Data locality-aware and QoS-aware dynamic cloud workflow scheduling in Hadoop for heterogeneous environment
    Ding, Fan
    Ma, Minjin
    INTERNATIONAL JOURNAL OF WEB AND GRID SERVICES, 2023, 19 (01) : 113 - 135
  • [36] QoS-aware web service selection with global optimization based on multi-objective genetic algorithm
    Wu, Yingbo
    Wang, Xu
    Journal of Computational Information Systems, 2012, 8 (05): : 1995 - 2007
  • [37] QoS-aware Automatic Service Composition Based on Service Execution Timeline with Multi-objective Optimization
    Wang, Zhaoning
    Cheng, Bo
    Zhang, Wenkai
    Chen, Junliang
    2020 IEEE 13TH INTERNATIONAL CONFERENCE ON SERVICES COMPUTING (SCC 2020), 2020, : 296 - 303
  • [38] Multi-objective QoS-aware optimization for deployment of IoT applications on cloud and fog computing infrastructure
    Hosseini Shirvani, Mirsaeid
    Ramzanpoor, Yaser
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (26): : 19581 - 19626
  • [39] Genetic Algorithm-Based Multi-objective Optimisation for QoS-Aware Web Services Composition
    Li, Li
    Yang, Pengyi
    Ou, Ling
    Zhang, Zili
    Cheng, Peng
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, 2010, 6291 : 549 - 554
  • [40] Multi-objective QoS-aware optimization for deployment of IoT applications on cloud and fog computing infrastructure
    Mirsaeid Hosseini Shirvani
    Yaser Ramzanpoor
    Neural Computing and Applications, 2023, 35 : 19581 - 19626