A security and cost aware scheduling algorithm for heterogeneous tasks of scientific workflow in clouds

被引:88
|
作者
Li, Zhongjin [1 ]
Ge, Jidong [1 ,2 ]
Yang, Hongji [3 ]
Huang, Liguo [4 ]
Hu, Haiyang [5 ]
Hu, Hao [1 ]
Luo, Bin [1 ]
机构
[1] Nanjing Univ, Software Inst, State Key Lab Novel Software Technol, Nanjing 210093, Jiangsu, Peoples R China
[2] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
[3] Bath Spa Univ, CCC, Bath, Avon, England
[4] Southern Methodist Univ, Dept Comp Sci & Engn, Dallas, TX 75275 USA
[5] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou 310018, Peoples R China
关键词
Scientific workflow scheduling; Cloud computing; Big data application; Security awareness; Particle swarm optimization (PSO); Deadline constraint; BIG DATA; COMPUTING ADOPTION; SERVICE; SEARCH;
D O I
10.1016/j.future.2015.12.014
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Security is increasingly critical for various scientific workflows that are big data applications and typically take quite amount of time being executed on large-scale distributed infrastructures. Cloud computing platform is such an infrastructure that can enable dynamic resource scaling on demand. Nevertheless, based on pay-per-use and hourly-based pricing model, users should pay attention to the cost incurred by renting virtual machines (VMs) from cloud data centers. Meanwhile, workflow tasks are generally heterogeneous and require different instance series (i.e., computing optimized, memory optimized, storage optimized, etc.). In this paper, we propose a security and cost aware scheduling (SCAS) algorithm for heterogeneous tasks of scientific workflow in clouds. Our proposed algorithm is based on the meta-heuristic optimization technique, particle swarm optimization (PSO), the coding strategy of which is devised to minimize the total workflow execution cost while meeting the deadline and risk rate constraints. Extensive experiments using three real-world scientific workflow applications, as well as CloudSim simulation framework, demonstrate the effectiveness and practicality of our algorithm. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:140 / 152
页数:13
相关论文
共 50 条
  • [31] HEFT based Workflow Scheduling Algorithm for Cost Optimization within Deadline in Hybrid Clouds
    Chopra, Nitish
    Singh, Sarbjeet
    2013 FOURTH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATIONS AND NETWORKING TECHNOLOGIES (ICCCNT), 2013,
  • [32] Storage-aware Algorithms for Scheduling of Workflow Ensembles in Clouds
    Piotr Bryk
    Maciej Malawski
    Gideon Juve
    Ewa Deelman
    Journal of Grid Computing, 2016, 14 : 359 - 378
  • [33] A data-aware scheduling strategy for workflow execution in clouds
    Marozzo, Fabrizio
    Rodrigo Duro, Francisco
    Garcia Blas, Javier
    Carretero, Jesus
    Talia, Domenico
    Trunfio, Paolo
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2017, 29 (24):
  • [34] Storage-aware Algorithms for Scheduling of Workflow Ensembles in Clouds
    Bryk, Piotr
    Malawski, Maciej
    Juve, Gideon
    Deelman, Ewa
    JOURNAL OF GRID COMPUTING, 2016, 14 (02) : 359 - 378
  • [35] An efficient cost-based algorithm for scheduling workflow tasks in cloud computing systems
    Amoon, Mohammed
    El-Bahnasawy, Nirmeen
    ElKazaz, Mai
    NEURAL COMPUTING & APPLICATIONS, 2019, 31 (05): : 1353 - 1363
  • [36] Scheduling deadline-constrained scientific workflow using chemical reaction optimisation algorithm in clouds
    Yan C.
    Luo H.
    Hu Z.
    Yan, Chaokun (ckyango@csu.edu.cn), 2018, Inderscience Publishers (10) : 378 - 393
  • [37] A multi-objective reinforcement learning algorithm for deadline constrained scientific workflow scheduling in clouds
    Yao QIN
    Hua WANG
    Shanwen YI
    Xiaole LI
    Linbo ZHAI
    Frontiers of Computer Science, 2021, (05) : 1 - 12
  • [38] A multi-objective reinforcement learning algorithm for deadline constrained scientific workflow scheduling in clouds
    Yao Qin
    Hua Wang
    Shanwen Yi
    Xiaole Li
    Linbo Zhai
    Frontiers of Computer Science, 2021, 15
  • [39] Scheduling deadline-constrained scientific workflow using chemical reaction optimisation algorithm in clouds
    Yan, Chaokun
    Luo, Huimin
    Hu, Zhigang
    INTERNATIONAL JOURNAL OF EMBEDDED SYSTEMS, 2018, 10 (05) : 378 - 393
  • [40] Chaotic hybrid multi-objective optimization algorithm for scientific workflow scheduling in multisite clouds
    Mohammadzadeh, Ali
    Javaheri, Danial
    Artin, Javad
    JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 2024, 75 (02) : 314 - 335