A security and cost aware scheduling algorithm for heterogeneous tasks of scientific workflow in clouds

被引:88
|
作者
Li, Zhongjin [1 ]
Ge, Jidong [1 ,2 ]
Yang, Hongji [3 ]
Huang, Liguo [4 ]
Hu, Haiyang [5 ]
Hu, Hao [1 ]
Luo, Bin [1 ]
机构
[1] Nanjing Univ, Software Inst, State Key Lab Novel Software Technol, Nanjing 210093, Jiangsu, Peoples R China
[2] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
[3] Bath Spa Univ, CCC, Bath, Avon, England
[4] Southern Methodist Univ, Dept Comp Sci & Engn, Dallas, TX 75275 USA
[5] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou 310018, Peoples R China
关键词
Scientific workflow scheduling; Cloud computing; Big data application; Security awareness; Particle swarm optimization (PSO); Deadline constraint; BIG DATA; COMPUTING ADOPTION; SERVICE; SEARCH;
D O I
10.1016/j.future.2015.12.014
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Security is increasingly critical for various scientific workflows that are big data applications and typically take quite amount of time being executed on large-scale distributed infrastructures. Cloud computing platform is such an infrastructure that can enable dynamic resource scaling on demand. Nevertheless, based on pay-per-use and hourly-based pricing model, users should pay attention to the cost incurred by renting virtual machines (VMs) from cloud data centers. Meanwhile, workflow tasks are generally heterogeneous and require different instance series (i.e., computing optimized, memory optimized, storage optimized, etc.). In this paper, we propose a security and cost aware scheduling (SCAS) algorithm for heterogeneous tasks of scientific workflow in clouds. Our proposed algorithm is based on the meta-heuristic optimization technique, particle swarm optimization (PSO), the coding strategy of which is devised to minimize the total workflow execution cost while meeting the deadline and risk rate constraints. Extensive experiments using three real-world scientific workflow applications, as well as CloudSim simulation framework, demonstrate the effectiveness and practicality of our algorithm. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:140 / 152
页数:13
相关论文
共 50 条
  • [41] A multi-objective reinforcement learning algorithm for deadline constrained scientific workflow scheduling in clouds
    Qin, Yao
    Wang, Hua
    Yi, Shanwen
    Li, Xiaole
    Zhai, Linbo
    FRONTIERS OF COMPUTER SCIENCE, 2021, 15 (05)
  • [42] Fluctuation-Aware and Predictive Workflow Scheduling in Cost-Effective Infrastructure-as-a-Service Clouds
    Li, Weiling
    Xia, Yunni
    Zhou, Mengchu
    Sun, Xiaoning
    Zhu, Qingsheng
    IEEE ACCESS, 2018, 6 : 61488 - 61502
  • [43] Genetic-based algorithms applied to a workflow scheduling algorithm with security and deadline constraints in clouds
    Shishido, Henrique Yoshikazu
    Estrella, Julio Cezar
    Motta Toledo, Claudio Fabiano
    Arantes, Marcio Silva
    COMPUTERS & ELECTRICAL ENGINEERING, 2018, 69 : 378 - 394
  • [44] A cost and makespan aware scheduling algorithm for dynamic multi-workflow in cloud environment
    Xia, Yuanqing
    Zhan, Yufeng
    Dai, Li
    Chen, Yuehong
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (02): : 1814 - 1833
  • [45] A cost and makespan aware scheduling algorithm for dynamic multi-workflow in cloud environment
    Yuanqing Xia
    Yufeng Zhan
    Li Dai
    Yuehong Chen
    The Journal of Supercomputing, 2023, 79 : 1814 - 1833
  • [46] Deadline Distribution Strategies for Scientific Workflow Scheduling in Commercial Clouds
    Arabnejad, Vahid
    Bubendorfer, Kris
    Ng, Bryan
    2016 IEEE/ACM 9TH INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING (UCC), 2016, : 70 - 78
  • [47] Budget Distribution Strategies for Scientific Workflow Scheduling in Commercial Clouds
    Arabnejad, Vahid
    Bubendorfer, Kris
    Ng, Bryan
    PROCEEDINGS OF THE 2016 IEEE 12TH INTERNATIONAL CONFERENCE ON E-SCIENCE (E-SCIENCE), 2016, : 137 - 146
  • [48] FFBAT: A security and cost-aware workflow scheduling approach combining firefly and bat algorithms
    Arunarani, A. R.
    Manjula, D.
    Sugumaran, Vijayan
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2017, 29 (24):
  • [49] Fair budget constrained workflow scheduling approach for heterogeneous clouds
    Naela Rizvi
    Dharavath Ramesh
    Cluster Computing, 2020, 23 : 3185 - 3201
  • [50] Fair budget constrained workflow scheduling approach for heterogeneous clouds
    Rizvi, Naela
    Ramesh, Dharavath
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2020, 23 (04): : 3185 - 3201