A security and cost aware scheduling algorithm for heterogeneous tasks of scientific workflow in clouds

被引:88
|
作者
Li, Zhongjin [1 ]
Ge, Jidong [1 ,2 ]
Yang, Hongji [3 ]
Huang, Liguo [4 ]
Hu, Haiyang [5 ]
Hu, Hao [1 ]
Luo, Bin [1 ]
机构
[1] Nanjing Univ, Software Inst, State Key Lab Novel Software Technol, Nanjing 210093, Jiangsu, Peoples R China
[2] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
[3] Bath Spa Univ, CCC, Bath, Avon, England
[4] Southern Methodist Univ, Dept Comp Sci & Engn, Dallas, TX 75275 USA
[5] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou 310018, Peoples R China
关键词
Scientific workflow scheduling; Cloud computing; Big data application; Security awareness; Particle swarm optimization (PSO); Deadline constraint; BIG DATA; COMPUTING ADOPTION; SERVICE; SEARCH;
D O I
10.1016/j.future.2015.12.014
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Security is increasingly critical for various scientific workflows that are big data applications and typically take quite amount of time being executed on large-scale distributed infrastructures. Cloud computing platform is such an infrastructure that can enable dynamic resource scaling on demand. Nevertheless, based on pay-per-use and hourly-based pricing model, users should pay attention to the cost incurred by renting virtual machines (VMs) from cloud data centers. Meanwhile, workflow tasks are generally heterogeneous and require different instance series (i.e., computing optimized, memory optimized, storage optimized, etc.). In this paper, we propose a security and cost aware scheduling (SCAS) algorithm for heterogeneous tasks of scientific workflow in clouds. Our proposed algorithm is based on the meta-heuristic optimization technique, particle swarm optimization (PSO), the coding strategy of which is devised to minimize the total workflow execution cost while meeting the deadline and risk rate constraints. Extensive experiments using three real-world scientific workflow applications, as well as CloudSim simulation framework, demonstrate the effectiveness and practicality of our algorithm. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:140 / 152
页数:13
相关论文
共 50 条
  • [1] A Cost-Aware Scheduling Algorithm for Reliable Workflow in IaaS Clouds
    Ye, Lingjuan
    Xia, Yuanqing
    Yang, Liwen
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 275 - 280
  • [2] Cost minimization of scheduling scientific workflow applications on clouds
    Wu, Hao
    Chen, Xin
    Song, Xiaoyu
    Guo, He
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (05):
  • [3] Privacy-aware and cost-aware workflow scheduling in clouds
    Wen Y.
    Liu J.
    Chen C.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2016, 22 (02): : 294 - 301
  • [4] Cost and Energy Aware Scheduling Algorithm for Scientific Workflows with Deadline Constraint in Clouds
    Li, Zhongjin
    Ge, Jidong
    Hu, Haiyang
    Song, Wei
    Hu, Hao
    Luo, Bin
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2018, 11 (04) : 713 - 726
  • [5] Cost-Efficient Workflow Scheduling Algorithm for Applications With Deadline Constraint on Heterogeneous Clouds
    Tang, Xiaoyong
    Cao, Wenbiao
    Tang, Huiya
    Deng, Tan
    Mei, Jing
    Liu, Yi
    Shi, Cheng
    Xia, Meng
    Zeng, Zeng
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (09) : 2079 - 2092
  • [6] A Review of Cost and Makespan-Aware Workflow Scheduling in Clouds
    Lu, Pingping
    Zhang, Gongxuan
    Zhu, Zhaomeng
    Zhou, Xiumin
    Sun, Jin
    Zhou, Junlong
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2019, 28 (06)
  • [7] Energy and cost aware workflow scheduling in clouds with deadline constraint
    Medara, Rambabu
    Singh, Ravi Shankar
    Sompalli, Mahesh
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (13):
  • [8] User Priority Aware and Cost Constrained Workflow Scheduling in Clouds
    Chen, Yuehong
    Xia, Yuanqing
    Yan, Ce
    Gao, Runze
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 2708 - 2713
  • [9] Cost and makespan-aware workflow scheduling in hybrid clouds
    Zhou, Junlong
    Wang, Tian
    Cong, Peijin
    Lu, Pingping
    Wei, Tongquan
    Chen, Mingsong
    JOURNAL OF SYSTEMS ARCHITECTURE, 2019, 100
  • [10] Workflow Tasks Scheduling Optimization Based on Genetic Algorithm in Clouds
    Yang Cui
    Zhang Xiaoqing
    2018 IEEE 3RD INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA), 2018, : 6 - 10