Scheduling parallel jobs with CPU and I/O resource requirements in cluster computing systems

被引:0
|
作者
Abawajy, JH [1 ]
Dandamudi, SP [1 ]
机构
[1] Carleton Univ, Sch Comp Sci, Ottawa, ON K1S 5B6, Canada
关键词
cluster computing; parallel job scheduling; parallel I/O; coordinated CPU-I/O resources scheduling; high-performance computing;
D O I
暂无
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
This paper addresses the problem of an on-line coordinated allocation of processor and I/O resources in large-scale shared heterogeneous cluster computing systems. Most research in job scheduling study has focused solely on the allocation of processors to jobs. However, since I/O is also a critical resource for many jobs, the allocation of processor and I/O resources must be coordinated to allow the system to operate most effectively. To this end, we present an efficient job scheduling policy and study its performance under various system and workload parameters. We also compared the performance of the proposed policy with static space time sharing policy. The results show that the proposed policy performs substantially better than the static space time sharing policy.
引用
收藏
页码:336 / 343
页数:8
相关论文
共 50 条
  • [41] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    Chen, ZG
    Zeng, BQ
    Xiong, C
    Deng, XH
    Zeng, ZW
    Liu, AF
    JOURNAL OF CENTRAL SOUTH UNIVERSITY OF TECHNOLOGY, 2005, 12 (05): : 572 - 577
  • [42] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    Zhi-gang Chen
    Bi-qing Zeng
    Ce Xiong
    Xiao-heng Deng
    Zhi-wen Zeng
    An-feng Liu
    Journal of Central South University of Technology, 2005, 12 : 572 - 577
  • [43] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    陈志刚
    曾碧卿
    熊策
    邓晓衡
    曾志文
    刘安丰
    Journal of Central South University of Technology(English Edition), 2005, (05) : 572 - 577
  • [44] Resource monitoring for cluster computing with application to parallel motion estimation
    Gunawan, TS
    Tong, CW
    APCCAS 2002: ASIA-PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS, VOL 1, PROCEEDINGS, 2002, : 207 - 210
  • [45] Scheduling jobs with service level requirements on parallel machines under availability and eligibility constraints
    Liao, Lu-Wen
    JOURNAL OF INFORMATION & OPTIMIZATION SCIENCES, 2009, 30 (06): : 1157 - 1176
  • [46] Storage System Optimization, Improving CPU Efficiency in I/O Bounded Jobs
    Cabrillo Bartolome, Iban
    Rodriguez Marrero, Ana Y.
    IBERGRID: 4TH IBERIAN GRID INFRASTRUCTURE CONFERENCE PROCEEDINGS, 2010, : 344 - 354
  • [47] Improving Cluster Utilization Through Adaptive Resource Management for Deep Neural Network and CPU Jobs Colocation
    Zhao, Han
    Cui, Weihao
    Chen, Quan
    Leng, Jingwen
    Zeng, Deze
    Guo, Minyi
    IEEE TRANSACTIONS ON COMPUTERS, 2023, 72 (12) : 3458 - 3472
  • [48] Optimal Resource Scheduling and Allocation in Distributed Computing Systems
    Ren, Wei
    Vlahakis, Eleftherios
    Athanasopoulos, Nikolaos
    Jungers, Raphael
    2022 AMERICAN CONTROL CONFERENCE, ACC, 2022, : 2327 - 2332
  • [49] AIMD scheduling and resource allocation in distributed computing systems
    Vlahakis, Eleftherios
    Athanasopoulos, Nikolaos
    McLoone, Sean
    2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 4642 - 4647
  • [50] Multisite co-allocation scheduling algorithms for parallel jobs in computing grid environments
    Weizhe Zhang
    Binxing Fang
    Mingzeng Hu
    Xinran Liu
    Hongli Zhang
    Lei Gao
    Science in China Series F: Information Sciences, 2006, 49 : 906 - 926