A novel disk I/O scheduling framework of virtualized storage system

被引:1
|
作者
Dingding Li
Mianxiong Dong
Yong Tang
Kaoru Ota
机构
[1] South China Normal University,School of Computer Science
[2] Muroran Institute of Technology,Department of Information and Electronic Engineering
来源
Cluster Computing | 2019年 / 22卷
关键词
Big data; Virtual machine; Disk I/O scheduling;
D O I
暂无
中图分类号
学科分类号
摘要
Modern data centers usually use virtual machine technology to host various big data applications in a single physical machine, not only enhancing the server utilization, but also providing them with the hardware-level isolation. However, in a typical virtualized environment an extra software layer called virtual machine monitor (VMM) is often interposed between the hardware resource and guest operating system (virtual machine, VM), shielding the specific user-process semantic inside a running VM. As a result, it obstructs the disk I/O scheduler of VMM to acquire the accurate information of a user-process (often a big data application), and thus proposes a challenge on the I/O request scheduling as well as the disk resource management at the granularity of VM user-process. Eventually, the disk I/O performance of a virtualized system is sub-optimal. This paper introduces an improved disk I/O scheduling framework for the virtualized system. It aims at bridging the semantic gap between physical disk I/O scheduler and VM user-process, providing a fair sharing of disk I/O resource among concurrent VMs. At the same time, it improves the overall disk I/O performance through a novel method for creating the image file of VM. Besides, an extra scheduling algorithm is proposed to further refine the storage performance. Finally, we implement these improvements on Xen hypervisor and conduct extensive experiments to verify our framework. The experimental result shows that our work improve the performance of read-intensive, write-intensive and mixed workloads up to 9, 10.7 and 20% respectively.
引用
收藏
页码:2395 / 2405
页数:10
相关论文
共 50 条
  • [1] A novel disk I/O scheduling framework of virtualized storage system
    Li, Dingding
    Dong, Mianxiong
    Tang, Yong
    Ota, Kaoru
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 1): : 2395 - 2405
  • [2] A Network-friendly Disk I/O Optimization Framework in a Virtualized Cloud System
    Li, Dingding
    Tang, Yong
    Liu, Bing
    Yang, Zhendong
    Zhao, Gansen
    Li, Jianguo
    2014 IEEE 8TH INTERNATIONAL SYMPOSIUM ON EMBEDDED MULTICORE/MANYCORE SOCS (MCSOC), 2014, : 9 - 14
  • [3] Improving disk I/O performance in a virtualized system
    Li, Dingding
    Jin, Hai
    Liao, Xiaofei
    Zhang, Yu
    Zhou, Bingbing
    JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2013, 79 (02) : 187 - 200
  • [4] I/O-intensive Scheduling in Multiprocessor Virtualized System
    Mao, Haoxiang
    Huang, Bindi
    2014 INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTERNET OF THINGS (CCIOT), 2014, : 49 - 52
  • [5] Disk Scheduling in a Multimedia I/O System
    Reddy, A. L. N.
    Wyllie, Jim
    Wijayaratne, K. B. R.
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2005, 1 (01) : 37 - 59
  • [6] Disk-Cache and Parallelism Aware I/O Scheduling to Improve Storage System Performance
    Prabhakar, Ramya
    Kandemir, Mahmut
    Jung, Myoungsoo
    IEEE 27TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS 2013), 2013, : 357 - 368
  • [7] Merging and Prioritizing Optimization in Block I/O Scheduling of Disk Storage
    Li, Hui
    Liao, Jianwei
    Liu, Xiaoyan
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2021, 30 (10)
  • [8] Adaptive Splitting-based Block I/O Scheduling in Disk Storage
    Li, Hui
    Chen, Shanxiong
    Xiao, Guoqiang
    Peng, Xiaoning
    Liao, Jianwei
    2018 IEEE 42ND ANNUAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE (COMPSAC), VOL 1, 2018, : 668 - 676
  • [9] A New Disk I/O Model of Virtualized Cloud Environment
    Li, Dingding
    Liao, Xiaofei
    Jin, Hai
    Zhou, Bingbing
    Zhang, Qi
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2013, 24 (06) : 1129 - 1138
  • [10] Enhance Virtualized HPC System Based on I/O Behavior Perception and Asymmetric Scheduling
    Hu, Yanyan
    Long, Xiang
    Zhang, Jiong
    2012 IEEE 14TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2012 IEEE 9TH INTERNATIONAL CONFERENCE ON EMBEDDED SOFTWARE AND SYSTEMS (HPCC-ICESS), 2012, : 169 - 178