CRUSH: Data Collection and Analysis Framework for Power Capped Data Intensive Computing

被引：0
|
作者：
Gupta, Anurag [1 ]
Gupta, Sanjeev [1 ]
Ge, Rong [2 ]
Zong, Ziliang [3 ]
机构：
[1] Marquette Univ, Dept Math Stat & Comp Sci, Milwaukee, WI 53233 USA
[2] Clemson Univ, Dept Comp Sci, Clemson, SC 29631 USA
[3] Texas State Univ, Dept Comp Sci, San Marcos, TX 78666 USA
来源：
2015 SIXTH INTERNATIONAL GREEN COMPUTING CONFERENCE AND SUSTAINABLE COMPUTING CONFERENCE (IGSC) | 2015年
关键词：
CRUSH; Power Capping; Power provisioning; DVFS; RAPL; Hadoop;
D O I：
暂无
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
Hadoop system has been widely used to support large-scale data intensive computing tasks on enterprise software infrastructure. Deploying and operating Hadoop incur high costs including hardware expenditure to build computer clusters and energy consumption to run the clusters. Building sustainable and scalable systems requires optimal power management schemes. In this paper, we present a framework, namely CRUSH, which collects power and resource usage data and provides statistical analysis for power management. We also demonstrate the usage of CRUSH in studying the effects of power capping on Hadoop jobs.
引用
收藏
页数：6
相关论文
共 50 条
  • [1] Parallel Framework for Data-Intensive Computing with XSEDE
    Subramanian, Ranjini
    Zhang, Hui
    PEARC '19: PROCEEDINGS OF THE PRACTICE AND EXPERIENCE IN ADVANCED RESEARCH COMPUTING ON RISE OF THE MACHINES (LEARNING), 2019,
  • [2] A Framework for Data-Intensive Computing with Cloud Bursting
    Bicer, Tekin
    Chiu, David
    Agrawal, Gagan
    2011 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER), 2011, : 169 - 177
  • [3] DATA COLLECTION ACQUISITION AND ON LINE DATA TRANSMISSION BY SMALL TERMINALS WITH COMPUTING POWER
    FETZER, H
    FIDRICH, P
    SOMMER, H
    IEEE COMPUTER GROUP NEWS, 1970, 3 (03): : 15 - &
  • [4] DATA INTENSIVE SCIENTIFIC ANALYSIS WITH GRID COMPUTING
    Terzo, Olivier
    Mossucca, Lorenzo
    Cucca, Manuela
    Notarpietro, Riccardo
    INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS AND COMPUTER SCIENCE, 2011, 21 (02) : 219 - 228
  • [5] Menthal: A Framework for Mobile Data Collection and Analysis
    Andone, Ionut
    Blaszkiewicz, Konrad
    Eibes, Mark
    Trendafilov, Boris
    Markowetz, Alexander
    Montag, Christian
    UBICOMP'16 ADJUNCT: PROCEEDINGS OF THE 2016 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING, 2016, : 624 - 629
  • [6] A Multidimensional Data Collection and Edge Computing Analysis Method
    Ji, Yanping
    Li, Jiawei
    Zhao, Boyan
    Wang, Wensi
    APPLIED SCIENCES-BASEL, 2024, 14 (01):
  • [7] Integrating Data-Intensive Computing Systems with Biological Data Analysis Frameworks
    Pedersen, Edvard
    Raknes, Inge Alexander
    Ernstsen, Martin
    Bongo, Lars Ailo
    23RD EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP 2015), 2015, : 733 - 740
  • [8] A unified delay analysis framework for opportunistic data collection
    Zhao, Dong
    Ma, Huadong
    Li, Qi
    Tang, Shaojie
    WIRELESS NETWORKS, 2018, 24 (04) : 1313 - 1325
  • [9] A qualitative framework for data collection and analysis in participation processes
    Marzouki, Amal
    Mellouli, Sehl
    Daniel, Sylvie
    PROCEEDINGS OF THE 20TH ANNUAL INTERNATIONAL CONFERENCE ON DIGITAL GOVERNMENT RESEARCH (DGO2019): GOVERNANCE IN THE AGE OF ARTIFICIAL INTELLIGENCE, 2019, : 398 - 408
  • [10] A unified delay analysis framework for opportunistic data collection
    Dong Zhao
    Huadong Ma
    Qi Li
    Shaojie Tang
    Wireless Networks, 2018, 24 : 1313 - 1325
12345