Modeling pre-Exascale AMR Parallel I/O Workloads via Proxy Applications

被引:0
|
作者
Godoy, William F. [1 ]
Delozier, Jenna [2 ]
Watson, Gregory R. [1 ]
机构
[1] Oak Ridge Natl Lab, Comp Sci & Math Div, Oak Ridge, TN 37830 USA
[2] Georgia Inst Technol, Coll Comp, Atlanta, GA 30332 USA
关键词
Proxy; I/O; AMR; MACSio; HPC; exascale;
D O I
10.1109/IPDPSW55747.2022.00153
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The present work investigates the modeling of pre-exascale input/output (DO) workloads of Adaptive Mesh Refinement (AMR) simulations through a simple proxy application. We collect data from the AMReX Castro framework running on the Summit supercomputer for a wide range of scales and mesh partitions for the hydrodynamic Sedov case as a baseline to provide sufficient coverage to the formulated proxy model. The non-linear analysis data production rates are quantified as a function of a set of input parameters such as output frequency, grid size, number of levels, and the Courant-Friedrichs-Lewy (CFL) condition number for each rank, mesh level and simulation time step. Linear regression is then applied to formulate a simple analytical model which allows to translate AMReX inputs into MACSio proxy I/O application parameters, resulting in a simple "kernel" approximation for data production at each time step. Results show that MACSio can simulate actual AMReX nonlinear "static" I/O workloads to a certain degree of confidence on the Summit supercomputer using the present methodology. The goal is to provide an initial level of understanding of AMR I/O workloads via lightweight proxy applications models to facilitate autotune data management strategies in anticipation of exascale systems.
引用
收藏
页码:952 / 961
页数:10
相关论文
共 50 条
  • [41] Design and implementation of a parallel I/O runtime system for irregular applications
    No, JC
    Park, SS
    Perez, JC
    Choudhary, A
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2002, 62 (02) : 193 - 220
  • [42] Language, compiler and parallel database support for I/O intensive applications
    Brezany, P
    Mueck, TA
    Schikuta, E
    HIGH-PERFORMANCE COMPUTING AND NETWORKING, 1995, 919 : 14 - 20
  • [43] ChemIO: High performance parallel I/O for computational chemistry applications
    Nieplocha, J
    Foster, I
    Kendall, RA
    INTERNATIONAL JOURNAL OF HIGH PERFORMANCE COMPUTING APPLICATIONS, 1998, 12 (03): : 345 - 363
  • [44] ChemIO: high performance parallel I/O for computational chemistry applications
    Pacific Northwest Natl Lab, Richland, United States
    Int J High Perform Comput Appl, 3 (345-363):
  • [45] MOANA: Modeling and Analyzing I/O Variability in Parallel System Experimental Design
    Cameron, Kirk W.
    Anwar, Ali
    Cheng, Yue
    Xu, Li
    Li, Bo
    Ananth, Uday
    Bernard, Jon
    Jearls, Chandler
    Lux, Thomas
    Hong, Yili
    Watson, Layne T.
    Butt, Ali R.
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (08) : 1843 - 1856
  • [46] Sigh performance parallel I/O schemes for irregular applications on clusters of workstations
    No, J
    Carretero, J
    Choudhary, A
    HIGH-PERFORMANCE COMPUTING AND NETWORKING, PROCEEDINGS, 1999, 1593 : 1117 - 1126
  • [47] Improving I/O Throughput of Scientific Applications using Transparent Parallel Compression
    Bicer, Tekin
    Yin, Jian
    Agrawal, Gagan
    2014 14TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2014, : 1 - 10
  • [48] Parallel Performance and I/O Profiling of HPC RNA-Seq Applications
    Cruz, Lucas
    Coelho, Micaella
    Galheigo, Marcelo
    Carneiro, Andre
    Carvalho, Diego
    Gadelha, Luiz
    Boito, Francieli
    Navaux, Philippe
    Osthoff, Carla
    Ocana, Kary
    COMPUTACION Y SISTEMAS, 2022, 26 (04): : 1625 - 1633
  • [49] Performance modeling for I/O-intensive applications on virtual machines
    Bhattacharya, Tathagata
    Peng, Xiaopu
    Mao, Jianzhou
    Zhang, Chaowei
    Takreeti, Taha
    Wang, Ye
    Cao, Ting
    Qin, Xiao
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (10):
  • [50] Parallel universal access layer: A scalable I/O library for integrated tokamak modeling
    Galonska, A.
    Gibbon, P.
    Imbeaux, F.
    Frauel, Y.
    Guillerminet, B.
    Manduchi, G.
    Wolf, F.
    COMPUTER PHYSICS COMMUNICATIONS, 2013, 184 (03) : 638 - 646