Energy-Aware Tile Size Selection for Affine Programs on GPUs

被引:0
|
作者
Jayaweera, Malith [1 ]
Kong, Martin [2 ]
Wang, Yanzhi [1 ]
Kaeli, David [1 ]
机构
[1] Northeastern Univ, Dept Elect & Comp Engn, Boston, MA USA
[2] Ohio State Univ, Dept Comp Sci & Engn, Columbus, OH USA
基金
美国国家科学基金会;
关键词
loop tiling; energy optimization; affine transformations; GPUs; POWER; PERFORMANCE; EFFICIENCY; ALGORITHM; MODEL;
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Loop tiling is a high-order transformation used to increase data locality and performance. While previous work has considered its application to several domains and architectures, its potential impact on energy efficiency has been largely ignored. In this work, we present an Energy-Aware Tile Size Selection Scheme (EATSS) for affine programs targeting GPUs. We automatically derive non-linear integer formulations for affine programs and use the Z3 solver to find effective tile sizes that meet architectural resource constraints, while maximizing performance and minimizing energy consumption. Our approach builds on the insight that reducing the liveness of in-cache data, together with exploiting automatic power scaling, can lead to substantial gains in performance and energy efficiency. We evaluate EATSS on NVIDIA Xavier and GA100 GPUs, and report median performance-per-Watt improvement relative to PPCG on several affine kernels. On Polybench kernels, we achieve 1.5x and 1.2x improvement and obtain up to 6.3x improvement on non-Polybench high-dimensional affine kernels.
引用
收藏
页码:13 / 27
页数:15
相关论文
共 50 条
  • [21] Energy-Aware Relay Selection for Multiuser Relay Networks
    Zuo, Fangzhi
    Dong, Min
    2012 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2012,
  • [22] SPRAT: Runtime Processor Selection for Energy-aware Computing
    Takizawa, Hiroyuki
    Sato, Katuto
    Kobayashi, Hiroaki
    2008 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING, 2008, : 386 - 393
  • [23] Energy-Aware Network Selection Using Traffic Estimation
    Petander, Henrik
    1ST ACM WORKSHOP ON MOBILE INTERNET THROUGH CELLULAR NETWORKS-OPERATIONS CHALLENGES AND SOLUTIONS (MICNET), 2009, : 55 - 60
  • [24] Energy-aware neural architecture selection and hyperparameter optimization
    Frey, Nathan C.
    Zhao, Dan
    Axelrod, Simon
    Jones, Michael
    Bestor, David
    Gadepally, Vijay
    Gomez-Bombarelli, Rafael
    Samsi, Siddharth
    2022 IEEE 36TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW 2022), 2022, : 732 - 741
  • [25] Energy-Aware Dynamic Server Selection and Task Allocation
    Bokar, Ali
    Bozyigit, Muslim
    Sener, Cevat
    23RD INTERNATIONAL SYMPOSIUM ON COMPUTER AND INFORMATION SCIENCES, 2008, : 207 - 212
  • [26] Energy-aware data prefetching for general-purpose programs
    Guo, Y
    Chheda, S
    Koren, I
    Krishna, CM
    Moritz, CA
    POWER-AWARE COMPUTER SYSTEMS, 2005, 3471 : 78 - 94
  • [27] EAIS: Energy-aware adaptive scheduling for CNN inference on high-performance GPUs
    Yao, Chunrong
    Liu, Wantao
    Tang, Weiqing
    Hu, Songlin
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2022, 130 : 253 - 268
  • [28] Multi-Kernel Auto-Tuning on GPUs: Performance and Energy-Aware Optimization
    Guerreiro, Joao
    Ilic, Aleksandar
    Roma, Nuno
    Tomas, Pedro
    23RD EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP 2015), 2015, : 438 - 445
  • [29] Energy-Aware WiFi Network Selection via Forecasting Energy Consumption
    Abdrabou, Atef
    Darwish, Mohamed
    Dalao, Ahmed
    AlKaabi, Mohammed
    Abutagiya, Mahmoud
    INTERNATIONAL JOURNAL OF ELECTRONICS AND TELECOMMUNICATIONS, 2020, 66 (02) : 339 - 345
  • [30] Energy-aware mapping for tile-based NoC architectures under performance constraints
    Hu, JC
    Marculescu, R
    ASP-DAC 2003: PROCEEDINGS OF THE ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE, 2003, : 233 - 239