High Performance Computing: From Deep Learning to Data Engineering

被引:1
|
作者
Fox, Geoffrey [1 ]
机构
[1] Indiana Univ, Bloomington, IN 47405 USA
关键词
D O I
10.1109/IPDPSW50202.2020.00164
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We describe how High-Performance Computing (HPC) can be used to enhance Big Data and Machine Learning (ML) systems (HPC for ML) but also how machine learning can be used to enhance system execution (ML for HPC). We review the different aspects of data engineering needed to process large scale data and how it is implemented in the Twister2 system combined with PyTorch and TensorFlow. We discuss the different forms of parallelism seen in deep learning with a focus on pipelined parallelism over layers
引用
收藏
页码:988 / 988
页数:1
相关论文
共 50 条
  • [21] High performance computing tools in science and engineering
    Francisco Almeida
    Jesús Vigo-Aguiar
    The Journal of Supercomputing, 2013, 65 : 997 - 998
  • [22] High performance computing tools in science and engineering
    Almeida, Francisco
    Vigo-Aguiar, Jesus
    JOURNAL OF SUPERCOMPUTING, 2013, 65 (03): : 997 - 998
  • [23] Deep Reinforcement Learning with Different Rewards for Scheduling in High-Performance Computing Systems
    Reza, Md Farhadur
    Zhao, Bo
    2021 IEEE INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS), 2021, : 183 - 186
  • [24] High Performance Computing Data Centers
    Beaty, Donald L.
    ASHRAE JOURNAL, 2013, 55 (12) : 142 - 144
  • [25] High performance computing with geographical data
    Clematis, A
    Mineter, M
    Marciano, R
    PARALLEL COMPUTING, 2003, 29 (10) : 1275 - 1279
  • [26] High Performance Computing needs high performance data management
    Kleese, K
    PROCEEDINGS OF THE HIGH PERFORMANCE COMPUTING SYMPOSIUM - HPC '99, 1999, : 331 - 336
  • [27] SIMCAN: A simulator to improve the learning of distributed and high-performance computing systems in engineering degrees
    Nunez, Alberto
    Manoso, Carolina
    de Madrid, Angel P.
    Pickin, Simon
    COMPUTER APPLICATIONS IN ENGINEERING EDUCATION, 2019, 27 (05) : 1126 - 1138
  • [28] AFFORDABLE HIGH PERFORMANCE COMPUTING FOR ACADEMIC & ENGINEERING RESEARCH
    Das, Abhishek
    Misra, Goldi
    Kurkure, Nisha
    Das, Shweta
    EDULEARN13: 5TH INTERNATIONAL CONFERENCE ON EDUCATION AND NEW LEARNING TECHNOLOGIES, 2013, : 569 - 572
  • [29] High Performance Computing education in an Indian engineering institute
    Neelima, B.
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2017, 105 : 73 - 82
  • [30] High-Performance Computing and Engineering Applications in Electromagnetics
    Yuan, Ning
    Li, Joshua Le-Wei
    Hu, Jun
    Bhardwaj, Ashutosh
    INTERNATIONAL JOURNAL OF ANTENNAS AND PROPAGATION, 2012, 2012