High Performance Computing: From Deep Learning to Data Engineering

被引：1
|
作者：
Fox, Geoffrey [1 ]
机构：
[1] Indiana Univ, Bloomington, IN 47405 USA
来源：
2020 IEEE 34TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW 2020) | 2020年
关键词：
D O I：
10.1109/IPDPSW50202.2020.00164
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
We describe how High-Performance Computing (HPC) can be used to enhance Big Data and Machine Learning (ML) systems (HPC for ML) but also how machine learning can be used to enhance system execution (ML for HPC). We review the different aspects of data engineering needed to process large scale data and how it is implemented in the Twister2 system combined with PyTorch and TensorFlow. We discuss the different forms of parallelism seen in deep learning with a focus on pipelined parallelism over layers
引用
收藏
页码：988 / 988
页数：1
相关论文
共 50 条
  • [1] Breast histopathology with high-performance computing and deep learning
    Graziani M.
    Eggel I.
    Deligand F.
    Bobák M.
    Andrearczyk V.
    Müller H.
    Computing and Informatics, 2021, 39 (04) : 780 - 807
  • [2] High performance reconfigurable computing for numerical simulation and deep learning
    Lin Gan
    Ming Yuan
    Jinzhe Yang
    Wenlai Zhao
    Wayne Luk
    Guangwen Yang
    CCF Transactions on High Performance Computing, 2020, 2 : 196 - 208
  • [3] High performance reconfigurable computing for numerical simulation and deep learning
    Gan, Lin
    Yuan, Ming
    Yang, Jinzhe
    Zhao, Wenlai
    Luk, Wayne
    Yang, Guangwen
    CCF TRANSACTIONS ON HIGH PERFORMANCE COMPUTING, 2020, 2 (02) : 196 - 208
  • [4] BREAST HISTOPATHOLOGY WITH HIGH-PERFORMANCE COMPUTING AND DEEP LEARNING
    Graziani, Mara
    Eggel, Ivan
    Deligand, Francois
    Bobak, Martin
    Andrearczyk, Vincent
    Mueller, Henning
    COMPUTING AND INFORMATICS, 2020, 39 (04) : 780 - 807
  • [5] Wind Prediction Using Deep Learning and High Performance Computing
    Manero, Jaume
    Bejar, Javier
    Cortes, Ulises
    HIGH PERFORMANCE COMPUTING, CARLA 2021, 2022, 1540 : 193 - 207
  • [6] Towards Prediction of Turbulent Flows at High Reynolds Numbers Using High Performance Computing Data and Deep Learning
    Bode, Mathis
    Gauding, Michael
    Gobbert, Jens Henrik
    Liao, Baohao
    Jitsev, Jenia
    Pitsch, Heinz
    HIGH PERFORMANCE COMPUTING, ISC HIGH PERFORMANCE 2018, 2018, 11203 : 614 - 623
  • [7] DRAS: Deep Reinforcement Learning for Cluster Scheduling in High Performance Computing
    Fan, Yuping
    Li, Boyang
    Favorite, Dustin
    Singh, Naunidh
    Childers, Taylor
    Rich, Paul
    Allcock, William
    Papka, Michael E.
    Lan, Zhiling
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (12) : 4903 - 4917
  • [8] High performance computing in science and engineering
    Magoules, Frederic
    Topping, Barry H. V.
    ADVANCES IN ENGINEERING SOFTWARE, 2007, 38 (05) : 285 - 286
  • [9] High performance computing in engineering and science
    Resch, M
    COMPUTATIONAL SCIENCE AND HIGH PERFORMANCE COMPUTING, 2005, 88 : 29 - 46
  • [10] Containerized deep learning in agriculture: Orchestrating GoogleNet with Kubernetes on high performance computing
    Hasan, Syed Humaid
    Hasan, Syeda Huyam
    Khan, Usman Ali
    Hasan, Syed Hamid
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024, 36 (15):
12345