High Performance Computing: From Deep Learning to Data Engineering

被引：1
|
作者：
Fox, Geoffrey [1 ]
机构：
[1] Indiana Univ, Bloomington, IN 47405 USA
来源：
2020 IEEE 34TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW 2020) | 2020年
关键词：
D O I：
10.1109/IPDPSW50202.2020.00164
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
We describe how High-Performance Computing (HPC) can be used to enhance Big Data and Machine Learning (ML) systems (HPC for ML) but also how machine learning can be used to enhance system execution (ML for HPC). We review the different aspects of data engineering needed to process large scale data and how it is implemented in the Twister2 system combined with PyTorch and TensorFlow. We discuss the different forms of parallelism seen in deep learning with a focus on pipelined parallelism over layers
引用
收藏
页码：988 / 988
页数：1
相关论文
共 50 条
  • [41] Machine learning and Big Data in deep underground engineering
    Nandi, Asoke
    Zhang, Ru
    Zhao, Tao
    Lei, Tao
    DEEP UNDERGROUND SCIENCE AND ENGINEERING, 2025,
  • [42] High Performance Data Engineering Everywhere
    Widanage, Chathura
    Perera, Niranda
    Abeykoon, Vibhatha
    Kamburugamuve, Supun
    Kanewala, Thejaka Amila
    Maithree, Hasara
    Wickramasinghe, Pulasthi
    Uyar, Ahmet
    Gunduz, Gurhan
    Fox, Geoffrey
    2020 IEEE INTERNATIONAL CONFERENCE ON SMART DATA SERVICES (SMDS 2020), 2020, : 122 - 132
  • [43] On the Dynamics of Non-IID Data in Federated Learning and High-Performance Computing
    Annunziata, Daniela
    Canzaniello, Marzia
    Chiaro, Diletta
    Izzo, Stefano
    Savoia, Martina
    Piccialli, Francesco
    2024 32ND EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING, PDP 2024, 2024, : 230 - 237
  • [44] Remote Sensing Big Data Classification with High Performance Distributed Deep Learning
    Sedona, Rocco
    Cavallaro, Gabriele
    Jitsev, Jenia
    Strube, Alexandre
    Riedel, Morris
    Benediktsson, Jon Atli
    REMOTE SENSING, 2019, 11 (24)
  • [45] Workshop on high performance data intensive computing
    Zhang, Yunquan
    Zhang, Ji-Lin
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2016, 28 (06): : 1695 - 1696
  • [46] Data distribution specification for high performance computing
    Zima, HP
    JOURNAL OF UNIVERSAL COMPUTER SCIENCE, 2001, 7 (08): : 736 - 753
  • [47] A High Performance Computing Framework for Data Mining
    Goyal, Navneet
    Balasubramaniam, Sundar
    Goyal, Poonam
    Islam, Saiyedul
    Sati, Mohit
    2016 23RD IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING WORKSHOPS (HIPCW 2016), 2016, : 11 - 18
  • [48] High-Performance Computing for Data Analytics
    Perrin, Dimitri
    Bezbradica, Marija
    Crane, Martin
    Ruskin, Heather J.
    Duhamel, Christophe
    2012 IEEE/ACM 16TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL TIME APPLICATIONS (DS-RT), 2012, : 234 - 242
  • [49] High performance data intensive computing - HPDIC
    Cerin, Christophe
    Jiang, Cong-Feng
    1688, IEEE Computer Society
  • [50] Machine Learning and High-Performance Computing Hybrid Systems, a New Way of Performance Acceleration in Engineering and Scientific Applications
    Gepner, Pawel
    PROCEEDINGS OF THE 2021 16TH CONFERENCE ON COMPUTER SCIENCE AND INTELLIGENCE SYSTEMS (FEDCSIS), 2021, : 27 - 36
12345