Orchestration of CPU and GPU Consumers for High-Performance Streaming Processing

被引:0
|
作者
Rovnyagin, Mikhail M. [1 ]
Gukov, Aleksey D. [1 ]
Timofeev, Kirill, V [1 ]
Hrapov, Alexander S. [1 ]
Mitenkov, Roman A. [1 ]
机构
[1] Natl Res Nucl Univ MEPhI Moscow Engn Phys Inst, Moscow, Russia
关键词
Kafka; consumers; CPU; GPU; failure statistic;
D O I
10.1109/ElConRus51938.2021.9396103
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the modern world, there are many systems using streaming data processing. Often, these systems use CPU and GPU devices in their calculations. It should be noted that such systems can fail for various reasons. Therefore, to optimize throughput, system designers need to determine in advance how many CPUs and GPUs to configure the system with. In our article, we present a possible architecture of such a system and present what methods can be used to calculate the optimal number of CPUs and GPUs with optimal throughput and taking into account other factors, for example, the cost of devices and the failure rate of the environment.
引用
收藏
页码:623 / 626
页数:4
相关论文
共 50 条
  • [41] A High Performance Implementation of Spectral Clustering on CPU-GPU Platforms
    Jin, Yu
    Jaja, Joseph F.
    2016 IEEE 30TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2016, : 825 - 834
  • [42] Determining a Device Crossover Point in CPU/GPU Systems for Streaming Applications
    Kanur, Sudeep
    Lund, Wictor
    Tsiopoulos, Leonidas
    Lilius, Johan
    2015 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2015, : 1417 - 1421
  • [43] Performance Analysis of LiDAR Data Processing on Multi-Core CPU and GPU Architectures
    Alzyout, Mohammad S.
    Al Nounou, Abd Alrahman
    Tikkisetty, Yashwanth Naidu
    Alawneh, Shadi
    2024 IEEE 3RD INTERNATIONAL CONFERENCE ON COMPUTING AND MACHINE INTELLIGENCE, ICMI 2024, 2024,
  • [44] Elastic GPU Processing for Streaming Video Data
    Hanhirova, Jussi
    Sundholm, Ari
    Hirvisalo, Vesa
    2015 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2015, : 1260 - 1264
  • [45] Parallel processing of a raytracer for GPU vs. for CPU
    Liao, SW
    Du, ZH
    Wu, GS
    Lueh, GY
    PDPTA '05: Proceedings of the 2005 International Conference on Parallel and Distributed Processing Techniques and Applications, Vols 1-3, 2005, : 1024 - 1030
  • [46] CPU and GPU Parallel Processing for Mobile Augmented Reality
    Baek, A-Ram
    Lee, Kangwoon
    Choi, Haechul
    2013 6TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP), VOLS 1-3, 2013, : 133 - 137
  • [47] CPU and GPU oriented optimizations for LiDAR data processing
    Munoz, Felipe
    Asenjo, Rafael
    Navarro, Angeles
    Cabaleiro, J. Carlos
    JOURNAL OF COMPUTATIONAL SCIENCE, 2024, 79
  • [48] GPU-UPGMA: high-performance computing for UPGMA algorithm based on graphics processing units
    Lin, Yu-Shiang
    Lin, Chun-Yuan
    Hung, Che-Lun
    Chung, Yeh-Ching
    Lee, Kual-Zheng
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2015, 27 (13): : 3403 - 3414
  • [49] Multivariable inversion using exhaustive grid search and high-performance GPU processing: a new perspective
    Venetis, Ioannis E.
    Saltogianni, Vasso
    Stiros, Stathis
    Gallopoulos, Efstratios
    GEOPHYSICAL JOURNAL INTERNATIONAL, 2020, 221 (02) : 905 - 927
  • [50] ExaTN: Scalable GPU-Accelerated High-Performance Processing of General Tensor Networks at Exascale
    Lyakh, Dmitry I.
    Nguyen, Thien
    Claudino, Daniel
    Dumitrescu, Eugene
    McCaskey, Alexander J.
    FRONTIERS IN APPLIED MATHEMATICS AND STATISTICS, 2022, 8