Orchestration of CPU and GPU Consumers for High-Performance Streaming Processing

被引：0

作者：

Rovnyagin, Mikhail M. ^{[1
]}

Gukov, Aleksey D. ^{[1
]}

Timofeev, Kirill, V ^{[1
]}

Hrapov, Alexander S. ^{[1
]}

Mitenkov, Roman A. ^{[1
]}

机构：

[1] Natl Res Nucl Univ MEPhI Moscow Engn Phys Inst, Moscow, Russia

来源：

PROCEEDINGS OF THE 2021 IEEE CONFERENCE OF RUSSIAN YOUNG RESEARCHERS IN ELECTRICAL AND ELECTRONIC ENGINEERING (ELCONRUS) | 2021年

关键词：

Kafka; consumers; CPU; GPU; failure statistic;

D O I：

10.1109/ElConRus51938.2021.9396103

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

In the modern world, there are many systems using streaming data processing. Often, these systems use CPU and GPU devices in their calculations. It should be noted that such systems can fail for various reasons. Therefore, to optimize throughput, system designers need to determine in advance how many CPUs and GPUs to configure the system with. In our article, we present a possible architecture of such a system and present what methods can be used to calculate the optimal number of CPUs and GPUs with optimal throughput and taking into account other factors, for example, the cost of devices and the failure rate of the environment.

引用

页码：623 / 626

页数：4

共 50 条

[31] INVESTIGATION OF PARALLEL DATA PROCESSING USING HYBRID HIGH PERFORMANCE CPU plus GPU SYSTEMS AND CUDA STREAMS
Czarnul, Pawel
COMPUTING AND INFORMATICS, 2020, 39 (03) : 510 - 536
[32] Query Processing on Heterogeneous CPU/GPU Systems
Rosenfeld, Viktor
Bress, Sebastian
Markl, Volker
ACM COMPUTING SURVEYS, 2023, 55 (01)
[33] A high-performance dynamic scheduling for sparse matrix-based applications on heterogeneous CPU-GPU environment
Shokrani Baigi, Ahmad
Savadi, Abdorreza
Naghibzadeh, Mahmoud
JOURNAL OF SUPERCOMPUTING, 2024, 80 (17): : 25071 - 25098
[34] High-Performance Flow Classification of Big Data Using Hybrid CPU-GPU Clusters of Cloud Environments
Fazel-Najafabadi, Azam
Abbasi, Mahdi
Attar, Hani H.
Amer, Ayman
Taherkordi, Amir
Shokrollahi, Azad
Khosravi, Mohammad R.
Solyman, Ahmed A.
TSINGHUA SCIENCE AND TECHNOLOGY, 2024, 29 (04): : 1118 - 1137
[35] Thanos: High-Performance CPU-GPU Based Balanced Graph Partitioning Using Cross-Decomposition
Kim, Dae Hee
Nagi, Rakesh
Chen, Deming
2020 25TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE, ASP-DAC 2020, 2020, : 91 - 96
[36] A high-performance multiscale space-time approach to high cycle fatigue simulation based on hybrid CPU/GPU computing
Zhang, Rui
Naboulsi, Sam
Eason, Thomas
Qian, Dong
FINITE ELEMENTS IN ANALYSIS AND DESIGN, 2019, 166
[37] Grus: Toward Unified-memory-efficient High-performance Graph Processing on GPU
Wang, Pengyu
Wang, Jing
Li, Chao
Wang, Jianzong
Zhu, Haojin
Guo, Minyi
ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION, 2021, 18 (02)
[38] HETEROGENEOUS GPU&CPU CLUSTER FOR HIGH PERFORMANCE COMPUTING IN CRYPTOGRAPHY
Marks, Michal
Jantura, Jaroslaw
Niewiadomska-Szynkiewicz, Ewa
Strzelczyk, Przemyslaw
Gozdz, Krzysztof
COMPUTER SCIENCE-AGH, 2012, 13 (02): : 63 - 79
[39] High performance computing and quantum trajectory method in CPU and GPU systems
Wisniewska, Joanna
Sawerwain, Marek
Leonski, Wieslaw
3RD INTERNATIONAL CONFERENCE ON MATHEMATICAL MODELING IN PHYSICAL SCIENCES (IC-MSQUARE 2014), 2015, 574
[40] Benchmarking of High Performance Computing Clusters with Heterogeneous CPU/GPU Architecture
Sukharev, Pavel V.
Vasilyev, Nikolay P.
Rovnyagin, Mikhail M.
Durnov, Maxim A.
PROCEEDINGS OF THE 2017 IEEE RUSSIA SECTION YOUNG RESEARCHERS IN ELECTRICAL AND ELECTRONIC ENGINEERING CONFERENCE (2017 ELCONRUS), 2017, : 574 - 577

← 1 2 3 4 5 →