Orchestration of CPU and GPU Consumers for High-Performance Streaming Processing

In the modern world, there are many systems using streaming data processing. Often, these systems use CPU and GPU devices in their calculations. It should be noted that such systems can fail for various reasons. Therefore, to optimize throughput, system designers need to determine in advance how many CPUs and GPUs to configure the system with. In our article, we present a possible architecture of such a system and present what methods can be used to calculate the optimal number of CPUs and GPUs with optimal throughput and taking into account other factors, for example, the cost of devices and the failure rate of the environment.