Parallelization and multi-threaded latency constrained parallel coding of JPEG XS

This paper discusses the background, challenges, opportunities for parallelization of low-latency video transport of JPEG XS streams over the real-time network protocol (RTP). Transport of compressed video signals over a constant bitrate channel requires smoothing buffers at encoder and decoder side. To limit their sizes in partical implementations, part 2 of the JPEG XS standard defines a normative buffer model along a sequential hypothetical reference decoder. Due to its sequential nature, it cannot be directly applied to high-speed applications that necessarily depend on multithreading. In this paper, the JPEG XS Part 2 buffer model is introduced, then the current state of JPEG XS RTP transport standardization is discussed, and multiple strategies for multithreaded encoding under latency contraints within this application are reported and analyzed.