Enhancing Throughput of Scalable Distributed Two-layer Data Structures

Scalability of data and throughput are important features of modern applications designed for distributed and loosely-coupled computer systems. In the paper, throughput scalable two-layer structures, called Throughput Scalability for SD2DS (TS2DS), are introduced. For maximum efficiency, the structures are stored in a distributed RAM of a multicomputer. Every data unit of TS2DS (a component) is split into two parts: a header and a body, located in distinct layers of the structure. For maximum flexibility, both layers are managed independently. Reference Counters are used to control the activity of the components and of the buckets. The most active components are mirrored to keep the throughput high. Two variants of the TS2DS, with different managemenent of Reference Counters, are introduced and evaluated.