A Top-Down Parallel Semisort

被引:26
|
作者
Gu, Yan [1 ]
Shun, Julian [1 ]
Sun, Yihan [1 ]
Blelloch, Guy E. [1 ]
机构
[1] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
基金
美国国家科学基金会;
关键词
Parallel Algorithms; Semisorting; Integer Sorting;
D O I
10.1145/2755573.2755597
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Semisorting is the problem of reordering an input array of keys such that equal keys are contiguous but different keys are not necessarily in sorted order. Semisorting is important for collecting equal values and is widely used in practice. For example, it is the core of the MapReduce paradigm, is a key component of the database join operation, and has many other applications. We describe a (randomized) parallel algorithm for the problem that is theoretically efficient (linear work and logarithmic depth), but is designed to be more practically efficient than previous algorithms. We use ideas from the parallel integer sorting algorithm of Rajasekaran and Reif, but instead of processing bits of a integers in a reduced range in a bottom-up fashion, we process the hashed values of keys directly top-down. We implement the algorithm and experimentally show on a variety of input distributions that it outperforms a similarly-optimized radix sort on a modern 40-core machine with hyper-threading by about a factor of 1.7-1.9, and achieves a parallel speedup of up to 38x. We discuss the various optimizations used in our implementation and present an extensive experimental analysis of its performance.
引用
收藏
页码:24 / 34
页数:11
相关论文
共 50 条
  • [31] TOP-DOWN (DYNAMICAL) METHOD
    陆维明
    ScienceinChina,SerA., 1982, Ser.A.1982 (03) : 302 - 309
  • [32] Top-down transformation choice
    Hothorn, Torsten
    STATISTICAL MODELLING, 2018, 18 (3-4) : 274 - 298
  • [33] Prospects for Top-Down Derivation
    Zwart, Jan-Wouter
    CATALAN JOURNAL OF LINGUISTICS, 2009, 8 : 161 - 187
  • [34] TOP-DOWN SEMANTIC ANALYSIS
    ADORNI, G
    BOCCALATTE, A
    DIMANZO, M
    COMPUTER JOURNAL, 1984, 27 (03): : 233 - 237
  • [35] A TOP-DOWN PLAN FOR THE PENTAGON
    ZAKHEIM, DS
    ORBIS-A JOURNAL OF WORLD AFFAIRS, 1995, 39 (02): : 173 - 187
  • [36] Top-down democratization in Tanzania
    Hyden, G
    JOURNAL OF DEMOCRACY, 1999, 10 (04): : 142 - 155
  • [37] Top-Down Constitutional Conventions
    Perry, Adam
    Tucker, Adam
    MODERN LAW REVIEW, 2018, 81 (05): : 765 - 789
  • [38] A TOP-DOWN EVALUATION OF PASCAL
    DOTY, KL
    COMPUTER DESIGN, 1980, 19 (05): : 167 - 177
  • [39] TOP-DOWN (DYNAMICAL) METHOD
    陆维明
    Science China Mathematics, 1982, (03) : 302 - 309
  • [40] MODIFIED TOP-DOWN DESIGN
    SAMID, G
    DATAMATION, 1981, 27 (12): : 175 - 176