Strongly Universal String Hashing is Fast

被引:11
|
作者
Lemire, Daniel [1 ]
Kaser, Owen [2 ]
机构
[1] Univ Quebec, TELUQ, LICEF Res Ctr, Montreal, PQ H3C 3P8, Canada
[2] Univ New Brunswick, Dept CSAS, St John, NB E2L 4L5, Canada
来源
COMPUTER JOURNAL | 2014年 / 57卷 / 11期
基金
加拿大自然科学与工程研究理事会;
关键词
string hashing; Barrett reduction; Carry-less Multiplications; Binary finite fields; non-cryptographic hash functions; NUMBER;
D O I
10.1093/comjnl/bxt070
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We present fast strongly universal string hashing families: they can process data at a rate of 0.2 CPU cycle per byte. Maybe surprisingly, we find that these families-though they require a large buffer of random numbers-are often faster than popular hash functions with weaker theoretical guarantees. Moreover, conventional wisdom is that hash functions with fewer multiplications are faster. Yet we find that they may fail to be faster due to operation pipelining. We present experimental results on several processors including low-power processors. Our tests include hash functions designed for processors with the carry-less multiplication instruction set. We also prove, using accessible proofs, the strong universality of our families.
引用
收藏
页码:1624 / 1638
页数:15
相关论文
共 50 条
  • [21] String graph construction using incremental hashing
    Ben-Bassat, Ilan
    Chor, Benny
    BIOINFORMATICS, 2014, 30 (24) : 3515 - 3523
  • [22] Universal reconstruction of a string
    Gawrychowski, Pawel
    Kociumaka, Tomasz
    Radoszewski, Jakub
    Rytter, Wojciech
    Walen, Tomasz
    THEORETICAL COMPUTER SCIENCE, 2020, 812 : 174 - 186
  • [23] A universal string theory
    Ohta, N
    PROGRESS OF THEORETICAL PHYSICS SUPPLEMENT, 1996, (123): : 411 - 419
  • [24] ON THE UNIVERSAL STRING THEORY
    FIGUEROAOFARRILL, JM
    PHYSICS LETTERS B, 1994, 321 (04) : 344 - 348
  • [25] Strongly history-independent hashing with applications
    Blelloch, Guy E.
    Golovin, Daniel
    48TH ANNUAL IEEE SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, PROCEEDINGS, 2007, : 272 - +
  • [26] On the strongly coupled heterotic string
    Dudas, E
    Mourad, J
    PHYSICS LETTERS B, 1997, 400 (1-2) : 71 - 79
  • [27] Fast Supervised Discrete Hashing
    Gui, Jie
    Liu, Tongliang
    Sun, Zhenan
    Tao, Dacheng
    Tan, Tieniu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (02) : 490 - 496
  • [28] Fast Scalable Supervised Hashing
    Luo, Xin
    Nie, Liqiang
    He, Xiangnan
    Wu, Ye
    Chen, Zhen-Duo
    Xu, Xin-Shun
    ACM/SIGIR PROCEEDINGS 2018, 2018, : 735 - 744
  • [29] THERE IS NO FAST SINGLE HASHING ALGORITHM
    AJTAI, M
    KOMLOS, J
    SZEMEREDI, E
    INFORMATION PROCESSING LETTERS, 1978, 7 (06) : 270 - 273
  • [30] Quantum Hashing via is an element of-Universal Hashing Constructions and Classical Fingerprinting
    Ablayev, F.
    Ablayev, M.
    LOBACHEVSKII JOURNAL OF MATHEMATICS, 2015, 36 (02) : 89 - 96