Strongly Universal String Hashing is Fast

被引:11
|
作者
Lemire, Daniel [1 ]
Kaser, Owen [2 ]
机构
[1] Univ Quebec, TELUQ, LICEF Res Ctr, Montreal, PQ H3C 3P8, Canada
[2] Univ New Brunswick, Dept CSAS, St John, NB E2L 4L5, Canada
来源
COMPUTER JOURNAL | 2014年 / 57卷 / 11期
基金
加拿大自然科学与工程研究理事会;
关键词
string hashing; Barrett reduction; Carry-less Multiplications; Binary finite fields; non-cryptographic hash functions; NUMBER;
D O I
10.1093/comjnl/bxt070
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We present fast strongly universal string hashing families: they can process data at a rate of 0.2 CPU cycle per byte. Maybe surprisingly, we find that these families-though they require a large buffer of random numbers-are often faster than popular hash functions with weaker theoretical guarantees. Moreover, conventional wisdom is that hash functions with fewer multiplications are faster. Yet we find that they may fail to be faster due to operation pipelining. We present experimental results on several processors including low-power processors. Our tests include hash functions designed for processors with the carry-less multiplication instruction set. We also prove, using accessible proofs, the strong universality of our families.
引用
收藏
页码:1624 / 1638
页数:15
相关论文
共 50 条
  • [1] Even strongly universal hashing is pretty fast
    Thorup, M
    PROCEEDINGS OF THE ELEVENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, 2000, : 496 - 497
  • [2] Strongly universal hashing and identification codes via channels
    Kurosawa, K
    Yoshida, T
    IEEE TRANSACTIONS ON INFORMATION THEORY, 1999, 45 (06) : 2091 - 2095
  • [3] String unification, universal one-loop corrections and strongly coupled heterotic string theory
    Nilles, HP
    Stieberger, S
    NUCLEAR PHYSICS B, 1997, 499 (1-2) : 3 - 28
  • [4] EXTENDIBLE HASHING WITH UNIVERSAL CLASS OF HASHING FUNCTIONS
    Sridevi, G. M.
    Ashoka, D., V
    Ramakrishna, M., V
    INTERNATIONAL JOURNAL ON INFORMATION TECHNOLOGIES AND SECURITY, 2021, 13 (01): : 51 - 66
  • [5] UNIVERSAL HASHING IN VLSI
    FURER, M
    LECTURE NOTES IN COMPUTER SCIENCE, 1988, 319 : 312 - 318
  • [6] Variationally universal hashing
    Krovetz, Ted
    Rogaway, Phillip
    INFORMATION PROCESSING LETTERS, 2006, 100 (01) : 36 - 39
  • [7] String Hashing for Linear Probing
    Thorup, Mikkel
    PROCEEDINGS OF THE TWENTIETH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, 2009, : 655 - 664
  • [8] Strongly Constrained Discrete Hashing
    Chen, Yong
    Tian, Zhibao
    Zhang, Hui
    Wang, Jun
    Zhang, Dell
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 3596 - 3611
  • [9] A fast and scalable string matching algorithm using contents correction signature hashing for network IDS
    Wang, J. S.
    Kwak, H. K.
    Jung, Y. J.
    Kwon, H. U.
    Kim, C. G.
    Chung, K. S.
    IEICE ELECTRONICS EXPRESS, 2008, 5 (22) : 949 - 953
  • [10] Energy scalable universal hashing
    Kaps, JP
    Yüksel, K
    Sunar, B
    IEEE TRANSACTIONS ON COMPUTERS, 2005, 54 (12) : 1484 - 1495