Strongly Universal String Hashing is Fast

被引:11
|
作者
Lemire, Daniel [1 ]
Kaser, Owen [2 ]
机构
[1] Univ Quebec, TELUQ, LICEF Res Ctr, Montreal, PQ H3C 3P8, Canada
[2] Univ New Brunswick, Dept CSAS, St John, NB E2L 4L5, Canada
来源
COMPUTER JOURNAL | 2014年 / 57卷 / 11期
基金
加拿大自然科学与工程研究理事会;
关键词
string hashing; Barrett reduction; Carry-less Multiplications; Binary finite fields; non-cryptographic hash functions; NUMBER;
D O I
10.1093/comjnl/bxt070
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We present fast strongly universal string hashing families: they can process data at a rate of 0.2 CPU cycle per byte. Maybe surprisingly, we find that these families-though they require a large buffer of random numbers-are often faster than popular hash functions with weaker theoretical guarantees. Moreover, conventional wisdom is that hash functions with fewer multiplications are faster. Yet we find that they may fail to be faster due to operation pipelining. We present experimental results on several processors including low-power processors. Our tests include hash functions designed for processors with the carry-less multiplication instruction set. We also prove, using accessible proofs, the strong universality of our families.
引用
收藏
页码:1624 / 1638
页数:15
相关论文
共 50 条
  • [41] Fast Algorithm for Anchor Graph Hashing
    Fujiwara, Yasuhiro
    Kanai, Sekitoshi
    Ida, Yasutoshi
    Kumagai, Atsutoshi
    Ueda, Naonori
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2021, 14 (06): : 916 - 928
  • [42] Fast Image Search with Distrubuted Hashing
    Durmaz, Osman
    Bilge, Hasan Sakir
    2018 26TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2018,
  • [43] Fast Plagiarism Detection by Sentence Hashing
    Ceglarek, Dariusz
    Haniewicz, Konstanty
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, PT II, 2012, 7268 : 30 - 37
  • [44] Fast Hashing with Strong Concentration Bounds
    Aamand, Anders
    Knudsen, Jakob Baek Tejs
    Knudsen, Mathias Baek Tejs
    Rasmussen, Peter Michael Reichstein
    Thorup, Mikkel
    PROCEEDINGS OF THE 52ND ANNUAL ACM SIGACT SYMPOSIUM ON THEORY OF COMPUTING (STOC '20), 2020, : 1265 - 1278
  • [45] Adaptive Hashing for Fast Similarity Search
    Cakir, Fatih
    Sclaroff, Stan
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1044 - 1052
  • [46] Fast and secure hashing based on codes
    Knudsen, L
    Preneel, B
    ADVANCES IN CRYPTOLOGY - CRYPTO'97, PROCEEDINGS, 1997, 1294 : 485 - 498
  • [47] COPING WITH STRONGLY COUPLED STRING THEORY
    BANKS, T
    DINE, M
    PHYSICAL REVIEW D, 1994, 50 (12): : 7454 - 7466
  • [48] Fast-Extract with Cube Hashing
    Schmitt, Bruno de O.
    Mishchenko, Alan
    Kravets, Victor N.
    Brayton, Robert K.
    Reis, Andre I.
    2017 22ND ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE (ASP-DAC), 2017, : 145 - 150
  • [49] Strongly Secure Universal Thresholdizer
    Ebrahimi, Ehsan
    Yadav, Anshu
    ADVANCES IN CRYPTOLOGY - ASIACRYPT 2024, PT III, 2025, 15486 : 207 - 239
  • [50] Feature hashing for fast image retrieval
    Yan, Lingyu
    Fu, Jiarun
    Zhang, Hongxin
    Yuan, Lu
    Xu, Hui
    MIPPR 2017: PATTERN RECOGNITION AND COMPUTER VISION, 2017, 10609