Secure Floating-Point Training

被引:0
|
作者
Rathee, Deevashwer [1 ]
Bhattacharya, Anwesh [2 ]
Gupta, Divya [2 ]
Sharma, Rahul [2 ]
Song, Dawn [1 ]
机构
[1] Univ Calif Berkeley, Berkeley, CA 94704 USA
[2] Microsoft Res, Redmond, WA USA
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Secure 2-party computation (2PC) of floating-point arithmetic is improving in performance and recent work runs deep learning algorithms with it, while being as numerically precise as commonly used machine learning (ML) frameworks like PyTorch. We find that the existing 2PC libraries for floating-point support generic computations and lack specialized support for ML training. Hence, their latency and communication costs for compound operations (e.g., dot products) are high. We provide novel specialized 2PC protocols for compound operations and prove their precision using numerical analysis. Our implementation BEACON outperforms state-of-the-art libraries for 2PC of floating-point by over 6x.
引用
收藏
页码:6329 / 6346
页数:18
相关论文
共 50 条
  • [41] THE ACCURACY OF FLOATING-POINT SUMMATION
    HIGHAM, NJ
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1993, 14 (04): : 783 - 799
  • [42] IEEE FLOATING-POINT FORMAT
    不详
    MICROPROCESSORS AND MICROSYSTEMS, 1988, 12 (01) : 13 - 23
  • [43] Decimal Floating-Point Multiplication
    Erle, Mark A.
    Hickmann, Brian J.
    Schulte, Michael J.
    IEEE TRANSACTIONS ON COMPUTERS, 2009, 58 (07) : 902 - 916
  • [44] Customising floating-point designs
    Gaffar, AA
    Luk, W
    Cheung, PYK
    Shirazi, N
    10TH ANNUAL IEEE SYMPOSIUM ON FIELD-PROGRAMMABLE CUSTOM COMPUTING MACHINES, PROCEEDINGS, 2002, : 315 - 317
  • [45] Hammering Floating-Point Arithmetic
    Torstensson, Olle
    Weber, Tjark
    FRONTIERS OF COMBINING SYSTEMS, FROCOS 2023, 2023, 14279 : 217 - 235
  • [46] FLOATING-POINT ARITHMETIC IN COBOL
    KESNER, O
    COMMUNICATIONS OF THE ACM, 1962, 5 (05) : 269 - 271
  • [47] Tunable Floating-Point Adder
    Nannarelli, Alberto
    IEEE TRANSACTIONS ON COMPUTERS, 2019, 68 (10) : 1553 - 1560
  • [48] INCREMENTAL FLOATING-POINT CODING
    SAMSON, PR
    JOURNAL OF THE AUDIO ENGINEERING SOCIETY, 1978, 26 (7-8): : 556 - &
  • [49] On Floating-Point Normal Vectors
    Meyer, Quirin
    Sussmuth, Jochen
    Susser, Gerd
    Stamminger, Marc
    Greiner, Guenther
    COMPUTER GRAPHICS FORUM, 2010, 29 (04) : 1405 - 1409
  • [50] PREDICTIVE FLOATING-POINT AMPLIFIER
    HARRIS, R
    GEOPHYSICS, 1977, 42 (01) : 154 - 154