Secure Floating-Point Training

被引:0
|
作者
Rathee, Deevashwer [1 ]
Bhattacharya, Anwesh [2 ]
Gupta, Divya [2 ]
Sharma, Rahul [2 ]
Song, Dawn [1 ]
机构
[1] Univ Calif Berkeley, Berkeley, CA 94704 USA
[2] Microsoft Res, Redmond, WA USA
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Secure 2-party computation (2PC) of floating-point arithmetic is improving in performance and recent work runs deep learning algorithms with it, while being as numerically precise as commonly used machine learning (ML) frameworks like PyTorch. We find that the existing 2PC libraries for floating-point support generic computations and lack specialized support for ML training. Hence, their latency and communication costs for compound operations (e.g., dot products) are high. We provide novel specialized 2PC protocols for compound operations and prove their precision using numerical analysis. Our implementation BEACON outperforms state-of-the-art libraries for 2PC of floating-point by over 6x.
引用
收藏
页码:6329 / 6346
页数:18
相关论文
共 50 条
  • [31] PARANOIA - A FLOATING-POINT BENCHMARK
    KARPINSKI, R
    BYTE, 1985, 10 (02): : 223 - &
  • [32] ROUNDINGS IN FLOATING-POINT ARITHMETIC
    YOHE, JM
    IEEE TRANSACTIONS ON COMPUTERS, 1973, C 22 (06) : 577 - 586
  • [33] ACCURATE FLOATING-POINT SUMMATION
    MALCOLM, MA
    COMMUNICATIONS OF THE ACM, 1971, 14 (11) : 731 - &
  • [34] FLOATING-POINT SURVIVAL KIT
    WILSON, P
    BYTE, 1988, 13 (03): : 217 - &
  • [35] AN ANALYSIS OF FLOATING-POINT ADDITION
    SWEENEY, DW
    IBM SYSTEMS JOURNAL, 1965, 4 (01) : 31 - 42
  • [36] Termination of floating-point computations
    Serebrenik, A
    De Schreye, D
    JOURNAL OF AUTOMATED REASONING, 2005, 34 (02) : 141 - 177
  • [37] Optimal Architecture of Floating-Point Arithmetic for Neural Network Training Processors
    Junaid, Muhammad
    Arslan, Saad
    Lee, TaeGeon
    Kim, HyungWon
    SENSORS, 2022, 22 (03)
  • [38] A decimal floating-point specification
    Cowlishaw, MF
    Schwarz, EM
    Smith, RM
    Webb, CF
    ARITH-15 2001: 15TH SYMPOSIUM ON COMPUTER ARITHMETIC, PROCEEDINGS, 2001, : 147 - 154
  • [39] FORTH FLOATING-POINT PACKAGE
    MONROE, AJ
    DR DOBBS JOURNAL, 1982, 7 (09): : 16 - &
  • [40] FLOATING-POINT NUMBER LISP
    UMEMURA, K
    SOFTWARE-PRACTICE & EXPERIENCE, 1991, 21 (10): : 1015 - 1026