Efficient Sum-Check Protocol for Convolution

被引:0
|
作者
Ju, Chanyang [1 ,2 ]
Lee, Hyeonbum [1 ,2 ]
Chung, Heewon [1 ,2 ]
Seo, Jae Hong [1 ,2 ]
Kim, Sungwook [3 ]
机构
[1] Hanyang Univ, Dept Math, Seoul 04763, South Korea
[2] Hanyang Univ, Res Inst Nat Sci, Seoul 64763, South Korea
[3] Seoul Womens Univ, Dept Informat Secur, Seoul 01797, South Korea
基金
新加坡国家研究基金会;
关键词
Verifiable computation; matrix multiplication; convolutional neural networks; interactive proofs; sum-check protocol;
D O I
10.1109/ACCESS.2021.3133442
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many applications have recently adopted machine learning and deep learning techniques. Convolutional neural networks (CNNs) are made up of sequential operations including activation, pooling, convolution, and fully connected layer, and their computation cost is enormous, with convolution and fully connected layer dominating. In general, a user with insufficient computer capacity delegated certain tasks to a server with sufficient computing power, and the user may want to verify that the outputs are truly machine learning model predictions. In this paper, we are interested in verifying that the delegation of CNNs, one of the deep learning models for image recognition and classification, is correct. Specifically, we focus on the verifiable computation of matrix multiplications in a CNN convolutional layer. We use Thaler's idea (CRYPTO 2013) for validating matrix multiplication operations and present a predicate function based on the insight that the sequence of operations can be viewed as sequential matrix multiplication. Furthermore, we lower the cost of proving by splitting a convolution operation into two halves. As a result, we can provide an efficient sum-check protocol for a convolution operation that, like the state-of-the-art zkCNN (ePrint 2021) approach, achieves asymptotically optimal proving cost. The suggested protocol is about 2x cheaper than zkCNN in terms of communication costs. We also propose a verified inference system based on our method as the fundamental building component.
引用
收藏
页码:164047 / 164059
页数:13
相关论文
共 50 条
  • [1] Efficient KZG-Based Univariate Sum-Check and Lookup Argument
    Zhang, Yuncong
    Sun, Shi-Feng
    Gu, Dawu
    PUBLIC-KEY CRYPTOGRAPHY, PT II, PKC 2024, 2024, 14602 : 400 - 425
  • [2] Enhanced low-density parity-check codes based on sum-check blocks
    Lin, Jingli
    Jing, Longjiang
    Zhu, Weile
    Yang, Chen
    2006 INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CIRCUITS AND SYSTEMS PROCEEDINGS, VOLS 1-4: VOL 1: SIGNAL PROCESSING, 2006, : 735 - +
  • [3] Efficient check sum computation
    Research Disclosure, 1998, (414):
  • [4] IP protocol identification method using the pattern match and check sum
    Yang, Jie
    Liu, Congfeng
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2012, 39 (03): : 149 - 153
  • [5] Efficient Collusion-Resisting Secure Sum Protocol
    Zhu Youwen
    Huang Liusheng
    Yang Wei
    Yuan Xing
    CHINESE JOURNAL OF ELECTRONICS, 2011, 20 (03): : 407 - 413
  • [6] Efficient check node update implementation for normalized Min-Sum algorithm
    Xin, Lu
    Liang Yongsheng
    Jun, Xu
    TENCON 2007 - 2007 IEEE REGION 10 CONFERENCE, VOLS 1-3, 2007, : 989 - +
  • [7] Conditional termination check min-sum algorithm for efficient LDPC decoders
    Cho, Keol
    Chung, Ki-Seok
    IEICE ELECTRONICS EXPRESS, 2015, 12 (24):
  • [8] On a shifted convolution sum problem
    Munshi, Ritabrata
    JOURNAL OF NUMBER THEORY, 2022, 230 : 225 - 232
  • [9] An Efficient Check Node Operation Circuit for Min-Sum Based LDPC Decoder
    Cho, Keol
    Chung, Ki-Seok
    18TH IEEE INTERNATIONAL SYMPOSIUM ON CONSUMER ELECTRONICS (ISCE 2014), 2014,
  • [10] Evaluate the Convolution Integral and Convolution Sum Use Compact formula
    Ren Bin
    Yu De-yong
    2011 7TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING (WICOM), 2011,