Efficient Sum-Check Protocol for Convolution

被引:0
|
作者
Ju, Chanyang [1 ,2 ]
Lee, Hyeonbum [1 ,2 ]
Chung, Heewon [1 ,2 ]
Seo, Jae Hong [1 ,2 ]
Kim, Sungwook [3 ]
机构
[1] Hanyang Univ, Dept Math, Seoul 04763, South Korea
[2] Hanyang Univ, Res Inst Nat Sci, Seoul 64763, South Korea
[3] Seoul Womens Univ, Dept Informat Secur, Seoul 01797, South Korea
基金
新加坡国家研究基金会;
关键词
Verifiable computation; matrix multiplication; convolutional neural networks; interactive proofs; sum-check protocol;
D O I
10.1109/ACCESS.2021.3133442
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many applications have recently adopted machine learning and deep learning techniques. Convolutional neural networks (CNNs) are made up of sequential operations including activation, pooling, convolution, and fully connected layer, and their computation cost is enormous, with convolution and fully connected layer dominating. In general, a user with insufficient computer capacity delegated certain tasks to a server with sufficient computing power, and the user may want to verify that the outputs are truly machine learning model predictions. In this paper, we are interested in verifying that the delegation of CNNs, one of the deep learning models for image recognition and classification, is correct. Specifically, we focus on the verifiable computation of matrix multiplications in a CNN convolutional layer. We use Thaler's idea (CRYPTO 2013) for validating matrix multiplication operations and present a predicate function based on the insight that the sequence of operations can be viewed as sequential matrix multiplication. Furthermore, we lower the cost of proving by splitting a convolution operation into two halves. As a result, we can provide an efficient sum-check protocol for a convolution operation that, like the state-of-the-art zkCNN (ePrint 2021) approach, achieves asymptotically optimal proving cost. The suggested protocol is about 2x cheaper than zkCNN in terms of communication costs. We also propose a verified inference system based on our method as the fundamental building component.
引用
收藏
页码:164047 / 164059
页数:13
相关论文
共 50 条
  • [31] Experimental check of the GDH sum rule at MAMI and ELSA
    Krimmer, J
    CZECHOSLOVAK JOURNAL OF PHYSICS, 2003, 53 : B215 - B222
  • [32] Check Sum Computing in Doubly Frustrated Microtubule Clusters
    Pietruszka, Mariusz
    Lipowczan, Marcin
    NEUROQUANTOLOGY, 2014, 12 (03) : 344 - 349
  • [33] Experimental check of the GDH sum rule at MAMI and ELSA
    Krimmer, J
    HADRON SPECTROSCOPY, 2002, 619 : 514 - 517
  • [34] The Gaussian Sum Convolution Probability Hypothesis Density Filter
    Yin, Jian Jun
    Zhang, Jian Qiu
    Zhuang, Ze Sen
    ICSP: 2008 9TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, VOLS 1-5, PROCEEDINGS, 2008, : 280 - 283
  • [35] CONVOLUTION SUM OF DIVISOR FUNCTIONS GIVEN THE CONDITIONS OF COPRIME†
    Lee, Soung Douk
    Kim, Daeyeoul
    JOURNAL OF APPLIED MATHEMATICS & INFORMATICS, 2023, 41 (06): : 1227 - 1235
  • [36] Non-Existence of Convolution Sum System Representations
    Boche, Holger
    Moenich, Ullrich J.
    Meinerzhagen, Bernd
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (10) : 2649 - 2664
  • [37] Ramanujan's convolution sum twisted by Dirichlet characters
    Aygin, Zafer Selcuk
    Hong, Nankun
    INTERNATIONAL JOURNAL OF NUMBER THEORY, 2019, 15 (01) : 137 - 152
  • [38] Experimental check of the GDH sum rule at MAMI and ELSA
    Braghieri, A
    NUCLEAR PHYSICS A, 2005, 755 : 350C - 352C
  • [39] ON DETERMINING A SUM OF CLOSE DISTRIBUTIONS FROM THEIR CONVOLUTION VALUES
    RONKIN, AL
    YLANOVSKII, AM
    THEORY OF PROBABILITY AND ITS APPLICATIONS, 1988, 32 (04) : 730 - 734
  • [40] ON THE SOLUTION OF THE CONVOLUTION EQUATION WITH A SUM-DIFFERENCE KERNEL
    Barseghyan, A. G.
    VESTNIK SAMARSKOGO GOSUDARSTVENNOGO TEKHNICHESKOGO UNIVERSITETA-SERIYA-FIZIKO-MATEMATICHESKIYE NAUKI, 2015, 19 (04): : 613 - 623