Efficient training of unitary optical neural networks

被引:3
|
作者
Lu, Kunrun [1 ]
Guo, Xianxin [2 ,3 ]
机构
[1] Harbin Inst Technol, Sch Sci, Weihai 264209, Shandong, Peoples R China
[2] Univ Oxford, Clarendon Lab, Parks Rd, Oxford OX1 3PU, England
[3] Lurtis Ltd, Wood Ctr Innovat, Quarry Rd, Oxford OX3 8SB, England
关键词
ALGORITHMS; DESIGN;
D O I
10.1364/OE.500544
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Deep learning has profoundly reshaped the technology landscape in numerous scientific areas and industrial sectors. This technology advancement is, nevertheless, confronted with severe bottlenecks in digital computing. Optical neural network presents a promising solution due to the ultra-high computing speed and energy efficiency. In this work, we present systematic study of unitary optical neural network (UONN) as an approach towards optical deep learning. Our results show that the UONN can be trained to high accuracy through special unitary gradient descent optimization, and the UONN is robust against physical imperfections and noises, hence it is more suitable for physical implementation than existing ONNs.
引用
收藏
页码:39616 / 39623
页数:8
相关论文
共 50 条
  • [31] Efficient Training of Graph Neural Networks on Large Graphs
    Shen, Yanyan
    Chen, Lei
    Fang, Jingzhi
    Zhang, Xin
    Gao, Shihong
    Yin, Hongbo
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2024, 17 (12): : 4237 - 4240
  • [32] Efficient training of RBF neural networks for pattern recognition
    Lampariello, F
    Sciandrone, M
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2001, 12 (05): : 1235 - 1242
  • [33] Fully forward mode training for optical neural networks
    Xue, Zhiwei
    Zhou, Tiankuang
    Xu, Zhihao
    Yu, Shaoliang
    Dai, Qionghai
    Fang, Lu
    NATURE, 2024, 632 (8024) : 280 - 286
  • [34] Deep Unitary Convolutional Neural Networks
    Chang, Hao-Yuan
    Wang, Kang L.
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT II, 2021, 12892 : 170 - 181
  • [35] Unitary Evolution Recurrent Neural Networks
    Arjovsky, Martin
    Shah, Amar
    Bengio, Yoshua
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [36] Efficient Trainability of Linear Optical Modules in Quantum Optical Neural Networks
    Volkoff, Tyler J.
    JOURNAL OF RUSSIAN LASER RESEARCH, 2021, 42 (03) : 250 - 260
  • [37] Efficient Trainability of Linear Optical Modules in Quantum Optical Neural Networks
    Tyler J. Volkoff
    Journal of Russian Laser Research, 2021, 42 : 250 - 260
  • [38] On unitary reconstruction of linear optical networks
    Tillmann, Max
    Schmidt, Christian
    Walther, Philip
    JOURNAL OF OPTICS, 2016, 18 (11)
  • [39] Memory-Efficient Training of Binarized Neural Networks on the Edge
    Yayla, Mikail
    Chen, Jian-Jia
    PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022, 2022, : 661 - 666
  • [40] Design and Training of Binarized Neural Networks for Highly Efficient Accelerators
    Li J.
    Xu H.
    Wang Y.
    Xiao H.
    Wang Y.
    Han Y.
    Li X.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2023, 35 (06): : 961 - 969