Efficient training of unitary optical neural networks

被引:3
|
作者
Lu, Kunrun [1 ]
Guo, Xianxin [2 ,3 ]
机构
[1] Harbin Inst Technol, Sch Sci, Weihai 264209, Shandong, Peoples R China
[2] Univ Oxford, Clarendon Lab, Parks Rd, Oxford OX1 3PU, England
[3] Lurtis Ltd, Wood Ctr Innovat, Quarry Rd, Oxford OX3 8SB, England
关键词
ALGORITHMS; DESIGN;
D O I
10.1364/OE.500544
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Deep learning has profoundly reshaped the technology landscape in numerous scientific areas and industrial sectors. This technology advancement is, nevertheless, confronted with severe bottlenecks in digital computing. Optical neural network presents a promising solution due to the ultra-high computing speed and energy efficiency. In this work, we present systematic study of unitary optical neural network (UONN) as an approach towards optical deep learning. Our results show that the UONN can be trained to high accuracy through special unitary gradient descent optimization, and the UONN is robust against physical imperfections and noises, hence it is more suitable for physical implementation than existing ONNs.
引用
收藏
页码:39616 / 39623
页数:8
相关论文
共 50 条
  • [21] EXODUS: Stable and efficient training of spiking neural networks
    Bauer, Felix C.
    Lenz, Gregor
    Haghighatshoar, Saeid
    Sheik, Sadique
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [22] Efficient Constructive Techniques for Training Switching Neural Networks
    Ferrari, Enrico
    Muselli, Marco
    CONSTRUCTIVE NEURAL NETWORKS, 2009, 258 : 25 - 48
  • [23] Efficient Training of Artificial Neural Networks for Autonomous Navigation
    Pomerleau, Dean A.
    NEURAL COMPUTATION, 1991, 3 (01) : 88 - 97
  • [24] Efficient and effective training of sparse recurrent neural networks
    Liu, Shiwei
    Ni'mah, Iftitahu
    Menkovski, Vlado
    Mocanu, Decebal Constantin
    Pechenizkiy, Mykola
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (15): : 9625 - 9636
  • [25] Accurate, efficient and scalable training of Graph Neural Networks
    Zeng, Hanqing
    Zhou, Hongkuan
    Srivastava, Ajitesh
    Kannan, Rajgopal
    Prasanna, Viktor
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2021, 147 : 166 - 183
  • [26] Data-Efficient Augmentation for Training Neural Networks
    Liu, Tian Yu
    Mirzasoleiman, Baharan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [27] Efficient Training of Low-Curvature Neural Networks
    Srinivas, Suraj
    Matoba, Kyle
    Lakkaraju, Himabindu
    Fleuret, Francois
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [28] Efficient Communications in Training Large Scale Neural Networks
    Zhao, Yiyang
    Wang, Linnan
    Wu, Wei
    Bosilca, George
    Vuduc, Richard
    Ye, Jinmian
    Tang, Wenqi
    Xu, Zenglin
    PROCEEDINGS OF THE THEMATIC WORKSHOPS OF ACM MULTIMEDIA 2017 (THEMATIC WORKSHOPS'17), 2017, : 110 - 116
  • [29] Efficient training of large neural networks for language modeling
    Schwenk, H
    2004 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2004, : 3059 - 3064
  • [30] Efficient EM training algorithm for probability neural networks
    Xiong, Hanchun
    He, Qianhua
    Li, Haizhou
    Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 1998, 26 (07): : 25 - 32