Efficient training of unitary optical neural networks

被引:3
|
作者
Lu, Kunrun [1 ]
Guo, Xianxin [2 ,3 ]
机构
[1] Harbin Inst Technol, Sch Sci, Weihai 264209, Shandong, Peoples R China
[2] Univ Oxford, Clarendon Lab, Parks Rd, Oxford OX1 3PU, England
[3] Lurtis Ltd, Wood Ctr Innovat, Quarry Rd, Oxford OX3 8SB, England
关键词
ALGORITHMS; DESIGN;
D O I
10.1364/OE.500544
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Deep learning has profoundly reshaped the technology landscape in numerous scientific areas and industrial sectors. This technology advancement is, nevertheless, confronted with severe bottlenecks in digital computing. Optical neural network presents a promising solution due to the ultra-high computing speed and energy efficiency. In this work, we present systematic study of unitary optical neural network (UONN) as an approach towards optical deep learning. Our results show that the UONN can be trained to high accuracy through special unitary gradient descent optimization, and the UONN is robust against physical imperfections and noises, hence it is more suitable for physical implementation than existing ONNs.
引用
收藏
页码:39616 / 39623
页数:8
相关论文
共 50 条
  • [1] NearUni: Near-Unitary Training for Efficient Optical Neural Networks
    Eldebiky, Amro
    Li, Bing
    Zhang, Grace Li
    2023 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD, 2023,
  • [2] projUNN: efficient method for training deep networks with unitary matrices
    Kiani, Bobak T.
    Balestriero, Randall
    LeCun, Yann
    Lloyd, Seth
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [3] Efficient training of backpropagation neural networks
    Otair, Mohammed A.
    Salameh, Walid A.
    NEURAL NETWORK WORLD, 2006, 16 (04) : 291 - 311
  • [4] Fast and Efficient and Training of Neural Networks
    Yu, Hao
    Wilamowski
    3RD INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTION, 2010, : 175 - 181
  • [5] Efficient and Reliable Training of Neural Networks
    Yu, Hao
    Wilamowski, Bogdan M.
    HSI: 2009 2ND CONFERENCE ON HUMAN SYSTEM INTERACTIONS, 2009, : 106 - 112
  • [6] Building Efficient Deep Neural Networks with Unitary Group Convolutions
    Zhao, Ritchie
    Hu, Yuwei
    Dotzel, Jordan
    De Sa, Christopher
    Zhang, Zhiru
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11295 - 11304
  • [7] Tunable Efficient Unitary Neural Networks (EUNN) and their application to RNNs
    Li Jing
    Shen, Yichen
    Dubcek, Tena
    Peurifoy, John
    Skirlo, Scott
    LeCun, Yann
    Tegmark, Max
    Soljacic, Marin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [8] Efficient On-Chip Training of Optical Neural Networks Using Genetic Algorithm
    Zhang, Hui
    Thompson, Jayne
    Gu, Mile
    Jiang, Xu Dong
    Cai, Hong
    Liu, Patricia Yang
    Shi, Yuzhi
    Zhang, Yi
    Karim, Muhammad Faeyz
    Lo, Guo Qiang
    Luo, Xianshu
    Dong, Bin
    Kwek, Leong Chuan
    Liu, Ai Qun
    ACS PHOTONICS, 2021, 8 (06) : 1662 - 1672
  • [9] Hybrid training of optical neural networks
    Spall, James
    Guo, Xianxin
    Lvovsky, A., I
    OPTICA, 2022, 9 (07): : 803 - 811
  • [10] Strategies for training optical neural networks
    Qipeng Yang
    Bowen Bai
    Weiwei Hu
    Xingjun Wang
    National Science Open, 2022, 1 (03) : 7 - 11