Inverse-designed integrated all-optical nonlinear activators for optical computing

Optical neural networks (ONNs) have been considered as an alternative solution to overcome the arithmetic and energy bottlenecks of electronic neural networks. However, the widespread implementation of ONNs is hindered by their lack of optical nonlinearity. In this work, three ultra-compact all-optical nonlinear activators are inverse-designed by combining the adjoint method and Kerr nonlinearity. The nonlinear response is mainly generated by the Kerr and the thermo-optic (TO) effect associated with the nonlinear refractive index. Transmission-as-computation and structure-as-function are realized, with a minimum activation threshold of 2.34 mW. In addition, we validated the feasibility and capability of the proposed method against benchmark machine learning tasks, in which the addition of nonlinear activation functions significantly improved the expressive power of the ONN, increasing the testing accuracy obtained from the Modified National Institute of Standards and Technology (MNIST) task from 88.15% to 93.25%. The proposed ONN framework with our nonlinear activators exhibited good robustness against phase errors in the network topology. We believe that this study contributes to the future development of large-scale chip-level ONNs.

Authors

Institutions

Publication Details

Journal
Optics Express
Published
2024-08-26
DOI
https://doi.org/10.1364/oe.531679
Citations
7
Primary Topic
Neural Networks and Reservoir Computing
Type
article
Field-Weighted Citation Impact
2.43

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Inverse-designed integrated all-optical nonlinear activators for optical computing

Zhouyuan Yan, Jiajing He, Ningning Dong, Jun Wang et al.
7 citations
Optics Express
Neural Networks and Reservoir Computing
2.43
article

Inverse-designed integrated all-optical nonlinear activators for optical computing

Zhouyuan Yan, Jiajing He, Ningning Dong, Jun Wang, Xiaobo Li, Yang Zhan, Yibiao Hu
article en
7 citations

Abstract

Optical neural networks (ONNs) have been considered as an alternative solution to overcome the arithmetic and energy bottlenecks of electronic neural networks. However, the widespread implementation of ONNs is hindered by their lack of optical nonlinearity. In this work, three ultra-compact all-optical nonlinear activators are inverse-designed by combining the adjoint method and Kerr nonlinearity. The nonlinear response is mainly generated by the Kerr and the thermo-optic (TO) effect associated with the nonlinear refractive index. Transmission-as-computation and structure-as-function are realized, with a minimum activation threshold of 2.34 mW. In addition, we validated the feasibility and capability of the proposed method against benchmark machine learning tasks, in which the addition of nonlinear activation functions significantly improved the expressive power of the ONN, increasing the testing accuracy obtained from the Modified National Institute of Standards and Technology (MNIST) task from 88.15% to 93.25%. The proposed ONN framework with our nonlinear activators exhibited good robustness against phase errors in the network topology. We believe that this study contributes to the future development of large-scale chip-level ONNs.

Optics ExpressVol. 32(19)
University of Chinese Academy of Sciences (CN), Center for Excellence in Education (US)
National Natural Science Foundation of China
Affordable and clean energy
Openalex Percentile: Top 10%
Neural Networks and Reservoir Computing
2.43
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Inverse-designed integrated all-optical nonlinear activators for optical computing — Zhouyuan Yan, Jiajing He, et al. · Optics Express (2024) | TGRS Research Map | TGRS