High‐Bit‐Efficiency TOPS Optical Tensor Convolutional Accelerator Using Microcombs
Abstract Tensor convolution is a fundamental operation in convolutional neural networks, especially for processing tensors, which are prevalent in real‐world applications. Current methods often convert tensor convolutions into matrix multiplications, leading to data replication, additional memory usage and increased hardware complexity. Here, a high‐bit‐efficiency optical tensor convolution accelerator with reduced data redundancy and lower memory consumption is presented. The bit‐efficiency of the optical tensor convolution accelerator is first explored, significantly improving its effective computing power by utilizing the spatial dimension. Consequently, the optical tensor convolutional accelerator operates at speeds exceeding 3 Tera Operations Per Second (TOPS)—the fastest single‐kernel optical convolutional accelerator to date, to the best of authors' knowledge. Its performance is validated on handwritten digit recognition and histopathologic cancer detection tasks, achieving 93.8% and 77% accuracy, respectively, closely matching in‐silico results. This approach simultaneously multiplexes the physical dimensions—wavelength, time, and space—and leverages the parallelism and high throughput of light, enabling efficient optical processing of tensor data with significant computational power.
Authors
- Sirui Huang (ORCID: https://orcid.org/0009-0007-7192-973X)
- Roberto Morandotti (ORCID: https://orcid.org/0000-0001-7717-1519)
- Xingyuan Xu (ORCID: https://orcid.org/0000-0002-8190-4700)
- Chan Xia (ORCID: https://orcid.org/0000-0002-1666-6339)
- Yunping Bai (ORCID: https://orcid.org/0000-0002-3747-8257)
- Kun Xu (ORCID: https://orcid.org/0000-0002-1663-9998)
- Yixuan Zheng (ORCID: https://orcid.org/0000-0001-9009-1433)
- Sai T. Chu (ORCID: https://orcid.org/0000-0001-8263-8507)
- Shuai Wang (ORCID: https://orcid.org/0000-0003-3730-6401)
- Xiaotian Zhu (ORCID: https://orcid.org/0000-0002-9306-5131)
- Chaoran Huang (ORCID: https://orcid.org/0000-0001-8205-8254)
- Shifan Chen (ORCID: https://orcid.org/0000-0001-7404-6456)
- David Moss (ORCID: https://orcid.org/0000-0001-5195-1744)
- Yuyang Liu (ORCID: https://orcid.org/0000-0002-0808-0047)
- Yifu Xu
- Xiaoyan Xu (ORCID: https://orcid.org/0009-0000-6483-7553)
- Brent E. Little
- Zhihui Liu (ORCID: https://orcid.org/0009-0003-7019-5552)
Institutions
- Beijing University of Posts and Telecommunications (CN)
- City University of Hong Kong (HK)
- Chinese University of Hong Kong (HK)
- Institut National de la Recherche Scientifique (CA)
- China Telecom (China) (CN)
- China Telecom (CN)
- Swinburne University of Technology (AU)
Publication Details
- Journal
- Laser & Photonics Review
- Published
- 2025-02-04
- DOI
- https://doi.org/10.1002/lpor.202401975
- Citations
- 14
- Primary Topic
- Neural Networks and Reservoir Computing
- Type
- article
- Field-Weighted Citation Impact
- 34.73
Funders
- National Natural Science Foundation of China
- Australian Research Council
- National Key Research and Development Program of China