TOPS‐Speed Reconfigurable Photonic Transposed Convolution Accelerator for Generative Tasks
ABSTRACT Transposed convolution, crucial in large‐parameter generative models ranging from content creation to autonomous driving, imposes substantial demands on GPU memory and energy consumption in electronic processors. Electronic processors, fundamentally limited by the von Neumann architecture and further hindered by silicon‐based quantum tunneling effects, struggle to meet the stringent real‐time requirements of modern generative workloads. In contrast, optical computing—exploiting ultra‐wide bandwidth and ultra‐low power consumption—offers a promising alternative for high‐speed transposed convolution in next‐generation AI. Here, we introduce a high‐speed and reconfigurable photonic transposed convolution accelerator (PTCA). By interleaving wavelength, temporal, and spatial dimensions and leveraging an integrated Kerr microcomb for data‐dimension expansion, the PTCA achieves tera operations per second (TOPS) with 100% bit efficiency. Experiments demonstrate a processing speed of 1.026 TOPS, making it, to the best of our knowledge, the fastest reconfigurable PTCA to date. In Fashion‐MNIST reconstruction tasks, this system achieves a mean squared error (MSE) of 0.0062 without any additional post‐processing by electronic fully connected layers. Our work thus establishes a high‐speed, reconfigurable photonic paradigm for accelerating future generative AI.
Authors
- Roberto Morandotti (ORCID: https://orcid.org/0000-0001-7717-1519)
- Xingyuan Xu (ORCID: https://orcid.org/0000-0002-8190-4700)
- Chan Xia (ORCID: https://orcid.org/0000-0002-1666-6339)
- Yunping Bai (ORCID: https://orcid.org/0000-0002-3747-8257)
- Kun Xu (ORCID: https://orcid.org/0000-0002-1663-9998)
- Yixuan Zheng (ORCID: https://orcid.org/0000-0001-9009-1433)
- Sai T. Chu (ORCID: https://orcid.org/0000-0001-8263-8507)
- Sha Zhu (ORCID: https://orcid.org/0000-0001-6725-5145)
- Xiaotian Zhu (ORCID: https://orcid.org/0000-0002-9306-5131)
- Shifan Chen (ORCID: https://orcid.org/0000-0001-7404-6456)
- Brent E. Little (ORCID: https://orcid.org/0000-0002-6031-4509)
- David Moss (ORCID: https://orcid.org/0000-0001-5195-1744)
- Yuyang Liu (ORCID: https://orcid.org/0000-0002-0808-0047)
- Yifu Xu
- Zhihui Liu (ORCID: https://orcid.org/0009-0003-7019-5552)
Institutions
- Beijing University of Posts and Telecommunications (CN)
- City University of Hong Kong (HK)
- Nankai University (CN)
- Institut National de la Recherche Scientifique (CA)
- Xi'an University of Technology (CN)
- China Telecom (China) (CN)
- China Telecom (CN)
- Swinburne University of Technology (AU)
Publication Details
- Journal
- Laser & Photonics Review
- Published
- 2025-11-02
- DOI
- https://doi.org/10.1002/lpor.202500771
- Primary Topic
- Neural Networks and Reservoir Computing
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Beijing University of Posts and Telecommunications
- State Key Laboratory of Information Photonics and Optical Communications
- National Key Research and Development Program of China