Vision transformer with photonic integrated circuits

We propose an optical transformer model based on the MZI cascaded mesh architecture. By constructing the self-attention layer using MZI cascaded mesh, the model achieved 96.12&percnt; accuracy on the MNIST dataset, demonstrating the effectiveness and potential of implementing large transformer models using optical architecture.

Authors

Tianhua Xu (ORCID: https://orcid.org/0000-0002-5510-841X)
Mingyu Chang
Y. T. Yu (ORCID: https://orcid.org/0009-0000-1610-905X)
Jian Zhao (ORCID: https://orcid.org/0000-0003-1626-2673)
Haowei Sha (ORCID: https://orcid.org/0000-0002-3231-1570)

Institutions

Tianjin University (CN)
University of Warwick (GB)

Publication Details

Published: 2024-11-27
DOI: https://doi.org/10.1117/12.3037375
Citations: 1
Primary Topic: Photonic and Optical Devices
Type: article
Field-Weighted Citation Impact: 0.21

Controls

|||

ALL TIME

JAN

FEB

MAR

APR

MAY

JUN

JUL

AUG

SEP

OCT

article

Vision transformer with photonic integrated circuits

Tianhua Xu, Mingyu Chang, Y. T. Yu, Jian Zhao et al.

Nov 27, 2024

1 citations

Photonic and Optical Devices

0.21

article

Vision transformer with photonic integrated circuits

Tianhua Xu, Mingyu Chang, Y. T. Yu, Jian Zhao, Haowei Sha

November 27, 2024article en

1 citations

Abstract

We propose an optical transformer model based on the MZI cascaded mesh architecture. By constructing the self-attention layer using MZI cascaded mesh, the model achieved 96.12&percnt; accuracy on the MNIST dataset, demonstrating the effectiveness and potential of implementing large transformer models using optical architecture.

Tianjin University (CN), University of Warwick (GB)

Affordable and clean energy

Openalex Percentile: Top 46%

Photonic and Optical Devices

0.21

DOI Source OpenAlex

AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.