1
|
Cheng J, Zhao Y, Zhang W, Zhou H, Huang D, Zhu Q, Guo Y, Xu B, Dong J, Zhang X. A small microring array that performs large complex-valued matrix-vector multiplication. FRONTIERS OF OPTOELECTRONICS 2022; 15:15. [PMID: 36637556 PMCID: PMC9756268 DOI: 10.1007/s12200-022-00009-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/26/2021] [Accepted: 11/02/2021] [Indexed: 06/17/2023]
Abstract
As an important computing operation, photonic matrix-vector multiplication is widely used in photonic neutral networks and signal processing. However, conventional incoherent matrix-vector multiplication focuses on real-valued operations, which cannot work well in complex-valued neural networks and discrete Fourier transform. In this paper, we propose a systematic solution to extend the matrix computation of microring arrays from the real-valued field to the complex-valued field, and from small-scale (i.e., 4 × 4) to large-scale matrix computation (i.e., 16 × 16). Combining matrix decomposition and matrix partition, our photonic complex matrix-vector multiplier chip can support arbitrary large-scale and complex-valued matrix computation. We further demonstrate Walsh-Hardmard transform, discrete cosine transform, discrete Fourier transform, and image convolutional processing. Our scheme provides a path towards breaking the limits of complex-valued computing accelerator in conventional incoherent optical architecture. More importantly, our results reveal that an integrated photonic platform is of huge potential for large-scale, complex-valued, artificial intelligence computing and signal processing.
Collapse
Affiliation(s)
- Junwei Cheng
- Wuhan National Laboratory for Optoelectronics, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Yuhe Zhao
- Wuhan National Laboratory for Optoelectronics, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Wenkai Zhang
- Wuhan National Laboratory for Optoelectronics, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Hailong Zhou
- Wuhan National Laboratory for Optoelectronics, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, 430074, China
- Photonics Research Centre, Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, Hong Kong, 999077, China
- The Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen, 518057, China
| | - Dongmei Huang
- The Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen, 518057, China
- Photonics Research Centre, Department of Electrical Engineering, The Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Qing Zhu
- Institute of Strategic Research, Huawei Technologies, Shenzhen, 518129, China
| | - Yuhao Guo
- Institute of Strategic Research, Huawei Technologies, Shenzhen, 518129, China
| | - Bo Xu
- Institute of Strategic Research, Huawei Technologies, Shenzhen, 518129, China
| | - Jianji Dong
- Wuhan National Laboratory for Optoelectronics, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, 430074, China.
| | - Xinliang Zhang
- Wuhan National Laboratory for Optoelectronics, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, 430074, China
| |
Collapse
|
2
|
Zhou H, Dong J, Cheng J, Dong W, Huang C, Shen Y, Zhang Q, Gu M, Qian C, Chen H, Ruan Z, Zhang X. Photonic matrix multiplication lights up photonic accelerator and beyond. LIGHT, SCIENCE & APPLICATIONS 2022; 11:30. [PMID: 35115497 PMCID: PMC8814250 DOI: 10.1038/s41377-022-00717-8] [Citation(s) in RCA: 48] [Impact Index Per Article: 24.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 01/07/2022] [Accepted: 01/13/2022] [Indexed: 05/09/2023]
Abstract
Matrix computation, as a fundamental building block of information processing in science and technology, contributes most of the computational overheads in modern signal processing and artificial intelligence algorithms. Photonic accelerators are designed to accelerate specific categories of computing in the optical domain, especially matrix multiplication, to address the growing demand for computing resources and capacity. Photonic matrix multiplication has much potential to expand the domain of telecommunication, and artificial intelligence benefiting from its superior performance. Recent research in photonic matrix multiplication has flourished and may provide opportunities to develop applications that are unachievable at present by conventional electronic processors. In this review, we first introduce the methods of photonic matrix multiplication, mainly including the plane light conversion method, Mach-Zehnder interferometer method and wavelength division multiplexing method. We also summarize the developmental milestones of photonic matrix multiplication and the related applications. Then, we review their detailed advances in applications to optical signal processing and artificial neural networks in recent years. Finally, we comment on the challenges and perspectives of photonic matrix multiplication and photonic acceleration.
Collapse
Affiliation(s)
- Hailong Zhou
- Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Jianji Dong
- Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, 430074, China.
| | - Junwei Cheng
- Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Wenchan Dong
- Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Chaoran Huang
- Department of Electronic Engineering, The Chinese University of Hong Kong, Shatin, Hong Kong, China
| | | | - Qiming Zhang
- Institute of Photonic Chips, University of Shanghai for Science and Technology, Shanghai, 200093, China
- Centre for Artificial-Intelligence Nanophotonics, School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Min Gu
- Institute of Photonic Chips, University of Shanghai for Science and Technology, Shanghai, 200093, China
- Centre for Artificial-Intelligence Nanophotonics, School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Chao Qian
- Interdisciplinary Center for Quantum Information, State Key Laboratory of Modern Optical Instrumentation, ZJU-Hangzhou Global Scientific and Technological Innovation Center, ZJU-UIUC Institute, Zhejiang University, Hangzhou, 310027, China
| | - Hongsheng Chen
- Interdisciplinary Center for Quantum Information, State Key Laboratory of Modern Optical Instrumentation, ZJU-Hangzhou Global Scientific and Technological Innovation Center, ZJU-UIUC Institute, Zhejiang University, Hangzhou, 310027, China
| | - Zhichao Ruan
- Interdisciplinary Center of Quantum Information, State Key Laboratory of Modern Optical Instrumentation, and Zhejiang Province Key Laboratory of Quantum Technology and Device, Department of Physics, Zhejiang University, Hangzhou, 310027, China
| | - Xinliang Zhang
- Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, 430074, China
| |
Collapse
|
3
|
A single shot coherent Ising machine based on a network of injection-locked multicore fiber lasers. Nat Commun 2019; 10:3516. [PMID: 31388011 PMCID: PMC6684570 DOI: 10.1038/s41467-019-11548-4] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2019] [Accepted: 07/18/2019] [Indexed: 11/24/2022] Open
Abstract
Combinatorial optimization problems over large and complex systems have many applications in social networks, image processing, artificial intelligence, computational biology and a variety of other areas. Finding the optimized solution for such problems in general are usually in non-deterministic polynomial time (NP)-hard complexity class. Some NP-hard problems can be easily mapped to minimizing an Ising energy function. Here, we present an analog all-optical implementation of a coherent Ising machine (CIM) based on a network of injection-locked multicore fiber (MCF) lasers. The Zeeman terms and the mutual couplings appearing in the Ising Hamiltonians are implemented using spatial light modulators (SLMs). As a proof-of-principle, we demonstrate the use of optics to solve several Ising Hamiltonians for up to thirteen nodes. Overall, the average accuracy of the CIM to find the ground state energy was ~90% for 120 trials. The fundamental bottlenecks for the scalability and programmability of the presented CIM are discussed as well. For specific computation problems where electronic digital processors have shortcomings in simulating, an analog optical system may be a solution, Here, the authors present an analog all-optical implementation of a coherent Ising machine based on a network of injection-locked multicore fiber lasers.
Collapse
|
4
|
Collins SA, Ahalt SC, Krishnamurthy AK, Stewart DF. Optical implementation and applications of closest-vector selection in neural networks. APPLIED OPTICS 1993; 32:1297-1303. [PMID: 20820263 DOI: 10.1364/ao.32.001297] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
Closest-vector selection is a process that underlies one technique for sending compressed-signal sets over noisy communication channels. Recently it has had application in radar target identification, speech and image analysis, pattern classification, and neural-net training. Various applications of closest-vector selection are discussed, and the design of an all-optical system that performs closest-vector selection is presented.
Collapse
|
5
|
Pochapsky E, Casasent DP. Acoustooptic linear heterodyned complex-valued matrix-vector processor. APPLIED OPTICS 1990; 29:2532-2543. [PMID: 20567289 DOI: 10.1364/ao.29.002532] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
A new analog (linear) optical vector-inner-product and matrix-vector processor architecture is described. It employs linear input laser-diode arrays and a multichannel acoustooptic cell. Attention is given to the selection of the operating modes for all devices, error correction, the ability of the system to operate on complex-valued data, and its stability with respect to temperature, data history, and component variations. Laboratory data are provided verifying the potential of the system architecture to achieve 9-10-bit accuracy and complex-valued multiplication.
Collapse
|
6
|
Eichmann G, Kostrzewski A, Kim DH, Li Y. Optical parallel register transfer microoperations using holographic symbolic substitutions. APPLIED OPTICS 1989; 28:3860-3863. [PMID: 20555791 DOI: 10.1364/ao.28.003860] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
Optical register transfer microoperations are proposed. Based on an optical holographic associative symbolic substitution, a hybrid optical word-parallel bit-serial register transfer processor architecture is described. Preliminary experimental results are included.
Collapse
|
7
|
de Groot PJ, Noll RJ. Reconfigurable bipolar analog optical crossbar switch. APPLIED OPTICS 1989; 28:1582-1587. [PMID: 20548703 DOI: 10.1364/ao.28.001582] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
A differential technique is proposed for obtaining bipolar analog {-1 . . . 0 . . . 1} inputs, outputs, and connection weights in a mask-type optical crossbar switch. The technique compensates for the limitations of current component technology and permits the use of inexpensive, low-contrast spatial light modulators for reconfigurable switching matrices. The conclusions of this work may be extended to design improvements in a wide variety of optical computing implementations.
Collapse
|