Photonics-enabled spiking timing-dependent convolutional neural network for real-time image classification

Photonic convolutional neural network with robustness against wavelength deviations

We experimentally explore the practicality of integrated multiwavelength laser arrays (MLAs) for photonic convolutional neural network (PCNN). MLAs represent excellent performance for PCNN, except for imperfect wavelength spacings due to fabrication variation. Therefore, the performance of PCNN with non-ideal wavelength spacing is investigated experimentally and numerically for the first time. The results show that there exists a certain tolerance for wavelength deviation on the degradation of the structural information of the extracted feature map, leading to the robustness of photonic recognition accuracy under non-ideal wavelength spacing. The results suggest that scalable MLAs could serve as an alternative source for the PCNN, to support low-cost optical computing scenarios. For a benchmark classification task of MNIST handwritten digits, the photonic prediction accuracy of 91.2% for stride 1 × 1 scheme using the testing dataset are experimentally obtained at speeds on the order of tera operations per second, compared to 94.14% on computer. The robust performance, flexible spectral control, low cost, large bandwidth and parallel processing capability of the PCNN driven by scalable MLAs may broaden the application possibilities of photonic neural networks in next generation data computing applications.

Compact optical convolution processing unit based on multimode interference

Convolutional neural networks are an important category of deep learning, currently facing the limitations of electrical frequency and memory access time in massive data processing. Optical computing has been demonstrated to enable significant improvements in terms of processing speeds and energy efficiency. However, most present optical computing schemes are hardly scalable since the number of optical elements typically increases quadratically with the computational matrix size. Here, a compact on-chip optical convolutional processing unit is fabricated on a low-loss silicon nitride platform to demonstrate its capability for large-scale integration. Three 2 × 2 correlated real-valued kernels are made of two multimode interference cells and four phase shifters to perform parallel convolution operations. Although the convolution kernels are interrelated, ten-class classification of handwritten digits from the MNIST database is experimentally demonstrated. The linear scalability of the proposed design with respect to computational size translates into a solid potential for large-scale integration.

Experimental demonstration of a photonic convolutional accelerator based on a monolithically integrated multi-wavelength distributed feedback laser

We propose and experimentally demonstrate a simple and energy-efficient photonic convolutional accelerator based on a monolithically integrated multi-wavelength distributed feedback semiconductor laser using the superimposed sampled Bragg grating structure. The photonic convolutional accelerator operates at 44.48 GOPS for one 2 × 2 kernel with a convolutional window vertical sliding stride of 2 and generates 100 images of real-time recognition. Furthermore, a real-time recognition task on the MNIST database of handwritten digits with a prediction accuracy of 84% is achieved. This work provides a compact and low-cost way to realize photonic convolutional neural networks.