Parallel convolutional processing using an integrated photonic tensor core

Integrated convolutional kernel based on two-dimensional photonic crystals

Optical neural networks (ONNs) exhibit significant potential for accelerating artificial intelligence task processing due to their low latency, high bandwidth, and parallel processing capabilities. Photonic crystals (PhCs) are extensively utilized in integrated optoelectronics because of their unique photonic bandgap properties and precise control of light waves. In this study, we propose an optical reconfigurable convolutional kernel based on PhCs. This kernel can perform convolutional operations on weights by constructing a PhC weight bank. The convolutional kernel demonstrates exceptional performance within the developed optical convolutional neural network framework, successfully realizing various image edge processing tasks. It achieves blind recognition accuracies of 97.81% for the MNIST dataset and 80.31% for the Fashion-MNIST dataset. This study not only demonstrates the feasibility of constructing optical neural networks based on PhCs but to our knowledge, also offers new avenues for the future development of optical computing.

Scalable Synaptic Transistor Memory from Solution-Processed Carbon Nanotubes for High-Speed Neuromorphic Data Processing

Neural networks as a core information processing technology in machine learning and artificial intelligence demand substantial computational resources to deal with the extensive multiply-accumulate operations. Neuromorphic computing is an emergent solution to address this problem, allowing the computation performed in memory arrays in parallel with high efficiencies conforming to the neural networks. Here, scalable synaptic transistor memories are developed from solution-sorted carbon nanotubes. The transistors exhibit a large switching ratio of over 105, a significant memory window of ≈12 V arising from charge trapping, and low response delays down to tens of nanoseconds. These device characteristics endow highly stabilized reconfigurable conductance states, successful emulation of synaptic functions, and a high data processing speed. Importantly, the devices exhibit uniform characteristic metrics, e.g., with a 1.8% variation in the memory window, suggesting an industrial-scale manufacturing capability of the fabrication. Using the memories, a hardware convolution kernel is designed and parallel image processing is demonstrated at a speed of 1 M bit per second per input channel. Given the efficacy of the convolution kernel, a promising prospect of the memories in implementing neuromorphic computing is envisaged. To explore the potential, large-scale convolution kernels are simulated and high-speed video processing is realized for autonomous driving.

120 GOPS Photonic tensor core in thin-film lithium niobate for inference and in situ training

Photonics offers a transformative approach to artificial intelligence (AI) and neuromorphic computing by enabling low-latency, high-speed, and energy-efficient computations. However, conventional photonic tensor cores face significant challenges in constructing large-scale photonic neuromorphic networks. Here, we propose a fully integrated photonic tensor core, consisting of only two thin-film lithium niobate (TFLN) modulators, a III-V laser, and a charge-integration photoreceiver. Despite its simple architecture, it is capable of implementing an entire layer of a neural network with a computational speed of 120 GOPS, while also allowing flexible adjustment of the number of inputs (fan-in) and outputs (fan-out). Our tensor core supports rapid in-situ training with a weight update speed of 60 GHz. Furthermore, it successfully classifies (supervised learning) and clusters (unsupervised learning) 112  × 112-pixel images through in-situ training. To enable in-situ training for clustering AI tasks, we offer a solution for performing multiplications between two negative numbers.

Ultra-broadband all-optical nonlinear activation function enabled by MoTe2/optical waveguide integrated devices

All-optical nonlinear activation functions (NAFs) are crucial for enabling rapid optical neural networks (ONNs). As linear matrix computation advances in integrated ONNs, on-chip all-optical NAFs face challenges such as limited integration, high latency, substantial power consumption, and a high activation threshold. In this work, we develop an integrated nonlinear optical activator based on the butt-coupling integration of two-dimensional (2D) MoTe2 and optical waveguides (OWGs). The activator exhibits an ultra-broadband response from visible to near-infrared wavelength, a low activation threshold of 0.94 μW, a small device size (~50 µm2), an ultra-fast response rate (2.08 THz), and high-density integration. The excellent nonlinear effects and broadband response of 2D materials have been utilized to create all-optical NAFs. These activators were applied to simulate MNIST handwritten digit recognition, achieving an accuracy of 97.6%. The results underscore the potential application of this approach in ONNs. Moreover, the classification of more intricate CIFAR-10 images demonstrated a generalizable accuracy of 94.6%. The present nonlinear activator promises a general platform for three-dimensional (3D) ultra-broadband ONNs with dense integration and low activation thresholds by integrating a variety of strong nonlinear optical (NLO) materials (e.g., 2D materials) and OWGs in glass.

Surface Lattice Resonance Lasers with Epitaxial InP Gain Medium

Surface lattice resonance (SLR) lasers, where the gain is supplied by a thin-film active material and the feedback comes from multiple scattering by plasmonic nanoparticles, have shown both low threshold lasing and tunability of the angular and spectral emission at room temperature. However, typically used materials such as organic dyes and QD films suffer from photodegradation, which hampers practical applications. Here, we demonstrate photostable single-mode lasing of SLR modes sustained in an epitaxial solid-state InP slab waveguide. The nanoparticle array is weakly coupled to the optical modes, which decreases the scattering losses and hence the experimental lasing threshold is as low as 94.99 ± 0.82 μJ cm2 pulse-1. The nanoparticle periodicity defines the lasing wavelength and enables tunable emission wavelengths over a 70 nm spectral range. Combining plasmonic nanoparticles with an epitaxial solid-state gain medium paves the way for large-area on-chip integrated SLR lasers for applications, including optical communication, optical computing, sensing, and LiDAR.

Photonic neuromorphic accelerators for event-based imaging flow cytometry

In this work, we present experimental results of a high-speed label-free imaging cytometry system that seamlessly merges the high-capturing rate and data sparsity of an event-based CMOS camera with lightweight photonic neuromorphic processing. This combination offers high classification accuracy and a massive reduction in the number of trainable parameters of the digital machine-learning back-end. The event-based camera is capable of capturing 1 Gevents/sec, where events correspond to pixel contrast changes, similar to the retina's ganglion cell function. The photonic neuromorphic accelerator is based on a hardware-friendly passive optical spectrum slicing technique that is able to extract meaningful features from the generated spike-trains using a purely analogue version of the convolutional operation. The experimental scenario comprises the discrimination of artificial polymethyl methacrylate calibrated beads, having different diameters, flowing at a mean speed of 0.1 m/sec. Classification accuracy, using only lightweight digital machine-learning schemes has topped at 98.2%. On the other hand, by experimentally pre-processing the raw spike data through the proposed photonic neuromorphic spectrum slicer at a rate of 3 × 106 images per second, we achieved an accuracy of 98.6%. This performance was accompanied by a reduction in the number of trainable parameters at the classification back-end by a factor ranging from 8 to 22, depending on the configuration of the digital neural network. These results confirm that neuromorphic sensing and neuromorphic computing can be efficiently merged to a unified bio-inspired system, offering a holistic enhancement in emerging bio-imaging applications.

Deep learning with photonic neural cellular automata

Rapid advancements in deep learning over the past decade have fueled an insatiable demand for efficient and scalable hardware. Photonics offers a promising solution by leveraging the unique properties of light. However, conventional neural network architectures, which typically require dense programmable connections, pose several practical challenges for photonic realizations. To overcome these limitations, we propose and experimentally demonstrate Photonic Neural Cellular Automata (PNCA) for photonic deep learning with sparse connectivity. PNCA harnesses the speed and interconnectivity of photonics, as well as the self-organizing nature of cellular automata through local interactions to achieve robust, reliable, and efficient processing. We utilize linear light interference and parametric nonlinear optics for all-optical computations in a time-multiplexed photonic network to experimentally perform self-organized image classification. We demonstrate binary (two-class) classification of images using as few as 3 programmable photonic parameters, achieving high experimental accuracy with the ability to also recognize out-of-distribution data. The proposed PNCA approach can be adapted to a wide range of existing photonic hardware and provides a compelling alternative to conventional photonic neural networks by maximizing the advantages of light-based computing whilst mitigating their practical challenges. Our results showcase the potential of PNCA in advancing photonic deep learning and highlights a path for next-generation photonic computers.

Information processing at the speed of light

In recent years, quantum computing has made significant strides, particularly in light-based technology. The introduction of quantum photonic chips has ushered in an era marked by scalability, stability, and cost-effectiveness, paving the way for innovative possibilities within compact footprints. This article provides a comprehensive exploration of photonic quantum computing, covering key aspects such as encoding information in photons, the merits of photonic qubits, and essential photonic device components including light squeezers, quantum light sources, interferometers, photodetectors, and waveguides. The article also examines photonic quantum communication and internet, and its implications for secure systems, detailing implementations such as quantum key distribution and long-distance communication. Emerging trends in quantum communication and essential reconfigurable elements for advancing photonic quantum internet are discussed. The review further navigates the path towards establishing scalable and fault-tolerant photonic quantum computers, highlighting quantum computational advantages achieved using photons. Additionally, the discussion extends to programmable photonic circuits, integrated photonics and transformative applications. Lastly, the review addresses prospects, implications, and challenges in photonic quantum computing, offering valuable insights into current advancements and promising future directions in this technology.

Spatiotemporally modulated full-polarized light emission for multiplexed optical encryption

Spatiotemporal control of full freedoms of polarized light emission is crucial in multiplexed optical computing, encryption and communication. Although recent advancements have been made in active emission or passive conversion of polarized light through solution-processed nanomaterials or metasurfaces, these design paths usually encounter limitations, such as small polarization degrees, low light utilization efficiency, limited polarization states, and lack of spatiotemporal control. Here, we addressed these challenges by integrating the spatiotemporal modulation of the LED device, the precise control and efficient polarization emission through nanomaterial assembly, and the programmable patterning/positioning using 3D printing. We achieved an extremely high degree of polarization for both linearly and circularly polarized emission from ultrathin inorganic nanowires and quantum nanorods thanks to the shear-force-induced alignment effect during the protruding of printing filaments. Real-time polarization modulation covering the entire Poincaré sphere can be conveniently obtained through the programming of the on-off state of each LED pixel. Further, the output polarization states can be encoded by an ordered chiral plasmonic film. Our device provides an excellent platform for multiplexing spatiotemporal polarization information, enabling visible light communication with an exceptionally elevated level of physical layer security and multifunctional encrypted displays that can encode both 2D and 3D information.

Optical neural networks: progress and challenges

Artificial intelligence has prevailed in all trades and professions due to the assistance of big data resources, advanced algorithms, and high-performance electronic hardware. However, conventional computing hardware is inefficient at implementing complex tasks, in large part because the memory and processor in its computing architecture are separated, performing insufficiently in computing speed and energy consumption. In recent years, optical neural networks (ONNs) have made a range of research progress in optical computing due to advantages such as sub-nanosecond latency, low heat dissipation, and high parallelism. ONNs are in prospect to provide support regarding computing speed and energy consumption for the further development of artificial intelligence with a novel computing paradigm. Herein, we first introduce the design method and principle of ONNs based on various optical elements. Then, we successively review the non-integrated ONNs consisting of volume optical components and the integrated ONNs composed of on-chip components. Finally, we summarize and discuss the computational density, nonlinearity, scalability, and practical applications of ONNs, and comment on the challenges and perspectives of the ONNs in the future development trends.

High-coherence parallelization in integrated photonics

Coherent optics has profoundly impacted diverse applications ranging from communications, LiDAR to quantum computations. However, developing coherent systems in integrated photonics comes at great expense in hardware integration and energy efficiency. Here we demonstrate a high-coherence parallelization strategy for advanced integrated coherent systems at minimal cost. By using a self-injection locked microcomb to injection lock distributed feedback lasers, we achieve a record high on-chip gain of 60 dB with no degradation in coherence. This strategy enables highly coherent channels with linewidths down to 10 Hz and power over 20 dBm. The overall electrical-to-optical efficiency reaches 19%, comparable to that of advanced semiconductor lasers. This method supports a silicon photonic communication link with an unprecedented data rate beyond 60 Tbit/s and reduces phase-related DSP consumption by 99.99999% compared to traditional III-V laser pump schemes. This work paves the way for realizing scalable, high-performance coherent integrated photonic systems, potentially benefiting numerous applications.

Mode Conversion Trimming in Asymmetric Directional Couplers Enabled by Silicon Ion Implantation

An on-chip asymmetric directional coupler (DC) can convert fundamental modes to higher-order modes and is one of the core components of mode-division multiplexing (MDM) technology. In this study, we propose that waveguides of the asymmetric DC can be trimmed by silicon ion implantation to tune the effective refractive index and facilitate mode conversion into higher-order modes. Through this method of tuning, transmission changes of up to 18 dB have been realized with one ion implantation step. In addition, adjusting the position of the ion implantation on the waveguide can provide a further degree of control over the transmission into the resulting mode. The results of this work present a promising new route for the development of high-efficiency, low-loss mode converters for integrated photonic platforms, and aim to facilitate the application of MDM technology in emerging photonic neuromorphic computing.

Harnessing the capabilities of VCSELs: unlocking the potential for advanced integrated photonic devices and systems

Vertical cavity surface emitting lasers (VCSELs) have emerged as a versatile and promising platform for developing advanced integrated photonic devices and systems due to their low power consumption, high modulation bandwidth, small footprint, excellent scalability, and compatibility with monolithic integration. By combining these unique capabilities of VCSELs with the functionalities offered by micro/nano optical structures (e.g. metasurfaces), it enables various versatile energy-efficient integrated photonic devices and systems with compact size, enhanced performance, and improved reliability and functionality. This review provides a comprehensive overview of the state-of-the-art versatile integrated photonic devices/systems based on VCSELs, including photonic neural networks, vortex beam emitters, holographic devices, beam deflectors, atomic sensors, and biosensors. By leveraging the capabilities of VCSELs, these integrated photonic devices/systems open up new opportunities in various fields, including artificial intelligence, large-capacity optical communication, imaging, biosensing, and so on. Through this comprehensive review, we aim to provide a detailed understanding of the pivotal role played by VCSELs in integrated photonics and highlight their significance in advancing the field towards efficient, compact, and versatile photonic solutions.

Octave-spanning Kerr soliton frequency combs in dispersion- and dissipation-engineered lithium niobate microresonators

Dissipative Kerr solitons from optical microresonators, commonly referred to as soliton microcombs, have been developed for a broad range of applications, including precision measurement, optical frequency synthesis, and ultra-stable microwave and millimeter wave generation, all on a chip. An important goal for microcombs is self-referencing, which requires octave-spanning bandwidths to detect and stabilize the comb carrier envelope offset frequency. Further, detection and locking of the comb spacings are often achieved using frequency division by electro-optic modulation. The thin-film lithium niobate photonic platform, with its low loss, strong second- and third-order nonlinearities, as well as large Pockels effect, is ideally suited for these tasks. However, octave-spanning soliton microcombs are challenging to demonstrate on this platform, largely complicated by strong Raman effects hindering reliable fabrication of soliton devices. Here, we demonstrate entirely connected and octave-spanning soliton microcombs on thin-film lithium niobate. With appropriate control over microresonator free spectral range and dissipation spectrum, we show that soliton-inhibiting Raman effects are suppressed, and soliton devices are fabricated with near-unity yield. Our work offers an unambiguous method for soliton generation on strongly Raman-active materials. Further, it anticipates monolithically integrated, self-referenced frequency standards in conjunction with established technologies, such as periodically poled waveguides and electro-optic modulators, on thin-film lithium niobate.

Restoration of motion-blurred numeral image using a complex-amplitude diffractive processor

We propose a complex-amplitude diffractive processor based on diffractive deep neural networks (D2NNs). By precisely controlling the propagation of an optical field, it can effectively remove the motion blur in numeral images and realize the restoration. Comparative analysis of phase-only, amplitude-only, and complex-amplitude diffractive processor reveals that the complex-amplitude network significantly enhances the performance of the processor and improves the peak signal-to-noise ratio (PSNR) of the images. Appropriate use of complex-amplitude networks contributes to reduce the number of network layers and alleviates alignment difficulties. Due to its fast processing speed and low power consumption, complex-amplitude diffractive processors hold potential applications in various fields including road monitoring, sports photography, satellite imaging, and medical diagnostics.

Tunable optical matrix convolution of 20-Gbit/s QPSK 2-D data with a kernel using optical wave mixing

Compared to its electronic counterpart, optically performed matrix convolution can accommodate phase-encoded data at high rates while avoiding optical-to-electronic-to-optical (OEO) conversions. We experimentally demonstrate a reconfigurable matrix convolution of quadrature phase-shift keying (QPSK)-encoded input data. The two-dimensional (2-D) input data is serialized, and its time-shifted replicas are generated. This 2-D data is convolved with a 1-D kernel with coefficients, which are applied by adjusting the relative phase and amplitude of the kernel pumps. Time-shifted data replicas (TSDRs) and kernel pumps are coherently mixed using nonlinear wave mixing in a periodically poled lithium niobate (PPLN) waveguide. To show the tunability and reconfigurability of this approach, we vary the kernel coefficients, kernel sizes (e.g., 2 × 1 or 3 × 1), and input data rates (e.g., 6-20 Gbit/s). The convolution results are verified to be error-free under an applied: (a) 2 × 1 kernel, resulting in a 16-quadrature amplitude modulation (QAM) output with an error vector magnitude (EVM) of ∼5.1-8.5%; and (b) 3 × 1 kernel, resulting in a 64-QAM output with an EVM of ∼4.9-5.5%.

Development of Photonic In-Sensor Computing Based on a Mid-Infrared Silicon Waveguide Platform

Neuromorphic in-sensor computing has provided an energy-efficient solution to smart sensor design and on-chip data processing. In recent years, various free-space-configured optoelectronic chips have been demonstrated for on-chip neuromorphic vision processing. However, on-chip waveguide-based in-sensor computing with different data modalities is still lacking. Here, by integrating a responsivity-tunable graphene photodetector onto the silicon waveguide, an on-chip waveguide-based in-sensor processing unit is realized in the mid-infrared wavelength range. The weighting operation is achieved by dynamically tuning the bias of the photodetector, which could reach 4 bit weighting precision. Three different neural network tasks are performed to demonstrate the capabilities of our device. First, image preprocessing is performed for handwritten digits and fashion product classification as a general task. Next, resistive-type glove sensor signals are reversed and applied to the photodetector as an input for gesture recognition. Finally, spectroscopic data processing for binary gas mixture classification is demonstrated by utilizing the broadband performance of the device from 3.65 to 3.8 μm. By extending the wavelength from near-infrared to mid-infrared, our work shows the capability of a waveguide-integrated tunable graphene photodetector as a viable weighting solution for photonic in-sensor computing. Furthermore, such a solution could be used for large-scale neuromorphic in-sensor computing in photonic integrated circuits at the edge.

Photonic topological phase transition induced by material phase transition

Photonic topological insulators (PTIs) have been proposed as an analogy to topological insulators in electronic systems. In particular, two-dimensional PTIs have gained attention for the integrated circuit applications. However, controlling the topological phase after fabrication is difficult because the photonic topology requires the built-in specific structures. This study experimentally demonstrates the band inversion in two-dimensional PTI induced by the phase transition of deliberately designed nanopatterns of a phase change material, Ge2Sb2Te5 (GST), which indicates the first observation of the photonic topological phase transition in two-dimensional PTI with changes in the Chern number. This approach allows us to directly alter the topological invariants, which is achieved by symmetry-breaking perturbation through GST nanopatterns with different symmetry from original PTI. The success of our scheme is attributed to the ultrafine lithographic alignment technologies of GST nanopatterns. These results demonstrate how to control photonic topological properties in a reconfigurable manner, providing insight into the possibilities for reconfigurable photonic processing circuits.

Multimodal Artificial Synapses for Neuromorphic Application

The rapid development of neuromorphic computing has led to widespread investigation of artificial synapses. These synapses can perform parallel in-memory computing functions while transmitting signals, enabling low-energy and fast artificial intelligence. Robots are the most ideal endpoint for the application of artificial intelligence. In the human nervous system, there are different types of synapses for sensory input, allowing for signal preprocessing at the receiving end. Therefore, the development of anthropomorphic intelligent robots requires not only an artificial intelligence system as the brain but also the combination of multimodal artificial synapses for multisensory sensing, including visual, tactile, olfactory, auditory, and taste. This article reviews the working mechanisms of artificial synapses with different stimulation and response modalities, and presents their use in various neuromorphic tasks. We aim to provide researchers in this frontier field with a comprehensive understanding of multimodal artificial synapses.

Self-Suppressed Quantum-Limited Timing Jitter and Fundamental Noise Limit of Soliton Microcombs

Quantum-limited timing jitter of soliton microcombs has long been recognized as their fundamental noise limit. Here, we surpass such limit by utilizing dispersive wave dynamics in multimode microresonators. Through the viscous force provided by these dispersive waves, the quantum-limited timing jitter can be suppressed to a much lower level that forms the ultimate fundamental noise limit of soliton microcombs. Our findings enable coherence engineering of soliton microcombs in the quantum regime, providing critical guidelines for using soliton microcombs to synthesize ultralow-noise microwave and optical signals.

Unveiling cutting-edge developments: architectures and nanostructured materials for application in optoelectronic artificial synapses

One possible result of low-level characteristics in the traditional von Neumann formulation system is brain-inspired photonics technology based on human brain idea. Optoelectronic neural devices, which are accustomed to imitating the sensory role of biological synapses by adjusting connection measures, can be used to fabricate highly reliable neurologically calculating devices. In this case, nanosized materials and device designs are attracting attention since they provide numerous potential benefits in terms of limited cool contact, rapid transfer fluidity, and the capture of photocarriers. In addition, the combination of classic nanosized photodetectors with recently generated digital synapses offers promising results in a variety of practical applications, such as data processing and computation. Herein, we present the progress in constructing improved optoelectronic synaptic devices that rely on nanomaterials, for example, 0-dimensional (quantum dots), 1-dimensional, and 2-dimensional composites, besides the continuously developing mixed heterostructures. Furthermore, the challenges and potential prospects linked with this field of study are discussed in this paper.

Fully forward mode training for optical neural networks

Optical computing promises to improve the speed and energy efficiency of machine learning applications1-6. However, current approaches to efficiently train these models are limited by in silico emulation on digital computers. Here we develop a method called fully forward mode (FFM) learning, which implements the compute-intensive training process on the physical system. The majority of the machine learning operations are thus efficiently conducted in parallel on site, alleviating numerical modelling constraints. In free-space and integrated photonics, we experimentally demonstrate optical systems with state-of-the-art performances for a given network size. FFM learning shows training the deepest optical neural networks with millions of parameters achieves accuracy equivalent to the ideal model. It supports all-optical focusing through scattering media with a resolution of the diffraction limit; it can also image in parallel the objects hidden outside the direct line of sight at over a kilohertz frame rate and can conduct all-optical processing with light intensity as weak as subphoton per pixel (5.40 × 1018- operations-per-second-per-watt energy efficiency) at room temperature. Furthermore, we prove that FFM learning can automatically search non-Hermitian exceptional points without an analytical model. FFM learning not only facilitates orders-of-magnitude-faster learning processes, but can also advance applied and theoretical fields such as deep neural networks, ultrasensitive perception and topological photonics.

Partial coherence enhances parallelized photonic computing

Advancements in optical coherence control1-5 have unlocked many cutting-edge applications, including long-haul communication, light detection and ranging (LiDAR) and optical coherence tomography6-8. Prevailing wisdom suggests that using more coherent light sources leads to enhanced system performance and device functionalities9-11. Our study introduces a photonic convolutional processing system that takes advantage of partially coherent light to boost computing parallelism without substantially sacrificing accuracy, potentially enabling larger-size photonic tensor cores. The reduction of the degree of coherence optimizes bandwidth use in the photonic convolutional processing system. This breakthrough challenges the traditional belief that coherence is essential or even advantageous in integrated photonic accelerators, thereby enabling the use of light sources with less rigorous feedback control and thermal-management requirements for high-throughput photonic computing. Here we demonstrate such a system in two photonic platforms for computing applications: a photonic tensor core using phase-change-material photonic memories that delivers parallel convolution operations to classify the gaits of ten patients with Parkinson's disease with 92.2% accuracy (92.7% theoretically) and a silicon photonic tensor core with embedded electro-absorption modulators (EAMs) to facilitate 0.108 tera operations per second (TOPS) convolutional processing for classifying the Modified National Institute of Standards and Technology (MNIST) handwritten digits dataset with 92.4% accuracy (95.0% theoretically).

Pyramid diffractive optical networks for unidirectional image magnification and demagnification

Diffractive deep neural networks (D2NNs) are composed of successive transmissive layers optimized using supervised deep learning to all-optically implement various computational tasks between an input and output field-of-view. Here, we present a pyramid-structured diffractive optical network design (which we term P-D2NN), optimized specifically for unidirectional image magnification and demagnification. In this design, the diffractive layers are pyramidally scaled in alignment with the direction of the image magnification or demagnification. This P-D2NN design creates high-fidelity magnified or demagnified images in only one direction, while inhibiting the image formation in the opposite direction-achieving the desired unidirectional imaging operation using a much smaller number of diffractive degrees of freedom within the optical processor volume. Furthermore, the P-D2NN design maintains its unidirectional image magnification/demagnification functionality across a large band of illumination wavelengths despite being trained with a single wavelength. We also designed a wavelength-multiplexed P-D2NN, where a unidirectional magnifier and a unidirectional demagnifier operate simultaneously in opposite directions, at two distinct illumination wavelengths. Furthermore, we demonstrate that by cascading multiple unidirectional P-D2NN modules, we can achieve higher magnification factors. The efficacy of the P-D2NN architecture was also validated experimentally using terahertz illumination, successfully matching our numerical simulations. P-D2NN offers a physics-inspired strategy for designing task-specific visual processors.

Multimodal deep learning using on-chip diffractive optics with in situ training capability

Multimodal deep learning plays a pivotal role in supporting the processing and learning of diverse data types within the realm of artificial intelligence generated content (AIGC). However, most photonic neuromorphic processors for deep learning can only handle a single data modality (either vision or audio) due to the lack of abundant parameter training in optical domain. Here, we propose and demonstrate a trainable diffractive optical neural network (TDONN) chip based on on-chip diffractive optics with massive tunable elements to address these constraints. The TDONN chip includes one input layer, five hidden layers, and one output layer, and only one forward propagation is required to obtain the inference results without frequent optical-electrical conversion. The customized stochastic gradient descent algorithm and the drop-out mechanism are developed for photonic neurons to realize in situ training and fast convergence in the optical domain. The TDONN chip achieves a potential throughput of 217.6 tera-operations per second (TOPS) with high computing density (447.7 TOPS/mm2), high system-level energy efficiency (7.28 TOPS/W), and low optical latency (30.2 ps). The TDONN chip has successfully implemented four-class classification in different modalities (vision, audio, and touch) and achieve 85.7% accuracy on multimodal test sets. Our work opens up a new avenue for multimodal deep learning with integrated photonic processors, providing a potential solution for low-power AI large models using photonic technology.

I/O-efficient iterative matrix inversion with photonic integrated circuits

Photonic integrated circuits have been extensively explored for optical processing with the aim of breaking the speed and energy efficiency bottlenecks of digital electronics. However, the input/output (IO) bottleneck remains one of the key barriers. Here we report a photonic iterative processor (PIP) for matrix-inversion-intensive applications. The direct reuse of inputted data in the optical domain unlocks the potential to break the IO bottleneck. We demonstrate notable IO advantages with a lossless PIP for real-valued matrix inversion and integral-differential equation solving, as well as a coherent PIP with optical loops integrated on-chip, enabling complex-valued computation and a net inversion time of 1.2 ns. Furthermore, we estimate at least an order of magnitude enhancement in IO efficiency of a PIP over photonic single-pass processors and the state-of-the-art electronic processors for reservoir training tasks and multiple-input and multiple-output (MIMO) precoding tasks, indicating the huge potential of PIP technology in practical applications.

Optoelectronic Devices for In-Sensor Computing

The demand for accurate perception of the physical world leads to a dramatic increase in sensory nodes. However, the transmission of massive and unstructured sensory data from sensors to computing units poses great challenges in terms of power-efficiency, transmission bandwidth, data storage, time latency, and security. To efficiently process massive sensory data, it is crucial to achieve data compression and structuring at the sensory terminals. In-sensor computing integrates perception, memory, and processing functions within sensors, enabling sensory terminals to perform data compression and data structuring. Here, vision sensors are adopted as an example and discuss the functions of electronic, optical, and optoelectronic hardware for visual processing. Particularly, hardware implementations of optoelectronic devices for in-sensor visual processing that can compress and structure multidimensional vision information are examined. The underlying resistive switching mechanisms of volatile/nonvolatile optoelectronic devices and their processing operations are explored. Finally, a perspective on the future development of optoelectronic devices for in-sensor computing is provided.

Super-resolution diffractive neural network for all-optical direction of arrival estimation beyond diffraction limits

Wireless sensing of the wave propagation direction from radio sources lays the foundation for communication, radar, navigation, etc. However, the existing signal processing paradigm for the direction of arrival estimation requires the radio frequency electronic circuit to demodulate and sample the multichannel baseband signals followed by a complicated computing process, which places the fundamental limit on its sensing speed and energy efficiency. Here, we propose the super-resolution diffractive neural networks (S-DNN) to process electromagnetic (EM) waves directly for the DOA estimation at the speed of light. The multilayer meta-structures of S-DNN generate super-oscillatory angular responses in local angular regions that can perform the all-optical DOA estimation with angular resolutions beyond the diffraction limit. The spatial-temporal multiplexing of passive and reconfigurable S-DNNs is utilized to achieve high-resolution DOA estimation over a wide field of view. The S-DNN is validated for the DOA estimation of multiple radio sources over 5 GHz frequency bandwidth with estimation latency over two to four orders of magnitude lower than the state-of-the-art commercial devices in principle. The results achieve the angular resolution over an order of magnitude, experimentally demonstrated with four times, higher than diffraction-limited resolution. We also apply S-DNN's edge computing capability, assisted by reconfigurable intelligent surfaces, for extremely low-latency integrated sensing and communication with low power consumption. Our work is a significant step towards utilizing photonic computing processors to facilitate various wireless sensing and communication tasks with advantages in both computing paradigms and performance over electronic computing.

Nanowatt all-optical 3D perception for mobile robotics

Three-dimensional (3D) perception is vital to drive mobile robotics' progress toward intelligence. However, state-of-the-art 3D perception solutions require complicated postprocessing or point-by-point scanning, suffering computational burden, latency of tens of milliseconds, and additional power consumption. Here, we propose a parallel all-optical computational chipset 3D perception architecture (Aop3D) with nanowatt power and light speed. The 3D perception is executed during the light propagation over the passive chipset, and the captured light intensity distribution provides a direct reflection of the depth map, eliminating the need for extensive postprocessing. The prototype system of Aop3D is tested in various scenarios and deployed to a mobile robot, demonstrating unprecedented performance in distance detection and obstacle avoidance. Moreover, Aop3D works at a frame rate of 600 hertz and a power consumption of 33.3 nanowatts per meta-pixel experimentally. Our work is promising toward next-generation direct 3D perception techniques with light speed and high energy efficiency.

Li Promoting Long Afterglow Organic Light-Emitting Transistor for Memory Optocoupler Module

The artificial brain is conceived as advanced intelligence technology, capable to emulate in-memory processes occurring in the human brain by integrating synaptic devices. Within this context, improving the functionality of synaptic transistors to increase information processing density in neuromorphic chips is a major challenge in this field. In this article, Li-ion migration promoting long afterglow organic light-emitting transistors, which display exceptional postsynaptic brightness of 7000 cd m-2 under low operational voltages of 10 V is presented. The postsynaptic current of 0.1 mA operating as a built-in threshold switch is implemented as a firing point in these devices. The setting-condition-triggered long afterglow is employed to drive the photoisomerization process of photochromic molecules that mimic neurotransmitter transfer in the human brain for realizing a key memory rule, that is, the transition from long-term memory to permanent memory. The combination of setting-condition-triggered long afterglow with photodiode amplifiers is also processed to emulate the human responding action after the setting-training process. Overall, the successful integration in neuromorphic computing comprising stimulus judgment, photon emission, transition, and encoding,  to emulate the complicated decision tree of the human brain is demonstrated.

Perfect linear optics using silicon photonics

Recently there has been growing interest in using photonics to perform the linear algebra operations of neuromorphic and quantum computing applications, aiming at harnessing silicon photonics' (SiPho) high-speed and energy-efficiency credentials. Accurately mapping, however, a matrix into optics remains challenging, since state-of-the-art optical architectures are sensitive to fabrication imperfections. This leads to reduced fidelity that degrades as the insertion losses of the optical matrix nodes or the matrix dimensions increase. In this work, we present the experimental deployment of a 4 × 4 coherent crossbar (Xbar) as a silicon chip and validate experimentally its theoretically predicted fidelity restoration credentials. We demonstrate the experimental implementation of 10,000 arbitrary linear transformations achieving a record-high fidelity of 99.997% ± 0.002, limited mainly by the measurement equipment. Our work represents an integrated optical circuit providing almost unity and loss-independent fidelity in the realization of arbitrary matrices, highlighting light's credentials in resolving complex computations.

Photonics for Neuromorphic Computing: Fundamentals, Devices, and Opportunities

In the dynamic landscape of Artificial Intelligence (AI), two notable phenomena are becoming predominant: the exponential growth of large AI model sizes and the explosion of massive amount of data. Meanwhile, scientific research such as quantum computing and protein synthesis increasingly demand higher computing capacities. As the Moore's Law approaches its terminus, there is an urgent need for alternative computing paradigms that satisfy this growing computing demand and break through the barrier of the von Neumann model. Neuromorphic computing, inspired by the mechanism and functionality of human brains, uses physical artificial neurons to do computations and is drawing widespread attention. This review studies the expansion of optoelectronic devices on photonic integration platforms that has led to significant growth in photonic computing, where photonic integrated circuits (PICs) have enabled ultrafast artificial neural networks (ANN) with sub-nanosecond latencies, low heat dissipation, and high parallelism. In particular, various technologies and devices employed in neuromorphic photonic AI accelerators, spanning from traditional optics to PCSEL lasers are examined. Lastly, it is recognized that existing neuromorphic technologies encounter obstacles in meeting the peta-level computing speed and energy efficiency threshold, and potential approaches in new devices, fabrication, materials, and integration to drive innovation are also explored. As the current challenges and barriers in cost, scalability, footprint, and computing capacity are resolved one-by-one, photonic neuromorphic systems are bound to co-exist with, if not replace, conventional electronic computers and transform the landscape of AI and scientific computing in the foreseeable future.

Investigating the Corrosion Resistance of Different SiC Crystal Types: From Energy Sectors to Advanced Applications

Silicon carbide, as a third-generation semiconductor material, plays a pivotal role in various advanced technological applications. Its exceptional stability under extreme conditions has garnered a significant amount of attention. These superior characteristics make silicon carbide an ideal candidate material for high-frequency, high-power electronic devices and applications in harsh environments. In particular, corrosion resistance in natural or artificially acidic and alkaline environments limits the practical application of many other materials. In fields such as chemical engineering, energy conversion, and environmental engineering, materials often face severe chemical erosion, necessitating materials with excellent chemical stability as foundational materials, carriers, or reaction media. Silicon carbide exhibits outstanding performance under these conditions, demonstrating significant resistance to corrosive substances such as hydrochloric acid, sulfuric acid, nitric acid, and alkaline substances such as potassium hydroxide and sodium hydroxide. Despite the well-known chemical stability of silicon carbide, the stability conditions of its different types (such as 3C-, 4H-, and 6H-SiC polycrystals) in acidic and alkaline environments, as well as the specific corrosion mechanisms and differences, warrant further investigation. This Review not only delves deeply into the detailed studies related to this topic but also highlights the current applications of different silicon carbide polycrystals in chemical reaction systems, energy conversion equipment, and recycling processes. Through a comprehensive analysis, this Review aims to bridge research gaps, offering a comparative analysis of the advantages and disadvantages between different polymorphs. It provides material scientists, engineers, and developers with a thorough understanding of silicon carbide's behavior in various chemical environments. This work will propel the research and development of silicon carbide materials under extreme conditions, especially in areas where chemical stability is crucial for device performance and durability. It lays a solid foundation for ultra-high-power, high-integration, high-reliability module architectures, supercomputing chips, and highly safe long-life batteries.

A blueprint for precise and fault-tolerant analog neural networks

Analog computing has reemerged as a promising avenue for accelerating deep neural networks (DNNs) to overcome the scalability challenges posed by traditional digital architectures. However, achieving high precision using analog technologies is challenging, as high-precision data converters are costly and impractical. In this work, we address this challenge by using the residue number system (RNS) and composing high-precision operations from multiple low-precision operations, thereby eliminating the need for high-precision data converters and information loss. Our study demonstrates that the RNS-based approach can achieve ≥99% FP32 accuracy with 6-bit integer arithmetic for DNN inference and 7-bit for DNN training. The reduced precision requirements imply that using RNS can achieve several orders of magnitude higher energy efficiency while maintaining the same throughput compared to conventional analog hardware with the same precision. We also present a fault-tolerant dataflow using redundant RNS to protect the computation against noise and errors inherent within analog hardware.

Spectrum-Dependent Image Convolutional Processing via a Two-Dimensional Polarization-Sensitive Photodetector

Currently, the improvement in the processing capacity of traditional processors considerably lags behind the demands of real-time image processing caused by the advancement of photodetectors and the widespread deployment of high-definition image sensors. Therefore, achieving real-time image processing at the sensor level has become a prominent research domain in the field of photodetector technology. This goal underscores the need for photodetectors with enhanced multifunctional integration capabilities than can perform real-time computations using optical or electrical signals. In this study, we employ an innovative p-type semiconductor GaTe0.5Se0.5 to construct a polarization-sensitive wide-spectral photodetector. Leveraging the wide-spectral photoresponse, we realize three-band imaging within a wavelength range of 390-810 nm. Furthermore, real-time image convolutional processing is enabled by configuring appropriate convolution kernels based on the polarization-sensitive photocurrents. The innovative design of the polarization-sensitive wide-spectral GaTe0.5Se0.5-based photodetector represents a notable contribution to the domain of real-time image perception and processing.

Large-scale photonic computing with nonlinear disordered media

Neural networks find widespread use in scientific and technological applications, yet their implementations in conventional computers have encountered bottlenecks due to ever-expanding computational needs. Photonic computing is a promising neuromorphic platform with potential advantages of massive parallelism, ultralow latency and reduced energy consumption but mostly for computing linear operations. Here we demonstrate a large-scale, high-performance nonlinear photonic neural system based on a disordered polycrystalline slab composed of lithium niobate nanocrystals. Mediated by random quasi-phase-matching and multiple scattering, linear and nonlinear optical speckle features are generated as the interplay between the simultaneous linear random scattering and the second-harmonic generation, defining a complex neural network in which the second-order nonlinearity acts as internal nonlinear activation functions. Benchmarked against linear random projection, such nonlinear mapping embedded with rich physical computational operations shows improved performance across a large collection of machine learning tasks in image classification, regression and graph classification. Demonstrating up to 27,648 input and 3,500 nonlinear output nodes, the combination of optical nonlinearity and random scattering serves as a scalable computing engine for diverse applications.

Machine learning interatomic potential: Bridge the gap between small-scale models and realistic device-scale simulations

Machine learning interatomic potential (MLIP) overcomes the challenges of high computational costs in density-functional theory and the relatively low accuracy in classical large-scale molecular dynamics, facilitating more efficient and precise simulations in materials research and design. In this review, the current state of the four essential stages of MLIP is discussed, including data generation methods, material structure descriptors, six unique machine learning algorithms, and available software. Furthermore, the applications of MLIP in various fields are investigated, notably in phase-change memory materials, structure searching, material properties predicting, and the pre-trained universal models. Eventually, the future perspectives, consisting of standard datasets, transferability, generalization, and trade-off between accuracy and complexity in MLIPs, are reported.

Electrically empowered microcomb laser

Optical microcomb underpins a wide range of applications from communication, metrology, to sensing. Although extensively explored in recent years, challenges remain in key aspects of microcomb such as complex soliton initialization, low power efficiency, and limited comb reconfigurability. Here we present an on-chip microcomb laser to address these key challenges. Realized with integration between III and V gain chip and a thin-film lithium niobate (TFLN) photonic integrated circuit (PIC), the laser directly emits mode-locked microcomb on demand with robust turnkey operation inherently built in, with individual comb linewidth down to 600 Hz, whole-comb frequency tuning rate exceeding 2.4 × 1017 Hz/s, and 100% utilization of optical power fully contributing to comb generation. The demonstrated approach unifies architecture and operation simplicity, electro-optic reconfigurability, high-speed tunability, and multifunctional capability enabled by TFLN PIC, opening up a great avenue towards on-demand generation of mode-locked microcomb that is of great potential for broad applications.

Measuring Electrical Resistivity at the Nanoscale in Phase-Change Materials

Electrical resistivity is the key parameter in the active regions of many current nanoscale devices, from memristors to resistive random-access memory and phase-change memories. The local resistivity of the materials is engineered on the nanoscale to fit the performance requirements. Phase-change memories, for example, rely on materials whose electrical resistance increases dramatically with a change from a crystalline to an amorphous phase. Electrical characterization methods have been developed to measure the response of individual devices, but they cannot map the local resistance across the active area. Here, we propose a method based on operando electron holography to determine the local resistance within working devices. Upon switching the device, we show that electrical resistance is inhomogeneous on the scale of only a few nanometers.

Integrated and DC-powered superconducting microcomb

Frequency combs, specialized laser sources emitting multiple equidistant frequency lines, have revolutionized science and technology with unprecedented precision and versatility. Recently, integrated frequency combs are emerging as scalable solutions for on-chip photonics. Here, we demonstrate a fully integrated superconducting microcomb that is easy to manufacture, simple to operate, and consumes ultra-low power. Our turnkey apparatus comprises a basic nonlinear superconducting device, a Josephson junction, directly coupled to a superconducting microstrip resonator. We showcase coherent comb generation through self-started mode-locking. Therefore, comb emission is initiated solely by activating a DC bias source, with power consumption as low as tens of picowatts. The resulting comb spectrum resides in the microwave domain and spans multiple octaves. The linewidths of all comb lines can be narrowed down to 1 Hz through a unique coherent injection-locking technique. Our work represents a critical step towards fully integrated microwave photonics and offers the potential for integrated quantum processors.

On-chip photonic convolution by phase-change in-memory computing cells with quasi-continuous tuning

Matrix multiplication acceleration by on-chip photonic integrated circuits (PICs) is emerging as one of the attractive and promising solutions, offering outstanding benefits in speed and bandwidth as compared to non-photonic approaches. Incorporating nonvolatile phase-change materials into PICs or devices enables optical storage and computing, surpassing their electrical counterparts. In this paper, we propose a design of on-chip photonic convolution for optical in-memory computing by integrating the phase change chalcogenide of Ge2Sb2Se4Te1 (GSST) into an asymmetric directional coupler for constructions of an in-memory computing cell, marrying the advantages of both the large bandwidth of Mach-Zehnder interferometers (MZIs) and the small size of micro-ring resonators (MRRs). Through quasi-continuous electro-thermal tuning of the GSST-integrated in-memory computing cells, numerical calculations about the optical and electro-thermal behaviors during GSST phase transition confirm the tunability of the programmable elements stored in the in-memory computing cells within [-1, 1]. For proof-of-concept verification, we apply the proposed optical convolutional kernel to a typical image edge detection application. As evidenced by the evaluation results, the prototype achieves the same accuracy as the convolution kernel implemented on a common digital computer, demonstrating the feasibility of the proposed scheme for on-chip photonic convolution and optical in-memory computing.

High-tolerance reconfigurable MZI racetrack resonator on a 3-µm-thick SOI photonics platform

Integration of resonators impacts the utilization of the 3-µm-thick silicon-on-insulator (SOI) platform in photonics integrated circuits (PICs). We propose an integrated resonator leveraging a deep-etch silicon waveguide. Through the utilization of a tunable coupler based on multimode interferometers (MMIs), the resonator achieves high fabrication tolerance and reconfigurability. In a critical-coupling state, it serves as a filter with an extinction ratio (ER) of 23.5 dB and quality (Q) factor of 3.1×105, operating within the range of 1530-1570 nm. In an extreme over-coupling state, it functions as a large-bandwidth delay line, offering continuous change in delay time of 22 ps, nearly wavelength-independent. This work provides devices to the 3-µm-thick silicon photonics device library, enriching the potential applications of this technology platform.

Perspective: an optoelectronic future for heterogeneous, dendritic computing

With the increasing number of applications reliant on large neural network models, the pursuit of more suitable computing architectures is becoming increasingly relevant. Progress toward co-integrated silicon photonic and CMOS circuits provides new opportunities for computing architectures with high bandwidth optical networks and high-speed computing. In this paper, we discuss trends in neuromorphic computing architecture and outline an optoelectronic future for heterogeneous, dendritic neuromorphic computing.

An optoacoustic field-programmable perceptron for recurrent neural networks

Recurrent neural networks (RNNs) can process contextual information such as time series signals and language. But their tracking of internal states is a limiting factor, motivating research on analog implementations in photonics. While photonic unidirectional feedforward neural networks (NNs) have demonstrated big leaps, bi-directional optical RNNs present a challenge: the need for a short-term memory that (i) programmable and coherently computes optical inputs, (ii) minimizes added noise, and (iii) allows scalability. Here, we experimentally demonstrate an optoacoustic recurrent operator (OREO) which meets (i, ii, iii). OREO contextualizes the information of an optical pulse sequence via acoustic waves. The acoustic waves link different optical pulses, capturing their information and using it to manipulate subsequent operations. OREO's all-optical control on a pulse-by-pulse basis offers simple reconfigurability and is used to implement a recurrent drop-out and pattern recognition of 27 optical pulse patterns. Finally, we introduce OREO as bi-directional perceptron for new classes of optical NNs.

Large-scale photonic chiplet Taichi empowers 160-TOPS/W artificial general intelligence

The pursuit of artificial general intelligence (AGI) continuously demands higher computing performance. Despite the superior processing speed and efficiency of integrated photonic circuits, their capacity and scalability are restricted by unavoidable errors, such that only simple tasks and shallow models are realized. To support modern AGIs, we designed Taichi-large-scale photonic chiplets based on an integrated diffractive-interference hybrid design and a general distributed computing architecture that has millions-of-neurons capability with 160-tera-operations per second per watt (TOPS/W) energy efficiency. Taichi experimentally achieved on-chip 1000-category-level classification (testing at 91.89% accuracy in the 1623-category Omniglot dataset) and high-fidelity artificial intelligence-generated content with up to two orders of magnitude of improvement in efficiency. Taichi paves the way for large-scale photonic computing and advanced tasks, further exploiting the flexibility and potential of photonics for modern AGI.

Multichannel meta-imagers for accelerating machine vision

Rapid developments in machine vision technology have impacted a variety of applications, such as medical devices and autonomous driving systems. These achievements, however, typically necessitate digital neural networks with the downside of heavy computational requirements and consequent high energy consumption. As a result, real-time decision-making is hindered when computational resources are not readily accessible. Here we report a meta-imager designed to work together with a digital back end to offload computationally expensive convolution operations into high-speed, low-power optics. In this architecture, metasurfaces enable both angle and polarization multiplexing to create multiple information channels that perform positively and negatively valued convolution operations in a single shot. We use our meta-imager for object classification, achieving 98.6% accuracy in handwritten digits and 88.8% accuracy in fashion images. Owing to its compactness, high speed and low power consumption, our approach could find a wide range of applications in artificial intelligence and machine vision applications.

Monolithic back-end-of-line integration of phase change materials into foundry-manufactured silicon photonics

Monolithic integration of novel materials without modifying the existing photonic component library is crucial to advancing heterogeneous silicon photonic integrated circuits. Here we show the introduction of a silicon nitride etch stop layer at select areas, coupled with low-loss oxide trench, enabling incorporation of functional materials without compromising foundry-verified device reliability. As an illustration, two distinct chalcogenide phase change materials (PCMs) with remarkable nonvolatile modulation capabilities, namely Sb2Se3 and Ge2Sb2Se4Te1, were monolithic back-end-of-line integrated, offering compact phase and intensity tuning units with zero-static power consumption. By employing these building blocks, the phase error of a push-pull Mach-Zehnder interferometer optical switch could be reduced with a 48% peak power consumption reduction. Mirco-ring filters with >5-bit wavelength selective intensity modulation and waveguide-based >7-bit intensity-modulation broadband attenuators could also be achieved. This foundry-compatible platform could open up the possibility of integrating other excellent optoelectronic materials into future silicon photonic process design kits.

Multi-channel broadband nonvolatile programmable modal switch

Mode-division multiplexing (MDM) in chip-scale photonics is paramount to sustain data capacity growth and reduce power consumption. However, its scalability hinges on developing efficient and dynamic modal switches. Existing active modal switches suffer from substantial static power consumption, large footprints, and narrow bandwidth. Here, we present, for the first time, to the best of our knowledge, a novel multiport, broadband, non-volatile, and programmable modal switch designed for on-chip MDM systems. Our design leverages the unique properties of integrating nanoscale phase-change materials (PCM) within a silicon photonic architecture. This enables independent manipulation of spatial modes, allowing for dynamic, non-volatile, and selective routing to six distinct output ports. Crucially, our switch outperforms current dynamic modal switches by offering non-volatile, energy-efficient multiport functionality and excels in performance metrics. Our switch exhibits exceptional broadband operating bandwidth exceeding 70 nm, with low loss (< 1 dB), and a high extinction ratio (> 10 dB). Our framework provides a step forward in chip-scale MDM, paving the way for future green and scalable data centers and high-performance computers.

Broadband angular spectrum differentiation using dielectric metasurfaces

Signal processing is of critical importance for various science and technology fields. Analog optical processing can provide an effective solution to perform large-scale and real-time data processing, superior to its digital counterparts, which have the disadvantages of low operation speed and large energy consumption. As an important branch of modern optics, Fourier optics exhibits great potential for analog optical image processing, for instance for edge detection. While these operations have been commonly explored to manipulate the spatial content of an image, mathematical operations that act directly over the angular spectrum of an image have not been pursued. Here, we demonstrate manipulation of the angular spectrum of an image, and in particular its differentiation, using dielectric metasurfaces operating across the whole visible spectrum. We experimentally show that this technique can be used to enhance desired portions of the angular spectrum of an image. Our approach can be extended to develop more general angular spectrum analog meta-processors, and may open opportunities for optical analog data processing and biological imaging.

Optimized wideband and compact multifunctional photonic device based on Sb2S3 phase change material

In this paper, a 1 × 2 photonic switch is designed based on a silicon-on-insulator (SOI) platform combined with the phase change material (PCM), Sb2S3, assisted by the direct binary search (DBS) algorithm. The designed photonic switch exhibits an impressive operating bandwidth ranging from 1450 to 1650 nm. The device has an insertion loss (IL) from 0.44 dB to 0.70 dB (of less than 0.7 dB) and cross talk (CT) from -26 dB to -20 dB (of less than -20 dB) over an operating bandwidth of 200 nm, especially an IL of 0.52 dB and CT of -24 dB at 1550 nm. Notably, the device is highly compact, with footprints of merely 3 × 4 µm2. Furthermore, we have extended the device's functionality for multifunctional operation in the C-band that can serve as both a 1 × 2 photonic switch and a 3 dB photonic power splitter. In the photonic switch mode, the device demonstrates an IL of 0.7 dB and a CT of -13.5 dB. In addition, when operating as a 3 dB photonic power splitter, the IL is less than 0.5 dB.