Enhanced diffraction efficiency with angular selectivity by inserting an optical interlayer into a diffractive waveguide for augmented reality displays

Breaking the in-coupling efficiency limit in waveguide-based AR displays with polarization volume gratings

Augmented reality (AR) displays, heralded as the next-generation platform for spatial computing, metaverse, and digital twins, empower users to perceive digital images overlaid with real-world environment, fostering a deeper level of human-digital interactions. With the rapid evolution of couplers, waveguide-based AR displays have streamlined the entire system, boasting a slim form factor and high optical performance. However, challenges persist in the waveguide combiner, including low optical efficiency and poor image uniformity, significantly hindering the long-term usage and user experience. In this paper, we first analyze the root causes of the low optical efficiency and poor uniformity in waveguide-based AR displays. We then discover and elucidate an anomalous polarization conversion phenomenon inherent to polarization volume gratings (PVGs) when the incident light direction does not satisfy the Bragg condition. This new property is effectively leveraged to circumvent the tradeoff between in-coupling efficiency and eyebox uniformity. Through feasibility demonstration experiments, we measure the light leakage in multiple PVGs with varying thicknesses using a laser source and a liquid-crystal-on-silicon light engine. The experiment corroborates the polarization conversion phenomenon, and the results align with simulation well. To explore the potential of such a polarization conversion phenomenon further, we design and simulate a waveguide display with a 50° field of view. Through achieving first-order polarization conversion in a PVG, the in-coupling efficiency and uniformity are improved by 2 times and 2.3 times, respectively, compared to conventional couplers. This groundbreaking discovery holds immense potential for revolutionizing next-generation waveguide-based AR displays, promising a higher efficiency and superior image uniformity.

Compensated DOE in a VHG-based waveguide display to improve uniformity

Augmented reality head-mounted displays (AR-HMDs) utilizing diffractive waveguides have emerged as a popular research focus. However, the illuminance uniformity over the fields of view (FOV) is often unsatisfactory in volume holographic grating (VHG) based waveguide displays. This paper proposes a high uniformity AR waveguide display system. Firstly, the angular uniformity of the VHG-based waveguide displays is analyzed. Subsequently, diffractive optical elements (DOEs) are seamlessly integrated onto the outer coupling surface of the waveguide substrate to improve the angular uniformity through phase compensation. To design the DOE phase, the multi-objective stochastic gradient descent (MO-SGD) algorithm is proposed. A single DOE is used to compensating various images form the image source. A hybrid loss, which includes the learned perceptual image patch similarity (LPIPS) metric, is applied to enhance the algorithm performance. Simulation results show that the proposed method effectively suppresses illumination degradation at the edge FOV in exit pupil images of the waveguide display system. In the results, the peak signal-to-noise ratio (PSNR) is improved by 5.54 dB. Optical experiments validate the effectiveness of the proposed method. The measured nonuniformity (NU) against FOVs is improved by 53.05% from 0.3749 to 0.1760.

Framework for optimizing AR waveguide in-coupler architectures

Waveguide displays have been shown to exhibit multiple interactions of light at the in-coupler diffractive surface, leading to light loss. Any losses at the in-coupler set a fundamental upper limit on the full-system efficiency. Furthermore, these losses vary spatially across the beam for each field, significantly decreasing the displayed image quality. We present a framework for alleviating the losses based on irradiance, efficiency, and MTF maps. We then derive and quantify the innate tradeoff between the in-coupling efficiency and the achievable modulation transfer function (MTF) characterizing image quality. Applying the framework, we show a new in-coupler architecture that mitigates the efficiency vs image quality tradeoff. In the example architecture, we demonstrate a computation speed that is 2,000 times faster than that of a commercial non-sequential ray tracer, enabling faster optimization and more thorough exploration of the parameter space. Results show that with this architecture, the in-coupling efficiency still meets the fundamental limit, while the MTF achieves the diffraction limit up to and including 30 cycles/deg, equivalent to 20/20 vision.

Conical diffractions of multilayered gratings modeled by Cartesian rigorous coupled-wave analysis

Rigorous coupled-wave analysis (RCWA) has become one of the most efficient electromagnetic solvers to cope with the diffractions of large-scale periodic nanostructures. Conventional RCWAs focus on planar diffractions and their iterative stabilities. Conical diffractions, as more general incidence cases, are paid little attention in developing their universal and stable implementations for multilayered gratings. Here, we reformulate RCWA algorithms step by step for conical diffractions in a global Cartesian coordinate system. By applying some mathematics tricks, it is found that boundary conditions in conical diffractions can be reduced to the same forms as that of planar diffractions. Conventional stable algorithms including enhanced transmittance matrices and scattering matrices can be directly implemented to attain robust diffraction efficiencies as well as electromagnetic fields for multilayered gratings. An exemplary application in diffractive-waveguide-based augmented reality verified our algorithms.

Grating waveguides by machine learning for augmented reality

We propose a machine-learning-based method for grating waveguides and augmented reality, significantly reducing the computation time compared with existing finite-element-based numerical simulation methods. Among the slanted, coated, interlayer, twin-pillar, U-shaped, and hybrid structure gratings, we exploit structural parameters such as grating slanted angle, grating depth, duty cycle, coating ratio, and interlayer thickness to construct the gratings. The multi-layer perceptron algorithm based on the Keras framework was used with a dataset comprised of 3000-14,000 samples. The training accuracy reached a coefficient of determination of more than 99.9% and an average absolute percentage error of 0.5%-2%. At the same time, the hybrid structure grating we built achieved a diffraction efficiency of 94.21% and a uniformity of 93.99%. This hybrid structure grating also achieved the best results in tolerance analysis. The high-efficiency artificial intelligence waveguide method proposed in this paper realizes the optimal design of a high-efficiency grating waveguide structure. It can provide theoretical guidance and technical reference for optical design based on artificial intelligence.

Introduction to the feature issue on augmented/virtual reality: optics & photonics

In recent years, augmented/virtual reality (AR/VR) has been attracting attention and investment in both the tech and academic communities, kickstarting a new wave of innovations. In the wake of this momentum, this feature issue was launched to cover the latest advances in this burgeoning field that pertains to optics and photonics. Alongside the 31 research articles being published, this introduction is appended to share with readers the behind-the-issue stories, submission statistics, reading guides, author biographies, and editors' perspectives.