High-performance reflection-type augmented reality 3D display using a reflective polarizer

Sub-pixel marking and depth-based correction methods for the elimination of voxel drifting in integral imaging display

Integral imaging is a kind of true three-dimensional (3D) display technology that uses a lens array to reconstruct vivid 3D images with full parallax and true color. In order to present a high-quality 3D image, it's vital to correct the axial position error caused by the misalignment and deformation of the lens array which makes the reconstructed lights deviate from the correct directions, resulting in severe voxel drifting and image blurring. We proposed a sub-pixel marking method to measure the axial position error of the lenses with great accuracy by addressing the sub-pixels under each lens and forming a homologous sub-pixel pair. The proposed measurement method relies on the geometric center alignment of image points, which is specifically expressed as the overlap between the test 3D voxel and the reference 3D voxel. Hence, measurement accuracy could be higher. Additionally, a depth-based sub-pixel correction method was proposed to eliminate the voxel drifting. The proposed correction method takes the voxel depth into consideration in the correction coefficient, and achieves accurate error correction for 3D images with different depths. The experimental results well confirmed that the proposed measuring and correction methods can greatly suppress the voxel drifting caused by the axial position error of the lenses, and greatly improve the 3D image quality.

Large viewing angle integral imaging 3D display system based on a symmetrical compound lens array

We propose a large viewing angle integral imaging 3D display system based on a symmetrical compound lens array (SCLA). The display system comprises a high-resolution 2D display panel, an SCLA, and a light shaping diffuser. The high-resolution 2D display panel presents an elemental image array, the SCLA modulates the light rays emitted from the 2D display panel to form 3D images in space, and the light shaping diffuser eliminates the gaps between 3D pixels of the 3D images. We find that the lateral aberration is a crucial factor that affects the resolution of the reconstructed 3D image. The symmetrical structure of the SCLA enables a reduced focal length and the elimination of lateral aberration, improving the viewing angle and the 3D image resolution simultaneously. The experimental results confirm that the proposed display system increases the viewing angle to 68.6°, achieving a comparable resolution of the full field of view while maintaining a simple structure.

Two-step diffraction method for an optical 360° cylindrical holographic display

We present a two-step diffraction method for an optical 360∘ cylindrical holographic display with a planar spatial light modulator (SLM) and a 45∘ conical mirror. The first step involves layered diffraction of the cylindrical object surface to obtain the complex amplitude distribution on the conical mirror, and the second step is the coordinate transformation, followed by plane-to-plane diffraction to finally obtain the hologram. Numerical simulations and optical experiments show that our proposed method offers improved accuracy in the propagation process compared with the previous method; furthermore, it enables better quality of reconstruction, particularly at large radius of object surface. We believe it is a solid step toward practicality for a cylindrical holographic display.

Depth-Enhanced Holographic Super Multi-View Maxwellian Display Based on Variable Filter Aperture

The super multi-view (SMV) near-eye display (NED) effectively provides depth cues for three-dimensional (3D) displays by projecting multiple viewpoint images or parallax images onto the retina simultaneously. Previous SMV NED suffers from a limited depth of field (DOF) due to the fixed image plane. Aperture filtering is widely used to enhance the DOF; however, an invariably sized aperture may have opposite effects on objects with different reconstruction depths. In this paper, a holographic SMV display based on the variable filter aperture is proposed to enhance the DOF. In parallax image acquisition, multiple groups of parallax images, each group recording a part of the 3D scene on a fixed depth range, are captured first. In the hologram calculation, each group of wavefronts at the image recording plane (IRP) is calculated by multiplying the parallax images with the corresponding spherical wave phase. Then, they are propagated to the pupil plane and multiplied by the corresponding aperture filter function. The size of the filter aperture is variable which is determined by the depth of the object. Finally, the complex amplitudes at the pupil plane are back-propagated to the holographic plane and added together to form the DOF-enhanced hologram. Simulation and experimental results verify the proposed method could improve the DOF of holographic SMV display, which will contribute to the application of 3D NED.

Depth of field and resolution-enhanced integral imaging display system

Depth of field (DOF) and resolution are mutually restricted in integral imaging (II) display. To overcome the trade-offs, we propose an II display system that simultaneously enhances the DOF and resolution. The system consists of a transmissive mirror device (TMD), a semi-transparent mirror (STM), and two II display units. Each II display unit consists of a 4K display screen and a micro-lens array (MLA). Benefiting from the parallel placement of the TMD and the STM, two central depth planes are reconstructed, which effectively enhances the DOF. Meanwhile, the resolution in the overlapping DOF region is increased to two times due to the interpolation of the light field information from two II display units. The impact of the distance between the two II display units and the TMD on the 3D image quality is analyzed. In geometric optics, a distance between the II two display units and the TMD is optimized to eliminate ghost images. In wave optics, a distance is optimized to eliminate 3D pixel gaps by exploiting the diffraction effect of the TMD. Both the geometric and wave optics are considered simultaneously to obtain a high-quality 3D image without ghost images and 3D pixel gaps. A DOF and resolution-enhanced II display system is developed, and the experimental results verify its feasibility.

System to eliminate the graininess of an integral imaging 3D display by using a transmissive mirror device

We propose a system to eliminate the graininess of an integral imaging 3D display by using a transmissive mirror device (TMD). The proposed system consists of a 2D display, a micro-lens array (MLA), and a TMD. The TMD comprises square apertures with mirror-reflective inner wall. The light rays pass through the square aperture to form a diffraction spot, and the diffraction light intensity has a Sinc-function distribution. Therefore, the TMD can be used as an optical low-pass filter. In a certain imaging range, the mainlobe of the Sinc-function distribution is almost unchanged. The TMD has the property of a volumetric optical low-pass filter. It can interpolate the interval between discrete 3D pixels. Therefore, the TMD can be used to eliminate the graininess. The resolution of the 3D image is improved by 2.12 times. The experimental results verify the feasibility of the proposed system.

Recent Advances in Planar Optics-Based Glasses-Free 3D Displays

Glasses-free three-dimensional (3D) displays are one of the technologies that will redefine human-computer interfaces. However, many geometric optics-based 3D displays suffer from a limited field of view (FOV), severe resolution degradation, and visual fatigue. Recently, planar optical elements (e.g., diffraction gratings, diffractive lenses and metasurfaces) have shown superior light manipulating capability in terms of light intensity, phase, and polarization. As a result, planar optics hold great promise to tackle the critical challenges for glasses-free 3D displays, especially for portable electronics and transparent display applications. In this review, the limitations of geometric optics-based glasses-free 3D displays are analyzed. The promising solutions offered by planar optics for glasses-free 3D displays are introduced in detail. As a specific application and an appealing feature, augmented reality (AR) 3D displays enabled by planar optics are comprehensively discussed. Fabrication technologies are important challenges that hinder the development of 3D displays. Therefore, multiple micro/nanofabrication methods used in 3D displays are highlighted. Finally, the current status, future direction and potential applications for glasses-free 3D displays and glasses-free AR 3D displays are summarized.

Optical design and pupil swim analysis of a compact, large EPD and immersive VR head mounted display

Virtual reality head-mounted displays (VR-HMDs) are crucial to Metaverse which appears to be one of the most popular terms to have been adopted over the internet recently. It provides basic infrastructure and entrance to cater for the next evolution of social interaction, and it has already been widely used in many fields. The VR-HMDs with traditional aspherical or Fresnel optics are not suitable for long-term usage because of the image quality, system size, and weight. In this study, we designed and developed a large exit pupil diameter (EPD), compact, and lightweight VR-HMD with catadioptric optics. The mathematical formula for designing the catadioptric VR optics is derived. The reason why this kind of immersive VR optics could achieve a compact size and large EPD simultaneously is answered. Various catadioptric forms are systematically proposed and compared. The design can achieve a diagonal field of view (FOV) of 96° at -1 diopter, with an EPD of 10 mm at 11 mm eye relief (ERF). The overall length (OAL) of the system was less than 20 mm. A prototype of a compact catadioptric VR-HMD system was successfully developed.

Augmented Reality Vector Light Field Display with Large Viewing Distance Based on Pixelated Multilevel Blazed Gratings

Glasses-free augmented reality (AR) 3D display has attracted great interest in its ability to merge virtual 3D objects with real scenes naturally, without the aid of any wearable devices. Here we propose an AR vector light field display based on a view combiner and an off-the-shelf purchased projector. The view combiner is sparsely covered with pixelated multilevel blazed gratings (MBG) for the projection of perspective virtual images. Multi-order diffraction of the MBG is designed to increase the viewing distance and vertical viewing angle. In a 20-inch prototype, multiple sets of 16 horizontal views form a smooth parallax. The viewing distance of the 3D scene is larger than 5 m. The vertical viewing angle is 15.6°. The light efficiencies of all views are larger than 53%. We demonstrate that the displayed virtual 3D scene retains natural motion parallax and high brightness while having a consistent occlusion effect with natural objects. This research can be extended to applications in areas such as human–computer interaction, entertainment, education, and medical care.

Optical See-through 2D/3D Compatible Display Using Variable-Focus Lens and Multiplexed Holographic Optical Elements

An optical see-through two-dimensional (2D)/three-dimensional (3D) compatible display using variable-focus lens and multiplexed holographic optical elements (MHOE) is presented. It mainly consists of a MHOE, a variable-focus lens and a projection display device. The customized MHOE, by using the angular multiplexing technology of volumetric holographic grating, records the scattering wavefront and spherical wavefront array required for 2D/3D compatible display. In particular, we proposed a feasible method to switch the 2D and 3D display modes by using a variable-focus lens in the reconstruction process. The proposed system solves the problem of bulky volume, and makes the MHOE more efficient to use. Based on the requirements of 2D and 3D displays, we calculated the liquid pumping volume of the variable-focus lens under two kinds of diopters.

High-performance reflection-type augmented reality 3D display using reflective polarizer: erratum

Correction of the title of the second part in our published article [Opt. Express29, 9446 (2021)10.1364/OE.421879].