Holographic super multi-view Maxwellian near-eye display with eyebox expansion

Dual light source compensation method for improving the quality of LC-SLM holographic displays

The inherent "grid" effect of LC-SLM in holographic displays can lead to issues such as the presence of zero-order spots and multi-level diffraction images, resulting in a decrease in the quality of reconstructed images. In this Letter, a dual light source compensation method is proposed to address this problem. By analyzing the influence of the LC-SLM "grid" effect on the diffraction field and the rule of change of light intensity distribution and position of the reconstructed image, the dual light source is introduced on the basis of the rule of change of energy distribution at the symmetric position of the reconstructed image so as to compensate for the quality of the display results. The results show that the method not only avoids the influence of zero-order spot and multi-level diffraction image on the holographic display results but also especially highlights that the uniformity of light energy distribution of the reconstructed image is greatly improved, which provides a reference for LC-SLM to perform a higher-quality holographic display.

Tomographic waveguide-based augmented reality display

A tomographic waveguide-based augmented reality display technique is proposed for near-eye three-dimensional (3D) display with accurate depth reconstructions. A pair of tunable lenses with complementary focuses is utilized to project tomographic virtual 3D images while maintaining the correct perception of the real scene. This approach reconstructs virtual 3D images with physical depth cues, thereby addressing the vergence-accommodation conflict inherent in waveguide augmented reality systems. A prototype has been constructed and optical experiments have been conducted, demonstrating the system's capability in delivering high-quality 3D scenes for waveguide-based augmented reality display.

High quality holographic 3D display with enhanced focus cues based on multiple directional light reconstruction

Holographic display faces the trade-off between image quality and focus cues, resulting from the specific choice of phase distribution. In this Letter, we propose a speckle-free holographic display with enhanced focus cues by multiple directional light reconstruction. The uniform phase hologram is first generated by the gradient descent optimization algorithm. The blazed grating phase is used to steer the object light to a specific direction. Multiple sub-holograms with different blazed gratings are refreshed fast to reconstruct the images from different directions. Thus, the defocus blur is improved due to the separation of multiple spots on the defocus plane. The multi-plane reconstruction is also realized by pre-processing the depth images to eliminate image separation. The proposed method provides apparent focus cues while maintaining high image qualities, which is expected to realize comfortable holographic near-eye display in the near future.

Multifocal multiview imaging and data compression based on angular-focal-spatial representation

Multifocal multiview (MFMV) is an emerging high-dimensional optical data that allows to record richer scene information but yields huge volumes of data. To unveil its imaging mechanism, we present an angular-focal-spatial representation model, which decomposes high-dimensional MFMV data into angular, spatial, and focal dimensions. To construct a comprehensive MFMV dataset, we leverage representative imaging prototypes, including digital camera imaging, emerging plenoptic refocusing, and synthesized Blender 3D creation. It is believed to be the first-of-its-kind MFMV dataset in multiple acquisition ways. To efficiently compress MFMV data, we propose the first, to our knowledge, MFMV data compression scheme based on angular-focal-spatial representation. It exploits inter-view, inter-stack, and intra-frame predictions to eliminate data redundancy in angular, focal, and spatial dimensions, respectively. Experiments demonstrate the proposed scheme outperforms the standard HEVC and MV-HEVC coding methods. As high as 3.693 dB PSNR gains and 64.22% bitrate savings can be achieved.

A Depth-Enhanced Holographic Super Multi-View Display Based on Depth Segmentation

A super multi-view (SMV) near-eye display (NED) effectively provides depth cues for three-dimensional (3D) display by projecting multiple viewpoint or parallax images onto the retina simultaneously. Previous SMV NED have suffered from a limited depth of field (DOF) due to a fixed image plane. In this paper, a holographic SMV Maxwellian display based on depth segmentation is proposed to enhance the DOF. The proposed approach involves capturing a set of parallax images and their corresponding depth maps. According to the depth maps, the parallax images are segmented into N sub-parallax images at different depth ranges. These sub-parallax images are then projected onto N image-recording planes (IRPs) of the corresponding depth for hologram computation. The wavefront at each IRP is calculated by multiplying the sub-parallax images with the corresponding spherical wave phases. Then, they are propagated to the hologram plane and added together to form a DOF-enhanced hologram. The simulation and experimental results are obtained to validate the effectiveness of the proposed method in extending the DOF of the holographic SMV displays, while accurately preserving occlusion.

Polarimetric calibrated robust dual-SLM complex-amplitude computer-generated holography

Liquid crystal on silicon (LCoS) is a widely used spatial light modulator (SLM) in computer-generated holography (CGH). However, the phase-modulating profile of LCoS is often not ideally uniform in application, bringing about undesired intensity fringes. In this study, we overcome this problem by proposing a highly robust dual-SLM complex-amplitude CGH technique, which incorporates a polarimetric mode and a diffractive mode. The polarimetric mode linearizes the general phase modulations of the two SLMs separately, while the diffractive mode uses camera-in-the-loop optimization to achieve improved holographic display. Experimental results show the effectiveness of our proposal in improving reconstructing accuracy by 21.12% in peak signal-to-noise ratio (PSNR) and 50.74% in structure similarity index measure (SSIM), using LCoS SLMs with originally non-uniform phase-modulating profiles.

Depth-Enhanced Holographic Super Multi-View Maxwellian Display Based on Variable Filter Aperture

The super multi-view (SMV) near-eye display (NED) effectively provides depth cues for three-dimensional (3D) displays by projecting multiple viewpoint images or parallax images onto the retina simultaneously. Previous SMV NED suffers from a limited depth of field (DOF) due to the fixed image plane. Aperture filtering is widely used to enhance the DOF; however, an invariably sized aperture may have opposite effects on objects with different reconstruction depths. In this paper, a holographic SMV display based on the variable filter aperture is proposed to enhance the DOF. In parallax image acquisition, multiple groups of parallax images, each group recording a part of the 3D scene on a fixed depth range, are captured first. In the hologram calculation, each group of wavefronts at the image recording plane (IRP) is calculated by multiplying the parallax images with the corresponding spherical wave phase. Then, they are propagated to the pupil plane and multiplied by the corresponding aperture filter function. The size of the filter aperture is variable which is determined by the depth of the object. Finally, the complex amplitudes at the pupil plane are back-propagated to the holographic plane and added together to form the DOF-enhanced hologram. Simulation and experimental results verify the proposed method could improve the DOF of holographic SMV display, which will contribute to the application of 3D NED.

Cross talk-free retinal projection display based on a holographic complementary viewpoint array

In near-eye displays (NEDs), retinal projection display (RPD) is one kind of promising technology to alleviate the vergence-accommodation conflict (VAC) issue due to its always-in-focus feature. Viewpoint replication is widely used to enlarge the limited eyebox. However, the mismatch between viewpoint interval and eye pupil diameter will cause the inter-viewpoint cross talk when multiple viewpoints enter the pupil simultaneously. In this Letter, a holographic complementary viewpoint method is proposed to solve this cross talk problem. Instead of avoiding observing multiple viewpoint images simultaneously, it is designed that multiple complementary viewpoints jointly project the complete image on the retina without cross talk. To do this, the target image is segmented into multiple sub-images, each multiplied with a corresponding partial spherical phase to converge to a specific complementary viewpoint. A group of complementary viewpoint enter the eye pupil simultaneously, and each viewpoint project a corresponding sub-image on a specific area of the retina and splice to a complete image. All of the complementary viewpoints are duplicated to an interlaced two-dimensional array to extend the eyebox in both horizontal and vertical directions. Optical experiment verifies that the proposed method could present smooth transition between viewpoints to avoid both inter-viewpoint cross talk and blank image issues.

Super multi-view display based on near-eye pinholes

Vergence-accommodation-conflict-free super multi-view (SMV) display based on more than one near-eye pinhole group for each pupil of the viewer is developed in this paper. Two-dimensionally arranged pinholes of a group correspond to different subscreens of the display screen, with perspective views projected by each subscreen through a corresponding pinhole splicing into an image of enlarged field of view (FOV). By sequentially switching on/off different pinhole groups, more than one mosaic image is projected to each pupil of the viewer. Adjacent pinholes of a group are endowed with different timing-polarizing characteristics to generate an effective noise-free region for each pupil. In the experiment, four groups of 3×3 pinholes are configured for a proof-of-concept SMV display on a 240 Hz display screen, with a diagonal FOV of 55 deg and a depth of field reaching 1.2 m.

Super multi-view near-eye virtual reality with directional backlights from wave-guides

Directional backlights have often been employed for generating multiple view-zones in three-dimensional (3D) display, with each backlight converging into a corresponding view-zone. By designing the view-zone interval for each pupil smaller than the pupil's diameter, super multi-view (SMV) can get implemented for a VAC-free 3D display. However, expanding the backlight from a light-source to cover the corresponding display panel often needs an extra thickness, which results in a thicker structure and is unwanted by a near-eye display. In this paper, two wave-guides are introduced into a near-eye virtual reality (NEVR) system, for sequentially guiding more than one directional backlight to each display panel for SMV display without bringing obvious extra thickness. A prototype SMV NEVR gets demonstrated, with two backlights from each wave-guide converging into two view-zones for a corresponding pupil. Although the additional configured light-sources are positioned far from the corresponding wave-guide in our proof-of-concept prototype, multiple light-sources can be attached to the corresponding wave-guide compactly if necessary. As proof, a 3D scene with defocus-blur effects gets displayed. The design range of the backlights' total reflection angles in the wave-guide is also discussed.

Super multi-view near-eye display with a lightguide combiner

We propose a lightguide-type super multi-view near-eye display that uses a digital micromirror device and a LED array. The proposed method presents three-dimensional images with a natural monocular depth cue using a compact combiner optics which consists of a thin lightguide and holographic optical elements (HOEs). Feasibility of the proposed method is verified by optical experiments which demonstrate monocular three-dimensional image presentation over a wide depth range. We also analyze the degradation of the image quality stemming from the spectral spread of the HOEs and show its reduction by a pre-compensation exploiting an adaptive moment estimation (Adam) optimizer.

Lensless phase-only holographic retinal projection display based on the error diffusion algorithm

Holographic retinal projection display (RPD) can project images directly onto the retina without any lens by encoding a convergent spherical wave phase with the target images. Conventional amplitude-type holographic RPD suffers from strong zero-order light and conjugate. In this paper, a lensless phase-only holographic RPD based on error diffusion algorithm is demonstrated. It is found that direct error diffusion of the complex Fresnel hologram leads to low image quality. Thus, a post-addition phase method is proposed based on angular spectrum diffraction. The spherical wave phase is multiplied after error diffusion process, and acts as an imaging lens. In this way, the error diffusion functions better due to reduced phase difference between adjacent pixels, and a virtual image with improved quality is produced. The viewpoint is easily deflected just by changing the post-added spherical phase. A full-color holographic RPD with adjustable eyebox is demonstrated experimentally with time-multiplexing technique.

Simultaneous multi-channel near-eye display: a holographic retinal projection display with large information content

Augmented reality (AR) near-eye displays (NEDs) are emerging as the next-generation display platform. The existing AR NED only present one single video channel at a time, same as traditional media such as TVs and smartphones. In this Letter, to the best of our knowledge, we propose for the first time a multi-channel holographic retinal projection display (RPD), which can provide multi-channel image sources simultaneously, thus greatly increasing the information content. Due to the superposition capacity of a hologram, multiple images are projected to different viewpoints simultaneously through multiple spherical wave encoding, so that the viewer can switch among playing channels very fast through eye rotation. A full-color dynamic multi-channel holographic near-eye display is demonstrated in the optical experiment. The proposed method provides a good prospect that the future AR glasses can play dozens of video channels in parallel, and the user can switch among channels freely and efficiently just through a simple eye rotation.