Lensless full-color holographic Maxwellian near-eye display with a horizontal eyebox expansion

High quality holographic 3D display with enhanced focus cues based on multiple directional light reconstruction

Holographic display faces the trade-off between image quality and focus cues, resulting from the specific choice of phase distribution. In this Letter, we propose a speckle-free holographic display with enhanced focus cues by multiple directional light reconstruction. The uniform phase hologram is first generated by the gradient descent optimization algorithm. The blazed grating phase is used to steer the object light to a specific direction. Multiple sub-holograms with different blazed gratings are refreshed fast to reconstruct the images from different directions. Thus, the defocus blur is improved due to the separation of multiple spots on the defocus plane. The multi-plane reconstruction is also realized by pre-processing the depth images to eliminate image separation. The proposed method provides apparent focus cues while maintaining high image qualities, which is expected to realize comfortable holographic near-eye display in the near future.

A Depth-Enhanced Holographic Super Multi-View Display Based on Depth Segmentation

A super multi-view (SMV) near-eye display (NED) effectively provides depth cues for three-dimensional (3D) display by projecting multiple viewpoint or parallax images onto the retina simultaneously. Previous SMV NED have suffered from a limited depth of field (DOF) due to a fixed image plane. In this paper, a holographic SMV Maxwellian display based on depth segmentation is proposed to enhance the DOF. The proposed approach involves capturing a set of parallax images and their corresponding depth maps. According to the depth maps, the parallax images are segmented into N sub-parallax images at different depth ranges. These sub-parallax images are then projected onto N image-recording planes (IRPs) of the corresponding depth for hologram computation. The wavefront at each IRP is calculated by multiplying the sub-parallax images with the corresponding spherical wave phases. Then, they are propagated to the hologram plane and added together to form a DOF-enhanced hologram. The simulation and experimental results are obtained to validate the effectiveness of the proposed method in extending the DOF of the holographic SMV displays, while accurately preserving occlusion.

Large field-of-view holographic Maxwellian display based on spherical crown diffraction

Maxwellian display, as an effective solution to the vergence accommodation conflict in near-eye displays (NEDs), has demonstrated its unique advantages in many aspects, such as the ability to provide sharp images within a certain depth of field (DOF) without being affected by the eye's focus. In recent years, the appearance of holographic Maxwellian displays has addressed the shortcomings of traditional Maxwellian displays, meeting the demands for flexible control parameters, aberration-free designing, and expanded eyebox. Nonetheless, the human eye's requirement for immersion still leaves room for a significant improvement in terms of the field-of-view (FOV). In this paper, we propose a large FOV holographic Maxwellian display based on spherical crown diffraction. The proposed spherical-crown holographic Maxwellian display theoretically can cover the full FOV required by the human eyes without complex optical paths and has flexible control of performance parameters such as DOF and image quality. We have successfully demonstrated the feasibility of the spherical crown diffraction model in lensless holographic Maxwellian displays, and it is expected to have practical applications in the field of holographic Maxwellian NEDs in the future.

Depth-Enhanced Holographic Super Multi-View Maxwellian Display Based on Variable Filter Aperture

The super multi-view (SMV) near-eye display (NED) effectively provides depth cues for three-dimensional (3D) displays by projecting multiple viewpoint images or parallax images onto the retina simultaneously. Previous SMV NED suffers from a limited depth of field (DOF) due to the fixed image plane. Aperture filtering is widely used to enhance the DOF; however, an invariably sized aperture may have opposite effects on objects with different reconstruction depths. In this paper, a holographic SMV display based on the variable filter aperture is proposed to enhance the DOF. In parallax image acquisition, multiple groups of parallax images, each group recording a part of the 3D scene on a fixed depth range, are captured first. In the hologram calculation, each group of wavefronts at the image recording plane (IRP) is calculated by multiplying the parallax images with the corresponding spherical wave phase. Then, they are propagated to the pupil plane and multiplied by the corresponding aperture filter function. The size of the filter aperture is variable which is determined by the depth of the object. Finally, the complex amplitudes at the pupil plane are back-propagated to the holographic plane and added together to form the DOF-enhanced hologram. Simulation and experimental results verify the proposed method could improve the DOF of holographic SMV display, which will contribute to the application of 3D NED.

Cross talk-free retinal projection display based on a holographic complementary viewpoint array

In near-eye displays (NEDs), retinal projection display (RPD) is one kind of promising technology to alleviate the vergence-accommodation conflict (VAC) issue due to its always-in-focus feature. Viewpoint replication is widely used to enlarge the limited eyebox. However, the mismatch between viewpoint interval and eye pupil diameter will cause the inter-viewpoint cross talk when multiple viewpoints enter the pupil simultaneously. In this Letter, a holographic complementary viewpoint method is proposed to solve this cross talk problem. Instead of avoiding observing multiple viewpoint images simultaneously, it is designed that multiple complementary viewpoints jointly project the complete image on the retina without cross talk. To do this, the target image is segmented into multiple sub-images, each multiplied with a corresponding partial spherical phase to converge to a specific complementary viewpoint. A group of complementary viewpoint enter the eye pupil simultaneously, and each viewpoint project a corresponding sub-image on a specific area of the retina and splice to a complete image. All of the complementary viewpoints are duplicated to an interlaced two-dimensional array to extend the eyebox in both horizontal and vertical directions. Optical experiment verifies that the proposed method could present smooth transition between viewpoints to avoid both inter-viewpoint cross talk and blank image issues.

Compact reconstruction of a Fourier hologram for a 3D object by scaling compensation

The Fourier holographic projection method is compact and computationally fast. However, since the magnification of the displayed image increases with the diffraction distance, this method cannot be used directly to display multi-plane three-dimensional (3D) scenes. We propose a holographic 3D projection method of Fourier holograms by scaling compensation to offset the magnification during optical reconstruction. To achieve a compact system, the proposed method is also used to reconstruct 3D virtual images with Fourier holograms. Different from traditional Fourier holographic displays, images are reconstructed behind a spatial light modulator (SLM) so that the observation position can be placed close to the SLM. The effectiveness of the method and the flexibility of combining it with other methods are confirmed by simulations and experiments. Therefore, our method could have potential applications in the augmented reality (AR) and virtual reality (VR) fields.

Super multi-view near-eye display with a lightguide combiner

We propose a lightguide-type super multi-view near-eye display that uses a digital micromirror device and a LED array. The proposed method presents three-dimensional images with a natural monocular depth cue using a compact combiner optics which consists of a thin lightguide and holographic optical elements (HOEs). Feasibility of the proposed method is verified by optical experiments which demonstrate monocular three-dimensional image presentation over a wide depth range. We also analyze the degradation of the image quality stemming from the spectral spread of the HOEs and show its reduction by a pre-compensation exploiting an adaptive moment estimation (Adam) optimizer.

Lensless phase-only holographic retinal projection display based on the error diffusion algorithm

Holographic retinal projection display (RPD) can project images directly onto the retina without any lens by encoding a convergent spherical wave phase with the target images. Conventional amplitude-type holographic RPD suffers from strong zero-order light and conjugate. In this paper, a lensless phase-only holographic RPD based on error diffusion algorithm is demonstrated. It is found that direct error diffusion of the complex Fresnel hologram leads to low image quality. Thus, a post-addition phase method is proposed based on angular spectrum diffraction. The spherical wave phase is multiplied after error diffusion process, and acts as an imaging lens. In this way, the error diffusion functions better due to reduced phase difference between adjacent pixels, and a virtual image with improved quality is produced. The viewpoint is easily deflected just by changing the post-added spherical phase. A full-color holographic RPD with adjustable eyebox is demonstrated experimentally with time-multiplexing technique.

Spectral-envelope modulated double-phase method for computer-generated holography

Computer-generated holography provides an approach to modulate the optical wavefront with computationally synthesized holograms. Since the hardware implementation for complex wavefronts is not yet available, double-phase decomposition is utilized as a complex encoding method of converting a complex wavefront to a double-phase hologram. The double-phase hologram adapts a complex wavefront for the phase-type devices, but the reconstruction is plagued by the noise caused by spatial-shifting errors. Here, a spectral-envelope modulated double-phase method is proposed to suppress the spatial-shifting noise with an off-axis envelope modulation on the Fourier spectrum of a double-phase hologram. This proposed method out-performs conventional on-axis double-phase method in optical reconstructing accuracy with indicated 9.54% improvement in PSNR and 196.86% improvement in SSIM.

Simultaneous multi-channel near-eye display: a holographic retinal projection display with large information content

Augmented reality (AR) near-eye displays (NEDs) are emerging as the next-generation display platform. The existing AR NED only present one single video channel at a time, same as traditional media such as TVs and smartphones. In this Letter, to the best of our knowledge, we propose for the first time a multi-channel holographic retinal projection display (RPD), which can provide multi-channel image sources simultaneously, thus greatly increasing the information content. Due to the superposition capacity of a hologram, multiple images are projected to different viewpoints simultaneously through multiple spherical wave encoding, so that the viewer can switch among playing channels very fast through eye rotation. A full-color dynamic multi-channel holographic near-eye display is demonstrated in the optical experiment. The proposed method provides a good prospect that the future AR glasses can play dozens of video channels in parallel, and the user can switch among channels freely and efficiently just through a simple eye rotation.

Method of color holographic display with speckle noise suppression

In this paper, a method of color holographic display with speckle noise suppression is proposed. Firstly, the intensity information of the object is extracted according to the red, green and blue (RGB) channels. The band-limited phase is calculated and used as the initial phase for each color channel. Secondly, the double-step Fresnel diffraction algorithm is used to calculate the computer-generated holograms (CGHs), and a filter plane that dynamically adjusts the position of the filter in the optical path is designed. Then, a divergent spherical phase factor is added to the CGHs. Finally, the time average method is used to further reduce the speckle noise. When the CGHs of the RGB channels are loaded on the digital micromirror device and illuminated by the RGB lights emitting in a temporal sequence, the color reconstructed images with speckle noise suppression can be displayed. The validity of the proposed method is verified.

Holographic super multi-view Maxwellian near-eye display with eyebox expansion

A holographic super multi-view (SMV) Maxwellian display based on flexible wavefront modulation is proposed for the first time, to the best of our knowledge. It solves the issue that the previous holographic Maxwellian displays could not provide depth cues for monocular vision. Different from the previous methods, two or more parallax images are multiplied by quadric phase distributions and converged to the viewpoints existing in the pupil to provide 3-D vision. A time division method is proposed to eliminate the cross talk caused by the coherence of different spherical waves. Experiments demonstrate that the proposed method can accurately reconstruct images at different depth without cross talk. The proposed method inherits the previous holographic Maxwellian display's advantages of flexible viewpoint position adjustment and large depth of field (DOF). Superior to geometric optics based SMV displays, the proposed system is compact without lens aberration since only a single spatial light modulator (SLM) is needed without any additional optical elements.

Adjustable and continuous eyebox replication for a holographic Maxwellian near-eye display

A Maxwellian display presents always-focused images to the viewer, alleviating the vergence-accommodation conflict (VAC) in near-eye displays (NEDs). Recently, many methods of improving its limited eyebox have been proposed, among which viewpoint replication has attracted a lot of attention. However, double-image, blind-area, and image-shift effects always happen in typical eyebox-replication Maxwellian NEDs when the eye moves between the replicated viewpoints, which prevents these NEDs from being applied more widely. In this Letter, we propose a method for designing a holographic Maxwellian NED system with continuous eyebox replication as well as flexible interval adjustment by changing the projection angles of the reconstructed images. Thus, holograms corresponding to the positions of different viewpoints are calculated to match the interval of the replicated viewpoints with the human pupil diameter, making it possible to eliminate or alleviate double-image or blind-area effects. Also, seamless viewpoint conversion in the eyebox is achieved by aligning the images of adjacent viewpoints on the retina via hologram pre-processing independently. These effects are verified successfully in optical experiments and have the potential to be applied in near-eye three-dimensional displays without VAC.

Conjugate wavefront encoding: an efficient eyebox extension approach for holographic Maxwellian near-eye display

Conventional holographic display suffers from the conjugate light issue. In this Letter, we propose to efficiently extend the eyebox of holographic Maxwellian near-eye display by encoding the conjugate wavefront as the multiplication of plane wave phase with the target image. It is interesting that after being focused by the lens, the generated conjugate viewpoints also present erect virtual images with the same image quality as the signal viewpoints. Multiple plane wave encoding is used for eyebox extension, and, because of the utilization of conjugate light, the effect of eyebox extension is doubled. That is, the space bandwidth of the amplitude-type hologram is fully used. A speckless holographic image is produced in mid-air with high quality within a large depth range. The proposed display is compact and promising for the augmented reality near-eye display. Furthermore, it may inspire better solutions for the conjugate light issue of amplitude-type holography.

Holographic 3D Display Using Depth Maps Generated by 2D-to-3D Rendering Approach

Holographic display has the potential to be utilized in many 3D application scenarios because it provides all the depth cues that human eyes can perceive. However, the shortage of 3D content has limited the application of holographic 3D displays. To enrich 3D content for holographic display, a 2D to 3D rendering approach is presented. In this method, 2D images are firstly classified into three categories, including distant view images, perspective view images and close-up images. For each category, the computer-generated depth map (CGDM) is calculated using a corresponding gradient model. The resulting CGDMs are applied in a layer-based holographic algorithm to obtain computer-generated holograms (CGHs). The correctly reconstructed region of the image changes with the reconstruction distance, providing a natural 3D display effect. The realistic 3D effect makes the proposed approach can be applied in many applications, such as education, navigation, and health sciences in the future.