2D/3D mixed frontal projection system based on integral imaging

Fast rendering and display of light field images with a controllable lighting mechanism

A fast light field (LF) image rendering method with controllable lighting mechanism is proposed and demonstrated. It solves the issue that previous image-based methods could not render and edit lighting effects for LF images. In contrast to previous methods, light cones and normal maps are defined and used to expand the RGBD images into RGBDNθ data, which gives more degrees of freedom to render LF images. Conjugate cameras are used to capture the RGBDN data, which simultaneously solve the pseudoscopic imaging problem. Perspective coherence is used to accelerate the RGBDNθ-based LF rendering process, which has been shown to be on average 30 times faster than the traditional per-viewpoint rendering (PVR) method. Vivid three-dimensional (3D) images with Lambertian reflection and non-Lambertian reflection effects including specular lighting and compound lighting have been reconstructed in 3D space using a homemade LF display system. The proposed method injects more flexibility into the rendering of LF images and can also be used in holographic display, augmented reality, virtual reality, and other fields.

Fast response electrically controlled liquid crystal lens array for high resolution 2D/3D switchable display

A fast response electrically controlled liquid crystal (LC) lens array is revealed. In order to realize the fast response, a double LC layer structure is adopted. The fabricated LC lens array has a small pitch of 310µm and LC layer with a thickness of 50μm. Experimental results show that the focal length of the LC lens array can be continuously adjusted by low driving voltage (∼6.5V_rms), and the shortest focal length is 0.5mm. The switching between 2D display and 3D display is realized by controlling the voltage off and on state of the LC lens array. Experimental result shows that the 2D/3D switchable display has a fast response time of 16ms. The short pitch LC lens array is expected to be used in high-resolution 2D/3D switchable display.

Switchable 2D/3D display based on a liquid crystal lens array and the rotating specimen shooting method

A liquid crystal (LC) lenticular lens array with auxiliary electrodes is proposed. The introduction of the auxiliary electrodes helps to obtain an LC lens array (LCLA) with relatively large aperture without complex structures. When the LCLA is in the focusing state, the voltage of auxiliary electrodes is less than that of edge electrodes, and the generated electric field in the LCLA can penetrate into the LC layer. Therefore, the ideal phase profile is obtained with a relatively thin LC layer thickness. Experimental results show that the LCLA has the characteristics of high optical power and low operation voltage. Based on the proposed LCLA, a multi-view 2D/3D switchable display is realized. In the experiment, a series of parallax images is obtained by rotating the sample to replace the convergence shooting method for 3D imaging. Compared with other 2D/3D switchable display devices, the multi-view 2D/3D switchable display based on the LCLA is characterized by being thin and compact, and displaying no moiré pattern.

Locally controllable 2D/3D mixed display and image generation method

In this paper, a locally controllable two-dimensional (2D)/ three-dimensional (3D) mixed display system and corresponding image generation method are proposed. The proposed system is mainly composed of a collimating backlight module (CBM) and a light control module (LCM). The CBM provides collimating polarized light. The LCM modulates a part of the collimating polarized light to form point light sources for 3D display and the other part to form scattered light sources for 2D display. The 2D and 3D display states can be locally controlled by using a pixelated mask loaded on a polarization switching layer. In addition, a corresponding image generation method is proposed. According to observer's demand, the parallax image is divided into target image area and residual image area by using deep learning matting algorithm, and a 2D/3D mixed light field image with full parallax 3D target image and high-resolution 2D residual image is generated. We developed a prototype based on the proposed locally controllable 2D/3D mixed display structure and generated two sets of 2D/3D mixed light field image with different target objects and residual objects from the same parallax images. The experimental results demonstrated the effectiveness of our proposed system and the corresponding image generation method. High-resolution 2D image and full parallax 3D image were displayed and locally switched in the experimental system.

Portable autostereoscopic display based on multi-directional backlight

A multi-directional backlight autostereoscopic display system with high resolution, low crosstalk, and motion parallax is developed in this paper. The proposed multi-directional backlight system is based on the Bragg mismatched reconstruction of volume holographic optical element (VHOE), and includes a set of light sources which are uniformly arrayed along one direction. Each light source produces its corresponding directional lighting to follow the human eye position detected by an eye tracker. Two scenarios are presented to build the multi-directional backlight system. The prism-type backlight system which guides the incident beam with a prism is relatively simple and easy to implement. The waveguide-type one which employs a transflective film to expand the incident light beam within the waveguide and modulate the intensity of the incident beam, is relatively thin and is applicable to large-area display. Two prototypes are built and the effectiveness of the proposed autostereoscopic display system is verified by the experimental results.

Resolution-preserving passive 2D/3D convertible display based on holographic optical elements

We propose and demonstrate a resolution-preserving passive 2D/3D convertible display by two individual wavelengths. It uses a holographic optical element to generate two images and passively separate the exit pupils for these two wavelengths, which forms two viewpoints for each of the observer's eyes. Due to Bragg-mismatched reconstruction of two similar but distinct wavelengths, the images are separated in space. They can be fused into one through the convergence function of human eyes. By switching the input image source, the conversion between 2D and 3D mode can be realized. This method is resolution-preserving and 2D/3D convertible with no extra active components. For experimental verification, a proof-of-concept projection-type prototype is assessed.

Four-mode 2D/3D switchable display with a 1D/2D convertible liquid crystal lens array

A four-mode 2D/3D switchable display using a 1D/2D convertible liquid crystal (LC) lens array is proposed in this paper. The LC lens array is composed of two orthogonal LC lens arrays, with a λ/2 film in the middle to rotate the polarization by 90°. Based on the LC lens array, a four-mode 2D/3D switchable display is realized, which is switchable between the turn-off and turn-on states: when the operating voltage V₁ = 0, V₂ = 0, the display operates in mode I, which is 2D display; when the operating voltage V₁ = 0, V₂ = 0, the display operates in mode II, and the 3D display effect is in x direction; when the operating voltage V₁ = 0, V₂ = 0, the display operates in mode III, and the 3D display effect is in y direction; when the operating voltage V₁ = 0, V₂ = 0, the display operates in mode IV, the 3D display effect is in x-y plane. Experimental results indicate that the LC lens array has simple fabrication process, low operating voltage (∼5.4V), and short focal length. Moreover, based on the designed LC lens array, the 2D/3D switchable display shows no moiré pattern.

Optofluidic lenticular lens array for a 2D/3D switchable display

In this paper, we propose an optofluidic lenticular lens array (OLLA) for a two-dimensional/three-dimensional (2D/3D) switchable display. The OLLA includes a bottom substrate layer with lenticular lens structure, a microfluidic layer with microchannels, and a top substrate layer with inlets as well as outlets. A micro gap is formed between the lenticular lens of the bottom substrate layer and the top substrate layer. When air is in the micro gap, the OLLA behaves as a lenticular lens array, which can realize 3D display. When fluid is filled in the micro gap, because the refractive index of the fluid is the same with the lenticular lens structure, the OLLA equivalents to a transparent flat panel, which can realize a 2D display. Experiments verify that a switchable 2D/3D display prototype based on this OLLA and a smartphone achieves both high-resolution 2D display and high-quality 3D display.

Optical See-through 2D/3D Compatible Display Using Variable-Focus Lens and Multiplexed Holographic Optical Elements

An optical see-through two-dimensional (2D)/three-dimensional (3D) compatible display using variable-focus lens and multiplexed holographic optical elements (MHOE) is presented. It mainly consists of a MHOE, a variable-focus lens and a projection display device. The customized MHOE, by using the angular multiplexing technology of volumetric holographic grating, records the scattering wavefront and spherical wavefront array required for 2D/3D compatible display. In particular, we proposed a feasible method to switch the 2D and 3D display modes by using a variable-focus lens in the reconstruction process. The proposed system solves the problem of bulky volume, and makes the MHOE more efficient to use. Based on the requirements of 2D and 3D displays, we calculated the liquid pumping volume of the variable-focus lens under two kinds of diopters.

Focus issue introduction: 3D image acquisition and display: technology, perception, and applications

This feature issue of Optics Express is organized in conjunction with the 2020 OSA conference on 3D image acquisition and display: technology, perception and applications which was held virtually in Vancouver from 22 to 26, June 2020 as part of the imaging and sensing congress 2020. This feature issue presents 29 articles based on the topics and scope of the 3D conference. This review provides a summary of these articles.