Three-dimensional display with a long viewing distance by use of integral photography

Bandwidth-enhanced depth priority integral imaging using a band-limited diffusing illumination technique

The display bandwidth and display mechanism determine the performance of the three-dimensional (3D) display system. In this paper, a bandwidth-enhanced depth priority integral imaging (DPII) technique is proposed. Information transmission efficiency (ITE) defined as the output display bandwidth divided by the input display bandwidth is used to assess the II system. By analyzing the ITE, we find that only a part of the input display bandwidth is used efficiently to present the 3D image in the traditional DPII system. The DPII system sacrifices the ITE for depth enhancement. The low ITE that fundamentally limits the 3D performance of the DPII system is ascribed to the diffusing illumination mechanism of the display system. To enhance the 3D performance, a collimated illumination DPII system as a special case of band-limited diffusing illumination technique has been proposed and demonstrated first. The bandwidth and ITE of such a DPII system are increased. The depth of field (DOF) of the system is doubled. The resolution of the 3D image is increased to the level of the resolution priority II system without sacrificing the viewing angle. A more general case, band-limited illumination DPII system is also demonstrated. By modulating the divergence angle of the illumination system, the 3D image's resolution and DOF can be controlled. The bandwidth and ITE of the DPII system using band-limited illumination are also higher than that of the traditional DPII system. Experiments are presented to prove the bandwidth-enhanced mechanism of the DPII system.

3-D spatial floating display using multi-wavelength integral photography

Three-dimensional (3-D) autostereoscopic display with dedicated multiple spatial information under corresponding illumination is critical, especially for anti-counterfeiting, entertainment, etc. In this paper, we propose a 3-D spatial floating display using multi-wavelength integral photography (IP). Using dedicated inkjet printer and refraction-based IP algorithm, a complex two-dimensional (2-D) elemental image array (EIA) can be printed for both fluorescent and normal 3-D autostereoscopic display. With a micro-convex lens array (MLA) and a medium attached on the EIA, normal 3-D images are reconstructed under visible light, while fluorescent 3-D images can be reconstructed under ultraviolet (UV) light. Moreover, to provide comfortable 3-D images with multiple information in space, a feasible 3-D spatial floating display system is also proposed considering the spatial position of the observer with less UV radiation. The proposed method takes the wavelength of 3-D display into consideration to provide spatial multi-information, and can be applied for media, entertainment, etc. Experimental results verified the availability of the proposed method.

Twin imaging phenomenon of integral imaging

The imaging principles and phenomena of integral imaging technique have been studied in detail using geometrical optics, wave optics, or light filed theory. However, most of the conclusions are only suit for the integral imaging systems using diffused illumination. In this work, a kind of twin imaging phenomenon and mechanism has been observed in a non-diffused illumination reflective integral imaging system. Interactive twin images including a real and a virtual 3D image of one object can be activated in the system. The imaging phenomenon is similar to the conjugate imaging effect of hologram, but it base on the refraction and reflection instead of diffraction. The imaging characteristics and mechanisms different from traditional integral imaging are deduced analytically. Thin film integral imaging systems with 80μm thickness have also been made to verify the imaging phenomenon. Vivid lighting interactive twin 3D images have been realized using a light-emitting diode (LED) light source. When the LED is moving, the twin 3D images are moving synchronously. This interesting phenomenon shows a good application prospect in interactive 3D display, argument reality, and security authentication.

Super long viewing distance light homogeneous emitting three-dimensional display

Three-dimensional (3D) display technology has continuously been attracting public attention with the progress in today's 3D television and mature display technologies. The primary characteristics of conventional glasses-free autostereoscopic displays, such as spatial resolution, image depths, and viewing angle, are often limited due to the use of optical lenses or optical gratings. We present a 3D display using MEMS-scanning-mechanism-based light homogeneous emitting (LHE) approach and demonstrate that the display can directly generate an autostereoscopic 3D image without the need for optical lenses or gratings. The generated 3D image has the advantages of non-aberration and a high-definition spatial resolution, making it the first to exhibit animated 3D images with image depth of six meters. Our LHE 3D display approach can be used to generate a natural flat-panel 3D display with super long viewing distance and alternative real-time image update.

Real-time computer-generated integral imaging and 3D image calibration for augmented reality surgical navigation

Autostereoscopic 3D image overlay for augmented reality (AR) based surgical navigation has been studied and reported many times. For the purpose of surgical overlay, the 3D image is expected to have the same geometric shape as the original organ, and can be transformed to a specified location for image overlay. However, how to generate a 3D image with high geometric fidelity and quantitative evaluation of 3D image's geometric accuracy have not been addressed. This paper proposes a graphics processing unit (GPU) based computer-generated integral imaging pipeline for real-time autostereoscopic 3D display, and an automatic closed-loop 3D image calibration paradigm for displaying undistorted 3D images. Based on the proposed methods, a novel AR device for 3D image surgical overlay is presented, which mainly consists of a 3D display, an AR window, a stereo camera for 3D measurement, and a workstation for information processing. The evaluation on the 3D image rendering performance with 2560×1600 elemental image resolution shows the rendering speeds of 50-60 frames per second (fps) for surface models, and 5-8 fps for large medical volumes. The evaluation of the undistorted 3D image after the calibration yields sub-millimeter geometric accuracy. A phantom experiment simulating oral and maxillofacial surgery was also performed to evaluate the proposed AR overlay device in terms of the image registration accuracy, 3D image overlay accuracy, and the visual effects of the overlay. The experimental results show satisfactory image registration and image overlay accuracy, and confirm the system usability.

Autostereoscopic 3D Display with Long Visualization Depth Using Referential Viewing Area-Based Integral Photography

We developed an autostereoscopic display for distant viewing of 3D computer graphics (CG) images without using special viewing glasses or tracking devices. The images are created by employing referential viewing area-based CG image generation and pixel distribution algorithm for integral photography (IP) and integral videography (IV) imaging. CG image rendering is used to generate IP/IV elemental images. The images can be viewed from each viewpoint within a referential viewing area and the elemental images are reconstructed from rendered CG images by pixel redistribution and compensation method. The elemental images are projected onto a screen that is placed at the same referential viewing distance from the lens array as in the image rendering. Photographic film is used to record the elemental images through each lens. The method enables 3D images with a long visualization depth to be viewed from relatively long distances without any apparent influence from deviated or distorted lenses in the array. We succeeded in creating an actual autostereoscopic images with an image depth of several meters in front of and behind the display that appear to have 3D even when viewed from a distance.

Depth enhancement of integral imaging by using polymer-dispersed liquid-crystal films and a dual-depth configuration

In spite of their many advantages, limited image depth still remains as an obstacle to three-dimensional displays based on integral imaging. In this Letter, by combining multiple polymer-dispersed liquid-crystal films and a dual-depth configuration, we propose a method to enhance the depth range of the integral imaging display system.

Noncontact Tactile Display Based on Radiation Pressure of Airborne Ultrasound

This paper describes a tactile display which provides unrestricted tactile feedback in air without any mechanical contact. It controls ultrasound and produces a stress field in a 3D space. The principle is based on a nonlinear phenomenon of ultrasound: Acoustic radiation pressure. The fabricated prototype consists of 324 airborne ultrasound transducers, and the phase and intensity of each transducer are controlled individually to generate a focal point. The DC output force at the focal point is 16 mN and the diameter of the focal point is 20 mm. The prototype produces vibrations up to 1 kHz. An interaction system including the prototype is also introduced, which enables users to see and touch virtual objects.

Multi-viewer tracking integral imaging system and its viewing zone analysis

We propose a multi-viewer tracking integral imaging system for viewing angle and viewing zone improvement. In the tracking integral imaging system, the pickup angles in each elemental lens in the lens array are decided by the positions of viewers, which means the elemental image can be made for each viewer to provide wider viewing angle and larger viewing zone. Our tracking integral imaging system is implemented with an infrared camera and infrared light emitting diodes which can track the viewers' exact positions robustly. For multiple viewers to watch integrated three-dimensional images in the tracking integral imaging system, it is needed to formulate the relationship between the multiple viewers' positions and the elemental images. We analyzed the relationship and the conditions for the multiple viewers, and verified them by the implementation of two-viewer tracking integral imaging system.

Viewing window expansion of integral floating display

A method to expand the viewing window for the integral floating display by twofold through time multiplexing is proposed. The viewing window of the integral floating display can be expanded by enlarging the elemental image area for each elemental lens, by which the viewing angle of the integral imaging system is determined. Also, the difference between the effects of elemental image area expansion on the viewing characteristics of images reconstructed by the integral floating display and the integral imaging system is investigated. The experimental results verify the enhancement of the viewing window for the three-dimensional images displayed by the proposed scheme.

Depth-enhanced integral imaging display system with electrically variable image planes using polymer-dispersed liquid-crystal layers

A depth-enhanced three-dimensional integral imaging system with electrically variable image planes is proposed. For implementing the variable image planes, polymer-dispersed liquid-crystal (PDLC) films and a projector are adopted as a new display system in the integral imaging. Since the transparencies of PDLC films are electrically controllable, we can make each film diffuse the projected light successively with a different depth from the lens array. As a result, the proposed method enables control of the location of image planes electrically and enhances the depth. The principle of the proposed method is described, and experimental results are also presented.