Volumetric display system based on three-dimensional scanning of inclined optical image

Extended depth of field in augmented reality

The 3D display device shows an image with depth information. Conventional 3D display devices based on binocular parallax can focus accurately only on the depth of a specific screen. Because the human eye has a narrow depth of field (DOF) under normal circumstances, 3D displays that provide a relatively wide range of virtual depth areas have limitations on the DOF where clear 3D images are seen. To resolve this problem, it is necessary to find the optical conditions to extend the DOF and analyze the phenomena related to it. For this, by using the Rayleigh criterion and the Strehl ratio, a criterion for this extension of the DOF is suggested. A practical optical structure that can effectively extend the DOF is devised using a flat panel display. This optical structure could be applied to AR, VR, and MR in the field of near-eye displays. From the results of this research, the fundamental optical conditions and standards are proposed for 3D displays that will provide 3D images with extended DOF in the future. Furthermore, it is also expected that these conditions and criteria can be applied to optical designs for the required performance in the development of 3D displays in various fields.

Static volumetric three-dimensional display based on an electric-field-controlled two-dimensional optical beam scanner

Using the quadratic electro-optic effect and the gradient of the composition ratio m [Nb/(Ta+Nb) in mol. %] in a potassium tantalate niobate crystal, we have designed an electric-field-controlled two-dimensional optical beam scanner with a wide wavelength range and fast response. This scanner is used to realize a volumetric display based on a two-frequency, two-step upconversion technique that is used to address the imaging volume. Use of appropriately designed imaging optics and custom-designed software to convert 2D renderings of volumetric images into control signals for the scanner along with appropriate infrared laser source selection allows efficient single-color image generation with a large viewing zone, without flicker and with natural depth cues. The resulting system has the potential to increase image resolution to nearly 61.5×10⁹ with high scanning frequency and to expand to display three-color imagery.

High-resolution augmented reality 3D display with use of a lenticular lens array holographic optical element

An augmented reality (AR) three-dimensional (3D) display based on one-dimensional integral imaging (1DII), by using a lenticular lens array holographic optical element (LLA-HOE), is proposed. The 3D image of the 1DII has higher vertical resolution compared with the image of conventional integral imaging whose resolution is sharply reduced for providing quasi-continuous viewpoints in both the horizontal and vertical directions. The proposed 3D display consists of a projector and an LLA-HOE and is compact. As an image combiner, the LLA-HOE can diffract Bragg-matched light rays that have the same wavelength and incident angle as the original reference wave; it can also function as a lenticular lens array to reconstruct a 3D image but transmit other light rays emitted from the surroundings. In the experiment, an LLA-HOE of 80  mm×80  mm size is recorded, and a combination of a high-resolution 3D virtual image and a real 3D object is presented by the proposed AR 3D display.

Aerial projection of three-dimensional motion pictures by electro-holography and parabolic mirrors

We demonstrate an aerial projection system for reconstructing 3D motion pictures based on holography. The system consists of an optical source, a spatial light modulator corresponding to a display and two parabolic mirrors. The spatial light modulator displays holograms calculated by computer and can reconstruct holographic motion pictures near the surface of the modulator. The two parabolic mirrors can project floating 3D images of the motion pictures formed by the spatial light modulator without mechanical scanning or rotating. In this demonstration, we used a phase-modulation-type spatial light modulator. The number of pixels and the pixel pitch of the modulator were 1,080 × 1,920 and 8.0 μm × 8.0 μm, respectively. The diameter, the height and the focal length of each parabolic mirror were 288 mm, 55 mm and 100 mm, respectively. We succeeded in aerially projecting 3D motion pictures of size ~2.5 mm³ by this system constructed by the modulator and mirrors. In addition, by applying a fast computational algorithm for holograms, we achieved hologram calculations at ~12 ms per hologram with 4 CPU cores.

Optimization of galvanometer scanning for optical coherence tomography

We study experimentally the effective duty cycle of galvanometer-based scanners (GSs) with regard to three main parameters of the scanning process: theoretical/imposed duty cycle (of the input signal), scan frequency, and scan amplitude. Sawtooth and triangular input signals for the device are considered. The effects of the mechanical inertia of the oscillatory element of the GS are analyzed and their consequences are discussed in the context of optical coherence tomography (OCT) imaging. When the theoretical duty cycle and the scan amplitude are increased to the limit, the saturation of the device is demonstrated for a useful range of scan frequencies by direct measurement of the position of the galvomirror. Investigations of OCT imaging of large samples also validate this saturation, as examplified by the gaps/blurred portions obtained between neighboring images when using both triangular and sawtooth scanning at high scan frequencies. For this latter aspect, the necessary overlap between neighboring B-scans, and therefore between the corresponding volumetric reconstructions of the sample, are evaluated and implemented with regard to the same parameters of the scanning process. OCT images that are free of these artifacts are thus obtained.

Realization of an aerial 3D image that occludes the background scenery

In this paper we describe an aerial 3D image that occludes far background scenery based on coarse integral volumetric imaging (CIVI) technology. There have been many volumetric display devices that present floating 3D images, most of which have not reproduced the visual occlusion. CIVI is a kind of multilayered integral imaging and realizes an aerial volumetric image with visual occlusion by combining multiview and volumetric display technologies. The conventional CIVI, however, cannot show a deep space, for the number of layered panels is limited because of the low transmittance of each panel. To overcome this problem, we propose a novel optical design to attain an aerial 3D image that occludes far background scenery. In the proposed system, a translucent display panel with 120 Hz refresh rate is located between the CIVI system and the aerial 3D image. The system modulates between the aerial image mode and the background image mode. In the aerial image mode, the elemental images are shown on the CIVI display and the inserted translucent display is uniformly translucent. In the background image mode, the black shadows of the elemental images in a white background are shown on the CIVI display and the background scenery is displayed on the inserted translucent panel. By alternation of these two modes at 120 Hz, an aerial 3D image that visually occludes the far background scenery is perceived by the viewer.

Volumetric display using rotating prism sheets arranged in a symmetrical configuration

A volumetric display that creates a distortion-free three-dimensional (3D) image in midair is described. The proposed system consists of rotating prism sheets used as an optical scanner and a dihedral corner reflector array (DCRA), which is a distortion-free imaging element. Two prism sheets are arranged in a symmetrical configuration to reduce an unnatural motion parallax caused by optical aberrations. A cross-section of the 3D image is formed by the DCRA in midair and moved by the rotating prism sheets to create a 3D displayable space. A 3D volume image was displayed without image distortion or unnatural motion parallax.

Floating volumetric image formation using a dihedral corner reflector array device

A volumetric display system using an optical imaging device consisting of numerous dihedral corner reflectors placed perpendicular to the surface of a metal plate is proposed. Image formation by the dihedral corner reflector array (DCRA) is free from distortion and focal length. In the proposed volumetric display system, a two-dimensional real image is moved by a mirror scanner to scan a three-dimensional (3D) space. Cross-sectional images of a 3D object are displayed in accordance with the position of the image plane. A volumetric image is observed as a stack of the cross-sectional images. The use of the DCRA brings compact system configuration and volumetric real image generation with very low distortion. An experimental volumetric display system including a DCRA, a galvanometer mirror, and a digital micro-mirror device was constructed to verify the proposed method. A volumetric image consisting of 1024×768×400 voxels was formed by the experimental system.

Experimental investigations of the scanning functions of galvanometer-based scanners with applications in OCT

We analyze the three most common profiles of scanning functions for galvanometer-based scanners (GSs): the sawtooth, triangular and sinusoidal functions. They are determined experimentally with regard to the scan parameters of the input signal (i.e., frequency and amplitude). We study the differences of the output function of the GS measured as the positional error of the oscillatory mirror from the ideal function given by the input signal of the device. The limits in achieving the different types of scanning functions in terms of duty cycle and linearity are determined experimentally for the possible range of scan parameters. Of particular importance are the preservation of an imposed duty cycle and profile for the sawtooth function, the quantification of the linearity for the sinusoidal function, and the effective duty cycle for the triangular, as well as for the other functions. The range of scan amplitudes for which the stability of the oscillatory regime of the galvo mirror is stable for different frequencies is also highlighted. While the use of the device in certain scanning regimes is studied, certain rules of thumb are deduced to make the best out of the galvoscanner. Finally, the three types of scanning functions are tested with a Fourier domain optical coherence tomography (FD OCT) setup and the conclusions of the study are demonstrated in an imaging application by correlating the determined limits of the scanning regimes with the requirements of OCT.

Synthesis and display of dynamic holographic 3D scenes with real-world objects

A 3D scene is synthesized combining multiple optically recorded digital holograms of different objects. The novel idea consists of compositing moving 3D objects in a dynamic 3D scene using a process that is analogous to stop-motion video. However in this case the movie has the exciting attribute that it can be displayed and observed in 3D. We show that 3D dynamic scenes can be projected as an alternative to complicated and heavy computations needed to generate realistic-looking computer generated holograms. The key tool for creating the dynamic action is based on a new concept that consists of a spatial, adaptive transformation of digital holograms of real-world objects allowing full control in the manipulation of the object's position and size in a 3D volume with very high depth-of-focus. A pilot experiment to evaluate how viewers perceive depth in a conventional single-view display of the dynamic 3D scene has been performed.

Demonstration of a large-size real-time full-color three-dimensional display

A large-size and full-color three-dimensional (3D) display system without the need for special eyeglasses is demonstrated. With a specially fabricated holographic functional screen with a size of 1.8x1.3 m(2), the system including optimally designed camera-projector arrays and a video server can display the fully continuous, natural 3D scene with more than 1 m image depth in real time. We explain the operating principle and present experimental results.

An updatable holographic three-dimensional display

Holographic three-dimensional (3D) displays provide realistic images without the need for special eyewear, making them valuable tools for applications that require situational awareness, such as medical, industrial and military imaging. Currently commercially available holographic 3D displays use photopolymers that lack image-updating capability, resulting in restricted use and high cost. Photorefractive polymers are dynamic holographic recording materials that allow updating of images and have a wide range of applications, including optical correlation, imaging through scattering media and optical communication. To be suitable for 3D displays, photorefractive polymers need to have nearly 100% diffraction efficiency, fast writing time, hours of image persistence, rapid erasure, and large area-a combination of properties that has not been shown before. Here, we report an updatable holographic 3D display based on photorefractive polymers with such properties, capable of recording and displaying new images every few minutes. This is the largest photorefractive 3D display to date (4 x 4 inches in size); it can be recorded within a few minutes, viewed for several hours without the need for refreshing, and can be completely erased and updated with new images when desired.