Aerial projection of three-dimensional motion pictures by electro-holography and parabolic mirrors

Cone-type multi-directional viewing-zone extension of a computer-generated hologram via a shuffle interconnection

We propose the multi-directional viewing-zone extension of computer-generated holograms (CGHs) using a single flat-panel spatial light modulator (SLM) and a multi-directional shuffle interconnection. A design breaking the SLM plane into several sub-zone regions and creating extended viewing-zones through a multi-directional shuffle interconnection is presented with a proof-of-concept experiment generating a cone-like viewing zone subtended by sixteen sub-viewing-zones.

Omnidirectional 3D autostereoscopic aerial display with continuous parallax

We present anl omnidirectional 3D autostereoscopic aerial display with continuous parallax. Integral photography (IP) combined with polyhedron-shaped aerial imaging plates (AIPs) is utilized to achieve an extended view angle of 3D aerial images. With optical theoretical analysis and an aerial in situ rotation design, a 3D aerial display with an enlarged viewing angle is realized. In particular, the proposed 3D aerial display can realize any assigned angle within 360 deg. We also optimize the aerial display with artifact image removal and floating image brightness analysis. Experiments are performed to prove the 3D aerial display with full-motion parallax, continuous viewpoints, and multiplayer interaction. The proposed system is an attractive prospect of non-contact interaction and multi-person collaboration.

Automotive Holographic Head-Up Displays

Driver's access to information about navigation and vehicle data through in-car displays and personal devices distract the driver from safe vehicle management. The discrepancy between road safety and infotainment must be addressed to develop safely operated modern vehicles. Head-up displays (HUDs) aim to introduce a seamless uptake of visual information for the driver while securely operating a vehicle. HUDs projected on the windshield provide the driver with visual navigation and vehicle data within the comfort of the driver's personal eye box through a customizable extended display space. Windshield HUDs do not require the driver to shift the gaze away from the road to attain road information. This article presents a review of technological advances and future perspectives in holographic HUDs by analyzing the optoelectronics devices and the user experience of the driver. The review elucidates holographic displays and full augmented reality in 3D with depth perception when projecting the visual information on the road within the driver's gaze. Design factors, functionality, and the integration of personalized machine learning technologies into holographic HUDs are discussed. Application examples of the display technologies regarding road safety and security are presented. An outlook is provided to reflect on display trends and autonomous driving.

Colour volumetric display based on holographic-laser-excited graphics using drawing space separation

A volumetric display generates a graphics that can be viewed from 360\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$^{\circ }$$\end{document}∘ by representing the 3D information of an object as voxels in physical space. However, the natural properties of physical objects, such as 3D information and colors, and the seamless relationships between graphics and humans make it difficult to implement such displays. Here, we introduce a novel system that combines the spatial generation of femtosecond-laser-excited emission points using computer-generated holograms and beam scanning with the drawing space separation method. We demonstrate the drawing of volumetric graphics that can be color-expressed in voxel units in the air. This system enables the drawing of volumetric graphics in the air, accurate color representations, and robust graphics that are not destroyed by contact with users or objects. It also lays the foundation for the implementation of future volumetric displays.

Dual Fresnel mirror system for 360 degree viewable three-dimensional displays

360-degree viewable three-dimensional (3D) display systems have gained considerable attention for the unique manner in which they display objects. Most of the optical display devices in these systems employ two parabolic mirrors facing each other separated by a distance equal to the focal length of the mirrors. However, the current configuration is limited to unity magnification and provides a small image relative to the volume of the system. This paper presents a novel 3D display system based on two Fresnel mirrors with different focal lengths facing each other. The distance between the mirrors can be adjusted to alter the magnification of the resulting 3D image. Wave-optics analysis of an optical dual-lens system equivalent to the proposed dual-mirror system was used to simulate the image distance, the transverse and longitudinal magnification, and the minimum length of the proposed system. This paper also addresses issues pertaining to the design and manufacture of Fresnel mirrors. An experiment system using Fresnel mirrors with focal lengths of 60mm and 90mm clearly demonstrated the efficacy of the proposed scheme in terms of 3D image magnification.

Fourier digital holography of real scenes for 360° tabletop holographic displays

Recently, the tabletop holographic display has been introduced to present a large 3D hologram floating over the table. When the observer looks down at the hologram, the display reconstructs upper perspectives of the object at a 45° angle. This paper presents the full imaging chain for the tabletop holographic display based on capture, processing, and reconstruction of a 360° observable hologram of the real object. Two different imaging methods, which involve lensless Fourier digital holographic recordings and the tabletop holographic display, are introduced. The first method utilizes the conventional capture approach with a side view perspective and numerical tilt correction for 45° angular mismatch between the acquisition and reconstruction systems. The second method presents a modified lensless digital Fourier holography for holographic recording of the upper perspective. Experimental results including numerical and optical reconstructions present various visual aspects of both capture approaches such as viewpoint correction, refocusing, 3D effects, and 3D deformations.

Three-Dimensional Aerial Image Interface, 3DAII

In this paper, we introduce the three-dimensional aerial image interface, 3DAII. This interface reconstructs and aerially projects a three-dimensional object image, which can be simultaneously observed from various viewpoints or by multiple users with the naked eye. A pyramid reflector is used to reconstruct the object image, and a pair of parabolic mirrors is used to aerially project the image. A user can directly manipulate the three-dimensional object image by superimposing a user’s hand-finger or a rod on the image. A motion capture sensor detects the user’s hand-finger that manipulates the projected image, and the system immediately exhibits some reaction such as deformation, displacement, and discoloration of the object image, including sound effects. A performance test is executed to confirm the functions of 3DAII. The execution time of the end-tip positioning of a robotic arm has been compared among four operating devices: touchscreen, gamepad, joystick, and 3DAII. The results exhibit the advantages of 3DAII; we can directly instruct the movement direction and movement speed of the end-tip of the robotic arm, using the three-dimensional Euclidean vector outputs of 3DAII in which we can intuitively make the end-tip of the robotic arm move in three-dimensional space. Therefore, 3DAII would be one important alternative to an intuitive spatial user interface, e.g., an operation device of aerial robots, a center console of automobiles, and a 3D modelling system. A survey has been conducted to evaluatecomfortandfatiguebased on ISO/TS 9241-411 andease of learningandsatisfactionbased on the USE questionnaire. We have identified several challenges related to visibility, workspace, and sensory feedback to users that we would like to address in the future.

Electronic Tabletop Holographic Display: Design, Implementation, and Evaluation

Most of the previously-tried prototype systems of digital holographic display are of front viewing flat panel-type systems having narrow viewing angle, which do not meet expectations towards holographic displays having more volumetric and realistic 3-dimensional image rendering capability. We have developed a tabletop holographic display system which is capable of 360° rendering of volumetric color hologram moving image, looking much like a real object. Multiple viewers around the display can see the image and perceive very natural binocular as well as motion parallax. We have previously published implementation details of a mono color version of the system, which was the first prototype. In this work, we present requirements, design methods, and the implementation result of a full parallax color tabletop holographic display system, with some recapitulation of motivation and a high-level design concept. We also address the important issue of performance measure and evaluation of a holographic display system and image, with initial results of experiments on our system.

Radially arranged dihedral corner reflector array for wide viewing angle of floating image without virtual image

We proposed a new type of dihedral corner reflector array (DCRA) called "radially arranged DCRA". Our radially arranged DCRA could display a floating, three-dimensional image with a wide viewing angle without producing virtual images because dihedral corner reflectors were radially arranged for the designed paths of rays. In this research, we designed a reflector array pattern and evaluated the viewing angle of the floating image displayed by our radially arranged DCRA. During evaluation, we measured the reflection ratio of the radially arranged DCRA and demonstrated a floating image. Compared with a conventional DCRA, our radially arranged DCRA could expand the viewing angle from ± 30° to ± 90° without producing virtual images.

Super-wide viewing-zone holographic 3D display using a convex parabolic mirror

To enlarge both horizontal (azimuthal) and vertical (zenithal) viewing zones simultaneously, a convex parabolic mirror is placed after passing through the hologram. Viewers perceive a three-dimensional (3D) object inside the parabolic mirror as a virtual image by capturing the wavefront radially reflected from the parabolic mirror. The optical experiment using the convex parabolic mirror has demonstrated an extremely wide viewing zone with an azimuthal range of 180° and zenithal range of 90°. The viewing zone and the shape of the parabolic surface are analyzed. The hologram is designed considering the parabolic mirror reflection, and its diffraction calculation method based on Fermat's principle is also proposed.

Accelerated synthesis of wide-viewing angle polygon computer-generated holograms using the interocular affine similarity of three-dimensional scenes

The interocular affine similarity of three-dimensional scenes is investigated and a novel accelerated reconfiguration algorithm for intermediate-view polygon computer-generated holograms based on interocular affine similarity is proposed. We demonstrate by using the numerical simulations of full-color polygon computer-generation holograms that the proposed intermediate view reconfiguration algorithm is particularly useful for the computation of wide-viewing angle polygon computer-generated holograms.

Full bandwidth dynamic coarse integral holographic displays with large field of view using a large resonant scanner and a galvanometer scanner

An efficient method to implement the coarse integral holographic (CIH) concept for dynamic CIH displays is to scan the information generated from a spatial light modulator (SLM) of a low space bandwidth product (SBP) but high bandwidth to form the hologram array for the integral optics. Previously, just over half of the SLMs bandwidth was utilized due to the fact that the galvanometer scanner in use could not tile all the holograms that the SLM is capable to produce, resulting in the loss of nearly half of the field of view (FOV). Here, we propose a full bandwidth dynamic CIH display using a large resonant scanner in conjunction with a hybrid raster scanner, which can utilize the full bandwidth of the spatial light modulator and double the horizontal FOV. Experimental results confirm that with the SLM and scanners as used, the FOV can reach 48° when the SLM reaches its full bandwidth. This approach can be used for future scalable and tileable CIH display systems.

Interactive Holographic Display Based on Finger Gestures

In this paper, we demonstrate an interactive, finger-sensitive system which enables an observer to intuitively handle electro-holographic images in real time. In this system, a motion sensor detects finger gestures (swiping and pinching) and translates them into the rotation and enlargement/reduction of the holographic image, respectively. By parallelising the hologram calculation using a graphics processing unit, we realised the interactive handling of the holographic image in real time. In a demonstration of the system, we used a Leap Motion sensor and a phase modulation-type spatial light modulator with 1,920 × 1,080 pixels and a pixel pitch of 8.0 µm × 8.0 µm. The constructed interactive finger-sensitive system was able to rotate a holographic image composed of 4,096 point light sources using a swiping gesture and enlarge or reduce it using a pinching gesture in real time. The average calculation speed was 27.6 ms per hologram. Finally, we extended the constructed system to a full-colour reconstruction system that generates a more realistic three-dimensional image. The extended system successfully allowed the handling of a full-colour holographic image composed of 1,709 point light sources with a calculation speed of 22.6 ms per hologram.

Real-time colour hologram generation based on ray-sampling plane with multi-GPU acceleration

Although electro-holography can reconstruct three-dimensional (3D) motion pictures, its computational cost is too heavy to allow for real-time reconstruction of 3D motion pictures. This study explores accelerating colour hologram generation using light-ray information on a ray-sampling (RS) plane with a graphics processing unit (GPU) to realise a real-time holographic display system. We refer to an image corresponding to light-ray information as an RS image. Colour holograms were generated from three RS images with resolutions of 2,048 × 2,048; 3,072 × 3,072 and 4,096 × 4,096 pixels. The computational results indicate that the generation of the colour holograms using multiple GPUs (NVIDIA Geforce GTX 1080) was approximately 300–500 times faster than those generated using a central processing unit. In addition, the results demonstrate that 3D motion pictures were successfully reconstructed from RS images of 3,072 × 3,072 pixels at approximately 15 frames per second using an electro-holographic reconstruction system in which colour holograms were generated from RS images in real time.

Digital holographic high-speed 3D imaging for the vibrometry of fast-occurring phenomena

Digital holography allows production of high-speed three-dimensional images at rates over 100,000 frames per second; however, simultaneously obtaining suitable performance and levels of accuracy using digital holography is difficult. This problem prevents high-speed three-dimensional imaging from being used for vibrometry. In this paper, we propose and test a digital holography method that can produce vibration measurements. The method is based on single-shot phase-shifting interferometry. Herein, we imaged the surface of a loudspeaker diaphragm and measured its displacement due to the vibrations produced by a frequency sweep signal. We then analyzed the frequency of the experimental data and confirmed that the frequency spectra inferred from the reconstructed images agreed well with the spectra produced by the sound recorded by a microphone. This method can be used for measuring vibrations with three-dimensional imaging for loudspeakers, microelectromechanical systems, surface acoustic wave filters, and biological tissues and organs.

360-degree tabletop electronic holographic display

We demonstrate a tabletop holographic display system for simultaneously serving continuous parallax 3.2-inch 360-degree three-dimensional holographic image content to multiple observers at a 45-degree oblique viewing circumference. To achieve this, localized viewing windows are to be seamlessly generated on the 360-degree viewing circumference. In the proposed system, four synchronized high-speed digital micro-mirror displays are optically configured to comprise a single 2 by 2 multi-vision panel that enables size enlargement and time-division-multiplexing of holographic image content. Also, a specially designed optical image delivery sub-system that is composed of parabolic mirrors and an aspheric lens is designed as an essential part for achieving an enlarged 3.2-inch holographic image and a large 45-degree oblique viewing angle without visual distortion.

Real-time time-division color electroholography using a single GPU and a USB module for synchronizing reference light

We propose real-time time-division color electroholography using a single graphics processing unit (GPU) and a simple synchronization system of reference light. To facilitate real-time time-division color electroholography, we developed a light emitting diode (LED) controller with a universal serial bus (USB) module and the drive circuit for reference light. A one-chip RGB LED connected to a personal computer via an LED controller was used as the reference light. A single GPU calculates three computer-generated holograms (CGHs) suitable for red, green, and blue colors in each frame of a three-dimensional (3D) movie. After CGH calculation using a single GPU, the CPU can synchronize the CGH display with the color switching of the one-chip RGB LED via the LED controller. Consequently, we succeeded in real-time time-division color electroholography for a 3D object consisting of around 1000 points per color when an NVIDIA GeForce GTX TITAN was used as the GPU. Furthermore, we implemented the proposed method in various GPUs. The experimental results showed that the proposed method was effective for various GPUs.