Three-directional motion compensation-based novel-look-up-table for video hologram generation of three-dimensional objects freely maneuvering in space

Phase-only hologram video compression using a deep neural network for up-scaling and restoration

This paper proposes a coding method for compressing a phase-only hologram video (PoHV), which can be directly displayed in a commercial phase-only spatial light modulator. Recently, there has been active research to use a standard codec as an anchor to develop a new video coding for 3D data such as MPEG point cloud compression. The main merit of this approach is that if a new video codec is developed, the performance of relative coding methods can be increased simultaneously. Furthermore, compatibility is increased by the capability to use various anchor codecs, and the developing time is decreased. This paper uses a currently used video codec as an anchor codec and develops a coding method including progressive scaling and a deep neural network to overcome low temporal correlation between frames of a PoHV. Since it is difficult to temporally predict a correlation between frames of a PoHV, this paper adopts a scaling function and a neural network in the encoding and decoding process, not adding complexity to an anchor itself to predict temporal correlation. The proposed coding method shows an enhanced coding gain of an average of 22%, compared with an anchor in all coding conditions. When observing numerical and optical reconstructions, the result images by the proposed show clearer objects and less juddering than the result by the anchor.

Alternative constraints for improved multiplane hologram generation

In this work, we introduce a modified hologram plane constraint to improve the accuracy of the global Gerchberg-Saxton (GGS) algorithm used for multiplane phase-only hologram generation. This constraint consists of a modified phase factor that depends on the amplitude of the field in the hologram plane. We demonstrate that this constraint produces an increase in the mean correlation coefficient between the reconstructed planes from a multiplane hologram and the corresponding amplitude targets for each plane. Furthermore, this constraint can be applied together with a mixed constraint in the reconstruction planes, leading to a more uniform and controllable reproduction of a target intensity distribution. To confirm the validity of our proposal, we show numerical and experimental results for multiplane holograms with six discrete planes, using both high and low contrast targets. For the experimental results, we implement a holographic projection scheme based on a phase-only spatial light modulator.

Fast calculation method based on hidden region continuity for computer-generated holograms with multiple cameras in a sports scene

We propose, to the best of our knowledge, the world's first system capable of fast calculating computer-generated holograms (CGHs) from a large-scale outdoor sports scene captured with multiple RGB cameras. In the system, we introduce a fast calculation method focusing on hidden region continuity (HRC) that frequently appears in a point cloud of a 3D sports scene generated from free-viewpoint video technology. The experimental results show that the calculation time of the proposed HRC method is five to 10 times faster than that of the point-based method, which is one of the common CGH calculation methods.

Fast hologram generation method based on the optimal segmentation of a sub-CGH

In this paper, a fast hologram generation method is proposed based on the optimal segmentation of a sub-computer-generated-hologram (sub-CGH). The relationship between the pixels on the hologram and the corresponding reconstructed image is calculated firstly. Secondly, the sub-CGH corresponding to the object point from the recorded object is optimized and divided into the optimized diffraction area and the invalid diffraction area. Then, the optimized diffraction area of the sub-CGH for each object point is pre-calculated and saved. Finally, the final hologram can be generated by superimposing all the sub-CGHs. With the proposed method, the calculation time for the final hologram can be significantly reduced and the quality of the reconstructed image is not affected. Moreover, the proposed method has the advantages of perspective enlargement compared with the traditional method, and the experiment results verify its feasibility.

Faster generation of holographic videos of objects moving in space using a spherical hologram-based 3-D rotational motion compensation scheme

A spherical hologram-based three-dimensional rotational-motion compensation (SH-3DRMC) method is proposed for the accelerated generation of holographic videos of a three-dimensional (3-D) object moving in space along the arbitrary trajectory with many locally-different curvatures. All those 3-D rotational motions of the object made on each arc can be compensated just by rotating their local spherical holograms along the spherical surfaces matched with the object's moving trajectory using the estimated rotation-axes and angles, which enables a massive reduction of computational complexity of the conventional hologram-generation algorithm and results in an accelerated calculation of holographic videos. Experiments with a test video show that the average calculation times of the conventional NLUT, WRP and 1-D NLUT methods employing the proposed SH-3DRMC scheme have been noticeably reduced by 34.75%, 41.37% and 31.64%, respectively, in comparison with those of their original methods. These good experimental results confirm the feasibility of the proposed system.

Full-scale one-dimensional NLUT method for accelerated generation of holographic videos with the least memory capacity

A full-scale one-dimensional novel-look-up-table (1-D NLUT) method enabling faster generation of holographic videos with the minimum memory capacity is proposed. Only a pair of half-sized 1-D baseline and depth-compensating principal-fringe-patterns (PFPs) is pre-calculated and stored based on the concentric-symmetry property of the PFP, and from which a set of half-sized 1-D PFPs for all depth planes are generated based on its thin-lens property, which enables minimization of the required memory size down to a few KB regardless of the number of depth planes. Moreover, all those hologram calculations are fully one-dimensionally performed with a set of half-sized 1-D PFPs based on its shift invariance property, which also allows minimization of its overall hologram calculation time. From experiments with test videos, the proposed method has been found to have the shortest hologram calculation time even with the least memory in comparison with several modified versions of the conventional NLUT and LUT methods, which confirms its feasibility.

Accelerated generation of holographic videos of 3-D objects in rotational motion using a curved hologram-based rotational-motion compensation method

A new curved hologram-based rotational-motion compensation (CH-RMC) method is proposed for accelerated generation of holographic videos of 3-D objects moving on the random path with many locally different arcs. All of those rotational motions of the object made on each arc can be compensated, just by rotating their local curved holograms along the curving surfaces matched with the object's moving trajectory without any additional calculation process, which results in great enhancements of the computational speed of the conventional hologram-generation algorithms. Experiments with a test video scenario reveal that average numbers of calculated object points (ANCOPs) and average calculation times for one frame (ACTs) of the CH-RMC-based ray-tracing, wavefront-recording-plane and novel- look-up-table methods have been found to be reduced by 73.10%, 73.84%, 73.34%, and 68.75%, 50.82%, 66.59%, respectively, in comparison with those of their original methods. In addition, successful reconstructions of 3-D scenes from those holographic videos confirm the feasibility of the proposed system.

Single SLM full-color holographic 3-D display based on sampling and selective frequency-filtering methods

A single SLM (spatial light modulator) full-color holographic 3-D display based on sampling and selective frequency-filtering methods is proposed. Spatially-sampled R(red), G(green) and B(blue)-holograms can provide periodic 3 × 3 arrays of their frequency spectrums. Thus, by allocating three groups of three spectrums to each color hologram, and selectively filtering out those spectrums with their own spectrum filtering masks (SFMs), frequency-filtered R, G and B-holograms can be obtained. These holograms are synthesized into a single color-multiplexed hologram, and optically reconstructed into a color distortion-free full-color 3-D object on the 4-f lens system, where color-dispersion due to the pixelated structure of the SLM can be removed with the optical versions of SFMs. Fourier-optical analysis and experiments with 3-D color objects in motion confirm the feasibility of the proposed system in the practical application.

Three-directional motion-compensation mask-based novel look-up table on graphics processing units for video-rate generation of digital holographic videos of three-dimensional scenes

A three-directional motion-compensation mask-based novel look-up table method is proposed and implemented on graphics processing units (GPUs) for video-rate generation of digital holographic videos of three-dimensional (3D) scenes. Since the proposed method is designed to be well matched with the software and memory structures of GPUs, the number of compute-unified-device-architecture kernel function calls can be significantly reduced. This results in a great increase of the computational speed of the proposed method, allowing video-rate generation of the computer-generated hologram (CGH) patterns of 3D scenes. Experimental results reveal that the proposed method can generate 39.8 frames of Fresnel CGH patterns with 1920×1080 pixels per second for the test 3D video scenario with 12,088 object points on dual GPU boards of NVIDIA GTX TITANs, and they confirm the feasibility of the proposed method in the practical application fields of electroholographic 3D displays.

Simple and fast cosine approximation method for computer-generated hologram calculation

The cosine function is a heavy computational operation in computer-generated hologram (CGH) calculation; therefore, it is implemented by substitution methods such as a look-up table. However, the computational load and required memory space of such methods are still large. In this study, we propose a simple and fast cosine function approximation method for CGH calculation. As a result, we succeeded in creating CGH with sufficient quality and made the calculation time 1.6 times as fast at maximum compared to using the look-up table of the cosine function on CPU implementation.

Accelerated one-step generation of full-color holographic videos using a color-tunable novel-look-up-table method for holographic three-dimensional television broadcasting

A color-tunable novel-look-up-table (CT-NLUT) for fast one-step calculation of full-color computer-generated holograms is proposed. The proposed method is composed of four principal fringe patterns (PFPs) such as a baseline, a depth-compensating and two color-compensating PFPs. CGH patterns for one color are calculated by combined use of baseline-PFP and depth-compensating-PFP and from them, those for two other colors are generated by being multiplied by the corresponding color-compensating-PFPs. color-compensating-PFPs compensate for differences in the wavelength between two colors based on their unique achromatic thin-lens properties, enabling transformation of one-color CGH pattern into those for other colors. This color-conversion property of the proposed method enables simultaneous generation of full color-CGH patterns, resulting in a significant reduction of the full color-CGH calculation time. Experimental results with test scenario show that the full color-CGH calculation time of the proposed CT-NLUT has been reduced by 45.10%, compared to the conventional NLUT. It has been further reduced by 96.01% when a data compression algorithm, called temporal redundancy-based NLUT, was used together, which means 25-fold reduction of its full color-CGH calculation time. Successful computational and optical reconstructions of full color-CGH patterns confirm the feasibility of the proposed method.

Fast one-step calculation of holographic videos of three-dimensional scenes by combined use of baseline and depth-compensating principal fringe patterns

As a new approach for rapid generation of holographic videos, a so-called compressed novel-look-up-table(C-NLUT), which is composed of only two principal fringe patterns (PFPs) of baseline and depth-compensating PFPs (B-PFP, DC-PFP), is proposed. Here, the hologram pattern for a 3-D video frame are generated by calculating the fringe patterns for all depth layers only by using the B-PFP, and then transforming them into those for their depth layers by being multiplied with corresponding DC-PFPs. With this one-step calculation process, the computational speed (CS) of the proposed method can be greatly enhanced. Experimental results show that the CS of the proposed method has been improved by 30.2% on the average compared to that of the conventional method. Furthermore, the average calculation time of a new hybrid MC/C-NLUT method, in which both of motion-compensation (MC) and one-step calculation schemes are employed, has been reduced by 99.7%, 65.4%, 60.2% and 30.2%, respectively compared to each of the conventional ray-tracing, LUT, NLUT, and MC-NLUT methods. In addition, the memory size of the proposed method has been also reduced by 82 × 10(6)-fold and 128-fold compared to those of the conventional LUT and NLUT methods, respectively.