Colour computer-generated holography for point clouds utilizing the Phong illumination model

Digital holographic content manipulation for wide-angle holographic near-eye displays

In recent years, the development of holographic near-eye displays (HNED) has surpassed the progress of digital hologram recording systems, especially in terms of wide-angle viewing capabilities. Thus, there is capture-display parameters incompatibility, which makes it impossible to reconstruct recorded objects in wide-angle display. This paper presents a complete imaging chain extending the available content for wide-angle HNED of pupil and non-pupil configuration with narrow-angle digital holograms of real objects. To this end, a new framework based on the phase-space approach is proposed that includes a set of affine transformations required to account for all differences in capture-display cases. The developed method allows free manipulation of the geometry of reconstructed objects, including axial and lateral positioning and size scaling. At the same time, it has a low computational effort. The presented work is supported with non-paraxial formulas developed using the phase-space approach, enabling accurate tracing of the holographic signal, its reconstruction, and measuring appearing deformations. The applicability of the proposed hologram manipulation method is proven with experimental results of digital hologram reconstruction in wide-angle HNED.

Remote photoplethysmography based on reflected light angle estimation

Objective. In previous studies, the factors affecting the accuracy of imaging photoplethysmography (iPPG) heart rate (HR) measurement have been focused on the light intensity, facial reflection angle, and motion artifacts. However, the factor of specularly reflected light has not been studied in detail. We explored the effect of specularly reflected light on the accuracy of HR estimation and proposed an estimation method for the direction of specularly radiated light.Approach. To study the HR measurement accuracy influenced by specularly reflected light, we control the component of specularly reflected light by controlling its angle. A total of 100 videos from four different reflected light angles were collected, and 25 subjects participated in the dataset collection. We extracted angles and illuminations for 71 facial regions, fitting sample points through interpolation, and selecting the angle corresponding to the maximum weight in the fitted curve as the estimated reflected angle.Main results. The experimental results show that higher specularly reflected light compromises HR estimation accuracy under the same value of light intensity. Notably, at a 60° angle, the HR accuracy (ACC) increased by 0.7%, while the signal-to-noise ratio and Pearson correlation coefficient increased by 0.8 dB and 0.035, respectively, compared to 0°. The overall root mean squared error, standard deviation, and mean error of our proposed reflected light angle estimation method on the illumination multi-angle incidence (IMAI) dataset are 1.173°, 0.978°, and 0.773°. The average Pearson value is 0.8 in the PURE rotation dataset. In addition, the average ACC of HR measurements in the PURE dataset is improved by 1.73% in our method compared to the state-of-the-art traditional methods.Significance. Our method has great potential for clinical applications, especially in bright light environments such as during surgery, to improve accuracy and monitor blood volume changes in blood vessels.

Point-polygon hybrid method for generating holograms

Computer-generated holograms (CGHs) are usually calculated from point clouds or polygon meshes. Point-based holograms are good at depicting details of objects, such as continuous depth cues, while polygon-based holograms tend to efficiently render high-density surfaces with accurate occlusions. Herein, we propose a novel point-polygon hybrid method (PPHM) to compute CGHs for the first time (to the best of our knowledge), which takes advantage of both point-based and polygon-based methods, and thus performs better than each of them separately. Reconstructions of 3D object holograms confirm that the proposed PPHM can present continuous depth cues with fewer triangles, implying high computational efficiency without losing quality.

Smoothing of inter-layer edge artifacts in depth-map computer-generated holograms

In the depth-map computer-generated hologram (CGH), inter-layer edge artifacts are observed in the discontinuous edges of section-wise depth-map objects. CGH synthesis, utilizing the hybrid smoothing method of silhouette masking and edge-apodization, alleviates unwanted inter-layer edge artifacts. The proposed method achieves improved de-artifact filtering that generates holographic images closer to the ground truth image of the depth-map object unattainable by the conventional CGH synthesis method.

Pincushion point-spread function for computer-generated holography

Point-spread functions (PSFs) are non-stationary signals whose spatial frequency increases with the radius. These signals are only meaningful over a small spatial region when being propagated over short distances and sampled with regular sampling pitch. Otherwise, aliasing at steep incidence angles leads to the computation of spurious frequencies. This is generally addressed by evaluating the PSF in a bounded disk-shaped region, which has the added benefit that it reduces the required number of coefficient updates. This significantly accelerates numerical diffraction calculations in, e.g., wavefront recording planes for high-resolution holograms. However, the use of a disk-shaped PSF is too conservative since it only utilizes about 78.5% of the total bandwidth of the hologram. We therefore derive a novel, to the best of our knowledge, optimally shaped PSF fully utilizing the bandwidth formed by two bounding hyperbola. A number of numerical experiments with the newly proposed pincushion PSF were performed, reporting over three-fold reductions of the signal error and significant improvements to the visual quality of computer-generated holograms at high viewing angles.

Computer-generated hologram manipulation and fast production with a focus on security application

Motivated by the successful printing of a computer-generated hologram using the computer-to-film (CtF) graphic process, we present a further refined technique with increased resolution, applicable in security. The CtF process offers low cost and fast production while persevering high resolution, and it can make every hologram unique. In this paper, we present the improvement of the printing method, with several software modifications and the implementation of security features at different levels of production.

Real-Time Computation of 3D Wireframes in Computer-Generated Holography

Computer-Generated Holography (CGH) algorithms simulate numerical diffraction, being applied in particular for holographic display technology. Due to the wave-based nature of diffraction, CGH is highly computationally intensive, making it especially challenging for driving high-resolution displays in real-time. To this end, we propose a technique for efficiently calculating holograms of 3D line segments. We express the solutions analytically and devise an efficiently computable approximation suitable for massively parallel computing architectures. The algorithms are implemented on a GPU (with CUDA), and we obtain a 70-fold speedup over the reference point-wise algorithm with almost imperceptible quality loss. We report real-time frame rates for CGH of complex 3D line-drawn objects, and validate the algorithm in both a simulation environment as well as on a holographic display setup.

Wide-viewing full-color depthmap computer-generated holograms

An efficient synthesis algorithm for wide-viewing full-color depthmap computer-generated holograms is proposed. We develop a precise computational algorithm integrating wave-optic geometry-mapping, color-matching, and noise-filtering to multiplex multiview elementary computer-generated holograms (CGHs) into a single high-definition CGH without three-dimensional perspective distortion or color dispersion. Computational parallelism is exploited to achieve significant computational efficiency improvement in the production throughput of full-color wide-viewing angle CGHs. The proposed algorithm is verified through the full-color binary hologram reconstruction experiments utilizing an off-axis R·G·B simultaneous illumination method, which suggests the feasibility of the full-color sub-wavelength binary spatial light modulator technology.

Digital Hologram Watermarking Based on Multiple Deep Neural Networks Training Reconstruction and Attack

This paper proposes a method to embed and extract a watermark on a digital hologram using a deep neural network. The entire algorithm for watermarking digital holograms consists of three sub-networks. For the robustness of watermarking, an attack simulation is inserted inside the deep neural network. By including attack simulation and holographic reconstruction in the network, the deep neural network for watermarking can simultaneously train invisibility and robustness. We propose a network training method using hologram and reconstruction. After training the proposed network, we analyze the robustness of each attack and perform re-training according to this result to propose a method to improve the robustness. We quantitatively evaluate the results of robustness against various attacks and show the reliability of the proposed technique.

Photorealistic computer generated holography with global illumination and path tracing

Computer generated holography (CGH) algorithms come in many forms, with different trade-offs in terms of visual quality and calculation speed. However, no CGH algorithm to date can accurately account for all 3D visual cues simultaneously, such as occlusion, shadows, continuous parallax, and precise focal cues, without view discretization. The aim is to create photorealistic CGH content, not only for display purposes but also to create reference data for comparing and testing CGH and compression algorithms. We propose a novel algorithm combining the precision of point-based CGH with the accurate shading and flexibility of ray-tracing algorithms. We demonstrate this by creating a scene with global illumination, soft shadows, and precise occlusion cues, implemented with OptiX and CUDA.

Absolute phase retrieval for colored objects based on three phase-shifting amount codes

We propose an absolute phase retrieval method based on three phase-shifting amount codes (3-PSA-codes) to measure the colored object with one additional pattern. 3-PSA-codes adopt the coding concept of 3-digit-codes, in which the code elements of three consecutive periods are treated as a unique code word for one period. However, to measure the colored object more effectively in the proposed method, each code element is embedded into the PSA domain and retrieved from the phase difference. Fringe patterns for the wrapped phase are artfully employed in the code element retrieval. Hence, for the first time, to the best of our knowledge, the code element related to the phase can be determined by one additional pattern. It breaks the constraint that temporal methods require multiple additional patterns to overcome the adverse effect of the surface color of objects on absolute phase retrieval. Experimental results demonstrate that the proposed 3-PSA-codes have strong robustness in the measurement of the colored object.

Suitability analysis of holographic vs light field and 2D displays for subjective quality assessment of Fourier holograms

Measuring the impact of compression on the reconstruction quality of holograms remains a challenge. A public subjectively-annotated holographic data set that allows for testing the performance of compression techniques and quality metrics is presented, in addition to a subjective visual quality assessment methodology. Moreover, the performance of the quality assessment procedures is compared for holographic, regular 2D and light field displays. For these experiments, a double-stimulus, multi-perspective, multi-depth testing methodology was designed and implemented. Analysis of the quality scores indicated that in the absence of a suitable holographic display and under the presented test conditions, non-holographic displays can be deployed to display numerically reconstructed holograms for visual quality assessment tasks.

Acceleration and expansion of a photorealistic computer-generated hologram using backward ray tracing and multiple off-axis wavefront recording plane methods

Holograms can reconstruct the light wave field of three-dimensional objects. However, the computer-generated hologram (CGH) requires much calculating time. Here we proposed a CGH generation algorithm based on backward ray tracing and multiple off-axis wavefront recording planes (MO-WRP) to generate photorealistic CGH with a large reconstruction image. In this method, multiple WRPs were placed parallelly between the virtual object and the hologram plane. Virtual rays were emitted from the pixel of WRPs and intersect with the object. The complex amplitude of WRPs is then determined by illumination module, such as Phong reflection module. The CGH was generated by the shifted Angular Spectrum Propagation (ASP) from WRPs to the hologram plane. Experimental results demonstrate the effectiveness of this method, and the CGH generation rate is 37.3 frames per second (1 WRP) and 9.8 frames per second (2×2 WRPs).

Analytic computation of line-drawn objects in computer generated holography

Digital holography is a promising display technology that can account for all human visual cues, with many potential applications i.a. in AR and VR. However, one of the main challenges in computer generated holography (CGH) needed for driving these displays are the high computational requirements. In this work, we propose a new CGH technique for the efficient analytical computation of lines and arc primitives. We express the solutions analytically by means of incomplete cylindrical functions, and devise an efficiently computable approximation suitable for massively parallel computing architectures. We implement the algorithm on a GPU (with CUDA), provide an error analysis and report real-time frame rates for CGH of complex 3D scenes of line-drawn objects, and validate the algorithm in an optical setup.

Phase added sub-stereograms for accelerating computer generated holography

Phase-added stereograms are a form of sparse computer generated holograms, subdividing the hologram in small Fourier transformed blocks and updating a single coefficient per block and per point-spread function. Unfortunately, these algorithms' computational performance is often bottlenecked by the relatively high memory requirements. We propose a technique to partition the 3D point cloud into cells using time-frequency analysis, grouping the affected coefficients into subsets that improve caching and minimize memory requirements. This results in significant acceleration of phase added stereogram algorithms without affecting render quality, enabling real-time CGH for driving holographic displays for more complex and detailed scenes than previously possible. We report a 30-fold speedup over the base implementation, achieving real-time speeds of 80ms per million points per megapixel on a single GPU.

Efficient holographic video generation based on rotational transformation of wavefields

High-quality holographic video generation requires both high computational resources and time; therefore, algorithms that can generate holographic videos efficiently will be soon in demand for dynamic holographic 3D displays. In this work, we present two algorithms that use a motion compensation scheme - based on the rotational transformation of wavefields [Appl. Opt.47, D110 (2008)], to generate efficiently holographic frames. The effects of motions to the wavefield are analyzed, while video generation examples are provided to support our theory. We report that with the proposed motion compensation scheme combined with the Phong multiple wavefront recording plane CGH method, a 10 times acceleration was achieved with regard to the ray tracing method, with a trade-off of energy loss of 10%. This speedup can be further improved by parallelization of the computations.

Optimized random phase tiles for non-iterative hologram generation

In this work, we introduce a technique for fast, high-quality, non-iterative generation of phase-only holograms from both 2D and 3D scenes. In this technique, we generate an optimized random phase tile which behaves like a small diffuser, spreading the amplitude of a section of the scene throughout the hologram plane. Each section of the scene is multiplied by this tile and then propagated to the hologram plane by means of the Fresnel transform. The contribution from each tile is added, resulting in a phase-only hologram of the scene. The optimized random phase tiles can be generated for any distance between the hologram plane and the object using an iterative Fresnel algorithm. Afterwards, this tile can be used to generate holograms from any number of objects without the need for further iterative algorithms. These holograms present increased quality after reconstruction compared to similar non-iterative hologram generation techniques. Both numerical and optical experiments are carried out, demonstrating the effectiveness of our proposal.

Efficient algorithms for the accurate propagation of extreme-resolution holograms

Display-sized full-parallax holograms with large viewing angles require resolutions surpassing tens of Gigapixels. Unfortunately, computer-generated holography is computationally intensive, particularly for these huge display resolutions. Existing algorithms designed for diffraction of typical Megapixel-sized holograms do not scale well for these large resolutions. Furthermore, since the holograms will not fit in the RAM of most of today's computers, the algorithms should be modified to minimize disk access. We propose two novel algorithms respectively for short-distance and long-distance propagation, and accurately compute the diffraction of a 17.2 Gigapixel hologram on a standard desktop machine. We report a 500-fold speedup over the reference rectangular tiling algorithm for the short-distance version, and a 50-fold speedup for the long-distance version.

Direct calculation of computer-generated holograms in sparse bases

Computer-generated holography is computationally intensive, making it especially challenging for holographic displays where high-resolutions and video rates are needed. To this end, we propose a technique for directly calculating short-time Fourier transform coefficients without the need for a look-up table. Because point spread functions are sparse in this transform domain, only a small fraction of the coefficients need to be updated, enabling significant speed gains. Twenty-fold accelerations are reported over the reference implementation. This approach generalizes the notion of the phase-added stereogram, allowing for the calculatiion of an arbitrary number of Fourier coefficients per block, enabling high calculation speed with holograms of good visual quality, targeting minimal memory requirements.

Synthetic amplitude for improved reconstruction of noniterative phase holograms

In this paper, we show how a specially designed synthetic amplitude can be used to obtain greatly improved reconstruction of objects only using the phase data of their Fourier or Fresnel transforms. The reconstruction of objects from phase-only information is of interest because phase modulation has much higher efficiency than amplitude modulation and can be achieved with a high degree of precision with current liquid-crystal-on-silicon spatial light modulators. However, direct reconstruction of an object from its phase information usually results in severely degraded outputs. Due to this issue, to achieve optimal reconstruction, the object information must be codified in a phase hologram by means of time-consuming algorithms. To avoid these kinds of algorithms, we propose using a synthetic amplitude, designed in such a way that, when multiplied with the phase information of the object, leads to high-quality reconstruction. This synthetic amplitude contains no information about the object and can be used to reconstruct a number of different inputs without further processing. We present experiments carried out in virtual and actual optical systems verifying the validity of our proposal for 2D, 3D, and dynamic scenes.

Progress in virtual reality and augmented reality based on holographic display

The past, present, and future industry prospects of virtual reality (VR) and augmented reality (AR) are presented. The future of VR/AR technology based on holographic display is predicted by analogy with the VR/AR based on binocular vision display and light field display. The investigations on holographic display that can be used in VR/AR are reviewed. The breakthroughs of holographic display are promising in VR/AR with high resolution. The challenges faced by VR/AR based on holographic display are analyzed.

Fourier rainbow holography

We present Fourier rainbow holographic imaging approach. It involves standard laser holographic recording and novel horizontal parallax only holographic display. In the display, the rainbow effect is introduced in an illumination module by high-frequency diffraction grating and white light LED source. The display is addressed by Fourier rainbow digital hologram (FRDH) encoding defocused object field with removed spatial frequency components in one direction by hologram slitting and without spherical phase factor. Theoretically and experimentally it is shown that the method extends the viewing zone of the classical viewing window display in vertical and longitudinal directions, thus the comfort of observation is improved. It is also numerically and experimentally validated that the numerical slitting applied within FRDH generation improves reconstruction depth of the display, here up to 400 mm.

Accelerated synthesis of wide-viewing angle polygon computer-generated holograms using the interocular affine similarity of three-dimensional scenes

The interocular affine similarity of three-dimensional scenes is investigated and a novel accelerated reconfiguration algorithm for intermediate-view polygon computer-generated holograms based on interocular affine similarity is proposed. We demonstrate by using the numerical simulations of full-color polygon computer-generation holograms that the proposed intermediate view reconfiguration algorithm is particularly useful for the computation of wide-viewing angle polygon computer-generated holograms.