Integral imaging using a color filter pinhole array on a display panel

Enhancing the spatial resolution of light-field displays without losing angular resolution by a computational subpixel realignment

Low spatial resolution is an urgent problem in integral imaging light-field displays (LFDs). This study proposes a computational method to enhance the spatial resolution without losing angular resolution. How rays reconstruct voxels through lenslets is changed so that every ray through a lenslet merely provides a subpixel. The three subpixels of a pixel no longer form one voxel but three independent voxels. We further demonstrate imperfect integration of subpixels, called the sampling error, can be eliminated on specific image depths, including the central depth plane. By realigning subpixels in the above manner under no sampling error, the sampling rate of voxels is three times the conventional pixel-based LFDs. Moreover, the ray number of every voxel is preserved for an unaffected angular resolution. With unavoidable component alignment errors, resolution gains of 2.52 and 2.0 are verified in simulation and experiment by computationally updating the elemental image array. The proposed computational method further reveals that LFDs intrinsically have a higher space-bandwidth product than presumed.

Examining the utility of pinhole-type screens for lightfield display

The use of microlens arrays for lightfield display has the drawback of providing images with strong chromatic aliasing. To overcome this problem, pinhole-type lightfield monitors are proposed. This paper is devoted to evaluating the capability for such lightfield monitors to offer the user a convincing 3D experience with images with enough brightness and continuous aspect. Thus, we have designed a psychophysical test specifically adapted for lightfield monitors, which allowed us to confirm the usability of pinhole-type monitors.

High-performance reflection-type augmented reality 3D display using a reflective polarizer

We propose a high-performance reflection-type augmented reality (AR) 3D display by using a reflective polarizer (RP). The RP functions as a reflective imaging device as well as an image combiner that combines the real scenes and the 3D images reconstructed by the integral imaging display unit. Benefiting from the flawless imaging of the RP, the proposed reflection-type AR system can achieve high-definition 3D display. A prototype based on the proposed reflection-type AR structure is developed, and it presents good 3D display effects and reflection-type AR performances. The developed prototype is very compact, as thin as 3.4 mm, which makes it be a potential candidate in stomatology and vehicle AR display.

A flipping-free 3D integral imaging display using a twice-imaging lens array

Integral imaging is a promising 3D visualization technique for reconstructing 3D medical scenes to enhance medical analysis and diagnosis. However, the use of lens arrays inevitably introduces flipped images beyond the field of view, which cannot reproduce the correct parallax relation. To avoid the flipping effect in optical reconstruction, a twice-imaging lens array based integral display is presented. The proposed lens arrangement, which consists of a light-controlling lens array, a field lens array and an imaging lens array, allows the light rays from each elemental image only pass through its corresponding lens unit. The lens arrangement is optimized with geometrical optics method, and the proposed display system is experimentally demonstrated. A full-parallax 3D medical scene showing continuous viewpoint information without flipping is reconstructed in 45° field of view.

Simple and fast calculation algorithm for computer-generated hologram based on integral imaging using look-up table

We proposed a simple and fast algorithm for computer-generated hologram (CGH) based on pinhole-type II using a look-up table. The method consists of two steps: in the first step, the unity amplitude diffraction pattern of the center pinhole on hologram plane is pre-calculated and stored as many sub-regions. Secondly, diffraction patterns for other pinholes are obtained by simply shifting and tiling the pre-calculated sub-regions, and the final CGH is obtained by adding them all together. The calculation time is short because only addition and multiplication of the stored diffraction pattern are required. In addition, the required memory space is small since only one diffraction pattern is stored. Numerical simulation and reconstruction are performed on both plane object and object with continuous depth profile to verify the proposed method. Result shows that the proposed method can easily achieve real-time hologram generation with several CPU threads running simultaneously.

Projection-type integral imaging system using a three-dimensional screen composed of a lens array and a retroreflector film

We propose an improved projection-type integral imaging system using a three-dimensional (3D) screen consisting of a lens array and a retroreflector film in this paper. The projection-type integral imaging system suffers from the disadvantage of low-visibility images because of the inherently small exit pupil size of the projector. In order to resolve this problem, we adopt a 3D screen to avoid the demerits of a diffuser screen, such as off-screen image blur and loss of parallax. To determine the appropriate configuration of the 3D screen in the system, a simulation based on a ray transfer matrix analysis method was performed. The results show that the 3D screen should be located near the central depth plane of the integral imaging system, which leads to the conclusion that only the real mode is available for the proposed system. Experiments to verify this configuration and the feasibility of the proposed system were conducted using a system constructed with a real mode integral imaging system including a convex mirror array, which can fundamentally eliminate the pseudoscopic problem.

Active confocal imaging for visual prostheses

There are encouraging advances in prosthetic vision for the blind, including retinal and cortical implants, and other "sensory substitution devices" that use tactile or electrical stimulation. However, they all have low resolution, limited visual field, and can display only few gray levels (limited dynamic range), severely restricting their utility. To overcome these limitations, image processing or the imaging system could emphasize objects of interest and suppress the background clutter. We propose an active confocal imaging system based on light-field technology that will enable a blind user of any visual prosthesis to efficiently scan, focus on, and "see" only an object of interest while suppressing interference from background clutter. The system captures three-dimensional scene information using a light-field sensor and displays only an in-focused plane with objects in it. After capturing a confocal image, a de-cluttering process removes the clutter based on blur difference. In preliminary experiments we verified the positive impact of confocal-based background clutter removal on recognition of objects in low resolution and limited dynamic range simulated phosphene images. Using a custom-made multiple-camera system based on light-field imaging, we confirmed that the concept of a confocal de-cluttered image can be realized effectively.

Tilted elemental image array generation method for moiré-reduced computer generated integral imaging display

In this paper, we propose a tilted elemental image array generation method for computer generated integral imaging display with reduced moiré patterns. The pixels of the tilted elemental image array are divided into border pixels and effective pixels. According to the optimal tilted angle, the effective pixels are arranged with uniform arrangement. Also, a pixel mapping method is proposed. Appropriate experiments are carried out and the experimental results show that not only the color moiré patterns are reduced remarkably, but also the resolution of the reconstructed 3D images are improved through the proposed method.