One Shot 360-Degree Light Field Capture and Reconstruction with Depth Extraction Based on Optical Flow for Light Field Camera

Optical-aberrations-corrected light field re-projection for high-quality plenoptic imaging

The singlet plenoptic camera, which consists of a single lens, microlens array (MLA) and image sensor, possesses the superiority that the imaging system is compact and lightweight, which is beneficial to miniaturization. However, such plenoptic cameras suffer from severe optical aberrations and their imaging quality is inferior for post-capture processing. Therefore, this paper proposes an optical-aberrations-corrected light field re-projection method to obtain high-quality singlet plenoptic imaging. First, optical aberrations are modeled by Seidel polynomials and included into point spread function (PSF) modeling. The modeled PSF is subsequently used to reconstruct imaging object information. Finally, the reconstructed imaging object information is re-projected back to the plenoptic imaging plane to obtain high-quality plenoptic images without optical aberrations. PSF modeling is validated by a self-built singlet plenoptic camera and the utility of the proposed optical-aberrations-corrected light field re-projection method is verified by numerical simulations and real imaging experiments.

Reciprocal 360-deg 3D light-field image acquisition and display system [Invited]

A reciprocal 360-deg three-dimensional light-field image acquisition and display system was designed using a common catadioptric optical configuration and a lens array. Proof-of-concept experimental setups were constructed with a full capturing part and a truncated display section to demonstrate that the proposed design works without loss of generality. Unlike conventional setups, which record and display rectangular volumes, the proposed configuration records 3D images from its surrounding spherical volume in the capture mode and projects 3D images to the same spherical volume in the display mode. This is particularly advantageous in comparison to other 360-deg multi-camera and multiple projector display systems that require extensive image and physical calibration. We analyzed the system and showed quality measures such as angular resolution and space bandwidth product based on design parameters. The issue due to pixel size difference between the available imaging sensor and the display was also addressed. A diffractive microlens array matching the sensor size was used in the acquisition part, whereas a vacuum cast lens array matching the display size was used in the display part with scaled optics. The experimental results demonstrate the proposed system design works well and is in good agreement with the simulation results.