Single-shot 3D motion picture camera with a dense point cloud

Exploiting Wavelength Diversity for High Resolution Time-of-Flight 3D Imaging

The poor lateral and depth resolution of state-of-the-art 3D sensors based on the time-of-flight (ToF) principle has limited widespread adoption to a few niche applications. In this work, we introduce a novel sensor concept that provides ToF-based 3D measurements of real world objects and surfaces with depth precision up to 35 μm and point cloud densities commensurate with the native sensor resolution of standard CMOS/CCD detectors (up to several megapixels). Such capabilities are realized by combining the best attributes of continuous wave ToF sensing, multi-wavelength interferometry, and heterodyne interferometry into a single approach. We describe multiple embodiments of the approach, each featuring a different sensing modality and associated tradeoffs.

Intensity interferometry-based 3D imaging

The development of single-photon counting detectors and arrays has made tremendous steps in recent years, not the least because of various new applications, e.g., LIDAR devices. In this work, a 3D imaging device based on real thermal light intensity interferometry is presented. By using gated SPAD technology, a basic 3D scene is imaged in reasonable measurement time. Compared to conventional approaches, the proposed synchronized photon counting allows the use of more light modes to enhance 3D ranging performance. Advantages like robustness to atmospheric scattering or autonomy by exploiting external light sources can make this ranging approach interesting for future applications.

Hand-guided qualitative deflectometry with a mobile device

We introduce a system that exploits the screen and front-facing camera of a mobile device to perform three-dimensional deflectometry-based surface measurements. In contrast to current mobile deflectometry systems, our method can capture surfaces with large normal variation and wide field of view (FoV). We achieve this by applying automated multi-view panoramic stitching algorithms to produce a large FoV normal map from a hand-guided capture process without the need for external tracking systems, like robot arms or fiducials. The presented work enables 3D surface measurements of specular objects 'in the wild' with a system accessible to users with little to no technical imaging experience. We demonstrate high-quality 3D surface measurements without the need for a calibration procedure. We provide experimental results with our prototype Deflectometry system and discuss applications for computer vision tasks such as object detection and recognition.

Dual surface structured light vision system based on multidimensional parameter coding

A dual surface structured light vision system based on the theory of multidimensional parameter coding is proposed in this paper that can provide a new high-performance and adaptive encoding robot vision perception system. Specifically, the dual surface structured light consists of an auxiliary light source and a principal structured light. Scene images from the auxiliary structured light determine the parameters of the principal structured light. The vision process system can adaptively encode the principal structured light according to types and numbers of parameters. The image formed by the encoded principal structured light can reflect the depth change details of the target object and guide the robot to locate the target object quickly and accurately. The simulation and industrial experiments show that the dual surface structured light vision system has wider application scenarios and higher accuracy than the traditional structured light vision system. According to different industrial scenes, the positioning accuracy of the vision system can reach 0.1 mm to 20 μm in 0.8 s.

Live video rate volumetric OCT imaging of the retina with multi-MHz A-scan rates

Surgical microscopes are vital tools for ophthalmic surgeons. The recent development of an integrated OCT system for the first time allows to look at tissue features below the surface. Hence, these systems can drastically improve the quality and reduce the risk of surgical interventions. However, current commercial OCT-enhanced ophthalmic surgical microscopes provide only one additional cross sectional view to the standard microscope image and feature a low update rate. To present volumetric data at a high update rate, much faster OCT systems than the ones applied in today's surgical microscopes need to be developed. We demonstrate live volumetric retinal OCT imaging, which may provide a sufficiently large volume size (330x330x595 Voxel) and high update frequency (24.2 Hz) such that the surgeon may even purely rely on the OCT for certain surgical maneuvers. It represents a major technological step towards the possible application of OCT-only surgical microscopes in the future which would be much more compact thus enabling many additional minimal invasive applications. We show that multi-MHz A-scan rates are essential for such a device. Additionally, advanced phase-based OCT techniques require 3D OCT volumes to be detected with a stable optical phase. These techniques can provide additional functional information of the retina. Up to now, classical OCT was to slow for this, so our system can pave the way to holographic OCT with a traditional confocal flying spot approach. For the first time, we present point scanning volumetric OCT imaging of the posterior eye with up to 191.2 Hz volume rate. We show that this volume rate is high enough to enable a sufficiently stable optical phase to a level, where remaining phase errors can be corrected. Applying advanced post processing concepts for numerical refocusing or computational adaptive optics should be possible in future with such a system.

Live video rate volumetric OCT imaging of the retina with multi-MHz A-scan rates

Surgical microscopes are vital tools for ophthalmic surgeons. The recent development of an integrated OCT system for the first time allows to look at tissue features below the surface. Hence, these systems can drastically improve the quality and reduce the risk of surgical interventions. However, current commercial OCT-enhanced ophthalmic surgical microscopes provide only one additional cross sectional view to the standard microscope image and feature a low update rate. To present volumetric data at a high update rate, much faster OCT systems than the ones applied in today's surgical microscopes need to be developed. We demonstrate live volumetric retinal OCT imaging, which may provide a sufficiently large volume size (330x330x595 Voxel) and high update frequency (24.2 Hz) such that the surgeon may even purely rely on the OCT for certain surgical maneuvers. It represents a major technological step towards the possible application of OCT-only surgical microscopes in the future which would be much more compact thus enabling many additional minimal invasive applications. We show that multi-MHz A-scan rates are essential for such a device. Additionally, advanced phase-based OCT techniques require 3D OCT volumes to be detected with a stable optical phase. These techniques can provide additional functional information of the retina. Up to now, classical OCT was to slow for this, so our system can pave the way to holographic OCT with a traditional confocal flying spot approach. For the first time, we present point scanning volumetric OCT imaging of the posterior eye with up to 191.2 Hz volume rate. We show that this volume rate is high enough to enable a sufficiently stable optical phase to a level, where remaining phase errors can be corrected. Applying advanced post processing concepts for numerical refocusing or computational adaptive optics should be possible in future with such a system.

GOBO projection for 3D measurements at highest frame rates: a performance analysis

Aperiodic sinusoidal patterns that are cast by a GOBO (GOes Before Optics) projector are a powerful tool for optically measuring the surface topography of moving or deforming objects with very high speed and accuracy. We optimised the first experimental setup that we were able to measure inflating car airbags at frame rates of more than 50 kHz while achieving a 3D point standard deviation of ~500 µm. Here, we theoretically investigate the method of GOBO projection of aperiodic sinusoidal fringes. In a simulation-based performance analysis, we examine the parameters that influence the accuracy of the measurement result and identify an optimal pattern design that yields the highest measurement accuracy. We compare the results with those that were obtained via GOBO projection of phase-shifted sinusoidal fringes. Finally, we experimentally verify the theoretical findings. We show that the proposed technique has several advantages over conventional fringe projection techniques, as the easy-to-build and cost-effective GOBO projector can provide a high radiant flux, allows high frame rates, and can be used over a wide spectral range.