1
|
Li F, Willomitzer F, Balaji MM, Rangarajan P, Cossairt O. Exploiting Wavelength Diversity for High Resolution Time-of-Flight 3D Imaging. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2021; 43:2193-2205. [PMID: 33886466 DOI: 10.1109/tpami.2021.3075156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
The poor lateral and depth resolution of state-of-the-art 3D sensors based on the time-of-flight (ToF) principle has limited widespread adoption to a few niche applications. In this work, we introduce a novel sensor concept that provides ToF-based 3D measurements of real world objects and surfaces with depth precision up to 35 μm and point cloud densities commensurate with the native sensor resolution of standard CMOS/CCD detectors (up to several megapixels). Such capabilities are realized by combining the best attributes of continuous wave ToF sensing, multi-wavelength interferometry, and heterodyne interferometry into a single approach. We describe multiple embodiments of the approach, each featuring a different sensing modality and associated tradeoffs.
Collapse
|
2
|
Wagner F, Schiffers F, Willomitzer F, Cossairt O, Velten A. Intensity interferometry-based 3D imaging. OPTICS EXPRESS 2021; 29:4733-4745. [PMID: 33726023 DOI: 10.1364/oe.412688] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/16/2020] [Accepted: 01/23/2021] [Indexed: 06/12/2023]
Abstract
The development of single-photon counting detectors and arrays has made tremendous steps in recent years, not the least because of various new applications, e.g., LIDAR devices. In this work, a 3D imaging device based on real thermal light intensity interferometry is presented. By using gated SPAD technology, a basic 3D scene is imaged in reasonable measurement time. Compared to conventional approaches, the proposed synchronized photon counting allows the use of more light modes to enhance 3D ranging performance. Advantages like robustness to atmospheric scattering or autonomy by exploiting external light sources can make this ranging approach interesting for future applications.
Collapse
|
3
|
Willomitzer F, Yeh CK, Gupta V, Spies W, Schiffers F, Katsaggelos A, Walton M, Cossairt O. Hand-guided qualitative deflectometry with a mobile device. OPTICS EXPRESS 2020; 28:9027-9038. [PMID: 32225516 DOI: 10.1364/oe.383475] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/21/2019] [Accepted: 02/18/2020] [Indexed: 06/10/2023]
Abstract
We introduce a system that exploits the screen and front-facing camera of a mobile device to perform three-dimensional deflectometry-based surface measurements. In contrast to current mobile deflectometry systems, our method can capture surfaces with large normal variation and wide field of view (FoV). We achieve this by applying automated multi-view panoramic stitching algorithms to produce a large FoV normal map from a hand-guided capture process without the need for external tracking systems, like robot arms or fiducials. The presented work enables 3D surface measurements of specular objects 'in the wild' with a system accessible to users with little to no technical imaging experience. We demonstrate high-quality 3D surface measurements without the need for a calibration procedure. We provide experimental results with our prototype Deflectometry system and discuss applications for computer vision tasks such as object detection and recognition.
Collapse
|
4
|
Xu M, Lu X, Huang H, Zhai M, Luo Q, Ji J. Dual surface structured light vision system based on multidimensional parameter coding. APPLIED OPTICS 2019; 58:7212-7221. [PMID: 31503996 DOI: 10.1364/ao.58.007212] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/02/2019] [Accepted: 08/12/2019] [Indexed: 06/10/2023]
Abstract
A dual surface structured light vision system based on the theory of multidimensional parameter coding is proposed in this paper that can provide a new high-performance and adaptive encoding robot vision perception system. Specifically, the dual surface structured light consists of an auxiliary light source and a principal structured light. Scene images from the auxiliary structured light determine the parameters of the principal structured light. The vision process system can adaptively encode the principal structured light according to types and numbers of parameters. The image formed by the encoded principal structured light can reflect the depth change details of the target object and guide the robot to locate the target object quickly and accurately. The simulation and industrial experiments show that the dual surface structured light vision system has wider application scenarios and higher accuracy than the traditional structured light vision system. According to different industrial scenes, the positioning accuracy of the vision system can reach 0.1 mm to 20 μm in 0.8 s.
Collapse
|
5
|
Kolb JP, Draxinger W, Klee J, Pfeiffer T, Eibl M, Klein T, Wieser W, Huber R. Live video rate volumetric OCT imaging of the retina with multi-MHz A-scan rates. PLoS One 2019; 14:e0213144. [PMID: 30921342 PMCID: PMC6438632 DOI: 10.1371/journal.pone.0213144] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2018] [Accepted: 02/18/2019] [Indexed: 12/17/2022] Open
Abstract
Surgical microscopes are vital tools for ophthalmic surgeons. The recent development of an integrated OCT system for the first time allows to look at tissue features below the surface. Hence, these systems can drastically improve the quality and reduce the risk of surgical interventions. However, current commercial OCT-enhanced ophthalmic surgical microscopes provide only one additional cross sectional view to the standard microscope image and feature a low update rate. To present volumetric data at a high update rate, much faster OCT systems than the ones applied in today's surgical microscopes need to be developed. We demonstrate live volumetric retinal OCT imaging, which may provide a sufficiently large volume size (330x330x595 Voxel) and high update frequency (24.2 Hz) such that the surgeon may even purely rely on the OCT for certain surgical maneuvers. It represents a major technological step towards the possible application of OCT-only surgical microscopes in the future which would be much more compact thus enabling many additional minimal invasive applications. We show that multi-MHz A-scan rates are essential for such a device. Additionally, advanced phase-based OCT techniques require 3D OCT volumes to be detected with a stable optical phase. These techniques can provide additional functional information of the retina. Up to now, classical OCT was to slow for this, so our system can pave the way to holographic OCT with a traditional confocal flying spot approach. For the first time, we present point scanning volumetric OCT imaging of the posterior eye with up to 191.2 Hz volume rate. We show that this volume rate is high enough to enable a sufficiently stable optical phase to a level, where remaining phase errors can be corrected. Applying advanced post processing concepts for numerical refocusing or computational adaptive optics should be possible in future with such a system.
Collapse
Affiliation(s)
- Jan Philip Kolb
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Wolfgang Draxinger
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Julian Klee
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Tom Pfeiffer
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Matthias Eibl
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | | | | | - Robert Huber
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
- * E-mail:
| |
Collapse
|
6
|
Kolb JP, Draxinger W, Klee J, Pfeiffer T, Eibl M, Klein T, Wieser W, Huber R. Live video rate volumetric OCT imaging of the retina with multi-MHz A-scan rates. PLoS One 2019; 14:e0213144. [PMID: 30921342 DOI: 10.1371/journals.phone.0213144] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2018] [Accepted: 02/18/2019] [Indexed: 05/25/2023] Open
Abstract
Surgical microscopes are vital tools for ophthalmic surgeons. The recent development of an integrated OCT system for the first time allows to look at tissue features below the surface. Hence, these systems can drastically improve the quality and reduce the risk of surgical interventions. However, current commercial OCT-enhanced ophthalmic surgical microscopes provide only one additional cross sectional view to the standard microscope image and feature a low update rate. To present volumetric data at a high update rate, much faster OCT systems than the ones applied in today's surgical microscopes need to be developed. We demonstrate live volumetric retinal OCT imaging, which may provide a sufficiently large volume size (330x330x595 Voxel) and high update frequency (24.2 Hz) such that the surgeon may even purely rely on the OCT for certain surgical maneuvers. It represents a major technological step towards the possible application of OCT-only surgical microscopes in the future which would be much more compact thus enabling many additional minimal invasive applications. We show that multi-MHz A-scan rates are essential for such a device. Additionally, advanced phase-based OCT techniques require 3D OCT volumes to be detected with a stable optical phase. These techniques can provide additional functional information of the retina. Up to now, classical OCT was to slow for this, so our system can pave the way to holographic OCT with a traditional confocal flying spot approach. For the first time, we present point scanning volumetric OCT imaging of the posterior eye with up to 191.2 Hz volume rate. We show that this volume rate is high enough to enable a sufficiently stable optical phase to a level, where remaining phase errors can be corrected. Applying advanced post processing concepts for numerical refocusing or computational adaptive optics should be possible in future with such a system.
Collapse
Affiliation(s)
- Jan Philip Kolb
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Wolfgang Draxinger
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Julian Klee
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Tom Pfeiffer
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Matthias Eibl
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | | | | | - Robert Huber
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| |
Collapse
|
7
|
Heist S, Dietrich P, Landmann M, Kühmstedt P, Notni G, Tünnermann A. GOBO projection for 3D measurements at highest frame rates: a performance analysis. LIGHT, SCIENCE & APPLICATIONS 2018; 7:71. [PMID: 30302242 PMCID: PMC6168569 DOI: 10.1038/s41377-018-0072-3] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/23/2018] [Revised: 09/07/2018] [Accepted: 09/07/2018] [Indexed: 06/08/2023]
Abstract
Aperiodic sinusoidal patterns that are cast by a GOBO (GOes Before Optics) projector are a powerful tool for optically measuring the surface topography of moving or deforming objects with very high speed and accuracy. We optimised the first experimental setup that we were able to measure inflating car airbags at frame rates of more than 50 kHz while achieving a 3D point standard deviation of ~500 µm. Here, we theoretically investigate the method of GOBO projection of aperiodic sinusoidal fringes. In a simulation-based performance analysis, we examine the parameters that influence the accuracy of the measurement result and identify an optimal pattern design that yields the highest measurement accuracy. We compare the results with those that were obtained via GOBO projection of phase-shifted sinusoidal fringes. Finally, we experimentally verify the theoretical findings. We show that the proposed technique has several advantages over conventional fringe projection techniques, as the easy-to-build and cost-effective GOBO projector can provide a high radiant flux, allows high frame rates, and can be used over a wide spectral range.
Collapse
Affiliation(s)
- Stefan Heist
- Institute of Applied Physics, Abbe Center of Photonics, Friedrich Schiller University, 07745 Jena, Germany
- Fraunhofer Institute for Applied Optics and Precision Engineering IOF, 07745 Jena, Germany
| | - Patrick Dietrich
- Institute of Applied Physics, Abbe Center of Photonics, Friedrich Schiller University, 07745 Jena, Germany
- Fraunhofer Institute for Applied Optics and Precision Engineering IOF, 07745 Jena, Germany
| | - Martin Landmann
- Institute of Applied Physics, Abbe Center of Photonics, Friedrich Schiller University, 07745 Jena, Germany
- Fraunhofer Institute for Applied Optics and Precision Engineering IOF, 07745 Jena, Germany
| | - Peter Kühmstedt
- Fraunhofer Institute for Applied Optics and Precision Engineering IOF, 07745 Jena, Germany
| | - Gunther Notni
- Fraunhofer Institute for Applied Optics and Precision Engineering IOF, 07745 Jena, Germany
- Department of Mechanical Engineering, Ilmenau University of Technology, 98693 Ilmenau, Germany
| | - Andreas Tünnermann
- Institute of Applied Physics, Abbe Center of Photonics, Friedrich Schiller University, 07745 Jena, Germany
- Fraunhofer Institute for Applied Optics and Precision Engineering IOF, 07745 Jena, Germany
| |
Collapse
|
8
|
Range Imaging for Motion Compensation in C-Arm Cone-Beam CT of Knees under Weight-Bearing Conditions. J Imaging 2018. [DOI: 10.3390/jimaging4010013] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
|