1
|
Pedrini G, Li R, Cao L, Reichelt S. Lensless imaging in one shot using the complex degree of coherence obtained by multiaperture interferences. Opt Lett 2024; 49:718-721. [PMID: 38300098 DOI: 10.1364/ol.511547] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/10/2023] [Accepted: 12/22/2023] [Indexed: 02/02/2024]
Abstract
The van Cittert-Zernike theorem states that the Fourier transform of the intensity distribution function of a distant, incoherent source is equal to the complex degree of coherence. In this Letter, we present a method for measuring the complex degree of coherence in one shot by recording the interference patterns produced by multiple aperture pairs. The intensity of the sample is obtained by Fourier transforming the complex degree of coherence. The experimental verification by using a simple object is presented together with a discussion on how the method could be improved for imaging more complex samples.
Collapse
|
2
|
Istrate E, Pedrini G, Reichelt S. Lensless microscopy by multiplane recordings: sub-micrometer, diffraction-limited, wide field-of-view imaging. Opt Express 2023; 31:36388-36401. [PMID: 38017792 DOI: 10.1364/oe.503944] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Accepted: 09/25/2023] [Indexed: 11/30/2023]
Abstract
Lensless microscopy is attractive because lenses are often large, heavy and expensive. We report diffraction-limited, sub-micrometer resolution in a lensless imaging system that does not need a reference wave and imposes few restrictions on the density of the sample. We use measurements of the intensity of light scattered by the sample at multiple heights above the sample and a modified Gerchberg-Saxton algorithm to reconstruct the phase of the optical field. We introduce a pixel-splitting algorithm that increases resolution beyond the size of the sensor pixels, and implement high-dynamic-range measurements. The resolution depends on the numerical aperture of the first measurement height only, while the field of view is limited by the last measurement height only. As a result, resolution and field of view can be controlled independently. The pixel-splitting algorithm also allows imaging with light of low spatial coherence, and we show that such low coherence is beneficial for a larger field of view. Using illumination from three LEDs, we produce full-color images of biological samples. Finally, we provide a detailed analysis of the limiting factors of this lensless microscopy system. The good performance demonstrated here can allow lensless systems to replace conventional microscope objectives in some situations.
Collapse
|
3
|
Gröger A, Pedrini G, Claus D, Alekseenko I, Gloeckler F, Reichelt S. Advantages of holographic imaging through fog. Appl Opt 2023; 62:D68-D76. [PMID: 37132771 DOI: 10.1364/ao.478435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
In this paper, we demonstrate digital holographic imaging through a 27-m-long fog tube filled with ultrasonically generated fog. Its high sensitivity makes holography a powerful technology for imaging through scattering media. With our large-scale experiments, we investigate the potential of holographic imaging for road traffic applications, where autonomous driving vehicles require reliable environmental perception in all weather conditions. We compare single-shot off-axis digital holography to conventional imaging (with coherent illumination) and show that holographic imaging requires 30 times less illumination power for the same imaging range. Our work includes signal-to-noise ratio considerations, a simulation model, and quantitative statements on the influence of various physical parameters on the imaging range.
Collapse
|
4
|
Li R, Pedrini G, Huang Z, Reichelt S, Cao L. Physics-enhanced neural network for phase retrieval from two diffraction patterns. Opt Express 2022; 30:32680-32692. [PMID: 36242324 DOI: 10.1364/oe.469080] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Accepted: 08/10/2022] [Indexed: 06/16/2023]
Abstract
In this work, we propose a physics-enhanced two-to-one Y-neural network (two inputs and one output) for phase retrieval of complex wavefronts from two diffraction patterns. The learnable parameters of the Y-net are optimized by minimizing a hybrid loss function, which evaluates the root-mean-square error and normalized Pearson correlated coefficient on the two diffraction planes. An angular spectrum method network is designed for self-supervised training on the Y-net. Amplitudes and phases of wavefronts diffracted by a USAF-1951 resolution target, a phase grating of 200 lp/mm, and a skeletal muscle cell were retrieved using a Y-net with 100 learning iterations. Fast reconstructions could be realized without constraints or a priori knowledge of the samples.
Collapse
|
5
|
Yang Y, Miao Y, Liu X, Pedrini G, Tang Q, Osten W, Peng X. Intrinsic parameter-free calibration of FPP using a ray phase mapping model. Opt Lett 2022; 47:3564-3567. [PMID: 35838731 DOI: 10.1364/ol.462504] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2022] [Accepted: 06/25/2022] [Indexed: 06/15/2023]
Abstract
This Letter presents a ray phase mapping model (RPM) for fringe projection profilometry (FPP) that avoids calibrating intrinsic parameters. The novelty of the RPM, to the best of our knowledge, is the ability to characterize the imaging system with independent rays for each pixel, and to associate the rays with the projected phase in the illumination field for efficient 3D mapping, which avoids complex imaging-specific modeling about lens layout and distortion. Two loss functions are constructed to flexibly optimize camera ray parameters and mapping coefficients, respectively. As a universal approach, it has the potential to calibrate different types of FPP systems with high accuracy. Experiments on wide-angle lens FPP, telecentric lens FPP, and micro-electromechanical system (MEMS)-based FPP are carried out to verify the feasibility of the proposed method.
Collapse
|
6
|
Zhou C, Han X, Wang Z, Sun R, Zhong W, Pedrini G, Zhong L, Lu X. Differential phase measurement based on synchronous phase shift determination. Opt Express 2022; 30:12545-12554. [PMID: 35472888 DOI: 10.1364/oe.456272] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Accepted: 03/10/2022] [Indexed: 06/14/2023]
Abstract
Based on synchronous phase shift determination, we propose a differential phase measurement method for differential interference contrast (DIC) microscopy. An on-line phase shift measurement device is used to generate carrier interferograms and determine the phase shift of DIC images. Then the differential phase can be extracted with the least-squares phase-shifting algorithm. In addition to realizing on-line, dynamic, real-time, synchronous and high precision phase shift measurement, the proposed method also can reconstruct the phase of the specimen by using the phase-integral algorithm. The differential phase measurement method reveals obvious advantages in error compensation, anti-interference, and noise suppression. Both simulation analysis and experimental result demonstrate that using the proposed method, the accuracy of phase shift measurement is higher than 0.007 rad. Very accurate phase reconstructions were obtained with both polystyrene microspheres and human vascular endothelial.
Collapse
|
7
|
Schiebelbein A, Pedrini G. Lensless phase imaging microscopy using multiple intensity diffraction patterns obtained under coherent and partially coherent illumination. Appl Opt 2022; 61:B271-B278. [PMID: 35201149 DOI: 10.1364/ao.444824] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Accepted: 12/09/2021] [Indexed: 06/14/2023]
Abstract
In this paper, we show how high-resolution phase imaging is obtained from multiple intensity diffraction patterns. The results of the experiments carried out with different microscopic phase and amplitude samples illuminated with coherent and partially coherent light are presented. A comparison with experimental results obtained by digital holographic microscopy is given, and advantages/disadvantages of the techniques are discussed.
Collapse
|
8
|
Javidi B, Carnicer A, Anand A, Barbastathis G, Chen W, Ferraro P, Goodman JW, Horisaki R, Khare K, Kujawinska M, Leitgeb RA, Marquet P, Nomura T, Ozcan A, Park Y, Pedrini G, Picart P, Rosen J, Saavedra G, Shaked NT, Stern A, Tajahuerce E, Tian L, Wetzstein G, Yamaguchi M. Roadmap on digital holography [Invited]. Opt Express 2021; 29:35078-35118. [PMID: 34808951 DOI: 10.1364/oe.435915] [Citation(s) in RCA: 52] [Impact Index Per Article: 17.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2021] [Accepted: 09/04/2021] [Indexed: 05/22/2023]
Abstract
This Roadmap article on digital holography provides an overview of a vast array of research activities in the field of digital holography. The paper consists of a series of 25 sections from the prominent experts in digital holography presenting various aspects of the field on sensing, 3D imaging and displays, virtual and augmented reality, microscopy, cell identification, tomography, label-free live cell imaging, and other applications. Each section represents the vision of its author to describe the significant progress, potential impact, important developments, and challenging issues in the field of digital holography.
Collapse
|
9
|
Meng Z, Pedrini G, Lv X, Ma J, Nie S, Yuan C. DL-SI-DHM: a deep network generating the high-resolution phase and amplitude images from wide-field images. Opt Express 2021; 29:19247-19261. [PMID: 34266038 DOI: 10.1364/oe.424718] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/16/2021] [Accepted: 05/26/2021] [Indexed: 06/13/2023]
Abstract
Structured illumination digital holographic microscopy (SI-DHM) is a high-resolution, label-free technique enabling us to image unstained biological samples. SI-DHM has high requirements on the stability of the experimental setup and needs long exposure time. Furthermore, image synthesizing and phase correcting in the reconstruction process are both challenging tasks. We propose a deep-learning-based method called DL-SI-DHM to improve the recording, the reconstruction efficiency and the accuracy of SI-DHM and to provide high-resolution phase imaging. In the training process, high-resolution amplitude and phase images obtained by phase-shifting SI-DHM together with wide-field amplitudes are used as inputs of DL-SI-DHM. The well-trained network can reconstruct both the high-resolution amplitude and phase images from a single wide-field amplitude image. Compared with the traditional SI-DHM, this method significantly shortens the recording time and simplifies the reconstruction process and complex phase correction, and frequency synthesizing are not required anymore. By comparsion, with other learning-based reconstruction schemes, the proposed network has better response to high frequencies. The possibility of using the proposed method for the investigation of different biological samples has been experimentally verified, and the low-noise characteristics were also proved.
Collapse
|
10
|
Ludwig S, Pedrini G, Peng X, Osten W. Single-pixel scatter-plate microscopy. Opt Lett 2021; 46:2473-2476. [PMID: 33988613 DOI: 10.1364/ol.420593] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Accepted: 04/27/2021] [Indexed: 06/12/2023]
Abstract
Based on the optical memory effect of scattered light, we developed a new single-pixel camera concept. The retrieved images contain both 3D and spectral information about the sample. A spatial light modulator (SLM) generates a random intensity modulation. The signal recorded by the single-pixel detector is cross correlated by the calculated point spread function (PSF) signals of the SLM to retrieve the image. In this publication, both simulations and experimental results are presented.
Collapse
|
11
|
Pedrini G, Claus D. Phase retrieval using bidirectional interference. Appl Opt 2021; 60:3517-3525. [PMID: 33983260 DOI: 10.1364/ao.415927] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Accepted: 03/27/2021] [Indexed: 06/12/2023]
Abstract
In this paper we describe a phase retrieval algorithm using constraints given by diffraction patterns and phase difference obtained from bidirectional interference. Wave propagation and linear phase ramps are used to connect the recordings. At least three patterns are recorded and processed (two diffraction patterns and one interference pattern). The quality of the results can be improved when recording and processing more patterns. The method works well with non-sparse samples and short (few millimeter) recording distances. Simulations, comparisons with other methods, and experimental validations are presented.
Collapse
|
12
|
Pedrini G, Claus D. Phase retrieval using 3D Fourier transforms of volume diffraction pattern. Opt Lett 2021; 46:1716-1719. [PMID: 33793526 DOI: 10.1364/ol.419676] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/12/2021] [Accepted: 03/04/2021] [Indexed: 06/12/2023]
Abstract
In this Letter, we describe a method for retrieving the phase of a wavefield from a volume diffraction pattern. We show at first that the magnitude of the 3D Fourier transform of a diffracted volume wavefield is concentrated around a paraboloid. For the phase retrieval, we apply iteratively the constraints of the measured intensity and the paraboloid (sparsity) constraint in the 3D Fourier domain. Experimental validations and comparisons to other methods are presented.
Collapse
|
13
|
Ludwig S, Ruchka P, Pedrini G, Peng X, Osten W. Scatter-plate microscopy with spatially coherent illumination and temporal scatter modulation. Opt Express 2021; 29:4530-4546. [PMID: 33771029 DOI: 10.1364/oe.412047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/13/2020] [Accepted: 12/19/2020] [Indexed: 06/12/2023]
Abstract
Scatter-plate microscopy (SPM) is a lensless imaging technique for high-resolution imaging through scattering media. So far, the method was demonstrated for spatially incoherent illumination and static scattering media. In this publication, we demonstrate that these restrictions are not necessary. We realized imaging with spatially coherent and spatially incoherent illumination. We further demonstrate that SPM is still a valid imaging method for scatter-plates, which change their scattering behaviour (i.e. the phase-shift) at each position on the plate continuously but independently from other positions. Especially we realized imaging through rotating ground glass diffusers.
Collapse
|
14
|
Meng Z, Ding L, Feng S, Xing F, Nie S, Ma J, Pedrini G, Yuan C. Numerical dark-field imaging using deep-learning. Opt Express 2020; 28:34266-34278. [PMID: 33182900 DOI: 10.1364/oe.401786] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/23/2020] [Accepted: 10/20/2020] [Indexed: 06/11/2023]
Abstract
Dark-field microscopy is a powerful technique for enhancing the imaging resolution and contrast of small unstained samples. In this study, we report a method based on end-to-end convolutional neural network to reconstruct high-resolution dark-field images from low-resolution bright-field images. The relation between bright- and dark-field which was difficult to deduce theoretically can be obtained by training the corresponding network. The training data, namely the matched bright- and dark-field images of the same object view, are simultaneously obtained by a special designed multiplexed image system. Since the image registration work which is the key step in data preparation is not needed, the manual error can be largely avoided. After training, a high-resolution numerical dark-field image is generated from a conventional bright-field image as the input of this network. We validated the method by the resolution test target and quantitative analysis of the reconstructed numerical dark-field images of biological tissues. The experimental results show that the proposed learning-based method can realize the conversion from bright-field image to dark-field image, so that can efficiently achieve high-resolution numerical dark-field imaging. The proposed network is universal for different kinds of samples. In addition, we also verify that the proposed method has good anti-noise performance and is not affected by the unstable factors caused by experiment setup.
Collapse
|
15
|
Li J, Zhang Q, Zhong L, Tian J, Pedrini G, Lu X. Quantitative phase imaging in dual-wavelength interferometry using a single wavelength illumination and deep learning. Opt Express 2020; 28:28140-28153. [PMID: 32988091 DOI: 10.1364/oe.402808] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/14/2020] [Accepted: 08/27/2020] [Indexed: 06/11/2023]
Abstract
In this manuscript, we propose a quantitative phase imaging method based on deep learning, using a single wavelength illumination to realize dual-wavelength phase-shifting phase recovery. By using the conditional generative adversarial network (CGAN), from one interferogram recorded at a single wavelength, we obtain interferograms at other wavelengths, the corresponding wrapped phases and then the phases at synthetic wavelengths. The feasibility of the proposed method is verified by simulation and experiments. The results demonstrate that the measurement range of single-wavelength interferometry (SWI) is improved by keeping a simple setup, avoiding the difficulty caused by using two wavelengths simultaneously. This will provide an effective solution for the problem of phase unwrapping and the measurement range limitation in phase-shifting interferometry.
Collapse
|
16
|
Cai Z, Chen J, Pedrini G, Osten W, Liu X, Peng X. Lensless light-field imaging through diffuser encoding. Light Sci Appl 2020; 9:143. [PMID: 32864118 PMCID: PMC7438505 DOI: 10.1038/s41377-020-00380-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/10/2020] [Revised: 07/24/2020] [Accepted: 08/02/2020] [Indexed: 05/12/2023]
Abstract
Microlens array-based light-field imaging has been one of the most commonly used and effective technologies to record high-dimensional optical signals for developing various potential high-performance applications in many fields. However, the use of a microlens array generally suffers from an intrinsic trade-off between the spatial and angular resolutions. In this paper, we concentrate on exploiting a diffuser to explore a novel modality for light-field imaging. We demonstrate that the diffuser can efficiently angularly couple incident light rays into a detected image without needing any lens. To characterize and analyse this phenomenon, we establish a diffuser-encoding light-field transmission model, in which four-dimensional light fields are mapped into two-dimensional images via a transmission matrix describing the light propagation through the diffuser. Correspondingly, a calibration strategy is designed to flexibly determine the transmission matrix, so that light rays can be computationally decoupled from a detected image with adjustable spatio-angular resolutions, which are unshackled from the resolution limitation of the sensor. The proof-of-concept approach indicates the possibility of using scattering media for lensless four-dimensional light-field recording and processing, not just for two- or three-dimensional imaging.
Collapse
Affiliation(s)
- Zewei Cai
- Institut für Technische Optik, Universität Stuttgart, Pfaffenwaldring 9, 70569 Stuttgart, Germany
- College of Physics and Optoelectronic Engineering, Shenzhen University, 518060 Guangdong, Shenzhen China
| | - Jiawei Chen
- College of Physics and Optoelectronic Engineering, Shenzhen University, 518060 Guangdong, Shenzhen China
| | - Giancarlo Pedrini
- Institut für Technische Optik, Universität Stuttgart, Pfaffenwaldring 9, 70569 Stuttgart, Germany
| | - Wolfgang Osten
- Institut für Technische Optik, Universität Stuttgart, Pfaffenwaldring 9, 70569 Stuttgart, Germany
| | - Xiaoli Liu
- College of Physics and Optoelectronic Engineering, Shenzhen University, 518060 Guangdong, Shenzhen China
| | - Xiang Peng
- College of Physics and Optoelectronic Engineering, Shenzhen University, 518060 Guangdong, Shenzhen China
| |
Collapse
|
17
|
Cai Z, Pedrini G, Osten W, Liu X, Peng X. Single-shot structured-light-field three-dimensional imaging. Opt Lett 2020; 45:3256-3259. [PMID: 32538956 DOI: 10.1364/ol.393911] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/27/2020] [Accepted: 05/06/2020] [Indexed: 06/11/2023]
Abstract
This Letter reports an approach to single-shot three-dimensional (3D) imaging that is combining structured illumination and light-field imaging. The sinusoidal distribution of the radiance in the structured-light field can be processed and transformed to compute the angular variance of the local radiance difference. The angular variance across the depth range exhibits a single-peak distribution trend that can be used to obtain the unambiguous depth. The phase computation that generally requires the acquisition of multi-frame phase-shifting images is no longer mandatory, thus enabling single-shot structured-light-field 3D imaging. The proposed approach was experimentally demonstrated through a dynamic scene.
Collapse
|
18
|
Wang F, Bian Y, Wang H, Lyu M, Pedrini G, Osten W, Barbastathis G, Situ G. Phase imaging with an untrained neural network. Light Sci Appl 2020; 9:77. [PMID: 32411362 PMCID: PMC7200792 DOI: 10.1038/s41377-020-0302-3] [Citation(s) in RCA: 76] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/15/2019] [Revised: 03/17/2020] [Accepted: 03/23/2020] [Indexed: 05/11/2023]
Abstract
Most of the neural networks proposed so far for computational imaging (CI) in optics employ a supervised training strategy, and thus need a large training set to optimize their weights and biases. Setting aside the requirements of environmental and system stability during many hours of data acquisition, in many practical applications, it is unlikely to be possible to obtain sufficient numbers of ground-truth images for training. Here, we propose to overcome this limitation by incorporating into a conventional deep neural network a complete physical model that represents the process of image formation. The most significant advantage of the resulting physics-enhanced deep neural network (PhysenNet) is that it can be used without training beforehand, thus eliminating the need for tens of thousands of labeled data. We take single-beam phase imaging as an example for demonstration. We experimentally show that one needs only to feed PhysenNet a single diffraction pattern of a phase object, and it can automatically optimize the network and eventually produce the object phase through the interplay between the neural network and the physical model. This opens up a new paradigm of neural network design, in which the concept of incorporating a physical model into a neural network can be generalized to solve many other CI problems.
Collapse
Affiliation(s)
- Fei Wang
- Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, 201800 Shanghai, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, 100049 Beijing, China
| | - Yaoming Bian
- Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, 201800 Shanghai, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, 100049 Beijing, China
| | - Haichao Wang
- Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, 201800 Shanghai, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, 100049 Beijing, China
| | - Meng Lyu
- Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, 201800 Shanghai, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, 100049 Beijing, China
| | - Giancarlo Pedrini
- Institut für Technische Optik, Universität Stuttgart, Pfaffenwaldring 9, 70569 Stuttgart, Germany
| | - Wolfgang Osten
- Institut für Technische Optik, Universität Stuttgart, Pfaffenwaldring 9, 70569 Stuttgart, Germany
| | - George Barbastathis
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA 02139-4301 USA
| | - Guohai Situ
- Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, 201800 Shanghai, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, 100049 Beijing, China
- Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, 310024 Hangzhou, China
| |
Collapse
|
19
|
Cai Z, Liu X, Pedrini G, Osten W, Peng X. Light-field depth estimation considering plenoptic imaging distortion. Opt Express 2020; 28:4156-4168. [PMID: 32122073 DOI: 10.1364/oe.385285] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/09/2019] [Accepted: 01/23/2020] [Indexed: 06/10/2023]
Abstract
Light-field imaging can simultaneously record spatio-angular information of light rays to carry out depth estimation via depth cues which reflect a coupling of the angular information and the scene depth. However, the unavoidable imaging distortion in a light-field imaging system has a side effect on the spatio-angular coordinate computation, leading to incorrectly estimated depth maps. Based on the previously established unfocused plenoptic metric model, this paper reports a study on the effect of the plenoptic imaging distortion on the light-field depth estimation. A method of light-field depth estimation considering the plenoptic imaging distortion is proposed. Besides, the accuracy analysis of the light-field depth estimation was performed by using standard components. Experimental results demonstrate that efficiently compensating the plenoptic imaging distortion results in a six-fold improvement in measuring accuracy and more consistency across the measuring depth range. Consequently, the proposed method is proved to be suitable for light-field depth estimation and three-dimensional measurement with high quality, enabling unfocused plenoptic cameras to be metrological tools in the potential application scenarios such as industry, biomedicine, entertainment, and many others.
Collapse
|
20
|
Ludwig S, Le Teurnier B, Pedrini G, Peng X, Osten W. Image reconstruction and enhancement by deconvolution in scatter-plate microscopy. Opt Express 2019; 27:23049-23058. [PMID: 31510587 DOI: 10.1364/oe.27.023049] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/14/2019] [Accepted: 07/17/2019] [Indexed: 06/10/2023]
Abstract
We investigated the capabilities of deconvolution for image enhancement in scatter-plate microscopy. This lensless imaging technique enables the investigation of microstructures through scattering media by cross-correlating the scattered light intensity with a previously recorded point spread function (PSF) of the scattering medium. The autocorrelation function of the PSF appears as the transfer function of the imaging process. Deconvolution methods use the knowledge of this transfer function to enhance the image quality by reducing the blur and strengthening the contrast with the objective to achieve diffraction-limited resolution. We obtained significant image enhancement both with means of inverse filtering and by applying iterative deconvolution algorithms.
Collapse
|
21
|
Cai Z, Liu X, Pedrini G, Osten W, Peng X. Unfocused plenoptic metric modeling and calibration. Opt Express 2019; 27:20177-20198. [PMID: 31510117 DOI: 10.1364/oe.27.020177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/09/2019] [Accepted: 06/26/2019] [Indexed: 06/10/2023]
Abstract
For unfocused plenoptic imaging systems, metric calibration is generally mandatory to achieve high-quality imaging and metrology. In this paper, we present an explicit derivation of an unfocused plenoptic metric model associating a measured light field in the object space with a recorded light field in the image space to conform physically to the imaging properties of unfocused plenoptic cameras. In addition, the impact of unfocused plenoptic imaging distortion on depth computation was experimentally explored, revealing that radial distortion parameters contain depth-dependent common factors, which were then modeled as depth distortions. Consequently, a complete unfocused plenoptic metric model was established by combining the explicit metric model with the imaging distortion model. A three-step unfocused plenoptic metric calibration strategy, in which the Levenberg-Marquardt algorithm is used for parameter optimization, is correspondingly proposed to determine 12 internal parameters for each microlens unit. Based on the proposed modeling and calibration, the depth measurement precision can be increased to 0.25 mm in a depth range of 300 mm, ensuring the potential applicability of consumer unfocused plenoptic cameras in high-accuracy three-dimensional measurement.
Collapse
|
22
|
Cai Z, Liu X, Pedrini G, Osten W, Peng X. Accurate depth estimation in structured light fields. Opt Express 2019; 27:13532-13546. [PMID: 31052874 DOI: 10.1364/oe.27.013532] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/18/2019] [Accepted: 04/12/2019] [Indexed: 06/09/2023]
Abstract
Passive light field imaging generally uses depth cues that depend on the image structure to perform depth estimation, causing robustness and accuracy problems in complex scenes. In this study, the commonly used depth cues, defocus and correspondence, were analyzed by using phase encoding instead of the image structure. The defocus cue obtained by spatial variance is insensitive to the global spatial monotonicity of the phase-encoded field. In contrast, the correspondence cue is sensitive to the angular variance of the phase-encoded field, and the correspondence responses across the depth range have single-peak distributions. Based on this analysis, a novel active light field depth estimation method is proposed by directly using the correspondence cue in the structured light field to search for non-ambiguous depths, and thus no optimization is required. Furthermore, the angular variance can be weighted to reduce the depth estimation uncertainty according to the phase encoding information. The depth estimation of an experimental scene with rich colors demonstrated that the proposed method could distinguish different depth regions in each color segment more clearly, and was substantially improved in terms of phase consistency compared to the passive method, thus verifying its robustness and accuracy.
Collapse
|
23
|
Pedrini G, Alekseenko I, Jagannathan G, Kempenaars M, Vayakis G, Osten W. Feasibility study of digital holography for erosion measurements under extreme environmental conditions inside the International Thermonuclear Experimental Reactor tokamak [invited]. Appl Opt 2019; 58:A147-A155. [PMID: 30873972 DOI: 10.1364/ao.58.00a147] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/01/2018] [Accepted: 11/26/2018] [Indexed: 06/09/2023]
Abstract
In the International Thermonuclear Experimental Reactor under construction in southern France, there will be a need for continuous measuring of the erosion at the wall, after the reactor starts operating. A two-wavelength interferometric technique based on digital holography is proposed for the erosion measurement. This technique has the ability to tackle the challenging environmental conditions within the reactor by a long-distance measurement, where a relay optic will be used for imaging the investigated surface on the detector. We will show that the shape measurements of objects located at a distance of more than 20 m from the measuring head can be carried out in a short time (100 μs) by the two-wavelength interferometric technique. A depth accuracy of ±10 μm is achieved.
Collapse
|
24
|
Liao M, Lu D, He W, Pedrini G, Osten W, Peng X. Improving reconstruction of speckle correlation imaging by using a modified phase retrieval algorithm with the number of nonzero-pixels constraint. Appl Opt 2019; 58:473-478. [PMID: 30645330 DOI: 10.1364/ao.58.000473] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/27/2018] [Accepted: 12/04/2018] [Indexed: 06/09/2023]
Abstract
Speckle correlation imaging (SCI) has been considered one of the most promising techniques for computational imaging through a scattering medium. However, the image quality is not always acceptable in conventional SCI, especially when a complex object is involved. In this work, a modified phase retrieval algorithm is introduced to significantly improve the imaging quality of SCI. In the proposed scheme, nonzero-pixel constraints, rather than the real and nonnegative constraints, are employed as the object domain constraints of the iterative algorithm in the image reconstruction process. Experimental results are presented to show the performance enhancement of this scheme, inclusive of less iterations, better image quality, and higher reliability, in comparison with the conventional SCI method.
Collapse
|
25
|
Cai Z, Liu X, Chen Z, Tang Q, Gao BZ, Pedrini G, Osten W, Peng X. Light-field-based absolute phase unwrapping. Opt Lett 2018; 43:5717-5720. [PMID: 30499976 DOI: 10.1364/ol.43.005717] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/09/2018] [Accepted: 10/24/2018] [Indexed: 06/09/2023]
Abstract
Ambiguity caused by a wrapped phase is an intrinsic problem in fringe projection-based 3D shape measurement. Among traditional methods for avoiding phase ambiguity, spatial phase unwrapping is sensitive to sensor noise and depth discontinuity, and temporal phase unwrapping requires additional encoding information that leads to an increase of image sequence acquisition time or a reduction of fringe contrast. Here, to the best of our knowledge, we report a novel method of absolute phase unwrapping based on light field imaging. In a recorded light field under structured illumination, i.e., a structured light field, a wrapped phase-encoded field can be retrieved and resampled in diverse image planes associated with several possible fringe orders in a measurement volume. Then, by leveraging phase consistency constraint in the resampled wrapped phase-encoded field, correct fringe orders can be determined to unwrap the wrapped phase without any additional encoding information. Experimental results demonstrated that the proposed method was suitable for accurate and robust absolute phase unwrapping.
Collapse
|
26
|
Buchta D, Serbes H, Claus D, Pedrini G, Osten W. Soft tissue elastography via shearing interferometry. J Med Imaging (Bellingham) 2018; 5:046001. [PMID: 30840733 DOI: 10.1117/1.jmi.5.4.046001] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2018] [Accepted: 10/10/2018] [Indexed: 11/14/2022] Open
Abstract
Early detection of cancer can significantly increase the survival chances of patients. Palpation is a traditional method in order to detect cancer; however, in minimally invasive surgery the surgeon is deprived of the sense of touch. We demonstrate how shearing elastography can recover elastic parameters and furthermore can be used to localize stiffness imhomogenities even if hidden underneath the surface. Furthermore, the influence of size and depth of the stiffness imhomogenities on the detection accuracy and localization is investigated.
Collapse
Affiliation(s)
- Dominic Buchta
- University of Stuttgart, Institut für Technische Optik, Stuttgart, Germany
| | - Hüseyin Serbes
- University of Stuttgart, Institut für Technische Optik, Stuttgart, Germany
| | - Daniel Claus
- University of Stuttgart, Institut für Technische Optik, Stuttgart, Germany
| | - Giancarlo Pedrini
- University of Stuttgart, Institut für Technische Optik, Stuttgart, Germany
| | - Wolfgang Osten
- University of Stuttgart, Institut für Technische Optik, Stuttgart, Germany
| |
Collapse
|
27
|
Claus D, Pedrini G, Buchta D, Osten W. Accuracy enhanced and synthetic wavelength adjustable optical metrology via spectrally resolved digital holography. J Opt Soc Am A Opt Image Sci Vis 2018; 35:546-552. [PMID: 29603983 DOI: 10.1364/josaa.35.000546] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/08/2017] [Accepted: 02/05/2018] [Indexed: 06/08/2023]
Abstract
This paper demonstrates the usefulness of spectrally resolved digital holography for dual-wavelength optical metrology. Based on the large degree of phase information available, multiple de-correlated dual-wavelength phase maps can be generated, which, when averaged, result in a signal-to-noise-ratio improvement. Compared with single-wavelength averaging, no further post-processing of the reconstructed dual-wavelength phase map is required. Moreover, the constraint imposed on the wavelength stability, as experienced in the conventional dual-wavelength method, can be relaxed, and the corresponding synthetic wavelength is adapted to the object under investigation. In addition, the possibility of optical sectioning based on the narrow-width coherence envelope is also demonstrated in transmission mode.
Collapse
|
28
|
Cazac V, Meshalkin A, Achimova E, Abashkin V, Katkovnik V, Shevkunov I, Claus D, Pedrini G. Surface relief and refractive index gratings patterned in chalcogenide glasses and studied by off-axis digital holography. Appl Opt 2018; 57:507-513. [PMID: 29400803 DOI: 10.1364/ao.57.000507] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/29/2017] [Accepted: 12/15/2017] [Indexed: 06/07/2023]
Abstract
Surface relief gratings and refractive index gratings are formed by direct holographic recording in amorphous chalcogenide nanomultilayer structures As2S3-Se and thin films As2S3. The evolution of the grating parameters, such as the modulation of refractive index and relief depth in dependence of the holographic exposure, is investigated. Off-axis digital holographic microscopy is applied for the measurement of the photoinduced phase gratings. For the high-accuracy reconstruction of the wavefront (amplitude and phase) transmitted by the fabricated gratings, we used a computational technique based on the sparse modeling of phase and amplitude. Both topography and refractive index maps of recorded gratings are revealed. Their separated contribution in diffraction efficiency is estimated.
Collapse
|
29
|
Singh AK, Pedrini G, Takeda M, Osten W. Scatter-plate microscope for lensless microscopy with diffraction limited resolution. Sci Rep 2017; 7:10687. [PMID: 28878361 PMCID: PMC5587816 DOI: 10.1038/s41598-017-10767-3] [Citation(s) in RCA: 44] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2017] [Accepted: 08/14/2017] [Indexed: 11/22/2022] Open
Abstract
Scattering media have always been looked upon as an obstacle in imaging. Various methods, ranging from holography to phase compensation as well as to correlation techniques, have been proposed to cope with this obstacle. We, on the other hand, have a different understanding about the role of the diffusing media. In this paper we propose and demonstrate a ‘scatter-plate microscope’ that utilizes the diffusing property of the random medium for imaging micro structures with diffraction-limited resolution. The ubiquitous property of the speckle patterns permits to exploit the scattering medium as an ultra-thin lensless microscope objective with a variable focal length and a large working distance. The method provides a light, flexible and cost effective imaging device as an alternative to conventional microscope objectives. In principle, the technique is also applicable to lensless imaging in UV and X-ray microscopy. Experiments were performed with visible light to demonstrate the microscopic imaging of USAF resolution test target and a biological sample with varying numerical aperture (NA) and magnifications.
Collapse
Affiliation(s)
- Alok Kumar Singh
- Institut für Technische Optik and Stuttgart Research Center of Photonic Engineering (SCoPE), University of Stuttgart, Pfaffenwaldring 9, 70569, Stuttgart, Germany.
| | - Giancarlo Pedrini
- Institut für Technische Optik and Stuttgart Research Center of Photonic Engineering (SCoPE), University of Stuttgart, Pfaffenwaldring 9, 70569, Stuttgart, Germany
| | - Mitsuo Takeda
- Institut für Technische Optik and Stuttgart Research Center of Photonic Engineering (SCoPE), University of Stuttgart, Pfaffenwaldring 9, 70569, Stuttgart, Germany.,Center for Optical Research and Education (CORE), Utsunomiya University, Yoto 7-1-2, Utsunomiya, Tochigi, 321-8585, Japan
| | - Wolfgang Osten
- Institut für Technische Optik and Stuttgart Research Center of Photonic Engineering (SCoPE), University of Stuttgart, Pfaffenwaldring 9, 70569, Stuttgart, Germany
| |
Collapse
|
30
|
Claus D, Mlikota M, Geibel J, Reichenbach T, Pedrini G, Mischinger J, Schmauder S, Osten W. Large-field-of-view optical elastography using digital image correlation for biological soft tissue investigation (erratum). J Med Imaging (Bellingham) 2017; 4:029801. [DOI: 10.1117/1.jmi.4.2.029801] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Affiliation(s)
- Daniel Claus
- Universität Stuttgart, Institut für Technische Optik, Stuttgart, Germany
| | - Marijo Mlikota
- Universität Stuttgart, Institut für Materialprüfung, Werkstoffkunde und Festigkeitslehre, Stuttgart, Germany
| | - Jonathan Geibel
- Universität Stuttgart, Institut für Technische Optik, Stuttgart, Germany
| | - Thomas Reichenbach
- Universität Stuttgart, Institut für Technische Optik, Stuttgart, Germany
| | - Giancarlo Pedrini
- Universität Stuttgart, Institut für Technische Optik, Stuttgart, Germany
| | - Johannes Mischinger
- Eberhard Karls Universität Tübingen, Klinik für Urologie, Universitätsklinikum Tübingen, Tübingen, Germany
| | - Siegfried Schmauder
- Universität Stuttgart, Institut für Materialprüfung, Werkstoffkunde und Festigkeitslehre, Stuttgart, Germany
| | - Wolfgang Osten
- Universität Stuttgart, Institut für Technische Optik, Stuttgart, Germany
| |
Collapse
|
31
|
Abstract
A new technique using digital holography to study the photoelastic isochromatic and isopachic fringes and their respective phases is reported. Our detailed theoretical and experimental analysis shows the possibility of whole-field analysis of every section of stressed photoelastic materials.
Collapse
|
32
|
Abstract
An alternative phase retrieval technique is discussed in this paper, which offers some advantages for the obtained resolution and reconstruction procedure. In contrast to commonly applied iterative phase retrieval routines, diffraction patterns with varying distance between the illumination source and the object are recorded. This has the same effect as changing the object sensor distance, albeit offering the advantage of preserving the resolution. Moreover, it is possible to employ the direct Fresnel propagation method without having to worry about different pixel sizes in the reconstruction plane. In addition, the influence of speckle decorrelation has carefully been studied and considered for the experimental implementation.
Collapse
|
33
|
Claus D, Mlikota M, Geibel J, Reichenbach T, Pedrini G, Mischinger J, Schmauder S, Osten W. Large-field-of-view optical elastography using digital image correlation for biological soft tissue investigation. J Med Imaging (Bellingham) 2017; 4:014505. [PMID: 28386578 PMCID: PMC5352912 DOI: 10.1117/1.jmi.4.1.014505] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2016] [Accepted: 02/17/2017] [Indexed: 11/14/2022] Open
Abstract
In minimally invasive surgery the haptic feedback, which represents an important tool for the localization of abnormalities, is no longer available. Elastography is an imaging technique that results in quantitative elastic parameters. It can hence be used to replace the lost sense of touch, as to enable tissue localization and discrimination. Digital image correlation is the chosen elastographic imaging technique. The implementation discussed here is clinically sound, based on a spectrally engineered illumination source that enables imaging of biological surface markers (blood vessels) with high contrast. Mechanical loading and deformation of the sample is performed using a rolling indenter, which enables the investigation of large organs (size of kidney) with reduced measurement time compared to a scanning approach. Furthermore, the rolling indentation results in strain contrast improvement and an increase in detection accuracy. The successful application of digital image correlation is first demonstrated on a silicone phantom and later on biological samples. Elasticity parameters and their corresponding four-dimensional distribution are generated via solving the inverse problem (only two-dimensional displacement field and strain map experimentally available) using a well-matched hyperelastic finite element model.
Collapse
Affiliation(s)
- Daniel Claus
- Universität Stuttgart , Institut für Technische Optik, Stuttgart, Germany
| | - Marijo Mlikota
- Universität Stuttgart , Institut für Materialprüfung, Werkstoffkunde und Festigkeitslehre, Stuttgart, Germany
| | - Jonathan Geibel
- Universität Stuttgart , Institut für Technische Optik, Stuttgart, Germany
| | - Thomas Reichenbach
- Universität Stuttgart , Institut für Technische Optik, Stuttgart, Germany
| | - Giancarlo Pedrini
- Universität Stuttgart , Institut für Technische Optik, Stuttgart, Germany
| | - Johannes Mischinger
- Eberhard Karls Universität Tübingen , Klinik für Urologie, Universitätsklinikum Tübingen, Tübingen, Germany
| | - Siegfried Schmauder
- Universität Stuttgart , Institut für Materialprüfung, Werkstoffkunde und Festigkeitslehre, Stuttgart, Germany
| | - Wolfgang Osten
- Universität Stuttgart , Institut für Technische Optik, Stuttgart, Germany
| |
Collapse
|
34
|
Singh AK, Naik DN, Pedrini G, Takeda M, Osten W. Exploiting scattering media for exploring 3D objects. Light Sci Appl 2017; 6:e16219. [PMID: 30167232 PMCID: PMC6062180 DOI: 10.1038/lsa.2016.219] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2016] [Revised: 08/22/2016] [Accepted: 09/04/2016] [Indexed: 05/20/2023]
Abstract
Scattering media, such as diffused glass and biological tissue, are usually treated as obstacles in imaging. To cope with the random phase introduced by a turbid medium, most existing imaging techniques recourse to either phase compensation by optical means or phase recovery using iterative algorithms, and their applications are often limited to two-dimensional imaging. In contrast, we utilize the scattering medium as an unconventional imaging lens and exploit its lens-like properties for lensless three-dimensional (3D) imaging with diffraction-limited resolution. Our spatially incoherent lensless imaging technique is simple and capable of variable focusing with adjustable depths of focus that enables depth sensing of 3D objects that are concealed by the diffusing medium. Wide-field imaging with diffraction-limited resolution is verified experimentally by a single-shot recording of the 1951 USAF resolution test chart, and 3D imaging and depth sensing are demonstrated by shifting focus over axially separated objects.
Collapse
Affiliation(s)
- Alok Kumar Singh
- Institut für Technische Optik (ITO) and Stuttgart Research Center of Photonic Engineering (SCoPE), University of Stuttgart, Pfaffenwaldring 9, 70569 Stuttgart, Germany
| | - Dinesh N Naik
- Institut für Technische Optik (ITO) and Stuttgart Research Center of Photonic Engineering (SCoPE), University of Stuttgart, Pfaffenwaldring 9, 70569 Stuttgart, Germany
- School of Physics, University of Hyderabad, Hyderabad 500 046, India
| | - Giancarlo Pedrini
- Institut für Technische Optik (ITO) and Stuttgart Research Center of Photonic Engineering (SCoPE), University of Stuttgart, Pfaffenwaldring 9, 70569 Stuttgart, Germany
| | - Mitsuo Takeda
- Institut für Technische Optik (ITO) and Stuttgart Research Center of Photonic Engineering (SCoPE), University of Stuttgart, Pfaffenwaldring 9, 70569 Stuttgart, Germany
- Center for Optical Research and Education (CORE), Utsunomiya University, Yoto 7-1-2, Utsunomiya, Tochigi, 321- 8585, Japan
| | - Wolfgang Osten
- Institut für Technische Optik (ITO) and Stuttgart Research Center of Photonic Engineering (SCoPE), University of Stuttgart, Pfaffenwaldring 9, 70569 Stuttgart, Germany
| |
Collapse
|
35
|
Khodadad D, Singh AK, Pedrini G, Sjödahl M. Full-field 3D deformation measurement: comparison between speckle phase and displacement evaluation. Appl Opt 2016; 55:7735-7743. [PMID: 27661605 DOI: 10.1364/ao.55.007735] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
The objective of this paper is to describe a full-field deformation measurement method based on 3D speckle displacements. The deformation is evaluated from the slope of the speckle displacement function that connects the different reconstruction planes. For our experiment, a symmetrical arrangement with four illuminations parallel to the planes (x,z) and (y,z) was used. Four sets of speckle patterns were sequentially recorded by illuminating an object from the four directions, respectively. A single camera is used to record the holograms before and after deformations. Digital speckle photography is then used to calculate relative speckle displacements in each direction between two numerically propagated planes. The 3D speckle displacements vector is calculated as a combination of the speckle displacements from the holograms recorded in each illumination direction. Using the speckle displacements, problems associated with rigid body movements and phase wrapping are avoided. In our experiment, the procedure is shown to give the theoretical accuracy of 0.17 pixels yielding the accuracy of 2×10-3 in the measurement of deformation gradients.
Collapse
|
36
|
Georges MP, Vandenrijt JF, Thizy C, Alexeenko I, Pedrini G, Vollheim B, Lopez I, Jorge I, Rochet J, Osten W. Combined holography and thermography in a single sensor through image-plane holography at thermal infrared wavelengths. Opt Express 2014; 22:25517-25529. [PMID: 25401585 DOI: 10.1364/oe.22.025517] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
Holographic interferometry in the thermal wavelengths range, combining a CO(2) laser and digital hologram recording with a microbolometer array based camera, allows simultaneously capturing temperature and surface shape information about objects. This is due to the fact that the holograms are affected by the thermal background emitted by objects at room temperature. We explain the setup and the processing of data which allows decoupling the two types of information. This natural data fusion can be advantageously used in a variety of nondestructive testing applications.
Collapse
|
37
|
Osten W, Faridian A, Gao P, Körner K, Naik D, Pedrini G, Singh AK, Takeda M, Wilke M. Recent advances in digital holography [invited]. Appl Opt 2014; 53:G44-63. [PMID: 25322137 DOI: 10.1364/ao.53.000g44] [Citation(s) in RCA: 73] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/07/2014] [Accepted: 06/05/2014] [Indexed: 05/25/2023]
Abstract
This article presents an overview of recent advances in the field of digital holography, ranging from holographic techniques designed to increase the resolution of microscopic images, holographic imaging using incoherent illumination, phase retrieval with incoherent illumination, imaging of occluded objects, and the holographic recording of depth-extended objects using a frequency-comb laser, to the design of an infrastructure for remote laboratories for digital-holographic microscopy and metrology. The paper refers to current trends in digital holography and explains them using new results that were recently achieved at the Institute for Applied Optics of the University Stuttgart.
Collapse
|
38
|
Abstract
In this Letter, we propose a method for retrieving the phase of a wavefront from the diffraction patterns recorded when the object is sequentially illuminated by spatially modulated light. For wavefronts having a smooth phase, the retrieval is achieved by using a deterministic method. When the phase has discontinuities, an iterative process is used for the retrieval and enhancement of the spatial resolution. Both the deterministic and iterative phase reconstructions are demonstrated by experiments.
Collapse
|
39
|
Abstract
We propose a method for high resolution phase imaging of biological and non-biological samples using an incoherent deep ultraviolet (DUV) LED source. The diffraction pattern of the object wave is recorded at different axial planes and the phase is retrieved by propagation of the angular spectrum. To maintain enough light intensity, we avoided using a pinhole or spectral filter for increasing the coherence of the DUV LED source. This makes the setup very simple and cost effective. The short wavelength (285 nm) of the DUV light, tuned to the absorption peak of the biological samples, allows simultaneously high resolution and high contrast images. The experimental results are presented to verify this principle.
Collapse
|
40
|
Singh AK, Naik DN, Pedrini G, Takeda M, Osten W. Looking through a diffuser and around an opaque surface: a holographic approach. Opt Express 2014; 22:7694-7701. [PMID: 24718145 DOI: 10.1364/oe.22.007694] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
Retrieving the information about the object hidden around a corner or obscured by a diffused surface has a vast range of applications. Over the time many techniques have been tried to make this goal realizable. Here, we are presenting yet another approach to retrieve a 3-D object from the scattered field using digital holography with statistical averaging. The methods are simple, easy to implement and allow fast image reconstruction because they do not require phase correction, complicated image processing, scanning of the object or any kind of wave shaping. The methods inherit the merit of digital holography that the micro deformation and displacement of the hidden object can also be detected.
Collapse
|
41
|
Naik DN, Pedrini G, Takeda M, Osten W. Spectrally resolved incoherent holography: 3D spatial and spectral imaging using a Mach-Zehnder radial-shearing interferometer. Opt Lett 2014; 39:1857-1860. [PMID: 24686623 DOI: 10.1364/ol.39.001857] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
Spatial and spectral information holds the key for characterizing incoherently illuminated or self-luminous objects, as well as for imaging fluorescence. We propose spectrally resolved incoherent holography using a multifunctional Mach-Zehnder interferometer that can introduce both a radial shear and a variable time delay between the interfering optical fields and permits the measurement of both spatial and temporal coherence functions, from which a 3D spatial and spectral image of the object is reconstructed. We propose and demonstrate the accurate 3D imaging of the object spectra by in situ calibration.
Collapse
|
42
|
Faridian A, Pedrini G, Osten W. Opposed-view dark-field digital holographic microscopy. Biomed Opt Express 2014; 5:728-36. [PMID: 24688809 PMCID: PMC3959838 DOI: 10.1364/boe.5.000728] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/27/2013] [Revised: 01/22/2014] [Accepted: 02/05/2014] [Indexed: 05/05/2023]
Abstract
Scattering and absorption belong to the major problems in imaging the internal layers of a biological specimen. Due to the structural inhomogeneity of the specimen, the distribution of the structures in the upper layers of a given internal structure of interest is different from the lower layers that may result in different interception of scattered light, falling into the angular aperture of the microscope objective, from the object in each imaging view. Therefore, different spatial frequencies of the scattered light can be acquired from different (top and bottom) views. We have arranged an opposed-view dark-field digital holographic microscope (DHM) to collect the scattered light concurrently from both views with the aim to increase the contrast of internal structures and improve the signal-to-noise ratio. Implementing a DHM system gives the possibility to implement digital refocusing process and obtain multilayer images from each side without a depth scan of the object. The method is explained and the results are presented exemplary for a Drosophila embryo.
Collapse
|
43
|
Abstract
In this Letter, we present referenceless phase retrieval methods with resolution enhancement. Structured illuminations with different orientations and phase shifts are generated by a spatial light modulator and are used to illuminate the specimen. The generated diffraction patterns are recorded by a CCD camera, and the phase of the wavefront is reconstructed from these patterns.
Collapse
|
44
|
Abstract
We have developed an imaging system to extract high contrast images from different layers of biological organisms. Utilizing a digital holographic approach, the system works without scanning through layers of the specimen. In dark-field illumination, scattered light has the main contribution in image formation, but in the case of coherent illumination, this creates a strong speckle noise that reduces the image quality. To remove this restriction, the specimen has been illuminated with various speckle-fields and a hologram has been recorded for each speckle-field. Each hologram has been analyzed separately and the corresponding intensity image has been reconstructed. The final image has been derived by averaging over the reconstructed images. A correlation approach has been utilized to determine the number of speckle-fields required to achieve a desired contrast and image quality. The reconstructed intensity images in different object layers are shown for different sea urchin larvae. Two multimedia files are attached to illustrate the process of digital focusing.
Collapse
Affiliation(s)
- Ahmad Faridian
- Universität Stuttgart, Institut für Technische Optik, Pfaffenwaldring 9, D-70569 Stuttgart, Germany.
| | | | | |
Collapse
|
45
|
Gao P, Pedrini G, Osten W. Structured illumination for resolution enhancement and autofocusing in digital holographic microscopy. Opt Lett 2013; 38:1328-30. [PMID: 23595474 DOI: 10.1364/ol.38.001328] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/07/2023]
Abstract
In this Letter we show how resolution enhancement and autofocusing in digital holographic microscopy is obtained by using structured illumination generated by a spatial light modulator, which enables it to project fringes of different orientations and phase shift without mechanical movement. The image plane is numerically determined by searching for the minimal deviation between the reconstructed images carried by different diffraction orders of the structured illuminations.
Collapse
Affiliation(s)
- Peng Gao
- Institut für Technische Optik, Universität Stuttgart, Pfaffenwaldring 9, Stuttgart 70569, Germany. ‑stuttgart.de
| | | | | |
Collapse
|
46
|
Naik DN, Pedrini G, Osten W. Recording of incoherent-object hologram as complex spatial coherence function using Sagnac radial shearing interferometer and a Pockels cell. Opt Express 2013; 21:3990-3995. [PMID: 23481933 DOI: 10.1364/oe.21.003990] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
The ideas of incoherent holography were conceived after the invention of coherent-light holography and their concepts seems indirectly related to it. In this work, we adopt an approach based on statistical optics to describe the process of recording of an incoherent-object hologram as a complex spatial coherence function. A Sagnac radial shearing interferometer is used for the correlation of optical fields and a Pockels cell is used to phase shift the interfering fields with the objective to quantify and to retrieve the spatial coherence function.
Collapse
Affiliation(s)
- Dinesh N Naik
- Institute für Technische Optik, Universität Stuttgart, Pfaffenwaldring 9, 70569 Stuttgart, Germany.
| | | | | |
Collapse
|
47
|
Alexeenko I, Vandenrijt JF, Pedrini G, Thizy C, Vollheim B, Osten W, Georges MP. Nondestructive testing by using long-wave infrared interferometric techniques with CO2 lasers and microbolometer arrays. Appl Opt 2013; 52:A56-A67. [PMID: 23292423 DOI: 10.1364/ao.52.000a56] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2012] [Accepted: 09/20/2012] [Indexed: 06/01/2023]
Abstract
We describe three different interferometric techniques (electronic speckle pattern interferometry, digital holographic interferometry, and digital shearography), using a long-wave infrared radiation produced by a CO(2) laser and recorded on a microbolometer array. Experimental results showing how these methods can be used for nondestructive testing are presented. Advantages and disadvantages of these approaches are discussed.
Collapse
Affiliation(s)
- Igor Alexeenko
- Institut für Technische Optik—Universität Stuttgart, Pfaffenwaldring 9, Stuttgart 70569, Germany
| | | | | | | | | | | | | |
Collapse
|
48
|
Tiziani HJ, Pedrini G. From speckle pattern photography to digital holographic interferometry [Invited]. Appl Opt 2013; 52:30-44. [PMID: 23292373 DOI: 10.1364/ao.52.000030] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/23/2012] [Accepted: 09/21/2012] [Indexed: 05/28/2023]
Abstract
Speckles are inherently an interference phenomenon produced when an optically rough surface or a turbulent medium introduces some degree of randomness to a reflected or a transmitted electromagnetic field. Speckles are often nuisance in coherent image formation. Speckle patterns are however a useful tool for displacement and deformation as well as vibration and stress analysis. The development of speckle photography to speckle interferometry and digital holographic interferometry is described in this paper.
Collapse
Affiliation(s)
- Hans J Tiziani
- Institut fuer Technische Optik, Universität Stuttgart, Pfaffenwaldring 9, Stuttgart 70569, Germany.
| | | |
Collapse
|
49
|
Bao P, Situ G, Pedrini G, Osten W. Lensless phase microscopy using phase retrieval with multiple illumination wavelengths. Appl Opt 2012; 51:5486-5494. [PMID: 22859039 DOI: 10.1364/ao.51.005486] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/02/2012] [Accepted: 06/04/2012] [Indexed: 06/01/2023]
Abstract
A phase retrieval method for microscopy using multiple illumination wavelengths is proposed. A fast algorithm suitable for calculations with high numerical aperture is used for the iterative retrieval of the object wavefront. The advantages and limitations of the technique are systematically analyzed and demonstrated by both simulation and experimental results.
Collapse
Affiliation(s)
- Peng Bao
- Institut für Technische Optik, Universität Stuttgart, Pfaffenwaldring 9, 70569, Stuttgart, Germany. ‐stuttgart.de
| | | | | | | |
Collapse
|
50
|
Almoro PF, Waller L, Agour M, Falldorf C, Pedrini G, Osten W, Hanson SG. Enhanced deterministic phase retrieval using a partially developed speckle field. Opt Lett 2012; 37:2088-2090. [PMID: 22660130 DOI: 10.1364/ol.37.002088] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
A technique for enhanced deterministic phase retrieval using a partially developed speckle field (PDSF) and a spatial light modulator (SLM) is demonstrated experimentally. A smooth test wavefront impinges on a phase diffuser, forming a PDSF that is directed to a 4f setup. Two defocused speckle intensity measurements are recorded at the output plane corresponding to axially-propagated representations of the PDSF in the input plane. The speckle intensity measurements are then used in a conventional transport of intensity equation (TIE) to reconstruct directly the test wavefront. The PDSF in our technique increases the dynamic range of the axial intensity derivative for smooth phase objects, resulting in a more robust solution to the TIE. The SLM setup enables a fast and accurate recording of speckle intensity. Experimental results are in good agreement with those obtained using the iterative phase retrieval and digital holographic methods of wavefront reconstruction.
Collapse
Affiliation(s)
- Percival F Almoro
- National Institute of Physics, University of the Philippines, Quezon City 1101, Philippines.
| | | | | | | | | | | | | |
Collapse
|