1
|
Xiang Q, Cui G, Liao F, Shi S, Cui W, Zhao J. Non-invasive accelerated imaging through a scattering medium via multi-stage complexity guidance. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2024; 41:1070-1081. [PMID: 38856419 DOI: 10.1364/josaa.517626] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Accepted: 04/18/2024] [Indexed: 06/11/2024]
Abstract
The research of scattering imaging is of great significance to the development of various fields, but the existing scattering imaging methods are difficult to combine for the advantages of non-invasiveness, real-time imaging, and high quality. In this paper, a new, to our knowledge, scattering imaging technique is proposed that optimizes the traditional autocorrelation imaging technique by multi-stage complexity guidance and the initial acceleration module. We introduce the complexity difference index into the phase iterative recovery step for effective complexity guidance, and add the initial module based on error-reduction iteration to realize a fast startup. A series of experiments is carried out to test the performance of the new technique. The results show that the proposed technique significantly improves the scattering reconstruction speed. Meanwhile, the accuracy and clarity of the reconstructed image are significantly higher than the traditional method in terms of fast imaging. Moreover, this technique has better robustness to noise compared to the traditional autocorrelation imaging technique. The experimental code for this paper is available on GitHub.
Collapse
|
2
|
Wu T, Dong J, Gigan S. Non-invasive single-shot recovery of a point-spread function of a memory effect based scattering imaging system. OPTICS LETTERS 2020; 45:5397-5400. [PMID: 33001903 DOI: 10.1364/ol.400869] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/10/2020] [Accepted: 08/26/2020] [Indexed: 06/11/2023]
Abstract
Accessing the point-spread function (PSF) of a complex optical system is important for a variety of imaging applications. However, placing an invasive point source is often impractical, and estimating it blindly with multiple frames is slow and requires a complex nonlinear optimization. Here, we introduce a simple single-shot method to noninvasively recover the accurate PSF of an isoplanatic imaging system, in the context of multiple light scattering. Our approach is based on the reconstruction of any unknown sparse hidden object using the autocorrelation imaging technique, followed by a deconvolution with a blur kernel derived from the statistics of a speckle pattern. A deconvolution on the camera image then retrieves the accurate PSF of the system, enabling further imaging applications. We demonstrate numerically and experimentally the effectiveness of this approach compared to previous deconvolution techniques.
Collapse
|
3
|
Han W, Gao X, Fan Z, Bai L, Liu B. Long Exposure Short Pulse Synchronous Phase Lock Method for Capturing High Dynamic Surface Shape. SENSORS 2020; 20:s20092550. [PMID: 32365797 PMCID: PMC7249036 DOI: 10.3390/s20092550] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/14/2020] [Revised: 04/25/2020] [Accepted: 04/27/2020] [Indexed: 11/21/2022]
Abstract
In infrared weak target detection systems, high-frequency vibrating mirrors (VMs) are a core component. The dynamic surface shape of the VM has a direct impact on imaging quality and the optical modulation effect, so its measurement is necessary but also very difficult. Measurement of the dynamic surface shape of VMs requires a transiently acquired image series, but traditional methods cannot perform this task, as, when the VM is vibrating at a frequency of 3033 Hz, using high-speed cameras to acquire the images would result in frame rates exceeding 1.34 MFPS, which is currently technically impossible. In this paper, we propose the long exposure short pulse synchronous phase lock (LSPL) method, which can capture the dynamic surface shape using a camera working at 10 FPS. In addition, our proposed approach uses a single laser pulse and can achieve the dynamic surface shape measurement on a single frame image.
Collapse
Affiliation(s)
- Weiqiang Han
- Institute of Optics and Electronics of Chinese Academy of Sciences, Chengdu 610209, China; (X.G.); (Z.F.); (L.B.); (B.L.)
- Key Laboratory of Science and Technology on Space Optoelectronic Precision Measurement, CAS, Chengdu 610209, China
- University of Chinese Academy of Sciences, Beijing 100149, China
- Correspondence:
| | - Xiaodong Gao
- Institute of Optics and Electronics of Chinese Academy of Sciences, Chengdu 610209, China; (X.G.); (Z.F.); (L.B.); (B.L.)
- Key Laboratory of Science and Technology on Space Optoelectronic Precision Measurement, CAS, Chengdu 610209, China
- University of Chinese Academy of Sciences, Beijing 100149, China
| | - Zhenjie Fan
- Institute of Optics and Electronics of Chinese Academy of Sciences, Chengdu 610209, China; (X.G.); (Z.F.); (L.B.); (B.L.)
- Key Laboratory of Science and Technology on Space Optoelectronic Precision Measurement, CAS, Chengdu 610209, China
| | - Le Bai
- Institute of Optics and Electronics of Chinese Academy of Sciences, Chengdu 610209, China; (X.G.); (Z.F.); (L.B.); (B.L.)
- University of Chinese Academy of Sciences, Beijing 100149, China
| | - Bo Liu
- Institute of Optics and Electronics of Chinese Academy of Sciences, Chengdu 610209, China; (X.G.); (Z.F.); (L.B.); (B.L.)
- Key Laboratory of Science and Technology on Space Optoelectronic Precision Measurement, CAS, Chengdu 610209, China
- University of Chinese Academy of Sciences, Beijing 100149, China
| |
Collapse
|
4
|
Divitt S, Gardner DF, Watnik AT. Imaging around corners in the mid-infrared using speckle correlations. OPTICS EXPRESS 2020; 28:11051-11064. [PMID: 32403624 DOI: 10.1364/oe.388260] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/17/2020] [Accepted: 03/12/2020] [Indexed: 06/11/2023]
Abstract
Speckle correlation imaging offers the ability to see objects through diffusive materials and around corners. Imaging self-illuminating thermal objects in non-line-of-sight scenarios is of particular interest. Here, using bispectrum and phase retrieval methods, we demonstrate speckle correlation imaging of mid-infrared objects through diffusers and around corners at resolutions near the diffraction limit. The images agree well with those recorded by conventional cameras with line-of-sight to the same objects.
Collapse
|
5
|
Zhu X, Kumar Sahoo S, Wang D, Quoc Lam H, Anthony Surman P, Li D, Dang C. Single-shot multi-view imaging enabled by scattering lens. OPTICS EXPRESS 2019; 27:37164-37171. [PMID: 31878501 DOI: 10.1364/oe.27.037164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/10/2019] [Accepted: 11/23/2019] [Indexed: 06/10/2023]
Abstract
Imaging three-dimensional (3D) objects has been realized by methods such as binocular stereo vision and multi-view imaging. These methods, however, needs multiple cameras or multiple shots to get elemental images. In this paper, we develop a single-shot multi-view imaging technique by utilizing the natural randomness of scattering media. By exploiting the memory effect and uncorrelated point spread functions (PSF) among scattering media, we demonstrate that both stereo imaging with large disparity and up to seven-view imaging of a 3D object can be reconstructed from only one speckle pattern by deconvolution. The elemental images are consistent with 3D object projection and images taken by multi-shot imaging. Our technique provides a feasible method to capture multi-view imaging with short acquisition time and easy calibration.
Collapse
|
6
|
Gardner DF, Divitt S, Watnik AT. Ptychographic imaging of incoherently illuminated extended objects using speckle correlations. APPLIED OPTICS 2019; 58:3564-3569. [PMID: 31044855 DOI: 10.1364/ao.58.003564] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/21/2019] [Accepted: 04/08/2019] [Indexed: 06/09/2023]
Abstract
A scattering layer is usually considered an obstacle to imaging. However, using speckle correlation imaging techniques, the scattering layer effectively acts as a lens. To date, the speckle correlation imaging method has been limited to imaging sparse samples. Here, we demonstrate imaging of incoherently illuminated extended objects in transmission and around-the-corner geometries. We are able to image extended objects by constraining the illumination spot on the object and then scanning the object. A ptychography algorithm is used to reconstruct the extended object. This work demonstrates the applicability of ptychography to spatially incoherent light and enables a new method of imaging in spectral regions where there is limited choice in optics, such as the terahertz, extreme ultraviolet, and x-ray regions.
Collapse
|
7
|
Mukherjee S, Rosen J. Imaging through scattering medium by adaptive non-linear digital processing. Sci Rep 2018; 8:10517. [PMID: 30002399 PMCID: PMC6043623 DOI: 10.1038/s41598-018-28523-6] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2018] [Accepted: 06/21/2018] [Indexed: 11/09/2022] Open
Abstract
Scattering media have always posed obstacles for imaging through them. In this study, we propose a single exposure, spatially incoherent and interferenceless method capable of imaging multi-plane objects through scattering media using only a single lens and a digital camera. A point object and a resolution chart are precisely placed at the same axial location, and light scattered from them is focused onto an image sensor using a spherical lens. For both cases, intensity patterns are recorded under identical conditions using only a single camera shot. The final image is obtained by an adaptive non-linear cross-correlation between the response functions of the point object and of the resolution chart. The clear and sharp reconstructed image demonstrates the validity of the method.
Collapse
Affiliation(s)
- Saswata Mukherjee
- Department of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O. Box 653, Beer-Sheva, 8410501, Israel.
| | - Joseph Rosen
- Department of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O. Box 653, Beer-Sheva, 8410501, Israel
| |
Collapse
|
8
|
An Early Study on Imaging 3D Objects Hidden Behind Highly Scattering Media: a Round-Trip Optical Transmission Matrix Method. APPLIED SCIENCES-BASEL 2018. [DOI: 10.3390/app8071036] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
9
|
Xu X, Xie X, Thendiyammal A, Zhuang H, Xie J, Liu Y, Zhou J, Mosk AP. Imaging of objects through a thin scattering layer using a spectrally and spatially separated reference. OPTICS EXPRESS 2018; 26:15073-15083. [PMID: 30114759 DOI: 10.1364/oe.26.015073] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2018] [Accepted: 05/21/2018] [Indexed: 06/08/2023]
Abstract
Incoherently illuminated or luminescent objects give rise to a low-contrast speckle-like pattern when observed through a thin diffusive medium, as such a medium effectively convolves their shape with a speckle-like point spread function (PSF). This point spread function can be extracted in the presence of a reference object of known shape. Here it is shown that reference objects that are both spatially and spectrally separated from the object of interest can be used to obtain an approximation of the point spread function. The crucial observation, corroborated by analytical calculations, is that the spectrally shifted point spread function is strongly correlated to a spatially scaled one. With the approximate point spread function thus obtained, the speckle-like pattern is deconvolved to produce a clear and sharp image of the object on a speckle-like background of low intensity.
Collapse
|
10
|
Hofer M, Soeller C, Brasselet S, Bertolotti J. Wide field fluorescence epi-microscopy behind a scattering medium enabled by speckle correlations. OPTICS EXPRESS 2018; 26:9866-9881. [PMID: 29715932 DOI: 10.1364/oe.26.009866] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/23/2018] [Accepted: 04/02/2018] [Indexed: 06/08/2023]
Abstract
Fluorescence microscopy is widely used in biological imaging, however scattering from tissues strongly limits its applicability to a shallow depth. In this work we adapt a methodology inspired from stellar speckle interferometry, and exploit the optical memory effect to enable fluorescence microscopy through a turbid layer. We demonstrate efficient reconstruction of micrometer-size fluorescent objects behind a scattering medium in epi-microscopy, and study the specificities of this imaging modality (magnification, field of view, resolution) as compared to traditional microscopy. Using a modified phase retrieval algorithm to reconstruct fluorescent objects from speckle images, we demonstrate robust reconstructions even in relatively low signal to noise conditions. This modality is particularly appropriate for imaging in biological media, which are known to exhibit relatively large optical memory ranges compatible with tens of micrometers size field of views, and large spectral bandwidths compatible with emission fluorescence spectra of tens of nanometers widths.
Collapse
|
11
|
Diebold AV, Imani MF, Sleasman T, Smith DR. Phaseless computational ghost imaging at microwave frequencies using a dynamic metasurface aperture. APPLIED OPTICS 2018; 57:2142-2149. [PMID: 29604010 DOI: 10.1364/ao.57.002142] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/17/2017] [Accepted: 02/21/2018] [Indexed: 06/08/2023]
Abstract
We demonstrate a dynamic metasurface aperture as a unique tool for computational ghost imaging at microwave frequencies. The aperture consists of a microstrip waveguide loaded with an array of metamaterial elements, each of which couples energy from the waveguide mode to the radiation field. With a tuning mechanism introduced into each independently addressable metamaterial element, the aperture can produce diverse radiation patterns that vary as a function of tuning state. Here, we show that fields from such an aperture approximately obey speckle statistics in the radiative near field. Inspired by the analogy with optical correlation imaging, we use the dynamic aperture as a means of illuminating a scene with structured microwave radiation, receiving the backscattered intensity with a simple waveguide probe. By correlating the magnitude of the received signal with the structured intensity patterns, we demonstrate high-fidelity, phaseless imaging of sparse targets. The dynamic metasurface aperture as a novel ghost imaging structure can find application in security screening, through-wall imaging, as well as biomedical diagnostics.
Collapse
|
12
|
Mukherjee S, Vijayakumar A, Kumar M, Rosen J. 3D Imaging through Scatterers with Interferenceless Optical System. Sci Rep 2018; 8:1134. [PMID: 29348514 PMCID: PMC5773561 DOI: 10.1038/s41598-018-19344-8] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2017] [Accepted: 12/29/2017] [Indexed: 11/21/2022] Open
Abstract
Imaging through a scattering medium is a challenging task. We propose and demonstrate an interferenceless incoherent opto-digital technique for 3D imaging through a scatterer with a single lens and a digital camera. The light diffracted from a point object is modulated by a scattering mask. The modulated wavefront is projected on an image sensor using a spherical lens and the impulse response is recorded. An object is placed at the same axial location as the point object and another intensity pattern is recorded with identical experimental conditions and with the same scattering mask. The image of the object is reconstructed by a cross-correlation between a reconstructing function and the object hologram. For 3D imaging, a library of reconstructing functions are created corresponding to different axial locations. The different planes of the object are reconstructed by a cross-correlation of the object hologram with the corresponding reconstructing functions.
Collapse
Affiliation(s)
- Saswata Mukherjee
- Department of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O. Box 653, Beer-Sheva, 8410501, Israel.
| | - A Vijayakumar
- Department of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O. Box 653, Beer-Sheva, 8410501, Israel
| | - Manoj Kumar
- Department of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O. Box 653, Beer-Sheva, 8410501, Israel
| | - Joseph Rosen
- Department of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O. Box 653, Beer-Sheva, 8410501, Israel
| |
Collapse
|