1
|
Mahmoud A, El-Sharkawy YH. Multi-wavelength interference phase imaging for automatic breast cancer detection and delineation using diffuse reflection imaging. Sci Rep 2024; 14:415. [PMID: 38172105 PMCID: PMC10764793 DOI: 10.1038/s41598-023-50475-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2023] [Accepted: 12/20/2023] [Indexed: 01/05/2024] Open
Abstract
Millions of women globally are impacted by the major health problem of breast cancer (BC). Early detection of BC is critical for successful treatment and improved survival rates. In this study, we provide a progressive approach for BC detection using multi-wavelength interference (MWI) phase imaging based on diffuse reflection hyperspectral (HS) imaging. The proposed findings are based on the measurement of the interference pattern between the blue (446.6 nm) and red (632 nm) wavelengths. We consider implementing a comprehensive image processing and categorization method based on the use of Fast Fourier (FF) transform analysis pertaining to a change in the refractive index between tumor and normal tissue. We observed that cancer growth affects tissue organization dramatically, as seen by persistently increased refractive index variance in tumors compared normal areas. Both malignant and normal tissue had different depth data collected from it that was analyzed. To enhance the categorization of ex-vivo BC tissue, we developed and validated a training classifier algorithm specifically designed for categorizing HS cube data. Following the application of signal normalization with the FF transform algorithm, our methodology achieved a high level of performance with a specificity (Spec) of 94% and a sensitivity (Sen) of 90.9% for the 632 nm acquired image categorization, based on preliminary findings from breast specimens under investigation. Notably, we successfully leveraged unstained tissue samples to create 3D phase-resolved images that effectively highlight the distinctions in diffuse reflectance features between cancerous and healthy tissue. Preliminary data revealed that our imaging method might be able to assist specialists in safely excising malignant areas and assessing the tumor bed following resection automatically at different depths. This preliminary investigation might result in an effective "in-vivo" disease description utilizing optical technology using a typical RGB camera with wavelength-specific operation with our quantitative phase MWI imaging methodology.
Collapse
Affiliation(s)
- Alaaeldin Mahmoud
- Optoelectronics and Automatic Control Systems Department, Military Technical College, Kobry El-Kobba, Cairo, Egypt.
| | - Yasser H El-Sharkawy
- Optoelectronics and Automatic Control Systems Department, Military Technical College, Kobry El-Kobba, Cairo, Egypt
| |
Collapse
|
2
|
Wang T, Jiang S, Song P, Wang R, Yang L, Zhang T, Zheng G. Optical ptychography for biomedical imaging: recent progress and future directions [Invited]. BIOMEDICAL OPTICS EXPRESS 2023; 14:489-532. [PMID: 36874495 PMCID: PMC9979669 DOI: 10.1364/boe.480685] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/10/2022] [Revised: 12/10/2022] [Accepted: 12/10/2022] [Indexed: 05/25/2023]
Abstract
Ptychography is an enabling microscopy technique for both fundamental and applied sciences. In the past decade, it has become an indispensable imaging tool in most X-ray synchrotrons and national laboratories worldwide. However, ptychography's limited resolution and throughput in the visible light regime have prevented its wide adoption in biomedical research. Recent developments in this technique have resolved these issues and offer turnkey solutions for high-throughput optical imaging with minimum hardware modifications. The demonstrated imaging throughput is now greater than that of a high-end whole slide scanner. In this review, we discuss the basic principle of ptychography and summarize the main milestones of its development. Different ptychographic implementations are categorized into four groups based on their lensless/lens-based configurations and coded-illumination/coded-detection operations. We also highlight the related biomedical applications, including digital pathology, drug screening, urinalysis, blood analysis, cytometric analysis, rare cell screening, cell culture monitoring, cell and tissue imaging in 2D and 3D, polarimetric analysis, among others. Ptychography for high-throughput optical imaging, currently in its early stages, will continue to improve in performance and expand in its applications. We conclude this review article by pointing out several directions for its future development.
Collapse
Affiliation(s)
- Tianbo Wang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
- These authors contributed equally to this work
| | - Shaowei Jiang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
- These authors contributed equally to this work
| | - Pengming Song
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
- These authors contributed equally to this work
| | - Ruihai Wang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
| | - Liming Yang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
| | - Terrance Zhang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
| | - Guoan Zheng
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
| |
Collapse
|
3
|
Muneta H, Horisaki R, Nishizaki Y, Naruse M, Tanida J. Single-shot blind deconvolution with coded aperture. APPLIED OPTICS 2022; 61:6408-6413. [PMID: 36255897 DOI: 10.1364/ao.460763] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Accepted: 06/28/2022] [Indexed: 06/16/2023]
Abstract
In this paper, we present a method for single-shot blind deconvolution incorporating a coded aperture (CA). In this method, we utilize the CA, inserted on the pupil plane, as support constraints in blind deconvolution. Not only an object is estimated, but also a point spread function of turbulence from a single captured image by a reconstruction algorithm with CA support. The proposed method is demonstrated by simulation and an experiment in which point sources are recovered under severe turbulence.
Collapse
|
4
|
Baek Y, Hugonnet H, Park Y. Pupil-aberration calibration with controlled illumination for quantitative phase imaging. OPTICS EXPRESS 2021; 29:22127-22135. [PMID: 34265984 DOI: 10.1364/oe.426080] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/24/2021] [Accepted: 06/09/2021] [Indexed: 06/13/2023]
Abstract
Quantitative phase imaging (QPI) exploits sample-induced changes in the optical field to analyze biological specimens in a label-free manner. However, the quantitative nature of QPI makes it susceptible to optical aberrations. We propose a method for calibrating pupil aberrations by imaging a sample of interest. The proposed method recovers pupil information by utilizing the cross-spectral density between optical fields at different incident angles and allows both thin and weakly scattering three-dimensional samples for calibration. We experimentally validate the proposed method by imaging various samples, including a resolution target, breast tissue, and a polystyrene bead, and demonstrate aberration-free two- and three-dimensional QPI.
Collapse
|
5
|
Park J, Brady DJ, Zheng G, Tian L, Gao L. Review of bio-optical imaging systems with a high space-bandwidth product. ADVANCED PHOTONICS 2021; 3:044001. [PMID: 35178513 PMCID: PMC8849623 DOI: 10.1117/1.ap.3.4.044001] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
Optical imaging has served as a primary method to collect information about biosystems across scales-from functionalities of tissues to morphological structures of cells and even at biomolecular levels. However, to adequately characterize a complex biosystem, an imaging system with a number of resolvable points, referred to as a space-bandwidth product (SBP), in excess of one billion is typically needed. Since a gigapixel-scale far exceeds the capacity of current optical imagers, compromises must be made to obtain either a low spatial resolution or a narrow field-of-view (FOV). The problem originates from constituent refractive optics-the larger the aperture, the more challenging the correction of lens aberrations. Therefore, it is impractical for a conventional optical imaging system to achieve an SBP over hundreds of millions. To address this unmet need, a variety of high-SBP imagers have emerged over the past decade, enabling an unprecedented resolution and FOV beyond the limit of conventional optics. We provide a comprehensive survey of high-SBP imaging techniques, exploring their underlying principles and applications in bioimaging.
Collapse
Affiliation(s)
- Jongchan Park
- University of California, Department of Bioengineering, Los Angeles, California, United States
| | - David J. Brady
- University of Arizona, James C. Wyant College of Optical Sciences, Tucson, Arizona, United States
| | - Guoan Zheng
- University of Connecticut, Department of Biomedical Engineering, Storrs, Connecticut, United States
- University of Connecticut, Department of Electrical and Computer Engineering, Storrs, Connecticut, United States
| | - Lei Tian
- Boston University, Department of Electrical and Computer Engineering, Boston, Massachusetts, United States
| | - Liang Gao
- University of California, Department of Bioengineering, Los Angeles, California, United States
| |
Collapse
|
6
|
Konda PC, Loetgering L, Zhou KC, Xu S, Harvey AR, Horstmeyer R. Fourier ptychography: current applications and future promises. OPTICS EXPRESS 2020; 28:9603-9630. [PMID: 32225565 DOI: 10.1364/oe.386168] [Citation(s) in RCA: 49] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Accepted: 01/30/2020] [Indexed: 05/18/2023]
Abstract
Traditional imaging systems exhibit a well-known trade-off between the resolution and the field of view of their captured images. Typical cameras and microscopes can either "zoom in" and image at high-resolution, or they can "zoom out" to see a larger area at lower resolution, but can rarely achieve both effects simultaneously. In this review, we present details about a relatively new procedure termed Fourier ptychography (FP), which addresses the above trade-off to produce gigapixel-scale images without requiring any moving parts. To accomplish this, FP captures multiple low-resolution, large field-of-view images and computationally combines them in the Fourier domain into a high-resolution, large field-of-view result. Here, we present details about the various implementations of FP and highlight its demonstrated advantages to date, such as aberration recovery, phase imaging, and 3D tomographic reconstruction, to name a few. After providing some basics about FP, we list important details for successful experimental implementation, discuss its relationship with other computational imaging techniques, and point to the latest advances in the field while highlighting persisting challenges.
Collapse
|
7
|
Shen C, Chan ACS, Chung J, Williams DE, Hajimiri A, Yang C. Computational aberration correction of VIS-NIR multispectral imaging microscopy based on Fourier ptychography. OPTICS EXPRESS 2019; 27:24923-24937. [PMID: 31510373 DOI: 10.1364/oe.27.024923] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/04/2019] [Accepted: 08/05/2019] [Indexed: 06/10/2023]
Abstract
Due to the chromatic dispersion properties inherent in all optical materials, even the best-designed multispectral objective will exhibit residual chromatic aberration. Here, we demonstrate a multispectral microscope with a computational scheme based on the Fourier ptychographic microscopy (FPM) to correct these effects in order to render undistorted, in-focus images. The microscope consists of 4 spectral channels ranging from 405 nm to 1552 nm. After the computational aberration correction, it can achieve isotropic resolution enhancement as verified with the Siemens star sample. We image a flip-chip to show the promise of our system to conduct fault detection on silicon chips. This computational approach provides a cost-efficient strategy for high quality multispectral imaging over a broad spectral range.
Collapse
|
8
|
Chan ACS, Kim J, Pan A, Xu H, Nojima D, Hale C, Wang S, Yang C. Parallel Fourier ptychographic microscopy for high-throughput screening with 96 cameras (96 Eyes). Sci Rep 2019; 9:11114. [PMID: 31366957 PMCID: PMC6668459 DOI: 10.1038/s41598-019-47146-z] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2019] [Accepted: 07/11/2019] [Indexed: 11/23/2022] Open
Abstract
We report the implementation of a parallel microscopy system (96 Eyes) that is capable of simultaneous imaging of all wells on a 96-well plate. The optical system consists of 96 microscopy units, where each unit is made out of a four element objective, made through a molded injection process, and a low cost CMOS camera chip. By illuminating the sample with angle varying light and applying Fourier Ptychography, we can improve the effective brightfield imaging numerical aperture of the objectives from 0.23 to 0.3, and extend the depth of field from ±5 μm to ±15 μm. The use of Fourier Ptychography additionally allows us to computationally correct the objectives’ aberrations out of the rendered images, and provides us with the ability to render phase images. The 96 Eyes acquires raw data at a rate of 0.7 frame per second (all wells) and the data are processed with 4 cores of graphical processing units (GPUs; GK210, Nvidia Tesla K80, USA). The system is also capable of fluorescence imaging (excitation = 465 nm, emission = 510 nm) at the native resolution of the objectives. We demonstrate the capability of this system by imaging S1P1-eGFP-Human bone osteosarcoma epithelial (U2OS) cells.
Collapse
Affiliation(s)
- Antony C S Chan
- Division of Engineering & Applied Science, California Institute of Technology, 1200 E California Blvd, Pasadena, CA, 91125, USA
| | - Jinho Kim
- Division of Engineering & Applied Science, California Institute of Technology, 1200 E California Blvd, Pasadena, CA, 91125, USA.,Samsung Engineering, 26 Sangil-ro 6-gil, Gangdong-gu, Seoul, Korea
| | - An Pan
- Division of Engineering & Applied Science, California Institute of Technology, 1200 E California Blvd, Pasadena, CA, 91125, USA.,State Key Laboratory of Transient Optics and Photonics, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an, 710119, China
| | - Han Xu
- Amgen South San Francisco, 1120 Veterans Blvd, South San Francisco, CA, 94080, USA.,A2 Biotherapeutics, 2260 Townsgate Rd, Westlask Village, CA, 91361, USA
| | - Dana Nojima
- Amgen South San Francisco, 1120 Veterans Blvd, South San Francisco, CA, 94080, USA.,Merck, 630 Gateway Blvd, South San Francisco, CA, 94080, USA
| | - Christopher Hale
- Amgen South San Francisco, 1120 Veterans Blvd, South San Francisco, CA, 94080, USA
| | - Songli Wang
- Amgen South San Francisco, 1120 Veterans Blvd, South San Francisco, CA, 94080, USA
| | - Changhuei Yang
- Division of Engineering & Applied Science, California Institute of Technology, 1200 E California Blvd, Pasadena, CA, 91125, USA.
| |
Collapse
|
9
|
Aidukas T, Konda PC, Harvey AR, Padgett MJ, Moreau PA. Phase and amplitude imaging with quantum correlations through Fourier Ptychography. Sci Rep 2019; 9:10445. [PMID: 31320691 PMCID: PMC6639395 DOI: 10.1038/s41598-019-46273-x] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2019] [Accepted: 06/21/2019] [Indexed: 11/09/2022] Open
Abstract
Extracting as much information as possible about an object when probing with a limited number of photons is an important goal with applications from biology and security to metrology. Imaging with a few photons is a challenging task as the detector noise and stray light are then predominant, which precludes the use of conventional imaging methods. Quantum correlations between photon pairs has been exploited in a so called ‘heralded imaging scheme’ to eliminate this problem. However these implementations have so-far been limited to intensity imaging and the crucial phase information is lost in these methods. In this work, we propose a novel quantum-correlation enabled Fourier Ptychography technique, to capture high-resolution amplitude and phase images with a few photons. This is enabled by the heralding of single photons combined with Fourier ptychographic reconstruction. We provide experimental validation and discuss the advantages of our technique that include the possibility of reaching a higher signal to noise ratio and non-scanning Fourier Ptychographic acquisition.
Collapse
Affiliation(s)
- Tomas Aidukas
- School of Physics and Astronomy, University of Glasgow, Glasgow, G12 8QQ, UK
| | - Pavan Chandra Konda
- School of Physics and Astronomy, University of Glasgow, Glasgow, G12 8QQ, UK
| | - Andrew R Harvey
- School of Physics and Astronomy, University of Glasgow, Glasgow, G12 8QQ, UK
| | - Miles J Padgett
- School of Physics and Astronomy, University of Glasgow, Glasgow, G12 8QQ, UK
| | - Paul-Antoine Moreau
- School of Physics and Astronomy, University of Glasgow, Glasgow, G12 8QQ, UK.
| |
Collapse
|
10
|
Chung J, Martinez GW, Lencioni KC, Sadda SR, Yang C. Computational aberration compensation by coded-aperture-based correction of aberration obtained from optical Fourier coding and blur estimation. OPTICA 2019; 6:647-661. [PMID: 33134437 PMCID: PMC7597901 DOI: 10.1364/optica.6.000647] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
We report a novel generalized optical measurement system and computational approach to determine and correct aberrations in optical systems. The system consists of a computational imaging method capable of reconstructing an optical system's pupil function by adapting overlapped Fourier coding to an incoherent imaging modality. It recovers the high-resolution image latent in an aberrated image via deconvolution. The deconvolution is made robust to noise by using coded apertures to capture images. We term this method coded-aperture-based correction of aberration obtained from overlapped Fourier coding and blur estimation (CACAO-FB). It is well-suited for various imaging scenarios where aberration is present and where providing a spatially coherent illumination is very challenging or impossible. We report the demonstration of CACAO-FB with a variety of samples including an in vivo imaging experiment on the eye of a rhesus macaque to correct for its inherent aberration in the rendered retinal images. CACAO-FB ultimately allows for an aberrated imaging system to achieve diffraction-limited performance over a wide field of view by casting optical design complexity to computational algorithms in post-processing.
Collapse
Affiliation(s)
- Jaebum Chung
- Department of Electrical Engineering, California Institute of Technology, Pasadena, California 91125, USA
- Corresponding author:
| | - Gloria W. Martinez
- Office of Laboratory Animal Resources, California Institute of Technology, Pasadena, California 91125, USA
| | - Karen C. Lencioni
- Office of Laboratory Animal Resources, California Institute of Technology, Pasadena, California 91125, USA
| | - Srinivas R. Sadda
- Doheny Eye Institute, University of California-Los Angeles, Los Angeles, California 90033, USA
| | - Changhuei Yang
- Department of Electrical Engineering, California Institute of Technology, Pasadena, California 91125, USA
| |
Collapse
|
11
|
Doelman R, Verhaegen M. Convex optimization-based blind deconvolution for images taken with coherent illumination. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2019; 36:678-685. [PMID: 31044991 DOI: 10.1364/josaa.36.000678] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/07/2018] [Accepted: 03/04/2019] [Indexed: 06/09/2023]
Abstract
A rank-constrained reformulation of the blind deconvolution problem on images taken with coherent illumination is proposed. Since in the reformulation the rank constraint is imposed on a matrix that is affine in the decision variables, we propose a novel convex heuristic for the blind deconvolution problem. The proposed heuristic allows for easy incorporation of prior information on the decision variables and the use of the phase diversity concept. The convex optimization problem can be iteratively re-parameterized to obtain better estimates. The proposed methods are demonstrated on numerically illustrative examples.
Collapse
|
12
|
Chen M, Phillips ZF, Waller L. Quantitative differential phase contrast (DPC) microscopy with computational aberration correction. OPTICS EXPRESS 2018; 26:32888-32899. [PMID: 30645449 DOI: 10.1364/oe.26.032888] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
Differential Phase Contrast (DPC) microscopy is a practical method for recovering quantitative phase from intensity images captured with different source patterns in an LED array microscope. Being a partially coherent imaging method, DPC does not suffer from speckle artifacts and achieves 2× better resolution than coherent methods. Like all imaging systems, however, DPC is susceptible to aberrations. Here, we propose a method of algorithmic self-calibration for DPC where we simultaneously recover the complex-field of the sample and the spatially-variant aberrations of the system, using 4 images with different illumination source patterns. The resulting phase reconstructions are digitally aberration-corrected.
Collapse
|
13
|
He X, Liu C, Zhu J. Single-shot aperture-scanning Fourier ptychography. OPTICS EXPRESS 2018; 26:28187-28196. [PMID: 30469994 DOI: 10.1364/oe.26.028187] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/15/2018] [Accepted: 09/28/2018] [Indexed: 06/09/2023]
Abstract
Aperture-scanning Fourier ptychography [Opt. Express22, 13586 (2014)] is a promising non-interferometric wavefront measurement technique. It eliminates the thin-sample requirement in typical Fourier ptychography employing angle-varying illumination. However, as aperture-scanning Fourier ptychography is based on step-by-step scanning, it requires long data acquisition time and a high-stability optical system. In this paper, we propose a single-shot aperture-scanning Fourier ptychography method. In our method, multiple low-resolution images are collected in a single shot by inserting a Dammann grating at a certain distance before the aperture, and the images are subsequently converted to a high-resolution complex wavefront. Compared with scanning-based aperture-scanning Fourier ptychography, the total acquisition time of the proposed method is dramatically reduced. The feasibility of our proposed method is demonstrated by proof-of-concept experiments.
Collapse
|
14
|
Eckert R, Phillips ZF, Waller L. Efficient illumination angle self-calibration in Fourier ptychography. APPLIED OPTICS 2018; 57:5434-5442. [PMID: 30117837 DOI: 10.1364/ao.57.005434] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
Fourier ptychography captures intensity images with varying source patterns (illumination angles) in order to computationally reconstruct large space-bandwidth-product images. Accurate knowledge of the illumination angles is necessary for good image quality; hence, calibration methods are crucial, despite often being impractical or slow. Here, we propose a fast, robust, and accurate self-calibration algorithm that uses only experimentally collected data and general knowledge of the illumination setup. First, our algorithm makes a fast direct estimate of the brightfield illumination angles based on image processing. Then, a more computationally intensive spectral correlation method is used inside the iterative solver to further refine the angle estimates of both brightfield and darkfield images. We demonstrate our method for correcting large and small misalignment artifacts in 2D and 3D Fourier ptychography with different source types: an LED array, a galvo-steered laser, and a high-NA quasi-dome LED illuminator.
Collapse
|
15
|
Holloway J, Wu Y, Sharma MK, Cossairt O, Veeraraghavan A. SAVI: Synthetic apertures for long-range, subdiffraction-limited visible imaging using Fourier ptychography. SCIENCE ADVANCES 2017; 3:e1602564. [PMID: 28439550 PMCID: PMC5392025 DOI: 10.1126/sciadv.1602564] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/18/2016] [Accepted: 02/17/2017] [Indexed: 05/05/2023]
Abstract
Synthetic aperture radar is a well-known technique for improving resolution in radio imaging. Extending these synthetic aperture techniques to the visible light domain is not straightforward because optical receivers cannot measure phase information. We propose to use macroscopic Fourier ptychography (FP) as a practical means of creating a synthetic aperture for visible imaging to achieve subdiffraction-limited resolution. We demonstrate the first working prototype for macroscopic FP in a reflection imaging geometry that is capable of imaging optically rough objects. In addition, a novel image space denoising regularization is introduced during phase retrieval to reduce the effects of speckle and improve perceptual quality of the recovered high-resolution image. Our approach is validated experimentally where the resolution of various diffuse objects is improved sixfold.
Collapse
Affiliation(s)
- Jason Holloway
- Department of Electrical and Computer Engineering, Rice University, 6100 Main Street, Houston, TX 77005, USA
| | - Yicheng Wu
- Department of Electrical and Computer Engineering, Rice University, 6100 Main Street, Houston, TX 77005, USA
| | - Manoj K. Sharma
- Department of Electrical Engineering and Computer Science, Northwestern University, 2145 Sheridan Road, Evanston, IL 60208, USA
| | - Oliver Cossairt
- Department of Electrical Engineering and Computer Science, Northwestern University, 2145 Sheridan Road, Evanston, IL 60208, USA
| | - Ashok Veeraraghavan
- Department of Electrical and Computer Engineering, Rice University, 6100 Main Street, Houston, TX 77005, USA
| |
Collapse
|
16
|
Chung J, Lu H, Ou X, Zhou H, Yang C. Wide-field Fourier ptychographic microscopy using laser illumination source. BIOMEDICAL OPTICS EXPRESS 2016; 7:4787-4802. [PMID: 27896016 PMCID: PMC5119616 DOI: 10.1364/boe.7.004787] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/05/2016] [Revised: 10/10/2016] [Accepted: 10/25/2016] [Indexed: 05/21/2023]
Abstract
Fourier ptychographic (FP) microscopy is a coherent imaging method that can synthesize an image with a higher bandwidth using multiple low-bandwidth images captured at different spatial frequency regions. The method's demand for multiple images drives the need for a brighter illumination scheme and a high-frame-rate camera for a faster acquisition. We report the use of a guided laser beam as an illumination source for an FP microscope. It uses a mirror array and a 2-dimensional scanning Galvo mirror system to provide a sample with plane-wave illuminations at diverse incidence angles. The use of a laser presents speckles in the image capturing process due to reflections between glass surfaces in the system. They appear as slowly varying background fluctuations in the final reconstructed image. We are able to mitigate these artifacts by including a phase image obtained by differential phase contrast (DPC) deconvolution in the FP algorithm. We use a 1-Watt laser configured to provide a collimated beam with 150 mW of power and beam diameter of 1 cm to allow for the total capturing time of 0.96 seconds for 96 raw FPM input images in our system, with the camera sensor's frame rate being the bottleneck for speed. We demonstrate a factor of 4 resolution improvement using a 0.1 NA objective lens over the full camera field-of-view of 2.7 mm by 1.5 mm.
Collapse
Affiliation(s)
- Jaebum Chung
- Department of Electrical Engineering, California Institute of Technology, Pasadena, California, 91125,
USA
| | - Hangwen Lu
- Department of Electrical Engineering, California Institute of Technology, Pasadena, California, 91125,
USA
| | - Xiaoze Ou
- Department of Electrical Engineering, California Institute of Technology, Pasadena, California, 91125,
USA
| | - Haojiang Zhou
- Department of Electrical Engineering, California Institute of Technology, Pasadena, California, 91125,
USA
| | - Changhuei Yang
- Department of Electrical Engineering, California Institute of Technology, Pasadena, California, 91125,
USA
| |
Collapse
|
17
|
Lu H, Chung J, Ou X, Yang C. Quantitative phase imaging and complex field reconstruction by pupil modulation differential phase contrast. OPTICS EXPRESS 2016; 24:25345-25361. [PMID: 27828473 PMCID: PMC5234501 DOI: 10.1364/oe.24.025345] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
Differential phase contrast (DPC) is a non-interferometric quantitative phase imaging method achieved by using an asymmetric imaging procedure. We report a pupil modulation differential phase contrast (PMDPC) imaging method by filtering a sample's Fourier domain with half-circle pupils. A phase gradient image is captured with each half-circle pupil, and a quantitative high resolution phase image is obtained after a deconvolution process with a minimum of two phase gradient images. Here, we introduce PMDPC quantitative phase image reconstruction algorithm and realize it experimentally in a 4f system with an SLM placed at the pupil plane. In our current experimental setup with the numerical aperture of 0.36, we obtain a quantitative phase image with a resolution of 1.73μm after computationally removing system aberrations and refocusing. We also extend the depth of field digitally by 20 times to ±50μm with a resolution of 1.76μm.
Collapse
|
18
|
Ou X, Chung J, Horstmeyer R, Yang C. Aperture scanning Fourier ptychographic microscopy. BIOMEDICAL OPTICS EXPRESS 2016; 7:3140-50. [PMID: 27570705 PMCID: PMC4986821 DOI: 10.1364/boe.7.003140] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/20/2016] [Revised: 06/23/2016] [Accepted: 07/17/2016] [Indexed: 05/05/2023]
Abstract
Fourier ptychographic microscopy (FPM) is implemented through aperture scanning by an LCOS spatial light modulator at the back focal plane of the objective lens. This FPM configuration enables the capturing of the complex scattered field for a 3D sample both in the transmissive mode and the reflective mode. We further show that by combining with the compressive sensing theory, the reconstructed 2D complex scattered field can be used to recover the 3D sample scattering density. This implementation expands the scope of application for FPM and can be beneficial for areas such as tissue imaging and wafer inspection.
Collapse
|
19
|
Moore DB, Fienup JR. Ptychography for optical metrology with limited translation knowledge. APPLIED OPTICS 2016; 55:4596-4610. [PMID: 27409017 DOI: 10.1364/ao.55.004596] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
We introduce unknown-transverse translation diversity phase retrieval: a ptychographic algorithm for optical metrology when a subaperture is translating through a plane conjugate to the exit pupil in a very poorly known fashion. The algorithm estimates the direction of translation and the distance traveled by the subaperture from one point spread function (PSF) to the next. It also estimates unknown point target motion and rotations of the subaperture between PSF acquisitions from the PSF data.
Collapse
|
20
|
Yeh LH, Dong J, Zhong J, Tian L, Chen M, Tang G, Soltanolkotabi M, Waller L. Experimental robustness of Fourier ptychography phase retrieval algorithms. OPTICS EXPRESS 2015; 23:33214-40. [PMID: 26831989 DOI: 10.1364/oe.23.033214] [Citation(s) in RCA: 100] [Impact Index Per Article: 11.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
Abstract
Fourier ptychography is a new computational microscopy technique that provides gigapixel-scale intensity and phase images with both wide field-of-view and high resolution. By capturing a stack of low-resolution images under different illumination angles, an inverse algorithm can be used to computationally reconstruct the high-resolution complex field. Here, we compare and classify multiple proposed inverse algorithms in terms of experimental robustness. We find that the main sources of error are noise, aberrations and mis-calibration (i.e. model mis-match). Using simulations and experiments, we demonstrate that the choice of cost function plays a critical role, with amplitude-based cost functions performing better than intensity-based ones. The reason for this is that Fourier ptychography datasets consist of images from both brightfield and darkfield illumination, representing a large range of measured intensities. Both noise (e.g. Poisson noise) and model mis-match errors are shown to scale with intensity. Hence, algorithms that use an appropriate cost function will be more tolerant to both noise and model mis-match. Given these insights, we propose a global Newton's method algorithm which is robust and accurate. Finally, we discuss the impact of procedures for algorithmic correction of aberrations and mis-calibration.
Collapse
|
21
|
Li P, Batey DJ, Edo TB, Rodenburg JM. Separation of three-dimensional scattering effects in tilt-series Fourier ptychography. Ultramicroscopy 2015; 158:1-7. [DOI: 10.1016/j.ultramic.2015.06.010] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2015] [Revised: 06/09/2015] [Accepted: 06/11/2015] [Indexed: 10/23/2022]
|
22
|
Horstmeyer R, Chen RY, Ou X, Ames B, Tropp JA, Yang C. Solving ptychography with a convex relaxation. NEW JOURNAL OF PHYSICS 2015; 17:053044. [PMID: 26146480 PMCID: PMC4486359 DOI: 10.1088/1367-2630/17/5/053044] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
Abstract
Ptychography is a powerful computational imaging technique that transforms a collection of low-resolution images into a high-resolution sample reconstruction. Unfortunately, algorithms that currently solve this reconstruction problem lack stability, robustness, and theoretical guarantees. Recently, convex optimization algorithms have improved the accuracy and reliability of several related reconstruction efforts. This paper proposes a convex formulation of the ptychography problem. This formulation has no local minima, it can be solved using a wide range of algorithms, it can incorporate appropriate noise models, and it can include multiple a priori constraints. The paper considers a specific algorithm, based on low-rank factorization, whose runtime and memory usage are near-linear in the size of the output image. Experiments demonstrate that this approach offers a 25% lower background variance on average than alternating projections, the ptychographic reconstruction algorithm that is currently in widespread use.
Collapse
Affiliation(s)
- Roarke Horstmeyer
- Department of Electrical Engineering, California Institute of Technology, Pasadena, CA 91125, USA
| | - Richard Y Chen
- Department of Computing and Mathematical Sciences, California Institute of Technology, Pasadena, CA 91125, USA
| | - Xiaoze Ou
- Department of Electrical Engineering, California Institute of Technology, Pasadena, CA 91125, USA
| | - Brendan Ames
- Department of Mathematics, University of Alabama, Tuscaloosa, AL 35487, USA
| | - Joel A Tropp
- Department of Computing and Mathematical Sciences, California Institute of Technology, Pasadena, CA 91125, USA
| | - Changhuei Yang
- Department of Electrical Engineering, California Institute of Technology, Pasadena, CA 91125, USA
| |
Collapse
|
23
|
Guo K, Bian Z, Dong S, Nanda P, Wang YM, Zheng G. Microscopy illumination engineering using a low-cost liquid crystal display. BIOMEDICAL OPTICS EXPRESS 2015; 6:574-9. [PMID: 25780746 PMCID: PMC4354584 DOI: 10.1364/boe.6.000574] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/25/2014] [Revised: 01/02/2015] [Accepted: 01/03/2015] [Indexed: 05/05/2023]
Abstract
Illumination engineering is critical for obtaining high-resolution, high-quality images in microscope settings. In a typical microscope, the condenser lens provides sample illumination that is uniform and free from glare. The associated condenser diaphragm can be manually adjusted to obtain the optimal illumination numerical aperture. In this paper, we report a programmable condenser lens for active illumination control. In our prototype setup, we used a $15 liquid crystal display as a transparent spatial light modulator and placed it at the back focal plane of the condenser lens. By setting different binary patterns on the display, we can actively control the illumination and the spatial coherence of the microscope platform. We demonstrated the use of such a simple scheme for multimodal imaging, including bright-field microscopy, darkfield microscopy, phase-contrast microscopy, polarization microscopy, 3D tomographic imaging, and super-resolution Fourier ptychographic imaging. The reported illumination engineering scheme is cost-effective and compatible with most existing platforms. It enables a turnkey solution with high flexibility for researchers in various communities. From the engineering point-of-view, the reported illumination scheme may also provide new insights for the development of multimodal microscopy and Fourier ptychographic imaging.
Collapse
Affiliation(s)
- Kaikai Guo
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269,
USA
- Equal contribution
| | - Zichao Bian
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269,
USA
- Equal contribution
| | - Siyuan Dong
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269,
USA
| | - Pariksheet Nanda
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269,
USA
| | - Ying Min Wang
- Institute of Materials Research and Engineering, A*STAR, 3 Research Link, 117602
Singapore
| | - Guoan Zheng
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269,
USA
- Electrical and Computer Engineering, University of Connecticut, Storrs, CT, 06269,
USA
| |
Collapse
|