1
|
Wang Z, Huang M, Qian L, Sun Y, Lu X, Zhao W, Zhang Z, Wang G, Zhao Y. Near-Space Wide-Area and High-Resolution Imaging System Design and Implementation. SENSORS (BASEL, SWITZERLAND) 2023; 23:6454. [PMID: 37514749 PMCID: PMC10385843 DOI: 10.3390/s23146454] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 07/04/2023] [Accepted: 07/05/2023] [Indexed: 07/30/2023]
Abstract
The near-space atmosphere is thin, and the atmospheric refraction and scattering on optical observation is very small, making it very suitable for wide-area and high-resolution surveillance using high-altitude balloon platforms. This paper adopts a 9344 × 7000 CMOS sensor to obtain high-resolution images, generating large-field-of-view imaging through the swing scanning of the photoelectric sphere and image stitching. In addition, a zoom lens is designed to achieve flexible applications for different scenarios, such as large-field-of-view and high-resolution imaging. The optical design results show that the camera system has good imaging quality within the focal length range of 320 mm-106.7 mm, and the relative distortion values at different focal lengths are less than 2%. The flight results indicate that the system can achieve seamless image stitching at a resolution of 0.2 m@20 km and the imaging field of view angle exceeds 33°. This system will perform other near-space flight experiments to verify its ultra-wide (field of view exceeding 100°) high-resolution imaging application.
Collapse
Affiliation(s)
- Zhanchao Wang
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China
- Key Laboratory of Computational Optical Imaging Technology, Chinese Academy of Sciences, Beijing 100094, China
| | - Min Huang
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China
- Key Laboratory of Computational Optical Imaging Technology, Chinese Academy of Sciences, Beijing 100094, China
- School of Optoelectronics, University of Chinese Academy of Sciences, Beijing 100094, China
| | - Lulu Qian
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China
- Key Laboratory of Computational Optical Imaging Technology, Chinese Academy of Sciences, Beijing 100094, China
- School of Optoelectronics, University of Chinese Academy of Sciences, Beijing 100094, China
| | - Yan Sun
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China
- Key Laboratory of Computational Optical Imaging Technology, Chinese Academy of Sciences, Beijing 100094, China
| | - Xiangning Lu
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China
- Key Laboratory of Computational Optical Imaging Technology, Chinese Academy of Sciences, Beijing 100094, China
| | - Wenhao Zhao
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China
- Key Laboratory of Computational Optical Imaging Technology, Chinese Academy of Sciences, Beijing 100094, China
| | - Zixuan Zhang
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China
- Key Laboratory of Computational Optical Imaging Technology, Chinese Academy of Sciences, Beijing 100094, China
| | - Guangming Wang
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China
- Key Laboratory of Computational Optical Imaging Technology, Chinese Academy of Sciences, Beijing 100094, China
| | - Yixin Zhao
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China
- Key Laboratory of Computational Optical Imaging Technology, Chinese Academy of Sciences, Beijing 100094, China
| |
Collapse
|
2
|
Yang X, Harfouche M, Zhou KC, Kreiss L, Xu S, Chandra Konda P, Kim K, Horstmeyer R. Multi-modal imaging using a cascaded microscope design. OPTICS LETTERS 2023; 48:1658-1661. [PMID: 37221734 DOI: 10.1364/ol.471380] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Accepted: 01/13/2023] [Indexed: 05/25/2023]
Abstract
We present a multi-modal fiber array snapshot technique (M-FAST) based on an array of 96 compact cameras placed behind a primary objective lens and a fiber bundle array. Our technique is capable of large-area, high-resolution, multi-channel video acquisition. The proposed design provides two key improvements to prior cascaded imaging system approaches: a novel optical arrangement that accommodates the use of planar camera arrays, and a new ability to acquire multi-modal image data acquisition. M-FAST is a multi-modal, scalable imaging system that can acquire snapshot dual-channel fluorescence images as well as differential phase contrast measurements over a large 6.59 mm × 9.74 mm field-of-view at 2.2-μm center full-pitch resolution.
Collapse
|
3
|
Patel A, Balis UGJ, Cheng J, Li Z, Lujan G, McClintock DS, Pantanowitz L, Parwani A. Contemporary Whole Slide Imaging Devices and Their Applications within the Modern Pathology Department: A Selected Hardware Review. J Pathol Inform 2021; 12:50. [PMID: 35070479 PMCID: PMC8721869 DOI: 10.4103/jpi.jpi_66_21] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2021] [Accepted: 09/22/2021] [Indexed: 12/21/2022] Open
Abstract
Digital pathology (DP) has disrupted the practice of traditional pathology, including applications in education, research, and clinical practice. Contemporary whole slide imaging (WSI) devices include technological advances that help address some of the challenges facing modern pathology, such as increasing workloads with fewer subspecialized pathologists, expanding integrated delivery networks with global reach, and greater customization when working up cases for precision medicine. This review focuses on integral hardware components of 43 market available and soon-to-be released digital WSI devices utilized throughout the world. Components such as objective lens type and magnification, scanning camera, illumination, and slide capacity were evaluated with respect to scan time, throughput, accuracy of scanning, and image quality. This analysis of assorted modern WSI devices offers essential, valuable information for successfully selecting and implementing a digital WSI solution for any given pathology practice.
Collapse
Affiliation(s)
- Ankush Patel
- Department of Pathology, The Ohio State University, Columbus, Ohio, USA
| | | | - Jerome Cheng
- Department of Pathology, University of Michigan, Ann Arbor, Michigan, USA
| | - Zaibo Li
- Department of Pathology, The Ohio State University, Columbus, Ohio, USA
| | - Giovanni Lujan
- Department of Pathology, The Ohio State University, Columbus, Ohio, USA
| | | | - Liron Pantanowitz
- Department of Pathology, University of Michigan, Ann Arbor, Michigan, USA
| | - Anil Parwani
- Department of Pathology, The Ohio State University, Columbus, Ohio, USA
| |
Collapse
|
4
|
Konda PC, Loetgering L, Zhou KC, Xu S, Harvey AR, Horstmeyer R. Fourier ptychography: current applications and future promises. OPTICS EXPRESS 2020; 28:9603-9630. [PMID: 32225565 DOI: 10.1364/oe.386168] [Citation(s) in RCA: 49] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Accepted: 01/30/2020] [Indexed: 05/18/2023]
Abstract
Traditional imaging systems exhibit a well-known trade-off between the resolution and the field of view of their captured images. Typical cameras and microscopes can either "zoom in" and image at high-resolution, or they can "zoom out" to see a larger area at lower resolution, but can rarely achieve both effects simultaneously. In this review, we present details about a relatively new procedure termed Fourier ptychography (FP), which addresses the above trade-off to produce gigapixel-scale images without requiring any moving parts. To accomplish this, FP captures multiple low-resolution, large field-of-view images and computationally combines them in the Fourier domain into a high-resolution, large field-of-view result. Here, we present details about the various implementations of FP and highlight its demonstrated advantages to date, such as aberration recovery, phase imaging, and 3D tomographic reconstruction, to name a few. After providing some basics about FP, we list important details for successful experimental implementation, discuss its relationship with other computational imaging techniques, and point to the latest advances in the field while highlighting persisting challenges.
Collapse
|
5
|
Cheng H, Chen X, Wen Y, Wang H, Li H. Sparse aperture arrangement for periodic LED array sampling in a Fourier ptychography microscopy system. APPLIED OPTICS 2019; 58:8791-8801. [PMID: 31873656 DOI: 10.1364/ao.58.008791] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2019] [Accepted: 09/22/2019] [Indexed: 06/10/2023]
Abstract
In a traditional Fourier ptychography microscopy (FPM) system, multiple low-resolution (LR) intensity images have to be sequentially captured under variable illumination angles and then stitched together in the Fourier domain, which is time-consuming. This paper proposes a sparse aperture arrangement method in which the relationship between the spatial spectrum distribution and the light-emitting diodes array sampling pattern is investigated. Mathematical models of the proposed method are developed, and numerical simulations and optical experiments are demonstrated to verify its feasibility. The results show that the number of LR images could be decreased significantly without sacrificing image reconstruction quality. To the best of our knowledge, this is the first time that the sparse aperture arrangement has been exploited for FPM. The proposed method may provide new insights for improving the efficiency of the FPM platform and discovering more applications in digital pathology.
Collapse
|
6
|
Aidukas T, Eckert R, Harvey AR, Waller L, Konda PC. Low-cost, sub-micron resolution, wide-field computational microscopy using opensource hardware. Sci Rep 2019; 9:7457. [PMID: 31092867 PMCID: PMC6520337 DOI: 10.1038/s41598-019-43845-9] [Citation(s) in RCA: 41] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2018] [Accepted: 04/30/2019] [Indexed: 12/19/2022] Open
Abstract
The revolution in low-cost consumer photography and computation provides fertile opportunity for a disruptive reduction in the cost of biomedical imaging. Conventional approaches to low-cost microscopy are fundamentally restricted, however, to modest field of view (FOV) and/or resolution. We report a low-cost microscopy technique, implemented with a Raspberry Pi single-board computer and color camera combined with Fourier ptychography (FP), to computationally construct 25-megapixel images with sub-micron resolution. New image-construction techniques were developed to enable the use of the low-cost Bayer color sensor, to compensate for the highly aberrated re-used camera lens and to compensate for misalignments associated with the 3D-printed microscope structure. This high ratio of performance to cost is of particular interest to high-throughput microscopy applications, ranging from drug discovery and digital pathology to health screening in low-income countries. 3D models and assembly instructions of our microscope are made available for open source use.
Collapse
Affiliation(s)
- Tomas Aidukas
- Imaging Concepts Group, School of Physics and Astronomy, University of Glasgow, Scotland, G12 8QQ, UK
| | - Regina Eckert
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, California, 94720, USA
| | - Andrew R Harvey
- Imaging Concepts Group, School of Physics and Astronomy, University of Glasgow, Scotland, G12 8QQ, UK.
| | - Laura Waller
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, California, 94720, USA
| | - Pavan C Konda
- Imaging Concepts Group, School of Physics and Astronomy, University of Glasgow, Scotland, G12 8QQ, UK
| |
Collapse
|
7
|
Song J, Allen CS, Gao S, Huang C, Sawada H, Pan X, Warner J, Wang P, Kirkland AI. Atomic Resolution Defocused Electron Ptychography at Low Dose with a Fast, Direct Electron Detector. Sci Rep 2019; 9:3919. [PMID: 30850641 PMCID: PMC6408533 DOI: 10.1038/s41598-019-40413-z] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2018] [Accepted: 02/14/2019] [Indexed: 01/16/2023] Open
Abstract
Electron ptychography has recently attracted considerable interest for high resolution phase-sensitive imaging. However, to date studies have been mainly limited to radiation resistant samples as the electron dose required to record a ptychographic dataset is too high for use with beam-sensitive materials. Here we report defocused electron ptychography using a fast, direct-counting detector to reconstruct the transmission function, which is in turn related to the electrostatic potential of a two-dimensional material at atomic resolution under various low dose conditions.
Collapse
Affiliation(s)
- Jiamei Song
- College of Engineering and Applied Sciences, Nanjing University, Nanjing, 210093, People's Republic of China
| | - Christopher S Allen
- Department of Materials, University of Oxford, Parks Road, Oxford, OX1 3PH, UK.,Electron Physical Sciences Imaging Centre, Diamond Lightsource Ltd., Didcot, OX11 0DE, UK
| | - Si Gao
- College of Engineering and Applied Sciences, Nanjing University, Nanjing, 210093, People's Republic of China
| | - Chen Huang
- Department of Materials, University of Oxford, Parks Road, Oxford, OX1 3PH, UK.,Electron Physical Sciences Imaging Centre, Diamond Lightsource Ltd., Didcot, OX11 0DE, UK
| | - Hidetaka Sawada
- JEOL Ltd, 1-2 Mushashino, 3-Chome, Akishima, Tokyo, 196, Japan
| | - Xiaoqing Pan
- Department of Materials Science and Engineering, and Department of Physics and Astronomy, University of California, Irvine, CA, 92697, USA
| | - Jamie Warner
- Department of Materials, University of Oxford, Parks Road, Oxford, OX1 3PH, UK
| | - Peng Wang
- College of Engineering and Applied Sciences, Nanjing University, Nanjing, 210093, People's Republic of China.
| | - Angus I Kirkland
- Department of Materials, University of Oxford, Parks Road, Oxford, OX1 3PH, UK.,Electron Physical Sciences Imaging Centre, Diamond Lightsource Ltd., Didcot, OX11 0DE, UK
| |
Collapse
|
8
|
Kheireddine S, Sudalaiyadum Perumal A, Smith ZJ, Nicolau DV, Wachsmann-Hogiu S. Dual-phone illumination-imaging system for high resolution and large field of view multi-modal microscopy. LAB ON A CHIP 2019; 19:825-836. [PMID: 30698180 DOI: 10.1039/c8lc00995c] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
In this paper we present for the first time a system comprised of two mobile phones, one for illumination and the other for microscopy, as a portable, user-friendly, and cost-effective microscopy platform for a wide range of applications. Versatile and adaptive illumination is made with a Retina display of an Apple mobile phone device. The phone screen is used to project various illumination patterns onto the specimen being imaged, each corresponding to a different illumination mode, such as bright-field, dark-field, point illumination, Rheinberg illumination, and fluorescence microscopy. The second phone (a Nokia phone) is modified to record microscopic images about the sample. This imaging platform provides a high spatial resolution of at least 2 μm, a large field-of-view of 3.6 × 2.7 mm, and a working distance of 0.6 mm. We demonstrate the performance of this platform for the visualization of microorganisms within microfluidic devices to gather qualitative and quantitative information regarding microorganism morphology, dimension, count, and velocity/trajectories in the x-y plane.
Collapse
Affiliation(s)
- Sara Kheireddine
- Department of Bioengineering, McGill University, Montreal, Quebec H3A 0E9, Canada.
| | | | | | | | | |
Collapse
|
9
|
Wu Z, Han C, Yang C, Huangfu J. 3D imaging scanner. APPLIED OPTICS 2018; 57:5399-5404. [PMID: 30117832 DOI: 10.1364/ao.57.005399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/13/2018] [Accepted: 06/03/2018] [Indexed: 06/08/2023]
Abstract
This paper proposes a multi-view three-dimensional display method based on a scanning imaging system with the light-intensity characteristic recorded by an improved flatbed scanner. Within the effective scanning depth of the imaging sensor, two transmission images are each simultaneously acquired by two linear CCD modules with different focal planes. Then the phase gradient information of the target can be obtained by an appropriate retrieval algorithm. Further, the multi-view three-dimensional effect is presented through dynamic angles of view. Theoretical analysis of this method is discussed, and experiments are carried out by building a scanner. The experiment results are presented with an algae specimen and transparent beads. We hope this method can be applied to present the three-dimensional effect of objects of flat translucent multilayer structure with a wide field of view.
Collapse
|
10
|
A modular, open-source, slide-scanning microscope for diagnostic applications in resource-constrained settings. PLoS One 2018; 13:e0194063. [PMID: 29543835 PMCID: PMC5854341 DOI: 10.1371/journal.pone.0194063] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2017] [Accepted: 02/24/2018] [Indexed: 12/20/2022] Open
Abstract
In this paper we report the development of a cost-effective, modular, open source, and fully automated slide-scanning microscope, composed entirely of easily available off-the-shelf parts, and capable of bright field and fluorescence modes. The automated X-Y stage is composed of two low-cost micrometer stages coupled to stepper motors operated in open-loop mode. The microscope is composed of a low-cost CMOS sensor and low-cost board lenses placed in a 4f configuration. The system has approximately 1 micron resolution, limited by the f/# of available board lenses. The microscope is compact, measuring just 25×25×30 cm, and has an absolute positioning accuracy of ±1 μm in the X and Y directions. A Z-stage enables autofocusing and imaging over large fields of view even on non-planar samples, and custom software enables automatic determination of sample boundaries and image mosaicking. We demonstrate the utility of our device through imaging of fluorescent- and transmission-dye stained blood and fecal smears containing human and animal parasites, as well as several prepared tissue samples. These results demonstrate image quality comparable to high-end commercial microscopes at a cost of less than US$400 for a bright-field system, with an extra US$100 needed for the fluorescence module.
Collapse
|
11
|
Russell CT, Rees EJ, Kaminski CF. Homographically generated light sheets for the microscopy of large specimens. OPTICS LETTERS 2018; 43:663-666. [PMID: 29444047 PMCID: PMC5862512 DOI: 10.1364/ol.43.000663] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/29/2017] [Revised: 11/08/2017] [Accepted: 11/12/2017] [Indexed: 06/08/2023]
Abstract
We compare the performance of linear and nonlinear methods for aligning the excitation and detection planes throughout volumes of large specimens in digitally scanned light sheet microscopy. An effective nonlinear method involves the registration of four corner extrema of the imaging volume via a projective transform. We show that this improves the light collection efficiency of the commonly used three-point affine registration by an average of 42% over a typical specimen volume. Accurate illumination/detection registration methods are now pertinent to biological research in view of current trends towards imaging large or expanded samples, at depth, with diffraction limited resolution.
Collapse
|
12
|
He X, Liu C, Zhu J. Single-shot Fourier ptychography based on diffractive beam splitting. OPTICS LETTERS 2018; 43:214-217. [PMID: 29328241 DOI: 10.1364/ol.43.000214] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/26/2017] [Accepted: 12/05/2017] [Indexed: 06/07/2023]
Abstract
An optical setup and corresponding reconstruction algorithm are proposed to realize single-shot Fourier ptychography (FP). Multiple angle-varied object waves are generated by placing a Dammann grating at a certain distance behind the object, and the generated image array of low resolution corresponding to different diffraction orders formed on the detector plane is recorded simultaneously in a single exposure. The amplitude, as well as the phase information of the object, can be properly reconstructed with a common FP algorithm from the recorded image array. This method eliminates the requirement for the angular scanning of common FP, and the total acquisition time is dramatically reduced. The feasibility of this proposed method was demonstrated both numerically and experimentally. The proposed method has the advantages of fast data acquisition and corresponding high temporal resolution, making it very suitable for applications in which high imaging speed is required.
Collapse
|
13
|
Abstract
State-of-the-art high-throughput microscopes are now capable of recording image data at a phenomenal rate, imaging entire microscope slides in minutes. In this paper we investigate how a large image set can be used to perform automated cell classification and denoising. To this end, we acquire an image library consisting of over one quarter-million white blood cell (WBC) nuclei together with CD15/CD16 protein expression for each cell. We show that the WBC nucleus images alone can be used to replicate CD expression-based gating, even in the presence of significant imaging noise. We also demonstrate that accurate estimates of white blood cell images can be recovered from extremely noisy images by comparing with a reference dictionary. This has implications for dose-limited imaging when samples belong to a highly restricted class such as a well-studied cell type. Furthermore, large image libraries may endow microscopes with capabilities beyond their hardware specifications in terms of sensitivity and resolution. We call for researchers to crowd source large image libraries of common cell lines to explore this possibility.
Collapse
|
14
|
McConnell G, Trägårdh J, Amor R, Dempster J, Reid E, Amos WB. A novel optical microscope for imaging large embryos and tissue volumes with sub-cellular resolution throughout. eLife 2016; 5. [PMID: 27661778 PMCID: PMC5035146 DOI: 10.7554/elife.18659] [Citation(s) in RCA: 77] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2016] [Accepted: 08/23/2016] [Indexed: 01/31/2023] Open
Abstract
Current optical microscope objectives of low magnification have low numerical aperture and therefore have too little depth resolution and discrimination to perform well in confocal and nonlinear microscopy. This is a serious limitation in important areas, including the phenotypic screening of human genes in transgenic mice by study of embryos undergoing advanced organogenesis. We have built an optical lens system for 3D imaging of objects up to 6 mm wide and 3 mm thick with depth resolution of only a few microns instead of the tens of microns currently attained, allowing sub-cellular detail to be resolved throughout the volume. We present this lens, called the Mesolens, with performance data and images from biological specimens including confocal images of whole fixed and intact fluorescently-stained 12.5-day old mouse embryos. DOI:http://dx.doi.org/10.7554/eLife.18659.001 For hundreds of years, optical microscopes have allowed living tissues to be studied in fine detail. Unfortunately, the images captured through typical microscope lenses feature a compromise between the level of detail in the image and how much of a sample can be shown. For example, densely packed individual cells often cannot be distinguished in an image that shows an entire mouse embryo. To address this issue, McConnell et al. have developed a microscope lens called the Mesolens. This can magnify samples by up to four times in much higher detail than conventional lenses that produce the same magnification. McConnell et al. tested the Mesolens as part of a technique called confocal microscopy, which can reconstruct the three-dimensional structure of a sample by collecting images from different layers. The resulting images allowed individual cells to be distinguished in cultures of rat brain cells. Furthermore, images of 10–12 day old mouse embryos contained enough detail to reveal many of the structures found inside cells, and allowed the distribution of cells to be tracked in developing organs such as the heart. Ultimately, the Mesolens has the potential to be used in many different applications and could assist in the study of many biological processes. In the future, McConnell et al. will test how effectively the Mesolens works as part of other microscopy techniques. DOI:http://dx.doi.org/10.7554/eLife.18659.002
Collapse
Affiliation(s)
- Gail McConnell
- Centre for Biophotonics, Strathclyde Institute for Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom
| | - Johanna Trägårdh
- Centre for Biophotonics, Strathclyde Institute for Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom
| | - Rumelo Amor
- Centre for Biophotonics, Strathclyde Institute for Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom
| | - John Dempster
- Centre for Biophotonics, Strathclyde Institute for Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom
| | - Es Reid
- Centre for Biophotonics, Strathclyde Institute for Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom
| | - William Bradshaw Amos
- Centre for Biophotonics, Strathclyde Institute for Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom.,MRC Laboratory of Molecular Biology, Cambridge, United Kingdom
| |
Collapse
|
15
|
Abstract
A custom-built objective lens called the Mesolens allows relatively large biological specimens to be imaged with cellular resolution.
Collapse
|
16
|
Kim J, Henley BM, Kim CH, Lester HA, Yang C. Incubator embedded cell culture imaging system (EmSight) based on Fourier ptychographic microscopy. BIOMEDICAL OPTICS EXPRESS 2016; 7:3097-110. [PMID: 27570701 PMCID: PMC4986817 DOI: 10.1364/boe.7.003097] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2016] [Revised: 07/07/2016] [Accepted: 07/17/2016] [Indexed: 05/20/2023]
Abstract
Multi-day tracking of cells in culture systems can provide valuable information in bioscience experiments. We report the development of a cell culture imaging system, named EmSight, which incorporates multiple compact Fourier ptychographic microscopes with a standard multiwell imaging plate. The system is housed in an incubator and presently incorporates six microscopes. By using the same low magnification objective lenses as the objective and the tube lens, the EmSight is configured as a 1:1 imaging system that, providing large field-of-view (FOV) imaging onto a low-cost CMOS imaging sensor. The EmSight improves the image resolution by capturing a series of images of the sample at varying illumination angles; the instrument reconstructs a higher-resolution image by using the iterative Fourier ptychographic algorithm. In addition to providing high-resolution brightfield and phase imaging, the EmSight is also capable of fluorescence imaging at the native resolution of the objectives. We characterized the system using a phase Siemens star target, and show four-fold improved coherent resolution (synthetic NA of 0.42) and a depth of field of 0.2 mm. To conduct live, long-term dopaminergic neuron imaging, we cultured ventral midbrain from mice driving eGFP from the tyrosine hydroxylase promoter. The EmSight system tracks movements of dopaminergic neurons over a 21 day period.
Collapse
Affiliation(s)
- Jinho Kim
- Department of Electrical Engineering, California Institute of Technology, Pasadena, California 91125, USA
| | - Beverley M. Henley
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, California 91125, USA
| | - Charlene H. Kim
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, California 91125, USA
| | - Henry A. Lester
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, California 91125, USA
| | - Changhuei Yang
- Department of Electrical Engineering, California Institute of Technology, Pasadena, California 91125, USA
| |
Collapse
|
17
|
Ou X, Zheng G, Yang C. Erratum: 0.5 gigapixel microscopy using a flatbed scanner: erratum. BIOMEDICAL OPTICS EXPRESS 2016; 7:646-7. [PMID: 26977368 PMCID: PMC4771477 DOI: 10.1364/boe.7.000646] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/13/2016] [Indexed: 05/26/2023]
Abstract
When one uses USAF target to calibrate the resolution of an imaging system, the periodicity of the smallest resolvable line should be used to define the limit. However, in the original paper, the line width of the resolution target was used to characterize the resolution of our microscope system, resulting in an overestimation of the performance of the imaging system. In this erratum, we correct the parts that state incorrect resolution and also re-evaluate the performance of our micoscope.[This corrects the article on p. 1 in vol. 5, PMID: 24466471.].
Collapse
Affiliation(s)
- Xiaoze Ou
- Department of Electrical Engineering, California Institute of Technology, Pasadena, CA, 91125, USA
| | - Guoan Zheng
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
- Electrical and Computer Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Changhuei Yang
- Department of Electrical Engineering, California Institute of Technology, Pasadena, CA, 91125, USA
| |
Collapse
|
18
|
High-throughput miniaturized microfluidic microscopy with radially parallelized channel geometry. Anal Bioanal Chem 2016; 408:1909-16. [DOI: 10.1007/s00216-015-9301-2] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2015] [Revised: 12/22/2015] [Accepted: 12/23/2015] [Indexed: 10/22/2022]
|
19
|
Chu K, Smith ZJ, Wachsmann-Hogiu S. Development of inexpensive blood imaging systems: where are we now? Expert Rev Med Devices 2015; 12:613-27. [PMID: 26305840 DOI: 10.1586/17434440.2015.1075388] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Clinical applications in the developing world, such as malaria and anemia diagnosis, demand a change in the medical paradigm of expensive care given in central locations by highly trained professionals. There has been a recent explosion in optical technologies entering the consumer market through the widespread adoption of smartphones and LEDs. This technology commoditization has enabled the development of small, portable optical imaging systems at an unprecedentedly low cost. Here, we review the state-of-the-field of the application of these systems for low-cost blood imaging with an emphasis on cellular imaging systems. In addition to some promising results addressing specific clinical issues, an overview of the technology landscape is provided. We also discuss several key issues that need to be addressed before these technologies can be commercialized.
Collapse
Affiliation(s)
- Kaiqin Chu
- a 1 Center for Biophotonics, University of California Davis, Sacramento, CA 95817, USA
| | | | | |
Collapse
|
20
|
Zhang Y, Jiang W, Tian L, Waller L, Dai Q. Self-learning based Fourier ptychographic microscopy. OPTICS EXPRESS 2015; 23:18471-86. [PMID: 26191905 DOI: 10.1364/oe.23.018471] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Fourier Ptychographic Microscopy (FPM) is a newly proposed computational imaging method aimed at reconstructing a high-resolution wide-field image from a sequence of low-resolution images. These low-resolution images are captured under varied illumination angles and the FPM recovery routine then stitches them together in the Fourier domain iteratively. Although FPM has achieved success with static sample reconstructions, the long acquisition time inhibits real-time application. To address this problem, we propose here a self-learning based FPM which accelerates the acquisition and reconstruction procedure. We first capture a single image under normally incident illumination, and then use it to simulate the corresponding low-resolution images under other illumination angles. The simulation is based on the relationship between the illumination angles and the shift of the sample's spectrum. We analyze the importance of the simulated low-resolution images in order to devise a selection scheme which only collects the ones with higher importance. The measurements are then captured with the selection scheme and employed to perform the FPM reconstruction. Since only measurements of high importance are captured, the time requirements of data collection as well as image reconstruction can be greatly reduced. We validate the effectiveness of the proposed method with simulation and experimental results showing that the reduction ratio of data size requirements can reach over 70%, without sacrificing image reconstruction quality.
Collapse
|
21
|
Han C, Huangfu J, Lai LL, Yang C. A wide field-of-view scanning endoscope for whole anal canal imaging. BIOMEDICAL OPTICS EXPRESS 2015; 6:607-14. [PMID: 25780750 PMCID: PMC4354600 DOI: 10.1364/boe.6.000607] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/06/2014] [Revised: 01/19/2015] [Accepted: 01/22/2015] [Indexed: 05/25/2023]
Abstract
We report a novel wide field-of-view (FOV) scanning endoscope, the AnCam, which is based on contact image sensor (CIS) technology used in commercialized business card scanners. The AnCam can capture the whole image of the anal canal within 10 seconds with a resolution of 89 μm, a maximum FOV of 100 mm × 120 mm, and a depth-of-field (DOF) of 0.65 mm at 5.9 line pairs per mm (lp/mm). We demonstrate the performance of the AnCam by imaging the entire anal canal of pigs and tracking the dynamics of acetowhite testing. We believe the AnCam can potentially be a simple and convenient solution for screening of the anal canal for dysplasia and for surveillance in patients following treatment for anal cancer.
Collapse
Affiliation(s)
- Chao Han
- Electrical Engineering, California Institute of Technology, Pasadena, CA 91125,
USA
- These authors contributed equally
| | - Jiangtao Huangfu
- Electrical Engineering, California Institute of Technology, Pasadena, CA 91125,
USA
- Department of Information and Electronic Engineering, Zhejiang University, Hangzhou 310027,
China
- These authors contributed equally
| | - Lily L. Lai
- Division of Surgical Oncology, Department of Surgery, City of Hope, Duarte, CA 91010,
USA
- These authors contributed equally
| | - Changhuei Yang
- Electrical Engineering, California Institute of Technology, Pasadena, CA 91125,
USA
| |
Collapse
|
22
|
Dong S, Guo K, Nanda P, Shiradkar R, Zheng G. FPscope: a field-portable high-resolution microscope using a cellphone lens. BIOMEDICAL OPTICS EXPRESS 2014; 5:3305-10. [PMID: 25360351 PMCID: PMC4206303 DOI: 10.1364/boe.5.003305] [Citation(s) in RCA: 46] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/02/2014] [Revised: 08/02/2014] [Accepted: 08/23/2014] [Indexed: 05/21/2023]
Abstract
The large consumer market has made cellphone lens modules available at low-cost and in high-quality. In a conventional cellphone camera, the lens module is used to demagnify the scene onto the image plane of the camera, where image sensor is located. In this work, we report a 3D-printed high-resolution Fourier ptychographic microscope, termed FPscope, which uses a cellphone lens in a reverse manner. In our platform, we replace the image sensor with sample specimens, and use the cellphone lens to project the magnified image to the detector. To supersede the diffraction limit of the lens module, we use an LED array to illuminate the sample from different incident angles and synthesize the acquired images using the Fourier ptychographic algorithm. As a demonstration, we use the reported platform to acquire high-resolution images of resolution target and biological specimens, with a maximum synthetic numerical aperture (NA) of 0.5. We also show that, the depth-of-focus of the reported platform is about 0.1 mm, orders of magnitude longer than that of a conventional microscope objective with a similar NA. The reported platform may enable healthcare accesses in low-resource settings. It can also be used to demonstrate the concept of computational optics for educational purposes.
Collapse
Affiliation(s)
- Siyuan Dong
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
- These authors contributed equally to this work
| | - Kaikai Guo
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
- These authors contributed equally to this work
| | - Pariksheet Nanda
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Radhika Shiradkar
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Guoan Zheng
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
- Electrical and Computer Engineering, University of Connecticut, Storrs, CT, 06269, USA
| |
Collapse
|
23
|
Abstract
In this Review, we provide an overview of flatbed scanner based biomedical imaging and sensing techniques. The extremely large imaging field-of-view (e.g., ~600-700 cm(2)) of these devices coupled with their cost-effectiveness provide unique opportunities for digital imaging of samples that are too large for regular optical microscopes, and for collection of large amounts of statistical data in various automated imaging or sensing tasks. Here we give a short introduction to the basic features of flatbed scanners also highlighting the key parameters for designing scientific experiments using these devices, followed by a discussion of some of the significant examples, where scanner-based systems were constructed to conduct various biomedical imaging and/or sensing experiments. Along with mobile phones and other emerging consumer electronics devices, flatbed scanners and their use in advanced imaging and sensing experiments might help us transform current practices of medicine, engineering and sciences through democratization of measurement science and empowerment of citizen scientists, science educators and researchers in resource limited settings.
Collapse
Affiliation(s)
- Zoltán Göröcs
- Department of Electrical Engineering, University of California Los Angeles (UCLA Electrical Engineering and Bioengineering Departments), CA 90095, USA.
| | | |
Collapse
|
24
|
Dong S, Horstmeyer R, Shiradkar R, Guo K, Ou X, Bian Z, Xin H, Zheng G. Aperture-scanning Fourier ptychography for 3D refocusing and super-resolution macroscopic imaging. OPTICS EXPRESS 2014; 22:13586-99. [PMID: 24921553 DOI: 10.1364/oe.22.013586] [Citation(s) in RCA: 60] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
Abstract
We report an imaging scheme, termed aperture-scanning Fourier ptychography, for 3D refocusing and super-resolution macroscopic imaging. The reported scheme scans an aperture at the Fourier plane of an optical system and acquires the corresponding intensity images of the object. The acquired images are then synthesized in the frequency domain to recover a high-resolution complex sample wavefront; no phase information is needed in the recovery process. We demonstrate two applications of the reported scheme. In the first example, we use an aperture-scanning Fourier ptychography platform to recover the complex hologram of extended objects. The recovered hologram is then digitally propagated into different planes along the optical axis to examine the 3D structure of the object. We also demonstrate a reconstruction resolution better than the detector pixel limit (i.e., pixel super-resolution). In the second example, we develop a camera-scanning Fourier ptychography platform for super-resolution macroscopic imaging. By simply scanning the camera over different positions, we bypass the diffraction limit of the photographic lens and recover a super-resolution image of an object placed at the far field. This platform's maximum achievable resolution is ultimately determined by the camera's traveling range, not the aperture size of the lens. The FP scheme reported in this work may find applications in 3D object tracking, synthetic aperture imaging, remote sensing, and optical/electron/X-ray microscopy.
Collapse
|
25
|
Ou X, Zheng G, Yang C. Embedded pupil function recovery for Fourier ptychographic microscopy. OPTICS EXPRESS 2014; 22:4960-72. [PMID: 24663835 PMCID: PMC4086333 DOI: 10.1364/oe.22.004960] [Citation(s) in RCA: 142] [Impact Index Per Article: 14.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/26/2013] [Revised: 02/12/2014] [Accepted: 02/17/2014] [Indexed: 05/18/2023]
Abstract
We develop and test a pupil function determination algorithm, termed embedded pupil function recovery (EPRY), which can be incorporated into the Fourier ptychographic microscopy (FPM) algorithm and recover both the Fourier spectrum of sample and the pupil function of imaging system simultaneously. This EPRY-FPM algorithm eliminates the requirement of the previous FPM algorithm for a priori knowledge of the aberration in the imaging system to reconstruct a high quality image. We experimentally demonstrate the effectiveness of this algorithm by reconstructing high resolution, large field-of-view images of biological samples. We also illustrate that the pupil function we retrieve can be used to study the spatially varying aberration of a large field-of-view imaging system. We believe that this algorithm adds more flexibility to FPM and can be a powerful tool for the characterization of an imaging system's aberration.
Collapse
Affiliation(s)
- Xiaoze Ou
- Department of Electrical Engineering, California Institute of Technology, Pasadena, CA, 91125, USA
| | - Guoan Zheng
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
- Electrical and Computer Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Changhuei Yang
- Department of Electrical Engineering, California Institute of Technology, Pasadena, CA, 91125, USA
| |
Collapse
|
26
|
Fitzmaurice M, Pogue BW, Tearney GJ, Tunnell JW, Yang C. Advances in optics for biotechnology, medicine and surgery. BIOMEDICAL OPTICS EXPRESS 2014; 5:560-561. [PMID: 24575348 PMCID: PMC3920884 DOI: 10.1364/boe.5.000560] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/23/2014] [Indexed: 06/03/2023]
Abstract
The guest editors introduce a Biomedical Optics Express feature issue that includes contributions from participants at the 2013 conference on Advances in Optics for Biotechnology, Medicine and Surgery XIII.
Collapse
Affiliation(s)
- Maryann Fitzmaurice
- Department of Pathology, Case Western Reserve University School of Medicine, Cleveland, OH 44106, USA
| | - Brian W. Pogue
- Thayer School of Engineering, 14 Engineering Drive, Dartmouth College, Hanover, NH 03755, USA
| | - Guillermo J. Tearney
- Harvard Medical School and Massachusetts General Hospital, Wellman Center for Photomedicine, Boston, MA 02114 USA
- Harvard-MIT Division of Health Sciences and Technology, Cambridge, MA 02139 USA
- Department of Pathology, Massachusetts General Hospital, Boston, MA 02114 USA
| | - James W. Tunnell
- Biomedical Engineering, The University of Texas at Austin, Austin, TX, 78712 USA
| | - Changhuei Yang
- Biomedical Engineering, The University of Texas at Austin, Austin, TX, 78712 USA
| |
Collapse
|