0.5 gigapixel microscopy using a flatbed scanner

Near-Space Wide-Area and High-Resolution Imaging System Design and Implementation

The near-space atmosphere is thin, and the atmospheric refraction and scattering on optical observation is very small, making it very suitable for wide-area and high-resolution surveillance using high-altitude balloon platforms. This paper adopts a 9344 × 7000 CMOS sensor to obtain high-resolution images, generating large-field-of-view imaging through the swing scanning of the photoelectric sphere and image stitching. In addition, a zoom lens is designed to achieve flexible applications for different scenarios, such as large-field-of-view and high-resolution imaging. The optical design results show that the camera system has good imaging quality within the focal length range of 320 mm-106.7 mm, and the relative distortion values at different focal lengths are less than 2%. The flight results indicate that the system can achieve seamless image stitching at a resolution of 0.2 m@20 km and the imaging field of view angle exceeds 33°. This system will perform other near-space flight experiments to verify its ultra-wide (field of view exceeding 100°) high-resolution imaging application.

Multi-modal imaging using a cascaded microscope design

We present a multi-modal fiber array snapshot technique (M-FAST) based on an array of 96 compact cameras placed behind a primary objective lens and a fiber bundle array. Our technique is capable of large-area, high-resolution, multi-channel video acquisition. The proposed design provides two key improvements to prior cascaded imaging system approaches: a novel optical arrangement that accommodates the use of planar camera arrays, and a new ability to acquire multi-modal image data acquisition. M-FAST is a multi-modal, scalable imaging system that can acquire snapshot dual-channel fluorescence images as well as differential phase contrast measurements over a large 6.59 mm × 9.74 mm field-of-view at 2.2-μm center full-pitch resolution.

Contemporary Whole Slide Imaging Devices and Their Applications within the Modern Pathology Department: A Selected Hardware Review

Digital pathology (DP) has disrupted the practice of traditional pathology, including applications in education, research, and clinical practice. Contemporary whole slide imaging (WSI) devices include technological advances that help address some of the challenges facing modern pathology, such as increasing workloads with fewer subspecialized pathologists, expanding integrated delivery networks with global reach, and greater customization when working up cases for precision medicine. This review focuses on integral hardware components of 43 market available and soon-to-be released digital WSI devices utilized throughout the world. Components such as objective lens type and magnification, scanning camera, illumination, and slide capacity were evaluated with respect to scan time, throughput, accuracy of scanning, and image quality. This analysis of assorted modern WSI devices offers essential, valuable information for successfully selecting and implementing a digital WSI solution for any given pathology practice.

Fourier ptychography: current applications and future promises

Traditional imaging systems exhibit a well-known trade-off between the resolution and the field of view of their captured images. Typical cameras and microscopes can either "zoom in" and image at high-resolution, or they can "zoom out" to see a larger area at lower resolution, but can rarely achieve both effects simultaneously. In this review, we present details about a relatively new procedure termed Fourier ptychography (FP), which addresses the above trade-off to produce gigapixel-scale images without requiring any moving parts. To accomplish this, FP captures multiple low-resolution, large field-of-view images and computationally combines them in the Fourier domain into a high-resolution, large field-of-view result. Here, we present details about the various implementations of FP and highlight its demonstrated advantages to date, such as aberration recovery, phase imaging, and 3D tomographic reconstruction, to name a few. After providing some basics about FP, we list important details for successful experimental implementation, discuss its relationship with other computational imaging techniques, and point to the latest advances in the field while highlighting persisting challenges.

Sparse aperture arrangement for periodic LED array sampling in a Fourier ptychography microscopy system

In a traditional Fourier ptychography microscopy (FPM) system, multiple low-resolution (LR) intensity images have to be sequentially captured under variable illumination angles and then stitched together in the Fourier domain, which is time-consuming. This paper proposes a sparse aperture arrangement method in which the relationship between the spatial spectrum distribution and the light-emitting diodes array sampling pattern is investigated. Mathematical models of the proposed method are developed, and numerical simulations and optical experiments are demonstrated to verify its feasibility. The results show that the number of LR images could be decreased significantly without sacrificing image reconstruction quality. To the best of our knowledge, this is the first time that the sparse aperture arrangement has been exploited for FPM. The proposed method may provide new insights for improving the efficiency of the FPM platform and discovering more applications in digital pathology.

Low-cost, sub-micron resolution, wide-field computational microscopy using opensource hardware

The revolution in low-cost consumer photography and computation provides fertile opportunity for a disruptive reduction in the cost of biomedical imaging. Conventional approaches to low-cost microscopy are fundamentally restricted, however, to modest field of view (FOV) and/or resolution. We report a low-cost microscopy technique, implemented with a Raspberry Pi single-board computer and color camera combined with Fourier ptychography (FP), to computationally construct 25-megapixel images with sub-micron resolution. New image-construction techniques were developed to enable the use of the low-cost Bayer color sensor, to compensate for the highly aberrated re-used camera lens and to compensate for misalignments associated with the 3D-printed microscope structure. This high ratio of performance to cost is of particular interest to high-throughput microscopy applications, ranging from drug discovery and digital pathology to health screening in low-income countries. 3D models and assembly instructions of our microscope are made available for open source use.

Atomic Resolution Defocused Electron Ptychography at Low Dose with a Fast, Direct Electron Detector

Electron ptychography has recently attracted considerable interest for high resolution phase-sensitive imaging. However, to date studies have been mainly limited to radiation resistant samples as the electron dose required to record a ptychographic dataset is too high for use with beam-sensitive materials. Here we report defocused electron ptychography using a fast, direct-counting detector to reconstruct the transmission function, which is in turn related to the electrostatic potential of a two-dimensional material at atomic resolution under various low dose conditions.

Dual-phone illumination-imaging system for high resolution and large field of view multi-modal microscopy

In this paper we present for the first time a system comprised of two mobile phones, one for illumination and the other for microscopy, as a portable, user-friendly, and cost-effective microscopy platform for a wide range of applications. Versatile and adaptive illumination is made with a Retina display of an Apple mobile phone device. The phone screen is used to project various illumination patterns onto the specimen being imaged, each corresponding to a different illumination mode, such as bright-field, dark-field, point illumination, Rheinberg illumination, and fluorescence microscopy. The second phone (a Nokia phone) is modified to record microscopic images about the sample. This imaging platform provides a high spatial resolution of at least 2 μm, a large field-of-view of 3.6 × 2.7 mm, and a working distance of 0.6 mm. We demonstrate the performance of this platform for the visualization of microorganisms within microfluidic devices to gather qualitative and quantitative information regarding microorganism morphology, dimension, count, and velocity/trajectories in the x-y plane.

3D imaging scanner

This paper proposes a multi-view three-dimensional display method based on a scanning imaging system with the light-intensity characteristic recorded by an improved flatbed scanner. Within the effective scanning depth of the imaging sensor, two transmission images are each simultaneously acquired by two linear CCD modules with different focal planes. Then the phase gradient information of the target can be obtained by an appropriate retrieval algorithm. Further, the multi-view three-dimensional effect is presented through dynamic angles of view. Theoretical analysis of this method is discussed, and experiments are carried out by building a scanner. The experiment results are presented with an algae specimen and transparent beads. We hope this method can be applied to present the three-dimensional effect of objects of flat translucent multilayer structure with a wide field of view.

A modular, open-source, slide-scanning microscope for diagnostic applications in resource-constrained settings

In this paper we report the development of a cost-effective, modular, open source, and fully automated slide-scanning microscope, composed entirely of easily available off-the-shelf parts, and capable of bright field and fluorescence modes. The automated X-Y stage is composed of two low-cost micrometer stages coupled to stepper motors operated in open-loop mode. The microscope is composed of a low-cost CMOS sensor and low-cost board lenses placed in a 4f configuration. The system has approximately 1 micron resolution, limited by the f/# of available board lenses. The microscope is compact, measuring just 25×25×30 cm, and has an absolute positioning accuracy of ±1 μm in the X and Y directions. A Z-stage enables autofocusing and imaging over large fields of view even on non-planar samples, and custom software enables automatic determination of sample boundaries and image mosaicking. We demonstrate the utility of our device through imaging of fluorescent- and transmission-dye stained blood and fecal smears containing human and animal parasites, as well as several prepared tissue samples. These results demonstrate image quality comparable to high-end commercial microscopes at a cost of less than US$400 for a bright-field system, with an extra US$100 needed for the fluorescence module.

Homographically generated light sheets for the microscopy of large specimens

We compare the performance of linear and nonlinear methods for aligning the excitation and detection planes throughout volumes of large specimens in digitally scanned light sheet microscopy. An effective nonlinear method involves the registration of four corner extrema of the imaging volume via a projective transform. We show that this improves the light collection efficiency of the commonly used three-point affine registration by an average of 42% over a typical specimen volume. Accurate illumination/detection registration methods are now pertinent to biological research in view of current trends towards imaging large or expanded samples, at depth, with diffraction limited resolution.

Single-shot Fourier ptychography based on diffractive beam splitting

An optical setup and corresponding reconstruction algorithm are proposed to realize single-shot Fourier ptychography (FP). Multiple angle-varied object waves are generated by placing a Dammann grating at a certain distance behind the object, and the generated image array of low resolution corresponding to different diffraction orders formed on the detector plane is recorded simultaneously in a single exposure. The amplitude, as well as the phase information of the object, can be properly reconstructed with a common FP algorithm from the recorded image array. This method eliminates the requirement for the angular scanning of common FP, and the total acquisition time is dramatically reduced. The feasibility of this proposed method was demonstrated both numerically and experimentally. The proposed method has the advantages of fast data acquisition and corresponding high temporal resolution, making it very suitable for applications in which high imaging speed is required.

Dictionary-enhanced imaging cytometry

State-of-the-art high-throughput microscopes are now capable of recording image data at a phenomenal rate, imaging entire microscope slides in minutes. In this paper we investigate how a large image set can be used to perform automated cell classification and denoising. To this end, we acquire an image library consisting of over one quarter-million white blood cell (WBC) nuclei together with CD15/CD16 protein expression for each cell. We show that the WBC nucleus images alone can be used to replicate CD expression-based gating, even in the presence of significant imaging noise. We also demonstrate that accurate estimates of white blood cell images can be recovered from extremely noisy images by comparing with a reference dictionary. This has implications for dose-limited imaging when samples belong to a highly restricted class such as a well-studied cell type. Furthermore, large image libraries may endow microscopes with capabilities beyond their hardware specifications in terms of sensitivity and resolution. We call for researchers to crowd source large image libraries of common cell lines to explore this possibility.

A novel optical microscope for imaging large embryos and tissue volumes with sub-cellular resolution throughout

Current optical microscope objectives of low magnification have low numerical aperture and therefore have too little depth resolution and discrimination to perform well in confocal and nonlinear microscopy. This is a serious limitation in important areas, including the phenotypic screening of human genes in transgenic mice by study of embryos undergoing advanced organogenesis. We have built an optical lens system for 3D imaging of objects up to 6 mm wide and 3 mm thick with depth resolution of only a few microns instead of the tens of microns currently attained, allowing sub-cellular detail to be resolved throughout the volume. We present this lens, called the Mesolens, with performance data and images from biological specimens including confocal images of whole fixed and intact fluorescently-stained 12.5-day old mouse embryos.

DOI:http://dx.doi.org/10.7554/eLife.18659.001

For hundreds of years, optical microscopes have allowed living tissues to be studied in fine detail. Unfortunately, the images captured through typical microscope lenses feature a compromise between the level of detail in the image and how much of a sample can be shown. For example, densely packed individual cells often cannot be distinguished in an image that shows an entire mouse embryo.

To address this issue, McConnell et al. have developed a microscope lens called the Mesolens. This can magnify samples by up to four times in much higher detail than conventional lenses that produce the same magnification.

McConnell et al. tested the Mesolens as part of a technique called confocal microscopy, which can reconstruct the three-dimensional structure of a sample by collecting images from different layers. The resulting images allowed individual cells to be distinguished in cultures of rat brain cells. Furthermore, images of 10–12 day old mouse embryos contained enough detail to reveal many of the structures found inside cells, and allowed the distribution of cells to be tracked in developing organs such as the heart.

Ultimately, the Mesolens has the potential to be used in many different applications and could assist in the study of many biological processes. In the future, McConnell et al. will test how effectively the Mesolens works as part of other microscopy techniques.

DOI:http://dx.doi.org/10.7554/eLife.18659.002

Imaging far and wide

A custom-built objective lens called the Mesolens allows relatively large biological specimens to be imaged with cellular resolution.

Incubator embedded cell culture imaging system (EmSight) based on Fourier ptychographic microscopy

Multi-day tracking of cells in culture systems can provide valuable information in bioscience experiments. We report the development of a cell culture imaging system, named EmSight, which incorporates multiple compact Fourier ptychographic microscopes with a standard multiwell imaging plate. The system is housed in an incubator and presently incorporates six microscopes. By using the same low magnification objective lenses as the objective and the tube lens, the EmSight is configured as a 1:1 imaging system that, providing large field-of-view (FOV) imaging onto a low-cost CMOS imaging sensor. The EmSight improves the image resolution by capturing a series of images of the sample at varying illumination angles; the instrument reconstructs a higher-resolution image by using the iterative Fourier ptychographic algorithm. In addition to providing high-resolution brightfield and phase imaging, the EmSight is also capable of fluorescence imaging at the native resolution of the objectives. We characterized the system using a phase Siemens star target, and show four-fold improved coherent resolution (synthetic NA of 0.42) and a depth of field of 0.2 mm. To conduct live, long-term dopaminergic neuron imaging, we cultured ventral midbrain from mice driving eGFP from the tyrosine hydroxylase promoter. The EmSight system tracks movements of dopaminergic neurons over a 21 day period.

Erratum: 0.5 gigapixel microscopy using a flatbed scanner: erratum

When one uses USAF target to calibrate the resolution of an imaging system, the periodicity of the smallest resolvable line should be used to define the limit. However, in the original paper, the line width of the resolution target was used to characterize the resolution of our microscope system, resulting in an overestimation of the performance of the imaging system. In this erratum, we correct the parts that state incorrect resolution and also re-evaluate the performance of our micoscope.[This corrects the article on p. 1 in vol. 5, PMID: 24466471.].

Development of inexpensive blood imaging systems: where are we now?

Clinical applications in the developing world, such as malaria and anemia diagnosis, demand a change in the medical paradigm of expensive care given in central locations by highly trained professionals. There has been a recent explosion in optical technologies entering the consumer market through the widespread adoption of smartphones and LEDs. This technology commoditization has enabled the development of small, portable optical imaging systems at an unprecedentedly low cost. Here, we review the state-of-the-field of the application of these systems for low-cost blood imaging with an emphasis on cellular imaging systems. In addition to some promising results addressing specific clinical issues, an overview of the technology landscape is provided. We also discuss several key issues that need to be addressed before these technologies can be commercialized.

Self-learning based Fourier ptychographic microscopy

Fourier Ptychographic Microscopy (FPM) is a newly proposed computational imaging method aimed at reconstructing a high-resolution wide-field image from a sequence of low-resolution images. These low-resolution images are captured under varied illumination angles and the FPM recovery routine then stitches them together in the Fourier domain iteratively. Although FPM has achieved success with static sample reconstructions, the long acquisition time inhibits real-time application. To address this problem, we propose here a self-learning based FPM which accelerates the acquisition and reconstruction procedure. We first capture a single image under normally incident illumination, and then use it to simulate the corresponding low-resolution images under other illumination angles. The simulation is based on the relationship between the illumination angles and the shift of the sample's spectrum. We analyze the importance of the simulated low-resolution images in order to devise a selection scheme which only collects the ones with higher importance. The measurements are then captured with the selection scheme and employed to perform the FPM reconstruction. Since only measurements of high importance are captured, the time requirements of data collection as well as image reconstruction can be greatly reduced. We validate the effectiveness of the proposed method with simulation and experimental results showing that the reduction ratio of data size requirements can reach over 70%, without sacrificing image reconstruction quality.

A wide field-of-view scanning endoscope for whole anal canal imaging

We report a novel wide field-of-view (FOV) scanning endoscope, the AnCam, which is based on contact image sensor (CIS) technology used in commercialized business card scanners. The AnCam can capture the whole image of the anal canal within 10 seconds with a resolution of 89 μm, a maximum FOV of 100 mm × 120 mm, and a depth-of-field (DOF) of 0.65 mm at 5.9 line pairs per mm (lp/mm). We demonstrate the performance of the AnCam by imaging the entire anal canal of pigs and tracking the dynamics of acetowhite testing. We believe the AnCam can potentially be a simple and convenient solution for screening of the anal canal for dysplasia and for surveillance in patients following treatment for anal cancer.

FPscope: a field-portable high-resolution microscope using a cellphone lens

The large consumer market has made cellphone lens modules available at low-cost and in high-quality. In a conventional cellphone camera, the lens module is used to demagnify the scene onto the image plane of the camera, where image sensor is located. In this work, we report a 3D-printed high-resolution Fourier ptychographic microscope, termed FPscope, which uses a cellphone lens in a reverse manner. In our platform, we replace the image sensor with sample specimens, and use the cellphone lens to project the magnified image to the detector. To supersede the diffraction limit of the lens module, we use an LED array to illuminate the sample from different incident angles and synthesize the acquired images using the Fourier ptychographic algorithm. As a demonstration, we use the reported platform to acquire high-resolution images of resolution target and biological specimens, with a maximum synthetic numerical aperture (NA) of 0.5. We also show that, the depth-of-focus of the reported platform is about 0.1 mm, orders of magnitude longer than that of a conventional microscope objective with a similar NA. The reported platform may enable healthcare accesses in low-resource settings. It can also be used to demonstrate the concept of computational optics for educational purposes.

Biomedical imaging and sensing using flatbed scanners

In this Review, we provide an overview of flatbed scanner based biomedical imaging and sensing techniques. The extremely large imaging field-of-view (e.g., ~600-700 cm(2)) of these devices coupled with their cost-effectiveness provide unique opportunities for digital imaging of samples that are too large for regular optical microscopes, and for collection of large amounts of statistical data in various automated imaging or sensing tasks. Here we give a short introduction to the basic features of flatbed scanners also highlighting the key parameters for designing scientific experiments using these devices, followed by a discussion of some of the significant examples, where scanner-based systems were constructed to conduct various biomedical imaging and/or sensing experiments. Along with mobile phones and other emerging consumer electronics devices, flatbed scanners and their use in advanced imaging and sensing experiments might help us transform current practices of medicine, engineering and sciences through democratization of measurement science and empowerment of citizen scientists, science educators and researchers in resource limited settings.

Aperture-scanning Fourier ptychography for 3D refocusing and super-resolution macroscopic imaging

We report an imaging scheme, termed aperture-scanning Fourier ptychography, for 3D refocusing and super-resolution macroscopic imaging. The reported scheme scans an aperture at the Fourier plane of an optical system and acquires the corresponding intensity images of the object. The acquired images are then synthesized in the frequency domain to recover a high-resolution complex sample wavefront; no phase information is needed in the recovery process. We demonstrate two applications of the reported scheme. In the first example, we use an aperture-scanning Fourier ptychography platform to recover the complex hologram of extended objects. The recovered hologram is then digitally propagated into different planes along the optical axis to examine the 3D structure of the object. We also demonstrate a reconstruction resolution better than the detector pixel limit (i.e., pixel super-resolution). In the second example, we develop a camera-scanning Fourier ptychography platform for super-resolution macroscopic imaging. By simply scanning the camera over different positions, we bypass the diffraction limit of the photographic lens and recover a super-resolution image of an object placed at the far field. This platform's maximum achievable resolution is ultimately determined by the camera's traveling range, not the aperture size of the lens. The FP scheme reported in this work may find applications in 3D object tracking, synthetic aperture imaging, remote sensing, and optical/electron/X-ray microscopy.

Embedded pupil function recovery for Fourier ptychographic microscopy

We develop and test a pupil function determination algorithm, termed embedded pupil function recovery (EPRY), which can be incorporated into the Fourier ptychographic microscopy (FPM) algorithm and recover both the Fourier spectrum of sample and the pupil function of imaging system simultaneously. This EPRY-FPM algorithm eliminates the requirement of the previous FPM algorithm for a priori knowledge of the aberration in the imaging system to reconstruct a high quality image. We experimentally demonstrate the effectiveness of this algorithm by reconstructing high resolution, large field-of-view images of biological samples. We also illustrate that the pupil function we retrieve can be used to study the spatially varying aberration of a large field-of-view imaging system. We believe that this algorithm adds more flexibility to FPM and can be a powerful tool for the characterization of an imaging system's aberration.

Advances in optics for biotechnology, medicine and surgery

The guest editors introduce a Biomedical Optics Express feature issue that includes contributions from participants at the 2013 conference on Advances in Optics for Biotechnology, Medicine and Surgery XIII.