Chip-scale fluorescence microscope based on a silo-filter complementary metal-oxide semiconductor image sensor

Long-term imaging of three-dimensional hyphal development using the ePetri dish

Imaging three-dimensional microbial development and behavior over extended periods is crucial for advancing microbiological studies. Here, we introduce an upgraded ePetri dish system specifically designed for extended microbial culturing and 3D imaging, addressing the limitations of existing methods. Our approach includes a sealed growth chamber to enable long-term culturing, and a multi-step reconstruction algorithm that integrates 3D deconvolution, image filtering, ridge, and skeleton detection for detailed visualization of the hyphal network. The system effectively monitored the development of Aspergillus brasiliensis hyphae over a seven-day period, demonstrating the growth medium's stability within the chamber. The system's 3D imaging capability was validated in a volume of 5.5 mm × 4 mm × 0.5 mm, revealing a radial growth pattern of fungal hyphae. Additionally, we show that the system can identify potential filter failures that are undetectable with 2D imaging. With these capabilities, the upgraded ePetri dish represents a significant advancement in long-term 3D microbial imaging, promising new insights into microbial development and behavior across various microbiological research areas.

DNF: diffractive neural field for lensless microscopic imaging

Lensless imaging has emerged as a robust means for the observation of microscopic scenes, enabling vast applications like whole-slide imaging, wave-front detection and microfluidic on-chip imaging. Such system captures diffractive measurements in a compact optical setup without the use of optical lens, and then typically applies phase retrieval algorithms to recover the complex field of target object. However existing techniques still suffer from unsatisfactory performance with noticeable reconstruction artifacts especially when the imaging parameter is not well calibrated. Here we propose a novel unsupervised Diffractive Neural Field (DNF) method to accurately characterize the imaging physical process to best reconstruct desired complex field of the target object through very limited measurement snapshots by jointly optimizing the imaging parameter and implicit mapping between spatial coordinates and complex field. Both simulations and experiments reveal the superior performance of proposed method, having > 6 dB PSNR (Peak Signal-to-Noise Ratio) gains on synthetic data quantitatively, and clear qualitative improvement on real-world samples. The proposed DNF also promises attractive prospects in practical applications because of its ultra lightweight complexity (e.g., 50× model size reduction) and plug-to-play advantage (e.g., random measurements with a coarse parameter estimation).

Microscope autofocus algorithm based on number of image slope variations

This paper presents a passive autofocus algorithm applicable to interferometric microscopes. The proposed algorithm uses the number of slope variations in an image mask to locate the focal plane (based on focus-inflection points) and identify the two neighboring planes at which fringes respectively appear and disappear. In experiments involving a Mirau objective lens, the proposed algorithm matched the autofocusing performance of conventional algorithms, and significantly outperformed detection schemes based on zero-order interference fringe in dealing with all kinds of surface blemish, regardless of severity. In experiments, the proposed algorithm also proved highly effective in cases without fringes.

Lensless imaging of plant samples using the cross-polarized light

Lensless imaging has recently become an alternative and cost-effective choice for many macro and micro applications, like wave-front sensing, fluorescence imaging, holographic microscopy, and so on. However, the polarized imaging, especially the cross-polarized light, has rarely been explored and integrated in lensless imaging methods. In this paper, we introduce the cross-polarized illumination into the lensless system for high-contrast and background-free imaging of plant samples. We capture a snapshot measurement and apply the blind deconvolution for reconstruction, obtaining the depolarized imaging of plant samples. Experiments exhibit the specific and sparse structures of the root system and vessel distribution of samples. We also build a corresponding lens-based system for performance comparison. This proposed lensless system is believed to have the potential in studies on the root development and water transport mechanism of plants in the future.

Microfluidic Based Optical Microscopes on Chip

Last decade's advancements in optofluidics allowed obtaining an ever increasing integration of different functionalities in lab on chip devices to culture, analyze, and manipulate single cells and entire biological specimens. Despite the importance of optical imaging for biological sample monitoring in microfluidics, imaging is traditionally achieved by placing microfluidics channels in standard bench-top optical microscopes. Recently, the development of either integrated optical elements or lensless imaging methods allowed optical imaging techniques to be implemented in lab on chip systems, thus increasing their automation, compactness, and portability. In this review, we discuss known solutions to implement microscopes on chip that exploit different optical methods such as bright-field, phase contrast, holographic, and fluorescence microscopy.

Challenges in paper-based fluorogenic optical sensing with smartphones

Application of optically superior, tunable fluorescent nanotechnologies have long been demonstrated throughout many chemical and biological sensing applications. Combined with microfluidics technologies, i.e. on lab-on-a-chip platforms, such fluorescent nanotechnologies have often enabled extreme sensitivity, sometimes down to single molecule level. Within recent years there has been a peak interest in translating fluorescent nanotechnology onto paper-based platforms for chemical and biological sensing, as a simple, low-cost, disposable alternative to conventional silicone-based microfluidic substrates. On the other hand, smartphone integration as an optical detection system as well as user interface and data processing component has been widely attempted, serving as a gateway to on-board quantitative processing, enhanced mobility, and interconnectivity with informational networks. Smartphone sensing can be integrated to these paper-based fluorogenic assays towards demonstrating extreme sensitivity as well as ease-of-use and low-cost. However, with these emerging technologies there are always technical limitations that must be addressed; for example, paper's autofluorescence that perturbs fluorogenic sensing; smartphone flash's limitations in fluorescent excitation; smartphone camera's limitations in detecting narrow-band fluorescent emission, etc. In this review, physical optical setups, digital enhancement algorithms, and various fluorescent measurement techniques are discussed and pinpointed as areas of opportunities to further improve paper-based fluorogenic optical sensing with smartphones.

Single-frame 3D fluorescence microscopy with ultraminiature lensless FlatScope

Modern biology increasingly relies on fluorescence microscopy, which is driving demand for smaller, lighter, and cheaper microscopes. However, traditional microscope architectures suffer from a fundamental trade-off: As lenses become smaller, they must either collect less light or image a smaller field of view. To break this fundamental trade-off between device size and performance, we present a new concept for three-dimensional (3D) fluorescence imaging that replaces lenses with an optimized amplitude mask placed a few hundred micrometers above the sensor and an efficient algorithm that can convert a single frame of captured sensor data into high-resolution 3D images. The result is FlatScope: perhaps the world's tiniest and lightest microscope. FlatScope is a lensless microscope that is scarcely larger than an image sensor (roughly 0.2 g in weight and less than 1 mm thick) and yet able to produce micrometer-resolution, high-frame rate, 3D fluorescence movies covering a total volume of several cubic millimeters. The ability of FlatScope to reconstruct full 3D images from a single frame of captured sensor data allows us to image 3D volumes roughly 40,000 times faster than a laser scanning confocal microscope while providing comparable resolution. We envision that this new flat fluorescence microscopy paradigm will lead to implantable endoscopes that minimize tissue damage, arrays of imagers that cover large areas, and bendable, flexible microscopes that conform to complex topographies.

Single-frame 3D fluorescence microscopy with ultraminiature lensless FlatScope

Modern biology increasingly relies on fluorescence microscopy, which is driving demand for smaller, lighter, and cheaper microscopes. However, traditional microscope architectures suffer from a fundamental trade-off: As lenses become smaller, they must either collect less light or image a smaller field of view. To break this fundamental trade-off between device size and performance, we present a new concept for three-dimensional (3D) fluorescence imaging that replaces lenses with an optimized amplitude mask placed a few hundred micrometers above the sensor and an efficient algorithm that can convert a single frame of captured sensor data into high-resolution 3D images. The result is FlatScope: perhaps the world's tiniest and lightest microscope. FlatScope is a lensless microscope that is scarcely larger than an image sensor (roughly 0.2 g in weight and less than 1 mm thick) and yet able to produce micrometer-resolution, high-frame rate, 3D fluorescence movies covering a total volume of several cubic millimeters. The ability of FlatScope to reconstruct full 3D images from a single frame of captured sensor data allows us to image 3D volumes roughly 40,000 times faster than a laser scanning confocal microscope while providing comparable resolution. We envision that this new flat fluorescence microscopy paradigm will lead to implantable endoscopes that minimize tissue damage, arrays of imagers that cover large areas, and bendable, flexible microscopes that conform to complex topographies.

Unconventional methods of imaging: computational microscopy and compact implementations

In the past two decades or so, there has been a renaissance of optical microscopy research and development. Much work has been done in an effort to improve the resolution and sensitivity of microscopes, while at the same time to introduce new imaging modalities, and make existing imaging systems more efficient and more accessible. In this review, we look at two particular aspects of this renaissance: computational imaging techniques and compact imaging platforms. In many cases, these aspects go hand-in-hand because the use of computational techniques can simplify the demands placed on optical hardware in obtaining a desired imaging performance. In the first main section, we cover lens-based computational imaging, in particular, light-field microscopy, structured illumination, synthetic aperture, Fourier ptychography, and compressive imaging. In the second main section, we review lensfree holographic on-chip imaging, including how images are reconstructed, phase recovery techniques, and integration with smart substrates for more advanced imaging tasks. In the third main section we describe how these and other microscopy modalities have been implemented in compact and field-portable devices, often based around smartphones. Finally, we conclude with some comments about opportunities and demand for better results, and where we believe the field is heading.

Lensless Imaging and Sensing

High-resolution optical microscopy has traditionally relied on high-magnification and high-numerical aperture objective lenses. In contrast, lensless microscopy can provide high-resolution images without the use of any focusing lenses, offering the advantages of a large field of view, high resolution, cost-effectiveness, portability, and depth-resolved three-dimensional (3D) imaging. Here we review various approaches to lensless imaging, as well as its applications in biosensing, diagnostics, and cytometry. These approaches include shadow imaging, fluorescence, holography, superresolution 3D imaging, iterative phase recovery, and color imaging. These approaches share a reliance on computational techniques, which are typically necessary to reconstruct meaningful images from the raw data captured by digital image sensors. When these approaches are combined with physical innovations in sample preparation and fabrication, lensless imaging can be used to image and sense cells, viruses, nanoparticles, and biomolecules. We conclude by discussing several ways in which lensless imaging and sensing might develop in the near future.

Compact Wireless Microscope for In-Situ Time Course Study of Large Scale Cell Dynamics within an Incubator

Imaging of live cells in a region of interest is essential to life science research. Unlike the traditional way that mounts CO2 incubator onto a bulky microscope for observation, here we propose a wireless microscope (termed w-SCOPE) that is based on the “microscope-in-incubator” concept and can be easily housed into a standard CO2 incubator for prolonged on-site observation of the cells. The w-SCOPE is capable of tunable magnification, remote control and wireless image transmission. At the same time, it is compact, measuring only ~10 cm in each dimension, and cost-effective. With the enhancement of compressive sensing computation, the acquired images can achieve a wide field of view (FOV) of ~113 mm² as well as a cellular resolution of ~3 μm, which enables various forms of follow-up image-based cell analysis. We performed 12 hours time-lapse study on paclitaxel-treated MCF-7 and HEK293T cell lines using w-SCOPE. The analytic results, such as the calculated viability and therapeutic window, from our device were validated by standard cell detection assays and imaging-based cytometer. In addition to those end-point detection methods, w-SCOPE further uncovered the time course of the cell’s response to the drug treatment over the whole period of drug exposure.

A smartphone-based chip-scale microscope using ambient illumination

Portable chip-scale microscopy devices can potentially address various imaging needs in mobile healthcare and environmental monitoring. Here, we demonstrate the adaptation of a smartphone's camera to function as a compact lensless microscope. Unlike other chip-scale microscopy schemes, this method uses ambient illumination as its light source and does not require the incorporation of a dedicated light source. The method is based on the shadow imaging technique where the sample is placed on the surface of the image sensor, which captures direct shadow images under illumination. To improve the image resolution beyond the pixel size, we perform pixel super-resolution reconstruction with multiple images at different angles of illumination, which are captured while the user is manually tilting the device around any ambient light source, such as the sun or a lamp. The lensless imaging scheme allows for sub-micron resolution imaging over an ultra-wide field-of-view (FOV). Image acquisition and reconstruction are performed on the device using a custom-built Android application, constructing a stand-alone imaging device for field applications. We discuss the construction of the device using a commercial smartphone and demonstrate the imaging capabilities of our system.