Recent advances in point spread function engineering and related computational microscopy approaches: from one viewpoint

Intelligent Beam Optimization for Light-Sheet Fluorescence Microscopy through Deep Learning

Light-sheet fluorescence microscopy (LSFM) provides the benefit of optical sectioning coupled with rapid acquisition times, enabling high-resolution 3-dimensional imaging of large tissue-cleared samples. Inherent to LSFM, the quality of the imaging heavily relies on the characteristics of the illumination beam, which only illuminates a thin section of the sample. Therefore, substantial efforts are dedicated to identifying slender, nondiffracting beam profiles that yield uniform and high-contrast images. An ongoing debate concerns the identification of optimal illumination beams for different samples: Gaussian, Bessel, Airy patterns, and/or others. However, comparisons among different beam profiles are challenging as their optimization objectives are often different. Given that our large imaging datasets (approximately 0.5 TB of images per sample) are already analyzed using deep learning models, we envisioned a different approach to the problem by designing an illumination beam tailored to boost the performance of the deep learning model. We hypothesized that integrating the physical LSFM illumination model (after passing it through a variable phase mask) into the training of a cell detection network would achieve this goal. Here, we report that joint optimization continuously updates the phase mask and results in improved image quality for better cell detection. The efficacy of our method is demonstrated through both simulations and experiments that reveal substantial enhancements in imaging quality compared to the traditional Gaussian light sheet. We discuss how designing microscopy systems through a computational approach provides novel insights for advancing optical design that relies on deep learning models for the analysis of imaging datasets.

Enhancing Light-Sheet Fluorescence Microscopy Illumination Beams through Deep Design Optimization

Light sheet fluorescence microscopy (LSFM) provides the benefit of optical sectioning coupled with rapid acquisition times for imaging of tissue-cleared specimen. This allows for high-resolution 3D imaging of large tissue volumes. Inherently to LSFM, the quality of the imaging heavily relies on the characteristics of the illumination beam, with the notion that the illumination beam only illuminates a thin section that is being imaged. Therefore, substantial efforts are dedicated to identifying slender, non-diffracting beam profiles that can yield uniform and high-contrast images. An ongoing debate concerns the employment of the most optimal illumination beam; Gaussian, Bessel, Airy patterns and/or others. Comparisons among different beam profiles is challenging as their optimization objective is often different. Given that our large imaging datasets (~0.5TB images per sample) is already analyzed using deep learning models, we envisioned a different approach to this problem by hypothesizing that we can tailor the illumination beam to boost the deep learning models performance. We achieve this by integrating the physical LSFM illumination model after passing through a variable phase mask into the training of a cell detection network. Here we report that the joint optimization continuously updates the phase mask, improving the image quality for better cell detection. Our method's efficacy is demonstrated through both simulations and experiments, revealing substantial enhancements in imaging quality compared to traditional Gaussian light sheet. We offer valuable insights for designing microscopy systems through a computational approach that exhibits significant potential for advancing optics design that relies on deep learning models for analysis of imaging datasets.

Machine-Learning-Based Single-Molecule Quantification of Circulating MicroRNA Mixtures

MicroRNAs (miRs) are small noncoding RNAs that regulate gene expression and are emerging as powerful indicators of diseases. MiRs are secreted in blood plasma and thus may report on systemic aberrations at an early stage via liquid biopsy analysis. We present a method for multiplexed single-molecule detection and quantification of a selected panel of miRs. The proposed assay does not depend on sequencing, requires less than 1 mL of blood, and provides fast results by direct analysis of native, unamplified miRs. This is enabled by a novel combination of compact spectral imaging and a machine learning-based detection scheme that allows simultaneous multiplexed classification of multiple miR targets per sample. The proposed end-to-end pipeline is extremely time efficient and cost-effective. We benchmark our method with synthetic mixtures of three target miRs, showcasing the ability to quantify and distinguish subtle ratio changes between miR targets.

Versatile all-digital transport-of-intensity based wavefront sensor and adaptive optics using a DMD

Measuring and correcting wavefront aberrations is an important process in a wide variety of disciplines, from ophthalmology, laser cutting, and astronomy to free-space communication and microscopy, and always relies on measuring intensities to infer phase. One approach is to use the transport-of-intensity as a means for phase retrieval, exploiting the connection between observed energy flow in optical fields and their wavefronts. Here we present a simple scheme, using a digital micro-mirror device (DMD), to perform angular spectrum propagation and extract the wavefront of optical fields at various wavelengths, dynamically, with high resolution and tuneable sensitivity. We verify the capability of our approach by extracting common Zernike aberrations, turbulent phase screens, and lens phases under static and dynamic conditions at multiple wavelengths and polarizations. We use this setup for adaptive optics, correcting distortion using a second DMD to apply conjugate phase modulation. We observed effective wavefront recovery under a variety of conditions which allowed for convenient real-time adaptive correction in a compact arrangement. Our approach provides an all-digital system that is versatile, cheap, fast, accurate, broadband and polarization invariant.

Deep learning in single-molecule imaging and analysis: recent advances and prospects

Single-molecule microscopy is advantageous in characterizing heterogeneous dynamics at the molecular level. However, there are several challenges that currently hinder the wide application of single molecule imaging in bio-chemical studies, including how to perform single-molecule measurements efficiently with minimal run-to-run variations, how to analyze weak single-molecule signals efficiently and accurately without the influence of human bias, and how to extract complete information about dynamics of interest from single-molecule data. As a new class of computer algorithms that simulate the human brain to extract data features, deep learning networks excel in task parallelism and model generalization, and are well-suited for handling nonlinear functions and extracting weak features, which provide a promising approach for single-molecule experiment automation and data processing. In this perspective, we will highlight recent advances in the application of deep learning to single-molecule studies, discuss how deep learning has been used to address the challenges in the field as well as the pitfalls of existing applications, and outline the directions for future development.

Wavefront engineered light needle microscopy for axially resolved rapid volumetric imaging

Increasing the acquisition speed of three-dimensional volumetric images is important-particularly in biological imaging-to unveil the structural dynamics and functionalities of specimens in detail. In conventional laser scanning fluorescence microscopy, volumetric images are constructed from optical sectioning images sequentially acquired by changing the observation plane, limiting the acquisition speed. Here, we present a novel method to realize volumetric imaging from two-dimensional raster scanning of a light needle spot without sectioning, even in the traditional framework of laser scanning microscopy. Information from multiple axial planes is simultaneously captured using wavefront engineering for fluorescence signals, allowing us to readily survey the entire depth range while maintaining spatial resolution. This technique is applied to real-time and video-rate three-dimensional tracking of micrometer-sized particles, as well as the prompt visualization of thick fixed biological specimens, offering substantially faster volumetric imaging.

Biophysical Reviews: 2020-looking back, going forward

After first describing the issue contents (Biophysical Reviews-Volume 12 Issue 6), this Editorial goes on to provide a short round-up of the activities of the journal in 2020. Directly following this Editorial are two obituaries marking the recent deaths of Prof. Fumio Oosawa (Japan) and Dr. Herbert Tabor (USA)-two major figures in Biophysical/Biochemical science from the last 100 years.