Adaptive optical fluorescence microscopy

Applications of Lightsheet Fluorescence Microscopy by High Numerical Aperture Detection Lens

This Review explores the evolution, improvements, and recent applications of Light Sheet Fluorescence Microscopy (LSFM) in biological research using a high numerical aperture detection objective (lens) for imaging subcellular structures. The Review begins with an overview of the development of LSFM, tracing its evolution from its inception to its current state and emphasizing key milestones and technological advancements over the years. Subsequently, we will discuss various improvements of LSFM techniques, covering advancements in hardware such as illumination strategies, optical designs, and sample preparation methods that have enhanced imaging capabilities and resolution. The advancements in data acquisition and processing are also included, which provides a brief overview of the recent development of artificial intelligence. Fluorescence probes that were commonly used in LSFM will be highlighted, together with some insights regarding the selection of potential probe candidates for future LSFM development. Furthermore, we also discuss recent advances in the application of LSFM with a focus on high numerical aperture detection objectives for various biological studies. For sample preparation techniques, there are discussions regarding fluorescence probe selection, tissue clearing protocols, and some insights into expansion microscopy. Integrated setups such as adaptive optics, single objective modification, and microfluidics will also be some of the key discussion points in this Review. We hope that this comprehensive Review will provide a holistic perspective on the historical development, technical enhancements, and cutting-edge applications of LSFM, showcasing its pivotal role and future potential in advancing biological research.

Optimization and realignment of OAM mode excitation in ring-core optical fibers using machine learning

Light beams carrying orbital angular momentum (OAM) in free space or within optical fibers have a wide range of applications in optics; however, exciting these modes with both high purity and low loss generally requires demanding optimization of excitation conditions in a high dimensional space. Furthermore, mechanical drift can significantly degrade the mode purity over time, which may limit practical deployment of OAM modes in concrete applications. Here, combining an iterative wavefront matching approach and a genetic algorithm, we demonstrate rapid and automated excitation of OAM modes with optimized purity and reduced loss. Our approach allows for systematic computational realignment of the system enabling drift compensation over extended durations. Our experimental results indicate that OAM purity can be optimized and maintained over periods exceeding 24 h, paving the way for the applications of stable OAM beams in optics.

Ultralow radiant exposure of a short-pulsed laser to disrupt melanosomes with localized thermal damage through a turbid medium

Short-pulsed lasers can treat dermal pigmented lesions through selective photothermolysis. The irradiated light experiences multiple scattering by the skin and is absorbed by abnormal melanosomes as well as by normal blood vessels above the target. Because the fluence is extremely high, the absorbed light can cause thermal damage to the adjacent tissue components, leading to complications. To minimize radiant exposure and reduce the risk of burns, a model of the melanosome-disruption threshold fluence (MDTF) has been developed that accounts for the light-propagation efficiency in the skin. However, the light-propagation efficiency is attenuated because of multiple scattering, which limits the extent to which the radiant exposure required for treatment can be reduced. Here, this study demonstrates the principle of melanosome disruption with localized thermal damage through a turbid medium by ultralow radiant exposure of a short-pulsed laser. The MDTF model was combined with a wavefront-shaping technique to design an irradiation condition that can increase the light-propagation efficiency to the target. Under this irradiation condition, melanosomes were disrupted at a radiant exposure 25 times lower than the minimal value used in conventional laser treatments. Furthermore, almost no thermal damage to the skin was confirmed through a numerical simulation. These experimental and numerical results show the potential for noninvasive melanosome disruption and may lead to the improvement of the safety of short-pulsed laser treatment.

A Simple Doublet Lens Design for Mid-Infrared Imaging

Wide-field mid-infrared (MIR) hyperspectral imaging offers a promising approach for studying heterogeneous chemical systems due to its ability to independently characterize the molecular properties of different regions of a sample. However, applications of wide-field MIR microscopy are limited to spatial resolutions no better than ∼1 μm. While methods exist to overcome the classical diffraction limit of ∼λ/2, chromatic aberration from transmissive imaging reduces the achievable resolution. Here we describe the design and implementation of a simple MIR achromatic lens combination that we believe will aid in the development of resolution-enhanced wide-field MIR hyperspectral optical and chemical absorption imaging. We also examine the use of this doublet lens to image through polystyrene microspheres, an emerging and simple means for enhancing spatial resolution.

Nonlinear Optical Properties of 2D Materials and their Applications

2D materials are a subject of intense research in recent years owing to their exclusive photoelectric properties. With giant nonlinear susceptibility and perfect phase matching, 2D materials have marvelous nonlinear light-matter interactions. The nonlinear optical properties of 2D materials are of great significance to the design and analysis of applied materials and functional devices. Here, the fundamental of nonlinear optics (NLO) for 2D materials is introduced, and the methods for characterizing and measuring second-order and third-order nonlinear susceptibility of 2D materials are reviewed. Furthermore, the theoretical and experimental values of second-order susceptibility χ(2) and third-order susceptibility χ(3) are tabulated. Several applications and possible future research directions of second-harmonic generation (SHG) and third-harmonic generation (THG) for 2D materials are presented.

Deep learning-based aberration compensation improves contrast and resolution in fluorescence microscopy

Optical aberrations hinder fluorescence microscopy of thick samples, reducing image signal, contrast, and resolution. Here we introduce a deep learning-based strategy for aberration compensation, improving image quality without slowing image acquisition, applying additional dose, or introducing more optics into the imaging path. Our method (i) introduces synthetic aberrations to images acquired on the shallow side of image stacks, making them resemble those acquired deeper into the volume and (ii) trains neural networks to reverse the effect of these aberrations. We use simulations and experiments to show that applying the trained 'de-aberration' networks outperforms alternative methods, providing restoration on par with adaptive optics techniques; and subsequently apply the networks to diverse datasets captured with confocal, light-sheet, multi-photon, and super-resolution microscopy. In all cases, the improved quality of the restored data facilitates qualitative image inspection and improves downstream image quantitation, including orientational analysis of blood vessels in mouse tissue and improved membrane and nuclear segmentation in C. elegans embryos.

Sensorless adaptive optics in the second near-infrared window for deep vascular imaging in vivo

We have experimentally validated the use of sensorless adaptive optics (AO) to enhance laser scanning confocal microscopy in the second near-infrared (NIR II) spectral range, termed as AO-NIR II confocal microscopy. This approach harnesses a NIR II fluorophore, excited by an 808 nm wavelength and emitting beyond 1000 nm, to visualize intricate structures in deep brain tissues with the intact skull. By leveraging the reduced scattering and aberrations in the NIR II spectrum, we successfully captured a three-dimensional (3D) vascular structure map extending 310 µm beneath the skull. AO typically boosts the fluorescence signal by approximately 2-3 times, leading to a superior contrast and diminished smearing effects. Consequently, small blood vessels at various depths can be clearly visualized, which might otherwise remain undetectable without AO corrections.

Non-invasive and noise-robust light focusing using confocal wavefront shaping

Wavefront-shaping is a promising approach for imaging fluorescent targets deep inside scattering tissue despite strong aberrations. It enables focusing an incoming illumination into a single spot inside tissue, as well as correcting the outgoing light scattered from the tissue. Previously, wavefront shaping modulations have been successively estimated using feedback from strong fluorescent beads, which have been manually added to a sample. However, such algorithms do not generalize to neurons whose emission is orders of magnitude weaker. We suggest a wavefront shaping approach that works with a confocal modulation of both the illumination and imaging arms. Since the aberrations are corrected in the optics before the detector, the low photon budget is directed into a single sensor spot and detected with high signal-noise ratio. We derive a score function for modulation evaluation from mathematical principles, and successfully use it to image fluorescence neurons, despite scattering through thick tissue.

Temporal-Focusing Multiphoton Excitation Single-Molecule Localization Microscopy Using Spontaneously Blinking Fluorophores

Single-molecule localization microscopy (SMLM) based on temporal-focusing multiphoton excitation (TFMPE) and single-wavelength excitation is used to visualize the three-dimensional (3D) distribution of spontaneously blinking fluorophore-labeled subcellular structures in a thick specimen with a nanoscale-level spatial resolution. To eliminate the photobleaching effect of unlocalized molecules in out-of-focus regions for improving the utilization rate of the photon budget in 3D SMLM imaging, SMLM with single-wavelength TFMPE achieves wide-field and axially confined two-photon excitation (TPE) of spontaneously blinking fluorophores. TPE spectral measurement of blinking fluorophores is then conducted through TFMPE imaging at a tunable excitation wavelength, yielding the optimal TPE wavelength for increasing the number of detected photons from a single blinking event during SMLM. Subsequently, the TPE fluorescence of blinking fluorophores is recorded to obtain a two-dimensional TFMPE-SMLM image of the microtubules in cancer cells with a localization precision of 18±6 nm and an overall imaging resolution of approximately 51 nm, which is estimated based on the contribution of Nyquist resolution and localization precision. Combined with astigmatic imaging, the system is capable of 3D TFMPE-SMLM imaging of brain tissue section of a 5XFAD transgenic mouse with the pathological features of Alzheimer's disease, revealing the distribution of neurotoxic amyloid-beta peptide deposits.

Live-cell imaging powered by computation

The proliferation of microscopy methods for live-cell imaging offers many new possibilities for users but can also be challenging to navigate. The prevailing challenge in live-cell fluorescence microscopy is capturing intra-cellular dynamics while preserving cell viability. Computational methods can help to address this challenge and are now shifting the boundaries of what is possible to capture in living systems. In this Review, we discuss these computational methods focusing on artificial intelligence-based approaches that can be layered on top of commonly used existing microscopies as well as hybrid methods that integrate computation and microscope hardware. We specifically discuss how computational approaches can improve the signal-to-noise ratio, spatial resolution, temporal resolution and multi-colour capacity of live-cell imaging.

Advancements and Practical Considerations for Biophysical Research: Navigating the Challenges and Future of Super-resolution Microscopy

The introduction of super-resolution microscopy (SRM) has significantly advanced our understanding of cellular and molecular dynamics, offering a detailed view previously beyond our reach. Implementing SRM in biophysical research, however, presents numerous challenges. This review addresses the crucial aspects of utilizing SRM effectively, from selecting appropriate fluorophores and preparing samples to analyzing complex data sets. We explore recent technological advancements and methodological improvements that enhance the capabilities of SRM. Emphasizing the integration of SRM with other analytical methods, we aim to overcome inherent limitations and expand the scope of biological insights achievable. By providing a comprehensive guide for choosing the most suitable SRM methods based on specific research objectives, we aim to empower researchers to explore complex biological processes with enhanced precision and clarity, thereby advancing the frontiers of biophysical research.

Fourier space aberration correction for high resolution refractive index imaging using incoherent light

An aberration correction method is introduced for 3D phase deconvolution microscopy. Our technique capitalizes on multiple illumination patterns to iteratively extract Fourier space aberrations, utilizing the overlapping information inherent in these patterns. By refining the point spread function based on the retrieved aberration data, we significantly improve the precision of refractive index deconvolution. We validate the effectiveness of our method on both synthetic and biological three-dimensional samples, achieving notable enhancements in resolution and measurement accuracy. The method's reliability in aberration retrieval is further confirmed through controlled experiments with intentionally induced spherical aberrations, underscoring its potential for wide-ranging applications in microscopy and biomedicine.

Magnetic voluntary head-fixation in transgenic rats enables lifespan imaging of hippocampal neurons

The precise neural mechanisms within the brain that contribute to the remarkable lifetime persistence of memory are not fully understood. Two-photon calcium imaging allows the activity of individual cells to be followed across long periods, but conventional approaches require head-fixation, which limits the type of behavior that can be studied. We present a magnetic voluntary head-fixation system that provides stable optical access to the brain during complex behavior. Compared to previous systems that used mechanical restraint, there are no moving parts and animals can engage and disengage entirely at will. This system is failsafe, easy for animals to use and reliable enough to allow long-term experiments to be routinely performed. Animals completed hundreds of trials per session of an odor discrimination task that required 2-4 s fixations. Together with a reflectance fluorescence collection scheme that increases two-photon signal and a transgenic Thy1-GCaMP6f rat line, we are able to reliably image the cellular activity in the hippocampus during behavior over long periods (median 6 months), allowing us track the same neurons over a large fraction of animals' lives (up to 19 months).

Adaptive optical third-harmonic generation microscopy for in vivo imaging of tissues

Third-harmonic generation microscopy is a powerful label-free nonlinear imaging technique, providing essential information about structural characteristics of cells and tissues without requiring external labelling agents. In this work, we integrated a recently developed compact adaptive optics module into a third-harmonic generation microscope, to measure and correct for optical aberrations in complex tissues. Taking advantage of the high sensitivity of the third-harmonic generation process to material interfaces and thin membranes, along with the 1,300-nm excitation wavelength used here, our adaptive optical third-harmonic generation microscope enabled high-resolution in vivo imaging within highly scattering biological model systems. Examples include imaging of myelinated axons and vascular structures within the mouse spinal cord and deep cortical layers of the mouse brain, along with imaging of key anatomical features in the roots of the model plant Brachypodium distachyon. In all instances, aberration correction led to significant enhancements in image quality.

Vascularized organoid-on-a-chip: design, imaging, and analysis

Vascularized organoid-on-a-chip (VOoC) models achieve substance exchange in deep layers of organoids and provide a more physiologically relevant system in vitro. Common designs for VOoC primarily involve two categories: self-assembly of endothelial cells (ECs) to form microvessels and pre-patterned vessel lumens, both of which include the hydrogel region for EC growth and allow for controlled fluid perfusion on the chip. Characterizing the vasculature of VOoC often relies on high-resolution microscopic imaging. However, the high scattering of turbid tissues can limit optical imaging depth. To overcome this limitation, tissue optical clearing (TOC) techniques have emerged, allowing for 3D visualization of VOoC in conjunction with optical imaging techniques. The acquisition of large-scale imaging data, coupled with high-resolution imaging in whole-mount preparations, necessitates the development of highly efficient analysis methods. In this review, we provide an overview of the chip designs and culturing strategies employed for VOoC, as well as the applicable optical imaging and TOC methods. Furthermore, we summarize the vascular analysis techniques employed in VOoC, including deep learning. Finally, we discuss the existing challenges in VOoC and vascular analysis methods and provide an outlook for future development.

Cortex-wide transcranial localization microscopy with fluorescently labeled red blood cells

Large-scale imaging of brain activity with high spatio-temporal resolution is crucial for advancing our understanding of brain function. The existing neuroimaging techniques are largely limited by restricted field of view, slow imaging speed, or otherwise do not have the adequate spatial resolution to capture brain activities on a capillary and cellular level. To address these limitations, we introduce fluorescence localization microscopy aided with sparsely-labeled red blood cells for cortex-wide morphological and functional cerebral angiography with 4.9 µm spatial resolution and 1 s temporal resolution. When combined with fluorescence calcium imaging, the proposed method enables extended recordings of stimulus-evoked neuro-vascular changes in the murine brain while providing simultaneous multiparametric readings of intracellular neuronal activity, blood flow velocity/direction/volume, and vessel diameter. Owing to its simplicity and versatility, the proposed approach will become an invaluable tool for deciphering the regulation of cortical microcirculation and neurovascular coupling in health and disease.

Adaptive optical imaging with entangled photons

Adaptive optics (AO) has revolutionized imaging in fields from astronomy to microscopy by correcting optical aberrations. In label-free microscopes, however, conventional AO faces limitations because of the absence of a guide star and the need to select an optimization metric specific to the sample and imaging process. Here, we propose an AO approach leveraging correlations between entangled photons to directly correct the point spread function. This guide star-free method is independent of the specimen and imaging modality. We demonstrate the imaging of biological samples in the presence of aberrations using a bright-field imaging setup operating with a source of spatially entangled photon pairs. Our approach performs better than conventional AO in correcting specific aberrations, particularly those involving substantial defocus. Our work improves AO for label-free microscopy and could play a major role in the development of quantum microscopes.

Shedding light on ultrasound in action: Optical and optoacoustic monitoring of ultrasound brain interventions

Monitoring brain responses to ultrasonic interventions is becoming an important pillar of a growing number of applications employing acoustic waves to actuate and cure the brain. Optical interrogation of living tissues provides a unique means for retrieving functional and molecular information related to brain activity and disease-specific biomarkers. The hybrid optoacoustic imaging methods have further enabled deep-tissue imaging with optical contrast at high spatial and temporal resolution. The marriage between light and sound thus brings together the highly complementary advantages of both modalities toward high precision interrogation, stimulation, and therapy of the brain with strong impact in the fields of ultrasound neuromodulation, gene and drug delivery, or noninvasive treatments of neurological and neurodegenerative disorders. In this review, we elaborate on current advances in optical and optoacoustic monitoring of ultrasound interventions. We describe the main principles and mechanisms underlying each method before diving into the corresponding biomedical applications. We identify areas of improvement as well as promising approaches with clinical translation potential.

Nanocrystals for Deep-Tissue In Vivo Luminescence Imaging in the Near-Infrared Region

In vivo imaging technologies have emerged as a powerful tool for both fundamental research and clinical practice. In particular, luminescence imaging in the tissue-transparent near-infrared (NIR, 700-1700 nm) region offers tremendous potential for visualizing biological architectures and pathophysiological events in living subjects with deep tissue penetration and high imaging contrast owing to the reduced light-tissue interactions of absorption, scattering, and autofluorescence. The distinctive quantum effects of nanocrystals have been harnessed to achieve exceptional photophysical properties, establishing them as a promising category of luminescent probes. In this comprehensive review, the interactions between light and biological tissues, as well as the advantages of NIR light for in vivo luminescence imaging, are initially elaborated. Subsequently, we focus on achieving deep tissue penetration and improved imaging contrast by optimizing the performance of nanocrystal fluorophores. The ingenious design strategies of NIR nanocrystal probes are discussed, along with their respective biomedical applications in versatile in vivo luminescence imaging modalities. Finally, thought-provoking reflections on the challenges and prospects for future clinical translation of nanocrystal-based in vivo luminescence imaging in the NIR region are wisely provided.

Single-shot digital optical fluorescence phase conjugation through forward multiple-scattering samples

Aberrations and multiple scattering in biological tissues critically distort light beams into highly complex speckle patterns. In this regard, digital optical phase conjugation (DOPC) is a promising technique enabling in-depth focusing. However, DOPC becomes challenging when using fluorescent guide stars for four main reasons: the low photon budget available, the large spectral bandwidth of the fluorescent signal, the Stokes shift between the emission and the excitation wavelength, and the absence of reference beam preventing holographic measurement. Here, we demonstrate the possibility to focus a laser beam through multiple-scattering samples by measuring speckle fields in a single acquisition step with a reference-free, high-resolution wavefront sensor. By taking advantage of the large spectral bandwidth of forward multiply scattering samples, digital fluorescence phase conjugation is achieved to focus a laser beam at the excitation wavelength while measuring the broadband speckle field arising from a micrometer-sized fluorescent bead.

Phase diversity-based wavefront sensing for fluorescence microscopy

Fluorescence microscopy is an invaluable tool in biology, yet its performance is compromised when the wavefront of light is distorted due to optical imperfections or the refractile nature of the sample. Such optical aberrations can dramatically lower the information content of images by degrading image contrast, resolution, and signal. Adaptive optics (AO) methods can sense and subsequently cancel the aberrated wavefront, but are too complex, inefficient, slow, or expensive for routine adoption by most labs. Here we introduce a rapid, sensitive, and robust wavefront sensing scheme based on phase diversity, a method successfully deployed in astronomy but underused in microscopy. Our method enables accurate wavefront sensing to less than λ/35 root mean square (RMS) error with few measurements, and AO with no additional hardware besides a corrective element. After validating the method with simulations, we demonstrate calibration of a deformable mirror > 100-fold faster than comparable methods (corresponding to wavefront sensing on the ~100 ms scale), and sensing and subsequent correction of severe aberrations (RMS wavefront distortion exceeding λ/2), restoring diffraction-limited imaging on extended biological samples.

Three-Photon Infrared Stimulation of Endogenous Neuroreceptors in Vivo

To interrogate neural circuits and crack their codes, in vivo brain activity imaging must be combined with spatiotemporally precise stimulation in three dimensions using genetic or pharmacological specificity. This challenge requires deep penetration and focusing as provided by infrared light and multiphoton excitation, and has promoted two-photon photopharmacology and optogenetics. However, three-photon brain stimulation in vivo remains to be demonstrated. We report the regulation of neuronal activity in zebrafish larvae by three-photon excitation of a photoswitchable muscarinic agonist at 50 pM, a billion-fold lower concentration than used for uncaging, and with mid-infrared light of 1560 nm, the longest reported photoswitch wavelength. Robust, physiologically relevant photoresponses allow modulating brain activity in wild-type animals with spatiotemporal and pharmacological precision. Computational calculations predict that azobenzene-based ligands have high three-photon absorption cross-section and can be used directly with pulsed infrared light. The expansion of three-photon pharmacology will deeply impact basic neurobiology and neuromodulation phototherapies.

Fluorescence-Based Mono- and Multimodal Imaging for In Vivo Tracking of Mesenchymal Stem Cells

The advancement of stem cell therapy has offered transformative therapeutic outcomes for a wide array of diseases over the past decades. Consequently, stem cell tracking has become significant in revealing the mechanisms of action and ensuring safe and effective treatments. Fluorescence stands out as a promising choice for stem cell tracking due to its myriad advantages, including high resolution, real-time monitoring, and multi-fluorescence detection. Furthermore, combining fluorescence with other tracking modalities-such as bioluminescence imaging (BLI), positron emission tomography (PET), photoacoustic (PA), computed tomography (CT), and magnetic resonance (MR)-can address the limitations of single fluorescence detection. This review initially introduces stem cell tracking using fluorescence imaging, detailing various labeling strategies such as green fluorescence protein (GFP) tagging, fluorescence dye labeling, and nanoparticle uptake. Subsequently, we present several combinations of strategies for efficient and precise detection.

Measurement precision bounds on aberrated single molecule emission patterns

Single-Molecule Localization Microscopy (SMLM) has revolutionized the study of biological phenomena by providing exquisite nanoscale spatial resolution. However, optical aberrations induced by sample and system imperfections distort the single molecule emission patterns (i.e. PSFs), leading to reduced precision and resolution of SMLM, particularly in three-dimensional (3D) applications. While various methods, both analytical and instrumental, have been employed to mitigate these aberrations, a comprehensive analysis of how different types of commonly encountered aberrations affect single molecule experiments and their image formation remains missing. In this study, we addressed this gap by conducting a quantitative study of the theoretical precision limit for position and wavefront distortion measurements in the presence of aberrations. Leveraging Fisher information and Cramér-Rao lower bound (CRLB), we quantitively analyzed and compared the effects of different aberration types, including index mismatch aberrations, on localization precision in both biplane and astigmatism 3D modalities as well as 2D SMLM imaging. Furthermore, we studied the achievable wavefront estimation precision from aberrated single molecule emission patterns, a pivot step for successful adaptive optics in SMLM through thick specimens. This analysis lays a quantitative foundation for the development and application of SMLM in whole-cells, tissues and with large field of view, providing in-depth insights into the behavior of different aberration types in single molecule imaging and thus generating theoretical guidelines for developing highly efficient aberration correction strategies and enhancing the precision and reliability of 3D SMLM.

Tandem aberration correction optics (TACO) in wide-field structured illumination microscopy

Structured illumination microscopy (SIM) is a powerful super-resolution imaging technique that uses patterned illumination to down-modulate high spatial-frequency information of samples. However, the presence of spatially-dependent aberrations can severely disrupt the illumination pattern, limiting the quality of SIM imaging. Conventional adaptive optics (AO) techniques that employ wavefront correctors at the pupil plane are not capable of effectively correcting these spatially-dependent aberrations. We introduce the Tandem Aberration Correction Optics (TACO) approach that combines both pupil AO and conjugate AO for aberration correction in SIM. TACO incorporates a deformable mirror (DM) for pupil AO in the detection path to correct for global aberrations, while a spatial light modulator (SLM) is placed at the plane conjugate to the aberration source near the sample plane, termed conjugate AO, to compensate spatially-varying aberrations in the illumination path. Our numerical simulations and experimental results show that the TACO approach can recover the illumination pattern close to an ideal condition, even when severely misshaped by aberrations, resulting in high-quality super-resolution SIM reconstruction. The TACO approach resolves a critical traditional shortcoming of aberration correction for structured illumination. This advance significantly expands the application of SIM imaging in the study of complex, particularly biological, samples and should be effective in other wide-field microscopies.

Large field of view aberrations correction with deformable lenses and multi conjugate adaptive optics

Optical microscopes can have limited resolution due to aberrations caused by samples and sample holders. Using deformable mirrors and wavefront sensorless optimization algorithms can correct these aberrations, but the correction is limited to a small area of the field of view. This study presents an adaptive optics method that uses a series of plug-and-play deformable lenses for large field of view wavefront correction. A direct wavefront measurement method using the spinning sub-pupil aberration measurement technique is combined with correction based on the deformable lenses. Experimental results using fluorescence microscopy with a wide field and a light sheet fluorescence microscope show that the proposed method can achieve detection and correction over an extended field of view with a compact transmissive module placed in the detection path of the microscope. This method could improve the resolution and accuracy of imaging in a variety of fields, including biology and materials science.

Construction and use of an adaptive optics two-photon microscope with direct wavefront sensing

Two-photon microscopy, combined with the appropriate optical labelling, enables the measurement and tracking of submicrometer structures within brain cells, as well as the spatiotemporal mapping of spikes in individual neurons and of neurotransmitter release in individual synapses. Yet, the spatial resolution of two-photon microscopy rapidly degrades as imaging is attempted at depths of more than a few scattering lengths into tissue, i.e., below the superficial layers that constitute the top 300-400 µm of the neocortex. To obviate this limitation, we shape the focal volume, generated by the excitation beam, by modulating the incident wavefront via guidestar-assisted adaptive optics. Here, we describe the construction, calibration and operation of a two-photon microscope that incorporates adaptive optics to restore diffraction-limited resolution at depths close to 900 µm in the mouse cortex. Our setup detects a guidestar formed by the excitation of a red-shifted dye in blood serum, used to directly measure the wavefront. We incorporate predominantly commercially available optical, optomechanical, mechanical and electronic components, and supply computer-aided design models of other customized components. The resulting adaptive optics two-photon microscope is modular and allows for expanded imaging and optical excitation capabilities. We demonstrate our methodology in the mouse neocortex by imaging the morphology of somatostatin-expressing neurons that lie 700 µm beneath the pia, calcium dynamics of layer 5b projection neurons and thalamocortical glutamate transmission to L4 neurons. The protocol requires ~30 d to complete and is suitable for users with graduate-level expertise in optics.

An optical clearing imaging window: Realization of mouse brain imaging and manipulation through scalp and skull

Cortical visualization is essential to understand the dynamic changes in brain microenvironment under physiopathological conditions. However, the turbid scalp and skull severely limit the imaging depth and resolution. Existing cranial windows require invasive scalp excision and various subsequent skull treatments. Non-invasive in vivo imaging of skull bone marrow, meninges, and cortex through scalp and skull with high resolution yet remains a challenge. In this work, a non-invasive trans-scalp/skull optical clearing imaging window is proposed for cortical and calvarial imaging, which is achieved by applying a novel skin optical clearing reagent. The imaging depth and resolution are greatly enhanced in near infrared imaging and optical coherence tomography imaging. Combining this imaging window with adaptive optics, we achieve the visualization and manipulation of the calvarial and cortical microenvironment through the scalp and skull using two-photon imaging for the first time. Our method provides a well-performed imaging window and paves the way for intravital brain studies with the advantages of easy-operation, convenience and non-invasiveness.

E2E-BPF microscope: extended depth-of-field microscopy using learning-based implementation of binary phase filter and image deconvolution

Several image-based biomedical diagnoses require high-resolution imaging capabilities at large spatial scales. However, conventional microscopes exhibit an inherent trade-off between depth-of-field (DoF) and spatial resolution, and thus require objects to be refocused at each lateral location, which is time consuming. Here, we present a computational imaging platform, termed E2E-BPF microscope, which enables large-area, high-resolution imaging of large-scale objects without serial refocusing. This method involves a physics-incorporated, deep-learned design of binary phase filter (BPF) and jointly optimized deconvolution neural network, which altogether produces high-resolution, high-contrast images over extended depth ranges. We demonstrate the method through numerical simulations and experiments with fluorescently labeled beads, cells and tissue section, and present high-resolution imaging capability over a 15.5-fold larger DoF than the conventional microscope. Our method provides highly effective and scalable strategy for DoF-extended optical imaging system, and is expected to find numerous applications in rapid image-based diagnosis, optical vision, and metrology.

Universal adaptive optics for microscopy through embedded neural network control

The resolution and contrast of microscope imaging is often affected by aberrations introduced by imperfect optical systems and inhomogeneous refractive structures in specimens. Adaptive optics (AO) compensates these aberrations and restores diffraction limited performance. A wide range of AO solutions have been introduced, often tailored to a specific microscope type or application. Until now, a universal AO solution - one that can be readily transferred between microscope modalities - has not been deployed. We propose versatile and fast aberration correction using a physics-based machine learning assisted wavefront-sensorless AO control (MLAO) method. Unlike previous ML methods, we used a specially constructed neural network (NN) architecture, designed using physical understanding of the general microscope image formation, that was embedded in the control loop of different microscope systems. The approach means that not only is the resulting NN orders of magnitude simpler than previous NN methods, but the concept is translatable across microscope modalities. We demonstrated the method on a two-photon, a three-photon and a widefield three-dimensional (3D) structured illumination microscope. Results showed that the method outperformed commonly-used modal-based sensorless AO methods. We also showed that our ML-based method was robust in a range of challenging imaging conditions, such as 3D sample structures, specimen motion, low signal to noise ratio and activity-induced fluorescence fluctuations. Moreover, as the bespoke architecture encapsulated physical understanding of the imaging process, the internal NN configuration was no-longer a "black box", but provided physical insights on internal workings, which could influence future designs.

Successful 3D imaging of cleared biological samples with light sheet fluorescence microscopy

In parallel with the development of tissue-clearing methods, over the last decade, light sheet fluorescence microscopy has contributed to major advances in various fields, such as cell and developmental biology and neuroscience. While biologists are increasingly integrating three-dimensional imaging into their research projects, their experience with the technique is not always up to their expectations. In response to a survey of specific challenges associated with sample clearing and labeling, image acquisition, and data analysis, we have critically assessed the recent literature to characterize the difficulties inherent to light sheet fluorescence microscopy applied to cleared biological samples and to propose solutions to overcome them. This review aims to provide biologists interested in light sheet fluorescence microscopy with a primer for the development of their imaging pipeline, from sample preparation to image analysis. Importantly, we believe that issues could be avoided with better anticipation of image analysis requirements, which should be kept in mind while optimizing sample preparation and acquisition parameters.

Deep learning-driven adaptive optics for single-molecule localization microscopy

The inhomogeneous refractive indices of biological tissues blur and distort single-molecule emission patterns generating image artifacts and decreasing the achievable resolution of single-molecule localization microscopy (SMLM). Conventional sensorless adaptive optics methods rely on iterative mirror changes and image-quality metrics. However, these metrics result in inconsistent metric responses and thus fundamentally limit their efficacy for aberration correction in tissues. To bypass iterative trial-then-evaluate processes, we developed deep learning-driven adaptive optics for SMLM to allow direct inference of wavefront distortion and near real-time compensation. Our trained deep neural network monitors the individual emission patterns from single-molecule experiments, infers their shared wavefront distortion, feeds the estimates through a dynamic filter and drives a deformable mirror to compensate sample-induced aberrations. We demonstrated that our method simultaneously estimates and compensates 28 wavefront deformation shapes and improves the resolution and fidelity of three-dimensional SMLM through >130-µm-thick brain tissue specimens.

Extrapolated speckle-correlation imaging with an untrained deep neural network

We present a method for speckle-correlation imaging with an extended field of view to observe spatially non-sparse objects. In speckle-correlation imaging, an object is recovered from a non-invasively captured image through a scattering medium by assuming shift-invariance of the optical process called the memory effect. The field of view of speckle-correlation imaging is limited by the size of the memory effect, and it can be extended by extrapolating the speckle correlation in the reconstruction process. However, spatially sparse objects are assumed in the inversion process because of its severe ill-posedness. To address this issue, we introduce a deep image prior, which regularizes the image statistics by using the structure of an untrained convolutional neural network, to speckle-correlation imaging. We experimentally demonstrated the proposed method and showed the possibility of extending the method to imaging through scattering media.

Gold-Nanorod-Assisted Live Cell Nuclear Imaging Based on Near-Infrared II Dark-Field Microscopy

Dark-field microscopy offers several advantages, including high image contrast, minimal cell damage, and the absence of photobleaching of nanoprobes, which make it highly advantageous for cell imaging. The NIR-II window has emerged as a prominent research focus in optical imaging in recent years, with its low autofluorescence background in biological samples and high imaging SBR. In this study, we initially compared dark-field imaging results of colorectal cancer cells in both visible and NIR-II wavelengths, confirming the superior performance of NIR-II imaging. Subsequently, we synthesized gold nanorods with localized surface plasmon resonance (LSPR) absorption peaks in the NIR-II window. After bio-compatible modification, we non-specifically labeled colorectal cancer cells for NIR-II dark-field scattering imaging. The imaging results revealed a sixfold increase in SBR, especially in the 1425-1475 nm wavelength range. Finally, we applied this imaging system to perform dark-field imaging of cell nuclei in the NIR-II region and used GNRs for specific nuclear labeling in colorectal cancer cells. The resulting images exhibited higher SBR than non-specifically-labeled cell imaging, and the probe's labeling was precise, confirming the potential application of this system in photothermal therapy and drug delivery for cancer cells.

Tracing multiple scattering trajectories for deep optical imaging in scattering media

Multiple light scattering hampers imaging objects in complex scattering media. Approaches used in real practices mainly aim to filter out multiple scattering obscuring the ballistic waves that travel straight through the scattering medium. Here, we propose a method that makes the deterministic use of multiple scattering for microscopic imaging of an object embedded deep within scattering media. The proposed method finds a stack of multiple complex phase plates that generate similar light trajectories as the original scattering medium. By implementing the inverse scattering using the identified phase plates, our method rectifies multiple scattering and amplifies ballistic waves by almost 600 times. This leads to a significant increase in imaging depth-more than three times the scattering mean free path-as well as the correction of image distortions. Our study marks an important milestone in solving the long-standing high-order inverse scattering problems.

Imagining the future of optical microscopy: everything, everywhere, all at once

The optical microscope has revolutionized biology since at least the 17th Century. Since then, it has progressed from a largely observational tool to a powerful bioanalytical platform. However, realizing its full potential to study live specimens is hindered by a daunting array of technical challenges. Here, we delve into the current state of live imaging to explore the barriers that must be overcome and the possibilities that lie ahead. We venture to envision a future where we can visualize and study everything, everywhere, all at once - from the intricate inner workings of a single cell to the dynamic interplay across entire organisms, and a world where scientists could access the necessary microscopy technologies anywhere.

Aberration-free holographic microscope for simultaneous imaging and stimulation of neuronal populations

A technical challenge in neuroscience is to record and specifically manipulate the activity of neurons in living animals. This can be achieved in some preparations with two-photon calcium imaging and photostimulation. These methods can be extended to three dimensions by holographic light sculpting with spatial light modulators (SLMs). At the same time, performing simultaneous holographic imaging and photostimulation is still cumbersome, requiring two light paths with separate SLMs. Here we present an integrated optical design using a single SLM for simultaneous imaging and photostimulation. Furthermore, we applied axially dependent adaptive optics to make the system aberration-free, and developed software for calibrations and closed-loop neuroscience experiments. Finally, we demonstrate the performance of the system with simultaneous calcium imaging and optogenetics in mouse primary auditory cortex in vivo. Our integrated holographic system could facilitate the systematic investigation of neural circuit function in awake behaving animals.

Label-free adaptive optics single-molecule localization microscopy for whole zebrafish

Specimen-induced aberration has been a major factor limiting the imaging depth of single-molecule localization microscopy (SMLM). Here, we report the application of label-free wavefront sensing adaptive optics to SMLM for deep-tissue super-resolution imaging. The proposed system measures complex tissue aberrations from intrinsic reflectance rather than fluorescence emission and physically corrects the wavefront distortion more than three-fold stronger than the previous limit. This enables us to resolve sub-diffraction morphologies of cilia and oligodendrocytes in whole zebrafish as well as dendritic spines in thick mouse brain tissues at the depth of up to 102 μm with localization number enhancement by up to 37 times and localization precision comparable to aberration-free samples. The proposed approach can expand the application range of SMLM to whole zebrafish that cause the loss of localization number owing to severe tissue aberrations.

Higher order wavefront correction and axial scanning in a single fast and compact piezo-driven adaptive lens

We present a compact adaptive glass membrane lens for higher order wavefront correction and axial scanning, driven by integrated segmented piezoelectric actuators. The membrane can be deformed in a combination of rotational symmetry providing focus control of up to ± 6 m^-1 and spherical aberration correction of up to 5 wavelengths and different discrete symmetries to correct higher order aberrations such as astigmatism, coma and trefoil by up to 10 wavelengths. Our design provides a large clear aperture of 12 mm at an outer diameter of the actuator of 18 mm, a thickness of 2 mm and a response time of less than 2 ms.

Unlocking the secrets of the invisible world: incredible deep optical imaging through in-silico clearing

In-silico clearing enables deep optical imaging of biological samples by correcting image blur caused by scattering and aberration. This breakthrough method offers researchers unprecedented insights into three-dimensional biological systems, with enormous potential for advancing biology and medicine to better understand living organisms and human health.

Nondestructive 3D Pathology with Light-Sheet Fluorescence Microscopy for Translational Research and Clinical Assays

In recent years, there has been a revived appreciation for the importance of spatial context and morphological phenotypes for both understanding disease progression and guiding treatment decisions. Compared with conventional 2D histopathology, which is the current gold standard of medical diagnostics, nondestructive 3D pathology offers researchers and clinicians the ability to visualize orders of magnitude more tissue within their natural volumetric context. This has been enabled by rapid advances in tissue-preparation methods, high-throughput 3D microscopy instrumentation, and computational tools for processing these massive feature-rich data sets. Here, we provide a brief overview of many of these technical advances along with remaining challenges to be overcome. We also speculate on the future of 3D pathology as applied in translational investigations, preclinical drug development, and clinical decision-support assays.

Deep learning-based adaptive optics for light sheet fluorescence microscopy

Light sheet fluorescence microscopy (LSFM) is a high-speed imaging technique that is often used to image intact tissue-cleared specimens with cellular or subcellular resolution. Like other optical imaging systems, LSFM suffers from sample-induced optical aberrations that decrement imaging quality. Optical aberrations become more severe when imaging a few millimeters deep into tissue-cleared specimens, complicating subsequent analyses. Adaptive optics are commonly used to correct sample-induced aberrations using a deformable mirror. However, routinely used sensorless adaptive optics techniques are slow, as they require multiple images of the same region of interest to iteratively estimate the aberrations. In addition to the fading of fluorescent signal, this is a major limitation as thousands of images are required to image a single intact organ even without adaptive optics. Thus, a fast and accurate aberration estimation method is needed. Here, we used deep-learning techniques to estimate sample-induced aberrations from only two images of the same region of interest in cleared tissues. We show that the application of correction using a deformable mirror greatly improves image quality. We also introduce a sampling technique that requires a minimum number of images to train the network. Two conceptually different network architectures are compared; one that shares convolutional features and another that estimates each aberration independently. Overall, we have presented an efficient way to correct aberrations in LSFM and to improve image quality.

Rabies virus-based labeling of layer 6 corticothalamic neurons for two-photon imaging in vivo

Neocortical layer 6 (L6) is less understood than other more superficial layers, largely owing to limitations of performing high-resolution investigations in vivo. Here, we show that labeling with the Challenge Virus Standard (CVS) rabies virus strain enables high-quality imaging of L6 neurons by conventional two-photon microscopes. CVS virus injection into the medial geniculate body can selectively label L6 neurons in the auditory cortex. Only three days after injection, dendrites and cell bodies of L6 neurons could be imaged across all cortical layers. Ca²⁺ imaging in awake mice showed that sound stimulation evokes neuronal responses from cell bodies with minimal contamination from neuropil signals. In addition, dendritic Ca²⁺ imaging revealed significant responses from spines and trunks across all layers. These results demonstrate a reliable method capable of rapid, high-quality labeling of L6 neurons that can be readily extended to other brain regions.

Uncovering Endoplasmic Reticulum Superoxide Regulating Hepatic Ischemia-Reperfusion Injury by Dynamic Reversible Fluorescence Imaging

Hepatic ischemia-reperfusion injury (HIRI) is a relatively common complication of liver resection and transplantation that is intimately connected to oxidative stress. The superoxide anion radical (O₂^•-), as the first reactive oxygen species produced by organisms, is an important marker of HIRI. The endoplasmic reticulum (ER) is an essential site for O₂^•- production, especially ER oxidative stress, which is closely linked to HIRI. Thus, dynamic variations in ER O₂^•- may accurately indicate the HIRI extent. However, there is still a lack of tools for the dynamic reversible detection of ER O₂^•-. Therefore, we designed and prepared an ER-targeted fluorescent reversible probe DPC for real-time tracing of O₂^•- fluctuations. We successfully observed a marked increase in ER O₂^•- levels in HIRI mice. A potential NADPH oxidase 4-ER O₂^•--SERCA2b-caspase 4 signaling pathway in HIRI mice was also revealed. Attractively, DPC was successfully used for precise fluorescent navigation and excision of HIRI sites.

Efficient framework of solving time-gated reflection matrix for imaging through turbid medium

Imaging through turbid medium is a long pursuit in many research fields, such as biomedicine, astronomy and automatic vehicle, in which the reflection matrix-based method is a promising solution. However, the epi-detection geometry suffers from round-trip distortion and it is challenging to isolate the input and output aberrations in non-ideal cases due to system imperfections and measurement noises. Here, we present an efficient framework based on single scattering accumulation together with phase unwrapping that can accurately separate input and output aberrations from the noise-affected reflection matrix. We propose to only correct the output aberration while suppressing the input aberration by incoherent averaging. The proposed method is faster in convergence and more robust against noise, avoiding precise and tedious system adjustments. In both simulations and experiments, we demonstrate the diffraction-limited resolution capability under optical thickness beyond 10 scattering mean free paths, showing the potential of applications in neuroscience and dermatology.

Blind deconvolution of second harmonic microscopy images of the living human eye

Second harmonic generation (SHG) imaging microscopy of thick biological tissues is affected by the presence of aberrations and scattering within the sample. Moreover, additional problems, such as uncontrolled movements, appear when imaging in-vivo. Deconvolution methods can be used to overcome these limitations under some conditions. In particular, we present here a technique based on a marginal blind deconvolution approach for improving SHG images obtained in vivo in the human eye (cornea and sclera). Different image quality metrics are used to quantify the attained improvement. Collagen fibers in both cornea and sclera are better visualized and their spatial distributions accurately assessed. This might be a useful tool to better discriminate between healthy and pathological tissues, especially those where changes in collagen distribution occur.

In-silico clearing approach for deep refractive index tomography by partial reconstruction and wave-backpropagation

Refractive index (RI) is considered to be a fundamental physical and biophysical parameter in biological imaging, as it governs light-matter interactions and light propagation while reflecting cellular properties. RI tomography enables volumetric visualization of RI distribution, allowing biologically relevant analysis of a sample. However, multiple scattering (MS) and sample-induced aberration (SIA) caused by the inhomogeneity in RI distribution of a thick sample make its visualization challenging. This paper proposes a deep RI tomographic approach to overcome MS and SIA and allow the enhanced reconstruction of thick samples compared to that enabled by conventional linear-model-based RI tomography. The proposed approach consists of partial RI reconstruction using multiple holograms acquired with angular diversity and their backpropagation using the reconstructed partial RI map, which unambiguously reconstructs the next partial volume. Repeating this operation efficiently reconstructs the entire RI tomogram while suppressing MS and SIA. We visualized a multicellular spheroid of diameter 140 µm within minutes of reconstruction, thereby demonstrating the enhanced deep visualization capability and computational efficiency of the proposed method compared to those of conventional RI tomography. Furthermore, we quantified the high-RI structures and morphological changes inside multicellular spheroids, indicating that the proposed method can retrieve biologically relevant information from the RI distribution. Benefitting from the excellent biological interpretability of RI distributions, the label-free deep visualization capability of the proposed method facilitates a noninvasive understanding of the architecture and time-course morphological changes of thick multicellular specimens.

Retinal microvascular and neuronal pathologies probed in vivo by adaptive optical two-photon fluorescence microscopy

The retina, behind the transparent optics of the eye, is the only neural tissue whose physiology and pathology can be non-invasively probed by optical microscopy. The aberrations intrinsic to the mouse eye, however, prevent high-resolution investigation of retinal structure and function in vivo. Optimizing the design of a two-photon fluorescence microscope (2PFM) and sample preparation procedure, we found that adaptive optics (AO), by measuring and correcting ocular aberrations, is essential for resolving putative synaptic structures and achieving three-dimensional cellular resolution in the mouse retina in vivo. Applying AO-2PFM to longitudinal retinal imaging in transgenic models of retinal pathology, we characterized microvascular lesions with sub-capillary details in a proliferative vascular retinopathy model, and found Lidocaine to effectively suppress retinal ganglion cell hyperactivity in a retinal degeneration model. Tracking structural and functional changes at high-resolution longitudinally, AO-2PFM enables microscopic investigations of retinal pathology and pharmacology for disease diagnosis and treatment in vivo.

Volumetric light sheet imaging with adaptive optics correction

Light sheet microscopy has developed quickly over the past decades and become a popular method for imaging live model organisms and other thick biological tissues. For rapid volumetric imaging, an electrically tunable lens can be used to rapidly change the imaging plane in the sample. For larger fields of view and higher NA objectives, the electrically tunable lens introduces aberrations in the system, particularly away from the nominal focus and off-axis. Here, we describe a system that employs an electrically tunable lens and adaptive optics to image over a volume of 499 × 499 × 192 μm3 with close to diffraction-limited resolution. Compared to the system without adaptive optics, the performance shows an increase in signal to background ratio by a factor of 3.5. While the system currently requires 7s/volume, it should be straightforward to increase the imaging speed to under 1s per volume.

Large-scale high-throughput 3D culture, imaging, and analysis of cell spheroids using microchip-enhanced light-sheet microscopy

Light sheet microscopy combined with a microchip is an emerging tool in biomedical research that notably improves efficiency. However, microchip-enhanced light-sheet microscopy is limited by noticeable aberrations induced by the complex refractive indices in the chip. Herein, we report a droplet microchip that is specifically engineered to be capable of large-scale culture of 3D spheroids (over 600 samples per chip) and has a polymer index matched to water (difference <1%). When combined with a lab-built open-top light-sheet microscope, this microchip-enhanced microscopy technique allows 3D time-lapse imaging of the cultivated spheroids with ∼2.5-µm single-cell resolution and a high throughput of ∼120 spheroids per minute. This technique was validated by a comparative study on the proliferation and apoptosis rates of hundreds of spheroids with or without treatment with the apoptosis-inducing drug Staurosporine.