Illumination angle correction during image acquisition in light-sheet fluorescence microscopy using deep learning

Roadmap on computational methods in optical imaging and holography [invited]

Computational methods have been established as cornerstones in optical imaging and holography in recent years. Every year, the dependence of optical imaging and holography on computational methods is increasing significantly to the extent that optical methods and components are being completely and efficiently replaced with computational methods at low cost. This roadmap reviews the current scenario in four major areas namely incoherent digital holography, quantitative phase imaging, imaging through scattering layers, and super-resolution imaging. In addition to registering the perspectives of the modern-day architects of the above research areas, the roadmap also reports some of the latest studies on the topic. Computational codes and pseudocodes are presented for computational methods in a plug-and-play fashion for readers to not only read and understand but also practice the latest algorithms with their data. We believe that this roadmap will be a valuable tool for analyzing the current trends in computational methods to predict and prepare the future of computational methods in optical imaging and holography.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00340-024-08280-3.

Deep learning-based adaptive optics for light sheet fluorescence microscopy

Light sheet fluorescence microscopy (LSFM) is a high-speed imaging technique that is often used to image intact tissue-cleared specimens with cellular or subcellular resolution. Like other optical imaging systems, LSFM suffers from sample-induced optical aberrations that decrement imaging quality. Optical aberrations become more severe when imaging a few millimeters deep into tissue-cleared specimens, complicating subsequent analyses. Adaptive optics are commonly used to correct sample-induced aberrations using a deformable mirror. However, routinely used sensorless adaptive optics techniques are slow, as they require multiple images of the same region of interest to iteratively estimate the aberrations. In addition to the fading of fluorescent signal, this is a major limitation as thousands of images are required to image a single intact organ even without adaptive optics. Thus, a fast and accurate aberration estimation method is needed. Here, we used deep-learning techniques to estimate sample-induced aberrations from only two images of the same region of interest in cleared tissues. We show that the application of correction using a deformable mirror greatly improves image quality. We also introduce a sampling technique that requires a minimum number of images to train the network. Two conceptually different network architectures are compared; one that shares convolutional features and another that estimates each aberration independently. Overall, we have presented an efficient way to correct aberrations in LSFM and to improve image quality.

COMBINe enables automated detection and classification of neurons and astrocytes in tissue-cleared mouse brains

Tissue clearing renders entire organs transparent to accelerate whole-tissue imaging; for example, with light-sheet fluorescence microscopy. Yet, challenges remain in analyzing the large resulting 3D datasets that consist of terabytes of images and information on millions of labeled cells. Previous work has established pipelines for automated analysis of tissue-cleared mouse brains, but the focus there was on single-color channels and/or detection of nuclear localized signals in relatively low-resolution images. Here, we present an automated workflow (COMBINe, Cell detectiOn in Mouse BraIN) to map sparsely labeled neurons and astrocytes in genetically distinct mouse forebrains using mosaic analysis with double markers (MADM). COMBINe blends modules from multiple pipelines with RetinaNet at its core. We quantitatively analyzed the regional and subregional effects of MADM-based deletion of the epidermal growth factor receptor (EGFR) on neuronal and astrocyte populations in the mouse forebrain.

Bulk and mosaic deletions of Egfr reveal regionally defined gliogenesis in the developing mouse forebrain

The epidermal growth factor receptor (EGFR) plays a role in cell proliferation and differentiation during healthy development and tumor growth; however, its requirement for brain development remains unclear. Here we used a conditional mouse allele for Egfr to examine its contributions to perinatal forebrain development at the tissue level. Subtractive bulk ventral and dorsal forebrain deletions of Egfr uncovered significant and permanent decreases in oligodendrogenesis and myelination in the cortex and corpus callosum. Additionally, an increase in astrogenesis or reactive astrocytes in effected regions was evident in response to cortical scarring. Sparse deletion using mosaic analysis with double markers (MADM) surprisingly revealed a regional requirement for EGFR in rostrodorsal, but not ventrocaudal glial lineages including both astrocytes and oligodendrocytes. The EGFR-independent ventral glial progenitors may compensate for the missing EGFR-dependent dorsal glia in the bulk Egfr-deleted forebrain, potentially exposing a regenerative population of gliogenic progenitors in the mouse forebrain.

Armour G, Horman BM, Rock KD, Witchey SK, Greenbaum A, Patisaul HB. Maternal organophosphate flame retardant exposure alters the developing mesencephalic dopamine system in fetal rat

Organophosphate flame retardants (OPFRs) have become the predominant substitution for legacy brominated flame retardants but there is concern about their potential developmental neurotoxicity (DNT). OPFRs readily dissociate from the fireproofed substrate to the environment, and they (or their metabolites) have been detected in diverse matrices including air, water, soil, and biota, including human urine and breastmilk. Given this ubiquitous contamination, it becomes increasingly important to understand the potential effects of OPFRs on the developing nervous system. We have previously shown that maternal exposure to OPFRs results in neuroendocrine disruption, alterations to developmental metabolism of serotonin (5-HT) and axonal extension in male fetal rats, and potentiates adult anxiety-like behaviors. The development of the serotonin and dopamine systems occur in parallel and interact, therefore, we first sought to enhance our prior 5-HT work by first examining the ascending 5-HT system on embryonic day 14 using whole mount clearing of fetal heads and 3-dimensional (3D) brain imaging. We also investigated the effects of maternal OPFR exposure on the development of the mesocortical dopamine system in the same animals through 2-dimensional and 3D analysis following immunohistochemistry for tyrosine hydroxylase (TH). Maternal OPFR exposure induced morphological changes to the putative ventral tegmental area and substantia nigra in both sexes and reduced the overall volume of this structure in males, whereas 5-HT nuclei were unchanged. Additionally, dopaminergic axogenesis was disrupted in OPFR exposed animals, as the dorsoventral spread of ventral telencephalic TH afferents were greater at embryonic day 14, while sparing 5-HT fibers. These results indicate maternal exposure to OPFRs alters the development trajectory of the embryonic dopaminergic system and adds to growing evidence of OPFR DNT.

Quantitative analysis of illumination and detection corrections in adaptive light sheet fluorescence microscopy

Light-sheet fluorescence microscopy (LSFM) is a high-speed, high-resolution and minimally phototoxic technique for 3D imaging of in vivo and in vitro specimens. LSFM exhibits optical sectioning and when combined with tissue clearing techniques, it facilitates imaging of centimeter scale specimens with micrometer resolution. Although LSFM is ubiquitous, it still faces two main challenges that effect image quality especially when imaging large volumes with high-resolution. First, the light-sheet illumination plane and detection lens focal plane need to be coplanar, however sample-induced aberrations can violate this requirement and degrade image quality. Second, introduction of sample-induced optical aberrations in the detection path. These challenges intensify when imaging whole organisms or structurally complex specimens like cochleae and bones that exhibit many transitions from soft to hard tissue or when imaging deep (> 2 mm). To resolve these challenges, various illumination and aberration correction methods have been developed, yet no adaptive correction in both the illumination and the detection path have been applied to improve LSFM imaging. Here, we bridge this gap, by implementing the two correction techniques on a custom built adaptive LSFM. The illumination beam angular properties are controlled by two galvanometer scanners, while a deformable mirror is positioned in the detection path to correct for aberrations. By imaging whole porcine cochlea, we compare and contrast these correction methods and their influence on the image quality. This knowledge will greatly contribute to the field of adaptive LSFM, and imaging of large volumes of tissue cleared specimens.