Laser scanning reflection-matrix microscopy for aberration-free imaging through intact mouse skull

Removing Artifacts in Transcranial Photoacoustic Imaging With Polarized Self-Attention Dense-UNet

OBJECTIVE

Photoacoustic imaging (PAI) is a promising transcranial imaging technique. However, the distortion of photoacoustic signals induced by the skull significantly influences its imaging quality. We aimed to use deep learning for removing artifacts in PAI.

METHODS

In this study, we propose a polarized self-attention dense U-Net, termed PSAD-UNet, to correct the distortion and accurately recover imaged objects beneath bone plates. To evaluate the performance of the proposed method, a series of experiments was performed using a custom-built PAI system.

RESULTS

The experimental results showed that the proposed PSAD-UNet method could effectively implement transcranial PAI through a one- or two-layer bone plate. Compared with the conventional delay-and-sum and classical U-Net methods, PSAD-UNet can diminish the influence of bone plates and provide high-quality PAI results in terms of structural similarity and peak signal-to-noise ratio. The 3-D experimental results further confirm the feasibility of PSAD-UNet in 3-D transcranial imaging.

CONCLUSION

PSAD-UNet paves the way for implementing transcranial PAI with high imaging accuracy, which reveals broad application prospects in preclinical and clinical fields.

Fast wavefront shaping for two-photon brain imaging with multipatch correction

Nonlinear fluorescence microscopy promotes in-vivo optical imaging of cellular structure at diffraction-limited resolution deep inside scattering biological tissues. Active compensation of tissue-induced aberrations and light scattering through adaptive wavefront correction further extends the accessible depth by restoring high resolution at large depth. However, those corrections are only valid over a very limited field of view within the angular memory effect. To overcome this limitation, we introduce an acousto-optic light modulation technique for fluorescence imaging with simultaneous wavefront correction at pixel scan speed. Biaxial wavefront corrections are first learned by adaptive optimization at multiple locations in the image field. During image acquisition, the learned corrections are then switched on the fly according to the position of the excitation focus during the raster scan. The proposed microscope is applied to in vivo transcranial neuron imaging and demonstrates multi-patch correction of thinned skull-induced aberrations and scattering at 40-kHz data acquisition speed.

Ultrasonic barrier-through imaging by Fabry-Perot resonance-tailoring panel

Imaging technologies that provide detailed information on intricate shapes and states of an object play critical roles in nanoscale dynamics, bio-organ and cell studies, medical diagnostics, and underwater detection. However, ultrasonic imaging of an object hidden by a nearly impenetrable metal barrier remains intractable. Here, we present the experimental results of ultrasonic imaging of an object in water behind a metal barrier of a high impedance mismatch. In comparison to direct ultrasonic images, our method yields sufficient object information on the shapes and locations with minimal errors. While our imaging principle is based on the Fabry-Perot (FP) resonance, our strategy for reducing attenuation in our experiments focuses on customising the resonance at any desired frequency. To tailor the resonance frequency, we placed an elaborately engineered panel of a specific material and thickness, called the FP resonance-tailoring panel (RTP), and installed the panel in front of a barrier at a controlled distance. Since our RTP-based imaging technique is readily compatible with conventional ultrasound devices, it can realise underwater barrier-through imaging and communication and enhance skull-through ultrasonic brain imaging.

The ultra-thin, minimally invasive surface electrode array NeuroWeb for probing neural activity

Electrophysiological recording technologies can provide valuable insights into the functioning of the central and peripheral nervous systems. Surface electrode arrays made of soft materials or implantable multi-electrode arrays with high electrode density have been widely utilized as neural probes. However, neither of these probe types can simultaneously achieve minimal invasiveness and robust neural signal detection. Here, we present an ultra-thin, minimally invasive neural probe (the "NeuroWeb") consisting of hexagonal boron nitride and graphene, which leverages the strengths of both surface electrode array and implantable multi-electrode array. The NeuroWeb open lattice structure with a total thickness of 100 nm demonstrates high flexibility and strong adhesion, establishing a conformal and tight interface with the uneven mouse brain surface. In vivo electrophysiological recordings show that NeuroWeb detects stable single-unit activity of neurons with high signal-to-noise ratios. Furthermore, we investigate neural interactions between the somatosensory cortex and the cerebellum using transparent dual NeuroWebs and optical stimulation, and measure the times of neural signal transmission between the brain regions depending on the pathway. Therefore, NeuroWeb can be expected to pave the way for understanding complex brain networks with optical and electrophysiological mapping of the brain.

Tracing multiple scattering trajectories for deep optical imaging in scattering media

Multiple light scattering hampers imaging objects in complex scattering media. Approaches used in real practices mainly aim to filter out multiple scattering obscuring the ballistic waves that travel straight through the scattering medium. Here, we propose a method that makes the deterministic use of multiple scattering for microscopic imaging of an object embedded deep within scattering media. The proposed method finds a stack of multiple complex phase plates that generate similar light trajectories as the original scattering medium. By implementing the inverse scattering using the identified phase plates, our method rectifies multiple scattering and amplifies ballistic waves by almost 600 times. This leads to a significant increase in imaging depth-more than three times the scattering mean free path-as well as the correction of image distortions. Our study marks an important milestone in solving the long-standing high-order inverse scattering problems.

Three-dimensional ultrasound matrix imaging

Matrix imaging paves the way towards a next revolution in wave physics. Based on the response matrix recorded between a set of sensors, it enables an optimized compensation of aberration phenomena and multiple scattering events that usually drastically hinder the focusing process in heterogeneous media. Although it gave rise to spectacular results in optical microscopy or seismic imaging, the success of matrix imaging has been so far relatively limited with ultrasonic waves because wave control is generally only performed with a linear array of transducers. In this paper, we extend ultrasound matrix imaging to a 3D geometry. Switching from a 1D to a 2D probe enables a much sharper estimation of the transmission matrix that links each transducer and each medium voxel. Here, we first present an experimental proof of concept on a tissue-mimicking phantom through ex-vivo tissues and then, show the potential of 3D matrix imaging for transcranial applications.

Label-free adaptive optics single-molecule localization microscopy for whole zebrafish

Specimen-induced aberration has been a major factor limiting the imaging depth of single-molecule localization microscopy (SMLM). Here, we report the application of label-free wavefront sensing adaptive optics to SMLM for deep-tissue super-resolution imaging. The proposed system measures complex tissue aberrations from intrinsic reflectance rather than fluorescence emission and physically corrects the wavefront distortion more than three-fold stronger than the previous limit. This enables us to resolve sub-diffraction morphologies of cilia and oligodendrocytes in whole zebrafish as well as dendritic spines in thick mouse brain tissues at the depth of up to 102 μm with localization number enhancement by up to 37 times and localization precision comparable to aberration-free samples. The proposed approach can expand the application range of SMLM to whole zebrafish that cause the loss of localization number owing to severe tissue aberrations.

Efficient framework of solving time-gated reflection matrix for imaging through turbid medium

Imaging through turbid medium is a long pursuit in many research fields, such as biomedicine, astronomy and automatic vehicle, in which the reflection matrix-based method is a promising solution. However, the epi-detection geometry suffers from round-trip distortion and it is challenging to isolate the input and output aberrations in non-ideal cases due to system imperfections and measurement noises. Here, we present an efficient framework based on single scattering accumulation together with phase unwrapping that can accurately separate input and output aberrations from the noise-affected reflection matrix. We propose to only correct the output aberration while suppressing the input aberration by incoherent averaging. The proposed method is faster in convergence and more robust against noise, avoiding precise and tedious system adjustments. In both simulations and experiments, we demonstrate the diffraction-limited resolution capability under optical thickness beyond 10 scattering mean free paths, showing the potential of applications in neuroscience and dermatology.

Exploiting volumetric wave correlation for enhanced depth imaging in scattering medium

Imaging an object embedded within a scattering medium requires the correction of complex sample-induced wave distortions. Existing approaches have been designed to resolve them by optimizing signal waves recorded in each 2D image. Here, we present a volumetric image reconstruction framework that merges two fundamental degrees of freedom, the wavelength and propagation angles of light waves, based on the object momentum conservation principle. On this basis, we propose methods for exploiting the correlation of signal waves from volumetric images to better cope with multiple scattering. By constructing experimental systems scanning both wavelength and illumination angle of the light source, we demonstrated a 32-fold increase in the use of signal waves compared with that of existing 2D-based approaches and achieved ultrahigh volumetric resolution (lateral resolution: 0.41 [Formula: see text], axial resolution: 0.60 [Formula: see text]) even within complex scattering medium owing to the optimal coherent use of the broad spectral bandwidth (225 nm).

Computational conjugate adaptive optics microscopy for longitudinal through-skull imaging of cortical myelin

Myelination processes are closely related to higher brain functions such as learning and memory. While their longitudinal observation has been crucial to understanding myelin-related physiology and various brain disorders, skull opening or thinning has been required to secure clear optical access. Here we present a high-speed reflection matrix microscope using a light source with a wavelength of 1.3 μm to reduce tissue scattering and aberration. Furthermore, we develop a computational conjugate adaptive optics algorithm designed for the recorded reflection matrix to optimally compensate for the skull aberrations. These developments allow us to realize label-free longitudinal imaging of cortical myelin through an intact mouse skull. The myelination processes of the same mice were observed from 3 to 10 postnatal weeks to the depth of cortical layer 4 with a spatial resolution of 0.79 μm. Our system will expedite the investigations on the role of myelination in learning, memory, and brain disorders.

Recent advances in optical imaging through deep tissue: imaging probes and techniques

Optical imaging has been essential for scientific observations to date, however its biomedical applications has been restricted due to its poor penetration through tissues. In living tissue, signal attenuation and limited imaging depth caused by the wave distortion occur because of scattering and absorption of light by various molecules including hemoglobin, pigments, and water. To overcome this, methodologies have been proposed in the various fields, which can be mainly categorized into two stategies: developing new imaging probes and optical techniques. For example, imaging probes with long wavelength like NIR-II region are advantageous in tissue penetration. Bioluminescence and chemiluminescence can generate light without excitation, minimizing background signals. Afterglow imaging also has high a signal-to-background ratio because excitation light is off during imaging. Methodologies of adaptive optics (AO) and studies of complex media have been established and have produced various techniques such as direct wavefront sensing to rapidly measure and correct the wave distortion and indirect wavefront sensing involving modal and zonal methods to correct complex aberrations. Matrix-based approaches have been used to correct the high-order optical modes by numerical post-processing without any hardware feedback. These newly developed imaging probes and optical techniques enable successful optical imaging through deep tissue. In this review, we discuss recent advances for multi-scale optical imaging within deep tissue, which can provide reseachers multi-disciplinary understanding and broad perspectives in diverse fields including biophotonics for the purpose of translational medicine and convergence science.

Through-skull brain imaging in vivo at visible wavelengths via dimensionality reduction adaptive-optical microscopy

Compensation of sample-induced optical aberrations is crucial for visualizing microscopic structures deep within biological tissues. However, strong multiple scattering poses a fundamental limitation for identifying and correcting the tissue-induced aberrations. Here, we introduce a label-free deep-tissue imaging technique termed dimensionality reduction adaptive-optical microscopy (DReAM) to selectively attenuate multiple scattering. We established a theoretical framework in which dimensionality reduction of a time-gated reflection matrix can attenuate uncorrelated multiple scattering while retaining a single-scattering signal with a strong wave correlation, irrespective of sample-induced aberrations. We performed mouse brain imaging in vivo through the intact skull with the probe beam at visible wavelengths. Despite the strong scattering and aberrations, DReAM offered a 17-fold enhancement of single scattering-to-multiple scattering ratio and provided high-contrast images of neural fibers in the brain cortex with the diffraction-limited spatial resolution of 412 nanometers and a 33-fold enhanced Strehl ratio.

High-throughput volumetric adaptive optical imaging using compressed time-reversal matrix

Deep-tissue optical imaging suffers from the reduction of resolving power due to tissue-induced optical aberrations and multiple scattering noise. Reflection matrix approaches recording the maps of backscattered waves for all the possible orthogonal input channels have provided formidable solutions for removing severe aberrations and recovering the ideal diffraction-limited spatial resolution without relying on fluorescence labeling and guide stars. However, measuring the full input-output response of the tissue specimen is time-consuming, making the real-time image acquisition difficult. Here, we present the use of a time-reversal matrix, instead of the reflection matrix, for fast high-resolution volumetric imaging of a mouse brain. The time-reversal matrix reduces two-way problem to one-way problem, which effectively relieves the requirement for the coverage of input channels. Using a newly developed aberration correction algorithm designed for the time-reversal matrix, we demonstrated the correction of complex aberrations using as small as 2% of the complete basis while maintaining the image reconstruction fidelity comparable to the fully sampled reflection matrix. Due to nearly 100-fold reduction in the matrix recording time, we could achieve real-time aberration-correction imaging for a field of view of 40 × 40 µm2 (176 × 176 pixels) at a frame rate of 80 Hz. Furthermore, we demonstrated high-throughput volumetric adaptive optical imaging of a mouse brain by recording a volume of 128 × 128 × 125 µm3 (568 × 568 × 125 voxels) in 3.58 s, correcting tissue aberrations at each and every 1 µm depth section, and visualizing myelinated axons with a lateral resolution of 0.45 µm and an axial resolution of 2 µm.

Optical Imaging of Beta-Amyloid Plaques in Alzheimer's Disease

Alzheimer's disease (AD) is a multifactorial, irreversible, and incurable neurodegenerative disease. The main pathological feature of AD is the deposition of misfolded β-amyloid protein (Aβ) plaques in the brain. The abnormal accumulation of Aβ plaques leads to the loss of some neuron functions, further causing the neuron entanglement and the corresponding functional damage, which has a great impact on memory and cognitive functions. Hence, studying the accumulation mechanism of Aβ in the brain and its effect on other tissues is of great significance for the early diagnosis of AD. The current clinical studies of Aβ accumulation mainly rely on medical imaging techniques, which have some deficiencies in sensitivity and specificity. Optical imaging has recently become a research hotspot in the medical field and clinical applications, manifesting noninvasiveness, high sensitivity, absence of ionizing radiation, high contrast, and spatial resolution. Moreover, it is now emerging as a promising tool for the diagnosis and study of Aβ buildup. This review focuses on the application of the optical imaging technique for the determination of Aβ plaques in AD research. In addition, recent advances and key operational applications are discussed.

Spatio-temporal parameters for optical probing of neuronal activity

The challenge to understand the complex neuronal circuit functions in the mammalian brain has brought about a revolution in light-based neurotechnologies and optogenetic tools. However, while recent seminal works have shown excellent insights on the processing of basic functions such as sensory perception, memory, and navigation, understanding more complex brain functions is still unattainable with current technologies. We are just scratching the surface, both literally and figuratively. Yet, the path towards fully understanding the brain is not totally uncertain. Recent rapid technological advancements have allowed us to analyze the processing of signals within dendritic arborizations of single neurons and within neuronal circuits. Understanding the circuit dynamics in the brain requires a good appreciation of the spatial and temporal properties of neuronal activity. Here, we assess the spatio-temporal parameters of neuronal responses and match them with suitable light-based neurotechnologies as well as photochemical and optogenetic tools. We focus on the spatial range that includes dendrites and certain brain regions (e.g., cortex and hippocampus) that constitute neuronal circuits. We also review some temporal characteristics of some proteins and ion channels responsible for certain neuronal functions. With the aid of the photochemical and optogenetic markers, we can use light to visualize the circuit dynamics of a functioning brain. The challenge to understand how the brain works continue to excite scientists as research questions begin to link macroscopic and microscopic units of brain circuits.

Distortion matrix concept for deep optical imaging in scattering media

In optical imaging, light propagation is affected by the inhomogeneities of the medium. Sample-induced aberrations and multiple scattering can strongly degrade the image resolution and contrast. On the basis of a dynamic correction of the incident and/or reflected wavefronts, adaptive optics has been used to compensate for those aberrations. However, it only applies to spatially invariant aberrations or to thin aberrating layers. Here, we propose a global and noninvasive approach based on the distortion matrix concept. This matrix basically connects any focusing point of the image with the distorted part of its wavefront in reflection. A singular value decomposition of the distortion matrix allows to correct for high-order aberrations and forward multiple scattering over multiple isoplanatic modes. Proof-of-concept experiments are performed through biological tissues including a turbid cornea. We demonstrate a Strehl ratio enhancement up to 2500 and recover a diffraction-limited resolution until a depth of 10 scattering mean free paths.