Freehand scanning photoacoustic microscopy with simultaneous localization and mapping

Unsupervised deep learning enables real-time image registration of fast-scanning optical-resolution photoacoustic microscopy

A fast scanner of optical-resolution photoacoustic microscopy is inherently vulnerable to perturbation, leading to severe image distortion and significant misalignment among multiple 2D or 3D images. Restoration and registration of these images is critical for accurately quantifying dynamic information in long-term imaging. However, traditional registration algorithms face a great challenge in computational throughput. Here, we develop an unsupervised deep learning based registration network to achieve real-time image restoration and registration. This method can correct artifacts from B-scan distortion and remove misalignment among adjacent and repetitive images in real time. Compared with conventional intensity based registration algorithms, the throughput of the developed algorithm is improved by 50 times. After training, the new deep learning method performs better than conventional feature based image registration algorithms. The results show that the proposed method can accurately restore and register the images of fast-scanning photoacoustic microscopy in real time, offering a powerful tool to extract dynamic vascular structural and functional information.

Perspectives on endoscopic functional photoacoustic microscopy

Endoscopy, enabling high-resolution imaging of deep tissues and internal organs, plays an important role in basic research and clinical practice. Recent advances in photoacoustic microscopy (PAM), demonstrating excellent capabilities in high-resolution functional imaging, have sparked significant interest in its integration into the field of endoscopy. However, there are challenges in achieving functional PAM in the endoscopic setting. This Perspective article discusses current progress in the development of endoscopic PAM and the challenges related to functional measurements. Then, it points out potential directions to advance endoscopic PAM for functional imaging by leveraging fiber optics, microfabrication, optical engineering, and computational approaches. Finally, it highlights emerging opportunities for functional endoscopic PAM in basic and translational biomedicine.

Free-moving-state microscopic imaging of cerebral oxygenation and hemodynamics with a photoacoustic fiberscope

We report the development of a head-mounted photoacoustic fiberscope for cerebral imaging in a freely behaving mouse. The 4.5-gram imaging probe has a 9-µm lateral resolution and 0.2-Hz frame rate over a 1.2-mm wide area. The probe can continuously monitor cerebral oxygenation and hemodynamic responses at single-vessel resolution, showing significantly different cerebrovascular responses to external stimuli under anesthesia and in the freely moving state. For example, when subjected to high-concentration CO2 respiration, enhanced oxygenation to compensate for hypercapnia can be visualized due to cerebral regulation in the freely moving state. Comparative studies exhibit significantly weakened compensation capabilities in obese rodents. This new imaging modality can be used for investigating both normal and pathological cerebrovascular functions and shows great promise for studying cerebral activity, disorders and their treatments.

Photoacoustic imaging plus X: a review

Significance

Photoacoustic (PA) imaging (PAI) represents an emerging modality within the realm of biomedical imaging technology. It seamlessly blends the wealth of optical contrast with the remarkable depth of penetration offered by ultrasound. These distinctive features of PAI hold tremendous potential for various applications, including early cancer detection, functional imaging, hybrid imaging, monitoring ablation therapy, and providing guidance during surgical procedures. The synergy between PAI and other cutting-edge technologies not only enhances its capabilities but also propels it toward broader clinical applicability.

Aim

The integration of PAI with advanced technology for PA signal detection, signal processing, image reconstruction, hybrid imaging, and clinical applications has significantly bolstered the capabilities of PAI. This review endeavor contributes to a deeper comprehension of how the synergy between PAI and other advanced technologies can lead to improved applications.

Approach

An examination of the evolving research frontiers in PAI, integrated with other advanced technologies, reveals six key categories named "PAI plus X." These categories encompass a range of topics, including but not limited to PAI plus treatment, PAI plus circuits design, PAI plus accurate positioning system, PAI plus fast scanning systems, PAI plus ultrasound sensors, PAI plus advanced laser sources, PAI plus deep learning, and PAI plus other imaging modalities.

Results

After conducting a comprehensive review of the existing literature and research on PAI integrated with other technologies, various proposals have emerged to advance the development of PAI plus X. These proposals aim to enhance system hardware, improve imaging quality, and address clinical challenges effectively.

Conclusions

The progression of innovative and sophisticated approaches within each category of PAI plus X is positioned to drive significant advancements in both the development of PAI technology and its clinical applications. Furthermore, PAI not only has the potential to integrate with the above-mentioned technologies but also to broaden its applications even further.

Review of low-cost light sources and miniaturized designs in photoacoustic microscopy

Significance

Photoacoustic microscopy (PAM) is a promising imaging technique to provide structural, functional, and molecular information for preclinical and clinical studies. However, expensive and bulky lasers and motorized stages have limited the broad applications of conventional PAM systems. A recent trend is to use low-cost light sources and miniaturized designs to develop a compact PAM system and expand its applications from benchtop to bedside.

Aim

We provide (1) an overview of PAM systems and their limitations, (2) a comprehensive review of PAM systems with low-cost light sources and their applications, (3) a comprehensive review of PAM systems with miniaturized and handheld scanning designs, and (4) perspective applications and a summary of the cost-effective and miniaturized PAM systems.

Approach

Papers published before July 2023 in the area of using low-cost light sources and miniaturized designs in PAM were reviewed. They were categorized into two main parts: (1) low-cost light sources and (2) miniaturized or handheld designs. The first part was classified into two subtypes: pulsed laser diode and continuous-wave laser diode. The second part was also classified into two subtypes: galvanometer scanner and micro-electro-mechanical system scanner.

Results

Significant progress has been made in the development of PAM systems based on low-cost and compact light sources as well as miniaturized and handheld designs.

Conclusions

The review highlights the potential of these advancements to revolutionize PAM technology, making it more accessible and practical for various applications in preclinical studies, clinical practice, and long-term monitoring.

Review of Three-Dimensional Handheld Photoacoustic and Ultrasound Imaging Systems and Their Applications

Photoacoustic (PA) imaging is a non-invasive biomedical imaging technique that combines the benefits of optics and acoustics to provide high-resolution structural and functional information. This review highlights the emergence of three-dimensional handheld PA imaging systems as a promising approach for various biomedical applications. These systems are classified into four techniques: direct imaging with 2D ultrasound (US) arrays, mechanical-scanning-based imaging with 1D US arrays, mirror-scanning-based imaging, and freehand-scanning-based imaging. A comprehensive overview of recent research in each imaging technique is provided, and potential solutions for system limitations are discussed. This review will serve as a valuable resource for researchers and practitioners interested in advancements and opportunities in three-dimensional handheld PA imaging technology.

Photoacoustic (532 and 1064 nm) and ultrasonic coscanning microscopy for in vivo imaging on small animals: A productized strategy

Photoacoustic microscopy provides a new dimension of observation in microscopic life science. However, due to the high complexity of building a photoacoustic microscopy system, for many life science practitioners, it usually takes several years to build a stable photoacoustic microscopy system. For the above situation, in this article, a productized strategy of photoacoustic (532 and 1064 nm) and ultrasonic coscanning microscopy for in vivo imaging on small animals is presented. A 532 nm laser is applied to image blood vessels and pigments in label-free manner, whereas 1064 nm laser is applied to image pigments and some novel probes developed for NIR-II windows. Ultrasound is applied to assist photoacoustic imaging to accurately locate its imaging site in tissues. All 3D results are obtained with one single scan. The strategy presented here will help life science practitioners to build a stable photoacoustic microscopy platform.

Simultaneous dual-modal photoacoustic and harmonic ultrasound microscopy with an optimized acoustic combiner

Simultaneous photoacoustic (PA) and ultrasound (US) imaging provides rich optical and acoustic contrasts with high sensitivity, specificity, and resolution, making it a promising tool for diagnosing and assessing various diseases. However, the resolution and penetration depth tend to be contradictory due to the increased attenuation of high-frequency ultrasound. To address this issue, we present simultaneous dual-modal PA/US microscopy with an optimized acoustic combiner that can maintain high resolution while improving the penetration of ultrasound imaging. A low-frequency ultrasound transducer is used for acoustic transmission, and a high-frequency transducer is used for PA and US detection. An acoustic beam combiner is utilized to merge the transmitting and receiving acoustic beams with a predetermined ratio. By combining the two different transducers, harmonic US imaging and high-frequency photoacoustic microscopy are implemented. In vivo experiments on the mouse brain demonstrate the simultaneous PA and US imaging ability. The harmonic US imaging of the mouse eye reveals finer iris and lens boundary structures than conventional US imaging, providing a high-resolution anatomical reference for co-registered PA imaging.