Miniature probe for in vivo optical- and acoustic-resolution photoacoustic microscopy

In-vivo assessment of a rat rectal tumor using optical-resolution photoacoustic endoscopy

Optical-resolution photoacoustic endoscopy (OR-PAE) has been proven to realize imaging on the vascular network in the gastrointestinal (GI) tract with high sensitivity and spatial resolution, providing morphological information. Various photoacoustic endoscopic catheters were developed to improve the resolution and adaptivity of in-vivo imaging. However, this technology has not yet been validated on in-vivo GI tumors, which generally feature angiogenesis. The tumor causes thickened mucosa and neoplasia, requiring large depth-of-field (DOF) in imaging, which contradicts to high-resolution imaging. In this work, a novel catheter was developed with a high resolution of ∼27 µm, providing a matched DOF of ∼400 µm to cover the vessels up to the submucosa layer. Optical-resolution photoacoustic endoscopic imaging was first performed on in-vivo rat rectal tumors. In addition, to further characterize the vessel morphology, tumor-suspected regions and normal regions were selected for quantification and analysis of vessel dimension distribution and tortuosity. All the results suggest that the OR-PAE has great application potential in tumor diagnosis, evaluation, and monitoring of therapeutic efficacy.

Thin flexible photoacoustic endoscopic probe with a distal-driven micro-step motor for pump-probe-based high-specific molecular imaging

Conventional photoacoustic endoscopy (PAE) is mostly for structural imaging, and its molecular imaging ability is quite limited. In this work, we address this issue and present the development of a flexible acoustic-resolution-based photoacoustic endoscopic (AR-PAE) probe with an outer diameter of 8 mm. This probe is driven by a micro-step motor at the distal end, enabling flexible and precise angular step control to synchronize with the optical parametric oscillator (OPO) lasers. This probe retains the high spatial resolution, high penetration depth, and spectroscopic imaging ability of conventional AR-PAE. Moreover, it is capable for background-free high-specific photoacoustic molecular imaging with a novel pump-probe detection technique, as demonstrated by the distribution visualizing of the FDA approved contrast agent methylene blue (MB) in an ex-vivo pig ileum. This proposed method represents an important technical advancement in multimodal PAE, and can potentially make considerable contributions across various biomedical fields.

High-resolution volumetric information fusion for depth of field enhancement in photoacoustic microscopy

Optical-resolution photoacoustic microscopy suffers from limited depth of field due to the strongly focused laser beam. Here, a novel volumetric information fusion is proposed to achieve large volumetric and high-resolution imaging. First, three-dimensional stationary wavelet transform was performed on the multi-focus data to obtain eight wavelet coefficients. Differential evolution based on joint weighted evaluation was then employed to optimize the block size of division for each wavelet coefficient. The proposed fusion rule using standard deviation for focus detection was used to fuse the corresponding sub-coefficients. Finally, photoacoustic imaging with large depth of field can be achieved by the inverse stationary wavelet transform. Performance test shows that the depth of field of photoacoustic imaging can be doubled without sacrificing lateral resolution. The proposed volumetric information fusion can further promote the capability of volumetric imaging of optical-resolution photoacoustic microscopy and will be helpful in the acquisition of physiological and pathological process.

Deep and Domain Transfer Learning Aided Photoacoustic Microscopy: Acoustic Resolution to Optical Resolution

Acoustic resolution photoacoustic micros- copy (AR-PAM) can achieve deeper imaging depth in biological tissue, with the sacrifice of imaging resolution compared with optical resolution photoacoustic microscopy (OR-PAM). Here we aim to enhance the AR-PAM image quality towards OR-PAM image, which specifically includes the enhancement of imaging resolution, restoration of micro-vasculatures, and reduction of artifacts. To address this issue, a network (MultiResU-Net) is first trained as generative model with simulated AR-OR image pairs, which are synthesized with physical transducer model. Moderate enhancement results can already be obtained when applying this model to in vivo AR imaging data. Nevertheless, the perceptual quality is unsatisfactory due to domain shift. Further, domain transfer learning technique under generative adversarial network (GAN) framework is proposed to drive the enhanced image's manifold towards that of real OR image. In this way, perceptually convincing AR to OR enhancement result is obtained, which can also be supported by quantitative analysis. Peak Signal to Noise Ratio (PSNR) and Structural Similarity Index (SSIM) values are significantly increased from 14.74 dB to 19.01 dB and from 0.1974 to 0.2937, respectively, validating the improvement of reconstruction correctness and overall perceptual quality. The proposed algorithm has also been validated across different imaging depths with experiments conducted in both shallow and deep tissue. The above AR to OR domain transfer learning with GAN (AODTL-GAN) framework has enabled the enhancement target with limited amount of matched in vivo AR-OR imaging data.

Investigation of nonlinear photoacoustic microscopy using a low-cost infrared lamp

Nonlinear photoacoustic microscopy (PAM) is a novel approach to enhance contrast and resolution. In this study, a low-cost infrared (IR) lamp as a simple approach for nonlinear PAM is demonstrated. Numerical simulations are first performed to verify the nonlinear photoacoustic effect under steady heating for two cases: (a) Differentiation of absorbers with different Grüneisen coefficients; (b) enhancement of photoacoustic amplitude. Then, sets of experiments are conducted to experimentally demonstrate our proposed approach: (a) Longitudinal monitoring of photoacoustic A-line signals from two samples, porcine tissue ex vivo and hemoglobin and indocyanine green (ICG) solutions in tubes in vitro for demonstrating the above-mentioned two cases; (b) PAM imaging of hemoglobin and ICG solutions in tubes before and after IR lamp heating. Different signal change and amplitude enhancement are observed in different demonstrations, showing the efficacy of the proposed approach. By virtue of cost-effectiveness and decent performance, our work facilitates nonlinear PAM studies.

Multiscale photoacoustic imaging without motion using single-pixel imaging

The conventional photoacoustic microscopy usually uses mechanical raster scanning to obtain three-dimensional information, and the imaging speed is limited. Meanwhile, the conventional photoacoustic microscopy can only be performed at one single scale due to fixed resolution, it cannot make full use of multiscale information for integrated imaging. Here, we proposed a multiscale photoacoustic microscopy based on single-pixel imaging. A sequence of sinusoidal fringes with varying spatial frequencies is used to obtain the Fourier coefficients in the case of a single ultrasonic transducer. By controlling the spatial frequency of fringe, the acquisition of Fourier coefficients can be controlled and multiscale imaging can be achieved. The feasibility of this method is verified by theory and simulation. The results show that the lateral resolution can be tuned from several microns to tens of microns without mechanical scanning. This method will expand the application of photoacoustic imaging in biomedical research.

Quantitative multilayered assessment of skin lightening by photoacoustic microscopy

BACKGROUND

With the emergence of various new skin-lightening products, there is an urgent need to scientifically evaluate the efficacy and toxicology of these products, and provide scientific guidance for their use based on physiological differences between individuals. Visualized imaging methods and quantitative evaluation criteria play key roles in evaluating the efficacy of skin-lightening products. In order to quantify the changes in the multilayered morphology and endogenous components of human skin before and after the use of lightening products, high-resolution three-dimensional (3D) imaging of human skin is required.

METHODS

In this study, photoacoustic microscopy (PAM; SSPM-532, Guangdong Photoacoustic Medical Technology Co., Ltd.) was used to capture the morphological structures of human skin and reveal skin components quantitatively. The efficacy and safety of skin-lightening products were evaluated by measuring skin melanin concentration and observing skin morphology. The melanin concentration in the epidermis was obtained by examining the linear relationship between photoacoustic (PA) signals. Further, the epidermal thickness and the melanin distribution were obtained in the cross-sectional (x-z) and lateral (x-y) images. Finally, the efficacy of skin-lightening products was evaluated according to the concentration and distribution of melanin in the epidermis, and the safety of cosmetics was assessed by observing the vascular morphology in the dermis.

RESULTS

PAM noninvasively could assess the multilayered morphological structures of human skin, which allowed for quantification of epidermal thickness and melanin concentration of different skin sites. Based on this, the efficacy and safety of skin-lightening products in multilayer structures were quantitatively evaluated.

CONCLUSIONS

As a quantitative imaging method, PAM, has the potential to accurately evaluate the use of skin-lightening products. The method can also be extended to assessments within the larger field of aesthetic medicine.

Photoacoustic microscopy with sparse data by convolutional neural networks

The point-by-point scanning mechanism of photoacoustic microscopy (PAM) results in low-speed imaging, limiting the application of PAM. In this work, we propose a method to improve the quality of sparse PAM images using convolutional neural networks (CNNs), thereby speeding up image acquisition while maintaining good image quality. The CNN model utilizes attention modules, residual blocks, and perceptual losses to reconstruct the sparse PAM image, which is a mapping from a 1/4 or 1/16 low-sampling sparse PAM image to a latent fully-sampled one. The model is trained and validated mainly on PAM images of leaf veins, showing effective improvements quantitatively and qualitatively. Our model is also tested using in vivo PAM images of blood vessels of mouse ears and eyes. The results suggest that the model can enhance the quality of the sparse PAM image of blood vessels in several aspects, which facilitates fast PAM and its clinical applications.

Progress of clinical translation of handheld and semi-handheld photoacoustic imaging

Photoacoustic imaging (PAI), featuring rich contrast, high spatial/temporal resolution and deep penetration, is one of the fastest-growing biomedical imaging technology over the last decade. To date, numbers of handheld and semi-handheld photoacoustic imaging devices have been reported with corresponding potential clinical applications. Here, we summarize emerged handheld and semi-handheld systems in terms of photoacoustic computed tomography (PACT), optoacoustic mesoscopy (OAMes), and photoacoustic microscopy (PAM). We will discuss each modality in three aspects: laser delivery, scanning protocol, and acoustic detection. Besides new technical developments, we also review the associated clinical studies, and the advantages/disadvantages of these new techniques. In the end, we propose the challenges and perspectives of miniaturized PAI in the future.

Photoacoustic endoscopy: A progress review

Endoscopy has been widely used in biomedical imaging and integrated with various optical and acoustic imaging modalities. Photoacoustic imaging (PAI), one of the fastest growing biomedical imaging modalities, is a noninvasive and nonionizing method that owns rich optical contrast, deep acoustic penetration depth, multiscale and multiparametric imaging capability. Hence, it is preferred to miniaturize the volume of PAI and develop an emerged endoscopic imaging modality referred to as photoacoustic endoscopy (PAE). It has been developed for more than one decade since the first report of PAE. Unfortunately, until now, there is no mature photoacoustic endoscopic technique recognized in clinic due to various technical limitations. To address this concern, recent development of new scanning mechanisms, adoption of novel optical/acoustic devices, utilization of superior computation methods and exploration of multimodality strategies have significantly promoted the progress of PAE toward clinic. In this review, we comprehensively reviewed recent progresses in single- and multimodality PAE with new physics, mechanisms and strategies to achieve practical devices for potential applicable scenarios including esophageal, gastrointestinal, urogenital and intravascular imaging. We ended this review with challenges and prospects for future development of PAE.

MEMS Ultrasound Transducers for Endoscopic Photoacoustic Imaging Applications

Photoacoustic imaging (PAI) is drawing extensive attention and gaining rapid development as an emerging biomedical imaging technology because of its high spatial resolution, large imaging depth, and rich optical contrast. PAI has great potential applications in endoscopy, but the progress of endoscopic PAI was hindered by the challenges of manufacturing and assembling miniature imaging components. Over the last decade, microelectromechanical systems (MEMS) technology has greatly facilitated the development of photoacoustic endoscopes and extended the realm of applicability of the PAI. As the key component of photoacoustic endoscopes, micromachined ultrasound transducers (MUTs), including piezoelectric MUTs (pMUTs) and capacitive MUTs (cMUTs), have been developed and explored for endoscopic PAI applications. In this article, the recent progress of pMUTs (thickness extension mode and flexural vibration mode) and cMUTs are reviewed and discussed with their applications in endoscopic PAI. Current PAI endoscopes based on pMUTs and cMUTs are also introduced and compared. Finally, the remaining challenges and future directions of MEMS ultrasound transducers for endoscopic PAI applications are given.

Photoacoustic-ultrasonic dual-mode microscopy with local speed-of-sound estimation

Synthetic aperture imaging and virtual point detection have been exploited to extend the depth of view of photoacoustic microscopy. The approach is commonly based on a constant assumed sound speed, which reduces image quality. We propose a new, to the best of our knowledge, self-adaptive technique to estimate the speed of sound when integrated with this hybrid strategy. It is accomplished through linear regression between the square of time of flight detected at individual virtual detectors and the square of their horizontal distances on the focal plane. The imaging results show our proposed method can significantly improve the lateral resolution, imaging intensity, and spatial precision for inhomogeneous tissue.

Towards a Low-Cost and Portable Photoacoustic Microscope for Point-of-Care and Wearable Applications

Several breakthrough applications in biomedical imaging have been reported in the recent years using advanced photoacoustic microscopy imaging systems. While two photon and other optical microscopy systems have recently emerged in portable and wearable form, there is much less work reported on the portable and wearable photoacoustic microscopy (PAM) systems. Working towards this goal, we report our studies on a low-cost and portable photoacoustic microscopy system that uses a custom fabricated 2.5 mm diameter ring ultrasound transducer integrated with a fiber-coupled laser diode. The ultrasound transducer is centered at 17.25 MHz, and shows ~ 45% and ~ 100% fractional bandwidths for ultrasound pulse-echo and photoacoustic A-line signals respectively. To achieve overall system portability, besides the imaging head, other backend imaging system components need to be readily portable as well. In this direction, we have studied the potential use of compact pre-amplifiers, scanning stages and microcontroller based data acquisition and reconstruction for photoacoustic imaging. The portable PAM system is validated by imaging phantoms embedded with light absorbing targets. Future directions that will likely help achieve a completely portable and wearable photoacoustic microscopy system are discussed.

Lithium niobate-based transparent ultrasound transducers for photoacoustic imaging

This Letter demonstrates lithium niobate (LiNbO₃)-based transparent ultrasound transducers (TUTs) for photoacoustic imaging applications. The TUTs were fabricated by coating the top and bottom surfaces of a 0.25 mm thick LiNbO₃wafer with transparent indium-tin-oxide (ITO) electrodes. The resulting transducers showed ∼80% optical transparency in the wavelength range of 690-970 nm. The TUTs had a resonant frequency of 14.5 MHz and ∼70% photoacoustic bandwidth. The versatility of the TUT approach is demonstrated by introducing two different transparent photoacoustic imaging (PAI) geometries. In one method, which suits endoscopy applications, an optical fiber of a laser diode is directly fixed on the backside of a 2.5 mm diameter TUT, and the fiber-TUT device is raster scanned to form 3D photoacoustic images. In the second method, which suits high-throughput applications, a free-space optical-only raster scanning of the laser fiber across a 1  cm×1  cm planar TUT yielded 3D photoacoustic images. The proposed TUT approach is low in cost, easy to manufacture, compatible with conventional clinical ultrasound electronics, and scalable for different configurations, including 2D TUT arrays to achieve real-time 3D high-throughput PAI.

PMN-PT/Epoxy 1-3 composite based ultrasonic transducer for dual-modality photoacoustic and ultrasound endoscopy

Endoscopic dual-modality photoacoustic (PA) and ultrasound (US) imaging has the capability of providing morphology and molecular information simultaneously. An ultrasonic transducer was applied for detecting PA signals and performing US imaging which determines the sensitivity and performance of a dual-modality PA/US system. In our study, a miniature single element 32-MHz lead magnesium niobate-lead titanate (PMN-PT) epoxy 1-3 composite based ultrasonic transducer was developed. A miniature endoscopic probe based on this transducer has been fabricated. Using the dual modality PA/US system with a PMN-PT/epoxy 1-3 composite based ultrasonic transducer, phantom and in vivo animal studies have been conducted to evaluate the performance. The preliminary results show enhanced bandwidths of the new ultrasonic transducer and improved signal-to-noise ratio of PA and US images of rat colorectal wall compared with PMN-PT and lead zirconate titanate (PZT) composite based ultrasonic transducers.

High-speed simultaneous multiscale photoacoustic microscopy

Photoacoustic microscopy (PAM) is a fast-growing biomedical imaging technique that provides high-resolution in vivo imaging beyond the optical diffusion limit. Depending on the scalable lateral resolution and achievable penetration depth, PAM can be classified into optical resolution PAM (OR-PAM) and acoustic resolution PAM (AR-PAM). The use of a microelectromechanical systems (MEMS) scanner has improved OR-PAM imaging speed significantly and is highly beneficial in the development of miniaturized handheld devices. The shallow penetration depth of OR-PAM limits the use of such devices for a wide range of clinical applications. We report the use of a high-speed MEMS scanner for both OR-PAM and AR-PAM. A high-speed, wide-area scanning integrated OR-AR-PAM system combining MEMS scanner and raster mechanical movement was developed. A lateral resolution of 5  μm and penetration depth ∼0.9-mm in vivo was achieved using OR-PAM at 586 nm, whereas a lateral resolution of 84  μm and penetration depth of ∼2-mm in vivo was achieved using AR-PAM at 532 nm.

1064 nm acoustic resolution photoacoustic microscopy

Photoacoustic imaging is a noninvasive imaging technique having the advantages of high-optical contrast and good acoustic resolution at improved imaging depths. Light transport in biological tissues is mainly characterized by strong optical scattering and absorption. Photoacoustic microscopy is capable of achieving high-resolution images at greater depth compared to conventional optical microscopy methods. In this work, we have developed a high-resolution, acoustic resolution photoacoustic microscopy (AR-PAM) system in the near infra-red (NIR) window II (NIR-II, eg, 1064 nm) for deep tissue imaging. Higher imaging depth is achieved as the tissue scattering at 1064 nm is lesser compared to visible or near infrared window-I (NIR-I). Our developed system can provide a lateral resolution of 130 μm, axial resolution of 57 μm, and image up to 11 mm deep in biological tissues. This 1064-AR-PAM system was used for imaging sentinel lymph node and the lymph vessel in rat. Urinary bladder of rat filled with black ink was also imaged to validate the feasibility of the developed system to study deeply seated organs.

Artifact-free imaging through a bone-like layer by using an ultrasonic-guided photoacoustic microscopy

Reflection artifacts caused by a bone-like layer badly degrade the quality of photoacoustic images in many biomedical applications, e.g., in vivo brain imaging through the skull. We proposed an ultrasonic-guided photoacoustic microscopy (PAM) to remove the reflection artifacts. This system is developed from dual-mode microscopy, integrating a scanning acoustic microscopy with a conventional PAM. Based on similar propagation characteristics of a photoacoustic signal and ultrasonic echo in a bone-like layer, we employ the ultrasonic echo as a filter to remove the multiple reflected artifacts in photoacoustic signals and obtain artifact-free images. An experiment of imaging a phantom below a bone-like film is used to demonstrate the performance of this method. The results suggest that this method can achieve an artifact-free image of the phantom under the film successfully, whereas the conventional PAM fails to achieve clean images of the vessel-like absorbers. This study might improve the imaging quality of PAM in many biomedical applications.

Miniature probe for all-optical double gradient-index lenses photoacoustic microscopy

A novel all-optical double gradient-index (GRIN) lens optical-resolution photoacoustic microscopy (OR-PAM), termed as DGL-PAM, is demonstrated. The miniature probe consists of a single-mode fiber and double GRIN lenses for optical focusing and a miniature fiber Fabry-Perot sensor for ultrasound detection. The new design is simple and realizes high resolution with long working distance (WD) by virtue of the double GRIN lenses. The overall size of the probe is 2.7 mm in diameter. High lateral resolution of 3.7 μm (at 532 nm laser wavelength) and long WD of 5.5 mm are achieved. In vivo OR-PAM of mouse ear demonstrates the imaging ability of DGL-PAM. Since precise alignment of optical and acoustic foci is not needed, the proposed DGL-PAM is relatively easy to implement. It has potential to be developed as a low-cost, disposable OR-PAM probe and for endoscopic applications. The proposed double GRIN lenses for making miniature endoscopic probes can also be applied to other modalities, such as optical coherence tomography and confocal fluorescence microscopy, to enable high resolution and long WD.