Quantitative analysis on in vivo tumor-microvascular images from optical-resolution photoacoustic microscopy

WSA-MP-Net: Weak-signal-attention and multi-scale perception network for microvascular extraction in optical-resolution photoacoustic microcopy

The unique advantage of optical-resolution photoacoustic microscopy (OR-PAM) is its ability to achieve high-resolution microvascular imaging without exogenous agents. This ability has excellent potential in the study of tissue microcirculation. However, tracing and monitoring microvascular morphology and hemodynamics in tissues is challenging because the segmentation of microvascular in OR-PAM images is complex due to the high density, structure complexity, and low contrast of vascular structures. Various microvasculature extraction techniques have been developed over the years but have many limitations: they cannot consider both thick and thin blood vessel segmentation simultaneously, they cannot address incompleteness and discontinuity in microvasculature, there is a lack of open-access datasets for DL-based algorithms. We have developed a novel segmentation approach to extract vascularity in OR-PAM images using a deep learning network incorporating a weak signal attention mechanism and multi-scale perception (WSA-MP-Net) model. The proposed WSA network focuses on weak and tiny vessels, while the MP module extracts features from different vessel sizes. In addition, Hessian-matrix enhancement is incorporated into the pre-and post-processing of the input and output data of the network to enhance vessel continuity. We constructed normal vessel (NV-ORPAM, 660 data pairs) and tumor vessel (TV-ORPAM, 1168 data pairs) datasets to verify the performance of the proposed method. We developed a semi-automatic annotation algorithm to obtain the ground truth for our network optimization. We applied our optimized model successfully to monitor glioma angiogenesis in mouse brains, thus demonstrating the feasibility and excellent generalization ability of our model. Compared to previous works, our proposed WSA-MP-Net extracts a significant number of microvascular while maintaining vessel continuity and signal fidelity. In quantitative analysis, the indicator values of our method improved by about 1.3% to 25.9%. We believe our proposed approach provides a promising way to extract a complete and continuous microvascular network of OR-PAM and enables its use in many microvascular-related biological studies and medical diagnoses.

Non-invasive evaluation of endometrial microvessels via in vivo intrauterine photoacoustic endoscopy

The endometrium microvessel system, responsible for supplying oxygen and nutrients to the embryo, holds significant importance in evaluating endometrial receptivity (ER). Visualizing this system directly can significantly enhance ER evaluation. Currently, clinical methods like Narrow-band hysteroscopy and Color Doppler ultrasound are commonly used for uterine blood vessel examination, but they have limitations in depth or resolution. Endoscopic Photoacoustic Imaging (PAE) has proven effective in visualizing microvessels in the digestive tract, while its adaptation to uterine imaging faces challenges due to the uterus's unique physiological characteristics. This paper for the first time that uses high-resolution PAE in vivo to capture a comprehensive network of endometrial microvessels non-invasively. Followed by continuous observation and quantitative analysis in the endometrial injury model, we further corroborated that PAE detection of endometrial microvessels stands as a valuable indicator for evaluating ER. The PAE system showcases its promising potential for integration into reproductive health assessments.

In-vivo assessment of a rat rectal tumor using optical-resolution photoacoustic endoscopy

Optical-resolution photoacoustic endoscopy (OR-PAE) has been proven to realize imaging on the vascular network in the gastrointestinal (GI) tract with high sensitivity and spatial resolution, providing morphological information. Various photoacoustic endoscopic catheters were developed to improve the resolution and adaptivity of in-vivo imaging. However, this technology has not yet been validated on in-vivo GI tumors, which generally feature angiogenesis. The tumor causes thickened mucosa and neoplasia, requiring large depth-of-field (DOF) in imaging, which contradicts to high-resolution imaging. In this work, a novel catheter was developed with a high resolution of ∼27 µm, providing a matched DOF of ∼400 µm to cover the vessels up to the submucosa layer. Optical-resolution photoacoustic endoscopic imaging was first performed on in-vivo rat rectal tumors. In addition, to further characterize the vessel morphology, tumor-suspected regions and normal regions were selected for quantification and analysis of vessel dimension distribution and tortuosity. All the results suggest that the OR-PAE has great application potential in tumor diagnosis, evaluation, and monitoring of therapeutic efficacy.

Classification-based framework for binarization on mice eye image in vivo with optical coherence tomography

Optical coherence tomography (OCT) angiography has drawn much attention in the medical imaging field. Binarization plays an important role in quantitative analysis of eye with optical coherence tomography. To address the problem of few training samples and contrast-limited scene, we proposed a new binarization framework with specific-patch SVM (SPSVM) for low-intensity OCT image, which is open and classification-based framework. This new framework contains two phases: training model and binarization threshold. In the training phase, firstly, the patches of target and background from few training samples are extracted as the ROI and the background, respectively. Then, PCA is conducted on all patches to reduce the dimension and learn the eigenvector subspace. Finally, the classification model is trained from the features of patches to get the target value of different patches. In the testing phase, the learned eigenvector subspace is conducted on the pixels of each patch. The binarization threshold of patch is obtained with the learned SVM model. We acquire a new OCT mice eye (OCT-ME) database, which is publicly available at https://mip2019.github.io/spsvm. Extensive experiments were performed to demonstrate the effectiveness of the proposed SPSVM framework.

Tracking Strain-Specific Morphogenesis and Angiogenesis of Murine Calvaria with Large-Scale Optoacoustic and Ultrasound Microscopy

Skull bone development is a dynamic and well-coordinated process playing a key role in maturation and maintenance of the bone marrow (BM), fracture healing, and progression of diseases such as osteoarthritis or osteoporosis. At present, dynamic transformation of the growing bone (osteogenesis) as well as its vascularization (angiogenesis) remain largely unexplored due to the lack of suitable in vivo imaging techniques capable of noninvasive visualization of the whole developing calvaria at capillary-level resolution. We present a longitudinal study on skull bone development using ultrasound-aided large-scale optoacoustic microscopy (U-LSOM). Skull bone morphogenesis and microvascular growth patterns were monitored in three common mouse strains (C57BL/6J, CD-1, and Athymic Nude-Foxn1nu) at the whole-calvaria scale over a 3-month period. Strain-specific differences in skull development were revealed by quantitative analysis of bone and vessel parameters, indicating the coupling between angiogenesis and osteogenesis during skull bone growth in a minimally invasive and label-free manner. The method further enabled identifying BM-specific sinusoidal vessels, and superficial skull vessels penetrating into BM compartments. Our approach furnishes a new high-throughput longitudinal in vivo imaging platform to study morphological and vascular skull alterations in health and disease, shedding light on the critical links between blood vessel formation, skull growth, and regeneration. © 2022 The Authors. Journal of Bone and Mineral Research published by Wiley Periodicals LLC on behalf of American Society for Bone and Mineral Research (ASBMR).

Spectroscopic thermo-elastic optical coherence tomography for tissue characterization

Optical imaging techniques that provide free space, label free imaging are powerful tools in obtaining structural and biochemical information in biological samples. To date, most of the optical imaging technologies create images with a specific contrast and require multimodality integration to add additional contrast. In this study, we demonstrate spectroscopic Thermo-elastic Optical Coherence Tomography (TE-OCT) as a potential tool in tissue identification. TE-OCT creates images based on two different forms of contrast: optical reflectance and thermo-elastic deformation. TE-OCT uses short laser pulses to induce thermo-elastic tissue deformation and measures the resulting surface displacement using phase-sensitive OCT. In this work we characterized the relation between thermo-elastic displacement and optical absorption, excitation, fluence and illumination area. The experimental results were validated with a 2-dimensional analytical model. Using spectroscopic TE-OCT, the thermo-elastic spectra of elastic phantoms and tissue components in coronary arteries were extracted. Specific tissue components, particularly lipid, an important biomarker for identifying atherosclerotic lesions, can be identified in the TE-OCT spectral response. As a label-free, free-space, dual-contrast, all-optical imaging technique, spectroscopic TE-OCT holds promise for biomedical research and clinical pathology diagnosis.

Multi-step deep neural network for identifying subfascial vessels in a dorsal skinfold window chamber model

Automatic segmentation of blood vessels in the dorsal skinfold window chamber (DWSC) model is a prerequisite for the evaluation of vascular-targeted photodynamic therapy (V-PDT) biological response. Recently, deep learning methods have been widely applied in blood vessel segmentation, but they have difficulty precisely identifying the subfascial vessels. This study proposed a multi-step deep neural network, named the global attention-Xnet (GA-Xnet) model, to precisely segment subfascial vessels in the DSWC model. We first used Hough transform combined with a U-Net model to extract circular regions of interest for image processing. GA step was then employed to obtain global feature learning followed by coarse segmentation for the entire blood vessel image. Secondly, the coarse segmentation of blood vessel images from the GA step and the same number of retinal images from the DRIVE datasets were combined as the mixing sample, inputted into the Xnet step to learn the multiscale feature predicting fine segmentation maps of blood vessels. The data show that the accuracy, sensitivity, and specificity for the segmentation of multiscale blood vessels in the DSWC model are 96.00%, 86.27%, 96.47%, respectively. As a result, the subfascial vessels could be accurately identified, and the connectedness of the vessel skeleton is well preserved. These findings suggest that the proposed multi-step deep neural network helps evaluate the short-term vascular responses in V-PDT.

Recent Technical Progression in Photoacoustic Imaging—Towards Using Contrast Agents and Multimodal Techniques

For combining optical and ultrasonic imaging methodologies, photoacoustic imaging (PAI) is the most important and successful hybrid technique, which has greatly contributed to biomedical research and applications. Its theoretical background is based on the photoacoustic effect, whereby a modulated or pulsed light is emitted into tissue, which selectively absorbs the optical energy of the light at optical wavelengths. This energy produces a fast thermal expansion in the illuminated tissue, generating pressure waves (or photoacoustic waves) that can be detected by ultrasonic transducers. Research has shown that optical absorption spectroscopy offers high optical sensitivity and contrast for ingredient determination, for example, while ultrasound has demonstrated good spatial resolution in biomedical imaging. Photoacoustic imaging combines these advantages, i.e., high contrast through optical absorption and high spatial resolution due to the low scattering of ultrasound in tissue. In this review, we focus on advances made in PAI in the last five years and present categories and key devices used in PAI techniques. In particular, we highlight the continuously increasing imaging depth achieved by PAI, particularly when using exogenous reagents. Finally, we discuss the potential of combining PAI with other imaging techniques.

High-security photoacoustic identity recognition by capturing hierarchical vascular structure of finger

Currently, most biometric methods mainly use single features, making them easily forged and cracked. In this study, a novel triple-layers biometric recognition method, based on photoacoustic microscopy, is proposed to improve the security of biometric identity recognition. Using the photoacoustic (PA) dermoscope, three-dimensional absorption-structure information of the fingers was obtained. Then, by combining U-Net, Gabor filtering, wavelet analysis and morphological transform, a lightweight algorithm called photoacoustic depth feature recognition algorithm (PADFR) was developed to automatically realize stratification (the fingerprint, blood vessel fingerprint and venous vascular), extracting feature points and identity recognition. The experimental results show that PADFR can automatically recognize the PA hierarchical features with an average accuracy equal to 92.99%. The proposed method is expected to be widely used in biometric identification system due to its high security.

Long-Term Imaging of Wound Angiogenesis with Large Scale Optoacoustic Microscopy

Wound healing is a well-coordinated process, necessitating efficient formation of new blood vessels. Vascularization defects are therefore a major risk factor for chronic, non-healing wounds. The dynamics of mammalian tissue revascularization, vessel maturation, and remodeling remain poorly understood due to lack of suitable in vivo imaging tools. A label-free large-scale optoacoustic microscopy (LSOM) approach is developed for rapid, non-invasive, volumetric imaging of tissue regeneration over large areas spanning up to 50 mm with a depth penetration of 1.5 mm. Vascular networks in dorsal mouse skin and full-thickness excisional wounds are imaged with capillary resolution during the course of healing, revealing previously undocumented views of the angiogenesis process in an unperturbed wound environment. Development of an automatic analysis framework enables the identification of key features of wound angiogenesis, including vessel length, diameter, tortuosity, and angular alignment. The approach offers a versatile tool for preclinical research in tissue engineering and regenerative medicine, empowering label-free, longitudinal, high-throughput, and quantitative studies of the microcirculation in processes associated with normal and impaired vascular remodeling, and analysis of vascular responses to pharmacological interventions in vivo.

The role of Notch ligand, Delta-like ligand 4 (DLL4), in cancer angiogenesis—implications for therapy

Background

It is generally accepted that angiogenesis is a complex and tightly regulated process characterized by the growth of blood vessels from existing vasculature. Activation of the Notch signalling pathway affects multiple aspects of vascular development. One of the components of the Notch signalling pathway, Delta-like ligand 4 (DLL4), has recently appeared as a critical regulator of tumour angiogenesis and thus as a promising therapeutic target.

Methods

This review article includes available data from peer-reviewed publications associated with the role of DLL4 in cancer angiogenesis. Searches were performed in PubMed, EMBASE, Google Scholar and Web of Science using the terms “tumour angiogenesis”, “DLL4”, “Notch signalling” and “anti-cancer therapy”.

Results

The survival curves of cancer patients revealed that the patients with high DLL4 expression levels had significantly shorter survival times than the patients with low DLL4 expression. Moreover, a positive correlation was also identified between DLL4 and VEGF receptorsʼ expression levels. It seems that inhibition of DLL4 may exert potent growth inhibitory effects on some tumours resistant to anti-VEGF therapies. A great number of blocking agents of DLL4/Notch signalling including anti-DLL4 antibodies, DNA vaccination, Notch antibodies and gamma-secretase inhibitors have been studied in preclinical tumour models.

Conclusion

DLL4 seems to be a promising target in anti-cancer therapy. Nevertheless, the careful evaluation of adverse effects on normal physiological processes in relation to therapeutic doses of anti-DLL4 drugs will be significant for advancement of DLL4 blocking agents in clinical oncology.

Full three-dimensional segmentation and quantification of tumor vessels for photoacoustic images

Quantitative analysis of tumor vessels is of great significance for tumor staging and diagnosis. Photoacoustic imaging (PAI) has been proven to be an effective way to visualize comprehensive tumor vascular networks in three-dimensional (3D) volume, while previous studies only quantified the vessels projected in one plane. In this study, tumor vessels were segmented and quantified in a full 3D framework. It had been verified in the phantom experiments that the 3D quantification results have better accuracy than 2D. Furthermore, in vivo vessel images were quantified by 2D and 3D quantification methods respectively. And the difference between these two results is significant. In this study, complete vessel segmentation and quantification method within a 3D framework was implemented, which showed obvious advantage in the analysis accuracy of 3D photoacoustic images, and potentially improve tumor study and diagnosis.

Photoacoustic and ultrasound (PAUS) dermoscope with high sensitivity and penetration depth by using a bimorph transducer

A bimorph transducer was proposed to improve the detection sensitivity and imaging depth of photoacoustic and ultrasound (PAUS) dermoscope. By applying the bimorph transducer, the imaging depth and sensitivity of PAUS dermoscope were enhanced by simultaneously improving excitation efficiency and reception bandwidth. The integrated design of the imaging head of the dermoscope makes it highly convenient for detecting human skin. The PAUS imaging performance was demonstrated via visualizing subcutaneous tumor and depicting full structures of different skin layers from epidermis to subcutaneous tissue. The results confirm that the dermoscope with the bimorph transducer is well suited for PA and US dual-modality imaging, which can provide multi-information for skin disease.

Wide-field monitoring and real-time local recording of microvascular networks on small animals with a dual-raster-scanned photoacoustic microscope

Photoacoustic microscopy (PAM) provides a new method for the imaging of small-animals with high-contrast and deep-penetration. However, the established PAM systems have suffered from a limited field-of-view or imaging speed, which are difficult to both monitor wide-field activity of organ and record real-time change of local tissue. Here, we reported a dual-raster-scanned photoacoustic microscope (DRS-PAM) that integrates a two-dimensional motorized translation stage for large field-of-view imaging and a two-axis fast galvanometer scanner for real-time imaging. The DRS-PAM provides a flexible transition from wide-field monitoring the vasculature of organs to real-time imaging of local dynamics. To test the performance of DRS-PAM, clear characterization of angiogenesis and functional detail was illustrated, hemodynamic activities of vasculature in cerebral cortex of a mouse were investigated. Furthermore, response of tumor to treatment were successfully monitored during treatment. The experimental results demonstrate the DRS-PAM holds the great potential for biomedical research of basic biology.

Electrothermal-MEMS-induced nonlinear distortion correction in photoacoustic laparoscopy

Micro-electro-mechanical systems (MEMS) scanner has significant advantages of miniature size, fast response and high stability, which is particularly applicable to photoacoustic laparoscopy (PAL). However, tilt angle-voltage curve of electrothermal MEMS shows a nonlinear character, which leads to inevitable nonlinear distortion in photoacoustic imaging. To overcome this problem, a nonlinear distortion correction was developed for the high-resolution forward-scanning electrothermal-MEMS-based PAL. The adaptive resampling method (ARM) was introduced to adaptively calibrate the projection of non-uniform scanning region to match the uniform scanning region. The correction performed low time complexity and high portability owing to the adaptive capacity of distortion decomposition in the reconstruction of physical models. Compared with the sample structure, phantom experiments demonstrated that the distortion was calibrated in all directions and the corrected image provided up to 96.82% high structural similarity in local subset. Furthermore, ARM was applied to imaging the abdominal cavity of rat and the vascular morphology was corrected in real-time display within a delay less than 2 seconds. All these results demonstrated that the nonlinear distortion correction possessed timely and effective correction in PAL, which suggested that it had the potential to employ to any other electrothermal-MEMS-based photoacoustic imaging systems for accurate and quantitative functional imaging.

Three-dimensional label-free imaging of mammalian yolk sac vascular remodeling with optical resolution photoacoustic microscopy

Vessel development in the yolk sac is important for the embryo development and the malfunction of which can lead to cardiac dysfunction, embryonic malformation and miscarriage. Although substantial emphasis has been placed on the yolk sac vascular remodeling, no detailed three-dimensional (3D) imaging and quantitative analysis of this process has been described. Herein, we explored the development of the vascular system in the visceral yolk sac (VYS) on E11.5, E12.5 and E13.5 mouse embryos using a home-built large field-of-view (FOV) optical-resolution photoacoustic microscopy (OR-PAM). The results showed that OR-PAM can be used as a label-free imaging tool for studying the 2D/3D morphology changes of the vascular system during organogenesis. In addition, after a quantitative analysis the results showed that the microvascular density in the VYS gradually reduced along with the embryo growth. Vascular density in the VYS of E11.5 mouse embryos was almost 6-fold than that of E13.5. Hovever, the averaged vessel diameter of the entire VYS membrane increased gradually with the development of embryos. This study suggests that OR-PAM is a potential tool for acquiring the hemodynamic parameters of mammalian embryos, which could be further used for studying diseases related with the vascular remodeling such as vascular malformations and heart defects.

Quantitative investigation of vascular response to mesenteric venous thrombosis using large-field-of-view photoacoustic microscopy

Mesenteric venous thrombosis (MVT) is one of major causes leading to severe mesenteric ischemia. Vascular network plays an important role during the occurrence and development of MVT. However, there lacks an appropriate imaging method, which features advanced volumetric resolving capability, superior sensitivity to hemoglobin, and ultra-large field-of-view (FOV), to investigate vascular response of MVT. In this study, we developed and applied a large-FOV optical resolution photoacoustic microscopy to quantify the vascular response during the entire course of two different MVT models in which we ligated the superior mesenteric vein and inferior mesenteric vein, respectively. Furthermore, we developed a quantitative algorithm to derive total vascular length, relative concentration of total hemoglobin and vascular density over the FOV to reveal different vascular responses in different MVT models.