Skeletonization algorithm-based blood vessel quantification usingin vivo3D photoacoustic imaging

3D Visualization, Skeletonization and Branching Analysis of Blood Vessels in Angiogenesis

Angiogenesis is the process of new blood vessels growing from existing vasculature. Visualizing them as a three-dimensional (3D) model is a challenging, yet relevant, task as it would be of great help to researchers, pathologists, and medical doctors. A branching analysis on the 3D model would further facilitate research and diagnostic purposes. In this paper, a pipeline of vision algorithms is elaborated to visualize and analyze blood vessels in 3D from formalin-fixed paraffin-embedded (FFPE) granulation tissue sections with two different staining methods. First, a U-net neural network is used to segment blood vessels from the tissues. Second, image registration is used to align the consecutive images. Coarse registration using an image-intensity optimization technique, followed by finetuning using a neural network based on Spatial Transformers, results in an excellent alignment of images. Lastly, the corresponding segmented masks depicting the blood vessels are aligned and interpolated using the results of the image registration, resulting in a visualized 3D model. Additionally, a skeletonization algorithm is used to analyze the branching characteristics of the 3D vascular model. In summary, computer vision and deep learning is used to reconstruct, visualize and analyze a 3D vascular model from a set of parallel tissue samples. Our technique opens innovative perspectives in the pathophysiological understanding of vascular morphogenesis under different pathophysiological conditions and its potential diagnostic role.

Quantification of vascular networks in photoacoustic mesoscopy

Mesoscopic photoacoustic imaging (PAI) enables non-invasive visualisation of tumour vasculature. The visual or semi-quantitative 2D measurements typically applied to mesoscopic PAI data fail to capture the 3D vessel network complexity and lack robust ground truths for assessment of accuracy. Here, we developed a pipeline for quantifying 3D vascular networks captured using mesoscopic PAI and tested the preservation of blood volume and network structure with topological data analysis. Ground truth data of in silico synthetic vasculatures and a string phantom indicated that learning-based segmentation best preserves vessel diameter and blood volume at depth, while rule-based segmentation with vesselness image filtering accurately preserved network structure in superficial vessels. Segmentation of vessels in breast cancer patient-derived xenografts (PDXs) compared favourably to ex vivo immunohistochemistry. Furthermore, our findings underscore the importance of validating segmentation methods when applying mesoscopic PAI as a tool to evaluate vascular networks in vivo.

Development of Stereo NIR-II Fluorescence Imaging System for 3D Tumor Vasculature in Small Animals

Near-infrared-II (NIR-II, 1000–1700 nm) fluorescence imaging boasts high spatial resolution and deep tissue penetration due to low light scattering, reduced photon absorption, and low tissue autofluorescence. NIR-II biological imaging is applied mainly in the noninvasive visualization of blood vessels and tumors in deep tissue. In the study, a stereo NIR-II fluorescence imaging system was developed for acquiring three-dimension (3D) images on tumor vasculature in real-time, on top of the development of fluorescent semiconducting polymer dots (IR-TPE Pdots) with ultra-bright NIR-II fluorescence (1000–1400 nm) and high stability to perform long-term fluorescence imaging. The NIR-II imaging system only consists of one InGaAs camera and a moving stage to simulate left-eye view and right-eye view for the construction of 3D in-depth blood vessel images. The system was validated with blood vessel phantom of tumor-bearing mice and was applied successfully in obtaining 3D blood vessel images with 0.6 mm- and 5 mm-depth resolution and 0.15 mm spatial resolution. The NIR-II stereo vision provides precise 3D information on the tumor microenvironment and blood vessel path.

REAP: revealing drug tolerant persister cells in cancer using contrast enhanced optical coherence and photoacoustic tomography

Despite chemotherapy, residual tumors often rely on so-called drug tolerant persister (DTP) cells, which evade treatment to give rise to therapy-resistant relapse and refractory disease. Detection of residual tumor cells proves to be challenging because of the rarity and heterogeneity of DTP cells. In the framework of a H2020 project, REAP will gather researchers and engineers from six countries, who will combine their expertise in biology, chemistry, oncology, material sciences, photonics, and electrical and biomedical engineering in the hope of revealing DTPs in cancer using contrast enhanced multimodal optical imaging. Laser sources for photoacoustic microscopy, photoacoustic tomography, and optical coherence tomography will be developed to enable the design of a two-photon laser scanning optical coherence photoacoustic microscopy system and an optical coherence photoacoustic tomography system. Furthermore, novel photoacoustic detectors using micro-ring resonator will be designed and fabricated, granting improved sensitivity and easier integration of multiple optical imaging modalities into a single system. Innovative algorithms will be developed to reconstruct and analyze the images quickly and automatically. With successful implementation of this four-year project, we can not only gain insight into the mechanisms governing DTPs, but also significantly advance the technology readiness level of contrast agents, lasers, sensors, and image analysis software through joint efforts.

Optical Coherence Tomography Angiography Monitors Cutaneous Wound Healing under Angiogenesis-Promoting Treatment in Diabetic and Non-Diabetic Mice

During wound healing, the rapid re-establishment of a functional microcirculation in the wounded tissue is of utmost importance. We applied optical coherence tomography (OCT) angiography to evaluate vascular remodeling in an excisional wound model in the pinnae of C57BL/6 and db/db mice receiving different proangiogenic topical treatments. Analysis of the high-resolution OCT angiograms, including the four quantitative parameters vessel density, vessel length, number of bifurcations, and vessel tortuosity, revealed changes of the microvasculature and allowed identification of the overlapping wound healing phases hemostasis, inflammation, proliferation, and remodeling. Angiograms acquired in the inflammatory phase in the first days showed a dilation of vessels and recruitment of pre-existing capillaries. In the proliferative phase, angiogenesis with the sprouting of new capillaries into the wound tissue led to an increase of the OCT angiography parameters vessel density, normalized vessel length, number of bifurcations, and vessel tortuosity by 28–47%, 39–52%, 33–48%, and 3–8% versus baseline, respectively. After the peak observed on study days four to seven, the parameters slowly decreased but remained still elevated 18 days after wounding, indicating a continuing remodeling phase. Our study suggests that OCT angiography has the potential to serve as a valuable preclinical research tool in studies investigating impaired vascular remodeling during wound healing and potential new treatment strategies.

Photoacoustic Imaging

Photoacoustic imaging (PAI) is an emerging imaging modality that shows great potential for preclinical research and clinical practice. As a hybrid technique, PAI uniquely combines the advantages of optical excitation and of acoustic detection. Optical excitation provides a rich contrast mechanism from either endogenous or exogenous chromophores, allowing PAI to perform biochemical, functional, and molecular imaging. Acoustic detection benefits from the low scattering of ultrasound in biological tissue, enabling PAI to generate high-resolution images in both the optical ballistic and diffusive regimes. Accordingly, this hybrid imaging modality features high sensitivity to optical absorption and wide scalability of spatial resolution with the desired imaging depth. Over the past two decades, the photoacoustic technique has led to a variety of exciting discoveries and applications from laboratory research to clinical patient care. In biological research, PAI has become an irreplaceable tool, providing functional optical contrast with high spatiotemporal resolution. Translational PAI also attracted growing interest in clinical applications including tumor margin examination, internal organ imaging, breast cancer screening, and sentinel lymph node mapping, among others.

Prospects of Photo- and Thermoacoustic Imaging in Neurosurgery

The evolution of neurosurgery has been, and continues to be, closely associated with innovations in technology. Modern neurosurgery is wed to imaging technology and the future promises even more dependence on anatomic and, perhaps more importantly, functional imaging. The photoacoustic phenomenon was described nearly 140 yr ago; however, biomedical applications for this technology have only recently received significant attention. Light-based photoacoustic and microwave-based thermoacoustic technologies represent novel biomedical imaging modalities with broad application potential within and beyond neurosurgery. These technologies offer excellent imaging resolution while generally considered safer, more portable, versatile, and convenient than current imaging technologies. In this review, we summarize the current state of knowledge regarding photoacoustic and thermoacoustic imaging and their potential impact on the field of neurosurgery.

Full three-dimensional segmentation and quantification of tumor vessels for photoacoustic images

Quantitative analysis of tumor vessels is of great significance for tumor staging and diagnosis. Photoacoustic imaging (PAI) has been proven to be an effective way to visualize comprehensive tumor vascular networks in three-dimensional (3D) volume, while previous studies only quantified the vessels projected in one plane. In this study, tumor vessels were segmented and quantified in a full 3D framework. It had been verified in the phantom experiments that the 3D quantification results have better accuracy than 2D. Furthermore, in vivo vessel images were quantified by 2D and 3D quantification methods respectively. And the difference between these two results is significant. In this study, complete vessel segmentation and quantification method within a 3D framework was implemented, which showed obvious advantage in the analysis accuracy of 3D photoacoustic images, and potentially improve tumor study and diagnosis.

Automatic skin lesion area determination of basal cell carcinoma using optical coherence tomography angiography and a skeletonization approach: Preliminary results

Cutaneous blood flow plays a key role in numerous physiological and pathological processes and has significant potential to be used as a biomarker to diagnose skin diseases such as basal cell carcinoma (BCC). The determination of the lesion area and vascular parameters within it, such as vessel density, is essential for diagnosis, surgical treatment and follow-up procedures. Here, an automatic skin lesion area determination algorithm based on optical coherence tomography angiography (OCTA) images is presented for the first time. The blood vessels are segmented within the OCTA images and then skeletonized. Subsequently, the skeleton is searched over the volume and numerous quantitative vascular parameters are calculated. The vascular density is then used to segment the lesion area. The algorithm is tested on both nodular and superficial BCC, and comparing with dermatological and histological results, the proposed method provides an accurate, non-invasive, quantitative and automatic tool for BCC lesion area determination.

Optical coherence tomography angiography and photoacoustic imaging in dermatology

Optical coherence tomography angiography (OCTA) is a relatively novel functional extension of the widely accepted ophthalmic imaging tool named optical coherence tomography (OCT). Since OCTA's debut in ophthalmology, researchers have also been trying to expand its translational application in dermatology. The ability of OCTA to resolve microvasculature has shown promising results in imaging skin diseases. Meanwhile, photoacoustic imaging (PAI), which uses laser pulse induced ultrasound waves as the signal, has been studied to differentiate human skin layers and to help in skin disease diagnosis. This perspective article gives a short review of OCTA and PAI in the field of photodermatology. After an introduction to the principles of OCTA and PAI, we describe the most updated results of skin disease imaging using these two optical imaging modalities. We also place emphasis on dual modality imaging combining OCTA and photoacoustic tomography (PAT) for dermatological applications. In the end, the challenges and prospects of these two imaging modalities in dermatology are discussed.

In vivo dual-scale photoacoustic surveillance and assessment of burn healing

Accurate diagnoses of superficial and deep dermal burns are difficult to make even by experienced investigators due to slight differences in dermis damage. Many imaging technologies have been developed to improve the burn depth assessment. But these imaging tools have limitations in deep imaging or resolving ability. Photoacoustic imaging is a hybrid modality combining optical and ultrasound imaging that remains high resolution in deep imaging depth. In this work, we used dual-scale photoacoustic imaging to noninvasively diagnose burn injury and monitor the burn healing. Real-time PACT provided cross-sectional and volumetric images of the burn region. High-resolution PAM allowed for imaging of angiogenesis on the hyperemic ring. A long-term surveillance was also performed to assess the difference between the two damage degrees of burn injuries. Our proposed method suggests an effective tool to diagnose and monitor burn injury.

Quantitative analysis on in vivo tumor-microvascular images from optical-resolution photoacoustic microscopy

Optical-resolution photoacoustic microscopy (OR-PAM) has been shown to be an excellent imaging modality for monitoring and study of tumor microvasculature. However, previous studies focused mainly on the normal tissues and did not quantify the tumor microvasculature. In this study, we present an in vivo OR-PAM imaging of the melanomas and hepatoma implanted in the mouse ear. We quantify the vessel growth by extracting the skeletons of both dense and thin branches of the tumor microvasculature obtained by Hessian matrix enhancement followed by improved two-step multistencils fast marching method. Compared with the previous methods of using OR-PAM for normal tissues, our method was more effective in extracting the binary vascular network in the tumor images and in obtaining the complete and continuous microvascular skeleton maps. Our demonstration of using OR-PAM in improving microvasculature of tumors and quantification of tumor growth would push deep this technology for the early diagnosis and treatment of cancers.

On the Relationship between Dynamic Contrast-Enhanced Ultrasound Parameters and the Underlying Vascular Architecture Extracted from Acoustic Angiography

Dynamic contrast-enhanced ultrasound (DCE-US) has been proposed as a powerful tool for cancer diagnosis by estimation of perfusion and dispersion parameters reflecting angiogenic vascular changes. This work was aimed at identifying which vascular features are reflected by the estimated perfusion and dispersion parameters through comparison with acoustic angiography (AA). AA is a high-resolution technique that allows quantification of vascular morphology. Three-dimensional AA and 2-D DCE-US bolus acquisitions were used to monitor the growth of fibrosarcoma tumors in nine rats. AA-derived vascular properties were analyzed along with DCE-US perfusion and dispersion to investigate the differences between tumor and control and their evolution in time. AA-derived microvascular density and DCE-US perfusion exhibited good agreement, confirmed by their spatial distributions. No vascular feature was correlated with dispersion. Yet, dispersion provided better cancer classification than perfusion. We therefore hypothesize that dispersion characterizes vessels that are smaller than those visible with AA.

3D Active Vessel Tracking Using an Elliptical Prior

In this paper, we propose a novel vessel tracking method, called active vessel tracking (AVT). The proposed method retains the major advantages that most 2D segmentation methods have demonstrated for 3D tracking while overcoming the drawbacks of previous 3D vessel tracking methods. Under the assumption that the vessel is cylindrical, thereby making its cross-section elliptical, the AVT finds a plane perpendicular to the vessel axis while tracking the vessel along its length. Also, We propose a method for vessel branch detection to automatically track complete vascular networks from a single starting point, whereas the previously proposed solutions have usually been limited in handling vessel bifurcations precisely on 3D or have required considerable user interaction. Our results show that the method is robust and accurate in both synthetic and clinical cases. In an experiment on synthetic data sets, the proposed method achieved a tracking accuracy of 96.1±0.5, detecting 99.1% of the branches. In an experiment on abdominal CTA data sets, it achieved a tracking accuracy of 98.4±0.5 for six target vessels, detecting 98.3% of the branches. These results show that the proposed method can outperform previous methods for vessel tracking.

Segmentation of vessel structures from photoacoustic images with reliability assessment

Photoacoustic imaging enables the imaging of soft biological tissue with combined optical contrast and ultrasound resolution. One of the targets of interest is tissue vasculature. However, the photoacoustic images may not directly provide the information on, for example, vasculature structure. Therefore, the images are improved by reducing noise and artefacts, and processed for better visualisation of the target of interest. In this work, we present a new segmentation method of photoacoustic images that also straightforwardly produces assessments of its reliability. The segmentation depends on parameters which have a natural tendency to increase the reliability as the parameter values monotonically change. The reliability is assessed by counting classifications of image voxels with different parameter values. The resulting segmentation with reliability offers new ways and tools to analyse photoacoustic images and new possibilities for utilising them as anatomical priors in further computations. Our MATLAB implementation of the method is available as an open-source software package [P. Raumonen, Matlab, 2018].

A Low Cost Implantation Model in the Rat That Allows a Spatial Assessment of Angiogenesis

There is continual demand for animal models that allow a quantitative assessment of angiogenic properties of biomaterials, therapies, and pharmaceuticals. In its simplest form, this is done by subcutaneous material implantation and subsequent vessel counting which usually omits spatial data. We have refined an implantation model and paired it with a computational analytic routine which outputs not only vessel count but also vessel density, distribution, and vessel penetration depth, that relies on a centric vessel as a reference point. We have successfully validated our model by characterizing the angiogenic potential of a fibrin matrix in conjunction with recombinant human vascular endothelial growth factor (rhVEGF165). The inferior epigastric vascular pedicles of rats were sheathed with silicone tubes, which were subsequently filled with 0.2 ml of fibrin and different doses of rhVEGF165, centrically embedding the vessels. Over 4 weeks, tissue samples were harvested and subsequently immunohistologically stained and computationally analyzed. The model was able to detect variations over the angiogenic potentials of growth factor spiked fibrin matrices. Adding 20 ng of rhVEGF165 resulted in a significant increase in vasculature while 200 ng of rhVEGF165 did not improve vascular growth. Vascularized tissue volume increased during the first week and vascular density increased during the second week. Total vessel count increased significantly and exhibited a peak after 2 weeks which was followed by a resorption of vasculature by week 4. In summary, a simple implantation model to study in vivo vascularization with only a minimal workload attached was enhanced to include morphologic data of the emerging vascular tree.

Non-invasive multimodal optical coherence and photoacoustic tomography for human skin imaging

The cutaneous vasculature is involved in many diseases. Current clinical examination techniques, however, cannot resolve the human vasculature with all plexus in a non-invasive manner. By combining an optical coherence tomography system with angiography extension and an all optical photoacoustic tomography system, we can resolve in 3D the blood vessels in human skin for all plexus non-invasively. With a customized imaging unit that permits access to various parts of patients' bodies, we applied our multimodality imaging system to investigate several different types of skin conditions. Quantitative vascular analysis is given for each of the dermatological conditions to show the potential diagnostic value of our system in non-invasive examination of diseases and physiological processes. Improved performance of our system over its previous generation is also demonstrated with an updated characterization.

Oxygen Enhanced Optoacoustic Tomography (OE-OT) Reveals Vascular Dynamics in Murine Models of Prostate Cancer

Poor oxygenation of solid tumours has been linked with resistance to chemo- and radio-therapy and poor patient outcomes, hence non-invasive imaging of oxygen supply and demand in tumours could improve disease staging and therapeutic monitoring. Optoacoustic tomography (OT) is an emerging clinical imaging modality that provides static images of endogenous haemoglobin concentration and oxygenation. Here, we demonstrate oxygen enhanced (OE)-OT, exploiting an oxygen gas challenge to visualise the spatiotemporal heterogeneity of tumour vascular function. We show that tracking oxygenation dynamics using OE-OT reveals significant differences between two prostate cancer models in nude mice with markedly different vascular function (PC3 & LNCaP), which appear identical in static OT. LNCaP tumours showed a spatially heterogeneous response within and between tumours, with a substantial but slow response to the gas challenge, aligned with ex vivo analysis, which revealed a generally perfused and viable tumour with marked areas of haemorrhage. PC3 tumours had a lower fraction of responding pixels compared to LNCaP with a high disparity between rim and core response. While the PC3 core showed little or no dynamic response, the rim showed a rapid change, consistent with our ex vivo findings of hypoxic and necrotic core tissue surrounded by a rim of mature and perfused vasculature. OE-OT metrics are shown to be highly repeatable and correlate directly on a per-tumour basis to tumour vessel function assessed ex vivo. OE-OT provides a non-invasive approach to reveal the complex dynamics of tumour vessel perfusion, permeability and vasoactivity in real time. Our findings indicate that OE-OT holds potential for application in prostate cancer patients, to improve delineation of aggressive and indolent disease as well as in patient stratification for chemo- and radio-therapy.