Dictionary learning sparse-sampling reconstruction method for in-vivo 3D photoacoustic computed tomography

DOVE: Doodled vessel enhancement for photoacoustic angiography super resolution

Deep-learning-based super-resolution photoacoustic angiography (PAA) has emerged as a valuable tool for enhancing the resolution of blood vessel images and aiding in disease diagnosis. However, due to the scarcity of training samples, PAA super-resolution models do not generalize well, especially in the challenging in-vivo imaging of organs with deep tissue penetration. Furthermore, prolonged exposure to high laser intensity during the image acquisition process can lead to tissue damage and secondary infections. To address these challenges, we propose an approach doodled vessel enhancement (DOVE) that utilizes hand-drawn doodles to train a PAA super-resolution model. With a training dataset consisting of only 32 real PAA images, we construct a diffusion model that interprets hand-drawn doodles as low-resolution images. DOVE enables us to generate a large number of realistic PAA images, achieving a 49.375% fool rate, even among experts in photoacoustic imaging. Subsequently, we employ these generated images to train a self-similarity-based model for super-resolution. During cross-domain tests, our method, trained solely on generated images, achieves a structural similarity value of 0.8591, surpassing the scores of all other models trained with real high-resolution images. DOVE successfully overcomes the limitation of insufficient training samples and unlocks the clinic application potential of super-resolution-based biomedical imaging.

Convolutional sparse coding for compressed sensing photoacoustic CT reconstruction with partially known support

In photoacoustic tomography (PAT), imaging speed is an essential metric that is restricted by the pulse laser repetition rate and the number of channels on the data acquisition card (DAQ). Reconstructing the initial sound pressure distribution with fewer elements can significantly reduce hardware costs and back-end acquisition pressure. However, undersampling will result in artefacts in the photoacoustic image, degrading its quality. Dictionary learning (DL) has been utilised for various image reconstruction techniques, but they disregard the uniformity of pixels in overlapping blocks. Therefore, we propose a compressive sensing (CS) reconstruction algorithm for circular array PAT based on gradient domain convolutional sparse coding (CSCGR). A small number of non-zero signal positions in the sparsely encoded feature map are used as partially known support (PKS) in the reconstruction procedure. The CS-CSCGR-PKS-based reconstruction algorithm can use fewer ultrasound transducers for signal acquisition while maintaining image fidelity. We demonstrated the effectiveness of this algorithm in sparse imaging through imaging experiments on the mouse torso, brain, and human fingers. Reducing the number of array elements while ensuring imaging quality effectively reduces equipment hardware costs and improves imaging speed.

Deep Learning Enhanced Volumetric Photoacoustic Imaging of Vasculature in Human

The development of high-performance imaging processing algorithms is a core area of photoacoustic tomography. While various deep learning based image processing techniques have been developed in the area, their applications in 3D imaging are still limited due to challenges in computational cost and memory allocation. To address those limitations, this work implements a 3D fully-dense (3DFD) U-net to linear array based photoacoustic tomography and utilizes volumetric simulation and mixed precision training to increase efficiency and training size. Through numerical simulation, phantom imaging, and in vivo experiments, this work demonstrates that the trained network restores the true object size, reduces the noise level and artifacts, improves the contrast at deep regions, and reveals vessels subject to limited view distortion. With these enhancements, 3DFD U-net successfully produces clear 3D vascular images of the palm, arms, breasts, and feet of human subjects. These enhanced vascular images offer improved capabilities for biometric identification, foot ulcer evaluation, and breast cancer imaging. These results indicate that the new algorithm will have a significant impact on preclinical and clinical photoacoustic tomography.

Photoacoustic imaging with limited sampling: a review of machine learning approaches

Photoacoustic imaging combines high optical absorption contrast and deep acoustic penetration, and can reveal structural, molecular, and functional information about biological tissue non-invasively. Due to practical restrictions, photoacoustic imaging systems often face various challenges, such as complex system configuration, long imaging time, and/or less-than-ideal image quality, which collectively hinder their clinical application. Machine learning has been applied to improve photoacoustic imaging and mitigate the otherwise strict requirements in system setup and data acquisition. In contrast to the previous reviews of learned methods in photoacoustic computed tomography (PACT), this review focuses on the application of machine learning approaches to address the limited spatial sampling problems in photoacoustic imaging, specifically the limited view and undersampling issues. We summarize the relevant PACT works based on their training data, workflow, and model architecture. Notably, we also introduce the recent limited sampling works on the other major implementation of photoacoustic imaging, i.e., photoacoustic microscopy (PAM). With machine learning-based processing, photoacoustic imaging can achieve improved image quality with modest spatial sampling, presenting great potential for low-cost and user-friendly clinical applications.

Application of photoacoustic computed tomography in biomedical imaging: A literature review

Photoacoustic computed tomography (PACT) is a hybrid imaging modality that combines optical excitation and acoustic detection techniques. It obtains high-resolution deep-tissue images based on the deep penetration of light, the anisotropy of light absorption in objects, and the photoacoustic effect. Hence, PACT shows great potential in biomedical sample imaging. Recently, due to its advantages of high sensitivity to optical absorption and wide scalability of spatial resolution with the desired imaging depth, PACT has received increasing attention in preclinical and clinical practice. To date, there has been a proliferation of PACT systems designed for specific biomedical imaging applications, from small animals to human organs, from ex vivo to in vivo real-time imaging, and from simple structural imaging to functional and molecular imaging with external contrast agents. Therefore, it is of great importance to summarize the previous applications of PACT systems in biomedical imaging and clinical practice. In this review, we searched for studies related to PACT imaging of biomedical tissues and samples over the past two decades; divided the studies into two categories, PACT imaging of preclinical animals and PACT imaging of human organs and body parts; and discussed the significance of the studies. Finally, we pointed out the future directions of PACT in biomedical applications. With the development of exogenous contrast agents and advances of imaging technique, in the future, PACT will enable biomedical imaging from organs to whole bodies, from superficial vasculature to internal organs, from anatomy to functions, and will play an increasingly important role in biomedical research and clinical practice.

Image Quality Improvement Techniques and Assessment Adequacy in Clinical Optoacoustic Imaging: A Systematic Review

Optoacoustic imaging relies on the detection of optically induced acoustic waves to offer new possibilities in morphological and functional imaging. As the modality matures towards clinical application, research efforts aim to address multifactorial limitations that negatively impact the resulting image quality. In an endeavor to obtain a clear view on the limitations and their effects, as well as the status of this progressive refinement process, we conduct an extensive search for optoacoustic image quality improvement approaches that have been evaluated with humans in vivo, thus focusing on clinically relevant outcomes. We query six databases (PubMed, Scopus, Web of Science, IEEE Xplore, ACM Digital Library, and Google Scholar) for articles published from 1 January 2010 to 31 October 2021, and identify 45 relevant research works through a systematic screening process. We review the identified approaches, describing their primary objectives, targeted limitations, and key technical implementation details. Moreover, considering comprehensive and objective quality assessment as an essential prerequisite for the adoption of such approaches in clinical practice, we subject 36 of the 45 papers to a further in-depth analysis of the reported quality evaluation procedures, and elicit a set of criteria with the intent to capture key evaluation aspects. Through a comparative criteria-wise rating process, we seek research efforts that exhibit excellence in quality assessment of their proposed methods, and discuss features that distinguish them from works with similar objectives. Additionally, informed by the rating results, we highlight areas with improvement potential, and extract recommendations for designing quality assessment pipelines capable of providing rich evidence.

Image reconstruction for endoscopic photoacoustic tomography including effects of detector responses

In photoacoustic tomography (PAT), conventional image reconstruction methods are generally based on the assumption of an ideal point-like ultrasonic detector. This assumption is appropriate when the receiving surface of the detector is sufficiently small and/or the distance between the imaged object and the detector is large enough. However, it does not hold in endoscopic applications of PAT. In this study, we propose a model-based image reconstruction method for endoscopic photoacoustic tomography (EPAT), considering the effect of detector responses on image quality. We construct a forward model to physically describe the imaging process of EPAT, including the generation of the initial pressure due to optical absorption and thermoelastic expansion, the propagation of photoacoustic waves in tissues, and the acoustic measurement. The model outputs the theoretical sampling voltage signal, which is the response of the ultrasonic detector to the acoustic pressure reaching its receiving surface. The images representing the distribution map of the optical absorption energy density on cross-sections of the imaged luminal structures are reconstructed from the sampling voltage signals output by the detector through iterative inversion of the forward model. Compared with the conventional approaches based on back-projection and other imaging models, our method improved the quality and spatial resolution of the resulting images.

Recovery of Blood Flow From Undersampled Photoacoustic Microscopy Data Using Sparse Modeling

Photoacoustic microscopy (PAM) leverages the optical absorption contrast of blood hemoglobin for high-resolution, multi-parametric imaging of the microvasculature in vivo. However, to quantify the blood flow speed, dense spatial sampling is required to assess blood flow-induced loss of correlation of sequentially acquired A-line signals, resulting in increased laser pulse repetition rate and consequently optical fluence. To address this issue, we have developed a sparse modeling approach for blood flow quantification based on downsampled PAM data. Evaluation of its performance both in vitro and in vivo shows that this sparse modeling method can accurately recover the substantially downsampled data (up to 8 times) for correlation-based blood flow analysis, with a relative error of 12.7 ± 6.1 % across 10 datasets in vitro and 12.7 ± 12.1 % in vivo for data downsampled 8 times. Reconstruction with the proposed method is on par with recovery using compressive sensing, which exhibits an error of 12.0 ± 7.9 % in vitro and 33.86 ± 26.18 % in vivo for data downsampled 8 times. Both methods outperform bicubic interpolation, which shows an error of 15.95 ± 9.85 % in vitro and 110.7 ± 87.1 % in vivo for data downsampled 8 times.

Dictionary learning technique enhances signal in LED-based photoacoustic imaging

There has been growing interest in low-cost light sources such as light-emitting diodes (LEDs) as an excitation source in photoacoustic imaging. However, LED-based photoacoustic imaging is limited by low signal due to low energy per pulse-the signal is easily buried in noise leading to low quality images. Here, we describe a signal de-noising approach for LED-based photoacoustic signals based on dictionary learning with an alternating direction method of multipliers. This signal enhancement method is then followed by a simple reconstruction approach delay and sum. This approach leads to sparse representation of the main components of the signal. The main improvements of this approach are a 38% higher contrast ratio and a 43% higher axial resolution versus the averaging method but with only 4% of the frames and consequently 49.5% less computational time. This makes it an appropriate option for real-time LED-based photoacoustic imaging.

Image reconstruction based on compressed sensing for sparse-data endoscopic photoacoustic tomography

Endoscopic photoacoustic tomography (EPAT) is an interventional application of photoacoustic tomography (PAT) to visualize anatomical features and functional components of biological cavity structures such as nasal cavity, digestive tract or coronary arterial vessels. One of the main challenges in clinical applicability of EPAT is the incomplete acoustic measurements due to the limited detectors or the limited-view acoustic detection enclosed in the cavity. In this case, conventional image reconstruction methodologies suffer from significantly degraded image quality. This work introduces a compressed-sensing (CS)-based method to reconstruct a high-quality image that represents the initial pressure distribution on a luminal cross-section from incomplete discrete acoustic measurements. The method constructs and trains a complete dictionary for the sparse representation of the photoacoustically-induced acoustic measurements. The sparse representation of the complete acoustic signals is then optimally obtained based on the sparse measurements and a sensing matrix. The complete acoustic signals are recovered from the sparse representation by inverse sparse transformation. The image of the initial pressure distribution is finally reconstructed from the recovered complete signals by using the time reversal (TR) algorithm. It was shown with numerical experiments that high-quality images with reduced under-sampling artifacts can be reconstructed from sparse measurements. The comparison results suggest that the proposed method outperforms the standard TR reconstruction by 40% in terms of the structural similarity of the reconstructed images.