A survey of computational frameworks for solving the acoustic inverse problem in three-dimensional photoacoustic computed tomography

Single-stage approach for estimating optical parameters in spectral quantitative photoacoustic tomography

In quantitative photoacoustic tomography, the optical parameters of a target, most importantly the concentrations of chromophores such as deoxygenated and oxygenated hemoglobin, are estimated from photoacoustic data measured on the boundary of the target. In this work, a numerical approximation of a forward model for spectral quantitative photoacoustic tomography is constructed by utilizing the diffusion approximation for light propagation, the acoustic wave equation for ultrasound propagation, and spectral models of optical absorption and scattering to describe the wavelength dependence of the optical parameters. The related inverse problem is approached in the framework of Bayesian inverse problems. Concentrations of four chromophores (deoxygenated and oxygenated hemoglobin, water, and lipid), two scattering parameters (reference scattering and scattering power), and the Grüneisen parameter are estimated in a single-stage from photoacoustic data. The methodology is evaluated using numerical simulations in different full-view and limited-view imaging settings. The results show that, utilizing spectral data and models, the spectral optical parameters and the Grüneisen parameter can be simultaneously estimated. Furthermore, the approach can also be utilized in limited-view imaging situations.

Shedding light on ultrasound in action: Optical and optoacoustic monitoring of ultrasound brain interventions

Monitoring brain responses to ultrasonic interventions is becoming an important pillar of a growing number of applications employing acoustic waves to actuate and cure the brain. Optical interrogation of living tissues provides a unique means for retrieving functional and molecular information related to brain activity and disease-specific biomarkers. The hybrid optoacoustic imaging methods have further enabled deep-tissue imaging with optical contrast at high spatial and temporal resolution. The marriage between light and sound thus brings together the highly complementary advantages of both modalities toward high precision interrogation, stimulation, and therapy of the brain with strong impact in the fields of ultrasound neuromodulation, gene and drug delivery, or noninvasive treatments of neurological and neurodegenerative disorders. In this review, we elaborate on current advances in optical and optoacoustic monitoring of ultrasound interventions. We describe the main principles and mechanisms underlying each method before diving into the corresponding biomedical applications. We identify areas of improvement as well as promising approaches with clinical translation potential.

S-Wave Accelerates Optimization-based Photoacoustic Image Reconstruction in vivo

OBJECTIVE

Photoacoustic imaging has undergone rapid development in recent years. To simulate photoacoustic imaging on a computer, the most popular MATLAB toolbox currently used for the forward projection process is k-Wave. However, k-Wave suffers from significant computation time. Here we propose a straightforward simulation approach based on superposed Wave (s-Wave) to accelerate photoacoustic simulation.

METHODS

In this study, we consider the initial pressure distribution as a collection of individual pixels. By obtaining standard sensor data from a single pixel beforehand, we can easily manipulate the phase and amplitude of the sensor data for specific pixels using loop and multiplication operators. The effectiveness of this approach is validated through an optimization-based reconstruction algorithm.

RESULTS

The results reveal significantly reduced computation time compared with k-Wave. Particularly in a sparse 3-D configuration, s-Wave exhibits a speed improvement >2000 times compared with k-Wave. In terms of optimization-based image reconstruction, in vivo imaging results reveal that using the s-Wave method yields images highly similar to those obtained using k-Wave, while reducing the reconstruction time by approximately 50 times.

CONCLUSION

Proposed here is an accelerated optimization-based algorithm for photoacoustic image reconstruction, using the fast s-Wave forward projection simulation. Our method achieves substantial time savings, particularly in sparse system configurations. Future work will focus on further optimizing the algorithm and expanding its applicability to a broader range of photoacoustic imaging scenarios.

In vivo noninvasive systemic myography of acute systemic vasoactivity in female pregnant mice

Altered vasoactivity is a major characteristic of cardiovascular and oncological diseases, and many therapies are therefore targeted to the vasculature. Therapeutics which are selective for the diseased vasculature are ideal, but whole-body selectivity of a therapeutic is challenging to assess in practice. Vessel myography is used to determine the functional mechanisms and evaluate pharmacological responses of vascularly-targeted therapeutics. However, myography can only be performed on ex vivo sections of individual arteries. We have developed methods for implementation of spherical-view photoacoustic tomography for non-invasive and in vivo myography. Using photoacoustic tomography, we demonstrate the measurement of acute vascular reactivity in the systemic vasculature and the placenta of female pregnant mice in response to two vasodilators. Photoacoustic tomography simultaneously captures the significant acute vasodilation of major arteries and detects selective vasoactivity of the maternal-fetal vasculature. Photoacoustic tomography has the potential to provide invaluable preclinical information on vascular response that cannot be obtained by other established methods.

Photoacoustic Imaging and Characterization of Bone in Medicine: Overview, Applications, and Outlook

Photoacoustic techniques have shown promise in identifying molecular changes in bone tissue and visualizing tissue microstructure. This capability represents significant advantages over gold standards (i.e., dual-energy X-ray absorptiometry) for bone evaluation without requiring ionizing radiation. Instead, photoacoustic imaging uses light to penetrate through bone, followed by acoustic pressure generation, resulting in highly sensitive optical absorption contrast in deep biological tissues. This review covers multiple bone-related photoacoustic imaging contributions to clinical applications, spanning bone cancer, joint pathologies, spinal disorders, osteoporosis, bone-related surgical guidance, consolidation monitoring, and transsphenoidal and transcranial imaging. We also present a summary of photoacoustic-based techniques for characterizing biomechanical properties of bone, including temperature, guided waves, spectral parameters, and spectroscopy. We conclude with a future outlook based on the current state of technological developments, recent achievements, and possible new directions.

The influences of finite aperture size in photoacoustic computed tomography

In photoacoustic computed tomography (PACT), the "finite aperture effect" is often characterized as a tangential resolution that increases proportionally with the distance from the rotation center. However, this conclusion is based on the inaccurate point-detector assumption used in image reconstruction. In this study, we appropriately modeled the finite size of the acoustic detector in the back-projection (BP) based image reconstruction to improve the accuracy of the time delay calculation and systematically investigated its effects. Our results showed that the main effect of the finite aperture size is the creation of a limited high-quality imaging region (HQIR) around the scanning center, due to the directional sensitivity of the detector. We also demonstrated that the "finite aperture effect" can reduce the optimal number of detectors required for spatial anti-aliasing. These new findings provide novel perspectives for optimizing PACT systems and corresponding reconstruction methods.

Model-Based 3-D X-Ray Induced Acoustic Computerized Tomography

X-ray-induced acoustic (XA) computerized tomography (XACT) is an evolving imaging technique that aims to reconstruct the X-ray energy deposition from XA measurements. Main challenges in XACT are the poor signal-to-noise ratio and limited field-of-view, which cause artifacts in the images. We demonstrate the efficacy of model-based (MB) algorithms for three-dimensional XACT and compare with the traditional algorithms. The MB algorithm is based on iterative, matrix-free approach for regularized-least-squares minimization corresponding to XACT. The matrix-free-LSQR (MF-LSQR) and the non-iterative model-backprojection (MBP) reconstructions were evaluated and compared with universal backprojection (UBP), time-reversal (TR) and fast-Fourier transform (FFT)-based reconstructions for numerical and experimental XACT datasets. The results demonstrate the capability of MF-LSQR algorithm to reduce noisy artifacts thus yielding better reconstructions. MBP and MF-LSQR algorithms perform particularly well with the experimental XACT dataset, where noise in signals significantly affects the reconstruction of the target in UBP and FFT-based reconstructions. The TR reconstruction for experimental XACT are comparable to MF-LSQR, but takes thrice as much time and filters the frequency components greater than maximum frequency supported by the grid, resulting loss of resolution. The MB algorithms are able to overcome the challenges in XACT and hence are vital for the clinical translation of XACT.

Quantitative photoacoustic tomography with light fluence compensation based on radiance Monte Carlo model

Objective. Photoacoustic tomography (PAT) is a rapidly evolving imaging modality that provides images with high contrast and spatial resolution showing the optical properties of biological tissues. The photoacoustic pressure is proportional to the product of the optical absorption coefficient and the local light fluence. The essential challenge in reconstructing quantitative images representing spatially varying absorption coefficients is the unknown light fluence. In addition, optical attenuation induces spatial variations in the light fluence, and the heterogeneity of the fluence determines the limits of reconstruction quality and depth.Approach.In this work, a reconstruction enhancement scheme is proposed to compensate for the variation in the light fluence in the absorption coefficient recovery. The inverse problem of the radiance Monte Carlo model describing light transport through the tissue is solved by using an alternating optimization strategy. In the iteration, the absorption coefficients and photon weights are alternately updated.Main results.The method provides highly accurate quantitative images of absorption coefficients in simulations, phantoms, andin vivostudies. The results show that the method has great potential for improving the accuracy of absorption coefficient recovery compared to conventional reconstruction methods that ignore light fluence variations. Comparison with state-of-the-art fluence compensation methods shows significant improvements in root mean square error, normalized mean square absolute distance, and structural similarity metrics.Significance.This method achieves high precision quantitative imaging by compensating for nonuniform light fluence without increasing the complexity and operation of the imaging system.

Sound out the impaired perfusion: Photoacoustic imaging in preclinical ischemic stroke

Acoustically detecting the optical absorption contrast, photoacoustic imaging (PAI) is a highly versatile imaging modality that can provide anatomical, functional, molecular, and metabolic information of biological tissues. PAI is highly scalable and can probe the same biological process at various length scales ranging from single cells (microscopic) to the whole organ (macroscopic). Using hemoglobin as the endogenous contrast, PAI is capable of label-free imaging of blood vessels in the brain and mapping hemodynamic functions such as blood oxygenation and blood flow. These imaging merits make PAI a great tool for studying ischemic stroke, particularly for probing into hemodynamic changes and impaired cerebral blood perfusion as a consequence of stroke. In this narrative review, we aim to summarize the scientific progresses in the past decade by using PAI to monitor cerebral blood vessel impairment and restoration after ischemic stroke, mostly in the preclinical setting. We also outline and discuss the major technological barriers and challenges that need to be overcome so that PAI can play a more significant role in preclinical stroke research, and more importantly, accelerate its translation to be a useful clinical diagnosis and management tool for human strokes.

Clinical photoacoustic/ultrasound dual-modal imaging: Current status and future trends

Photoacoustic tomography (PAT) is an emerging biomedical imaging modality that combines optical and ultrasonic imaging, providing overlapping fields of view. This hybrid approach allows for a natural integration of PAT and ultrasound (US) imaging in a single platform. Due to the similarities in signal acquisition and processing, the combination of PAT and US imaging creates a new hybrid imaging for novel clinical applications. Over the recent years, particular attention is paid to the development of PAT/US dual-modal systems highlighting mutual benefits in clinical cases, with an aim of substantially improving the specificity and sensitivity for diagnosis of diseases. The demonstrated feasibility and accuracy in these efforts open an avenue of translating PAT/US imaging to practical clinical applications. In this review, the current PAT/US dual-modal imaging systems are discussed in detail, and their promising clinical applications are presented and compared systematically. Finally, this review describes the potential impacts of these combined systems in the coming future.

Co-optimization method to improve lateral resolution in photoacoustic computed tomography

In biomedical imaging, photoacoustic computed tomography (PACT) has recently gained increased interest as this imaging technique has good optical contrast and depth of acoustic penetration. However, a spinning blur will be introduced during the image reconstruction process due to the limited size of the ultrasonic transducers (UT) and a discontinuous measurement process. In this study, a damping UT and adaptive back-projection co-optimization (CODA) method is developed to improve the lateral spatial resolution of PACT. In our PACT system, a damping aperture UT controls the size of the receiving area, which suppresses image blur at the signal acquisition stage. Then, an innovative adaptive back-projection algorithm is developed, which corrects the undesirable artifacts. The proposed method was evaluated using agar phantom and ex-vivo experiments. The results show that the CODA method can effectively compensate for the spinning blur and eliminate unwanted artifacts in PACT. The proposed method can significantly improve the lateral spatial resolution and image quality of reconstructed images, making it more appealing for wider clinical applications of PACT as a novel, cost-effective modality.

High frame rate (∼3 Hz) circular photoacoustic tomography using single-element ultrasound transducer aided with deep learning

SIGNIFICANCE

In circular scanning photoacoustic tomography (PAT), it takes several minutes to generate an image of acceptable quality, especially with a single-element ultrasound transducer (UST). The imaging speed can be enhanced by faster scanning (with high repetition rate light sources) and using multiple-USTs. However, artifacts arising from the sparse signal acquisition and low signal-to-noise ratio at higher scanning speeds limit the imaging speed. Thus, there is a need to improve the imaging speed of the PAT systems without hampering the quality of the PAT image.

AIM

To improve the frame rate (or imaging speed) of the PAT system by using deep learning (DL).

APPROACH

For improving the frame rate (or imaging speed) of the PAT system, we propose a novel U-Net-based DL framework to reconstruct PAT images from fast scanning data.

RESULTS

The efficiency of the network was evaluated on both single- and multiple-UST-based PAT systems. Both phantom and in vivo imaging demonstrate that the network can improve the imaging frame rate by approximately sixfold in single-UST-based PAT systems and by approximately twofold in multi-UST-based PAT systems.

CONCLUSIONS

We proposed an innovative method to improve the frame rate (or imaging speed) by using DL and with this method, the fastest frame rate of ∼ 3    Hz imaging is achieved without hampering the quality of the reconstructed image.

Enhancing Finite Element-Based Photoacoustic Tomography by Localized Reconstruction Method

Iterative reconstruction algorithm based on finite element (FE) modeling is a powerful approach in photoacoustic tomography (PAT). However, an iterative inverse algorithm using conventional FE meshing of the entire imaging zone is computationally demanding, which hinders this powerful tool in applications where quick image acquisition and/or a large image matrix is needed. To address this challenge, parallel computing techniques are proposed and implemented in the field. Here, we present an alternative approach for 2D PAT, which locoregionally reconstructs the region of interest (ROI) instead of the full imaging zone. Our simulated and phantom experimental results demonstrate that this ROI reconstruction algorithm can produce almost the same image quality as the conventional full zone-based reconstruction algorithm; however, the computation time can be significantly reduced without any additional hardware cost by more than two orders of magnitude (100-fold). This algorithm is further applied and validated in an in vivo study. The major vessel structures in a rat’s brain can be imaged clearly using our ROI-based approach, coupled with a mesh of 11,801 nodes. This novel algorithm can also be parallelized using MPI or GPU acceleration techniques to further enhance the reconstruction performance of FE-based PAT.

On the Retrieval of Forward-Scattered Waveforms From Acoustic Reflection and Transmission Data With the Marchenko Equation

A Green's function in an acoustic medium can be retrieved from reflection data by solving a multidimensional Marchenko equation. This procedure requires a priori knowledge of the initial focusing function, which can be interpreted as the inverse of a transmitted wavefield as it would propagate through the medium, excluding (multiply) reflected waveforms. In practice, the initial focusing function is often replaced by a time-reversed direct wave, which is computed with help of a macro velocity model. Green's functions that are retrieved under this (direct-wave) approximation typically lack forward-scattered waveforms and their associated multiple reflections. We examine whether this problem can be mitigated by incorporating transmission data. Based on these transmission data, we derive an auxiliary equation for the forward-scattered components of the initial focusing function. We demonstrate that this equation can be solved in an acoustic medium with mass density contrast and constant propagation velocity. By solving the auxiliary and Marchenko equation successively, we can include forward-scattered waveforms in our Green's function estimates, as we demonstrate with a numerical example.

A New Framework of Designing Iterative Techniques for Image Deblurring

In this work we present a framework of designing iterative techniques for image deblurring in inverse problem. The new framework is based on two observations about existing methods. We used Landweber method as the basis to develop and present the new framework but note that the framework is applicable to other iterative techniques. First, we observed that the iterative steps of Landweber method consist of a constant term, which is a low-pass filtered version of the already blurry observation. We proposed a modification to use the observed image directly. Second, we observed that Landweber method uses an estimate of the true image as the starting point. This estimate, however, does not get updated over iterations. We proposed a modification that updates this estimate as the iterative process progresses. We integrated the two modifications into one framework of iteratively deblurring images. Finally, we tested the new method and compared its performance with several existing techniques, including Landweber method, Van Cittert method, GMRES (generalized minimal residual method), and LSQR (least square), to demonstrate its superior performance in image deblurring.

Image reconstruction for endoscopic photoacoustic tomography including effects of detector responses

In photoacoustic tomography (PAT), conventional image reconstruction methods are generally based on the assumption of an ideal point-like ultrasonic detector. This assumption is appropriate when the receiving surface of the detector is sufficiently small and/or the distance between the imaged object and the detector is large enough. However, it does not hold in endoscopic applications of PAT. In this study, we propose a model-based image reconstruction method for endoscopic photoacoustic tomography (EPAT), considering the effect of detector responses on image quality. We construct a forward model to physically describe the imaging process of EPAT, including the generation of the initial pressure due to optical absorption and thermoelastic expansion, the propagation of photoacoustic waves in tissues, and the acoustic measurement. The model outputs the theoretical sampling voltage signal, which is the response of the ultrasonic detector to the acoustic pressure reaching its receiving surface. The images representing the distribution map of the optical absorption energy density on cross-sections of the imaged luminal structures are reconstructed from the sampling voltage signals output by the detector through iterative inversion of the forward model. Compared with the conventional approaches based on back-projection and other imaging models, our method improved the quality and spatial resolution of the resulting images.

Normalization of optical fluence distribution for three-dimensional functional optoacoustic tomography of the breast

SIGNIFICANCE

In three-dimensional (3D) functional optoacoustic tomography (OAT), wavelength-dependent optical attenuation and nonuniform incident optical fluence limit imaging depth and field of view and can hinder accurate estimation of functional quantities, such as the vascular blood oxygenation. These limitations hinder OAT of large objects, such as a human female breast.

AIM

We aim to develop a measurement-data-driven method for normalization of the optical fluence distribution and to investigate blood vasculature detectability and accuracy for estimating vascular blood oxygenation.

APPROACH

The proposed method is based on reasonable assumptions regarding breast anatomy and optical properties. The nonuniform incident optical fluence is estimated based on the illumination geometry in the OAT system, and the depth-dependent optical attenuation is approximated using Beer-Lambert law.

RESULTS

Numerical studies demonstrated that the proposed method significantly enhanced blood vessel detectability and improved estimation accuracy of the vascular blood oxygenation from multiwavelength OAT measurements, compared with direct application of spectral linear unmixing without optical fluence compensation. Experimental results showed that the proposed method revealed previously invisible structures in regions deeper than 15 mm and/or near the chest wall.

CONCLUSIONS

The proposed method provides a straightforward and computationally inexpensive approximation of wavelength-dependent effective optical attenuation and, thus, enables mitigation of the spectral coloring effect in functional 3D OAT imaging.

Analysis for Full-Field Photoacoustic Tomography with Variable Sound Speed

Photoacoustic tomography (PAT) is a non-invasive imaging modality that requires recovering the initial data of the wave equation from certain measurements of the solution outside the object. In the standard PAT measurement setup, the used data consist of time-dependent signals measured on an observation surface. In contrast, the measured data from the recently invented full-field detection technique provide the solution of the wave equation on a spatial domain at a single instant in time. While reconstruction using classical PAT data has been extensively studied, not much is known for the full field PAT problem. In this paper, we build mathematical foundations of the latter problem for variable sound speed and settle its uniqueness and stability. Moreover, we introduce an exact inversion method using time-reversal and study its convergence. Our results demonstrate the suitability of both the full field approach and the proposed time-reversal technique for high resolution photoacoustic imaging.

Suite of 3D test objects for performance assessment of hybrid photoacoustic-ultrasound breast imaging systems

SIGNIFICANCE

During the development and early testing phases of new photoacoustic (PA) breast imaging systems, several choices need to be made in aspects of system design and measurement sequences. Decision-making can be complex for state-of-the-art systems such as 3D hybrid photoacoustic-ultrasound (PA-US) breast imagers intended for multispectral quantitative imaging. These systems have a large set of design choices and system settings that affect imaging performance in different ways and often require trade-offs. Decisions have to be made carefully as they can strongly influence the imaging performance.

AIM

A systematic approach to assess the influence of various choices on the imaging performance in carefully controlled laboratory situations is crucial before starting with human studies. Test objects and phantoms are used for first imaging studies, but most reported structures have a 2D geometry and are not suitable to assess all the image quality characteristics (IQCs) of 3D hybrid PA-US systems.

APPROACH

Our work introduces a suite of five test objects designed for hybrid PA-US systems with a 3D detection aperture. We present the test object designs and production protocols and explain how they can be used to study various performance measures. To demonstrate the utility of the developed objects, measurements are made with an existing tomographic PA system.

RESULTS

Two test objects were developed for measurements of the US detectors' impulse responses and light distribution on the breast surface. Three others were developed to assess image quality and quantitative accuracy of the PA and US modes. Three of the five objects were imaged to demonstrate their use.

CONCLUSIONS

The developed test objects allow one to study influences of various choices in design and system settings. With this, IQCs can be assessed as a function of measurement sequence settings for the PA and US modes in a controlled way. Systematic studies and measurements using these objects will help to optimize various system settings and measurement protocols in laboratory situations before embarking on human studies.

Suppression of motion artifacts in intravascular photoacoustic image sequences

Intravascular photoacoustic (IVPA) imaging is an image-based imaging modality for the assessment of atherosclerotic plaques. Successful application of IVPA for in vivo coronary arterial imaging requires one overcomes the challenge of motion artifacts associated with the cardiac cycle. We propose a method for correcting artifacts owing to cardiac motion, which are observed in sequential IVPA images acquired by the continuous pullback of the imaging catheter. This method groups raw photoacoustic signals into subsets corresponding to similar phases in the cardiac cycles. Thereafter, the sequential images are reconstructed, by representing the initial pressure distribution on the vascular cross-sections based on the clustered frames of signals by time reversal. Results of simulation data demonstrate the efficacy of this method in suppressing motion artifacts. Qualitative and quantitative evaluations of the method indicate an enhancement of the image quality. Comparison results reveal that this method is computationally efficient in motion correction compared with the image-based gating.

Denoising of pre-beamformed photoacoustic data using generative adversarial networks

We have trained generative adversarial networks (GANs) to mimic both the effect of temporal averaging and of singular value decomposition (SVD) denoising. This effectively removes noise and acquisition artifacts and improves signal-to-noise ratio (SNR) in both the radio-frequency (RF) data and in the corresponding photoacoustic reconstructions. The method allows a single frame acquisition instead of averaging multiple frames, reducing scan time and total laser dose significantly. We have tested this method on experimental data, and quantified the improvement over using either SVD denoising or frame averaging individually for both the RF data and the reconstructed images. We achieve a mean squared error (MSE) of 0.05%, structural similarity index measure (SSIM) of 0.78, and a feature similarity index measure (FSIM) of 0.85 compared to our ground-truth RF results. In the subsequent reconstructions using the denoised data we achieve a MSE of 0.05%, SSIM of 0.80, and a FSIM of 0.80 compared to our ground-truth reconstructions.

Fast Correction of “Finite Aperture Effect” in Photoacoustic Tomography Based on Spatial Impulse Response

Photoacoustic computed tomography (PACT) is a fast-developing imaging technique, which can provide structural and functional information in biological tissues with high-resolution beyond the depth of the optical diffusion limit. However, the most current PACT reconstruction method generally employs a point detector assumption, whereas in most PAT systems with circular or spherical scanning modes, the transducer is mostly flat and with a finite size. This model mismatch leads to a notable deterioration in the lateral direction in regions far from the rotation center, which is known as the “finite aperture effect”. In this work, we propose to compensate a novel Back-projection (BP) method based on the transducer’s spatial impulse response (SIR) for fast correction of the “finite aperture effect”. The SIR accounts for the waveform change of the transducer for an arbitrary point source due to the geometry of the detection surface. Simulation results showed that the proposed SIR-BP method can effectively improve the lateral resolution and signal to noise ratio (SNR) in the off-center regions. For a target 4.5 mm far from the rotation center, this new method improved the lateral resolution about five times along with a 7 dB increase in the SNR. Experimental results also showed that this SIR-BP method can well restore the image angular blur to recover small structures, as demonstrated by the imaging of leaf veins. This new method offers a valuable alternative to the conventional BP method, and can guide the design of PAT systems based on circular/spherical scan.

Photoacoustic computed tomography for functional human brain imaging [Invited]

The successes of magnetic resonance imaging and modern optical imaging of human brain function have stimulated the development of complementary modalities that offer molecular specificity, fine spatiotemporal resolution, and sufficient penetration simultaneously. By virtue of its rich optical contrast, acoustic resolution, and imaging depth far beyond the optical transport mean free path (∼1 mm in biological tissues), photoacoustic computed tomography (PACT) offers a promising complementary modality. In this article, PACT for functional human brain imaging is reviewed in its hardware, reconstruction algorithms, in vivo demonstration, and potential roadmap.

Computationally Efficient Forward Operator for Photoacoustic Tomography Based on Coordinate Transformations

Photoacoustic tomography (PAT) is an imaging modality that utilizes the photoacoustic effect. In PAT, a photoacoustic image is computed from measured data by modeling ultrasound propagation in the imaged domain and solving an inverse problem utilizing a discrete forward operator. However, in realistic measurement geometries with several ultrasound transducers and relatively large imaging volume, an explicit formation and use of the forward operator can be computationally prohibitively expensive. In this work, we propose a transformation-based approach for efficient modeling of photoacoustic signals and reconstruction of photoacoustic images. In the approach, the forward operator is constructed for a reference ultrasound transducer and expanded into a general measurement geometry using transformations that map the formulated forward operator in local coordinates to the global coordinates of the measurement geometry. The inverse problem is solved using a Bayesian framework. The approach is evaluated with numerical simulations and experimental data. The results show that the proposed approach produces accurate 3-D photoacoustic images with a significantly reduced computational cost both in memory requirements and time. In the studied cases, depending on the computational factors, such as discretization, over the 30-fold reduction in memory consumption was achieved without a reduction in image quality compared to a conventional approach.

Approximate back-projection method for improving lateral resolution in circular-scanning-based photoacoustic tomography

PURPOSE

In circular-scanning-based photoacoustic tomography (PAT), the effect of finite transducer aperture has not been effectively resolved. The goal of this paper is to propose a practical reconstruction method that accounts for the finite transducer aperture to improve the lateral resolution.

METHODS

We for the first time propose to calculate the spatial-temporal response (STR) of the employed finite-sized transducer in a forward model, and then compensate the time delay and the directional sensitivity of the transducer in the framework of the back-projection method. Both simulation and phantom experiments were carried out to evaluate the lateral resolution improvement with the proposed method. The performance of this new method for imaging complicated targets was also assessed by calculating the mean image gradient.

RESULTS

Simulation results showed that with this new method the lateral resolution for off-center targets can be as good as that for the center targets. Phantom experimental results showed that this new method can improve the lateral resolution more than two times for a point target about 5 mm far from the rotation center. Phantom experimental results also showed that many blurred fine structures of a piece of leaf veins at the off-center regions were well restored with the new method, and the mean image gradient improved about 1.3 times.

CONCLUSION

The proposed new method can effectively account for the effect of finite transducer aperture for circular-scanning-based PAT in homogenous acoustic media. This new method also features its robustness and computational efficiency, so that it is a worthy replacement to the conventional back-projection algorithm in circular-scanning-based PAT. This new method can be of great importance to the design of circular-scanning or spherical-scanning-based PAT systems.

Axial accuracy and signal enhancement in acoustic-resolution photoacoustic microscopy by laser jitter effect correction and pulse energy compensation

In recent years, photoacoustic imaging has found vast applications in biomedical imaging. Photoacoustic imaging has high optical contrast and high ultrasound resolution allowing deep tissue non-invasive imaging beyond the optical diffusion limit. Q-switched lasers are extensively used in photoacoustic imaging due to the availability of high energy and short laser pulses, which are essential for high-resolution photoacoustic imaging. In most cases, this type of light source suffers from pulse peak-power energy variations and timing jitter noise, resulting in uncertainty in the output power and arrival time of the laser pulses. These problems cause intensity degradation and temporal displacement of generated photoacoustic signals which in turn deteriorate the quality of the acquired photoacoustic images. In this study, we used a high-speed data acquisition system in combination with a fast photodetector and a software-based approach to capture laser pulses precisely in order to reduce the effect of timing jitter and normalization of the photoacoustic signals based on pulse peak-powers simultaneously. In the experiments, maximum axial accuracy enhancement of 14 µm was achieved in maximum-amplitude projected images on XZ and YZ planes with ±13.5 ns laser timing jitter. Furthermore, photoacoustic signal enhancement of 77% was obtained for 75% laser pulses peak-power stability.

Dimensionality reduced plug and play priors for improving photoacoustic tomographic imaging with limited noisy data

The reconstruction methods for solving the ill-posed inverse problem of photoacoustic tomography with limited noisy data are iterative in nature to provide accurate solutions. These methods performance is highly affected by the noise level in the photoacoustic data. A singular value decomposition (SVD) based plug and play priors method for solving photoacoustic inverse problem was proposed in this work to provide robustness to noise in the data. The method was shown to be superior as compared to total variation regularization, basis pursuit deconvolution and Lanczos Tikhonov based regularization and provided improved performance in case of noisy data. The numerical and experimental cases show that the improvement can be as high as 8.1 dB in signal to noise ratio of the reconstructed image and 67.98% in root mean square error in comparison to the state of the art methods.

Spatial resolution in photoacoustic computed tomography

Photoacoustic computed tomography (PACT) is a novel biomedical imaging modality and has experienced fast developments in the past two decades. Spatial resolution is an important criterion to measure the imaging performance of a PACT system. Here we survey state-of-the-art literature on the spatial resolution of PACT and analyze resolution degradation models from signal generation, propagation, reception, to image reconstruction. Particularly, the impacts of laser pulse duration, acoustic attenuation, acoustic heterogeneity, detector bandwidth, detector aperture, detector view angle, signal sampling, and image reconstruction algorithms are reviewed and discussed. Analytical expressions of point spread functions related to these impacting factors are summarized based on rigorous mathematical formulas. State-of-the-art approaches devoted to enhancing spatial resolution are also reviewed. This work is expected to elucidate the concept of spatial resolution in PACT and inspire novel image quality enhancement techniques.

Deep learning approach to improve tangential resolution in photoacoustic tomography

In circular scan photoacoustic tomography (PAT), the axial resolution is spatially invariant and is limited by the bandwidth of the detector. However, the tangential resolution is spatially variant and is dependent on the aperture size of the detector. In particular, the tangential resolution improves with the decreasing aperture size. However, using a detector with a smaller aperture reduces the sensitivity of the transducer. Thus, large aperture size detectors are widely preferred in circular scan PAT imaging systems. Although several techniques have been proposed to improve the tangential resolution, they have inherent limitations such as high cost and the need for customized detectors. Herein, we propose a novel deep learning architecture to counter the spatially variant tangential resolution in circular scanning PAT imaging systems. We used a fully dense U-Net based convolutional neural network architecture along with 9 residual blocks to improve the tangential resolution of the PAT images. The network was trained on the simulated datasets and its performance was verified by experimental in vivo imaging. Results show that the proposed deep learning network improves the tangential resolution by eight folds, without compromising the structural similarity and quality of image.

Spherical-view photoacoustic tomography for monitoring in vivo placental function

Photoacoustic tomography has great potential to image dynamic functional changes in vivo. Many tomographic systems are built with a circular view geometry, necessitating a linear translation along one axis of the subject to obtain a three-dimensional volume. In this work, we evaluated a prototype spherical view photoacoustic tomographic system which acquires a 3D volume in a single scan, without linear translation. We simultaneously measured relative hemoglobin oxygen saturation in multiple placentas of pregnant mice under oxygen challenge. We also synthesized a folate-conjugated indocyanine green (ICG) contrast agent to image folate kinetics in the placenta. Photoacoustic tomography performed at the wavelength of peak optical absorption of our contrast agent revealed increased ICG signal over time. Through these phantom and in vivo studies, we have demonstrated that the spherical view 3D photoacoustic tomographic system achieves high sensitivity and fast image acquisition, enabling in vivo experiments to assess physiological and molecular dynamics.

Integrating photoacoustic tomography into a multimodal automated breast ultrasound scanner

SIGNIFICANCE

Photoacoustic tomography (PAT) is a promising emergent modality for the screening and staging of breast cancer. To minimize barriers to clinical translation, it is common to develop PAT systems based upon existing ultrasound hardware, which can entail significant design challenges in terms of light delivery. This often results in inherently non-uniform fluence within the tissue and should be accounted for during image reconstruction.

AIM

We aim to integrate PAT into an automated breast ultrasound scanner with minimal change to the existing system.

APPROACH

We designed and implemented an illuminator that directs spatially non-uniform light to the tissue near the acquisition plane of the imaging array. We developed a graphics processing unit-accelerated reconstruction method, which accounts for this illumination geometry by modeling the structure of the light in the sample. We quantified the performance of this system using a custom, modular photoacoustic phantom and graphite rods embedded in chicken breast tissue.

RESULTS

Our illuminator provides a fluence of 2.5  mJ cm  -  2 at the tissue surface, which was sufficient to attain a signal-to-noise ratio (SNR) of 8 dB at 2 cm in chicken breast tissue and image 0.25-mm features at depths of up to 3 cm in a medium with moderate optical scattering. Our reconstruction scheme is 200  ×   faster than a CPU implementation; it provides a 25% increase in SNR at 2 cm in chicken breast tissue and lowers image error by an average of 31% at imaging depths >1.5  cm compared with a method that does not account for the inhomogeneity of the illumination or the transducer directivity.

CONCLUSIONS

A fan-shaped illumination geometry is feasible for PAT; however, it is important to account for non-uniform fluence in illumination scenarios such as this. Future work will focus on increasing fluence and further optimizing the ultrasound hardware to improve SNR and overall image quality.

Model-Based Reconstruction of Large Three-Dimensional Optoacoustic Datasets

Iterative model-based algorithms are known to enable more accurate and quantitative optoacoustic (photoacoustic) tomographic reconstructions than standard back-projection methods. However, three-dimensional (3D) model-based inversion is often hampered by high computational complexity and memory overhead. Parallel implementations on a graphics processing unit (GPU) have been shown to efficiently reduce the memory requirements by on-the-fly calculation of the actions of the optoacoustic model matrix, but the high complexity still makes these approaches impractical for large 3D optoacoustic datasets. Herein, we show that the computational complexity of 3D model-based iterative inversion can be significantly reduced by splitting the model matrix into two parts: one maximally sparse matrix containing only one entry per voxel-transducer pair and a second matrix corresponding to cyclic convolution. We further suggest reconstructing the images by multiplying the transpose of the model matrix calculated in this manner with the acquired signals, which is equivalent to using a very large regularization parameter in the iterative inversion method. The performance of these two approaches is compared to that of standard back-projection and a recently introduced GPU-based model-based method using datasets from in vivo experiments. The reconstruction time was accelerated by approximately an order of magnitude with the new iterative method, while multiplication with the transpose of the matrix is shown to be as fast as standard back-projection.

Quality Assessment of the Neural Algorithms on the Example of EIT-UST Hybrid Tomography

The paper presents the results of research on the hybrid industrial tomograph electrical impedance tomography (EIT) and ultrasonic tomography (UST) (EIT-UST), operating on the basis of electrical and ultrasonic data. The emphasis of the research was placed on the algorithmic domain. However, it should be emphasized that all hardware components of the hybrid tomograph, including electronics, sensors and transducers, have been designed and mostly made in the Netrix S.A. laboratory. The test object was a tank filled with water with several dozen percent concentration. As part of the study, the original multiple neural networks system was trained, the characteristic feature of which is the generation of each of the individual pixels of the tomographic image, using an independent artificial neural network (ANN), with the input vector for all ANNs being the same. Despite the same measurement vector, each of the ANNs generates its own independent output value for a given tomogram pixel, because, during training, the networks get their respective weights and biases. During the tests, the results of three tomographic methods were compared: EIT, UST and EIT-UST hybrid. The results confirm that the use of heterogeneous tomographic systems (hybrids) increases the reliability of reconstruction in various measuring cases, which is used to solve quality problems in managing production processes.

In vivo detection of venous sinus distension due to intracranial hypotension in small animal using pulsed-laser-diode photoacoustic tomography

Intracranial hypotension (IH) is a pathophysiological condition of reduced intracranial pressure caused by low cerebrospinal fluid (CSF) volume due to dural injuries from lumbar puncture, surgery, or trauma. Understanding the prognosis of IH in small animal models is important to gain insights on the complications associated with it such as orthostatic headache, cerebral venous thrombosis, coma, and so forth. Photoacoustic tomography (PAT) offers a novel and cost-effective way to perceive and detect IH in small animal models. In this study, a pulsed laser diode (PLD)-based PAT imaging system was used to examine the changes in the venous sinuses of the rat brain due to IH, induced through CSF extraction. After the CSF extraction, an increase in the sagittal sinus area by ~30% and width by 40% ± 5% was observed. These results provide supportive evidence that the PLD-PAT can be employed for detecting changes in sagittal sinus due to IH in rat model.

Quantitative PA tomography of high resolution 3-D images: Experimental validation in a tissue phantom

Quantitative photoacoustic tomography aims to recover the spatial distribution of absolute chromophore concentrations and their ratios from deep tissue, high-resolution images. In this study, a model-based inversion scheme based on a Monte-Carlo light transport model is experimentally validated on 3-D multispectral images of a tissue phantom acquired using an all-optical scanner with a planar detection geometry. A calibrated absorber allowed scaling of the measured data during the inversion, while an acoustic correction method was employed to compensate the effects of limited view detection. Chromophore- and fluence-dependent step sizes and Adam optimization were implemented to achieve rapid convergence. High resolution 3-D maps of absolute concentrations and their ratios were recovered with high accuracy. Potential applications of this method include quantitative functional and molecular photoacoustic tomography of deep tissue in preclinical and clinical studies.

Photoacoustic Imaging in Tissue Engineering and Regenerative Medicine

Several imaging modalities are available for investigation of the morphological, functional, and molecular features of engineered tissues in small animal models. While research in tissue engineering and regenerative medicine (TERM) would benefit from a comprehensive longitudinal analysis of new strategies, researchers have not always applied the most advanced methods. Photoacoustic imaging (PAI) is a rapidly emerging modality that has received significant attention due to its ability to exploit the strong endogenous contrast of optical methods with the high spatial resolution of ultrasound methods. Exogenous contrast agents can also be used in PAI for targeted imaging. Applications of PAI relevant to TERM include stem cell tracking, longitudinal monitoring of scaffolds in vivo, and evaluation of vascularization. In addition, the emerging capabilities of PAI applied to the detection and monitoring of cancer and other inflammatory diseases could be exploited by tissue engineers. This article provides an overview of the operating principles of PAI and its broad potential for application in TERM. Impact statement Photoacoustic imaging, a new hybrid imaging technique, has demonstrated high potential in the clinical diagnostic applications. The optical and acoustic aspect of the photoacoustic imaging system works in harmony to provide better resolution at greater tissue depth. Label-free imaging of vasculature with this imaging can be used to track and monitor disease, as well as the therapeutic progression of treatment. Photoacoustic imaging has been utilized in tissue engineering to some extent; however, the full benefit of this technique is yet to be explored. The increasing availability of commercial photoacoustic systems will make application as an imaging tool for tissue engineering application more feasible. This review first provides a brief description of photoacoustic imaging and summarizes its current and potential application in tissue engineering.

Image reconstruction based on compressed sensing for sparse-data endoscopic photoacoustic tomography

Endoscopic photoacoustic tomography (EPAT) is an interventional application of photoacoustic tomography (PAT) to visualize anatomical features and functional components of biological cavity structures such as nasal cavity, digestive tract or coronary arterial vessels. One of the main challenges in clinical applicability of EPAT is the incomplete acoustic measurements due to the limited detectors or the limited-view acoustic detection enclosed in the cavity. In this case, conventional image reconstruction methodologies suffer from significantly degraded image quality. This work introduces a compressed-sensing (CS)-based method to reconstruct a high-quality image that represents the initial pressure distribution on a luminal cross-section from incomplete discrete acoustic measurements. The method constructs and trains a complete dictionary for the sparse representation of the photoacoustically-induced acoustic measurements. The sparse representation of the complete acoustic signals is then optimally obtained based on the sparse measurements and a sensing matrix. The complete acoustic signals are recovered from the sparse representation by inverse sparse transformation. The image of the initial pressure distribution is finally reconstructed from the recovered complete signals by using the time reversal (TR) algorithm. It was shown with numerical experiments that high-quality images with reduced under-sampling artifacts can be reconstructed from sparse measurements. The comparison results suggest that the proposed method outperforms the standard TR reconstruction by 40% in terms of the structural similarity of the reconstructed images.

Light-Emitting-Diode-Based Multispectral Photoacoustic Computed Tomography System

Photoacoustic computed tomography (PACT) has been widely explored for non-ionizing functional and molecular imaging of humans and small animals. In order for light to penetrate deep inside tissue, a bulky and high-cost tunable laser is typically used. Light-emitting diodes (LEDs) have recently emerged as cost-effective and portable alternative illumination sources for photoacoustic imaging. In this study, we have developed a portable, low-cost, five-dimensional (x, y, z, t, λ ) PACT system using multi-wavelength LED excitation to enable similar functional and molecular imaging capabilities as standard tunable lasers. Four LED arrays and a linear ultrasound transducer detector array are housed in a hollow cylindrical geometry that rotates 360 degrees to allow multiple projections through the subject of interest placed inside the cylinder. The structural, functional, and molecular imaging capabilities of the LED-PACT system are validated using various tissue-mimicking phantom studies. The axial, lateral, and elevational resolutions of the system at 2.3 cm depth are estimated as 0.12 mm, 0.3 mm, and 2.1 mm, respectively. Spectrally unmixed photoacoustic contrasts from tubes filled with oxy- and deoxy-hemoglobin, indocyanine green, methylene blue, and melanin molecules demonstrate the multispectral molecular imaging capabilities of the system. Human-finger-mimicking phantoms made of a bone and blood tubes show structural and functional oxygen saturation imaging capabilities. Together, these results demonstrate the potential of the proposed LED-based, low-cost, portable PACT system for pre-clinical and clinical applications.