A Single Simulation Platform for Hybrid Photoacoustic and RF-Acoustic Computed Tomography

Quantitative photoacoustic tomography: modeling and inverse problems

Significance

Quantitative photoacoustic tomography (QPAT) exploits the photoacoustic effect with the aim of estimating images of clinically relevant quantities related to the tissue's optical absorption. The technique has two aspects: an acoustic part, where the initial acoustic pressure distribution is estimated from measured photoacoustic time-series, and an optical part, where the distributions of the optical parameters are estimated from the initial pressure.

Aim

Our study is focused on the optical part. In particular, computational modeling of light propagation (forward problem) and numerical solution methodologies of the image reconstruction (inverse problem) are discussed.

Approach

The commonly used mathematical models of how light and sound propagate in biological tissue are reviewed. A short overview of how the acoustic inverse problem is usually treated is given. The optical inverse problem and methods for its solution are reviewed. In addition, some limitations of real-life measurements and their effect on the inverse problems are discussed.

Results

An overview of QPAT with a focus on the optical part was given. Computational modeling and inverse problems of QPAT were addressed, and some key challenges were discussed. Furthermore, the developments for tackling these problems were reviewed. Although modeling of light transport is well-understood and there is a well-developed framework of inverse mathematics for approaching the inverse problem of QPAT, there are still challenges in taking these methodologies to practice.

Conclusions

Modeling and inverse problems of QPAT together were discussed. The scope was limited to the optical part, and the acoustic aspects were discussed only to the extent that they relate to the optical aspect.

Stochastic three-dimensional numerical phantoms to enable computational studies in quantitative optoacoustic computed tomography of breast cancer

Significance

When developing a new quantitative optoacoustic computed tomography (OAT) system for diagnostic imaging of breast cancer, objective assessments of various system designs through human trials are infeasible due to cost and ethical concerns. In prototype stages, however, different system designs can be cost-efficiently assessed via virtual imaging trials (VITs) employing ensembles of digital breast phantoms, i.e., numerical breast phantoms (NBPs), that convey clinically relevant variability in anatomy and optoacoustic tissue properties.

Aim

The aim is to develop a framework for generating ensembles of realistic three-dimensional (3D) anatomical, functional, optical, and acoustic NBPs and numerical lesion phantoms (NLPs) for use in VITs of OAT applications in the diagnostic imaging of breast cancer.

Approach

The generation of the anatomical NBPs was accomplished by extending existing NBPs developed by the U.S. Food and Drug Administration. As these were designed for use in mammography applications, substantial modifications were made to improve blood vasculature modeling for use in OAT. The NLPs were modeled to include viable tumor cells only or a combination of viable tumor cells, necrotic core, and peripheral angiogenesis region. Realistic optoacoustic tissue properties were stochastically assigned in the NBPs and NLPs.

Results

To advance optoacoustic and optical imaging research, 84 datasets have been released; these consist of anatomical, functional, optical, and acoustic NBPs and the corresponding simulated multi-wavelength optical fluence, initial pressure, and OAT measurements. The generated NBPs were compared with clinical data with respect to the volume of breast blood vessels and spatially averaged effective optical attenuation. The usefulness of the proposed framework was demonstrated through a case study to investigate the impact of acoustic heterogeneity on OAT images of the breast.

Conclusions

The proposed framework will enhance the authenticity of virtual OAT studies and can be widely employed for the investigation and development of advanced image reconstruction and machine learning-based methods, as well as the objective evaluation and optimization of the OAT system designs.

Acousto-Optics: Recent Studies and Medical Applications

Development of acousto-optic (AO) techniques has made progress in recent years across a range of medical application fields, especially in improving resolution, detection speed, and imaging depth. This paper presents a comprehensive overview of recent advancements in AO-based techniques that have been presented after the previously published review in 2017. The survey covers a description of theoretical modeling strategies and numerical simulation methods as well as recent applications in medical fields. It also provides a comparison between different techniques in terms of complexity, achieved depth in tissue, and resolution. In addition, a comparison between different numerical simulation methods will be outlined. Additionally, a number of challenges faced by AO techniques are considered, particularly in the context of realistic in vivo imaging. Finally, the paper discusses prospects of AO-based medical diagnosis methods.

Deep learning methods hold promise for light fluence compensation in three-dimensional optoacoustic imaging

SIGNIFICANCE

Quantitative optoacoustic imaging (QOAI) continues to be a challenge due to the influence of nonlinear optical fluence distribution, which distorts the optoacoustic image representation. Nonlinear optical fluence correction in OA imaging is highly ill-posed, leading to the inaccurate recovery of optical absorption maps. This work aims to recover the optical absorption maps using deep learning (DL) approach by correcting for the fluence effect.

AIM

Different DL models were compared and investigated to enable optical absorption coefficient recovery at a particular wavelength in a nonhomogeneous foreground and background medium.

APPROACH

Data-driven models were trained with two-dimensional (2D) Blood vessel and three-dimensional (3D) numerical breast phantom with highly heterogeneous/realistic structures to correct for the nonlinear optical fluence distribution. The trained DL models such as U-Net, Fully Dense (FD) U-Net, Y-Net, FD Y-Net, Deep residual U-Net (Deep ResU-Net), and generative adversarial network (GAN) were tested to evaluate the performance of optical absorption coefficient recovery (or fluence compensation) with in-silico and in-vivo datasets.

RESULTS

The results indicated that FD U-Net-based deconvolution improves by about 10% over reconstructed optoacoustic images in terms of peak-signal-to-noise ratio. Further, it was observed that DL models can indeed highlight deep-seated structures with higher contrast due to fluence compensation. Importantly, the DL models were found to be about 17 times faster than solving diffusion equation for fluence correction.

CONCLUSIONS

The DL methods were able to compensate for nonlinear optical fluence distribution more effectively and improve the optoacoustic image quality.

Modeling toolchain for realistic simulation of photoacoustic data acquisition

SIGNIFICANCE

Physics-based simulations of photoacoustic (PA) signals are used to validate new methods, to characterize PA setups and to generate training datasets for machine learning. However, a thoroughly validated PA simulation toolchain that can simulate realistic images is still lacking.

AIM

A quantitative toolchain was developed to model PA image acquisition in complex tissues, by simulating both the optical fluence and the acoustic wave propagation.

APPROACH

Sampling techniques were developed to decrease artifacts in acoustic simulations. The performance of the simulations was analyzed by measuring the point spread function (PSF) and using a rotatable three-channel phantom, filled with cholesterol, a human carotid plaque sample, and porcine blood. Ex vivo human plaque samples were simulated to validate the methods in more complex tissues.

RESULTS

The sampling techniques could enhance the quality of the simulated PA images effectively. The resolution and intensity of the PSF in the turbid medium matched the experimental data well. Overall, the appearance, signal-to-noise ratio and speckle of the images could be simulated accurately.

CONCLUSIONS

A PA toolchain was developed and validated, and the results indicate a great potential of PA simulations in more complex and heterogeneous media.

SIMPA: an open-source toolkit for simulation and image processing for photonics and acoustics

SIGNIFICANCE

Optical and acoustic imaging techniques enable noninvasive visualisation of structural and functional properties of tissue. The quantification of measurements, however, remains challenging due to the inverse problems that must be solved. Emerging data-driven approaches are promising, but they rely heavily on the presence of high-quality simulations across a range of wavelengths due to the lack of ground truth knowledge of tissue acoustical and optical properties in realistic settings.

AIM

To facilitate this process, we present the open-source simulation and image processing for photonics and acoustics (SIMPA) Python toolkit. SIMPA is being developed according to modern software design standards.

APPROACH

SIMPA enables the use of computational forward models, data processing algorithms, and digital device twins to simulate realistic images within a single pipeline. SIMPA's module implementations can be seamlessly exchanged as SIMPA abstracts from the concrete implementation of each forward model and builds the simulation pipeline in a modular fashion. Furthermore, SIMPA provides comprehensive libraries of biological structures, such as vessels, as well as optical and acoustic properties and other functionalities for the generation of realistic tissue models.

RESULTS

To showcase the capabilities of SIMPA, we show examples in the context of photoacoustic imaging: the diversity of creatable tissue models, the customisability of a simulation pipeline, and the degree of realism of the simulations.

CONCLUSIONS

SIMPA is an open-source toolkit that can be used to simulate optical and acoustic imaging modalities. The code is available at: https://github.com/IMSY-DKFZ/simpa, and all of the examples and experiments in this paper can be reproduced using the code available at: https://github.com/IMSY-DKFZ/simpa_paper_experiments.

Development of a digital breast phantom for photoacoustic computed tomography

Photoacoustic (PA) imaging provides morphological and functional information about angiogenesis and thus is potentially suitable for breast cancer diagnosis. However, the development of PA breast imaging has been hindered by inadequate patients and a lack of ground truth images. Here, we report a digital breast phantom with realistic acoustic and optical properties, with which a digital PA-ultrasound imaging pipeline is developed to create a diverse pool of virtual patients with three types of masses: ductal carcinoma in situ, invasive breast cancer, and fibroadenoma. The experimental results demonstrate that our model is realistic, flexible, and can be potentially useful for accelerating the development of PA breast imaging technology.

Light-Emitting-Diode-Based Multispectral Photoacoustic Computed Tomography System

Photoacoustic computed tomography (PACT) has been widely explored for non-ionizing functional and molecular imaging of humans and small animals. In order for light to penetrate deep inside tissue, a bulky and high-cost tunable laser is typically used. Light-emitting diodes (LEDs) have recently emerged as cost-effective and portable alternative illumination sources for photoacoustic imaging. In this study, we have developed a portable, low-cost, five-dimensional (x, y, z, t, λ ) PACT system using multi-wavelength LED excitation to enable similar functional and molecular imaging capabilities as standard tunable lasers. Four LED arrays and a linear ultrasound transducer detector array are housed in a hollow cylindrical geometry that rotates 360 degrees to allow multiple projections through the subject of interest placed inside the cylinder. The structural, functional, and molecular imaging capabilities of the LED-PACT system are validated using various tissue-mimicking phantom studies. The axial, lateral, and elevational resolutions of the system at 2.3 cm depth are estimated as 0.12 mm, 0.3 mm, and 2.1 mm, respectively. Spectrally unmixed photoacoustic contrasts from tubes filled with oxy- and deoxy-hemoglobin, indocyanine green, methylene blue, and melanin molecules demonstrate the multispectral molecular imaging capabilities of the system. Human-finger-mimicking phantoms made of a bone and blood tubes show structural and functional oxygen saturation imaging capabilities. Together, these results demonstrate the potential of the proposed LED-based, low-cost, portable PACT system for pre-clinical and clinical applications.

Multidomain computational modeling of photoacoustic imaging: verification, validation, and image quality prediction

As photoacoustic imaging (PAI) technology matures, computational modeling will increasingly represent a critical tool for facilitating clinical translation through predictive simulation of real-world performance under a wide range of device and biological conditions. While modeling currently offers a rapid, inexpensive tool for device development and prediction of fundamental image quality metrics (e.g., spatial resolution and contrast ratio), rigorous verification and validation will be required of models used to provide regulatory-grade data that effectively complements and/or replaces in vivo testing. To address methods for establishing model credibility, we developed an integrated computational model of PAI by coupling a previously developed three-dimensional Monte Carlo model of tissue light transport with a two-dimensional (2D) acoustic wave propagation model implemented in the well-known k-Wave toolbox. We then evaluated ability of the model to predict basic image quality metrics by applying standardized verification and validation principles for computational models. The model was verified against published simulation data and validated against phantom experiments using a custom PAI system. Furthermore, we used the model to conduct a parametric study of optical and acoustic design parameters. Results suggest that computationally economical 2D acoustic models can adequately predict spatial resolution, but metrics such as signal-to-noise ratio and penetration depth were difficult to replicate due to challenges in modeling strong clutter observed in experimental images. Parametric studies provided quantitative insight into complex relationships between transducer characteristics and image quality as well as optimal selection of optical beam geometry to ensure adequate image uniformity. Multidomain PAI simulation tools provide high-quality tools to aid device development and prediction of real-world performance, but further work is needed to improve model fidelity, especially in reproducing image noise and clutter.