Three-dimensional optoacoustic reconstruction using fast sparse representation

Image restoration for ring-array photoacoustic tomography system based on blind spatially rotational deconvolution

Ring-array photoacoustic tomography (PAT) system has been widely used in noninvasive biomedical imaging. However, the reconstructed image usually suffers from spatially rotational blur and streak artifacts due to the non-ideal imaging conditions. To improve the reconstructed image towards higher quality, we propose a concept of spatially rotational convolution to formulate the image blur process, then we build a regularized restoration problem model accordingly and design an alternating minimization algorithm which is called blind spatially rotational deconvolution to achieve the restored image. Besides, we also present an image preprocessing method based on the proposed algorithm to remove the streak artifacts. We take experiments on phantoms and in vivo biological tissues for evaluation, the results show that our approach can significantly enhance the resolution of the image obtained from ring-array PAT system and remove the streak artifacts effectively.

Deep learning framework for three-dimensional surface reconstruction of object of interest in photoacoustic tomography

Photoacoustic tomography (PAT) is a non-ionizing hybrid imaging technology of clinical importance that combines the high contrast of optical imaging with the high penetration of ultrasonic imaging. Two-dimensional (2D) tomographic images can only provide the cross-sectional structure of the imaging target rather than its overall spatial morphology. This work proposes a deep learning framework for reconstructing three-dimensional (3D) surface of an object of interest from a series of 2D images. It achieves end-to-end mapping from a series of 2D images to a 3D image, visually displaying the overall morphology of the object. The framework consists of four modules: segmentation module, point cloud generation module, point cloud completion module, and mesh conversion module, which respectively implement the tasks of segmenting a region of interest, generating a sparse point cloud, completing sparse point cloud and reconstructing 3D surface. The network model is trained on simulation data sets and verified on simulation, phantom, and in vivo data sets. The results showed superior 3D reconstruction performance both visually and on the basis of quantitative evaluation metrics compared to the state-of-the-art non-learning and learning approaches. This method potentially enables high-precision 3D surface reconstruction from the tomographic images output by the preclinical PAT system without changing the imaging system. It provides a general deep learning scheme for 3D reconstruction from tomographic scanning data.

Review of Deep Learning Approaches for Interleaved Photoacoustic and Ultrasound (PAUS) Imaging

Photoacoustic (PA) imaging provides optical contrast at relatively large depths within the human body, compared to other optical methods, at ultrasound (US) spatial resolution. By integrating real-time PA and US (PAUS) modalities, PAUS imaging has the potential to become a routine clinical modality bringing the molecular sensitivity of optics to medical US imaging. For applications where the full capabilities of clinical US scanners must be maintained in PAUS, conventional limited view and bandwidth transducers must be used. This approach, however, cannot provide high-quality maps of PA sources, especially vascular structures. Deep learning (DL) using data-driven modeling with minimal human design has been very effective in medical imaging, medical data analysis, and disease diagnosis, and has the potential to overcome many of the technical limitations of current PAUS imaging systems. The primary purpose of this article is to summarize the background and current status of DL applications in PAUS imaging. It also looks beyond current approaches to identify remaining challenges and opportunities for robust translation of PAUS technologies to the clinic.

Spatially-variant image deconvolution for photoacoustic tomography

Photoacoustic tomography (PAT) system can reconstruct images of biological tissues with high resolution and contrast. However, in practice, the PAT images are usually degraded by spatially variant blur and streak artifacts due to the non-ideal imaging conditions and chosen reconstruction algorithms. Therefore, in this paper, we propose a two-phase restoration method to progressively improve the image quality. In the first phase, we design a precise device and measuring method to obtain spatially variant point spread function samples at preset positions of the PAT system in image domain, then we adopt principal component analysis and radial basis function interpolation to model the entire spatially variant point spread function. Afterwards, we propose a sparse logarithmic gradient regularized Richardson-Lucy (SLG-RL) algorithm to deblur the reconstructed PAT images. In the second phase, we present a novel method called deringing which is also based on SLG-RL to remove the streak artifacts. Finally, we evaluate our method with simulation, phantom and in vivo experiments, respectively. All the results show that our method can significantly improve the quality of PAT images.

Image Quality Improvement Techniques and Assessment Adequacy in Clinical Optoacoustic Imaging: A Systematic Review

Optoacoustic imaging relies on the detection of optically induced acoustic waves to offer new possibilities in morphological and functional imaging. As the modality matures towards clinical application, research efforts aim to address multifactorial limitations that negatively impact the resulting image quality. In an endeavor to obtain a clear view on the limitations and their effects, as well as the status of this progressive refinement process, we conduct an extensive search for optoacoustic image quality improvement approaches that have been evaluated with humans in vivo, thus focusing on clinically relevant outcomes. We query six databases (PubMed, Scopus, Web of Science, IEEE Xplore, ACM Digital Library, and Google Scholar) for articles published from 1 January 2010 to 31 October 2021, and identify 45 relevant research works through a systematic screening process. We review the identified approaches, describing their primary objectives, targeted limitations, and key technical implementation details. Moreover, considering comprehensive and objective quality assessment as an essential prerequisite for the adoption of such approaches in clinical practice, we subject 36 of the 45 papers to a further in-depth analysis of the reported quality evaluation procedures, and elicit a set of criteria with the intent to capture key evaluation aspects. Through a comparative criteria-wise rating process, we seek research efforts that exhibit excellence in quality assessment of their proposed methods, and discuss features that distinguish them from works with similar objectives. Additionally, informed by the rating results, we highlight areas with improvement potential, and extract recommendations for designing quality assessment pipelines capable of providing rich evidence.

Universal Real-Time Adaptive Signal Compression for High-Frame-Rate Optoacoustic Tomography

Optoacoustic tomography (OAT) has recently been advanced toward ultrafast volumetric imaging frame rates in the kilohertz range. As a result, excessive data processing and storage capacity requirements are increasingly being imposed on the imaging systems. OAT data commonly exhibit significant sparsity across the spatial, temporal or spectral domains, which facilitated the development of compressed sensing algorithms exploiting various sparse acquisition and under-sampling schemes to reduce data rates. However, performance of compressed sensing critically depends on a priori knowledge on the type of acquired data and/or imaged object, commonly resulting in lack of general applicability and unpredictable image quality. In this work, we report on a fast adaptive OAT data compression framework operating on fully sampled tomographic data. It is based on a wavelet packet transform that maximizes the data compression ratio according to the desired signal energy loss. A dedicated reconstruction method was further developed that efficiently renders images directly from the compressed data. Up to 1000x compression ratios were achieved while providing efficient control over the resulting image quality from arbitrary datasets exhibiting diverse spatial, temporal and spectral characteristics. Our approach enables faster and longer acquisitions and facilitates long-term storage of large OAT datasets.

3D Indoor Scene Reconstruction and Layout Based on Virtual Reality Technology and Few-Shot Learning

Indoor three-dimensional layout has a strong application background, such as virtual office three-dimensional layout planning, museum three-dimensional layout planning, and cave scene three-dimensional layout planning, which have been widely used in telecommuting, education, tourism, and other industries. In view of this, this paper proposes an indoor landscape reconstruction method based on VR (virtual reality) and draws indoor landscape information and images by using VR technology to generate an indoor landscape reconstruction panorama. A model is established to correct the distance error and reflectivity error of depth image, improve the accuracy of the depth image, and finally improve the accuracy of three-dimensional indoor scene TDR (three-dimensional reconstruction). In the process of optimizing layout, the Monte Carlo sampling method is used based on the Markov chain, and constraints are used as density functions to guide layout sampling and generate a number of reasonable scene layout suggestions in the iterative process of the sampler. Experiments show that this method can provide scientific and reasonable guidance to users' scene layout and help them complete the furniture layout quickly.

Binary photoacoustic tomography for improved vasculature imaging

SIGNIFICANCE

The proposed binary tomography approach was able to recover the vasculature structures accurately, which could potentially enable the utilization of binary tomography algorithm in scenarios such as therapy monitoring and hemorrhage detection in different organs.

AIM

Photoacoustic tomography (PAT) involves reconstruction of vascular networks having direct implications in cancer research, cardiovascular studies, and neuroimaging. Various methods have been proposed for recovering vascular networks in photoacoustic imaging; however, most methods are two-step (image reconstruction and image segmentation) in nature. We propose a binary PAT approach wherein direct reconstruction of vascular network from the acquired photoacoustic sinogram data is plausible.

APPROACH

Binary tomography approach relies on solving a dual-optimization problem to reconstruct images with every pixel resulting in a binary outcome (i.e., either background or the absorber). Further, the binary tomography approach was compared against backprojection, Tikhonov regularization, and sparse recovery-based schemes.

RESULTS

Numerical simulations, physical phantom experiment, and in-vivo rat brain vasculature data were used to compare the performance of different algorithms. The results indicate that the binary tomography approach improved the vasculature recovery by 10% using in-silico data with respect to the Dice similarity coefficient against the other reconstruction methods.

CONCLUSION

The proposed algorithm demonstrates superior vasculature recovery with limited data both visually and based on quantitative image metrics.

Single laser-shot super-resolution photoacoustic tomography with fast sparsity-based reconstruction

Recently, ℓ 1 -norm based reconstruction approaches have been used with linear array systems to improve photoacoustic resolution and demonstrate undersampled imaging when there is sufficient sparsity in some domain. However, such approaches have yet to beat the half-wavelength resolution limit. In this paper, the ability to beat the half-wavelength diffraction limit is demonstrated using a 5 MHz ring array photoacoustic tomography system and ℓ 1 -norm based reconstruction approaches. We used the array system to image wire targets at ≈ 2 - 3 cm depth in both intralipid scattering solution and water. The minimum observable separation was estimated as 70 ± 10 μ m , improving on the half-wavelength resolution limit of 145 μ m . This improvement was demonstrated even when using a random projection transform to reduce data by 99 % , enabling substantially faster reconstruction times. This is the first photoacoustic tomography approach capable of beating the half-wavelength resolution limit with a single laser shot.

Non-local means improves total-variation constrained photoacoustic image reconstruction

Photoacoustic/Optoacoustic tomography aims to reconstruct maps of the initial pressure rise induced by the absorption of light pulses in tissue. This reconstruction is an ill-conditioned and under-determined problem, when the data acquisition protocol involves limited detection positions. The aim of the work is to develop an inversion method which integrates denoising procedure within the iterative model-based reconstruction to improve quantitative performance of optoacoustic imaging. Among the model-based schemes, total-variation (TV) constrained reconstruction scheme is a popular approach. In this work, a two-step approach was proposed for improving the TV constrained optoacoustic inversion by adding a non-local means based filtering step within each TV iteration. Compared to TV-based reconstruction, inclusion of this non-local means step resulted in signal-to-noise ratio improvement of 2.5 dB in the reconstructed optoacoustic images.

Sound Out the Deep Colors: Photoacoustic Molecular Imaging at New Depths

Photoacoustic tomography (PAT) has become increasingly popular for molecular imaging due to its unique optical absorption contrast, high spatial resolution, deep imaging depth, and high imaging speed. Yet, the strong optical attenuation of biological tissues has traditionally prevented PAT from penetrating more than a few centimeters and limited its application for studying deeply seated targets. A variety of PAT technologies have been developed to extend the imaging depth, including employing deep-penetrating microwaves and X-ray photons as excitation sources, delivering the light to the inside of the organ, reshaping the light wavefront to better focus into scattering medium, as well as improving the sensitivity of ultrasonic transducers. At the same time, novel optical fluence mapping algorithms and image reconstruction methods have been developed to improve the quantitative accuracy of PAT, which is crucial to recover weak molecular signals at larger depths. The development of highly-absorbing near-infrared PA molecular probes has also flourished to provide high sensitivity and specificity in studying cellular processes. This review aims to introduce the recent developments in deep PA molecular imaging, including novel imaging systems, image processing methods and molecular probes, as well as their representative biomedical applications. Existing challenges and future directions are also discussed.

Y-Net: Hybrid deep learning image reconstruction for photoacoustic tomography in vivo

Conventional reconstruction algorithms (e.g., delay-and-sum) used in photoacoustic imaging (PAI) provide a fast solution while many artifacts remain, especially for limited-view with ill-posed problem. In this paper, we propose a new convolutional neural network (CNN) framework Y-Net: a CNN architecture to reconstruct the initial PA pressure distribution by optimizing both raw data and beamformed images once. The network combines two encoders with one decoder path, which optimally utilizes more information from raw data and beamformed image. We compared our result with some ablation studies, and the results of the test set show better performance compared with conventional reconstruction algorithms and other deep learning method (U-Net). Both in-vitro and in-vivo experiments are used to validated our method, which still performs better than other existing methods. The proposed Y-Net architecture also has high potential in medical image reconstruction for other imaging modalities beyond PAI.

Spatiotemporal Antialiasing in Photoacoustic Computed Tomography

Photoacoustic computed tomography (PACT) based on a full-ring ultrasonic transducer array is widely used for small animal wholebody and human organ imaging, thanks to its high in-plane resolution and full-view fidelity. However, spatial aliasing in full-ring geometry PACT has not been studied in detail. If the spatial Nyquist criterion is not met, aliasing in spatial sampling causes artifacts in reconstructed images, even when the temporal Nyquist criterion has been satisfied. In this work, we clarified the source of spatial aliasing through spatiotemporal analysis. We demonstrated that the combination of spatial interpolation and temporal filtering can effectively mitigate artifacts caused by aliasing in either image reconstruction or spatial sampling, and we validated this method by both numerical simulations and in vivo experiments.

A Synthetic Total Impulse Response Characterization Method for Correction of Hand-Held Optoacoustic Images

The impulse response of optoacoustic (photoacoustic) tomographic imaging system depends on several system components, the characteristics of which can influence the quality of reconstructed images. The effect of these system components on reconstruction quality have not been considered in detail so far. Here we combine sparse measurements of the total impulse response (TIR) with a geometric acoustic model to obtain a full characterization of the TIR of a handheld optoacoustic tomography system with concave limited-view acquisition geometry. We then use this synthetic TIR to reconstruct data from phantoms and healthy human volunteers, demonstrating improvements in image resolution and fidelity. The higher accuracy of optoacoustic tomographic reconstruction with TIR correction further improves the diagnostic capability of handheld optoacoustic tomographic systems.

Breaking the resolution limit in photoacoustic imaging using non-negativity and sparsity

The spatial resolution achievable in photoacoustic imaging decreases with the imaging depth, resulting in blurred images for deeper structures. Apart from technical limitations, the ultimate resolution limit results from the second law of thermodynamics. The attenuation of the optically generated acoustic waves on their way from the imaged structure to the sample surface by scattering and dissipation leads to an increase of entropy. The resulting loss of spatial resolution for structures embedded in attenuating media can be compensated by numerical methods that make use of additional available information. In this article, we demonstrate this using experimental data from plane one-dimensional (1D) acoustic waves propagating in fat tissue. The acoustic waves are optically induced by nanosecond laser pulses and measured with piezoelectric transducers. The experimental results of 1D compensation are also relevant for photoacoustic imaging in 2D or 3D in an acoustically attenuating medium by dividing the reconstruction problem into two steps: First, the ideal signal, which is the solution of the un-attenuated wave equation, is determined by the proposed 1D attenuation compensation for each detector signal. In a second step, any ultrasound reconstruction method for un-attenuated data can be used for image reconstruction. For the reconstruction of a small step milled into a silicon wafer surface, which allows the generation of two photoacoustic pulses with a small time offset, we take advantage of non-negativity and sparsity and inverted the measured, frequency dependent acoustic attenuation of the fat tissue. We were able to improve the spatial resolution for imaging through 20 mm of porcine fat tissue compared to the diffraction limit at the cut-off frequency by at least a factor of two.

Model-Based Reconstruction of Large Three-Dimensional Optoacoustic Datasets

Iterative model-based algorithms are known to enable more accurate and quantitative optoacoustic (photoacoustic) tomographic reconstructions than standard back-projection methods. However, three-dimensional (3D) model-based inversion is often hampered by high computational complexity and memory overhead. Parallel implementations on a graphics processing unit (GPU) have been shown to efficiently reduce the memory requirements by on-the-fly calculation of the actions of the optoacoustic model matrix, but the high complexity still makes these approaches impractical for large 3D optoacoustic datasets. Herein, we show that the computational complexity of 3D model-based iterative inversion can be significantly reduced by splitting the model matrix into two parts: one maximally sparse matrix containing only one entry per voxel-transducer pair and a second matrix corresponding to cyclic convolution. We further suggest reconstructing the images by multiplying the transpose of the model matrix calculated in this manner with the acquired signals, which is equivalent to using a very large regularization parameter in the iterative inversion method. The performance of these two approaches is compared to that of standard back-projection and a recently introduced GPU-based model-based method using datasets from in vivo experiments. The reconstruction time was accelerated by approximately an order of magnitude with the new iterative method, while multiplication with the transpose of the matrix is shown to be as fast as standard back-projection.

Full-frequency correction of spatial impulse response in back-projection scheme using space-variant filtering for optoacoustic mesoscopy

The fidelity and quality of reconstructed images in optoacoustic mesoscopy (OPAM) can be significantly improved by considering the spatial impulse response (SIR) of the employed focused transducer into reconstruction. However, the traditional method fully taking the SIR into account can hardly meet the data-intensive requirements of high resolution OPAM because of excessive memory and time consumption. Herein, a modified back-projection method using a space-variant filter for full-frequency correction of the SIR is presented, and applied to the OPAM system with a sphere-focused transducer. The proposed method can readily manage the large datasets of the OPAM and effectively reduce the extra time consumption. The performance of the proposed method is showcased by simulations and experiments of phantoms and biological tissue. The results demonstrate that the modified back-projection method exhibits better image fidelity, resolution and contrast compared to the common and weighted back-projection methods that are not or not fully accounting for the SIR.

Super-resolution photoacoustic and ultrasound imaging with sparse arrays

It has previously been demonstrated that model-based reconstruction methods relying on a priori knowledge of the imaging point spread function (PSF) coupled to sparsity priors on the object to image can provide super-resolution in photoacoustic (PA) or in ultrasound (US) imaging. Here, we experimentally show that such reconstruction also leads to super-resolution in both PA and US imaging with arrays having much less elements than used conventionally (sparse arrays). As a proof of concept, we obtained super-resolution PA and US cross-sectional images of microfluidic channels with only 8 elements of a 128-elements linear array using a reconstruction approach based on a linear propagation forward model and assuming sparsity of the imaged structure. Although the microchannels appear indistinguishable in the conventional delay-and-sum images obtained with all the 128 transducer elements, the applied sparsity-constrained model-based reconstruction provides super-resolution with down to only 8 elements. We also report simulation results showing that the minimal number of transducer elements required to obtain a correct reconstruction is fundamentally limited by the signal-to-noise ratio. The proposed method can be straigthforwardly applied to any transducer geometry, including 2D sparse arrays for 3D super-resolution PA and US imaging.

Fast and High-Resolution Three-Dimensional Hybrid-Domain Photoacoustic Imaging Incorporating Analytical-Focused Transducer Beam Amplitude

Recently, many reconstruction methods have been developed to improve the lateral resolution of acoustic-resolution photoacoustic microscopy (ARPAM) in out-of-focus regions. Though these methods enhance image resolution to some extent, they require advanced computational hardware and large computational time, especially for three-dimensional (3-D) cases. However, some methods do not consider the finite size of a transducer, while others employ numerical discretization to build a focused transducer model that is less efficient and accurate. To overcome these problems, we propose a 3-D ARPAM imaging reconstruction method with high precision, high efficiency, and low memory cost. It inherits the framework of model-based reconstructions and incorporates the forward acoustic model in the hybrid domain. This hybrid-domain acoustic model promotes an analytical solution to establish a focused transducer model. Furthermore, the non-uniform fast Fourier transform (NUFFT) and deconvolution methods are introduced to reduce the required computational time and memory volume for 3-D reconstructions. According to the experimental results reconstructed by the proposed method, the lateral resolution of an ARPAM image recorded by a 20-MHz focused transducer (NA 0.393) can reach 88.39 [Formula: see text]. This resolution exceeds the diffraction limitation of the focused transducer ( [Formula: see text]). When reconstructing a 3-D image with 200×200×150 pixels, the proposed method takes only 8.15 s using a laptop loaded with Intel Core i7-8550U CPU at 1.8 GHz and 1.06-GB memory.

Photoacoustic imaging depth comparison at 532-, 800-, and 1064-nm wavelengths: Monte Carlo simulation and experimental validation

Photoacoustic imaging (PAI) provides high-resolution and high-optical-contrast imaging beyond optical diffusion limit. Further improvement in imaging depth has been achieved by using near-infrared window-I (NIR-I, 700 to 900 nm) for illumination, due to lower scattering and absorption by tissues in this wavelength range. Recently, near-infrared window-II (NIR-II, 900 to 1700 nm) has been explored for PAI. We studied the imaging depths in biological tissues for different illumination wavelengths in visible, NIR-I, and NIR-II regions using Monte Carlo (MC) simulations and validated with experimental results. MC simulations were done to compute fluence in tissue, absorbance in blood vessel, and in a spherical absorber (mimicking sentinel lymph node) embedded at different depths in breast tissue. Photoacoustic tomography and acoustic resolution photoacoustic microscopy experiments were conducted to validate the MC results. We demonstrate that maximum imaging depth is achieved by wavelengths in NIR-I window (∼800  nm) when the energy density deposited is same for all wavelengths. However, illumination using wavelengths around 1064 nm (NIR-II window) gives the maximum imaging depth when the energy density deposited is proportional to maximum permissible exposure (MPE) at corresponding wavelength. These results show that it is the higher MPE of NIR-II window that helps in increasing the PAI depth for chromophores embedded in breast tissue.

Optoacoustic image formation approaches-a clinical perspective

Clinical translation of optoacoustic imaging is fostered by the rapid technical advances in imaging performance as well as the growing number of clinicians recognizing the immense diagnostic potential of this technology. Clinical optoacoustic systems are available in multiple configurations, including hand-held and endoscopic probes as well as raster-scan approaches. The hardware design must be adapted to the accessible portion of the imaged region and other application-specific requirements pertaining the achievable depth, field of view or spatio-temporal resolution. Equally important is the adequate choice of the signal and image processing approach, which is largely responsible for the resulting imaging performance. Thus, new image reconstruction algorithms are constantly evolving in parallel to the newly-developed set-ups. This review focuses on recent progress on optoacoustic image formation algorithms and processing methods in the clinical setting. Major reconstruction challenges include real-time image rendering in two and three dimensions, efficient hybridization with other imaging modalitites as well as accurate interpretation and quantification of bio-markers, herein discussed in the context of ongoing progress in clinical translation.

Streak artifact suppression in photoacoustic computed tomography using adaptive back projection

For photoacoustic computed tomography (PACT), an insufficient number of ultrasound detectors can cause serious streak-type artifacts. These artifacts get overlaid on top of image features, and thus locally jeopardize image quality and resolution. Here, a reconstruction algorithm, termed Contamination-Tracing Back-Projection (CTBP), is proposed for the mitigation of streak-type artifacts. During reconstruction, CTBP adaptively adjusts the back-projection weight, whose value is determined by the likelihood of contamination, to minimize the negative influences of strong absorbers. An iterative solution of the eikonal equation is implemented to accurately trace the time of flight of different pixels. Numerical, phantom and in vivo experiments demonstrate that CTBP can dramatically suppress streak artifacts in PACT and improve image quality.

Fractional Regularization to Improve Photoacoustic Tomographic Image Reconstruction

Photoacoustic tomography involves reconstructing the initial pressure rise distribution from the measured acoustic boundary data. The recovery of the initial pressure rise distribution tends to be an ill-posed problem in the presence of noise and when limited independent data is available, necessitating regularization. The standard regularization schemes include Tikhonov, l₁ -norm, and total-variation. These regularization schemes weigh the singular values equally irrespective of the noise level present in the data. This paper introduces a fractional framework to weigh the singular values with respect to a fractional power. This fractional framework was implemented for Tikhonov, l₁ -norm, and total-variation regularization schemes. Moreover, an automated method for choosing the fractional power was also proposed. It was shown theoretically and with numerical experiments that the fractional power is inversely related to the data noise level for fractional Tikhonov scheme. The fractional framework outperforms the standard regularization schemes, Tikhonov, l₁ -norm, and total-variation by 54% in numerical simulations, experimental phantoms, and in vivo rat data in terms of observed contrast/signal-to-noise-ratio of the reconstructed images.

Bioengineered bacterial vesicles as biological nano-heaters for optoacoustic imaging

Advances in genetic engineering have enabled the use of bacterial outer membrane vesicles (OMVs) to deliver vaccines, drugs and immunotherapy agents, as a strategy to circumvent biocompatibility and large-scale production issues associated with synthetic nanomaterials. We investigate bioengineered OMVs for contrast enhancement in optoacoustic (photoacoustic) imaging. We produce OMVs encapsulating biopolymer-melanin (OMVMel) using a bacterial strain expressing a tyrosinase transgene. Our results show that upon near-infrared light irradiation, OMVMel generates strong optoacoustic signals appropriate for imaging applications. In addition, we show that OMVMel builds up intense heat from the absorbed laser energy and mediates photothermal effects both in vitro and in vivo. Using multispectral optoacoustic tomography, we noninvasively monitor the spatio-temporal, tumour-associated OMVMel distribution in vivo. This work points to the use of bioengineered vesicles as potent alternatives to synthetic particles more commonly employed for optoacoustic imaging, with the potential to enable both image enhancement and photothermal applications.

Maximum Entropy Based Non-Negative Optoacoustic Tomographic Image Reconstruction

OBJECTIVE

Optoacoustic (photoacoustic) tomography is aimed at reconstructing maps of the initial pressure rise induced by the absorption of light pulses in tissue. In practice, due to inaccurate assumptions in the forward model, noise, and other experimental factors, the images are often afflicted by artifacts, occasionally manifested as negative values. The aim of this work is to develop an inversion method which reduces the occurrence of negative values and improves the quantitative performance of optoacoustic imaging.

METHODS

We present a novel method for optoacoustic tomography based on an entropy maximization algorithm, which uses logarithmic regularization for attaining non-negative reconstructions. The reconstruction image quality is further improved using structural prior-based fluence correction.

RESULTS

We report the performance achieved by the entropy maximization scheme on numerical simulation, experimental phantoms, and in-vivo samples.

CONCLUSION

The proposed algorithm demonstrates superior reconstruction performance by delivering non-negative pixel values with no visible distortion of anatomical structures.

SIGNIFICANCE

Our method can enable quantitative optoacoustic imaging, and has the potential to improve preclinical and translational imaging applications.

Spatially variant regularization based on model resolution and fidelity embedding characteristics improves photoacoustic tomography

Photoacoustic tomography tends to be an ill-conditioned problem with noisy limited data requiring imposition of regularization constraints, such as standard Tikhonov (ST) or total variation (TV), to reconstruct meaningful initial pressure rise distribution from the tomographic acoustic measurements acquired at the boundary of the tissue. However, these regularization schemes do not account for nonuniform sensitivity arising due to limited detector placement at the boundary of tissue as well as other system parameters. For the first time, two regularization schemes were developed within the Tikhonov framework to address these issues in photoacoustic imaging. The model resolution, based on spatially varying regularization, and fidelity-embedded regularization, based on orthogonality between the columns of system matrix, were introduced. These were systematically evaluated with the help of numerical and in-vivo mice data. It was shown that the performance of the proposed spatially varying regularization schemes were superior (with at least 2 dB or 1.58 times improvement in the signal-to-noise ratio) compared to ST-/TV-based regularization schemes.

Enhancing sparse-view photoacoustic tomography with combined virtually parallel projecting and spatially adaptive filtering

To fully realize the potential of photoacoustic tomography (PAT) in preclinical and clinical applications, rapid measurements and robust reconstructions are needed. Sparse-view measurements have been adopted effectively to accelerate the data acquisition. However, since the reconstruction from the sparse-view sampling data is challenging, both the effective measurement and the appropriate reconstruction should be taken into account. In this study, we present an iterative sparse-view PAT reconstruction scheme, where a concept of virtual parallel-projection matching the measurement condition is introduced to aid the "compressive sensing" in the reconstruction procedure, and meanwhile, the non-local spatially adaptive filtering exploring the a priori information of the mutual similarities in natural images is adopted to recover the unknowns in the transformed sparse domain. Consequently, the reconstructed images with the proposed sparse-view scheme can be evidently improved in comparison to those with the universal back-projection method, for the cases of same sparse views. The proposed approach has been validated by the simulations and ex vivo experiments, which exhibits desirable performances in image fidelity even from a small number of measuring positions.

Nonlinear optoacoustic readings from diffusive media at near-infrared wavelengths

Optoacoustic (photoacoustic) imaging assumes that the detected signal varies linearly with laser energy. However, nonlinear intensity responses as a function of light fluence have been suggested in optoacoustic microscopy, that is, within the first millimeter of tissue. In this study, we explore the presence of nonlinearity deeper in tissue (~4 mm), as it relates to optoacoustic mesoscopy, and investigate the fluence required to delineate a switch from linear to nonlinear behavior. Optoacoustic signal nonlinearity is studied for different materials, different wavelengths and as a function of changes in the scattering and absorption coefficient of the medium imaged. We observe fluence thresholds in the mJ/cm² range and preliminary find that different materials may exhibit different nonlinearity patterns. We discuss the implications of nonlinearity in relation to image accuracy and quantification in optoacoustic tomography.

Efficient 3-D Model-Based Reconstruction Scheme for Arbitrary Optoacoustic Acquisition Geometries

Optimal optoacoustic tomographic sampling is often hindered by the frequency-dependent directivity of ultrasound sensors, which can only be accounted for with an accurate 3-D model. Herein, we introduce a 3-D model-based reconstruction method applicable to optoacoustic imaging systems employing detection elements with arbitrary size and shape. The computational complexity and memory requirements are mitigated by introducing an efficient graphic processing unit (GPU)-based implementation of the iterative inversion. On-the-fly calculation of the entries of the model-matrix via a small look-up table avoids otherwise unfeasible storage of matrices typically occupying more than 300GB of memory. Superior imaging performance of the suggested method with respect to standard optoacoustic image reconstruction methods is first validated quantitatively using tissue-mimicking phantoms. Significant improvements in the spatial resolution, contrast to noise ratio and overall 3-D image quality are also reported in real tissues by imaging the finger of a healthy volunteer with a hand-held volumetric optoacoustic imaging system.