Optoacoustic image formation approaches-a clinical perspective

Advances in photoacoustic imaging aided by nano contrast agents: special focus on role of lymphatic system imaging for cancer theranostics

Photoacoustic imaging (PAI) is a successful clinical imaging platform for management of cancer and other health conditions that has seen significant progress in the past decade. However, clinical translation of PAI based methods are still under scrutiny as the imaging quality and clinical information derived from PA images are not on par with other imaging methods. Hence, to improve PAI, exogenous contrast agents, in the form of nanomaterials, are being used to achieve better image with less side effects, lower accumulation, and improved target specificity. Nanomedicine has become inevitable in cancer management, as it contributes at every stage from diagnosis to therapy, surgery, and even in the postoperative care and surveillance for recurrence. Nanocontrast agents for PAI have been developed and are being explored for early and improved cancer diagnosis. The systemic stability and target specificity of the nanomaterials to render its theranostic property depends on various influencing factors such as the administration route and physico-chemical responsiveness. The recent focus in PAI is on targeting the lymphatic system and nodes for cancer diagnosis, as they play a vital role in cancer progression and metastasis. This review aims to discuss the clinical advancements of PAI using nanoparticles as exogenous contrast agents for cancer theranostics with emphasis on PAI of lymphatic system for diagnosis, cancer progression, metastasis, PAI guided tumor resection, and finally PAI guided drug delivery.

Limited view correction in low-optical-NA photoacoustic microscopy

Photoacoustic microscope (PAM) with a low-optical NA suffers from a limited view along the optical axis, due to the coherent cancellation of acoustic pressure waves after being excited with a smoothly focused beam. Using larger-NA (NA > 0.3) objectives can readily overcome the limited-view problem, while the consequences are the shallow working distance and time-consuming depth scanning for large-volume imaging. Instead, we report an off-axis oblique detection strategy that is compatible with a low-optical-NA PAM for turning up the optical-axis structures. Comprehensive photoacoustic modeling and ex vivo phantom and in vivo mouse brain imaging experiments are conducted to validate the efficacy of correcting the limited view. Proof-of-concept experiment results show that the visibility of optical-axis structures can be greatly enhanced by making the detection angle off the optical axis larger than 45°, strongly recommending that off-axis oblique detection is a simple and cost-effective alternative method to solve the limited-view problems in low-optical-NA PAMs.

Full-view LED-based optoacoustic tomography

Optoacoustic tomography is commonly performed with bulky and expensive short-pulsed solid-state lasers providing high per-pulse energies in the millijoule range. Light emitting diodes (LEDs) represent a cost-effective and portable alternative for optoacoustic signal excitation that can additionally provide excellent pulse-to-pulse stability. Herein, we introduce a full-view LED-based optoacoustic tomography (FLOAT) system for deep tissue in vivo imaging. It is based on a custom-made electronic unit driving a stacked array of LEDs, which attains 100 ns pulse width and highly stable (0.62 % standard deviation) total per-pulse energy of 0.48 mJ. The illumination source is integrated into a circular array of cylindrically-focused ultrasound detection elements to result in a full-view tomographic configuration, which plays a critical role in circumventing limited-view effects, enhancing the effective field-of-view and image quality for cross-sectional (2D) imaging. We characterized the FLOAT performance in terms of pulse width, power stability, excitation light distribution, signal-to-noise and penetration depth. FLOAT of the human finger revealed a comparable imaging performance to that achieved with the standard pulsed Nd:YAG laser. It is anticipated that this compact, affordable and versatile illumination technology will facilitate optoacoustic imaging developments in resource-limited settings for biological and clinical applications.

Photoacoustic imaging for characterization of radiofrequency ablated cardiac tissues

Photoacoustic (PA) imaging is an emerging technique being explored for various clinical applications. PA imaging offers a portable, inexpensive, stand-alone modality for evaluating optical contrast agents. PA signals are well-correlated with tissue physical parameters and can quantify various physiological variables (e.g., oxygenation of hemoglobin). Moreover, radiofrequency (RF) ablation is a promising treatment for certain cardiac arrhythmias. Assessment of RF-ablated lesions is of clinical importance. The purpose of this study is to elaborate the PA imaging to characterize RF-ablated cardiac tissues. Specifically, we describe the application of PA imaging to identify, characterize, and quantify cardiac RF lesions, highlighting the fundamental principles and unique benefits of this optical imaging technique. Potential future clinical application of PA imaging that reveals additional information about structural damage in RF-treated cardiac tissue are also anticipated.

Looking deep inside tissue with photoacoustic molecular probes: a review

Significance

Deep tissue noninvasive high-resolution imaging with light is challenging due to the high degree of light absorption and scattering in biological tissue. Photoacoustic imaging (PAI) can overcome some of the challenges of pure optical or ultrasound imaging to provide high-resolution deep tissue imaging. However, label-free PAI signals from light absorbing chromophores within the tissue are nonspecific. The use of exogeneous contrast agents (probes) not only enhances the imaging contrast (and imaging depth) but also increases the specificity of PAI by binding only to targeted molecules and often providing signals distinct from the background.

Aim

We aim to review the current development and future progression of photoacoustic molecular probes/contrast agents.

Approach

First, PAI and the need for using contrast agents are briefly introduced. Then, the recent development of contrast agents in terms of materials used to construct them is discussed. Then, various probes are discussed based on targeting mechanisms, in vivo molecular imaging applications, multimodal uses, and use in theranostic applications.

Results

Material combinations are being used to develop highly specific contrast agents. In addition to passive accumulation, probes utilizing activation mechanisms show promise for greater controllability. Several probes also enable concurrent multimodal use with fluorescence, ultrasound, Raman, magnetic resonance imaging, and computed tomography. Finally, targeted probes are also shown to aid localized and molecularly specific photo-induced therapy.

Conclusions

The development of contrast agents provides a promising prospect for increased contrast, higher imaging depth, and molecularly specific information. Of note are agents that allow for controlled activation, explore other optical windows, and enable multimodal use to overcome some of the shortcomings of label-free PAI.

High frame rate (∼3 Hz) circular photoacoustic tomography using single-element ultrasound transducer aided with deep learning

SIGNIFICANCE

In circular scanning photoacoustic tomography (PAT), it takes several minutes to generate an image of acceptable quality, especially with a single-element ultrasound transducer (UST). The imaging speed can be enhanced by faster scanning (with high repetition rate light sources) and using multiple-USTs. However, artifacts arising from the sparse signal acquisition and low signal-to-noise ratio at higher scanning speeds limit the imaging speed. Thus, there is a need to improve the imaging speed of the PAT systems without hampering the quality of the PAT image.

AIM

To improve the frame rate (or imaging speed) of the PAT system by using deep learning (DL).

APPROACH

For improving the frame rate (or imaging speed) of the PAT system, we propose a novel U-Net-based DL framework to reconstruct PAT images from fast scanning data.

RESULTS

The efficiency of the network was evaluated on both single- and multiple-UST-based PAT systems. Both phantom and in vivo imaging demonstrate that the network can improve the imaging frame rate by approximately sixfold in single-UST-based PAT systems and by approximately twofold in multi-UST-based PAT systems.

CONCLUSIONS

We proposed an innovative method to improve the frame rate (or imaging speed) by using DL and with this method, the fastest frame rate of ∼ 3    Hz imaging is achieved without hampering the quality of the reconstructed image.

Photoacoustic computational ghost imaging

Photoacoustic imaging with optical resolution usually requires a single-pixel raster scan. An alternative approach based on illumination with patterns obtained from a Hadamard matrix, measurement of the generated ultrasound wave with a single detector, followed by a reconstruction known from computational ghost imaging is demonstrated here. Since many pixels on the object are illuminated at the same time, thereby contributing to the recorded signal, this approach gives a better contrast-to-noise ratio compared to the raster scan, as demonstrated in a phantom experiment. Furthermore, exploiting the temporal information for depth-resolved imaging is possible. The proposed method will be beneficial in situations where the radiant exposure of a sample is limited due to either safety precautions or the properties of the available light source.

Deep-learning-based multi-transducer photoacoustic tomography imaging without radius calibration

Pulsed laser diodes are used in photoacoustic tomography (PAT) as excitation sources because of their low cost, compact size, and high pulse repetition rate. In combination with multiple single-element ultrasound transducers (SUTs) the imaging speed of PAT can be improved. However, during PAT image reconstruction, the exact radius of each SUT is required for accurate reconstruction. Here we developed a novel deep learning approach to alleviate the need for radius calibration. We used a convolutional neural network (fully dense U-Net) aided with a convolutional long short-term memory block to reconstruct the PAT images. Our analysis on the test set demonstrates that the proposed network eliminates the need for radius calibration and improves the peak signal-to-noise ratio by ∼73% without compromising the image quality. In vivo imaging was used to verify the performance of the network.

Deep learning of image- and time-domain data enhances the visibility of structures in optoacoustic tomography

Images rendered with common optoacoustic system implementations are often afflicted with distortions and poor visibility of structures, hindering reliable image interpretation and quantification of bio-chrome distribution. Among the practical limitations contributing to artifactual reconstructions are insufficient tomographic detection coverage and suboptimal illumination geometry, as well as inability to accurately account for acoustic reflections and speed of sound heterogeneities in the imaged tissues. Here we developed a convolutional neural network (CNN) approach for enhancement of optoacoustic image quality which combines training on both time-resolved signals and tomographic reconstructions. Reference human finger data for training the CNN were recorded using a full-ring array system that provides optimal tomographic coverage around the imaged object. The reconstructions were further refined with a dedicated algorithm that minimizes acoustic reflection artifacts induced by acoustically mismatch structures, such as bones. The combined methodology is shown to outperform other learning-based methods solely operating on image-domain data.

Optoacoustic imaging of the skin

Optoacoustic (OA, photoacoustic) imaging capitalizes on the synergistic combination of light excitation and ultrasound detection to empower biological and clinical investigations with rich optical contrast while effectively bridging the gap between micro and macroscopic imaging realms. State-of-the-art OA embodiments consistently provide images at micron-scale resolution through superficial tissue layers by means of focused illumination that can be smoothly exchanged for acoustic-resolution images at diffuse light depths of several millimetres to centimetres via ultrasound beamforming or tomographic reconstruction. Taken together, this unique multi-scale imaging capacity opens unprecedented capabilities for high-resolution in vivo interrogations of the skin at scalable depths. Moreover, diverse anatomical and functional information is retrieved via dynamic mapping of endogenous chromophores such as haemoglobin, melanin, lipids, collagen, water and others. This, along with the use of non-ionizing radiation, facilitates a clinical translation of the OA modalities. We review recent progress in OA imaging of the skin in preclinical and clinical studies exploiting the rich contrast provided by endogenous substances in tissues. The imaging capabilities of existing approaches are discussed in the context of initial translational studies on skin cancer, inflammatory skin diseases, wounds and other conditions.

Axial accuracy and signal enhancement in acoustic-resolution photoacoustic microscopy by laser jitter effect correction and pulse energy compensation

In recent years, photoacoustic imaging has found vast applications in biomedical imaging. Photoacoustic imaging has high optical contrast and high ultrasound resolution allowing deep tissue non-invasive imaging beyond the optical diffusion limit. Q-switched lasers are extensively used in photoacoustic imaging due to the availability of high energy and short laser pulses, which are essential for high-resolution photoacoustic imaging. In most cases, this type of light source suffers from pulse peak-power energy variations and timing jitter noise, resulting in uncertainty in the output power and arrival time of the laser pulses. These problems cause intensity degradation and temporal displacement of generated photoacoustic signals which in turn deteriorate the quality of the acquired photoacoustic images. In this study, we used a high-speed data acquisition system in combination with a fast photodetector and a software-based approach to capture laser pulses precisely in order to reduce the effect of timing jitter and normalization of the photoacoustic signals based on pulse peak-powers simultaneously. In the experiments, maximum axial accuracy enhancement of 14 µm was achieved in maximum-amplitude projected images on XZ and YZ planes with ±13.5 ns laser timing jitter. Furthermore, photoacoustic signal enhancement of 77% was obtained for 75% laser pulses peak-power stability.

Imaging technology of the lymphatic system

The lymphatic system plays critical roles in tissue fluid homeostasis and immunity and has been implicated in the development of many different pathologies, ranging from lymphedema, the spread of cancer to chronic inflammation. In this review, we first summarize the state-of-the-art of lymphatic imaging in the clinic and the advantages and disadvantages of these existing techniques. We then detail recent progress on imaging technology, including advancements in tracer design and injection methods, that have allowed visualization of lymphatic vessels with excellent spatial and temporal resolution in preclinical models. Finally, we describe the different approaches to quantifying lymphatic function that are being developed and discuss some emerging topics for lymphatic imaging in the clinic. Continued advancements in lymphatic imaging technology will be critical for the optimization of diagnostic methods for lymphatic disorders and the evaluation of novel therapies targeting the lymphatic system.

Another decade of photoacoustic imaging

Photoacoustic imaging - a hybrid biomedical imaging modality finding its way to clinical practices. Although the photoacoustic phenomenon was known more than a century back, only in the last two decades it has been widely researched and used for biomedical imaging applications. In this review we focus on the development and progress of the technology in the last decade (2010-2020). From becoming more and more user friendly, cheaper in cost, portable in size, photoacoustic imaging promises a wide range of applications, if translated to clinic. The growth of photoacoustic community is steady, and with several new directions researchers are exploring, it is inevitable that photoacoustic imaging will one day establish itself as a regular imaging system in the clinical practices.

Deep learning approach to improve tangential resolution in photoacoustic tomography

In circular scan photoacoustic tomography (PAT), the axial resolution is spatially invariant and is limited by the bandwidth of the detector. However, the tangential resolution is spatially variant and is dependent on the aperture size of the detector. In particular, the tangential resolution improves with the decreasing aperture size. However, using a detector with a smaller aperture reduces the sensitivity of the transducer. Thus, large aperture size detectors are widely preferred in circular scan PAT imaging systems. Although several techniques have been proposed to improve the tangential resolution, they have inherent limitations such as high cost and the need for customized detectors. Herein, we propose a novel deep learning architecture to counter the spatially variant tangential resolution in circular scanning PAT imaging systems. We used a fully dense U-Net based convolutional neural network architecture along with 9 residual blocks to improve the tangential resolution of the PAT images. The network was trained on the simulated datasets and its performance was verified by experimental in vivo imaging. Results show that the proposed deep learning network improves the tangential resolution by eight folds, without compromising the structural similarity and quality of image.

Compressed Optoacoustic Sensing of Volumetric Cardiac Motion

The recently developed optoacoustic tomography systems have attained volumetric frame rates exceeding 100 Hz, thus opening up new venues for studying previously invisible biological dynamics. Further gains in temporal resolution can potentially be achieved via partial data acquisition, though a priori knowledge on the acquired data is essential for rendering accurate reconstructions using compressed sensing approaches. In this work, we suggest a machine learning method based on principal component analysis for high-frame-rate volumetric cardiac imaging using only a few tomographic optoacoustic projections. The method is particularly effective for discerning periodic motion, as demonstrated herein by non-invasive imaging of a beating mouse heart. A training phase enables efficiently compressing the heart motion information, which is subsequently used as prior information for image reconstruction from sparse sampling at a higher frame rate. It is shown that image quality is preserved with a 64-fold reduction in the data flow. We demonstrate that, under certain conditions, the volumetric motion could effectively be captured by relying on time-resolved data from a single optoacoustic detector. Feasibility of capturing transient (non-periodic) events not registered in the training phase is further demonstrated by visualizing perfusion of a contrast agent in vivo. The suggested approach can be used to significantly boost the temporal resolution of optoacoustic imaging and facilitate development of more affordable and data efficient systems.

Multifocal structured illumination optoacoustic microscopy

Optoacoustic (OA) imaging has the capacity to effectively bridge the gap between macroscopic and microscopic realms in biological imaging. High-resolution OA microscopy has so far been performed via point-by-point scanning with a focused laser beam, thus greatly restricting the achievable imaging speed and/or field of view. Herein we introduce multifocal structured illumination OA microscopy (MSIOAM) that attains real-time 3D imaging speeds. For this purpose, the excitation laser beam is shaped to a grid of focused spots at the tissue surface by means of a beamsplitting diffraction grating and a condenser and is then scanned with an acousto-optic deflector operating at kHz rates. In both phantom and in vivo mouse experiments, a 10 mm wide volumetric field of view was imaged with 15 Hz frame rate at 28 μm spatial resolution. The proposed method is expected to greatly aid in biological investigations of dynamic functional, kinetic, and metabolic processes across multiple scales.

In vivo detection of venous sinus distension due to intracranial hypotension in small animal using pulsed-laser-diode photoacoustic tomography

Intracranial hypotension (IH) is a pathophysiological condition of reduced intracranial pressure caused by low cerebrospinal fluid (CSF) volume due to dural injuries from lumbar puncture, surgery, or trauma. Understanding the prognosis of IH in small animal models is important to gain insights on the complications associated with it such as orthostatic headache, cerebral venous thrombosis, coma, and so forth. Photoacoustic tomography (PAT) offers a novel and cost-effective way to perceive and detect IH in small animal models. In this study, a pulsed laser diode (PLD)-based PAT imaging system was used to examine the changes in the venous sinuses of the rat brain due to IH, induced through CSF extraction. After the CSF extraction, an increase in the sagittal sinus area by ~30% and width by 40% ± 5% was observed. These results provide supportive evidence that the PLD-PAT can be employed for detecting changes in sagittal sinus due to IH in rat model.

In vivo optoacoustic monitoring of percutaneous laser ablation of tumors in a murine breast cancer model

Laser ablation (LA) is a promising approach for minimally invasive cancer treatments. Its in vivo applicability is often impeded by the lack of efficient monitoring tools that can help to minimize collateral tissue damage and aid in determining the optimal treatment end-points. We have devised a new, to the best of our knowledge, hybrid LA approach combining simultaneous volumetric optoacoustic (OA) imaging to monitor the lesion progression accurately in real time and 3D. Time-lapse imaging of laser ablation of solid tumors was performed in a murine breast cancer model in vivo by irradiation of subcutaneous tumors with a 100 mJ short-pulsed (${\sim}{5}\;{\rm ns}$∼5ns) laser operating at 1064 nm and 100 Hz pulse repetition frequency. Local changes in the OA signal intensity ascribed to structural alterations in the tumor vasculature were clearly observed, while the OA volumetric projections recorded in vivo appeared to correlate with cross sections of the excised tumors.