Enhanced contrast acoustic-resolution photoacoustic microscopy using double-stage delay-multiply-and-sum beamformer for vasculature imaging

Enhanced resolution and sensitivity acoustic-resolution photoacoustic microscopy with semi/unsupervised GANs

Acoustic-resolution photoacoustic microscopy (AR-PAM) enables visualization of biological tissues at depths of several millimeters with superior optical absorption contrast. However, the lateral resolution and sensitivity of AR-PAM are generally lower than those of optical-resolution PAM (OR-PAM) owing to the intrinsic physical acoustic focusing mechanism. Here, we demonstrate a computational strategy with two generative adversarial networks (GANs) to perform semi/unsupervised reconstruction with high resolution and sensitivity in AR-PAM by maintaining its imaging capability at enhanced depths. The b-scan PAM images were prepared as paired (for semi-supervised conditional GAN) and unpaired (for unsupervised CycleGAN) groups for label-free reconstructed AR-PAM b-scan image generation and training. The semi/unsupervised GANs successfully improved resolution and sensitivity in a phantom and in vivo mouse ear test with ground truth. We also confirmed that GANs could enhance resolution and sensitivity of deep tissues without the ground truth.

Restoring the imaging quality of circular transducer array-based PACT using synthetic aperture focusing technique integrated with 2nd-derivative-based back projection scheme

Circular-array-based photoacoustic computed tomography (CA-PACT) is a promising imaging tool owing to its broad acoustic detection coverage and fidelity. However, CA-PACT suffers from poor image quality outside the focal zone along both elevational and lateral dimensions. To address this challenge, we proposed a novel reconstruction strategy by integrating the synthetic aperture focusing technique (SAFT) with the 2nd derivative-based back projection (2nd D-BP) algorithm to restore the image quality outside the focal zone along both the elevational and lateral axes. The proposed solution is a two-phase reconstruction scheme. In the first phase, with the assistance of an acoustic lens, we designed a circular array-based SAFT algorithm to restore the resolution and SNR along the elevational axis. The acoustic lens pushes the boundary of the upper limit of the SAFT scheme to achieve enhanced elevational resolution. In the second phase, we proposed a 2nd D-BP scheme to improve the lateral resolution and suppress noises in 3D imaging results. The 2nd D-BP strategy enhances the image quality along the lateral dimension by up-converting the high spatial frequencies of the object's absorption pattern. We validated the effectiveness of the proposed strategy using both phantoms and in vivo human experiments. The experimental results demonstrated superior image quality (7-fold enhancement in elevational resolution, 3-fold enhancement in lateral resolution, and an 11-dB increase in SNR). This strategy provides a new paradigm in the PACT system as it significantly enhances the spatial resolution and imaging contrast in both the elevational and lateral dimensions while maintaining a large focal zone.

Energy compensated synthetic aperture focusing technique for photoacoustic microscopy

We report an adaptive energy-compensated synthetic aperture focusing technique (eC-SAFT) for improving the imaging performance of photoacoustic microscopy (PAM) in terms of depth of field (DOF), spatial resolution (both axial and lateral), and SNR. In addition to coherency and time-delay (in conventional SAFT), our beamforming-based reconstruction algorithm takes into account acoustic energy loss-a primary physical parameter in acoustic wave propagation-following Beer-Lambert's law. Experimental validation studies were performed in tissue-mimicking (Agar) phantoms, complex leaf veins, and chicken breast tissues. Results demonstrate that our proposed eC-SAFT+CF outperforms conventional SAFT+CF to improve axial resolution (up to ∼ 5 % ), lateral resolution (up to ∼ 5 % ), SNR (up to ∼ 6 % ) and CR (up to ∼ 8 % ).

Improving photoacoustic imaging in low signal-to-noise ratio by using spatial and polarity coherence

To suppress the noise and sidelobe of photoacoustic images, a method is proposed combined with spatial coherence and polarity coherence. In this method, PA signals are delayed, multiplied, then performed polarity coherence, and finally summed. The polarity of delayed-and-multiplied signals rather than the amplitude is considered in polarity coherence operation. The polarity coherence factor is calculated based on the standard deviation of the polarity. Then, the factor as weights is applied to the coherent sum output after spatial autocorrelation to finally obtain the image. The simulated and experimental results prove that the noise level can be effectively suppressed due to its relatively low polarity coherence factor. Compared with the delay-and-sum method, the quantitative results in simulations show that the image contrast and full-width at half-maximum of the proposed method increase by about 227.0 % and 56.5 % when the signal-to-noise ratio of the raw signal is 0 dB, respectively. Besides achieving a better image contrast, this method obtains improvements in sidelobe attenuation and has a narrow main lobe.

Achieving depth-independent lateral resolution in AR-PAM using the synthetic-aperture focusing technique

Acoustic-resolution photoacoustic microscopy (AR-PAM) is a promising imaging modality that renders images with ultrasound resolution and extends the imaging depth beyond the optical ballistic regime. To achieve a high lateral resolution, a large numerical aperture (NA) of a focused transducer is usually applied for AR-PAM. However, AR-PAM fails to hold its performance in the out-of-focus region. The lateral resolution and signal-to-noise ratio (SNR) degrade substantially, thereby leading to a significantly deteriorated image quality outside the focal area. Based on the concept of the synthetic-aperture focusing technique (SAFT), various strategies have been developed to address this challenge. These include 1D-SAFT, 2D-SAFT, adaptive-SAFT, spatial impulse response (SIR)-based schemes, and delay-multiply-and-sum (DMAS) strategies. These techniques have shown progress in achieving depth-independent lateral resolution, while several challenges remain. This review aims to introduce these developments in SAFT-based approaches, highlight their fundamental mechanisms, underline the advantages and limitations of each approach, and discuss the outlook of the remaining challenges for future advances.

Performance comparison of high-speed photoacoustic microscopy: opto-ultrasound combiner versus ring-shaped ultrasound transducer

Photoacoustic microscopy (PAM) embedded with a 532 nm pulse laser is widely used to visualize the microvascular structures in both small animals and humans in vivo. An opto-ultrasound combiner (OUC) is often utilized in high-speed PAM to confocally align the optical and acoustic beams to improve the system's sensitivity. However, acoustic impedance mismatch in the OUC results in little improvement in the sensitivity. Alternatively, a ring-shaped ultrasound transducer (RUT) can also accomplish the confocal configuration. Here, we compare the performance of OUC and RUT modules through ultrasound pulse-echo tests and PA imaging experiments. The signal-to-noise ratios (SNRs) of the RUT-based system were 15 dB, 12 dB, and 7 dB higher when compared to the OUC-based system for ultrasound pulse-echo test, PA phantom imaging test, and PA in-vivo imaging test, respectively. In addition, the RUT-based system could image the microvascular structures of small parts of a mouse body in a few seconds with minimal loss in SNR. Thus, with increased sensitivity, improved image details, and fast image acquisition, we believe the RUT-based systems could play a significant role in the design of future fast-PAM systems.

Super-Resolution Photoacoustic Microscopy Using Structured-Illumination

A novel super-resolution volumetric photoacoustic microscopy, based on the theory of structured-illumination, is proposed in this paper. The structured-illumination will be introduced in order to surpass the diffraction limit in a photoacoustic microscopy (PAM) structure. Through optical excitation of the targeted object with a sinusoidal spatial fringe pattern, the object's frequency spectrum is forced to shift in the spatial frequency domain. The shifting in the desired direction leads to the passage of the high-frequency contents of the object through the passband of the acoustic diffraction frequency response. Finally, combining the low-frequency image with the high-frequency parts in four regular orientations in the spatial frequency domain is equivalent to imaging the targeted object with an imaging system of two-fold bandwidth and thus half lateral resolution. In order to obtain the image of out-of-focus regions and improve the lateral resolution outside the focal region of a PAM imaging system, Fourier-domain reconstruction algorithm based on the synthetic aperture focusing technique (SAFT) using the virtual detector concept is utilized for reduction in the required computational load and time. The performance of the proposed imaging system is validated with in vivo and ex vivo targets. The experimental results obtained from several tungsten filaments in the depth range of 1.2 mm, show an improvement of -6 dB lateral resolution from 55- [Formula: see text] to 25- [Formula: see text] and also an improvement of signal-to-noise ratio (SNR) from 16-22 dB to 27-33 dB in the proposed system.

Photoacoustic tomography reconstruction using lag-based delay multiply and sum with a coherence factor improves in vivo ovarian cancer diagnosis

Ovarian cancer is the fifth most common cause of death due to cancer, and it is the deadliest of all gynecological cancers. Diagnosing ovarian cancer via conventional photoacoustic delay-and-sum beamforming (DAS) presents several challenges, such as poor image resolution and low lesion to background tissue contrast. To address these concerns, we propose an improved beamformer named lag-based delay multiply and sum combined with coherence factor (DMAS-LAG-CF). Simulations and phantom experiments demonstrate that compared with the conventional DAS, the proposed algorithm can provide 1.39 times better resolution and 10.77 dB higher contrast. For patient data, similar performance on contrast ratios has been observed. However, since the diagnostic accuracy between cancer and benign/normal groups is a significant measure, we have extracted photoacoustic histogram features of mean, kurtosis and skewness. DMAS-LAG-CF can improve cancer diagnosis with an AUC of 0.91 for distinguishing malignant vs. benign ovarian lesions when mean and skewness are used as features.

Motion-compensated noninvasive periodontal health monitoring using handheld and motor-based photoacoustic-ultrasound imaging systems

Simultaneous visualization of the teeth and periodontium is of significant clinical interest for image-based monitoring of periodontal health. We recently reported the application of a dual-modality photoacoustic-ultrasound (PA-US) imaging system for resolving periodontal anatomy and periodontal pocket depths in humans. This work utilized a linear array transducer attached to a stepper motor to generate 3D images via maximum intensity projection. This prior work also used a medical head immobilizer to reduce artifacts during volume rendering caused by motion from the subject (e.g., breathing, minor head movements). However, this solution does not completely eliminate motion artifacts while also complicating the imaging procedure and causing patient discomfort. To address this issue, we report the implementation of an image registration technique to correctly align B-mode PA-US images and generate artifact-free 2D cross-sections. Application of the deshaking technique to PA phantoms revealed 80% similarity to the ground truth when shaking was intentionally applied during stepper motor scans. Images from handheld sweeps could also be deshaken using an LED PA-US scanner. In ex vivo porcine mandibles, pigmentation of the enamel was well-estimated within 0.1 mm error. The pocket depth measured in a healthy human subject was also in good agreement with our prior study. This report demonstrates that a modality-independent registration technique can be applied to clinically relevant PA-US scans of the periodontium to reduce operator burden of skill and subject discomfort while showing potential for handheld clinical periodontal imaging.

Beamforming for large-area scan and improved SNR in array-based photoacoustic microscopy

Beamforming enhances the performance of array-based photoacoustic microscopy (PAM) systems for large-area scan. In this study, we quantify the imaging performance of a large field-of-view optical-resolution photoacoustic-microscopy system using an phased-array detector. The system combines a low-cost pulsed-laser diode with a 128-element linear ultrasound probe. Signal-to-noise ratio (SNR) and generalized contrast-to-noise ratio (gCNR) are quantified using the phased-array detector and applying three beamforming strategies: a no-beamforming method equivalent to a single-element flat transducer, a fixed focus beamforming method that mimics a single-element focused transducer, and a dynamic focus beamforming using a delay-and-sum (DAS) algorithm. The imaging capabilities of the system are demonstrated generating high-resolution images of tissue-mimicking phantoms containing sub-millimetre ink tubes and an ex vivo rabbit's ear. The results show that dynamic focus DAS beamforming increases and homogenizes SNR along 1-cm² images, reaching values up to 15 dB compared to an unfocused detector and up to 30 dB compared to out-of-focus regions of the fixed focus configuration. Moreover, the obtained values of gCNR using the DAS beamformer indicate an excellent target visibility, both on phantoms and ex vivo. This strategy makes it possible to scan larger surfaces compared to standard configurations using single-element detectors, paving the way for advanced array-based PAM systems.

Another decade of photoacoustic imaging

Photoacoustic imaging - a hybrid biomedical imaging modality finding its way to clinical practices. Although the photoacoustic phenomenon was known more than a century back, only in the last two decades it has been widely researched and used for biomedical imaging applications. In this review we focus on the development and progress of the technology in the last decade (2010-2020). From becoming more and more user friendly, cheaper in cost, portable in size, photoacoustic imaging promises a wide range of applications, if translated to clinic. The growth of photoacoustic community is steady, and with several new directions researchers are exploring, it is inevitable that photoacoustic imaging will one day establish itself as a regular imaging system in the clinical practices.

Convolutional neural network for resolution enhancement and noise reduction in acoustic resolution photoacoustic microscopy

In acoustic resolution photoacoustic microscopy (AR-PAM), a high numerical aperture focused ultrasound transducer (UST) is used for deep tissue high resolution photoacoustic imaging. There is a significant degradation of lateral resolution in the out-of-focus region. Improvement in out-of-focus resolution without degrading the image quality remains a challenge. In this work, we propose a deep learning-based method to improve the resolution of AR-PAM images, especially at the out of focus plane. A modified fully dense U-Net based architecture was trained on simulated AR-PAM images. Applying the trained model on experimental images showed that the variation in resolution is ∼10% across the entire imaging depth (∼4 mm) in the deep learning-based method, compared to ∼180% variation in the original PAM images. Performance of the trained network on in vivo rat vasculature imaging further validated that noise-free, high resolution images can be obtained using this method.