In Vivo Demonstration of Photoacoustic Image Guidance and Robotic Visual Servoing for Cardiac Catheter-Based Interventions

Diagnostic and therapeutic optical imaging in cardiovascular diseases

Cardiovascular disease (CVD) is one of the most prevalent health threats globally. Traditional diagnostic methods for CVDs, including electrocardiography, ultrasound, and cardiac magnetic resonance imaging, have inherent limitations in real-time monitoring and high-resolution visualization of cardiovascular pathophysiology. In recent years, optical imaging technology has gained considerable attention as a non-invasive, high-resolution, real-time monitoring solution in the study and diagnosis of CVD. This review discusses the latest advancements, and applications of optical techniques in cardiac imaging. We compare the advantages of optical imaging over traditional modalities and especially scrutinize techniques such as optical coherence tomography, photoacoustic imaging, and fluorescence imaging. We summarize their investigations in atherosclerosis, myocardial infarction, and heart valve disease, etc. Additionally, we discuss challenges like deep-tissue imaging and high spatiotemporal resolution adjustment, and review existing solutions such as multimodal integration, artificial intelligence, and enhanced optical probes. This article aims to drive further development in optical imaging technologies to provide more precise and efficient tools for early diagnosis, pathological mechanism exploration, and treatment of CVD.

Robotically steerable intraluminal imaging probe with side-viewing 3D photoacoustic computed tomography

This Letter presents, for the first time to our knowledge, a continuum robotic-steered endoluminal volumetric photoacoustic tomography probe. With regard to the design of the probe, a coaxial optical and acoustic imaging system has been developed that employs a custom designed piezoelectric micromachined ultrasonic transducer (PMUT). The dimensions of the system are constrained within a cylindrical housing with a diameter of 12 mm and a length of 30 mm. In regard to the robot design, the motion capabilities of the continuum robot have been successfully modeled and characterized. Based on the proposed system, the potential for early detection and screening of gastrointestinal cancers through phantoms has been validated. The experimental results demonstrate that the robotic-assisted photoacoustic system performs well in localizing unknown lesions and characterizing deep-seated abnormalities, exhibiting promising clinical applications.

Cardiac-gated spectroscopic photoacoustic imaging for ablation-induced necrotic lesion visualization

Radiofrequency (RF) ablation is a minimally invasive therapy for atrial fibrillation. Conventional RF procedures lack intraoperative monitoring of ablation-induced necrosis, complicating assessment of completeness. While spectroscopic photoacoustic (sPA) imaging shows promise in distinguishing ablated tissue, multi-spectral imaging is challenging in vivo due to low imaging quality caused by motion. Here, we introduce a cardiac-gated sPA imaging (CG-sPA) framework to enhance image quality using a motion-gated averaging filter, relying on image similarity. Necrotic extent was calculated based on the ratio between spectral unmixed ablated tissue contrast and total tissue contrast, visualizing as a continuous color map to highlight necrotic area. The validation of the concept was conducted in both ex vivo and in vivo swine models. The ablation-induced necrotic lesion was successfully detected throughout the cardiac cycle through CG-sPA imaging. The results suggest the CG-sPA imaging framework has great potential to be incorporated into clinical workflow to guide ablation procedures intraoperatively.

Split-based elevational localization of photoacoustic guidewire tip by 1D array probe using spatial impulse response

Objective. Photoacoustic emitters on the tip of a therapeutic device have been intensively studied for echo-guided intervention purposes. In this study, a novel method for localizing the guidewire tip emitter in the elevation direction using a 1D array probe is proposed to resolve the issue of the tip potentially deviating from the ultrasound-imaged plane.Approach. Our method uses the 'interference split' that appears when the emitter is off-plane. Here, a point source from the emitter splits into two points in images. Based on the split, 'split-based elevation localization (SEL)' is introduced to estimate the absolute elevation position of the emitter. Additionally, 'Signed SEL' incorporates an asymmetric feature into the 1D probe to obtain the sign of the elevation localization. An attenuative coupler is attached to the half side of the probe to control the interference split. In SEL and Signed SEL, we propose a modeled split matching (MSM) algorithm to localize the tip position. MSM performs pattern matching of a measured split waveform with modeled split waveforms corresponding to all emitter positions in a region of interest. The modeled waveforms are precalculated using the spatial impulse response. The proposed method is numerically and experimentally validated.Main results. Numerical simulations for time-domain wave propagation clearly demonstrated the interference split phenomena. In the experimental validation with a vessel-mimicking phantom, the proposed methods successfully estimated the elevation positions,yb.SEL exhibited a root-mean-squared error (RMSE) of 2.0 mm for the range of 0 mm ≤yb≤ 30 mm, while Signed SEL estimated the absolute position with an RMSE of 2.4 mm and the sign with an accuracy of 80.8% for the range of -30 mm ≤yb≤ 30 mm.Significance.These results suggest that the proposed method could provide approximate tip positions and help sonographers track it by fanning the probe.

Deep learning in vivo catheter tip locations for photoacoustic-guided cardiac interventions

Significance

Interventional cardiac procedures often require ionizing radiation to guide cardiac catheters to the heart. To reduce the associated risks of ionizing radiation, photoacoustic imaging can potentially be combined with robotic visual servoing, with initial demonstrations requiring segmentation of catheter tips. However, typical segmentation algorithms applied to conventional image formation methods are susceptible to problematic reflection artifacts, which compromise the required detectability and localization of the catheter tip.

Aim

We describe a convolutional neural network and the associated customizations required to successfully detect and localize in vivo photoacoustic signals from a catheter tip received by a phased array transducer, which is a common transducer for transthoracic cardiac imaging applications.

Approach

We trained a network with simulated photoacoustic channel data to identify point sources, which appropriately model photoacoustic signals from the tip of an optical fiber inserted in a cardiac catheter. The network was validated with an independent simulated dataset, then tested on data from the tips of cardiac catheters housing optical fibers and inserted into ex vivo and in vivo swine hearts.

Results

When validated with simulated data, the network achieved an F 1 score of 98.3% and Euclidean errors (mean ± one standard deviation) of 1.02 ± 0.84    mm for target depths of 20 to 100 mm. When tested on ex vivo and in vivo data, the network achieved F 1 scores as large as 100.0%. In addition, for target depths of 40 to 90 mm in the ex vivo and in vivo data, up to 86.7% of axial and 100.0% of lateral position errors were lower than the axial and lateral resolution, respectively, of the phased array transducer.

Conclusions

These results demonstrate the promise of the proposed method to identify photoacoustic sources in future interventional cardiology and cardiac electrophysiology applications.

Laparoscopic Photoacoustic Imaging System Based on Side-Illumination Diffusing Fibers

OBJECTIVE

To develop a flexible miniaturized photoacoustic (PA) imaging probe for detecting anatomical structures during laparoscopic surgery. The proposed probe aimed to facilitate intraoperative detection of blood vessels and nerve bundles embedded in tissue not directly visible to the operating physician to preserve these delicate and vital structures.

METHODS

We modified a commercially available ultrasound laparoscopic probe by incorporating custom-fabricated side-illumination diffusing fibers that illuminate the probe's field of view. The probe geometry, including the position and orientation of the fibers and the emission angle, was determined using computational models of light propagation in the simulation and subsequently validated through experimental studies.

RESULTS

In wire phantom studies within an optical scattering medium, the probe achieved an imaging resolution of 0.43 ±0.09 mm and a signal-to-noise ratio of 31.2±1.84 dB. We also conducted an ex vivo study using a rat model, demonstrating the successful detection of blood vessels and nerves.

CONCLUSION

Our results indicate the viability of a side-illumination diffusing fiber PA imaging system for guidance during laparoscopic surgery.

SIGNIFICANCE

The potential clinical translation of this technology could enhance the preservation of critical vascular structures and nerves, thereby minimizing post-operative complications.

Handheld interventional ultrasound/photoacoustic puncture needle navigation based on deep learning segmentation

Interventional ultrasound (US) has challenges in accurate localization of the puncture needle due to intrinsic acoustic interferences, which lead to blurred, indistinct, and even invisible needles in handheld linear array transducer-based US navigation, especially the incorrect needle tip positioning. Photoacoustic (PA) imaging can provide complementary image contrast, without additional data acquisition. Herein, we proposed an internal illumination to solely light up the needle tip in PA imaging. Then deep-learning-based feature segmentation alleviates acoustic interferences, enhancing the needle shaft-tip visibility. Further, needle shaft-tip compensation aligned the needle shaft in US image and the needle tip in the PA image. The experiments on phantom, ex vivo chicken breast, preclinical radiofrequency ablation and in vivo biopsy of sentinel lymph nodes were piloted. The target registration error can reach the submillimeter level, achieving precise puncture needle tracking ability with in-plane US/PA navigation.

Intraoperative laparoscopic photoacoustic image guidance system in the da Vinci surgical system

This paper describes a framework allowing intraoperative photoacoustic (PA) imaging integrated into minimally invasive surgical systems. PA is an emerging imaging modality that combines the high penetration of ultrasound (US) imaging with high optical contrast. With PA imaging, a surgical robot can provide intraoperative neurovascular guidance to the operating physician, alerting them of the presence of vital substrate anatomy invisible to the naked eye, preventing complications such as hemorrhage and paralysis. Our proposed framework is designed to work with the da Vinci surgical system: real-time PA images produced by the framework are superimposed on the endoscopic video feed with an augmented reality overlay, thus enabling intuitive three-dimensional localization of critical anatomy. To evaluate the accuracy of the proposed framework, we first conducted experimental studies in a phantom with known geometry, which revealed a volumetric reconstruction error of 1.20 ± 0.71 mm. We also conducted an ex vivo study by embedding blood-filled tubes into chicken breast, demonstrating the successful real-time PA-augmented vessel visualization onto the endoscopic view. These results suggest that the proposed framework could provide anatomical and functional feedback to surgeons and it has the potential to be incorporated into robot-assisted minimally invasive surgical procedures.

Niche preclinical and clinical applications of photoacoustic imaging with endogenous contrast

In the past decade, photoacoustic (PA) imaging has attracted a great deal of popularity as an emergent diagnostic technology owing to its successful demonstration in both preclinical and clinical arenas by various academic and industrial research groups. Such steady growth of PA imaging can mainly be attributed to its salient features, including being non-ionizing, cost-effective, easily deployable, and having sufficient axial, lateral, and temporal resolutions for resolving various tissue characteristics and assessing the therapeutic efficacy. In addition, PA imaging can easily be integrated with the ultrasound imaging systems, the combination of which confers the ability to co-register and cross-reference various features in the structural, functional, and molecular imaging regimes. PA imaging relies on either an endogenous source of contrast (e.g., hemoglobin) or those of an exogenous nature such as nano-sized tunable optical absorbers or dyes that may boost imaging contrast beyond that provided by the endogenous sources. In this review, we discuss the applications of PA imaging with endogenous contrast as they pertain to clinically relevant niches, including tissue characterization, cancer diagnostics/therapies (termed as theranostics), cardiovascular applications, and surgical applications. We believe that PA imaging's role as a facile indicator of several disease-relevant states will continue to expand and evolve as it is adopted by an increasing number of research laboratories and clinics worldwide.

Flexible array transducer for photoacoustic-guided interventions: phantom and ex vivo demonstrations

Photoacoustic imaging has demonstrated recent promise for surgical guidance, enabling visualization of tool tips during surgical and non-surgical interventions. To receive photoacoustic signals, most conventional transducers are rigid, while a flexible array is able to deform and provide complete contact on surfaces with different geometries. In this work, we present photoacoustic images acquired with a flexible array transducer in multiple concave shapes in phantom and ex vivo bovine liver experiments targeted toward interventional photoacoustic applications. We validate our image reconstruction equations for known sensor geometries with simulated data, and we provide empirical elevation field-of-view, target position, and image quality measurements. The elevation field-of-view was 6.08 mm at a depth of 4 cm and greater than 13 mm at a depth of 5 cm. The target depth agreement with ground truth ranged 98.35-99.69%. The mean lateral and axial target sizes when imaging 600 μm-core-diameter optical fibers inserted within the phantoms ranged 0.98-2.14 mm and 1.61-2.24 mm, respectively. The mean ± one standard deviation of lateral and axial target sizes when surrounded by liver tissue were 1.80±0.48 mm and 2.17±0.24 mm, respectively. Contrast, signal-to-noise, and generalized contrast-to-noise ratios ranged 6.92-24.42 dB, 46.50-67.51 dB, and 0.76-1, respectively, within the elevational field-of-view. Results establish the feasibility of implementing photoacoustic-guided surgery with a flexible array transducer.

Photoacoustic imaging for characterization of radiofrequency ablated cardiac tissues

Photoacoustic (PA) imaging is an emerging technique being explored for various clinical applications. PA imaging offers a portable, inexpensive, stand-alone modality for evaluating optical contrast agents. PA signals are well-correlated with tissue physical parameters and can quantify various physiological variables (e.g., oxygenation of hemoglobin). Moreover, radiofrequency (RF) ablation is a promising treatment for certain cardiac arrhythmias. Assessment of RF-ablated lesions is of clinical importance. The purpose of this study is to elaborate the PA imaging to characterize RF-ablated cardiac tissues. Specifically, we describe the application of PA imaging to identify, characterize, and quantify cardiac RF lesions, highlighting the fundamental principles and unique benefits of this optical imaging technique. Potential future clinical application of PA imaging that reveals additional information about structural damage in RF-treated cardiac tissue are also anticipated.

Integrated Ultrasound and Photoacoustic-Guided Laser Ablation Theranostic Endoscopic System

Advancements in ablation techniques have paved the way towards the development of safer and more effective clinical procedures for treating various maladies such as atrial fibrillation (AF). AF is characterized by rapid, chaotic atrial activation and is commonly treated using radiofrequency applicators or laser ablation catheters. However, the lack of thermal lesion formation and temperature monitoring capabilities in these devices prevents them from measuring the treatment outcome directly. In addition, poor differentiation between healthy and ablated tissues leads to incomplete ablation, which reduces safety and causes complications in patients. Hence, a novel photoacoustic (PA)-guided laser ablation theranostic device was developed around a traditional phased-array endoscope. The proposed technology provides lesion formation, tissue distinguishing, and temperature monitoring capabilities. Our results have validated the lesion monitoring capability of the proposed technology through PA correlation maps. The tissue distinguishing capability of the theranostic device was verified by the measurable differences in the PA signal between pre-and post-ablated mice myocardial tissue. The increase in the PA signal with temperature variations caused by the ablation laser confirmed the ability of the proposed device to provide temperature feedback.

A Review of Emerging Electromagnetic-Acoustic Sensing Techniques for Healthcare Monitoring

Conventional electromagnetic (EM) sensing techniques such as radar and LiDAR are widely used for remote sensing, vehicle applications, weather monitoring, and clinical monitoring. Acoustic techniques such as sonar and ultrasound sensors are also used for consumer applications, such as ranging and in vivo medical/healthcare applications. It has been of long-term interest to doctors and clinical practitioners to realize continuous healthcare monitoring in hospitals and/or homes. Physiological and biopotential signals in real-time serve as important health indicators to predict and prevent serious illness. Emerging electromagnetic-acoustic (EMA) sensing techniques synergistically combine the merits of EM sensing with acoustic imaging to achieve comprehensive detection of physiological and biopotential signals. Further, EMA enables complementary fusion sensing for challenging healthcare settings, such as real-world long-term monitoring of treatment effects at home or in remote environments. This article reviews various examples of EMA sensing instruments, including implementation, performance, and application from the perspectives of circuits to systems. The novel and significant applications to healthcare are discussed. Three types of EMA sensors are presented: (1) Chip-based radar sensors for health status monitoring, (2) Thermo-acoustic sensing instruments for biomedical applications, and (3) Photoacoustic (PA) sensing and imaging systems, including dedicated reconstruction algorithms were reviewed from time-domain, frequency-domain, time-reversal, and model-based solutions. The future of EMA techniques for continuous healthcare with enhanced accuracy supported by artificial intelligence (AI) is also presented.

Dual-wavelength photoacoustic atlas method to estimate fractional methylene blue and hemoglobin contents

SIGNIFICANCE

Methylene blue (MB) is an exogenous contrast agent that has the potential to assist with visualization and penetration challenges in photoacoustic imaging. However, monitoring the local concentration between MB and endogenous chromophores is critical for avoiding unnecessary MB accumulations that could lead to adverse effects such as hemolysis when exposed to increased dose and photodamage when exposed to high laser energies.

AIM

We developed a modified version of a previously proposed acoustic-based atlas method to estimate concentration levels from a mixture of two photoacoustic-sensitive materials after two laser wavelength emissions.

APPROACH

Photoacoustic data were acquired from mixtures of 100-μM MB and either human or porcine blood (Hb) injected in a plastisol phantom, using laser wavelengths of 710 and 870 nm. An algorithm to perform linear regression of the acoustic frequency response from an atlas composed of pure concentrations was designed to assess the concentration levels from photoacoustic samples obtained from 11 known MB/Hb volume mixtures. The mean absolute error (MAE), coefficient of determination (i.e., R2), and Spearman's correlation coefficient (i.e., ρ) between the estimated results and ground-truth labels were calculated to assess the algorithm performance, linearity, and monotonicity, respectively.

RESULTS

The overall MAE, R2, and ρ were 12.68%, 0.80, and 0.89, respectively, for the human Hb dataset and 9.92%, 0.86, and 0.93, respectively, for the porcine Hb dataset. In addition, a similarly linear relationship was observed between the acoustic frequency response at 2.3 MHz and 870-nm laser wavelength and the ground-truth concentrations, with R2 and | ρ | values of 0.76 and 0.88, respectively.

CONCLUSIONS

Contrast agent concentration monitoring is feasible with the proposed approach. The potential for minimal data acquisition times with only two wavelength emissions is advantageous toward real-time implementation in the operating room.

Theoretical Framework to Predict Generalized Contrast-to-Noise Ratios of Photoacoustic Images With Applications to Computer Vision

The successful integration of computer vision, robotic actuation, and photoacoustic imaging to find and follow targets of interest during surgical and interventional procedures requires accurate photoacoustic target detectability. This detectability has traditionally been assessed with image quality metrics, such as contrast, contrast-to-noise ratio, and signal-to-noise ratio (SNR). However, predicting target tracking performance expectations when using these traditional metrics is difficult due to unbounded values and sensitivity to image manipulation techniques like thresholding. The generalized contrast-to-noise ratio (gCNR) is a recently introduced alternative target detectability metric, with previous work dedicated to empirical demonstrations of applicability to photoacoustic images. In this article, we present theoretical approaches to model and predict the gCNR of photoacoustic images with an associated theoretical framework to analyze relationships between imaging system parameters and computer vision task performance. Our theoretical gCNR predictions are validated with histogram-based gCNR measurements from simulated, experimental phantom, ex vivo, and in vivo datasets. The mean absolute errors between predicted and measured gCNR values ranged from 3.2 ×10^-3 to 2.3 ×10^-2 for each dataset, with channel SNRs ranging -40 to 40 dB and laser energies ranging 0.07 [Formula: see text] to 68 mJ. Relationships among gCNR, laser energy, target and background image parameters, target segmentation, and threshold levels were also investigated. Results provide a promising foundation to enable predictions of photoacoustic gCNR and visual servoing segmentation accuracy. The efficiency of precursory surgical and interventional tasks (e.g., energy selection for photoacoustic-guided surgeries) may also be improved with the proposed framework.

Neural Network Kalman Filtering for 3-D Object Tracking From Linear Array Ultrasound Data

Many interventional surgical procedures rely on medical imaging to visualize and track instruments. Such imaging methods not only need to be real time capable but also provide accurate and robust positional information. In ultrasound (US) applications, typically, only 2-D data from a linear array are available, and as such, obtaining accurate positional estimation in three dimensions is nontrivial. In this work, we first train a neural network, using realistic synthetic training data, to estimate the out-of-plane offset of an object with the associated axial aberration in the reconstructed US image. The obtained estimate is then combined with a Kalman filtering approach that utilizes positioning estimates obtained in previous time frames to improve localization robustness and reduce the impact of measurement noise. The accuracy of the proposed method is evaluated using simulations, and its practical applicability is demonstrated on experimental data obtained using a novel optical US imaging setup. Accurate and robust positional information is provided in real time. Axial and lateral coordinates for out-of-plane objects are estimated with a mean error of 0.1 mm for simulated data and a mean error of 0.2 mm for experimental data. The 3-D localization is most accurate for elevational distances larger than 1 mm, with a maximum distance of 6 mm considered for a 25-mm aperture.

Deep Learning for Instrumented Ultrasonic Tracking: From Synthetic Training Data to In Vivo Application

Instrumented ultrasonic tracking is used to improve needle localization during ultrasound guidance of minimally invasive percutaneous procedures. Here, it is implemented with transmitted ultrasound pulses from a clinical ultrasound imaging probe, which is detected by a fiber-optic hydrophone integrated into a needle. The detected transmissions are then reconstructed to form the tracking image. Two challenges are considered with the current implementation of ultrasonic tracking. First, tracking transmissions are interleaved with the acquisition of B-mode images, and thus, the effective B-mode frame rate is reduced. Second, it is challenging to achieve an accurate localization of the needle tip when the signal-to-noise ratio is low. To address these challenges, we present a framework based on a convolutional neural network (CNN) to maintain spatial resolution with fewer tracking transmissions and enhance signal quality. A major component of the framework included the generation of realistic synthetic training data. The trained network was applied to unseen synthetic data and experimental in vivo tracking data. The performance of needle localization was investigated when reconstruction was performed with fewer (up to eightfold) tracking transmissions. CNN-based processing of conventional reconstructions showed that the axial and lateral spatial resolutions could be improved even with an eightfold reduction in tracking transmissions. The framework presented in this study will significantly improve the performance of ultrasonic tracking, leading to faster image acquisition rates and increased localization accuracy.

Photoacoustic-guided endovenous laser ablation: Characterization and in vivo canine study

Endovenous laser ablation (EVLA) is a minimally invasive surgical procedure, often guided by ultrasound (US) imaging, for treating venous insufficiencies. US imaging limitations in accurately visualizing the catheter and the lack of a temperature monitoring system can lead to sub-optimal outcomes. An integrated photoacoustic (PA)-guided EVLA system has been previously developed and reported to overcome the shortcomings of US-guided procedure. In this study, we further characterized the system and tested the in vivo utility. In addition, PA thermometry was further explored by compensating the variation of PA signal with temperature with respect to the temperature-dependent absorption of blood and water. In vivo imaging results indicated that the PA-guided EVLA system can provide high contrast and accurate images of the ablation catheter tip overlaid on US images of the background tissue. Additionally, absorption-compensated PA signal amplitudes over a relevant range of temperature were measured and demonstrated.

Combined Ultrasound and Photoacoustic Image Guidance of Spinal Pedicle Cannulation Demonstrated With Intact ex vivo Specimens

OBJECTIVE

Spinal fusion surgeries require accurate placement of pedicle screws in anatomic corridors without breaching bone boundaries. We are developing a combined ultrasound and photoacoustic image guidance system to avoid pedicle screw misplacement and accidental bone breaches, which can lead to nerve damage.

METHODS

Pedicle cannulation was performed on a human cadaver, with co-registered photoacoustic and ultrasound images acquired at various time points during the procedure. Bony landmarks obtained from coherence-based ultrasound images of lumbar vertebrae were registered to post-operative CT images. Registration methods were additionally tested on an ex vivo caprine vertebra.

RESULTS

Locally weighted short-lag spatial coherence (LW-SLSC) ultrasound imaging enhanced the visualization of bony structures with generalized contrast-to-noise ratios (gCNRs) of 0.99 and 0.98-1.00 in the caprine and human vertebrae, respectively. Short-lag spatial coherence (SLSC) and amplitude-based delay-and-sum (DAS) ultrasound imaging generally produced lower gCNRs of 0.98 and 0.84, respectively, in the caprine vertebra and 0.84-0.93 and 0.34-0.99, respectively, in the human vertebrae. The mean ± standard deviation of the area of -6 dB contours created from DAS photoacoustic images acquired with an optical fiber inserted in prepared pedicle holes (i.e., fiber surrounded by cancellous bone) and holes created after intentional breaches (i.e., fiber exposed to cortical bone) was 10.06 ±5.22 mm ² and 2.47 ±0.96 mm ², respectively (p 0.01).

CONCLUSIONS

Coherence-based LW-SLSC and SLSC beamforming improved visualization of bony anatomical landmarks for ultrasound-to-CT registration, while amplitude-based DAS beamforming successfully distinguished photoacoustic signals within the pedicle from less desirable signals characteristic of impending bone breaches.

SIGNIFICANCE

These results are promising to improve visual registration of ultrasound and photoacoustic images with CT images, as well as to assist surgeons with identifying and avoiding impending bone breaches during pedicle cannulation in spinal fusion surgeries.

Subaperture Processing-Based Adaptive Beamforming for Photoacoustic Imaging

Delay-and-sum (DAS) beamformers, when applied to photoacoustic (PA) image reconstruction, produce strong sidelobes due to the absence of transmit focusing. Consequently, DAS PA images are often severely degraded by strong off-axis clutter. For preclinical in vivo cardiac PA imaging, the presence of these noise artifacts hampers the detectability and interpretation of PA signals from the myocardial wall, crucial for studying blood-dominated cardiac pathological information and to complement functional information derived from ultrasound imaging. In this article, we present PA subaperture processing (PSAP), an adaptive beamforming method, to mitigate these image degrading effects. In PSAP, a pair of DAS reconstructed images is formed by splitting the received channel data into two complementary nonoverlapping subapertures. Then, a weighting matrix is derived by analyzing the correlation between subaperture beamformed images and multiplied with the full-aperture DAS PA image to reduce sidelobes and incoherent clutter. We validated PSAP using numerical simulation studies using point target, diffuse inclusion and microvasculature imaging, and in vivo feasibility studies on five healthy murine models. Qualitative and quantitative analysis demonstrate improvements in PAI image quality with PSAP compared to DAS and coherence factor weighted DAS (DAS _CF ). PSAP demonstrated improved target detectability with a higher generalized contrast-to-noise (gCNR) ratio in vasculature simulations where PSAP produces 19.61% and 19.53% higher gCNRs than DAS and DAS _CF , respectively. Furthermore, PSAP provided higher image contrast quantified using contrast ratio (CR) (e.g., PSAP produces 89.26% and 11.90% higher CR than DAS and DAS _CF in vasculature simulations) and improved clutter suppression.

Enhancement of in vivo cardiac photoacoustic signal specificity using spatiotemporal singular value decomposition

SIGNIFICANCE

Photoacoustic imaging (PAI) can be used to infer molecular information about myocardial health non-invasively in vivo using optical excitation at ultrasonic spatial resolution. For clinical and preclinical linear array imaging systems, conventional delay-and-sum (DAS) beamforming is typically used. However, DAS cardiac PA images are prone to artifacts such as diffuse quasi-static clutter with temporally varying noise-reducing myocardial signal specificity. Typically, multiple frame averaging schemes are utilized to improve the quality of cardiac PAI, which affects the spatial and temporal resolution and reduces sensitivity to subtle PA signal variation. Furthermore, frame averaging might corrupt myocardial oxygen saturation quantification due to the presence of natural cardiac wall motion. In this paper, a spatiotemporal singular value decomposition (SVD) processing algorithm is proposed to reduce DAS PAI artifacts and subsequent enhancement of myocardial signal specificity.

AIM

Demonstrate enhancement of PA signals from myocardial tissue compared to surrounding tissues and blood inside the left-ventricular (LV) chamber using spatiotemporal SVD processing with electrocardiogram (ECG) and respiratory signal (ECG-R) gated in vivo murine cardiac PAI.

APPROACH

In vivo murine cardiac PAI was performed by collecting single wavelength (850 nm) photoacoustic channel data on eight healthy mice. A three-dimensional (3D) volume of complex PAI data over a cardiac cycle was reconstructed using a custom ECG-R gating algorithm and DAS beamforming. Spatiotemporal SVD was applied on a two-dimensional Casorati matrix generated using the 3D volume of PAI data. The singular value spectrum (SVS) was then filtered to remove contributions from diffuse quasi-static clutter and random noise. Finally, SVD processed beamformed images were derived using filtered SVS and inverse SVD computations.

RESULTS

Qualitative comparison with DAS and minimum variance (MV) beamforming shows that SVD processed images had better myocardial signal specificity, contrast, and target detectability. DAS, MV, and SVD images were quantitatively evaluated by calculating contrast ratio (CR), generalized contrast-to-noise ratio (gCNR), and signal-to-noise ratio (SNR). Quantitative evaluations were done at three cardiac time points (during systole, at end-systole (ES), and during diastole) identified from co-registered ultrasound M-Mode image. Mean CR, gCNR, and SNR values of SVD images at ES were 245, 115.15, and 258.17 times higher than DAS images with statistical significance evaluated with one-way analysis of variance.

CONCLUSIONS

Our results suggest that significantly better-quality images can be realized using spatiotemporal SVD processing for in vivo murine cardiac PAI.

Photoacoustic-guided surgery from head to toe [Invited]

Photoacoustic imaging-the combination of optics and acoustics to visualize differences in optical absorption - has recently demonstrated strong viability as a promising method to provide critical guidance of multiple surgeries and procedures. Benefits include its potential to assist with tumor resection, identify hemorrhaged and ablated tissue, visualize metal implants (e.g., needle tips, tool tips, brachytherapy seeds), track catheter tips, and avoid accidental injury to critical subsurface anatomy (e.g., major vessels and nerves hidden by tissue during surgery). These benefits are significant because they reduce surgical error, associated surgery-related complications (e.g., cancer recurrence, paralysis, excessive bleeding), and accidental patient death in the operating room. This invited review covers multiple aspects of the use of photoacoustic imaging to guide both surgical and related non-surgical interventions. Applicable organ systems span structures within the head to contents of the toes, with an eye toward surgical and interventional translation for the benefit of patients and for use in operating rooms and interventional suites worldwide. We additionally include a critical discussion of complete systems and tools needed to maximize the success of surgical and interventional applications of photoacoustic-based technology, spanning light delivery, acoustic detection, and robotic methods. Multiple enabling hardware and software integration components are also discussed, concluding with a summary and future outlook based on the current state of technological developments, recent achievements, and possible new directions.

Empirical assessment of laser safety for photoacoustic-guided liver surgeries

Photoacoustic imaging is a promising technique to provide guidance during multiple surgeries and procedures. One challenge with this technique is that major blood vessels in the liver are difficult to differentiate from surrounding tissue within current safety limits, which only exist for human skin and eyes. In this paper, we investigate the safety of raising this limit for liver tissue excited with a 750 nm laser wavelength and approximately 30 mJ laser energy (corresponding to approximately 150 mJ/cm² fluence). Laparotomies were performed on six swine to empirically investigate potential laser-related liver damage. Laser energy was applied for temporal durations of 1 minute, 10 minutes, and 20 minutes. Lasered liver lobes were excised either immediately after laser application (3 swine) or six weeks after surgery (3 swine). Cell damage was assessed using liver damage blood biomarkers and histopathology analyses of 41 tissue samples total. The biomarkers were generally normal over a 6 week post-surgical in vivo study period. Histopathology revealed no cell death, although additional pathology was present (i.e., hemorrhage, inflammation, fibrosis) due to handling, sample resection, and fibrous adhesions as a result of the laparotomy. These results support a new protocol for studying laser-related liver damage, indicating the potential to raise the safety limit for liver photoacoustic imaging to approximately 150 mJ/cm² with a laser wavelength of 750 nm and for imaging durations up to 10 minutes without causing cell death. This investigation and protocol may be applied to other tissues and extended to additional wavelengths and energies, which is overall promising for introducing new tissue-specific laser safety limits for photoacoustic-guided surgery.

Spatiotemporal Coherence Weighting for In Vivo Cardiac Photoacoustic Image Beamformation

Photoacoustic (PA) image reconstruction generally utilizes delay-and-sum (DAS) beamforming of received acoustic waves from tissue irradiated with optical illumination. However, nonadaptive DAS reconstructed cardiac PA images exhibit temporally varying noise which causes reduced myocardial PA signal specificity, making image interpretation difficult. Adaptive beamforming algorithms such as minimum variance (MV) with coherence factor (CF) weighting have been previously reported to improve the DAS image quality. In this article, we report on an adaptive beamforming algorithm by extending CF weighting to the temporal domain for preclinical cardiac PA imaging (PAI). The proposed spatiotemporal coherence factor (STCF) considers multiple temporally adjacent image acquisition events during beamforming and cancels out signals with low spatial coherence and temporal coherence, resulting in higher background noise cancellation while preserving the main features of interest (myocardial wall) in the resultant PA images. STCF has been validated using the numerical simulations and in vivo ECG and respiratory-signal-gated cardiac PAI in healthy murine hearts. The numerical simulation results demonstrate that STCF weighting outperforms DAS and MV beamforming with and without CF weighting under different levels of inherent contrast, acoustic attenuation, optical scattering, and signal-to-noise (SNR) of channel data. Performance improvement is attributed to higher sidelobe reduction (at least 5 dB) and SNR improvement (at least 10 dB). Improved myocardial signal specificity and higher signal rejection in the left ventricular chamber and acoustic gel region are observed with STCF in cardiac PAI.

Internal-Illumination Photoacoustic Tomography Enhanced by a Graded-Scattering Fiber Diffuser

The penetration depth of photoacoustic imaging in biological tissues has been fundamentally limited by the strong optical attenuation when light is delivered externally through the tissue surface. To address this issue, we previously reported internal-illumination photoacoustic imaging using a customized radial-emission optical fiber diffuser, which, however, has complex fabrication, high cost, and non-uniform light emission. To overcome these shortcomings, we have developed a new type of low-cost fiber diffusers based on a graded-scattering method in which the optical scattering of the fiber diffuser is gradually increased as the light travels. The graded scattering can compensate for the optical attenuation and provide relatively uniform light emission along the diffuser. We performed Monte Carlo numerical simulations to optimize several key design parameters, including the number of scattering segments, scattering anisotropy factor, divergence angle of the optical fiber, and reflective index of the surrounding medium. These optimized parameters collectively result in uniform light emission along the fiber diffuser and can be flexibly adjusted to accommodate different applications. We fabricated and characterized the prototype fiber diffuser made of agarose gel and intralipid. Equipped with the new fiber diffuser, we performed thorough proof-of-concept studies on ex vivo tissue phantoms and an in vivo swine model to demonstrate the deep-imaging capability (~10 cm achieved ex vivo) of photoacoustic tomography. We believe that the internal light delivery via the optimized fiber diffuser is an effective strategy to image deep targets (e.g., kidney) in large animals or humans.

Photoacoustic Spatial Coherence Theory and Applications to Coherence-Based Image Contrast and Resolution

The photoacoustic effect relies on optical transmission, which causes thermal expansion and generates acoustic signals. Coherence-based photoacoustic signal processing is often preferred over more traditional signal processing methods due to improved signal-to-noise ratios, imaging depth, and resolution in applications such as cell tracking, blood flow estimation, and imaging. However, these applications lack a theoretical spatial coherence model to support their implementation. In this article, the photoacoustic spatial coherence theory is derived to generate theoretical spatial coherence functions. These theoretical spatial coherence functions are compared with k-Wave simulated data and experimental data from point and circular targets (0.1-12 mm in diameter) with generally good agreement, particularly in the shorter spatial lag region. The derived theory was used to hypothesize and test previously unexplored principles for optimizing photoacoustic short-lag spatial coherence (SLSC) images, including the influence of the incident light profile on photoacoustic spatial coherence functions and associated SLSC image contrast and resolution. Results also confirm previous trends from experimental observations, including changes in SLSC image resolution and contrast as a function of the first M lags summed to create SLSC images. For example, small targets (e.g., <1-4 mm in diameter) can be imaged with larger M values to boost target contrast and resolution, and contrast can be further improved by reducing the illuminating beam to a size that is smaller than the target size. Overall, the presented theory provides a promising foundation to support a variety of coherence-based photoacoustic signal processing methods, and the associated theory-based simulation methods are more straightforward than the existing k-Wave simulation methods for SLSC images.

Photoacoustic imaging for surgical guidance: Principles, applications, and outlook

Minimally invasive surgeries often require complicated maneuvers and delicate hand-eye coordination and ideally would incorporate "x-ray vision" to see beyond tool tips and underneath tissues prior to making incisions. Photoacoustic imaging has the potential to offer this feature but not with ionizing x-rays. Instead, optical fibers and acoustic receivers enable photoacoustic sensing of major structures-such as blood vessels and nerves-that are otherwise hidden from view. This imaging process is initiated by transmitting laser pulses that illuminate regions of interest, causing thermal expansion and the generation of sound waves that are detectable with conventional ultrasound transducers. The recorded signals are then converted to images through the beamforming process. Photoacoustic imaging may be implemented to both target and avoid blood-rich surgical contents (and in some cases simultaneously or independently visualize optical fiber tips or metallic surgical tool tips) in order to prevent accidental injury and assist device operators during minimally invasive surgeries and interventional procedures. Novel light delivery systems, counterintuitive findings, and robotic integration methods introduced by the Photoacoustic & Ultrasonic Systems Engineering Lab are summarized in this invited Perspective, setting the foundation and rationale for the subsequent discussion of the author's views on possible future directions for this exciting frontier known as photoacoustic-guided surgery.

GPU implementation of photoacoustic short-lag spatial coherence imaging for improved image-guided interventions

SIGNIFICANCE

Photoacoustic-based visual servoing is a promising technique for surgical tool tip tracking and automated visualization of photoacoustic targets during interventional procedures. However, one outstanding challenge has been the reliability of obtaining segmentations using low-energy light sources that operate within existing laser safety limits.

AIM

We developed the first known graphical processing unit (GPU)-based real-time implementation of short-lag spatial coherence (SLSC) beamforming for photoacoustic imaging and applied this real-time algorithm to improve signal segmentation during photoacoustic-based visual servoing with low-energy lasers.

APPROACH

A 1-mm-core-diameter optical fiber was inserted into ex vivo bovine tissue. Photoacoustic-based visual servoing was implemented as the fiber was manually displaced by a translation stage, which provided ground truth measurements of the fiber displacement. GPU-SLSC results were compared with a central processing unit (CPU)-SLSC approach and an amplitude-based delay-and-sum (DAS) beamforming approach. Performance was additionally evaluated with in vivo cardiac data.

RESULTS

The GPU-SLSC implementation achieved frame rates up to 41.2 Hz, representing a factor of 348 speedup when compared with offline CPU-SLSC. In addition, GPU-SLSC successfully recovered low-energy signals (i.e., ≤268  μJ) with mean ± standard deviation of signal-to-noise ratios of 11.2  ±  2.4 (compared with 3.5  ±  0.8 with conventional DAS beamforming). When energies were lower than the safety limit for skin (i.e., 394.6  μJ for 900-nm wavelength laser light), the median and interquartile range (IQR) of visual servoing tracking errors obtained with GPU-SLSC were 0.64 and 0.52 mm, respectively (which were lower than the median and IQR obtained with DAS by 1.39 and 8.45 mm, respectively). GPU-SLSC additionally reduced the percentage of failed segmentations when applied to in vivo cardiac data.

CONCLUSIONS

Results are promising for the use of low-energy, miniaturized lasers to perform GPU-SLSC photoacoustic-based visual servoing in the operating room with laser pulse repetition frequencies as high as 41.2 Hz.

In Vivo Demonstration of Photoacoustic Image Guidance and Robotic Visual Servoing for Cardiac Catheter-Based Interventions

Cardiac interventional procedures are often performed under fluoroscopic guidance, exposing both the patient and operators to ionizing radiation. To reduce this risk of radiation exposure, we are exploring the use of photoacoustic imaging paired with robotic visual servoing for cardiac catheter visualization and surgical guidance. A cardiac catheterization procedure was performed on two in vivo swine after inserting an optical fiber into the cardiac catheter to produce photoacoustic signals from the tip of the fiber-catheter pair. A combination of photoacoustic imaging and robotic visual servoing was employed to visualize and maintain constant sight of the catheter tip in order to guide the catheter through the femoral or jugular vein, toward the heart. Fluoroscopy provided initial ground truth estimates for 1D validation of the catheter tip positions, and these estimates were refined using a 3D electromagnetic-based cardiac mapping system as the ground truth. The 1D and 3D root mean square errors ranged 0.25-2.28 mm and 1.24-1.54 mm, respectively. The catheter tip was additionally visualized at three locations within the heart: (1) inside the right atrium, (2) in contact with the right ventricular outflow tract, and (3) inside the right ventricle. Lasered regions of cardiac tissue were resected for histopathological analysis, which revealed no laser-related tissue damage, despite the use of 2.98 mJ per pulse at the fiber tip (379.2 mJ/cm² fluence). In addition, there was a 19 dB difference in photoacoustic signal contrast when visualizing the catheter tip pre- and post-endocardial tissue contact, which is promising for contact confirmation during cardiac interventional procedures (e.g., cardiac radiofrequency ablation). These results are additionally promising for the use of photoacoustic imaging to guide cardiac interventions by providing depth information and enhanced visualization of catheter tip locations within blood vessels and within the beating heart.