Intra-instrument channel workable, optical-resolution photoacoustic and ultrasonic mini-probe system for gastrointestinal endoscopy

Simultaneous photoacoustic and ultrasound imaging: A review

Photoacoustic imaging (PAI) is an emerging biomedical imaging technique that combines the advantages of optical and ultrasound imaging, enabling the generation of images with both optical resolution and acoustic penetration depth. By leveraging similar signal acquisition and processing methods, the integration of photoacoustic and ultrasound imaging has introduced a novel hybrid imaging modality suitable for clinical applications. Photoacoustic-ultrasound imaging allows for non-invasive, high-resolution, and deep-penetrating imaging, providing a wealth of image information. In recent years, with the deepening research and the expanding biomedical application scenarios of photoacoustic-ultrasound bimodal systems, the immense potential of photoacoustic-ultrasound bimodal imaging in basic research and clinical applications has been demonstrated, with some research achievements already commercialized. In this review, we introduce the principles, technical advantages, and biomedical applications of photoacoustic-ultrasound bimodal imaging techniques, specifically focusing on tomographic, microscopic, and endoscopic imaging modalities. Furthermore, we discuss the future directions of photoacoustic-ultrasound bimodal imaging technology.

Non-invasive evaluation of endometrial microvessels via in vivo intrauterine photoacoustic endoscopy

The endometrium microvessel system, responsible for supplying oxygen and nutrients to the embryo, holds significant importance in evaluating endometrial receptivity (ER). Visualizing this system directly can significantly enhance ER evaluation. Currently, clinical methods like Narrow-band hysteroscopy and Color Doppler ultrasound are commonly used for uterine blood vessel examination, but they have limitations in depth or resolution. Endoscopic Photoacoustic Imaging (PAE) has proven effective in visualizing microvessels in the digestive tract, while its adaptation to uterine imaging faces challenges due to the uterus's unique physiological characteristics. This paper for the first time that uses high-resolution PAE in vivo to capture a comprehensive network of endometrial microvessels non-invasively. Followed by continuous observation and quantitative analysis in the endometrial injury model, we further corroborated that PAE detection of endometrial microvessels stands as a valuable indicator for evaluating ER. The PAE system showcases its promising potential for integration into reproductive health assessments.

In-vivo assessment of a rat rectal tumor using optical-resolution photoacoustic endoscopy

Optical-resolution photoacoustic endoscopy (OR-PAE) has been proven to realize imaging on the vascular network in the gastrointestinal (GI) tract with high sensitivity and spatial resolution, providing morphological information. Various photoacoustic endoscopic catheters were developed to improve the resolution and adaptivity of in-vivo imaging. However, this technology has not yet been validated on in-vivo GI tumors, which generally feature angiogenesis. The tumor causes thickened mucosa and neoplasia, requiring large depth-of-field (DOF) in imaging, which contradicts to high-resolution imaging. In this work, a novel catheter was developed with a high resolution of ∼27 µm, providing a matched DOF of ∼400 µm to cover the vessels up to the submucosa layer. Optical-resolution photoacoustic endoscopic imaging was first performed on in-vivo rat rectal tumors. In addition, to further characterize the vessel morphology, tumor-suspected regions and normal regions were selected for quantification and analysis of vessel dimension distribution and tortuosity. All the results suggest that the OR-PAE has great application potential in tumor diagnosis, evaluation, and monitoring of therapeutic efficacy.

Multi-Scale Volumetric Dynamic Optoacoustic and Laser Ultrasound (OPLUS) Imaging Enabled by Semi-Transparent Optical Guidance

Major biological discoveries are made by interrogating living organisms with light. However, the limited penetration of un-scattered photons within biological tissues limits the depth range covered by optical methods. Deep-tissue imaging is achieved by combining light and ultrasound. Optoacoustic imaging exploits the optical generation of ultrasound to render high-resolution images at depths unattainable with optical microscopy. Recently, laser ultrasound has been suggested as a means of generating broadband acoustic waves for high-resolution pulse-echo ultrasound imaging. Herein, an approach is proposed to simultaneously interrogate biological tissues with light and ultrasound based on layer-by-layer coating of silica optical fibers with a controlled degree of transparency. The time separation between optoacoustic and ultrasound signals collected with a custom-made spherical array transducer is exploited for simultaneous 3D optoacoustic and laser ultrasound (OPLUS) imaging with a single laser pulse. OPLUS is shown to enable large-scale anatomical characterization of tissues along with functional multi-spectral imaging of chromophores and assessment of cardiac dynamics at ultrafast rates only limited by the pulse repetition frequency of the laser. The suggested approach provides a flexible and scalable means for developing a new generation of systems synergistically combining the powerful capabilities of optoacoustics and ultrasound imaging in biology and medicine.

An umbrella-inspired snap-on robotic 3D photoacoustic endoscopic probe for augmented intragastric sensing: Proof of concept study

In this paper, we present a novel on-demand modular robotic photoacoustic tomography (PAT) probe integrated into an endoscopic device, potentially for deep intragastric sensing. The proposed solution offers a plug-and-play approach through the use of meso-scale steerable endoscopy and a new 'snap-on' 3D robotic PAT probe that can reconfigure the geometry of the intracorporeal light delivery, inspired by an umbrella structure. Specifically, using the limited esophageal access, steerable endoscopy allows navigation and advancement of a distally mounted robotic add-on for PAT that is folded until it reaches the deep-seated gastric lesion. Once the tip is positioned near the lesion site in the gastric cavity, there is ample working space for the robotic probe to adjust its umbrella-like unfolded shape. This allows fine-tuning of the laser delivery orientation of the fiber bundles to achieve the lesion-specific light delivery scheme. This design allows volumetric imaging of the intragastric PAT with enhanced sensitivity. To evaluate the performance of the modular robotic PAT probe, we performed a simulation analysis of the light intensity and ultrasound field distribution. The simulation results show that the robotic probe is feasible for intracorporeal PAT imaging. In addition, we printed a 3D model of a human stomach containing a simulated gastric tumour. Both the phantom and ex vivo experimental results validate the feasibility of the proposed robotic PAT probe.

Photoacoustic imaging plus X: a review

Significance

Photoacoustic (PA) imaging (PAI) represents an emerging modality within the realm of biomedical imaging technology. It seamlessly blends the wealth of optical contrast with the remarkable depth of penetration offered by ultrasound. These distinctive features of PAI hold tremendous potential for various applications, including early cancer detection, functional imaging, hybrid imaging, monitoring ablation therapy, and providing guidance during surgical procedures. The synergy between PAI and other cutting-edge technologies not only enhances its capabilities but also propels it toward broader clinical applicability.

Aim

The integration of PAI with advanced technology for PA signal detection, signal processing, image reconstruction, hybrid imaging, and clinical applications has significantly bolstered the capabilities of PAI. This review endeavor contributes to a deeper comprehension of how the synergy between PAI and other advanced technologies can lead to improved applications.

Approach

An examination of the evolving research frontiers in PAI, integrated with other advanced technologies, reveals six key categories named "PAI plus X." These categories encompass a range of topics, including but not limited to PAI plus treatment, PAI plus circuits design, PAI plus accurate positioning system, PAI plus fast scanning systems, PAI plus ultrasound sensors, PAI plus advanced laser sources, PAI plus deep learning, and PAI plus other imaging modalities.

Results

After conducting a comprehensive review of the existing literature and research on PAI integrated with other technologies, various proposals have emerged to advance the development of PAI plus X. These proposals aim to enhance system hardware, improve imaging quality, and address clinical challenges effectively.

Conclusions

The progression of innovative and sophisticated approaches within each category of PAI plus X is positioned to drive significant advancements in both the development of PAI technology and its clinical applications. Furthermore, PAI not only has the potential to integrate with the above-mentioned technologies but also to broaden its applications even further.

Scaling down the dimensions of a Fabry-Perot polymer film acoustic sensor for photoacoustic endoscopy

Significance

A Fabry-Perot (FP) polymer film sensor can be used to detect acoustic waves in a photoacoustic endoscope (PAE) if the dimensions can be adequately scaled down in size. Current FP sensors have limitations in size, sensitivity, and array configurability.

Aim

We aim to characterize and demonstrate the imaging performance of a miniature FP sensor to evaluate the effects of reduced size and finite dimensions.

Approach

A transfer matrix model was developed to characterize the frequency response of a multilayer miniature FP sensor. An analytical model was derived to describe the effects of a substrate with finite thickness. Finite-element analysis was performed to characterize the temporal response of a sensor with finite dimensions. Miniature 2 × 2    mm 2 FP sensors were designed and fabricated using gold films as reflective mirrors on either side of a parylene C film deposited on a glass wafer. A single-wavelength laser was used to interrogate the sensor using illumination delivered by fiber subprobes. Imaging phantoms were used to verify FP sensor performance, and in vivo images of blood vessels were collected from a live mouse.

Results

The finite thickness substrate of the FP sensor resulted in echoes in the time domain signal that could be removed by back filtering. The substrate acted as a filter in the frequency domain. The finite lateral sensor dimensions produced side waves that could be eliminated by surface averaging using an interrogation beam with adequate diameter. The fabricated FP sensor produced a noise-equivalent pressure = 0.76 kPa, bandwidth of 16.6 MHz, a spectral full-width at-half-maximum = 0.2886 nm, and quality factor Q = 2694 . Photoacoustic images were collected from phantoms and blood vessels in a live mouse.

Conclusions

A miniature wafer-based FP sensor design has been demonstrated with scaled down form factor for future use in PAE.

Hybrid Models for Endoscopy Image Analysis for Early Detection of Gastrointestinal Diseases Based on Fused Features

The gastrointestinal system contains the upper and lower gastrointestinal tracts. The main tasks of the gastrointestinal system are to break down food and convert it into essential elements that the body can benefit from and expel waste in the form of feces. If any organ is affected, it does not work well, which affects the body. Many gastrointestinal diseases, such as infections, ulcers, and benign and malignant tumors, threaten human life. Endoscopy techniques are the gold standard for detecting infected parts within the organs of the gastrointestinal tract. Endoscopy techniques produce videos that are converted into thousands of frames that show the disease's characteristics in only some frames. Therefore, this represents a challenge for doctors because it is a tedious task that requires time, effort, and experience. Computer-assisted automated diagnostic techniques help achieve effective diagnosis to help doctors identify the disease and give the patient the appropriate treatment. In this study, many efficient methodologies for analyzing endoscopy images for diagnosing gastrointestinal diseases were developed for the Kvasir dataset. The Kvasir dataset was classified by three pre-trained models: GoogLeNet, MobileNet, and DenseNet121. The images were optimized, and the gradient vector flow (GVF) algorithm was applied to segment the regions of interest (ROIs), isolating them from healthy regions and saving the endoscopy images as Kvasir-ROI. The Kvasir-ROI dataset was classified by the three pre-trained GoogLeNet, MobileNet, and DenseNet121 models. Hybrid methodologies (CNN-FFNN and CNN-XGBoost) were developed based on the GVF algorithm and achieved promising results for diagnosing disease based on endoscopy images of gastroenterology. The last methodology is based on fused CNN models and their classification by FFNN and XGBoost networks. The hybrid methodology based on the fused CNN features, called GoogLeNet-MobileNet-DenseNet121-XGBoost, achieved an AUC of 97.54%, accuracy of 97.25%, sensitivity of 96.86%, precision of 97.25%, and specificity of 99.48%.

Optical-resolution functional gastrointestinal photoacoustic endoscopy based on optical heterodyne detection of ultrasound

Photoacoustic endoscopy shows promise in the detection of gastrointestinal cancer, inflammation, and other lesions. High-resolution endoscopic imaging of the hemodynamic response necessitates a small-sized, high-sensitivity ultrasound sensor. Here, we utilize a laser ultrasound sensor to develop a miniaturized, optical-resolution photoacoustic endoscope. The sensor can boost the acoustic response by a gain factor of ω_o/Ω (the frequency ratio of the signal light and measured ultrasound) by measuring the acoustically induced optical phase change. As a result, we achieve a noise-equivalent pressure density (NEPD) below 1.5 mPa·Hz^-1/2 over the measured range of 5 to 25 MHz. The heterodyne phase detection using dual-frequency laser beams of the sensor can offer resistance to thermal drift and vibrational perturbations. The endoscope is used to in vivo image a rat rectum and visualize the oxygen saturation changes during acute inflammation, which can hardly be observed with other imaging modalities.

Motion Compensation for 3D Multispectral Handheld Photoacoustic Imaging

Three-dimensional (3D) handheld photoacoustic (PA) and ultrasound (US) imaging performed using mechanical scanning are more useful than conventional 2D PA/US imaging for obtaining local volumetric information and reducing operator dependence. In particular, 3D multispectral PA imaging can capture vital functional information, such as hemoglobin concentrations and hemoglobin oxygen saturation (sO₂), of epidermal, hemorrhagic, ischemic, and cancerous diseases. However, the accuracy of PA morphology and physiological parameters is hampered by motion artifacts during image acquisition. The aim of this paper is to apply appropriate correction to remove the effect of such motion artifacts. We propose a new motion compensation method that corrects PA images in both axial and lateral directions based on structural US information. 3D PA/US imaging experiments are performed on a tissue-mimicking phantom and a human wrist to verify the effects of the proposed motion compensation mechanism and the consequent spectral unmixing results. The structural motions and sO₂ values are confirmed to be successfully corrected by comparing the motion-compensated images with the original images. The proposed method is expected to be useful in various clinical PA imaging applications (e.g., breast cancer, thyroid cancer, and carotid artery disease) that are susceptible to motion contamination during multispectral PA image analysis.

Smartphone-Integrated Photoacoustic Analytical Device for Point-of-Care Testing of Food Contaminant Azodicarbonamide

Azodicarbonamide (ADA) is widely used as a flour additive due to its oxidizing and bleaching properties, but it reacts with wet flour during heat processing and is easily decomposed into semicarbazide with genotoxicity and carcinogenicity. In order to improve the efficiency of food safety supervision and expand the scope of food safety control, it is of great significance to develop a facile method for point-of-care testing (POCT) of ADA. Herein, a field-portable and universal smartphone-based photoacoustic (PA) integration device is constructed for quantitative POCT of ADA in flour. The recognition probe Prussian blue with favorable stability is loaded on a flexible substrate for fabricating a portable test strip. In the presence of target ADA, the PA signal changes driven by a modulated 808 nm laser beam can be conveniently collected through the recording application (Audio Lab) of the smartphone. By combining the economic test strip and portable PA device with smartphone readout, it not only greatly simplifies the operation steps but also dramatically reduces the size and cost of the instrument. There is a favorable linear relationship between the PA signal and ADA concentration in the range of 10-200 μmol L^-1 (R² = 0.9928), and a detection limit of 5 μmol L^-1 obtained is much lower than the maximum allowable ADA level in the extract of flour (388 μmol L^-1). The present miniature PA device with strong POCT ability holds enormous public health significance and economic value in the field of food safety, especially in resource-limited settings.

Tapered catheter-based transurethral photoacoustic and ultrasonic endoscopy of the urinary system

Early diagnosis is critical for treating bladder cancer, as this cancer is very aggressive and lethal if detected too late. To address this important clinical issue, a photoacoustic tomography (PAT)-based transabdominal imaging approach was suggested in previous reports, in which its in vivo feasibility was also demonstrated based on a small animal model. However, successful translation of this approach to real clinical settings would be challenging because the human bladder is located at a depth that far exceeds the typical penetration depth of PAT (∼3 cm for in vivo cases). In this study, we developed a tapered catheter-based, transurethral photoacoustic and ultrasonic endoscopic probe with a 2.8 mm outer diameter to investigate whether the well-known benefits of PAT can be harnessed to resolve unmet urological issues, including early diagnosis of bladder cancer. To demonstrate the in vivo imaging capability of the proposed imaging probe, we performed a rabbit model-based urinary system imaging experiment and acquired a 3D microvasculature map distributed in the wall of the urinary system, which is a first in PAT, to the best of our knowledge. We believe that the results strongly support the use of this transurethral imaging approach as a feasible strategy for addressing urological diagnosis issues.

Photoacoustic/Ultrasound Endoscopic Imaging Reconstruction Algorithm Based on the Approximate Gaussian Acoustic Field

This paper aims to propose a new photoacoustic/ultrasound endoscopic imaging reconstruction algorithm based on the approximate Gaussian acoustic field which significantly improves the resolution and signal-to-noise ratio (SNR) of the out-of-focus region. We demonstrated the method by numerical calculations and investigated the applicability of the algorithm in a chicken breast phantom. The validation was finally performed by the rabbit rectal endoscopy experiment. Simulation results show that the lateral resolution of the target point in the out-of-focus region can be well optimized with this new algorithm. Phantom experimental results show that the lateral resolution of the indocyanine green (ICG) tube in the photoacoustic image is reduced from 3.975 mm to 1.857 mm by using our new algorithm, which is a 52.3% improvement. Ultrasound images also show a significant improvement in lateral resolution. The results of the rabbit rectal endoscopy experiment prove that the algorithm we proposed is capable of providing higher-quality photoacoustic/ultrasound images. In conclusion, the algorithm enables fast acoustic resolution photoacoustic/ ultrasonic dynamic focusing and effectively improves the imaging quality of the system, which has significant guidance for the design of acoustic resolution photoacoustic/ultrasound endoscopy systems.

Deep-Learning-Based Algorithm for the Removal of Electromagnetic Interference Noise in Photoacoustic Endoscopic Image Processing

Despite all the expectations for photoacoustic endoscopy (PAE), there are still several technical issues that must be resolved before the technique can be successfully translated into clinics. Among these, electromagnetic interference (EMI) noise, in addition to the limited signal-to-noise ratio (SNR), have hindered the rapid development of related technologies. Unlike endoscopic ultrasound, in which the SNR can be increased by simply applying a higher pulsing voltage, there is a fundamental limitation in leveraging the SNR of PAE signals because they are mostly determined by the optical pulse energy applied, which must be within the safety limits. Moreover, a typical PAE hardware situation requires a wide separation between the ultrasonic sensor and the amplifier, meaning that it is not easy to build an ideal PAE system that would be unaffected by EMI noise. With the intention of expediting the progress of related research, in this study, we investigated the feasibility of deep-learning-based EMI noise removal involved in PAE image processing. In particular, we selected four fully convolutional neural network architectures, U-Net, Segnet, FCN-16s, and FCN-8s, and observed that a modified U-Net architecture outperformed the other architectures in the EMI noise removal. Classical filter methods were also compared to confirm the superiority of the deep-learning-based approach. Still, it was by the U-Net architecture that we were able to successfully produce a denoised 3D vasculature map that could even depict the mesh-like capillary networks distributed in the wall of a rat colorectum. As the development of a low-cost laser diode or LED-based photoacoustic tomography (PAT) system is now emerging as one of the important topics in PAT, we expect that the presented AI strategy for the removal of EMI noise could be broadly applicable to many areas of PAT, in which the ability to apply a hardware-based prevention method is limited and thus EMI noise appears more prominently due to poor SNR.