High-Speed Integrated Endoscopic Photoacoustic and Ultrasound Imaging System

Unveiling the Potential: A Comprehensive Review of Dynamic Slow-Motion Video Endoscopy for Eustachian Tube Dysfunction Evaluation

Eustachian tube dysfunction (ETD) poses diagnostic challenges due to its complex pathophysiology and varied clinical presentation. Traditional diagnostic methods often lack direct visualization of the Eustachian tube (ET) function, leading to suboptimal evaluation and management. Dynamic slow-motion video endoscopy (DSVE) has emerged as a novel approach to address these limitations, offering real-time visualization of ET dynamics with enhanced clarity and precision. This comprehensive review provides an overview of DSVE as a promising tool for evaluating ETD. We discuss its methodology, clinical applications, comparative analysis with traditional methods, and future directions. Key findings from the literature highlight DSVE's ability to enhance diagnostic accuracy, facilitate targeted treatment strategies, and improve patient outcomes. Integrating DSVE into routine clinical practice holds significant implications for the diagnosis and management of ETD, offering clinicians valuable insights into underlying pathophysiology and guiding personalized treatment interventions. Future research should focus on standardizing DSVE protocols, validating its diagnostic accuracy, and exploring its role in guiding novel treatment modalities. By advancing our understanding of ETD and optimizing diagnostic and therapeutic approaches, DSVE has the potential to revolutionize the management of this common yet challenging otologic condition.

Thin flexible photoacoustic endoscopic probe with a distal-driven micro-step motor for pump-probe-based high-specific molecular imaging

Conventional photoacoustic endoscopy (PAE) is mostly for structural imaging, and its molecular imaging ability is quite limited. In this work, we address this issue and present the development of a flexible acoustic-resolution-based photoacoustic endoscopic (AR-PAE) probe with an outer diameter of 8 mm. This probe is driven by a micro-step motor at the distal end, enabling flexible and precise angular step control to synchronize with the optical parametric oscillator (OPO) lasers. This probe retains the high spatial resolution, high penetration depth, and spectroscopic imaging ability of conventional AR-PAE. Moreover, it is capable for background-free high-specific photoacoustic molecular imaging with a novel pump-probe detection technique, as demonstrated by the distribution visualizing of the FDA approved contrast agent methylene blue (MB) in an ex-vivo pig ileum. This proposed method represents an important technical advancement in multimodal PAE, and can potentially make considerable contributions across various biomedical fields.

Scaling down the dimensions of a Fabry-Perot polymer film acoustic sensor for photoacoustic endoscopy

Significance

A Fabry-Perot (FP) polymer film sensor can be used to detect acoustic waves in a photoacoustic endoscope (PAE) if the dimensions can be adequately scaled down in size. Current FP sensors have limitations in size, sensitivity, and array configurability.

Aim

We aim to characterize and demonstrate the imaging performance of a miniature FP sensor to evaluate the effects of reduced size and finite dimensions.

Approach

A transfer matrix model was developed to characterize the frequency response of a multilayer miniature FP sensor. An analytical model was derived to describe the effects of a substrate with finite thickness. Finite-element analysis was performed to characterize the temporal response of a sensor with finite dimensions. Miniature 2 × 2    mm 2 FP sensors were designed and fabricated using gold films as reflective mirrors on either side of a parylene C film deposited on a glass wafer. A single-wavelength laser was used to interrogate the sensor using illumination delivered by fiber subprobes. Imaging phantoms were used to verify FP sensor performance, and in vivo images of blood vessels were collected from a live mouse.

Results

The finite thickness substrate of the FP sensor resulted in echoes in the time domain signal that could be removed by back filtering. The substrate acted as a filter in the frequency domain. The finite lateral sensor dimensions produced side waves that could be eliminated by surface averaging using an interrogation beam with adequate diameter. The fabricated FP sensor produced a noise-equivalent pressure = 0.76 kPa, bandwidth of 16.6 MHz, a spectral full-width at-half-maximum = 0.2886 nm, and quality factor Q = 2694 . Photoacoustic images were collected from phantoms and blood vessels in a live mouse.

Conclusions

A miniature wafer-based FP sensor design has been demonstrated with scaled down form factor for future use in PAE.

Circular array transducer based-photoacoustic/ultrasonic endoscopic imaging with tunable ring-beam excitation

Photoacoustic/ultrasound endoscopic imaging is regarded as an effective method to achieve accurate detection of intestinal disease by offering both the functional and structural information, simultaneously. Compared to the conventional endoscopy with single transducer and laser spot for signal detection and optical excitation, photoacoustic/ultrasound endoscopic probe using circular array transducer and ring-shaped laser beam avoids the instability brought by the mechanical scanning point-to-point, offering the dual-modality imaging with high accuracy and efficiency. Meanwhile, considering the complex morphological environments of intestinal tracts in clinics, developing the probe having sufficient wide imaging distance range is especially important. In this work, we develop a compact circular photoacoustic/ultrasonic endoscopic probe, using the group of fiber, lens and home-made axicon, to generate relatively concentrated ring-shaped laser beam for 360° excitation with high efficiency. Furthermore, the laser ring size can be tuned conveniently by changing the fiber-lens distance to ensure the potential applicability of the probe in various and complex morphological environments of intestines. Phantom experimental results demonstrate imaging distance range wide enough to cover from 12 mm to 30 mm. In addition, the accessibility of the photoacoustic signals of molecular probes in ex vivo experiments at the tissue depth of 7 mm using excitation energy of 5 mJ has also been demonstrated, showing a high optical excitation efficiency of the probe.

Photoacoustic imaging for microcirculation

Microcirculation facilitates the blood-tissue exchange of nutrients and regulates blood perfusion. It is, therefore, essential in maintaining tissue health. Aberrations in microcirculation are potentially indicative of underlying cardiovascular and metabolic pathologies. Thus, quantitative information about it is of great clinical relevance. Photoacoustic imaging (PAI) is a capable technique that relies on the generation of imaging contrast via the absorption of light and can image at micron-scale resolution. PAI is especially desirable to map microvasculature as hemoglobin strongly absorbs light and can generate a photoacoustic signal. This paper reviews the current state of the art for imaging microvascular networks using photoacoustic imaging. We further describe how quantitative information about blood dynamics such as the total hemoglobin concentration, oxygen saturation, and blood flow rate is obtained using PAI. We also discuss its importance in understanding key pathophysiological processes in neurovascular, cardiovascular, ophthalmic, and cancer research fields. We then discuss the current challenges and limitations of PAI and the approaches that can help overcome these limitations. Finally, we provide the reader with an overview of future trends in the field of PAI for imaging microcirculation.

Acoustic-resolution-based spectroscopic photoacoustic endoscopy towards molecular imaging in deep tissues

Due to many technical difficulties, the study of molecular photoacoustic endoscopic (PAE) imaging in deep tissues is limited. In this work, we have set up a multimodal acoustic-resolution-based PAE (AR-PAE) system to image the rabbit rectum and preliminarily explored the potential of molecular PAE for deep-seated targets in proof-of-concept. We developed an improved back-projection (IBP) algorithm for focused detection over the centimeter-scale imaging depth. We also developed a deep-learning-based algorithm to remove the electrical noise from the step motor to prevent data averaging for reduced scanning time. We injected a dose of indocyanine green (ICG) near the rabbit rectum and compared 2D and 3D photoacoustic/ultrasound (PA/US) images at different wavelengths. We proposed incorporating a small camera to guide the slow PA/US endoscopic scan. Results show that this system has achieved a lateral resolution of about 0.77/0.65 mm for PA/US images with a signal-to-noise ratio (SNR) of 25/38 dB at an imaging depth of 1.4 cm. We found that the rectum wall and the ICG can be well distinguished spectroscopically. Results also show that the PA images at 532 nm have higher signal intensity and reflection artifacts from pelvic tendons and bones than those at longer wavelengths such as 800 nm. The proposed methods and the intuitive findings in this work may guide and promote the development of high-penetration molecular PAE.

A Feasible Multimodal Photoacoustic Imaging Approach for Evaluating the Clinical Symptoms of Inflammatory Arthritis

Numerous traditional medical imaging methods, including computed tomography with X-rays, positron emission tomography (PET), and magnetic resonance imaging (MRI), are utilized frequently in medical settings to screen for illnesses, diagnose patients, and track the effectiveness of treatments. When examining bone protrusions, CT is preferred over MRI for scanning connective tissue. Although the picture quality of PET is inferior to that of CT and MR, it is outstanding for detecting the molecular markers and metabolic functions of illnesses. To give high-resolution structural pictures and improved ailment sensitivity and specificity within another image, multimodal data and substantial therapeutic influence on advanced diagnostics and therapeutics have been used. The goal was to evaluate the clinical significance of multimodal photoacoustic/ultrasound (PA/US) articular imaging scoring, a cutting-edge image technique that may show the microvessels and oxygen levels of rheumatoid arthritis-related inflamed joints (RA). The PA/US imaging technology analyzed seven tiny joints. The PA and power Doppler (PD) impulses were semiquantified using a 0-3 grading scale, and the averages of the PA and PD scores for the seven joints are computed. Three PA+SO2 types were found determined by the relative oxygen levels (SO2) measurements of the affected joints. Researchers evaluated the relationships between the disease activity ratings and the PA/US imaging ratings. The PA scores and medical ratings that reflect the extent of the pain have strong relationships with each other, as do the PA+SO2 combinations. PA may be clinically useful in assessing RA. Thus, the research evaluated the clinical symptoms of inflammatory arthritis using a multimodal photoacoustic image process.

Tapered catheter-based transurethral photoacoustic and ultrasonic endoscopy of the urinary system

Early diagnosis is critical for treating bladder cancer, as this cancer is very aggressive and lethal if detected too late. To address this important clinical issue, a photoacoustic tomography (PAT)-based transabdominal imaging approach was suggested in previous reports, in which its in vivo feasibility was also demonstrated based on a small animal model. However, successful translation of this approach to real clinical settings would be challenging because the human bladder is located at a depth that far exceeds the typical penetration depth of PAT (∼3 cm for in vivo cases). In this study, we developed a tapered catheter-based, transurethral photoacoustic and ultrasonic endoscopic probe with a 2.8 mm outer diameter to investigate whether the well-known benefits of PAT can be harnessed to resolve unmet urological issues, including early diagnosis of bladder cancer. To demonstrate the in vivo imaging capability of the proposed imaging probe, we performed a rabbit model-based urinary system imaging experiment and acquired a 3D microvasculature map distributed in the wall of the urinary system, which is a first in PAT, to the best of our knowledge. We believe that the results strongly support the use of this transurethral imaging approach as a feasible strategy for addressing urological diagnosis issues.

Intra-instrument channel workable, optical-resolution photoacoustic and ultrasonic mini-probe system for gastrointestinal endoscopy

There has been a long-standing expectation that the optical-resolution embodiment of photoacoustic tomography could have a substantial impact on gastrointestinal endoscopy by enabling microscopic visualization of the vasculature based on the endogenous contrast mechanism. Although multiple studies have demonstrated the in vivo imaging capability of a developed imaging device over the last decade, the implementation of such an endoscopic system that can be applied immediately when necessary via the instrument channel of a video endoscope has been a challenge. In this study, we developed a 3.38-mm diameter catheter-based, integrated optical-resolution photoacoustic and ultrasonic mini-probe system and successfully demonstrated its intra-instrument channel workability for the standard 3.7-mm diameter instrument channel of a clinical video endoscope based on a swine model. Through the instrument channel, we acquired the first in vivo dual-mode photoacoustic and ultrasonic endoscopic images from the esophagogastric junction of a swine. Further, in a rat colorectum in vivo imaging experiment, we visualized hierarchically developed mesh-like capillary networks with a hole size as small as ~50 µm, which suggests the potential level of image details that could be photoacoustically provided in clinical settings in the future.

Deep-Learning-Based Algorithm for the Removal of Electromagnetic Interference Noise in Photoacoustic Endoscopic Image Processing

Despite all the expectations for photoacoustic endoscopy (PAE), there are still several technical issues that must be resolved before the technique can be successfully translated into clinics. Among these, electromagnetic interference (EMI) noise, in addition to the limited signal-to-noise ratio (SNR), have hindered the rapid development of related technologies. Unlike endoscopic ultrasound, in which the SNR can be increased by simply applying a higher pulsing voltage, there is a fundamental limitation in leveraging the SNR of PAE signals because they are mostly determined by the optical pulse energy applied, which must be within the safety limits. Moreover, a typical PAE hardware situation requires a wide separation between the ultrasonic sensor and the amplifier, meaning that it is not easy to build an ideal PAE system that would be unaffected by EMI noise. With the intention of expediting the progress of related research, in this study, we investigated the feasibility of deep-learning-based EMI noise removal involved in PAE image processing. In particular, we selected four fully convolutional neural network architectures, U-Net, Segnet, FCN-16s, and FCN-8s, and observed that a modified U-Net architecture outperformed the other architectures in the EMI noise removal. Classical filter methods were also compared to confirm the superiority of the deep-learning-based approach. Still, it was by the U-Net architecture that we were able to successfully produce a denoised 3D vasculature map that could even depict the mesh-like capillary networks distributed in the wall of a rat colorectum. As the development of a low-cost laser diode or LED-based photoacoustic tomography (PAT) system is now emerging as one of the important topics in PAT, we expect that the presented AI strategy for the removal of EMI noise could be broadly applicable to many areas of PAT, in which the ability to apply a hardware-based prevention method is limited and thus EMI noise appears more prominently due to poor SNR.

Photoacoustic imaging of fresh human surgically and endoscopically resected gastrointestinal specimens

Objective

Photoacoustic (PA) imaging is a novel noninvasive technique that offers high‐contrast tomographic imaging with ultrasound‐like resolution at depths of centimeters, enabling visualization of deep small vessels. The aim of this pilot study was to survey the characteristics of deep vessel networks in the mucosa of neoplastic gastrointestinal (GI) lesions using PA imaging.

Methods

Specimens of patients who had undergone surgical and endoscopic resection for GI lesions were included in this study. The PA/ultrasound imaging system for clinical research is characterized by a technology that can superimpose a PA image over an ultrasound image. Three‐dimensional PA images were acquired for the resected specimen before fixation. The stomach and colon of live pigs were incised, and the walls were scanned from the mucosa.

Results

A total of 32 specimens (nine esophageal, 12 gastric, 11 colorectal) were scanned. The pathological diagnoses were adenomas (n = 2), intramucosal cancers (n = 14), and invasive cancers (n = 16). The deep vessel networks of all lesions could be visualized. In the intramucosal lesions, the deep vessel network was similar to that of a normal tissue. In invasive cancers, the thick and prominent vessel network was visible in the surface layer of esophageal cancers, infiltrated area of gastric cancers, and surface layer and infiltrated area of colorectal cancers. In the images of living pigs, visualizing the vascular network deeper than the submucosa in both the stomach and large intestine was possible.

Conclusion

Our study confirmed that the deep vessel networks of neoplastic GI lesions were visible by PA imaging.

Advances in Endoscopic Photoacoustic Imaging

Photoacoustic (PA) imaging is able to provide extremely high molecular contrast while maintaining the superior imaging depth of ultrasound (US) imaging. Conventional microscopic PA imaging has limited access to deeper tissue due to strong light scattering and attenuation. Endoscopic PA technology enables direct delivery of excitation light into the interior of a hollow organ or cavity of the body for functional and molecular PA imaging of target tissue. Various endoscopic PA probes have been developed for different applications, including the intravascular imaging of lipids in atherosclerotic plaque and endoscopic imaging of colon cancer. In this paper, the authors review representative probe configurations and corresponding preclinical applications. In addition, the potential challenges and future directions of endoscopic PA imaging are discussed.

360º optoacoustic capsule endoscopy at 50 Hz for esophageal imaging

Gastrointestinal (GI) endoscopy is a common medical diagnostic procedure used for esophageal cancer detection. Current emerging capsule optoacoustic endoscopes, however, suffer from low pulse repetition rates and slow scanning units limit attainable imaging frame rates. Consequently, motion artifacts result in inaccurate spatial mapping and misinterpretation of data. To overcome these limitations, we report a 360º, 50 Hz frame rate, distal scanning capsule optoacoustic endoscope. The translational capability of the instrument for human GI tract imaging was characterized with an Archimedean spiral phantom consisting of twelve 100 µm sutures, a stainless steel mesh with a pitch of 3 mm and an ex vivo pig esophagus sample. We estimated an imaging penetration depth of ~0.84 mm in vivo by immersing the mesh phantom in intralipid solution to simulate light scattering in human esophageal tissue and validated our findings ex vivo using pig esophagus. This proof-of-concept study demonstrates the translational potential of the proposed video-rate endoscope for human GI tract imaging.

Transparent capacitive micromachined ultrasound transducer linear arrays for combined realtime optical and ultrasonic imaging

Transparent ultrasound transducers could enable many novel applications involving both ultrasonics and optics. Recently, we reported transparent capacitive micromachined ultrasound transducers (CMUTs) and demonstrated through-illumination photoacoustic imaging. This work presents the feasibility of transparent CMUTs for combined ultrasound imaging and through-array white-light imaging with a miniature camera placed behind the array. Transparent CMUT devices are fabricated with an adhesive wafer bonding technique and provide high transparency up to 90% in visible wavelengths. Fabricated linear arrays have a central operating frequency of 9 MHz with 128 active elements. Realtime plane-wave imaging is performed for ultrasound imaging, and lateral and axial resolutions of, respectively, 234 and 338 µm are achieved. Transparent CMUT has demonstrated a high transmit sensitivity of 1.4 kPa/V per channel with a 100 VDC bias voltage. The signal-to-noise ratio for a beamformed image of wire targets is determined to be 28.4 dB. To the best of our knowledge, this is the first report of combined realtime optical and ultrasonic imaging with transparent arrays. This technology may enable one to visually see what is being scanned and scan what one sees without co-registration errors. Future applications could include multi-modality probes for interventional and surgical procedures.

Forward-Looking Multimodal Endoscopic System Based on Optical Multispectral and High-Frequency Ultrasound Imaging Techniques for Tumor Detection

We developed a forward-looking (FL) multimodal endoscopic system that offers color, spectral classified, high-frequency ultrasound (HFUS) B-mode, and integrated backscattering coefficient (IBC) images for tumor detection in situ. Examination of tumor distributions from the surface of the colon to deeper inside is essential for determining a treatment plan of cancer. For example, the submucosal invasion depth of tumors in addition to the tumor distributions on the colon surface is used as an indicator of whether the endoscopic dissection would be operated. Thus, we devised the FL multimodal endoscopic system to offer information on the tumor distribution from the surface to deep tissue with high accuracy. This system was evaluated with bilayer gelatin phantoms which have different properties at each layer of the phantom in a lateral direction. After evaluating the system with phantoms, it was employed to characterize forty human colon tissues excised from cancer patients. The proposed system could allow us to obtain highly resolved chemical, anatomical, and macro-molecular information on excised colon tissues including tumors, thus enhancing the detection of tumor distributions from the surface to deep tissue. These results suggest that the FL multimodal endoscopic system could be an innovative screening instrument for quantitative tumor characterization.

Electrothermal-MEMS-induced nonlinear distortion correction in photoacoustic laparoscopy

Micro-electro-mechanical systems (MEMS) scanner has significant advantages of miniature size, fast response and high stability, which is particularly applicable to photoacoustic laparoscopy (PAL). However, tilt angle-voltage curve of electrothermal MEMS shows a nonlinear character, which leads to inevitable nonlinear distortion in photoacoustic imaging. To overcome this problem, a nonlinear distortion correction was developed for the high-resolution forward-scanning electrothermal-MEMS-based PAL. The adaptive resampling method (ARM) was introduced to adaptively calibrate the projection of non-uniform scanning region to match the uniform scanning region. The correction performed low time complexity and high portability owing to the adaptive capacity of distortion decomposition in the reconstruction of physical models. Compared with the sample structure, phantom experiments demonstrated that the distortion was calibrated in all directions and the corrected image provided up to 96.82% high structural similarity in local subset. Furthermore, ARM was applied to imaging the abdominal cavity of rat and the vascular morphology was corrected in real-time display within a delay less than 2 seconds. All these results demonstrated that the nonlinear distortion correction possessed timely and effective correction in PAL, which suggested that it had the potential to employ to any other electrothermal-MEMS-based photoacoustic imaging systems for accurate and quantitative functional imaging.

Minimally invasive photoacoustic imaging: Current status and future perspectives

Photoacoustic imaging (PAI) is an emerging biomedical imaging modality that is based on optical absorption contrast, capable of revealing distinct spectroscopic signatures of tissue at high spatial resolution and large imaging depths. However, clinical applications of conventional non-invasive PAI systems have been restricted to examinations of tissues at depths less than a few cm due to strong light attenuation. Minimally invasive photoacoustic imaging (miPAI) has greatly extended the landscape of PAI by delivering excitation light within tissue through miniature fibre-optic probes. In the past decade, various miPAI systems have been developed with demonstrated applicability in several clinical fields. In this article, we present an overview of the current status of miPAI and our thoughts on future perspectives.

Characterizing intestinal strictures of Crohn's disease in vivo by endoscopic photoacoustic imaging

Crohn's disease (CD) is one type of inflammatory bowel disease where both inflammation and fibrosis cause the thickening of the bowel wall and development of the strictures. Accurate assessment of the strictures is critical for the management of CD because the fibrotic strictures must be removed surgically. In this study, a prototype capsule-shaped acoustic resolution photoacoustic (PA) endoscope, which can perform mulitwavelength side-view scanning, was developed to characterize the intestinal strictures of CD. The imaging performance of the probe was tested in phantom experiments and a rabbit trinitrobenzene sulfonic acid (TNBS) model with acute (inflammatory only) or chronic (mixed fibrotic and inflammatory) colitis in vivo. The motion artifacts due to intestinal peristalsis and the respiratory motion of the animals were compensated to improve image qualities. Quantitative molecular component images derived from multi-wavelength PA measurements of normal, acute and chronic intestinal strictures demonstrated statistically significant differences among the three groups that were confirmed by histopathology. A longitudinal study demonstrated the capability of the system in monitoring the development of fibrosis. The results suggest that the proposed novel, capsule-shaped acoustic resolution PA endoscope can be used to characterize fibrostenotic disease in vivo.

Multimodal endoscopy for colorectal cancer detection by optical coherence tomography and near-infrared fluorescence imaging

While colonoscopy is the gold standard for diagnosis and classification of colorectal cancer (CRC), its sensitivity and specificity are operator-dependent and are especially poor for small and flat lesions. Contemporary imaging modalities, such as optical coherence tomography (OCT) and near-infrared (NIR) fluorescence, have been investigated to visualize microvasculature and morphological changes for detecting early stage CRC in the gastrointestinal (GI) tract. In our study, we developed a multimodal endoscopic system with simultaneous co-registered OCT and NIR fluorescence imaging. By introducing a contrast agent into the vascular network, NIR fluorescence is able to highlight the cancer-suspected area based on significant change of tumor vascular density and morphology caused by angiogenesis. With the addition of co-registered OCT images to reveal subsurface tissue layer architecture, the suspected regions can be further investigated by the altered light scattering resulting from the morphological abnormality. Using this multimodal imaging system, an in vivo animal study was performed using a F344-ApcPircUwm rat, in which the layered architecture and microvasculature of the colorectal wall at different time points were demonstrated. The co-registered OCT and NIR fluorescence images allowed the identification and differentiation of normal colon, hyperplastic polyp, adenomatous polyp, and adenocarcinoma. This multimodal imaging strategy using a single imaging probe has demonstrated the enhanced capability of identification and classification of CRC compared to using any of these technologies alone, thus has the potential to provide a new clinical tool to advance gastroenterology practice.