Using the shortwave infrared to image middle ear pathologies

Optical coherence tomography otoscope for imaging of tympanic membrane and middle ear pathology

Significance

Pathologies within the tympanic membrane (TM) and middle ear (ME) can lead to hearing loss. Imaging tools available in the hearing clinic for diagnosis and management are limited to visual inspection using the classic otoscope. The otoscopic view is limited to the surface of the TM, especially in diseased ears where the TM is opaque. An integrated optical coherence tomography (OCT) otoscope can provide images of the interior of the TM and ME space as well as an otoscope image. This enables the clinicians to correlate the standard otoscopic view with OCT and then use the new information to improve the diagnostic accuracy and management.

Aim

We aim to develop an OCT otoscope that can easily be used in the hearing clinic and demonstrate the system in the hearing clinic, identifying relevant image features of various pathologies not apparent in the standard otoscopic view.

Approach

We developed a portable OCT otoscope device featuring an improved field of view and form-factor that can be operated solely by the clinician using an integrated foot pedal to control image acquisition. The device was used to image patients at a hearing clinic.

Results

The field of view of the imaging system was improved to a 7.4 mm diameter, with lateral and axial resolutions of 38    μ m and 33.4    μ m , respectively. We developed algorithms to resample the images in Cartesian coordinates after collection in spherical polar coordinates and correct the image aberration. We imaged over 100 patients in the hearing clinic at USC Keck Hospital. Here, we identify some of the pathological features evident in the OCT images and highlight cases in which the OCT image provided clinically relevant information that was not available from traditional otoscopic imaging.

Conclusions

The developed OCT otoscope can readily fit into the hearing clinic workflow and provide new relevant information for diagnosing and managing TM and ME disease.

Advancing DIEP Flap Monitoring with Optical Imaging Techniques: A Narrative Review

OBJECTIVES

This review aims to explore recent advancements in optical imaging techniques for monitoring the viability of Deep Inferior Epigastric Perforator (DIEP) flap reconstruction. The objectives include highlighting the principles, applications, and clinical utility of optical imaging modalities such as near-infrared spectroscopy (NIRS), indocyanine green (ICG) fluorescence angiography, laser speckle contrast imaging (LSCI), hyperspectral imaging (HSI), dynamic infrared thermography (DIRT), and short-wave infrared thermography (SWIR) in assessing tissue perfusion and oxygenation. Additionally, this review aims to discuss the potential of these techniques in enhancing surgical outcomes by enabling timely intervention in cases of compromised flap perfusion.

MATERIALS AND METHODS

A comprehensive literature review was conducted to identify studies focusing on optical imaging techniques for monitoring DIEP flap viability. We searched PubMed, MEDLINE, and relevant databases, including Google Scholar, Web of Science, Scopus, PsycINFO, IEEE Xplore, and ProQuest Dissertations & Theses, among others, using specific keywords related to optical imaging, DIEP flap reconstruction, tissue perfusion, and surgical outcomes. This extensive search ensured we gathered comprehensive data for our analysis. Articles discussing the principles, applications, and clinical use of NIRS, ICG fluorescence angiography, LSCI, HSI, DIRT, and SWIR in DIEP flap monitoring were selected for inclusion. Data regarding the techniques' effectiveness, advantages, limitations, and potential impact on surgical decision-making were extracted and synthesized.

RESULTS

Optical imaging modalities, including NIRS, ICG fluorescence angiography, LSCI, HSI, DIRT, and SWIR offer a non- or minimal-invasive, real-time assessment of tissue perfusion and oxygenation in DIEP flap reconstruction. These techniques provide objective and quantitative data, enabling surgeons to monitor flap viability accurately. Studies have demonstrated the effectiveness of optical imaging in detecting compromised perfusion and facilitating timely intervention, thereby reducing the risk of flap complications such as partial or total loss. Furthermore, optical imaging modalities have shown promise in improving surgical outcomes by guiding intraoperative decision-making and optimizing patient care.

CONCLUSIONS

Recent advancements in optical imaging techniques present valuable tools for monitoring the viability of DIEP flap reconstruction. NIRS, ICG fluorescence angiography, LSCI, HSI, DIRT, and SWIR offer a non- or minimal-invasive, real-time assessment of tissue perfusion and oxygenation, enabling accurate evaluation of flap viability. These modalities have the potential to enhance surgical outcomes by facilitating timely intervention in cases of compromised perfusion, thereby reducing the risk of flap complications. Incorporating optical imaging into clinical practice can provide surgeons with objective and quantitative data, assisting in informed decision-making for optimal patient care in DIEP flap reconstruction surgeries.

From bone to nanoparticles: development of a novel generation of bone derived nanoparticles for image guided orthopedic regeneration

Bone related diseases such as osteoporosis, osteoarthritis, metastatic bone cancer, osteogenesis imperfecta, and Paget's disease, are primarily treated with pharmacologic therapies that often exhibit limited efficacy and substantial side effects. Bone injuries or fractures are primarily repaired with biocompatible materials that produce mixed results in sufficiently regenerating healthy and homogenous bone tissue. Each of these bone conditions, both localized and systemic, use different strategies with the same goal of achieving a healthy and homeostatic bone environment. In this study, we developed a new type of bone-based nanoparticle (BPs) using the entire organic extracellular matrix (ECM) of decellularized porcine bone, additionally encapsulating indocyanine green dye (ICG) for an in vivo monitoring capability. Utilizing the regenerative capability of bone ECM and the functionality of nanoparticles, the ICG encapsulated BPs (ICG/BPs) have been demonstrated to be utilized as a therapeutic option for localized and systemic orthopedic conditions. Additionally, ICG enables an in situ monitoring capability in the Short-Wave Infrared (SWIR) spectrum, capturing the degradation or the biodistribution of the ICG/BPs after both local implantation and intravenous administration, respectively. The efficacy and safety of the ICG/BPs shown within this study lay the foundation for future investigations, which will delve into optimization for clinical translation.

Label-Free Optical Technologies for Middle-Ear Diseases

Medical applications of optical technology have increased tremendously in recent decades. Label-free techniques have the unique advantage of investigating biological samples in vivo without introducing exogenous agents. This is especially beneficial for a rapid clinical translation as it reduces the need for toxicity studies and regulatory approval for exogenous labels. Emerging applications have utilized label-free optical technology for screening, diagnosis, and surgical guidance. Advancements in detection technology and rapid improvements in artificial intelligence have expedited the clinical implementation of some optical technologies. Among numerous biomedical application areas, middle-ear disease is a unique space where label-free technology has great potential. The middle ear has a unique anatomical location that can be accessed through a dark channel, the external auditory canal; it can be sampled through a tympanic membrane of approximately 100 microns in thickness. The tympanic membrane is the only membrane in the body that is surrounded by air on both sides, under normal conditions. Despite these favorable characteristics, current examination modalities for middle-ear space utilize century-old technology such as white-light otoscopy. This paper reviews existing label-free imaging technologies and their current progress in visualizing middle-ear diseases. We discuss potential opportunities, barriers, and practical considerations when transitioning label-free technology to clinical applications.

Machine Learning-Assisted Short-Wave InfraRed (SWIR) Techniques for Biomedical Applications: Towards Personalized Medicine

Personalized medicine transforms healthcare by adapting interventions to individuals' unique genetic, molecular, and clinical profiles. To maximize diagnostic and/or therapeutic efficacy, personalized medicine requires advanced imaging devices and sensors for accurate assessment and monitoring of individual patient conditions or responses to therapeutics. In the field of biomedical optics, short-wave infrared (SWIR) techniques offer an array of capabilities that hold promise to significantly enhance diagnostics, imaging, and therapeutic interventions. SWIR techniques provide in vivo information, which was previously inaccessible, by making use of its capacity to penetrate biological tissues with reduced attenuation and enable researchers and clinicians to delve deeper into anatomical structures, physiological processes, and molecular interactions. Combining SWIR techniques with machine learning (ML), which is a powerful tool for analyzing information, holds the potential to provide unprecedented accuracy for disease detection, precision in treatment guidance, and correlations of complex biological features, opening the way for the data-driven personalized medicine field. Despite numerous biomedical demonstrations that utilize cutting-edge SWIR techniques, the clinical potential of this approach has remained significantly underexplored. This paper demonstrates how the synergy between SWIR imaging and ML is reshaping biomedical research and clinical applications. As the paper showcases the growing significance of SWIR imaging techniques that are empowered by ML, it calls for continued collaboration between researchers, engineers, and clinicians to boost the translation of this technology into clinics, ultimately bridging the gap between cutting-edge technology and its potential for personalized medicine.

Recent Advances in the HPPH-Based Third-Generation Photodynamic Agents in Biomedical Applications

Photodynamic therapy has emerged as a recognized anti-tumor treatment involving three fundamental elements: photosensitizers, light, and reactive oxygen species. Enhancing the effectiveness of photosensitizers remains the primary avenue for improving the biological therapeutic outcomes of PDT. Through three generations of development, HPPH is a 2-(1-hexyloxyethyl)-2-devinyl derivative of pyropheophorbide-α, representing a second-generation photosensitizer already undergoing clinical trials for various tumors. The evolution toward third-generation photosensitizers based on HPPH involves structural modifications for multimodal applications and the combination of multifunctional compounds, leading to improved imaging localization and superior anti-tumor effects. While research into third-generation HPPH is beneficial for advancing PDT treatment, equal attention should also be directed toward the other two essential elements and personalized diagnosis and treatment methodologies.

Ambient Light Resistant Shortwave Infrared Fluorescence Imaging for Preclinical Tumor Delineation via the pH Low-Insertion Peptide Conjugated to Indocyanine Green

Shortwave infrared (900-1,700 nm) fluorescence imaging (SWIRFI) has shown significant advantages over visible (400-650 nm) and near-infrared (700-900 nm) fluorescence imaging (reduced autofluorescence, improved contrast, tissue resolution, and depth sensitivity). However, there is a major lag in the clinical translation of preclinical SWIRFI systems and targeted SWIRFI probes. Methods: We preclinically show that the pH low-insertion peptide conjugated to indocyanine green (pHLIP ICG), currently in clinical trials, is an excellent candidate for cancer-targeted SWIRFI. Results: pHLIP ICG SWIRFI achieved picomolar sensitivity (0.4 nM) with binary and unambiguous tumor screening and resection up to 96 h after injection in an orthotopic breast cancer mouse model. SWIRFI tumor screening and resection had ambient light resistance (possible without gating or filtering) with outstanding signal-to-noise ratio (SNR) and contrast-to-noise ratio (CNR) values at exposures from 10 to 0.1 ms. These SNR and CNR values were also found for the extended emission of pHLIP ICG in vivo (>1,100 nm, 300 ms). Conclusion: SWIRFI sensitivity and ambient light resistance enabled continued tracer clearance tracking with unparalleled SNR and CNR values at video rates for tumor delineation (achieving a tumor-to-muscle ratio above 20). In total, we provide a direct precedent for the democratic translation of an ambient light resistant SWIRFI and pHLIP ICG ecosystem, which can instantly improve tumor resection.

Automated Segmentation of Optical Coherence Tomography Images of the Human Tympanic Membrane Using Deep Learning

Optical Coherence Tomography (OCT) is a light-based imaging modality that is used widely in the diagnosis and management of eye disease, and it is starting to become used to evaluate for ear disease. However, manual image analysis to interpret the anatomical and pathological findings in the images it provides is complicated and time-consuming. To streamline data analysis and image processing, we applied a machine learning algorithm to identify and segment the key anatomical structure of interest for medical diagnostics, the tympanic membrane. Using 3D volumes of the human tympanic membrane, we used thresholding and contour finding to locate a series of objects. We then applied TensorFlow deep learning algorithms to identify the tympanic membrane within the objects using a convolutional neural network. Finally, we reconstructed the 3D volume to selectively display the tympanic membrane. The algorithm was able to correctly identify the tympanic membrane properly with an accuracy of ~98% while removing most of the artifacts within the images, caused by reflections and signal saturations. Thus, the algorithm significantly improved visualization of the tympanic membrane, which was our primary objective. Machine learning approaches, such as this one, will be critical to allowing OCT medical imaging to become a convenient and viable diagnostic tool within the field of otolaryngology.

Enhancing intraoperative tumor delineation with multispectral short-wave infrared fluorescence imaging and machine learning

SIGNIFICANCE

Fluorescence-guided surgery (FGS) provides specific real-time visualization of tumors, but intensity-based measurement of fluorescence is prone to errors. Multispectral imaging (MSI) in the short-wave infrared (SWIR) has the potential to improve tumor delineation by enabling machine-learning classification of pixels based on their spectral characteristics.

AIM

Determine whether MSI can be applied to FGS and combined with machine learning to provide a robust method for tumor visualization.

APPROACH

A multispectral SWIR fluorescence imaging device capable of collecting data from six spectral filters was constructed and deployed on neuroblastoma (NB) subcutaneous xenografts ( n = 6 ) after the injection of a NB-specific NIR-I fluorescent probe (Dinutuximab-IRDye800). We constructed image cubes representing fluorescence collected from ∼ 850 to 1450 nm and compared the performance of seven learning-based methods for pixel-by-pixel classification, including linear discriminant analysis, k -nearest neighbor classification, and a neural network.

RESULTS

The spectra of tumor and non-tumor tissue were subtly different and conserved between individuals. In classification, a combine principal component analysis and k -nearest-neighbor approach with area under curve normalization performed best, achieving 97.5% per-pixel classification accuracy (97.1%, 93.5%, and 99.2% for tumor, non-tumor tissue and background, respectively).

CONCLUSIONS

The development of dozens of new imaging agents provides a timely opportunity for multispectral SWIR imaging to revolutionize next-generation FGS.

A new label-free optical imaging method for the lymphatic system enhanced by deep learning

Our understanding of the lymphatic vascular system lags far behind that of the blood vascular system, limited by available imaging technologies. We present a label-free optical imaging method that visualizes the lymphatic system with high contrast. We developed an orthogonal polarization imaging (OPI) in the shortwave infrared range (SWIR) and imaged both lymph nodes and lymphatic vessels of mice and rats in vivo through intact skin, as well as human mesenteric lymph nodes in colectomy specimens. By integrating SWIR-OPI with U-Net, a deep learning image segmentation algorithm, we automated the lymph node size measurement process. Changes in lymph nodes in response to cancer progression were monitored in two separate mouse cancer models, through which we obtained insights into pre-metastatic niches and correlation between lymph node masses and many important biomarkers. In a human pilot study, we demonstrated the effectiveness of SWIR-OPI to detect human lymph nodes in real time with clinical colectomy specimens.

One Sentence Summary

We develop a real-time high contrast optical technique for imaging the lymphatic system, and apply it to anatomical pathology gross examination in a clinical setting, as well as real-time monitoring of tumor microenvironment in animal studies.

Photostable Small-Molecule NIR-II Fluorescent Scaffolds that Cross the Blood-Brain Barrier for Noninvasive Brain Imaging

The second near-infrared (NIR-II, 1000-1700 nm) fluorescent probes have significant advantages over visible or NIR-I (600-900 nm) imaging for both depth of penetration and level of resolution. Since the blood-brain barrier (BBB) prevents most molecules from entering the central nervous system, NIR-II dyes with large molecular frameworks have limited applications for brain imaging. In this work, we developed a series of boron difluoride (BF₂) formazanate NIR-II dyes, which had tunable photophysical properties, ultrahigh photostability, excellent biological stability, and strong brightness. Modulation of the aniline moiety of BF₂ formazanate dyes significantly enhances their abilities to cross the BBB for noninvasive brain imaging. Furthermore, the intact mouse brain imaging and dynamic dye diffusion across the BBB were monitored using these BF₂ formazanate dyes in the NIR-II region. In murine glioblastoma models, these dyes can differentiate tumors from normal brain tissues. We anticipate that this new type of small molecule will find potential applications in creating probes and drugs relevant to theranostic for brain pathologies.

PET/NIR-II fluorescence imaging and image-guided surgery of glioblastoma using a folate receptor α-targeted dual-modal nanoprobe

PURPOSE

The surgery of glioblastoma (GBM) requires a maximal resection of the tumor when it is safe and feasible. The infiltrating growth property of the GBM makes it a challenge for neurosurgeons to identify the tumor tissue even with the assistance of the surgical microscope. This highlights the urgent requirement for imaging techniques that can differentiate tumor tissues during surgery in real time. Fluorescence image-guided surgery of GBM has been investigated using several non-specific fluorescent probes that emit light in the visible and the first near-infrared window (NIR-I, 700-900 nm), which limit the detection accuracy because of the non-specific targeting mechanism and spectral characteristics. Targeted NIR-II (1000-1700 nm) fluorescent probes for GBM are thus highly desired. The folate receptor (FR) has been reported to be upregulated in GBM, which renders it to be a promising target for specific tumor imaging.

METHODS

In this study, the folic acid (FA) that can target the FR was conjugated with the clinically approved indocyanine green (ICG) dye and DOTA chelator for radiolabeling with ⁶⁴Cu to achieve targeted positron emission tomography (PET) and fluorescence imaging of GBM.

RESULTS

Surprisingly it was found that the resulted bioconjugate, DOTA-FA-ICG and non-radioactive ^natCu-DOTA-FA-ICG, were both self-assembled into nanoparticles with NIR-II emission signal. The radiolabeled DOTA-FA-ICG, ⁶⁴Cu-DOTA-FA-ICG, was found to specifically accumulate in the orthotopic GBM models using in vivo PET, NIR-II, and NIR-I fluorescence imaging. The best time window of fluorescence imaging was demonstrated to be 24 h after DOTA-FA-ICG injection. NIR-II fluorescence image-guided surgery was successfully conducted in the orthotopic GBM models using DOTA-FA-ICG. All the fluorescent tissue was removed and proved to be GBM by the H&E examination.

CONCLUSION

Overall, our study demonstrates that the probes, ⁶⁴Cu-DOTA-FA-ICG and DOTA-FA-ICG, hold promise for preoperative PET examination and intraoperative NIR-II fluorescence image-guided surgery of GBM, respectively.

Automated classification of otitis media with OCT: augmenting pediatric image datasets with gold-standard animal model data

Otitis media (OM) is an extremely common disease that affects children worldwide. Optical coherence tomography (OCT) has emerged as a noninvasive diagnostic tool for OM, which can detect the presence and quantify the properties of middle ear fluid and biofilms. Here, the use of OCT data from the chinchilla, the gold-standard OM model for the human disease, is used to supplement a human image database to produce diagnostically relevant conclusions in a machine learning model. Statistical analysis shows the datatypes are compatible, with a blended-species model reaching ∼95% accuracy and F1 score, maintaining performance while additional human data is collected.

Color Dependence Analysis in a CNN-Based Computer-Aided Diagnosis System for Middle and External Ear Diseases

Artificial intelligence-assisted otologic diagnosis has been of growing interest in the scientific community, where middle and external ear disorders are the most frequent diseases in daily ENT practice. There are some efforts focused on reducing medical errors and enhancing physician capabilities using conventional artificial vision systems. However, approaches with multispectral analysis have not yet been addressed. Tissues of the tympanic membrane possess optical properties that define their characteristics in specific light spectra. This work explores color wavelengths dependence in a model that classifies four middle and external ear conditions: normal, chronic otitis media, otitis media with effusion, and earwax plug. The model is constructed under a computer-aided diagnosis system that uses a convolutional neural network architecture. We trained several models using different single-channel images by taking each color wavelength separately. The results showed that a single green channel model achieves the best overall performance in terms of accuracy (92%), sensitivity (85%), specificity (95%), precision (86%), and F1-score (85%). Our findings can be a suitable alternative for artificial intelligence diagnosis systems compared to the 50% of overall misdiagnosis of a non-specialist physician.

Multimodal Handheld Probe for Characterizing Otitis Media - Integrating Raman Spectroscopy and Optical Coherence Tomography

Otitis media (OM) is a common disease of the middle ear, affecting 80% of children before the age of three. The otoscope, a simple illuminated magnifier, is the standard clinical diagnostic tool to observe the middle ear. However, it has limited contrast to detect signs of infection, such as clearly identifying and characterizing middle ear fluid or biofilms that accumulate within the middle ear. Likewise, invasive sampling of every subject is not clinically indicated nor practical. Thus, collecting accurate noninvasive diagnostic factors is vital for clinicians to deliver a precise diagnosis and effective treatment regimen. To address this need, a combined benchtop Raman spectroscopy (RS) and optical coherence tomography (OCT) system was developed. Together, RS-OCT can non-invasively interrogate the structural and biochemical signatures of the middle ear under normal and infected conditions.In this paper, in vivo RS scans from pediatric clinical human subjects presenting with OM were evaluated in parallel with RS-OCT data of physiologically relevant in vitro ear models. Component-level characterization of a healthy tympanic membrane and malleus bone, as well as OM-related middle ear fluid, identified the optimal position within the ear for RS-OCT data collection. To address the design challenges in developing a system specific to clinical use, a prototype non-contact multimodal handheld probe was built and successfully tested in vitro. Design criteria have been developed to successfully address imaging constraints imposed by physiological characteristics of the ear and optical safety limits. Here, we present the pathway for translation of RS-OCT for non-invasive detection of OM.

Establishing design principles for emissive organic SWIR chromophores from energy gap laws

Rational design of bright near and shortwave infrared (NIR: 700-1000 SWIR: 1000- 2000 nm) emitters remains an open question with applications spanning imaging and photonics. Combining experiment and theory, we derive an energy gap quantum yield master equation (EQME), describing the fundamental limits in SWIR quantum yields (ϕ F ) for organic chromophores. Evaluating the photophysics of 21 polymethine NIR/SWIR chromophores to parameterize the EQME, we explain the precipitous decline of ϕ F past 900 nm through decreasing radiative rates and increasing nonradiative losses via high frequency vibrations relating to the energy gap. Using the EQME we develop an energy gap independent ϕ F NIR/SWIR chromophore comparison metric. We show electron donating character on polymethine heterocycles results in relative increases in radiative efficiency obscured by a simultaneous redshift. Finally, the EQME yields rational chromophore design insights shown by how deuteration (backed by our experimental results) or molecular aggregation increases SWIR ϕ F .

Shortwave infrared otoscopy for diagnosis of middle ear effusions: a machine-learning-based approach

Otitis media, a common disease marked by the presence of fluid within the middle ear space, imparts a significant global health and economic burden. Identifying an effusion through the tympanic membrane is critical to diagnostic success but remains challenging due to the inherent limitations of visible light otoscopy and user interpretation. Here we describe a powerful diagnostic approach to otitis media utilizing advancements in otoscopy and machine learning. We developed an otoscope that visualizes middle ear structures and fluid in the shortwave infrared region, holding several advantages over traditional approaches. Images were captured in vivo and then processed by a novel machine learning based algorithm. The model predicts the presence of effusions with greater accuracy than current techniques, offering specificity and sensitivity over 90%. This platform has the potential to reduce costs and resources associated with otitis media, especially as improvements are made in shortwave imaging and machine learning.

Bright Chromenylium Polymethine Dyes Enable Fast, Four-Color In Vivo Imaging with Shortwave Infrared Detection

Optical imaging within the shortwave infrared (SWIR, 1000-2000 nm) region of the electromagnetic spectrum has enabled high-resolution and high-contrast imaging in mice, non-invasively. Polymethine dyes, with their narrow absorption spectra and high absorption coefficients, are optimal probes for fast and multiplexed SWIR imaging. Here, we expand upon the multiplexing capabilities in SWIR imaging by obtaining brighter polymethine dyes with varied excitation wavelengths spaced throughout the near-infrared (700-1000 nm) region. Building on the flavylium polymethine dye scaffold, we explored derivatives with functional group substitution at the 2-position, deemed chromenylium polymethine dyes. The reported dyes have reduced nonradiative rates and enhanced emissive properties, enabling non-invasive imaging in mice in a single color at 300 fps and in three colors at 100 fps. Combined with polymethine dyes containing a red-shifted julolidine flavylium heterocycle and indocyanine green, distinct channels with well-separated excitation wavelengths provide non-invasive video-rate in vivo imaging in four colors.

Short-Wave Infrared Fluorescence Chemical Sensor for Detection of Otitis Media

Otitis media (OM) or middle ear infection is one of the most common diseases in young children around the world. The diagnosis of OM is currently performed using an otoscope to detect middle ear fluid and inflammatory changes manifested in the tympanic membrane. However, conventional otoscopy cannot visualize across the tympanic membrane or sample middle ear fluid. This can lead to low diagnostic certainty and overdiagnoses of OM. To improve the diagnosis of OM, we have developed a short-wave infrared (SWIR) otoscope in combination with a protease-cleavable biosensor, 6QC-ICG, which can facilitate the detection of inflammatory proteases in the middle ear with an increase in contrast. 6QC-ICG is a fluorescently quenched probe, which is activated in the presence of cysteine cathepsin proteases that are up-regulated in inflammatory immune cells. Using a preclinical model and custom-built SWIR otomicroscope in this proof-of-concept study, we successfully demonstrated the feasibility of robustly distinguishing inflamed ears from controls (p = 0.0006). The inflamed ears showed an overall signal-to-background ratio of 2.0 with a mean fluorescence of 81 ± 17 AU, while the control ear exhibited a mean fluorescence of 41 ± 11 AU. We envision that these fluorescently quenched probes in conjunction with SWIR imaging tools have the potential to be used as an alternate/adjunct tool for objective diagnosis of OM.

Application of Multispectral Imaging in the Human Tympanic Membrane

Multispectral imaging has recently shown good performance in determining information about physiology, morphology, and composition of tissue. In the endoscopy field, many researches have shown the ability to apply multispectral or narrow-band images in surveying vascular structure based on the interaction of light wavelength with tissue composition. However, there has been no mention to assess the contrast between other components in the middle ear such as the tympanic membrane, malleus, and the surrounding area. Using CT, OCT, or ODT can clearly describe the tympanic membrane structure; nevertheless, these approaches are expensive, more complex, and time-consuming and are not suitable for most common middle ear diagnoses. Here, we show the potential of using the multispectral imaging technique to enhance the contrast of the tympanic membrane compared to the surrounding tissue. The optical absorption and scattering of biological tissues constituents are not the same at different wavelengths. In this pilot study, multiwavelength images of the tympanic membrane were captured by using the otoscope with LED light source at three distinct spectral regions: 450 nm, 530 nm, and 630 nm. Subsequently, analyses of the intensity images as well as the histogram of these images point out that the 630 nm illumination image features an evident contrast in the intensity of the tympanic membrane and malleus compared to the surrounding area. Analysis of such images could facilitate the boundary determination and segmentation of the tympanic membrane (TM) with high precision.

Monodisperse and Water-Soluble Quantum Dots for SWIR Imaging via Carboxylic Acid Copolymer Ligands

Compared to the visible and near-infrared, the short-wave infrared region (SWIR; 1000-2000 nm) has excellent properties for in vivo imaging: low autofluorescence, reduced scattering, and a low-absorption cross-section of blood or tissue. However, the general adoption of SWIR imaging in biomedical research will be enhanced by a broader availability of versatile and bright contrast materials. Quantum dots (QDs) are bright and compact SWIR emitters with narrow size distributions and emission spectra, but their use is limited by the shortcomings of established ligand systems for SWIR QDs. Established ligands often result in SWIR probes with either limited colloidal stability, large size, or broad size distribution or a combination of all three. We present a polymeric QD ligand designed to be compatible with oleate-coated QDs. Our polymeric acid ligand is a copolymer bearing carboxylic acid anchoring groups and PEG-550 chains to solubilize the QD-ligand construct. After a mild and rapid ligand exchange, the resulting constructs are compact (<11 nm hydrodynamic diameter) and have narrow size distribution. Both qualities are preserved for several months in isotonic saline. The constructs are bright in vivo, and to demonstrate their suitability for imaging, we perform whole-body imaging and lymphatic imaging, including visualization of lymphatic flow.

Optical Identification of Middle Ear Infection

Ear infection is one of the most commonly occurring inflammation diseases in the world, especially for children. Almost every child encounters at least one episode of ear infection before he/she reaches the age of seven. The typical treatment currently followed by physicians is visual inspection and antibiotic prescription. In most cases, a lack of improper treatment results in severe bacterial infection. Therefore, it is necessary to design and explore advanced practices for effective diagnosis. In this review paper, we present the various types of ear infection and the related pathogens responsible for middle ear infection. We outline the conventional techniques along with clinical trials using those techniques to detect ear infections. Further, we highlight the need for emerging techniques to reduce ear infection complications. Finally, we emphasize the utility of Raman spectroscopy as a prospective non-invasive technique for the identification of middle ear infection.

Panel 1: Biotechnology, biomedical engineering and new models of otitis media

OBJECTIVE

To summarize recently published key articles on the topics of biomedical engineering, biotechnology and new models in relation to otitis media (OM).

DATA SOURCES

Electronic databases: PubMed, Ovid Medline, Cochrane Library and Clinical Evidence (BMJ Publishing).

REVIEW METHODS

Articles on biomedical engineering, biotechnology, material science, mechanical and animal models in OM published between May 2015 and May 2019 were identified and subjected to review. A total of 132 articles were ultimately included.

RESULTS

New imaging technologies for the tympanic membrane (TM) and the middle ear cavity are being developed to assess TM thickness, identify biofilms and differentiate types of middle ear effusions. Artificial intelligence (AI) has been applied to train software programs to diagnose OM with a high degree of certainty. Genetically modified mice models for OM have further investigated what predisposes some individuals to OM and consequent hearing loss. New vaccine candidates protecting against major otopathogens are being explored and developed, especially combined vaccines, targeting more than one pathogen. Transcutaneous vaccination against non-typeable Haemophilus influenzae has been successfully tried in a chinchilla model. In terms of treatment, novel technologies for trans-tympanic drug delivery are entering the clinical domain. Various growth factors and grafting materials aimed at improving healing of TM perforations show promising results in animal models.

CONCLUSION

New technologies and AI applications to improve the diagnosis of OM have shown promise in pre-clinical models and are gradually entering the clinical domain. So are novel vaccines and drug delivery approaches that may allow local treatment of OM.

IMPLICATIONS FOR PRACTICE

New diagnostic methods, potential vaccine candidates and the novel trans-tympanic drug delivery show promising results, but are not yet adapted to clinical use.

Core-shell polymeric nanoparticles co-loaded with photosensitizer and organic dye for photodynamic therapy guided by fluorescence imaging in near and short-wave infrared spectral regions

BACKGROUND

Biodistribution of photosensitizer (PS) in photodynamic therapy (PDT) can be assessed by fluorescence imaging that visualizes the accumulation of PS in malignant tissue prior to PDT. At the same time, excitation of the PS during an assessment of its biodistribution results in premature photobleaching and can cause toxicity to healthy tissues. Combination of PS with a separate fluorescent moiety, which can be excited apart from PS activation, provides a possibility for fluorescence imaging (FI) guided delivery of PS to cancer site, followed by PDT.

RESULTS

In this work, we report nanoformulations (NFs) of core-shell polymeric nanoparticles (NPs) co-loaded with PS [2-(1-hexyloxyethyl)-2-devinyl pyropheophorbide-a, HPPH] and near infrared fluorescent organic dyes (NIRFDs) that can be excited in the first or second near-infrared windows of tissue optical transparency (NIR-I, ~ 700-950 nm and NIR-II, ~ 1000-1350 nm), where HPPH does not absorb and emit. After addition to nanoparticle suspensions, PS and NIRFDs are entrapped by the nanoparticle shell of co-polymer of N-isopropylacrylamide and acrylamide [poly(NIPAM-co-AA)], while do not bind with the polystyrene (polySt) core alone. Loading of the NIRFD and PS to the NPs shell precludes aggregation of these hydrophobic molecules in water, preventing fluorescence quenching and reduction of singlet oxygen generation. Moreover, shift of the absorption of NIRFD to longer wavelengths was found to strongly reduce an efficiency of the electronic excitation energy transfer between PS and NIRFD, increasing the efficacy of PDT with PS-NIRFD combination. As a result, use of the NFs of PS and NIR-II NIRFD enables fluorescence imaging guided PDT, as it was shown by confocal microscopy and PDT of the cancer cells in vitro. In vivo studies with subcutaneously tumored mice demonstrated a possibility to image biodistribution of tumor targeted NFs both using HPPH fluorescence with conventional imaging camera sensitive in visible and NIR-I ranges (~ 400-750 nm) and imaging camera for short-wave infrared (SWIR) region (~ 1000-1700 nm), which was recently shown to be beneficial for in vivo optical imaging.

CONCLUSIONS

A combination of PS with fluorescence in visible and NIR-I spectral ranges and, NIR-II fluorescent dye allowed us to obtain PS nanoformulation promising for see-and-treat PDT guided with visible-NIR-SWIR fluorescence imaging.

Identification of early inflammatory changes in the tympanic membrane with Raman spectroscopy

The tympanic membrane (TM) is a dynamic structure that separates the middle ear from the external auditory canal. It is also integral for the transmission of sound waves. In this study, we demonstrate the feasibility of using Raman spectroscopy to identify early chemical changes resulting from inflammation in the TM that can serve as an indicator of acute otitis media. Bacterial lipopolysaccharide (LPS) was injected trans-tympanicaly in a murine model. Presence of inflammatory response was assessed with binocular microscopy, confirmed with histopathology and immunofluorescence staining. Successful discrimination suggesting spectral differences among the control and LPS treated groups was achieved using principal component analysis. Raman imaging revealed major differences in collagen distribution and nucleic acid content. Image segmentation analysis on the trichrome stained tissue sections was performed to corroborate the Raman spectra. The spectral co-localization study suggests changes in the expression of collagen IV specific signals in LPS treated samples. The overall findings of the study support prospective application of RS in the diagnosis and therapeutic monitoring of otitis media.

Optical fluorescence imaging with shortwave infrared light emitter nanomaterials for in vivo cell tracking in regenerative medicine

In vivo tracking and monitoring of adoptive cell transfer has a distinct importance in cell‐based therapy. There are many imaging modalities for in vivo monitoring of biodistribution, viability and effectiveness of transferred cells. Some of these procedures are not applicable in the human body because of low sensitivity and high possibility of tissue damages. Shortwave infrared region (SWIR) imaging is a relatively new technique by which deep biological tissues can be potentially visualized with high resolution at cellular level. Indeed, scanning of the electromagnetic spectrum (beyond 1000 nm) of SWIR has a great potential to increase sensitivity and resolution of in vivo imaging for various human tissues. In this review, molecular imaging modalities used for monitoring of biodistribution and fate of administered cells with focusing on the application of non‐invasive optical imaging at shortwave infrared region are discussed in detail.

Automated classification platform for the identification of otitis media using optical coherence tomography

The diagnosis and treatment of otitis media (OM), a common childhood infection, is a significant burden on the healthcare system. Diagnosis relies on observer experience via otoscopy, although for non-specialists or inexperienced users, accurate diagnosis can be difficult. In past studies, optical coherence tomography (OCT) has been used to quantitatively characterize disease states of OM, although with the involvement of experts to interpret and correlate image-based indicators of infection with clinical information. In this paper, a flexible and comprehensive framework is presented that automatically extracts features from OCT images, classifies data, and presents clinically relevant results in a user-friendly platform suitable for point-of-care and primary care settings. This framework was used to test the discrimination between OCT images of normal controls, ears with biofilms, and ears with biofilms and middle ear fluid (effusion). Predicted future performance of this classification platform returned promising results (90%+ accuracy) in various initial tests. With integration into patient healthcare workflow, users of all levels of medical experience may be able to collect OCT data and accurately identify the presence of middle ear fluid and/or biofilms.

Emerging Technologies for the Diagnosis of Otitis Media

OBJECTIVE

To review new experimental techniques for the diagnosis of otitis media (OM).

DATA SOURCES

Literature search in English in the following databases: MEDLINE (via PubMed), Ovid Medline, Google Scholar, and Clinical Evidence (BMJ Publishing) between January 1, 2005, and April 30, 2018. Subsequently, articles were reviewed and included only if relevant.

REVIEW METHODS

MeSH terms: ["diagnosis"] AND [all forms of OM] AND ["human"] AND ["ear"] and ["tympanic membrane"]. The retrieved innovative diagnostic techniques rely on and take advantage of the physical properties of the tympanomastoid cavity components: tympanic membrane (TM) thickness, its translucency and compliance; middle ear fluid characteristics; biofilm presence; increased tissue metabolic activity in OM states; and fluid presence in the mastoid cavity. These parameters are taken into account to establish OM diagnosis objectively. We review spectral gradient acoustic reflectometry, digital otoscopy, TM image analysis, multicolor reflectance imaging, anticonfocal middle ear assessment, optical coherence tomography, quantitative pneumatic otoscopy, transmastoid ultrasound, wideband measurements, TM thickness mapping, shortwave infrared imaging, and wideband acoustic transfer functions.

CONCLUSIONS

New experimental techniques are gradually introduced to overcome the limitations of standard otoscopy. The aforementioned techniques are still under investigation and are pending widespread clinical use. The implementation of these techniques in the market is dependent on their success in clinical trials, as well as on their future cost.

IMPLICATION FOR PRACTICE

New techniques for the diagnosis of OM can objectively evaluate the morphology of the TM, determine the presence of middle ear fluid and evaluate its content, and thus potentially replace standard otoscopy.

Initial findings of shortwave infrared otoscopy in a pediatric population

OBJECTIVE

To evaluate the feasibility of Shortwave infrared (SWIR) otoscopy in a pediatric population and establish differences with visible otoscopy.

METHODS

Pediatric patients 3 years of age and older seen in the otolaryngology clinic with an audiogram and tympanogram obtained within a week of the visit were recruited for video otoscopy using visible light otoscopy and SWIR otoscopy. Videos were rated by two otolaryngologists based on ability to identify the promontory, ability to identify the ossicular chain and presence or absence of middle ear fluid.

RESULTS

A total of 74 video recordings of ears were obtained in 20 patients. We obtained interpretable images in 63/74 (85.1%) ears. There was no statistical significance between ability to perform SWIR otoscopy versus white light video otoscopy as indicated by a p-value of 0.376. There was high inter-rater agreement for identification of both the promontory and the ossicular chain with Kappa values of 0.81 and 0.92 respectively. There was statistical significance between SWIR otoscopy and visible otoscopy in the ability to image the promontory (p = 0.012) and the ossicular chain (p = 0.010). Increased contrast of middle ear fluid was seen in SWIR otoscopy when compared to visible otoscopy.

CONCLUSION

SWIR otoscopy is feasible in a pediatric population and could offer some advantages over visible light otoscopy such as better visualization of the middle ear structures through the tympanic membrane and increased contrast for middle ear effusions.

In Vivo Vibration Measurement of Middle Ear Structure Using Doppler Optical Coherence Tomography: Preliminary Study

Objectives

Doppler optical coherence tomography (DOCT) is useful for both, the spatially resolved measurement of the tympanic membrane (TM) oscillation and high-resolution imaging. We demonstrated a new technique capable of providing real-time two-dimensional Doppler OCT image of rapidly oscillatory latex mini-drum and in vivo rat TM and ossicles.

Methods

Using DOCT system, the oscillation of sample was measured at frequency range of 1–4 kHz at an output of 15 W. After the sensitivity of the DOCT system was verified using a latex mini-drum consisting of a 100 μm-thick latex membrane, changes in displacement of the umbo and contacted area between TM and malleus in normal and pathologic conditions.

Results

The oscillation cycles of the mini-drum for stimulus frequencies were 1.006 kHz for 1 kHz, 2.012 kHz for 2kHz, and 3.912 kHz for 4 kHz, which means that the oscillation cycle of the mini-drum become short in proportional to the frequency of stimuli. The oscillation cycles of umbo area and the junction area in normal TM for frequencies of the stimuli showed similar integer ratio with the data of latex mini-drum for stimuli less than 4 kHz. In the case of middle ear effusion condition, the Doppler signal showed a tendency of attenuation in all frequencies, which was prominent at 1 kHz and 2 kHz.

Conclusion

The TM vibration under sound stimulation with frequencies from 1 kHz to 4 kHz in normal and pathologic conditions was demonstrated using signal demodulation method in in vivo condition. The OCT technology could be helpful for functional and structural assessment as an optional modality.

Differential diagnosis of otitis media with effusion using label-free Raman spectroscopy: A pilot study

Otitis media with effusion (OME) is an important and common condition affecting hearing in pediatric patients characterized by the presence of fluid in the middle ear space. The fluid is normally described as serous or mucoid based on differences in the fluid viscosity. The differential diagnosis of two OMEs, namely serous and mucoid is of significant clinical value because while the former is self-limiting, surgical procedure is commonly required for the latter. However, accurate identification of fluid types remains a challenging target unattainable with current clinical modalities due to unavailability of nonperturbative molecular tools. Here, we report an emerging spectroscopy approach featuring Raman scattering and multivariate analysis of spectral patterns to discern serous and mucoid fluids, obtained from pediatric patients undergoing myringotomy and tube placement, by providing information of differentially expressed molecules with high specificity. We demonstrate the feasibility of Raman spectroscopy-based approach to categorize middle ear effusion based on the characteristic spectral markers, notably of mucin, with classification accuracy of 91% and 93% for serous and mucoid, respectively. Our findings pave the way for further development of such a tool for fully noninvasive application that will lead to objective and accurate diagnosis thereby reducing unnecessary visits and surgical procedures.

Shortwave infrared fluorescence imaging with the clinically approved near-infrared dye indocyanine green

Fluorescence imaging is a method of real-time molecular tracking in vivo that has enabled many clinical technologies. Imaging in the shortwave IR (SWIR; 1,000-2,000 nm) promises higher contrast, sensitivity, and penetration depths compared with conventional visible and near-IR (NIR) fluorescence imaging. However, adoption of SWIR imaging in clinical settings has been limited, partially due to the absence of US Food and Drug Administration (FDA)-approved fluorophores with peak emission in the SWIR. Here, we show that commercially available NIR dyes, including the FDA-approved contrast agent indocyanine green (ICG), exhibit optical properties suitable for in vivo SWIR fluorescence imaging. Even though their emission spectra peak in the NIR, these dyes outperform commercial SWIR fluorophores and can be imaged in the SWIR, even beyond 1,500 nm. We show real-time fluorescence imaging using ICG at clinically relevant doses, including intravital microscopy, noninvasive imaging in blood and lymph vessels, and imaging of hepatobiliary clearance, and show increased contrast compared with NIR fluorescence imaging. Furthermore, we show tumor-targeted SWIR imaging with IRDye 800CW-labeled trastuzumab, an NIR dye being tested in multiple clinical trials. Our findings suggest that high-contrast SWIR fluorescence imaging can be implemented alongside existing imaging modalities by switching the detection of conventional NIR fluorescence systems from silicon-based NIR cameras to emerging indium gallium arsenide-based SWIR cameras. Using ICG in particular opens the possibility of translating SWIR fluorescence imaging to human clinical applications. Indeed, our findings suggest that emerging SWIR-fluorescent in vivo contrast agents should be benchmarked against the SWIR emission of ICG in blood.

Shortwave infrared fluorescence imaging with the clinically approved near-infrared dye indocyanine green

Fluorescence imaging is a method of real-time molecular tracking in vivo that has enabled many clinical technologies. Imaging in the shortwave IR (SWIR; 1,000-2,000 nm) promises higher contrast, sensitivity, and penetration depths compared with conventional visible and near-IR (NIR) fluorescence imaging. However, adoption of SWIR imaging in clinical settings has been limited, partially due to the absence of US Food and Drug Administration (FDA)-approved fluorophores with peak emission in the SWIR. Here, we show that commercially available NIR dyes, including the FDA-approved contrast agent indocyanine green (ICG), exhibit optical properties suitable for in vivo SWIR fluorescence imaging. Even though their emission spectra peak in the NIR, these dyes outperform commercial SWIR fluorophores and can be imaged in the SWIR, even beyond 1,500 nm. We show real-time fluorescence imaging using ICG at clinically relevant doses, including intravital microscopy, noninvasive imaging in blood and lymph vessels, and imaging of hepatobiliary clearance, and show increased contrast compared with NIR fluorescence imaging. Furthermore, we show tumor-targeted SWIR imaging with IRDye 800CW-labeled trastuzumab, an NIR dye being tested in multiple clinical trials. Our findings suggest that high-contrast SWIR fluorescence imaging can be implemented alongside existing imaging modalities by switching the detection of conventional NIR fluorescence systems from silicon-based NIR cameras to emerging indium gallium arsenide-based SWIR cameras. Using ICG in particular opens the possibility of translating SWIR fluorescence imaging to human clinical applications. Indeed, our findings suggest that emerging SWIR-fluorescent in vivo contrast agents should be benchmarked against the SWIR emission of ICG in blood.

Phasor-FLIM as a Screening Tool for the Differential Diagnosis of Actinic Keratosis, Bowen's Disease, and Basal Cell Carcinoma

The aim of this study was to distinguish basal cell carcinoma (BCC) from actinic keratosis (AK) and Bowen's disease (BD) by fluorescence lifetimes of hematoxylin and eosin (H&E) and phasor analysis. Pseudocolor images of average fluorescence lifetime (τm) exhibited more contrast than conventional bright field and/or fluorescence images of H&E-stained sections. The mean values (μ) of τm distribution (τm_μ) in three layers of skin were first explored for comparison with the corresponding layers of AK, BD, and BCC. Moreover, analysis of the H&E fluorescence lifetimes in the phasor space was performed by observing clusters in specific regions of the phasor plot. Various structures in the skin were distinguished. Comparisons of phase distributions from the corresponding layers of skin resulted in quantitative separation and calculation of distinctive parameters including coordinate values, diagonal slopes, and phasor areas. The combination of fluorescence lifetime imaging microscopy (FLIM) and phasor approach (phasor-FLIM) provides a simple method for histopathology analysis and can significantly improve the accuracy of bright field H&E diagnosis. We therefore believe that phasor-FLIM is an aided tool with the potential to provide rapid confirmation of diagnostic criteria and classification of histological types of skin neoplasms.

Penetration depth of photons in biological tissues from hyperspectral imaging in shortwave infrared in transmission and reflection geometries

Measurement of photon penetration in biological tissues is a central theme in optical imaging. A great number of endogenous tissue factors such as absorption, scattering, and anisotropy affect the path of photons in tissue, making it difficult to predict the penetration depth at different wavelengths. Traditional studies evaluating photon penetration at different wavelengths are focused on tissue spectroscopy that does not take into account the heterogeneity within the sample. This is especially critical in shortwave infrared where the individual vibration-based absorption properties of the tissue molecules are affected by nearby tissue components. We have explored the depth penetration in biological tissues from 900 to 1650 nm using Monte–Carlo simulation and a hyperspectral imaging system with Michelson spatial contrast as a metric of light penetration. Chromatic aberration-free hyperspectral images in transmission and reflection geometries were collected with a spectral resolution of 5.27 nm and a total acquisition time of 3 min. Relatively short recording time minimized artifacts from sample drying. Results from both transmission and reflection geometries consistently revealed that the highest spatial contrast in the wavelength range for deep tissue lies within 1300 to 1375 nm; however, in heavily pigmented tissue such as the liver, the range 1550 to 1600 nm is also prominent.