1
|
Chen J, Yang J, Wang J, Zhao Z, Wang M, Sun C, Song N, Feng S. Study on an Automatic Classification Method for Determining the Malignancy Grade of Glioma Pathological Sections Based on Hyperspectral Multi-Scale Spatial-Spectral Fusion Features. SENSORS (BASEL, SWITZERLAND) 2024; 24:3803. [PMID: 38931588 PMCID: PMC11207485 DOI: 10.3390/s24123803] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/12/2024] [Revised: 06/05/2024] [Accepted: 06/11/2024] [Indexed: 06/28/2024]
Abstract
This study describes a novel method for grading pathological sections of gliomas. Our own integrated hyperspectral imaging system was employed to characterize 270 bands of cancerous tissue samples from microarray slides of gliomas. These samples were then classified according to the guidelines developed by the World Health Organization, which define the subtypes and grades of diffuse gliomas. We explored a hyperspectral feature extraction model called SMLMER-ResNet using microscopic hyperspectral images of brain gliomas of different malignancy grades. The model combines the channel attention mechanism and multi-scale image features to automatically learn the pathological organization of gliomas and obtain hierarchical feature representations, effectively removing the interference of redundant information. It also completes multi-modal, multi-scale spatial-spectral feature extraction to improve the automatic classification of glioma subtypes. The proposed classification method demonstrated high average classification accuracy (>97.3%) and a Kappa coefficient (0.954), indicating its effectiveness in improving the automatic classification of hyperspectral gliomas. The method is readily applicable in a wide range of clinical settings, offering valuable assistance in alleviating the workload of clinical pathologists. Furthermore, the study contributes to the development of more personalized and refined treatment plans, as well as subsequent follow-up and treatment adjustment, by providing physicians with insights into the underlying pathological organization of gliomas.
Collapse
Affiliation(s)
- Jiaqi Chen
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China; (J.C.)
- University of Chinese Academy of Sciences, Beijing 130033, China
| | - Jin Yang
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China; (J.C.)
| | - Jinyu Wang
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China; (J.C.)
- University of Chinese Academy of Sciences, Beijing 130033, China
| | - Zitong Zhao
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China; (J.C.)
- University of Chinese Academy of Sciences, Beijing 130033, China
| | - Mingjia Wang
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China; (J.C.)
| | - Ci Sun
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China; (J.C.)
| | - Nan Song
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China; (J.C.)
| | - Shulong Feng
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China; (J.C.)
| |
Collapse
|
2
|
Selvander M, Alexander J, Guenot D. Naevi Characterization Using Hyperspectral Imaging: A Pilot Study. Curr Eye Res 2024; 49:624-630. [PMID: 38407145 DOI: 10.1080/02713683.2024.2314602] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2023] [Accepted: 01/29/2024] [Indexed: 02/27/2024]
Abstract
PURPOSE The prevalence of choroidal naevi is common and has been found to be up to 10%. Little is known regarding the optical properties of choroidal naevi. A novel hyperspectral eye fundus camera was used to investigate choroidal naevi's optical density spectra in the retina. METHODS In an ophthalmology clinic setting, patients with choroidal naevi were included in the study. Visual acuity and pressure were tested. Following mydriatics, optical coherence tomography and fundus photography were taken as a reference, after which a hyperspectral image with 12 nm spectral resolution at 450-700 nm was taken. The optical density spectra was measured across the area of the naevus. RESULTS Nine patients with 11 naevi were examined. The visual acuity was not affected by any of the naevi. All the naevi were flat as measured either with the optical coherence tomography and/or on inspection, and only one naevi had a risk factor (orange pigmentation). The Wasserstein distance between the background and the naevi was higher at 695 nm compared to 555 nm (p = .002). The naevi could be grouped into three clusters based on the extracted optical density spectra. CONCLUSION Choroidal naevi are better visible in longer wavelengths compared to shorter wavelengths. This finding can be used to contour and follow choroidal naevi. Choroidal naevi expose different optical density spectra that can be grouped into three different clusters. One of these clusters has an optical density spectra resembling the absorption spectra of lipofuscin, which may indicate the content of this pigment.
Collapse
Affiliation(s)
- Madeleine Selvander
- Department of Clinical Sciences Malmö, Lund University, Lund, Sweden
- Sundets Ögonläkare, Helsingborg, Sweden
| | | | | |
Collapse
|
3
|
Saeed A, Hadoux X, van Wijngaarden P. Hyperspectral retinal imaging biomarkers of ocular and systemic diseases. Eye (Lond) 2024:10.1038/s41433-024-03135-9. [PMID: 38778136 DOI: 10.1038/s41433-024-03135-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2023] [Revised: 02/20/2024] [Accepted: 05/07/2024] [Indexed: 05/25/2024] Open
Abstract
Hyperspectral imaging is a frontier in the field of medical imaging technology. It enables the simultaneous collection of spectroscopic and spatial data. Structural and physiological information encoded in these data can be used to identify and localise typically elusive biomarkers. Studies of retinal hyperspectral imaging have provided novel insights into disease pathophysiology and new ways of non-invasive diagnosis and monitoring of retinal and systemic diseases. This review provides a concise overview of recent advances in retinal hyperspectral imaging.
Collapse
Affiliation(s)
- Abera Saeed
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, Melbourne, 3002, VIC, Australia
- Ophthalmology, Department of Surgery, University of Melbourne, Melbourne, 3002, VIC, Australia
| | - Xavier Hadoux
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, Melbourne, 3002, VIC, Australia
| | - Peter van Wijngaarden
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, Melbourne, 3002, VIC, Australia.
- Ophthalmology, Department of Surgery, University of Melbourne, Melbourne, 3002, VIC, Australia.
| |
Collapse
|
4
|
Lapointe N, Akitegetse C, Poirier J, Picard M, Sauvageau P, Sauvageau D. Targeted spectroscopy in the eye fundus. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:126004. [PMID: 38111476 PMCID: PMC10725981 DOI: 10.1117/1.jbo.28.12.126004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Revised: 11/18/2023] [Accepted: 11/21/2023] [Indexed: 12/20/2023]
Abstract
Significance The assessment of biomarkers in the eye is rapidly gaining traction for the screening, diagnosis, and monitoring of ocular and neurological diseases. Targeted ocular spectroscopy is a technology that enables concurrent imaging of the eye fundus and analysis of high-quality spectra from a targeted region within the imaged area. This provides structural, compositional, and functional information of specific regions of the eye fundus from a non-invasive approach to ocular biomarker detection. Aim The aim of our study was to demonstrate the multimodal functionality and validation of targeted ocular spectroscopy. This was done in vitro, using a reference target and a model eye, and in vivo. Approach Images and spectra from different regions of a reference target and a model eye were acquired and analyzed to validate the system. Targeted ocular fluorescence spectroscopy was also demonstrated with the same model. Subsequently, in vivo imaging and diffuse reflectance spectra were acquired to assess blood oxygen saturation in the optic nerve head and the parafovea of healthy subjects. Results Tests conducted with the reference target showed accurate spectral analysis within specific areas of the imaging space. In the model eye, distinct spectral signatures were observed for the optic disc, blood vessels, the retina, and the macula, consistent with the variations in tissue composition and functions between these regions. An ocular oximetry algorithm was applied to in vivo spectra from the optic nerve head and parafovea of healthy patients, showing significant differences in blood oxygen saturation. Finally, targeted fluorescence spectral analysis was performed in vitro. Conclusions Diffuse reflectance and fluorescence spectroscopy in specific regions of the eye fundus open the door to a whole new range of monitoring and diagnostic capabilities, from assessment of oxygenation in glaucoma and diabetic retinopathy to photo-oxidation and photodegradation in age-related macular degeneration.
Collapse
Affiliation(s)
| | | | | | | | | | - Dominic Sauvageau
- Zilia Inc., Quebec City, Québec, Canada
- University of Alberta, Department of Chemical and Materials Engineering, Edmonton, Alberta, Canada
| |
Collapse
|
5
|
Ma F, Yuan M, Kozak I. Multispectral imaging: Review of current applications. Surv Ophthalmol 2023; 68:889-904. [PMID: 37321478 DOI: 10.1016/j.survophthal.2023.06.004] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Revised: 06/06/2023] [Accepted: 06/06/2023] [Indexed: 06/17/2023]
Abstract
Multispectral imaging (MSI) is a unique layer-by-layer imaging technique that allows the visualization of a wide array of retinal and choroidal pathologies including retinovascular disorders, retinal pigment epithelial changes, and choroidal lesions. Herein, we summarize the basic imaging principles and current applications of MSI together with recent technology advances in the field. MSI detects reflectance signal from both normal chorioretinal tissue and pathological lesions. Either hyperreflectance or hyporeflectance reveals the absorption activity of pigments such as hemoglobin and melanin and the reflection from interfaces such as the posterior hyaloid. Advances in MSI technique include creation of a retinal and choroidal oxy-deoxy map that could provide a better understanding of blood oxygen saturation within lesions as well as better interpretation of reflectance phenomenon of MSI images such as the different reflectance from the Sattler and Haller layers described in this review.
Collapse
Affiliation(s)
- Feiyan Ma
- The Second Hospital of Hebei Medical University, Ophthalmology Department, Shijiazhuang, China.
| | - Mingzhen Yuan
- Beijing Tongren Hospital of Capital Medical University, Ophthalmology Department, Beijing, China
| | - Igor Kozak
- Moorfields Eye Hospitals UAE, Abu Dhabi, United Arab Emirates.
| |
Collapse
|
6
|
Tornow RP, Odstrcilik J, Kolar R. A multi-color video-ophthalmoscopes allows to measure the spectral distribution of light absorption of blood in the human retina. Front Med (Lausanne) 2023; 10:1125154. [PMID: 37007778 PMCID: PMC10060599 DOI: 10.3389/fmed.2023.1125154] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Accepted: 02/24/2023] [Indexed: 03/18/2023] Open
Abstract
Based on our previously developed mono-color video-ophthalmoscope a multi-color video-ophthalmoscope was developed. Using narrow band transmission filters, this instrument allows to measure the pulsatile cardiac cycle induced blood volume changes in the human retina for any wavelength in the sensitivity range of the used CMOS-camera. In this key experiment, video sequences (8 s, 25 fps, 200 frames) of the optic nerve head (ONH) were acquire for seven wavelengths between 475 nm and 677 nm one after the other. After image registration of all frames of each video sequence (to compensate for eye movements) and trend correction (to compensate for slow intensity changes), the amplitude of the cardiac cycle induced light intensity changes (pulsatile absorption amplitude PAA) can be calculated for all seven wavelengths. The results confirmed that the spectral distribution of PAA (λ) follows the distribution of the light absorption of blood. The measured values correspond to the absorption of a thin blood layer of about 0.5 μm thickness.
Collapse
Affiliation(s)
- Ralf-Peter Tornow
- Department of Ophthalmology, Friedrich-Alexander Universität Erlangen-Nürnberg, Erlangen, Germany
- *Correspondence: Ralf-Peter Tornow,
| | - Jan Odstrcilik
- Department of Biomedical Engineering, Faculty of Electrical Engineering and Communication, Brno University of Technology, Brno, Czechia
| | - Radim Kolar
- Department of Biomedical Engineering, Faculty of Electrical Engineering and Communication, Brno University of Technology, Brno, Czechia
| |
Collapse
|
7
|
Hou J, Ness SS, Tschudi J, O’Farrell M, Veddegjerde R, Martinsen ØG, Tønnessen TI, Strand-Amundsen R. Assessment of Intestinal Ischemia-Reperfusion Injury Using Diffuse Reflectance VIS-NIR Spectroscopy and Histology. SENSORS (BASEL, SWITZERLAND) 2022; 22:9111. [PMID: 36501812 PMCID: PMC9738753 DOI: 10.3390/s22239111] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 11/05/2022] [Accepted: 11/16/2022] [Indexed: 06/17/2023]
Abstract
A porcine model was used to investigate the feasibility of using VIS-NIR spectroscopy to differentiate between degrees of ischemia-reperfusion injury in the small intestine. Ten pigs were used in this study and four segments were created in the small intestine of each pig: (1) control, (2) full arterial and venous mesenteric occlusion for 8 h, (3) arterial and venous mesenteric occlusion for 2 h followed by reperfusion for 6 h, and (4) arterial and venous mesenteric occlusion for 4 h followed by reperfusion for 4 h. Two models were built using partial least square discriminant analysis. The first model was able to differentiate between the control, ischemic, and reperfused intestinal segments with an average accuracy of 99.2% with 10-fold cross-validation, and the second model was able to discriminate between the viable versus non-viable intestinal segments with an average accuracy of 96.0% using 10-fold cross-validation. Moreover, histopathology was used to investigate the borderline between viable and non-viable intestinal segments. The VIS-NIR spectroscopy method together with a PLS-DA model showed promising results and appears to be well-suited as a potentially real-time intraoperative method for assessing intestinal ischemia-reperfusion injury, due to its easy-to-use and non-invasive nature.
Collapse
Affiliation(s)
- Jie Hou
- Department of Physics, University of Oslo, Sem Sælands vei 24, 0371 Oslo, Norway
- Department of Clinical and Biomedical Engineering, Oslo University Hospital, 0424 Oslo, Norway
| | - Siri Schøne Ness
- Department of Pathology, The Norwegian Radium Hospital, Oslo University Hospital, Ullernchausseen 70, 0379 Oslo, Norway
| | - Jon Tschudi
- SINTEF AS, Smart Sensors and Microsystems, Forskningsveien 1, 0373 Oslo, Norway
| | - Marion O’Farrell
- SINTEF AS, Smart Sensors and Microsystems, Forskningsveien 1, 0373 Oslo, Norway
| | | | - Ørjan Grøttem Martinsen
- Department of Physics, University of Oslo, Sem Sælands vei 24, 0371 Oslo, Norway
- Department of Clinical and Biomedical Engineering, Oslo University Hospital, 0424 Oslo, Norway
| | - Tor Inge Tønnessen
- Department of Emergencies and Critical Care, Oslo University Hospital, 0424 Oslo, Norway
- Institute of Clinical Medicine, University of Oslo, 0318 Oslo, Norway
| | - Runar Strand-Amundsen
- Department of Clinical and Biomedical Engineering, Oslo University Hospital, 0424 Oslo, Norway
- Sensocure AS, Langmyra 11, 3185 Skoppum, Norway
| |
Collapse
|
8
|
Burgos-Fernández FJ, Alterini T, Díaz-Doutón F, González L, Mateo C, Mestre C, Pujol J, Vilaseca M. Reflectance evaluation of eye fundus structures with a visible and near-infrared multispectral camera. BIOMEDICAL OPTICS EXPRESS 2022; 13:3504-3519. [PMID: 35781951 PMCID: PMC9208594 DOI: 10.1364/boe.457412] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 04/12/2022] [Accepted: 04/30/2022] [Indexed: 06/15/2023]
Abstract
We examined the spectral reflectance of fundus structures in the visible and near-infrared (400-1300 nm) range for contributing to the medical diagnosis of fundus diseases. Spectral images of healthy eye fundus and other ocular diseases were acquired using a novel multispectral fundus camera. Reflectance metrics were computed based on contrast to analyze the spectral features. Significant differences were observed among the structures in healthy and diseased eye fundus. Specifically, near-infrared analysis allows imaging of deeper layers, such as the choroid, which, to date, has not been retrieved using traditional color fundus cameras. Pathological structures, which were hardly observable in color fundus images owing to metamerism, were also revealed by the developed multispectral fundus camera.
Collapse
Affiliation(s)
- Francisco J. Burgos-Fernández
- Center for Sensors, Instruments and Systems Development, Universitat Politècnica de Catalunya, Rambla Sant Nebridi 10, Terrassa, 08222, Spain
| | - Tommaso Alterini
- Center for Sensors, Instruments and Systems Development, Universitat Politècnica de Catalunya, Rambla Sant Nebridi 10, Terrassa, 08222, Spain
| | - Fernando Díaz-Doutón
- Center for Sensors, Instruments and Systems Development, Universitat Politècnica de Catalunya, Rambla Sant Nebridi 10, Terrassa, 08222, Spain
| | - Laura González
- Instituto de Microcirugía Ocular (Miranza Group), Josep Maria Lladó Street 3, Barcelona, 08035, Spain
| | - Carlos Mateo
- Instituto de Microcirugía Ocular (Miranza Group), Josep Maria Lladó Street 3, Barcelona, 08035, Spain
| | - Clara Mestre
- Indiana University School of Optometry, 800 Atwater Ave, Bloomington, IN 47405, USA
| | - Jaume Pujol
- Center for Sensors, Instruments and Systems Development, Universitat Politècnica de Catalunya, Rambla Sant Nebridi 10, Terrassa, 08222, Spain
| | - Meritxell Vilaseca
- Center for Sensors, Instruments and Systems Development, Universitat Politècnica de Catalunya, Rambla Sant Nebridi 10, Terrassa, 08222, Spain
| |
Collapse
|
9
|
Terry J, Geddes D, Ochoa-Gutierrez V, Yang Z, Smith KJ, Harvey AR. Trans-scleral Illumination - The Future of Retinal Imaging? EPJ WEB OF CONFERENCES 2022. [DOI: 10.1051/epjconf/202226602007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
We report how illumination of the retina through the sclera enables the recording of high-contrast reflectance and fluorescence images of the retina, free of the cornea and lens glare and autofluoresence that degrades images recorded using traditional illumination through the pupil.
Collapse
|
10
|
Schramm S, Dietzel A, Link D, Blum MC, Klee S. 3D retinal imaging and measurement using light field technology. JOURNAL OF BIOMEDICAL OPTICS 2021; 26:JBO-210183RR. [PMID: 34921542 PMCID: PMC8678491 DOI: 10.1117/1.jbo.26.12.126002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Accepted: 12/06/2021] [Indexed: 06/14/2023]
Abstract
SIGNIFICANCE Light-field fundus photography has the potential to be a new milestone in ophthalmology. Up-to-date publications show only unsatisfactory image quality, preventing the use of depth measurements. We show that good image quality and, consequently, reliable depth measurements are possible, and we investigate the current challenges of this novel technology. AIM We investigated whether light field (LF) imaging of the retina provides depth information, on which structures the depth is estimated, which illumination wavelength should be used, whether deeper layers are measurable, and what kinds of artifacts occur. APPROACH The technical setup, a mydriatic fundus camera with an LF imager, and depth estimation were validated by an eye model and in vivo measurements of three healthy subjects and three subjects with suspected glaucoma. Comparisons between subjects and the corresponding optical coherence tomography (OCT) measurements were used for verification of the depth estimation. RESULTS This LF setup allowed for three-dimensional one-shot imaging and depth estimation of the optic disc with green light. In addition, a linear relationship was found between the depth estimates of the OCT and those of the setup developed here. This result is supported by the eye model study. Deeper layers were not measurable. CONCLUSIONS If image artifacts can be handled, LF technology has the potential to help diagnose and monitor glaucoma risk at an early stage through a rapid, cost-effective one-shot technology.
Collapse
Affiliation(s)
- Stefan Schramm
- Technische Universität Ilmenau, Institute of Biomedical Engineering and Informatics, Faculty of Computer Sciences and Automation, Ilmenau, Germany
| | - Alexander Dietzel
- Technische Universität Ilmenau, Institute of Biomedical Engineering and Informatics, Faculty of Computer Sciences and Automation, Ilmenau, Germany
| | - Dietmar Link
- Technische Universität Ilmenau, Institute of Biomedical Engineering and Informatics, Faculty of Computer Sciences and Automation, Ilmenau, Germany
| | - Maren-Christina Blum
- Technische Universität Ilmenau, Institute of Biomedical Engineering and Informatics, Faculty of Computer Sciences and Automation, Ilmenau, Germany
| | - Sascha Klee
- Technische Universität Ilmenau, Institute of Biomedical Engineering and Informatics, Faculty of Computer Sciences and Automation, Ilmenau, Germany
- Karl Landsteiner University of Health Sciences, Division Biostatistics and Data Science, Department of General Health Studies, Krems, Austria
| |
Collapse
|
11
|
Lv M, Li W, Tao R, H Lovell N, Yang Y, Tu T, Li W. Spatial-Spectral Density Peaks-Based Discriminant Analysis for Membranous Nephropathy Classification Using Microscopic Hyperspectral Images. IEEE J Biomed Health Inform 2021; 25:3041-3051. [PMID: 33434138 DOI: 10.1109/jbhi.2021.3050483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The traditional differential diagnosis of membranous nephropathy (MN) mainly relies on clinical symptoms, serological examination and optical renal biopsy. However, there is a probability of false positives in the optical inspection results, and it is unable to detect the change of biochemical components, which poses an obstacle to pathogenic mechanism analysis. Microscopic hyperspectral imaging can reveal detailed component information of immune complexes, but the high dimensionality of microscopic hyperspectral image brings difficulties and challenges to image processing and disease diagnosis. In this paper, a novel classification framework, including spatial-spectral density peaks-based discriminant analysis (SSDP), is proposed for intelligent diagnosis of MN using a microscopic hyperspectral pathological dataset. SSDP constructs a set of graphs describing intrinsic structure of MHSI in both spatial and spectral domains by employing density peak clustering. In the process of graph embedding, low-dimensional features with important diagnostic information in the immune complex are obtained by compacting the spatial-spectral local intra-class pixels while separating the spectral inter-class pixels. For the MN recognition task, a support vector machine (SVM) is used to classify pixels in the low-dimensional space. Experimental validation data employ two types of MN that are difficult to distinguish with optical microscope, including primary MN and hepatitis B virus-associated MN. Experimental results show that the proposed SSDP achieves a sensitivity of 99.36%, which has potential clinical value for automatic diagnosis of MN.
Collapse
|
12
|
Past, present and future role of retinal imaging in neurodegenerative disease. Prog Retin Eye Res 2021; 83:100938. [PMID: 33460813 PMCID: PMC8280255 DOI: 10.1016/j.preteyeres.2020.100938] [Citation(s) in RCA: 62] [Impact Index Per Article: 20.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Revised: 12/11/2020] [Accepted: 12/17/2020] [Indexed: 02/08/2023]
Abstract
Retinal imaging technology is rapidly advancing and can provide ever-increasing amounts of information about the structure, function and molecular composition of retinal tissue in humans in vivo. Most importantly, this information can be obtained rapidly, non-invasively and in many cases using Food and Drug Administration-approved devices that are commercially available. Technologies such as optical coherence tomography have dramatically changed our understanding of retinal disease and in many cases have significantly improved their clinical management. Since the retina is an extension of the brain and shares a common embryological origin with the central nervous system, there has also been intense interest in leveraging the expanding armamentarium of retinal imaging technology to understand, diagnose and monitor neurological diseases. This is particularly appealing because of the high spatial resolution, relatively low-cost and wide availability of retinal imaging modalities such as fundus photography or OCT compared to brain imaging modalities such as magnetic resonance imaging or positron emission tomography. The purpose of this article is to review and synthesize current research about retinal imaging in neurodegenerative disease by providing examples from the literature and elaborating on limitations, challenges and future directions. We begin by providing a general background of the most relevant retinal imaging modalities to ensure that the reader has a foundation on which to understand the clinical studies that are subsequently discussed. We then review the application and results of retinal imaging methodologies to several prevalent neurodegenerative diseases where extensive work has been done including sporadic late onset Alzheimer's Disease, Parkinson's Disease and Huntington's Disease. We also discuss Autosomal Dominant Alzheimer's Disease and cerebrovascular small vessel disease, where the application of retinal imaging holds promise but data is currently scarce. Although cerebrovascular disease is not generally considered a neurodegenerative process, it is both a confounder and contributor to neurodegenerative disease processes that requires more attention. Finally, we discuss ongoing efforts to overcome the limitations in the field and unmet clinical and scientific needs.
Collapse
|
13
|
Abstract
Similar to other organs, the retina relies on tightly regulated perfusion and oxygenation. Previous studies have demonstrated that retinal blood flow is affected in a variety of eye and systemic diseases, including diabetic retinopathy, age-related macular degeneration, and glaucoma. Although measurement of peripheral oxygen saturation has become a standard clinical measurement through the development of pulse oximetry, developing a noninvasive technique to measure retinal oxygen saturation has proven challenging, and retinal oximetry technology currently remains inadequate for reliable clinical use. Here, we review current strategies and approaches, as well as several newer technologies in development, and discuss the future of retinal oximetry.
Collapse
Affiliation(s)
- Anupam K Garg
- Shiley Eye Institute, Viterbi Family Department of Ophthalmology, University of California San Diego, La Jolla, CA, USA.,School of Medicine, University of California San Diego, La Jolla, CA, USA
| | - Darren Knight
- Shiley Eye Institute, Viterbi Family Department of Ophthalmology, University of California San Diego, La Jolla, CA, USA
| | - Leonardo Lando
- Shiley Eye Institute, Viterbi Family Department of Ophthalmology, University of California San Diego, La Jolla, CA, USA
| | - Daniel L Chao
- Shiley Eye Institute, Viterbi Family Department of Ophthalmology, University of California San Diego, La Jolla, CA, USA.,School of Medicine, University of California San Diego, La Jolla, CA, USA.,Janssen Research and Development, Raritan, NJ, USA
| |
Collapse
|
14
|
Hedde PN, Cinco R, Malacrida L, Kamaid A, Gratton E. Phasor-based hyperspectral snapshot microscopy allows fast imaging of live, three-dimensional tissues for biomedical applications. Commun Biol 2021; 4:721. [PMID: 34117344 PMCID: PMC8195998 DOI: 10.1038/s42003-021-02266-z] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Accepted: 05/26/2021] [Indexed: 01/31/2023] Open
Abstract
Hyperspectral imaging is highly sought after in many fields including mineralogy and geology, environment and agriculture, astronomy and, importantly, biomedical imaging and biological fluorescence. We developed ultrafast phasor-based hyperspectral snapshot microscopy based on sine/cosine interference filters for biomedical imaging not feasible with conventional hyperspectral detection methods. Current approaches rely on slow spatial or spectral scanning limiting their application in living biological tissues, while faster snapshot methods such as image mapping spectrometry and multispectral interferometry are limited in spatial and/or spectral resolution, are computationally demanding, and imaging devices are very expensive to manufacture. Leveraging light sheet microscopy, phasor-based hyperspectral snapshot microscopy improved imaging speed 10-100 fold which, combined with minimal light exposure and high detection efficiency, enabled hyperspectral metabolic imaging of live, three-dimensional mouse tissues not feasible with other methods. As a fit-free method that does not require any a priori information often unavailable in complex and evolving biological systems, the rule of linear combinations of the phasor could spectrally resolve subtle differences between cell types in the developing zebrafish retina and spectrally separate and track multiple organelles in 3D cultured cells over time. The sine/cosine snapshot method is adaptable to any microscope or imaging device thus making hyperspectral imaging and fit-free analysis based on linear combinations broadly available to researchers and the public.
Collapse
Affiliation(s)
- Per Niklas Hedde
- Laboratory for Fluorescence Dynamics, University of California, Irvine, CA, USA.
- Department of Pharmaceutical Sciences, University of California, Irvine, CA, USA.
- Beckman Laser Institute & Medical Clinic, University of California, Irvine, CA, USA.
| | - Rachel Cinco
- Laboratory for Fluorescence Dynamics, University of California, Irvine, CA, USA
| | - Leonel Malacrida
- Departamento de Fisiopatología, Hospital de Clínicas, Facultad de Medicina, Universidad de la República, Montevideo, Uruguay
- Advanced Bioimaging Unit, Institut Pasteur of Montevideo and Universidad de la República, Montevideo, Uruguay
| | - Andrés Kamaid
- Advanced Bioimaging Unit, Institut Pasteur of Montevideo and Universidad de la República, Montevideo, Uruguay
| | - Enrico Gratton
- Laboratory for Fluorescence Dynamics, University of California, Irvine, CA, USA.
- Beckman Laser Institute & Medical Clinic, University of California, Irvine, CA, USA.
| |
Collapse
|
15
|
Lv M, Chen T, Yang Y, Tu T, Zhang N, Li W, Li W. Membranous nephropathy classification using microscopic hyperspectral imaging and tensor patch-based discriminative linear regression. BIOMEDICAL OPTICS EXPRESS 2021; 12:2968-2978. [PMID: 34168909 PMCID: PMC8194628 DOI: 10.1364/boe.421345] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/03/2021] [Revised: 04/12/2021] [Accepted: 04/14/2021] [Indexed: 05/14/2023]
Abstract
Optical kidney biopsy, serological examination, and clinical symptoms are the main methods for membranous nephropathy (MN) diagnosis. However, false positives and undetectable biochemical components in the results of optical inspections lead to unsatisfactory diagnostic sensitivity and pose obstacles to pathogenic mechanism analysis. In order to reveal detailed component information of immune complexes of MN, microscopic hyperspectral imaging technology is employed to establish a hyperspectral database of 68 patients with two types of MN. Based on the characteristic of the medical HSI, a novel framework of tensor patch-based discriminative linear regression (TDLR) is proposed for MN classification. Experimental results show that the classification accuracy of the proposed model for MN identification is 98.77%. The combination of tensor-based classifiers and hyperspectral data analysis provides new ideas for the research of kidney pathology, which has potential clinical value for the automatic diagnosis of MN.
Collapse
Affiliation(s)
- Meng Lv
- School of Information and Electronics, Beijing Institute of Technology, and Beijing Key Laboratory of Fractional Signals and Systems, Beijing 100081, China
| | - Tianhong Chen
- School of Information and Electronics, Beijing Institute of Technology, and Beijing Key Laboratory of Fractional Signals and Systems, Beijing 100081, China
| | - Yue Yang
- Department of Kidney Disease, China-Japan Friendship Hospital, Beijing 100029, China
| | - Tianqi Tu
- Department of Kidney Disease, China-Japan Friendship Hospital, Beijing 100029, China
| | - Nianrong Zhang
- Department of Kidney Disease, China-Japan Friendship Hospital, Beijing 100029, China
| | - Wenge Li
- Department of Kidney Disease, China-Japan Friendship Hospital, Beijing 100029, China
| | - Wei Li
- School of Information and Electronics, Beijing Institute of Technology, and Beijing Key Laboratory of Fractional Signals and Systems, Beijing 100081, China
| |
Collapse
|
16
|
Modulation by Ozone Therapy of Oxidative Stress in Chemotherapy-Induced Peripheral Neuropathy: The Background for a Randomized Clinical Trial. Int J Mol Sci 2021; 22:ijms22062802. [PMID: 33802143 PMCID: PMC7998838 DOI: 10.3390/ijms22062802] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2021] [Revised: 03/05/2021] [Accepted: 03/08/2021] [Indexed: 12/22/2022] Open
Abstract
(1) Background: Chemotherapy-induced peripheral neuropathy (CIPN) decreases the quality of life of patients and can lead to a dose reduction and/or the interruption of chemotherapy treatment, limiting its effectiveness. Potential pathophysiological mechanisms involved in the pathogenesis of CIPN include chronic oxidative stress and subsequent increase in free radicals and proinflammatory cytokines. Approaches for the treatment of CIPN are highly limited in their number and efficacy, although several antioxidant-based therapies have been tried. On the other hand, ozone therapy can induce an adaptive antioxidant and anti-inflammatory response, which could be potentially useful in the management of CIPN. (2) Methods: The aims of this works are: (a) to summarize the potential mechanisms that could induce CIPN by the most relevant drugs (platinum, taxanes, vinca alkaloids, and bortezomib), with particular focus on the role of oxidative stress; (b) to summarize the current situation of prophylactic and treatment approaches; (c) to describe the action mechanisms of ozone therapy to modify oxidative stress and inflammation with its potential repercussions for CIPN; (d) to describe related experimental and clinical reports with ozone therapy in chemo-induced neurologic symptoms and CIPN; and (e) to show the main details about an ongoing focused clinical trial. (3) Results: A wide background relating to the mechanisms of action and a small number of experimental and clinical reports suggest that ozone therapy could be useful to prevent or improve CIPN. (4) Conclusions: Currently, there are no clinically relevant approaches for the prevention and treatment of stablished CIPN. The potential role of ozone therapy in this syndrome merits further research. Randomized controlled trials are ongoing.
Collapse
|
17
|
Abstract
The most common imaging methods used in dentistry are X-ray imaging and RGB color photography. However, both imaging methods provide only a limited amount of information on the wavelength-dependent optical properties of the hard and soft tissues in the mouth. Spectral imaging, on the other hand, provides significantly more information on the medically relevant dental and oral features (e.g. caries, calculus, and gingivitis). Due to this, we constructed a spectral imaging setup and acquired 316 oral and dental reflectance spectral images, 215 of which are annotated by medical experts, of 30 human test subjects. Spectral images of the subjects’ faces and other areas of interest were captured, along with other medically relevant information (e.g., pulse and blood pressure). We collected these oral, dental, and face spectral images, their annotations and metadata into a publicly available database that we describe in this paper. This oral and dental spectral image database (ODSI-DB) provides a vast amount of data that can be used for developing, e.g., pattern recognition and machine vision applications for dentistry.
Collapse
|
18
|
Nitzan M, Nitzan I, Arieli Y. The Various Oximetric Techniques Used for the Evaluation of Blood Oxygenation. SENSORS 2020; 20:s20174844. [PMID: 32867184 PMCID: PMC7506757 DOI: 10.3390/s20174844] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/05/2020] [Revised: 08/24/2020] [Accepted: 08/25/2020] [Indexed: 12/12/2022]
Abstract
Adequate oxygen delivery to a tissue depends on sufficient oxygen content in arterial blood and blood flow to the tissue. Oximetry is a technique for the assessment of blood oxygenation by measurements of light transmission through the blood, which is based on the different absorption spectra of oxygenated and deoxygenated hemoglobin. Oxygen saturation in arterial blood provides information on the adequacy of respiration and is routinely measured in clinical settings, utilizing pulse oximetry. Oxygen saturation, in venous blood (SvO2) and in the entire blood in a tissue (StO2), is related to the blood supply to the tissue, and several oximetric techniques have been developed for their assessment. SvO2 can be measured non-invasively in the fingers, making use of modified pulse oximetry, and in the retina, using the modified Beer–Lambert Law. StO2 is measured in peripheral muscle and cerebral tissue by means of various modes of near infrared spectroscopy (NIRS), utilizing the relative transparency of infrared light in muscle and cerebral tissue. The primary problem of oximetry is the discrimination between absorption by hemoglobin and scattering by tissue elements in the attenuation measurement, and the various techniques developed for isolating the absorption effect are presented in the current review, with their limitations.
Collapse
Affiliation(s)
- Meir Nitzan
- Department of Physics/Electro-Optics Engineering, Jerusalem College of Technology, 21 Havaad Haleumi St., Jerusalem 91160, Israel;
- Correspondence:
| | - Itamar Nitzan
- Monash Newborn, Monash Children’s Hospital, Melbourne 3168, Australia;
- Department of Neonatology, Shaare Zedek Medical Center, Shmuel Bait St 12, Jerusalem 9103102, Israel
| | - Yoel Arieli
- Department of Physics/Electro-Optics Engineering, Jerusalem College of Technology, 21 Havaad Haleumi St., Jerusalem 91160, Israel;
| |
Collapse
|
19
|
Lemmens S, Van Eijgen J, Van Keer K, Jacob J, Moylett S, De Groef L, Vancraenendonck T, De Boever P, Stalmans I. Hyperspectral Imaging and the Retina: Worth the Wave? Transl Vis Sci Technol 2020; 9:9. [PMID: 32879765 PMCID: PMC7442879 DOI: 10.1167/tvst.9.9.9] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2019] [Accepted: 06/23/2020] [Indexed: 02/07/2023] Open
Abstract
Purpose Hyperspectral imaging is gaining attention in the biomedical field because it generates additional spectral information to study physiological and clinical processes. Several technologies have been described; however an independent, systematic literature overview is lacking, especially in the field of ophthalmology. This investigation is the first to systematically overview scientific literature specifically regarding retinal hyperspectral imaging. Methods A systematic literature review was conducted, in accordance with PRISMA Statement 2009 criteria, in four bibliographic databases: Medline, Embase, Cochrane Database of Systematic Reviews, and Web of Science. Results Fifty-six articles were found that meet the review criteria. A range of techniques was reported: Fourier analysis, liquid crystal tunable filters, tunable laser sources, dual-slit monochromators, dispersive prisms and gratings, computed tomography, fiber optics, and Fabry-Perrot cavity filter covered complementary metal oxide semiconductor. We present a narrative synthesis and summary tables of findings of the included articles, because methodologic heterogeneity and diverse research topics prevented a meta-analysis being conducted. Conclusions Application in ophthalmology is still in its infancy. Most previous experiments have been performed in the field of retinal oximetry, providing valuable information in the diagnosis and monitoring of various ocular diseases. To date, none of these applications have graduated to clinical practice owing to the lack of sufficiently large validation studies. Translational Relevance Given the promising results that smaller studies show for hyperspectral imaging (e.g., in Alzheimer's disease), advanced research in larger validation studies is warranted to determine its true clinical potential.
Collapse
Affiliation(s)
- Sophie Lemmens
- University Hospitals UZ Leuven, Department of Ophthalmology, Leuven, Belgium
- KU Leuven, Biomedical Sciences Group, Department of Neurosciences, Research Group Ophthalmology, Leuven, Belgium
- VITO (Flemish Institute for Technological Research), Health Unit, Boeretang, Belgium
| | - Jan Van Eijgen
- University Hospitals UZ Leuven, Department of Ophthalmology, Leuven, Belgium
- KU Leuven, Biomedical Sciences Group, Department of Neurosciences, Research Group Ophthalmology, Leuven, Belgium
- VITO (Flemish Institute for Technological Research), Health Unit, Boeretang, Belgium
| | - Karel Van Keer
- University Hospitals UZ Leuven, Department of Ophthalmology, Leuven, Belgium
- KU Leuven, Biomedical Sciences Group, Department of Neurosciences, Research Group Ophthalmology, Leuven, Belgium
| | - Julie Jacob
- University Hospitals UZ Leuven, Department of Ophthalmology, Leuven, Belgium
- KU Leuven, Biomedical Sciences Group, Department of Neurosciences, Research Group Ophthalmology, Leuven, Belgium
| | - Sinéad Moylett
- Department of Psychiatry, University of Cambridge School of Clinical Medicine, Cambridge Biomedical Campus, Cambridge, UK
| | - Lies De Groef
- Neural Circuit Development and Regeneration Research Group, Department of Biology, KU Leuven, Leuven, Belgium
| | - Toon Vancraenendonck
- VITO (Flemish Institute for Technological Research), Health Unit, Boeretang, Belgium
| | - Patrick De Boever
- VITO (Flemish Institute for Technological Research), Health Unit, Boeretang, Belgium
- Hasselt University, Centre of Environmental Sciences, Agoralaan, Belgium
| | - Ingeborg Stalmans
- University Hospitals UZ Leuven, Department of Ophthalmology, Leuven, Belgium
- KU Leuven, Biomedical Sciences Group, Department of Neurosciences, Research Group Ophthalmology, Leuven, Belgium
| |
Collapse
|
20
|
Puustinen S, Alaoui S, Bartczak P, Bednarik R, Koivisto T, Dietz A, von Und Zu Fraunberg M, Iso-Mustajärvi M, Elomaa AP. Spectrally Tunable Neural Network-Assisted Segmentation of Microneurosurgical Anatomy. Front Neurosci 2020; 14:640. [PMID: 32694976 PMCID: PMC7339939 DOI: 10.3389/fnins.2020.00640] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2020] [Accepted: 05/25/2020] [Indexed: 11/29/2022] Open
Abstract
Background Distinct tissue types are differentiated based on the surgeon’s knowledge and subjective visible information, typically assisted with white-light intraoperative imaging systems. Narrow-band imaging (NBI) assists in tissue identification and enables automated classifiers, but many anatomical details moderate computational predictions and cause bias. In particular, tissues’ light-source-dependent optical characteristics, anatomical location, and potentially hazardous microstructural changes such as peeling have been overlooked in previous literature. Methods Narrow-band images of five (n = 5) facial nerves (FNs) and internal carotid arteries (ICAs) were captured from freshly frozen temporal bones. The FNs were split into intracranial and intratemporal samples, and ICAs’ adventitia was peeled from the distal end. Three-dimensional (3D) spectral data were captured by a custom-built liquid crystal tunable filter (LCTF) spectral imaging (SI) system. We investigated the normal variance between the samples and utilized descriptive and machine learning analysis on the image stack hypercubes. Results Reflectance between intact and peeled arteries in lower-wavelength domains between 400 and 576 nm was significantly different (p < 0.05). Proximal FN could be differentiated from distal FN in a higher range, 490–720 nm (p < 0.001). ICA with intact tunica differed from proximal FN nearly thorough the VIS range, 412–592 nm (p < 0.001) and 664–720 nm (p < 0.05) as did its distal counterpart, 422–720 nm (p < 0.001). The availed U-Net algorithm classified 90.93% of the pixels correctly in comparison to tissue margins delineated by a specialist. Conclusion Selective NBI represents a promising method for assisting tissue identification and computational segmentation of surgical microanatomy. Further multidisciplinary research is required for its clinical applications and intraoperative integration.
Collapse
Affiliation(s)
- Sami Puustinen
- School of Medicine, Faculty of Health Sciences, University of Eastern Finland, Kuopio, Finland
| | - Soukaina Alaoui
- School of Computing, Faculty of Science and Forestry, University of Eastern Finland, Joensuu, Finland
| | - Piotr Bartczak
- School of Computing, Faculty of Science and Forestry, University of Eastern Finland, Joensuu, Finland
| | - Roman Bednarik
- School of Computing, Faculty of Science and Forestry, University of Eastern Finland, Joensuu, Finland
| | - Timo Koivisto
- Department of Neurosurgery, Neurocenter, Kuopio University Hospital, Kuopio, Finland
| | - Aarno Dietz
- Department of Otolaryngology, Kuopio University Hospital, Kuopio, Finland
| | | | - Matti Iso-Mustajärvi
- Department of Otolaryngology, Kuopio University Hospital, Kuopio, Finland.,Eastern Finland Center of Microsurgery, Kuopio University Hospital, Kuopio, Finland
| | - Antti-Pekka Elomaa
- Eastern Finland Center of Microsurgery, Kuopio University Hospital, Kuopio, Finland
| |
Collapse
|
21
|
Kumar JRH, Seelamantula CS, Mohan A, Shetty R, Berendschot TJM, Webers CAB. Automatic analysis of normative retinal oximetry images. PLoS One 2020; 15:e0231677. [PMID: 32421691 PMCID: PMC7233590 DOI: 10.1371/journal.pone.0231677] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2019] [Accepted: 03/29/2020] [Indexed: 11/18/2022] Open
Abstract
Retinal oximetry is an important screening tool for early detection of retinal pathologies due to changes in the vasculature and also serves as a useful indicator of human-body-wide vascular abnormalities. We present an automatic technique for the measurement of oxygen saturation in retinal arterioles and venules using dual-wavelength retinal oximetry images. The technique is based on segmenting an optic-disc-centered ring-shaped region of interest and subsequent analysis of the oxygen saturation levels. We show that the two dominant peaks in the histogram of the oxygen saturation levels correspond to arteriolar and venular oxygen saturations from which the arterio-venous saturation difference (AVSD) can be calculated. For evaluation, we use a normative database of Asian Indian eyes containing 44 dual-wavelength retinal oximetry images. Validations against expert manual annotations of arterioles and venules show that the proposed technique results in an average arteriolar oxygen saturation (SatO2) of 87.48%, venular SatO2 of 57.41%, and AVSD of 30.07% in comparison with the expert ground-truth average arteriolar SatO2 of 89.41%, venular SatO2 of 56.32%, and AVSD of 33.09%, respectively. The results exhibit high consistency across the dataset indicating that the automated technique is an accurate alternative to the manual procedure.
Collapse
Affiliation(s)
- J. R. Harish Kumar
- Department of Electrical Engineering, Indian Institute of Science, Bangalore, India
- Department of Electrical and Electronics Engineering, Manipal Institute of Technology, MAHE, Manipal, India
- * E-mail: (JRHK); (CSS); (AM)
| | - Chandra Sekhar Seelamantula
- Department of Electrical Engineering, Indian Institute of Science, Bangalore, India
- * E-mail: (JRHK); (CSS); (AM)
| | - Ashwin Mohan
- Postgraduate Institute of Ophthalmology, Narayana Nethralaya, Bangalore, India
- * E-mail: (JRHK); (CSS); (AM)
| | - Rohit Shetty
- Postgraduate Institute of Ophthalmology, Narayana Nethralaya, Bangalore, India
| | | | | |
Collapse
|
22
|
Robertson G, Fleming A, Williams MC, Trucco E, Quinn N, Hogg R, McKay GJ, Kee F, Young I, Pellegrini E, Newby DE, van Beek EJR, Peto T, Dhillon B, van Hemert J, MacGillivray TJ. Association between hypertension and retinal vascular features in ultra-widefield fundus imaging. Open Heart 2020; 7:e001124. [PMID: 32076560 PMCID: PMC6999694 DOI: 10.1136/openhrt-2019-001124] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/27/2019] [Revised: 11/27/2019] [Accepted: 12/17/2019] [Indexed: 01/14/2023] Open
Abstract
Objective Changes to the retinal vasculature are known to be associated with hypertension independently of traditional risk factors. We investigated whether measurements of retinal vascular calibre from ultra-widefield fundus imaging were associated with hypertensive status. Methods We retrospectively collected and semiautomatically measured ultra-widefield retinal fundus images from a subset of participants enrolled in an ongoing population study of ageing, categorised as normotensive or hypertensive according to thresholds on systolic/diastolic blood pressure (140/90 mm Hg) measured in a clinical setting. Vascular calibre in the peripheral retina was measured to calculate the nasal–annular arteriole:venule ratio (NA-AVR), a novel combined parameter. Results Left and right eyes were analysed from 440 participants (aged 50–59 years, mean age of 54.6±2.9 years, 247, 56.1% women), including 151 (34.3%) categorised as hypertensive. Arterioles were thinner and the NA-AVR was smaller in people with hypertension. The area under the receiver operating characteristic curve of NA-AVR for hypertensive status was 0.73 (95% CI 0.68 to 0.78) using measurements from left eyes, while for right eyes, it was 0.64 (95% CI 0.59 to 0.70), representing evidence of a statistically significant difference between the eyes (p=0.020). Conclusions Semiautomated measurements of NA-AVR in ultra-widefield fundus imaging were associated with hypertension. With further development, this may help screen people attending routine eye health check-ups for high blood pressure. These individuals may then follow a care pathway for suspected hypertension. Our results showed differences between left and right eyes, highlighting the importance of investigating both eyes of a patient.
Collapse
Affiliation(s)
| | | | | | - Emanuele Trucco
- The VAMPIRE Project, Computer Vision and Image Processing Group, School of Science and Engineering, University of Dundee, Dundee, Dundee, UK
| | - Nicola Quinn
- Centre for Public Health, Queen's University Belfast, Belfast, Belfast, UK
| | - Ruth Hogg
- Centre for Public Health, Queen's University Belfast, Belfast, Belfast, UK
| | - Gareth J McKay
- Centre for Public Health, Queen's University Belfast, Belfast, Belfast, UK
| | - Frank Kee
- Centre for Public Health, Queen's University Belfast, Belfast, Belfast, UK
| | - Ian Young
- Centre for Public Health, Queen's University Belfast, Belfast, Belfast, UK
| | | | - David E Newby
- Centre for Cardiovascular Sciences, University of Edinburgh, Edinburgh, Lothian, UK
| | - Edwin J R van Beek
- Centre for Cardiovascular Sciences, University of Edinburgh, Edinburgh, Lothian, UK.,Edinburgh Imaging Facility QMRI, University of Edinburgh, Edinburgh, UK
| | - Tunde Peto
- Centre for Public Health, Queen's University Belfast, Belfast, Belfast, UK
| | - Baljean Dhillon
- The VAMPIRE Project, Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, UK
| | | | - Thomas J MacGillivray
- Edinburgh Imaging Facility QMRI, University of Edinburgh, Edinburgh, UK.,The VAMPIRE Project, Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, UK
| | | |
Collapse
|
23
|
Carles G, Brewer L, Harvey AR. Measurement of absorption in scattering media using objective laser speckle: application to blood oximetry. OPTICS EXPRESS 2020; 28:5119-5133. [PMID: 32121739 DOI: 10.1364/oe.383318] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/21/2019] [Accepted: 01/30/2020] [Indexed: 06/10/2023]
Abstract
Multi-spectral imaging enables non-invasive sensing of chemical concentrations in biological tissue based on measurement of optical absorption, but invariably in the presence of high levels of scatter. Absorption is normally inferred from measurement of contrast of biological features, such as the vasculature, and so accuracy is degraded by the poorly characterized modulation-transfer function of the imaging optics and overlying tissue. We report how experimental characterization of the spectral variation of the tissue point-spread function and associated objective speckle pattern can be used to characterize the absorption spectrum and chromophore concentration, with a particular emphasis on determination of the ratio of oxygenated to deoxygenated hemoglobin within blood. Absorption measurements are determined purely by the geometry of the experiment, without degradation due to optical aberrations and associated light scatter. The technique offers enhanced and low-cost determination of in vitro or in vivo chromophore characterizations, including blood-gas analysis.
Collapse
|
24
|
|
25
|
Choudhary TR, Ball D, Ramos JF, Stefansson E, Harvey AR. Remote sensing of blood oxygenation using red-eye pupil reflection. Physiol Meas 2019; 40:12NT01. [PMID: 31805541 DOI: 10.1088/1361-6579/ab5f3b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE To develop a technique for remote sensing of systemic blood oxygenation using red-eye pupil reflection. APPROACH The ratio of the intensities of light from the bright pupil reflections at oxygen sensitive and isosbestic wavelengths is shown to be sensitive to the oxygenation of blood in the eye. A conventional retinal camera, fitted with an image-replicating imaging spectrometer, was used at standoff range to record snapshot spectral images of the face and eyes at eight different wavelengths. In our pilot study we measured optical-density ratios (ODRs) of pupil reflections at wavelengths of 780 nm and 800 nm, simultaneous with pulse oximetry, for ten healthy human subjects under conditions of normoxia and mild hypoxia (15% oxygen). The low absorption at these infrared wavelengths localises the sensing to the choroid. We propose that this can be used for as a proxy for systemic oximetry. MAIN RESULTS A significant reduction (P < 0.001) in ODR of the pupil images was observed during hypoxia and returned to baseline on resumption of normoxia. We demonstrate that measurement of the choroidal ODR can be used to detect changes in blood oxygenation that correlate positively with pulse oximetry and with a noise-equivalent oximetry precision of 0.5%. SIGNIFICANCE We describe a new method to remotely and non-invasively sense the oxygen saturation of choroidal blood. The methodology provides a proxy for remote sensing of cerebral and systemic blood oxygenation. We demonstrate the technique at short range but it has potential for systemic oximetry at large standoff ranges.
Collapse
Affiliation(s)
- Tushar R Choudhary
- The Roslin Institute and Royal (Dick) School of Veterinary Studies, University of Edinburgh, Edinburgh, Midlothian, EH25 9RG, United Kingdom. School of Physics and Astronomy, University of Glasgow, Glasgow, United Kingdom. Author to whom any correspondence should be addressed
| | | | | | | | | |
Collapse
|
26
|
Martinez B, Leon R, Fabelo H, Ortega S, Piñeiro JF, Szolna A, Hernandez M, Espino C, J. O’Shanahan A, Carrera D, Bisshopp S, Sosa C, Marquez M, Camacho R, Plaza MDLL, Morera J, M. Callico G. Most Relevant Spectral Bands Identification for Brain Cancer Detection Using Hyperspectral Imaging. SENSORS (BASEL, SWITZERLAND) 2019; 19:E5481. [PMID: 31842410 PMCID: PMC6961052 DOI: 10.3390/s19245481] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/25/2019] [Revised: 12/01/2019] [Accepted: 12/10/2019] [Indexed: 02/07/2023]
Abstract
Hyperspectral imaging (HSI) is a non-ionizing and non-contact imaging technique capable of obtaining more information than conventional RGB (red green blue) imaging. In the medical field, HSI has commonly been investigated due to its great potential for diagnostic and surgical guidance purposes. However, the large amount of information provided by HSI normally contains redundant or non-relevant information, and it is extremely important to identify the most relevant wavelengths for a certain application in order to improve the accuracy of the predictions and reduce the execution time of the classification algorithm. Additionally, some wavelengths can contain noise and removing such bands can improve the classification stage. The work presented in this paper aims to identify such relevant spectral ranges in the visual-and-near-infrared (VNIR) region for an accurate detection of brain cancer using in vivo hyperspectral images. A methodology based on optimization algorithms has been proposed for this task, identifying the relevant wavelengths to achieve the best accuracy in the classification results obtained by a supervised classifier (support vector machines), and employing the lowest possible number of spectral bands. The results demonstrate that the proposed methodology based on the genetic algorithm optimization slightly improves the accuracy of the tumor identification in ~5%, using only 48 bands, with respect to the reference results obtained with 128 bands, offering the possibility of developing customized acquisition sensors that could provide real-time HS imaging. The most relevant spectral ranges found comprise between 440.5-465.96 nm, 498.71-509.62 nm, 556.91-575.1 nm, 593.29-615.12 nm, 636.94-666.05 nm, 698.79-731.53 nm and 884.32-902.51 nm.
Collapse
Affiliation(s)
- Beatriz Martinez
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35017 Las Palmas de Gran Canaria, Spain; (R.L.); (H.F.); (S.O.); (G.M.C.)
| | - Raquel Leon
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35017 Las Palmas de Gran Canaria, Spain; (R.L.); (H.F.); (S.O.); (G.M.C.)
| | - Himar Fabelo
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35017 Las Palmas de Gran Canaria, Spain; (R.L.); (H.F.); (S.O.); (G.M.C.)
| | - Samuel Ortega
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35017 Las Palmas de Gran Canaria, Spain; (R.L.); (H.F.); (S.O.); (G.M.C.)
| | - Juan F. Piñeiro
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, 35010 Barranco de la Ballena s/n, Las Palmas de Gran Canaria, Spain; (J.F.P.); (A.S.); (M.H.); (C.E.); (A.J.O.); (D.C.); (S.B.); (C.S.); (M.M.); (J.M.)
| | - Adam Szolna
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, 35010 Barranco de la Ballena s/n, Las Palmas de Gran Canaria, Spain; (J.F.P.); (A.S.); (M.H.); (C.E.); (A.J.O.); (D.C.); (S.B.); (C.S.); (M.M.); (J.M.)
| | - Maria Hernandez
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, 35010 Barranco de la Ballena s/n, Las Palmas de Gran Canaria, Spain; (J.F.P.); (A.S.); (M.H.); (C.E.); (A.J.O.); (D.C.); (S.B.); (C.S.); (M.M.); (J.M.)
| | - Carlos Espino
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, 35010 Barranco de la Ballena s/n, Las Palmas de Gran Canaria, Spain; (J.F.P.); (A.S.); (M.H.); (C.E.); (A.J.O.); (D.C.); (S.B.); (C.S.); (M.M.); (J.M.)
| | - Aruma J. O’Shanahan
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, 35010 Barranco de la Ballena s/n, Las Palmas de Gran Canaria, Spain; (J.F.P.); (A.S.); (M.H.); (C.E.); (A.J.O.); (D.C.); (S.B.); (C.S.); (M.M.); (J.M.)
| | - David Carrera
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, 35010 Barranco de la Ballena s/n, Las Palmas de Gran Canaria, Spain; (J.F.P.); (A.S.); (M.H.); (C.E.); (A.J.O.); (D.C.); (S.B.); (C.S.); (M.M.); (J.M.)
| | - Sara Bisshopp
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, 35010 Barranco de la Ballena s/n, Las Palmas de Gran Canaria, Spain; (J.F.P.); (A.S.); (M.H.); (C.E.); (A.J.O.); (D.C.); (S.B.); (C.S.); (M.M.); (J.M.)
| | - Coralia Sosa
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, 35010 Barranco de la Ballena s/n, Las Palmas de Gran Canaria, Spain; (J.F.P.); (A.S.); (M.H.); (C.E.); (A.J.O.); (D.C.); (S.B.); (C.S.); (M.M.); (J.M.)
| | - Mariano Marquez
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, 35010 Barranco de la Ballena s/n, Las Palmas de Gran Canaria, Spain; (J.F.P.); (A.S.); (M.H.); (C.E.); (A.J.O.); (D.C.); (S.B.); (C.S.); (M.M.); (J.M.)
| | - Rafael Camacho
- Department of Pathological Anatomy, University Hospital Doctor Negrin of Gran Canaria, 35010 Barranco de la Ballena s/n, Las Palmas de Gran Canaria, Spain; (R.C.); (M.d.l.L.P.)
| | - Maria de la Luz Plaza
- Department of Pathological Anatomy, University Hospital Doctor Negrin of Gran Canaria, 35010 Barranco de la Ballena s/n, Las Palmas de Gran Canaria, Spain; (R.C.); (M.d.l.L.P.)
| | - Jesus Morera
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, 35010 Barranco de la Ballena s/n, Las Palmas de Gran Canaria, Spain; (J.F.P.); (A.S.); (M.H.); (C.E.); (A.J.O.); (D.C.); (S.B.); (C.S.); (M.M.); (J.M.)
| | - Gustavo M. Callico
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35017 Las Palmas de Gran Canaria, Spain; (R.L.); (H.F.); (S.O.); (G.M.C.)
| |
Collapse
|
27
|
Fu C, Ma K, Li Z, Wang H, Chen T, Zhang D, Wang S, Mu N, Yang C, Zhao L, Gong S, Feng H, Li F. Rapid, label-free detection of cerebral ischemia in rats using hyperspectral imaging. J Neurosci Methods 2019; 329:108466. [PMID: 31628961 DOI: 10.1016/j.jneumeth.2019.108466] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2019] [Revised: 10/14/2019] [Accepted: 10/15/2019] [Indexed: 01/27/2023]
Abstract
BACKGROUND Stroke is the third most common cause of disability and the second most common cause of death worldwide. Ischemia, one of the two broad categories of stroke, is characterized by a lack of sufficient amounts of blood in order to supply an adequate amount of oxygen and nutrients. It is important to assess the part of the brain that becomes ischemic and necrotic during neurosurgery or experiments in real time. However, there is currently no effective means to achieve this goal. NEW METHOD We proposed a method based on hyperspectral imaging (HSI) for the real-time detection of a varied range of ischemic brain tissues in vivo or ex vivo and assessed the practical utility of a model of ischemic stroke in rats. RESULTS The results showed that hyperspectral images processed with a ratio of spectral reflectance at 545 and 560 nm (R545/R560) could identify early brain ischemia and accurately show regions of ischemia. COMPARISON WITH EXISTING METHODS We verified the area imaged by HSI using hematoxylin and eosin (HE) and 2, 3, 5-triphenyltetrazolium chloride (TTC) staining methods. This technique could precisely image the ischemic part of the brain in vivo and ex vivo. CONCLUSIONS These results demonstrate the practical utility of HSI for the real-time detection of cerebral ischemia in rats. By providing rapid assessment of brain tissue perfusion, HSI may help doctors recognize ischemic regions quickly and precisely during surgery as well as have great utility in the experimental process.
Collapse
Affiliation(s)
- Chuhua Fu
- Department of Neurosurgery, Southwest Hospital, Third Military Medical University, Chongqing, 400038, China; Department of Neurosurgery, Xiangyang No. 1 People's Hospital, Hubei University of Medicine, Xiangyang, 441000, China
| | - Kang Ma
- Department of Neurosurgery, Southwest Hospital, Third Military Medical University, Chongqing, 400038, China
| | - Zhao Li
- Department of Neurosurgery, Southwest Hospital, Third Military Medical University, Chongqing, 400038, China
| | - Haifeng Wang
- Institute of Fluid Physics, China Academy of Engineering Physics, Mianyang, Sichuan Province, 621900, China
| | - Tunan Chen
- Department of Neurosurgery, Southwest Hospital, Third Military Medical University, Chongqing, 400038, China
| | - Dayong Zhang
- Institute of Fluid Physics, China Academy of Engineering Physics, Mianyang, Sichuan Province, 621900, China
| | - Shi Wang
- Department of Neurosurgery, Southwest Hospital, Third Military Medical University, Chongqing, 400038, China
| | - Ning Mu
- Department of Neurosurgery, Southwest Hospital, Third Military Medical University, Chongqing, 400038, China
| | - Chuanyan Yang
- Department of Neurosurgery, Southwest Hospital, Third Military Medical University, Chongqing, 400038, China
| | - Lu Zhao
- Department of Neurosurgery, Southwest Hospital, Third Military Medical University, Chongqing, 400038, China
| | - Sheng Gong
- Department of Neurosurgery, Southwest Hospital, Third Military Medical University, Chongqing, 400038, China
| | - Hua Feng
- Department of Neurosurgery, Southwest Hospital, Third Military Medical University, Chongqing, 400038, China
| | - Fei Li
- Department of Neurosurgery, Southwest Hospital, Third Military Medical University, Chongqing, 400038, China.
| |
Collapse
|
28
|
Damodaran M, Amelink A, Feroldi F, Lochocki B, Davidoiu V, de Boer JF. In vivo subdiffuse scanning laser oximetry of the human retina. JOURNAL OF BIOMEDICAL OPTICS 2019; 24:1-14. [PMID: 31571433 PMCID: PMC6997660 DOI: 10.1117/1.jbo.24.9.096009] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/22/2019] [Accepted: 09/09/2019] [Indexed: 06/10/2023]
Abstract
Scanning laser ophthalmoscopes (SLOs) have the potential to perform high speed, high contrast, functional imaging of the human retina for diagnosis and follow-up of retinal diseases. Commercial SLOs typically use a monochromatic laser source or a superluminescent diode for imaging. Multispectral SLOs using an array of laser sources for spectral imaging have been demonstrated in research settings, with applications mainly aiming at retinal oxygenation measurements. Previous SLO-based oximetry techniques are predominantly based on wavelengths that depend on laser source availability. We describe an SLO system based on a supercontinuum (SC) source and a double-clad fiber using the single-mode core for illumination and the larger inner cladding for quasi-confocal detection to increase throughput and signal-to-noise ratio. A balanced detection scheme was implemented to suppress the relative intensity noise of the SC source. The SLO produced dual wavelength, high-quality images at 10 frames / s with a maximum 20 deg imaging field-of-view with any desired combination of wavelengths in the visible spectrum. We demonstrate SLO-based dual-wavelength oximetry in vessels down to 50 μm in diameter. Reproducibility was demonstrated by performing three different imaging sessions of the same volunteer, 8 min apart. Finally, by performing a wavelength sweep between 485 and 608 nm, we determined, for our SLO geometry, an approximately linear relationship between the effective path length of photons through the blood vessels and the vessel diameter.
Collapse
Affiliation(s)
- Mathi Damodaran
- Vrije Universiteit Amsterdam, LaserLaB, Department of Physics and Astronomy, Amsterdam, The Netherlands
| | - Arjen Amelink
- Netherlands Organization for Applied Scientific Research TNO, Department of Optics, Delft, The Netherlands
| | - Fabio Feroldi
- Vrije Universiteit Amsterdam, LaserLaB, Department of Physics and Astronomy, Amsterdam, The Netherlands
| | - Benjamin Lochocki
- Vrije Universiteit Amsterdam, LaserLaB, Department of Physics and Astronomy, Amsterdam, The Netherlands
| | - Valentina Davidoiu
- Vrije Universiteit Amsterdam, LaserLaB, Department of Physics and Astronomy, Amsterdam, The Netherlands
| | - Johannes F. de Boer
- Vrije Universiteit Amsterdam, LaserLaB, Department of Physics and Astronomy, Amsterdam, The Netherlands
- Amsterdam UMC, Ophthalmology Department, Amsterdam, The Netherlands
| |
Collapse
|
29
|
Alterini T, Díaz-Doutón F, Burgos-Fernández FJ, González L, Mateo C, Vilaseca M. Fast visible and extended near-infrared multispectral fundus camera. JOURNAL OF BIOMEDICAL OPTICS 2019; 24:1-7. [PMID: 31538437 PMCID: PMC6997669 DOI: 10.1117/1.jbo.24.9.096007] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2019] [Accepted: 08/07/2019] [Indexed: 05/15/2023]
Abstract
We present a multispectral fundus camera that performs fast imaging of the ocular posterior pole in the visible and near-infrared (400 to 1300 nm) wavelengths through 15 spectral bands, using a flashlight source made of light-emitting diodes, and CMOS and InGaAs cameras. We investigate the potential of this system for visualizing occult and overlapping structures of the retina in the unexplored wavelength range beyond 900 nm, in which radiation can penetrate deeper into the tissue. Reflectance values at each pixel are also retrieved from the acquired images in the analyzed spectral range. The available spectroscopic information and the visualization of retinal structures, specifically the choroidal vasculature and drusen-induced retinal pigment epithelium degeneration, which are hardly visible in conventional color fundus images, underline the clinical potential of this system as a new tool for ophthalmic diagnosis.
Collapse
Affiliation(s)
- Tommaso Alterini
- Universitat Politècnica de Catalunya, Center for Sensors, Instruments and Systems Development (CD6), Terrassa, Barcelona, Spain
- Address all correspondence to Tommaso Alterini, E-mail:
| | - Fernando Díaz-Doutón
- Universitat Politècnica de Catalunya, Center for Sensors, Instruments and Systems Development (CD6), Terrassa, Barcelona, Spain
| | - Francisco J. Burgos-Fernández
- Universitat Politècnica de Catalunya, Center for Sensors, Instruments and Systems Development (CD6), Terrassa, Barcelona, Spain
| | | | - Carlos Mateo
- Instituto de Microcirugía Ocular, Barcelona, Spain
| | - Meritxell Vilaseca
- Universitat Politècnica de Catalunya, Center for Sensors, Instruments and Systems Development (CD6), Terrassa, Barcelona, Spain
| |
Collapse
|
30
|
Halicek M, Fabelo H, Ortega S, Callico GM, Fei B. In-Vivo and Ex-Vivo Tissue Analysis through Hyperspectral Imaging Techniques: Revealing the Invisible Features of Cancer. Cancers (Basel) 2019; 11:E756. [PMID: 31151223 PMCID: PMC6627361 DOI: 10.3390/cancers11060756] [Citation(s) in RCA: 96] [Impact Index Per Article: 19.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2019] [Revised: 05/20/2019] [Accepted: 05/24/2019] [Indexed: 12/27/2022] Open
Abstract
In contrast to conventional optical imaging modalities, hyperspectral imaging (HSI) is able to capture much more information from a certain scene, both within and beyond the visual spectral range (from 400 to 700 nm). This imaging modality is based on the principle that each material provides different responses to light reflection, absorption, and scattering across the electromagnetic spectrum. Due to these properties, it is possible to differentiate and identify the different materials/substances presented in a certain scene by their spectral signature. Over the last two decades, HSI has demonstrated potential to become a powerful tool to study and identify several diseases in the medical field, being a non-contact, non-ionizing, and a label-free imaging modality. In this review, the use of HSI as an imaging tool for the analysis and detection of cancer is presented. The basic concepts related to this technology are detailed. The most relevant, state-of-the-art studies that can be found in the literature using HSI for cancer analysis are presented and summarized, both in-vivo and ex-vivo. Lastly, we discuss the current limitations of this technology in the field of cancer detection, together with some insights into possible future steps in the improvement of this technology.
Collapse
Affiliation(s)
- Martin Halicek
- Department of Bioengineering, The University of Texas at Dallas, 800 W. Campbell Road, Richardson, TX 75080, USA.
- Department of Biomedical Engineering, Emory University and The Georgia Institute of Technology, 1841 Clifton Road NE, Atlanta, GA 30329, USA.
| | - Himar Fabelo
- Department of Bioengineering, The University of Texas at Dallas, 800 W. Campbell Road, Richardson, TX 75080, USA.
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35017 Las Palmas de Gran Canaria, Spain.
| | - Samuel Ortega
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35017 Las Palmas de Gran Canaria, Spain.
| | - Gustavo M Callico
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35017 Las Palmas de Gran Canaria, Spain.
| | - Baowei Fei
- Department of Bioengineering, The University of Texas at Dallas, 800 W. Campbell Road, Richardson, TX 75080, USA.
- Advanced Imaging Research Center, University of Texas Southwestern Medical Center, 5323 Harry Hine Blvd, Dallas, TX 75390, USA.
- Department of Radiology, University of Texas Southwestern Medical Center, 5323 Harry Hine Blvd, Dallas, TX 75390, USA.
| |
Collapse
|
31
|
Retinal oximetry: Metabolic imaging for diseases of the retina and brain. Prog Retin Eye Res 2019; 70:1-22. [DOI: 10.1016/j.preteyeres.2019.04.001] [Citation(s) in RCA: 62] [Impact Index Per Article: 12.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2018] [Revised: 03/27/2019] [Accepted: 04/10/2019] [Indexed: 12/20/2022]
|
32
|
Ortega S, Fabelo H, Iakovidis DK, Koulaouzidis A, Callico GM. Use of Hyperspectral/Multispectral Imaging in Gastroenterology. Shedding Some⁻Different⁻Light into the Dark. J Clin Med 2019; 8:E36. [PMID: 30609685 PMCID: PMC6352071 DOI: 10.3390/jcm8010036] [Citation(s) in RCA: 61] [Impact Index Per Article: 12.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2018] [Revised: 12/14/2018] [Accepted: 12/26/2018] [Indexed: 01/27/2023] Open
Abstract
Hyperspectral/Multispectral imaging (HSI/MSI) technologies are able to sample from tens to hundreds of spectral channels within the electromagnetic spectrum, exceeding the capabilities of human vision. These spectral techniques are based on the principle that every material has a different response (reflection and absorption) to different wavelengths. Thereby, this technology facilitates the discrimination between different materials. HSI has demonstrated good discrimination capabilities for materials in fields, for instance, remote sensing, pollution monitoring, field surveillance, food quality, agriculture, astronomy, geological mapping, and currently, also in medicine. HSI technology allows tissue observation beyond the limitations of the human eye. Moreover, many researchers are using HSI as a new diagnosis tool to analyze optical properties of tissue. Recently, HSI has shown good performance in identifying human diseases in a non-invasive manner. In this paper, we show the potential use of these technologies in the medical domain, with emphasis in the current advances in gastroenterology. The main aim of this review is to provide an overview of contemporary concepts regarding HSI technology together with state-of-art systems and applications in gastroenterology. Finally, we discuss the current limitations and upcoming trends of HSI in gastroenterology.
Collapse
Affiliation(s)
- Samuel Ortega
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), Las Palmas de Gran Canaria 35017, Spain.
| | - Himar Fabelo
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), Las Palmas de Gran Canaria 35017, Spain.
| | - Dimitris K Iakovidis
- Dept. of Computer Science and Biomedical Informatics, University of Thessaly, 35131 Lamia, Greece.
| | | | - Gustavo M Callico
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), Las Palmas de Gran Canaria 35017, Spain.
| |
Collapse
|
33
|
Ex Vivo Hyperspectral Autofluorescence Imaging and Localization of Fluorophores in Human Eyes with Age-Related Macular Degeneration. Vision (Basel) 2018; 2:vision2040038. [PMID: 31735901 PMCID: PMC6835627 DOI: 10.3390/vision2040038] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2018] [Revised: 05/19/2018] [Accepted: 09/12/2018] [Indexed: 12/28/2022] Open
Abstract
To characterize fluorophore signals from drusen and retinal pigment epithelium (RPE) and their changes in age related macular degeneration (AMD), the authors describe advances in ex vivo hyperspectral autofluorescence (AF) imaging of human eye tissue. Ten RPE flatmounts from eyes with AMD and 10 from eyes without AMD underwent 40× hyperspectral AF microscopic imaging. The number of excitation wavelengths tested was initially two (436 nm and 480 nm), then increased to three (436 nm, 480 nm, and 505 nm). Emission spectra were collected at 10 nm intervals from 420 nm to 720 nm. Non-negative matrix factorization (NMF) algorithms decomposed the hyperspectral images into individual emission spectra and their spatial abundances. These include three distinguishable spectra for RPE fluorophores (S1, S2, and S3) in both AMD and non-AMD eyes, a spectrum for drusen (SDr) only in AMD eyes, and a Bruch's membrane spectrum that was detectable in normal eyes. Simultaneous analysis of datacubes excited atthree excitation wavelengths revealed more detailed spatial localization of the RPE spectra and SDr within drusen than exciting only at two wavelengths. Within AMD and non-AMD groups, two different NMF initialization methods were tested on each group and converged to qualitatively similar spectra. In AMD, the peaks of the SDr at ~510 nm (436 nm excitation) were particularly consistent. Between AMD and non-AMD groups, corresponding spectra in common, S1, S2, and S3, also had similar peak locations and shapes, but with some differences and further characterization warranted.
Collapse
|
34
|
Hyperspectral Image Mapping Spectrometry for Retinal Oximetry Measurements in Four Diseased Eyes. Int Ophthalmol Clin 2018; 56:25-38. [PMID: 27575756 DOI: 10.1097/iio.0000000000000139] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
|
35
|
Damodaran M, Amelink A, de Boer JF. Optimal wavelengths for subdiffuse scanning laser oximetry of the human retina. JOURNAL OF BIOMEDICAL OPTICS 2018; 23:1-15. [PMID: 30152203 DOI: 10.1117/1.jbo.23.8.086003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/07/2018] [Accepted: 08/02/2018] [Indexed: 06/08/2023]
Abstract
Retinal blood vessel oxygenation is considered to be an important marker for numerous eye diseases. Oxygenation is typically assessed by imaging the retinal vessels at different wavelengths using multispectral imaging techniques, where the choice of wavelengths will affect the achievable measurement accuracy. Here, we present a detailed analysis of the error propagation of measurement noise in retinal oximetry, to identify optimal wavelengths that will yield the lowest uncertainty in saturation estimation for a given measurement noise level. In our analysis, we also investigate the effect of hemoglobin packing in discrete blood vessels (pigment packaging), which may result in a nonnegligible bias in saturation estimation if unaccounted for under specific geometrical conditions, such as subdiffuse sampling of smaller blood vessels located deeper within the retina. Our analyses show that using 470, 506, and 592 nm, a fairly accurate estimation of the whole oxygen saturation regime [0 1] can be realized, even in the presence of the pigment packing effect. To validate the analysis, we developed a scanning laser ophthalmoscope to produce high contrast images with a maximum pixel rate of 60 kHz and a maximum 30-deg imaging field of view. Confocal reflectance measurements were then conducted on a tissue-mimicking scattering phantom with optical properties similar to retinal tissue including narrow channels filled with absorbing dyes to mimic blood vessels. By imaging at three optimal wavelengths, the saturation of the dye combination was calculated. The experimental values show good agreement with our theoretical derivations.
Collapse
Affiliation(s)
- Mathi Damodaran
- Vrije Universiteit Amsterdam, LaserLaB, Department of Physics and Astronomy, Amsterdam, The Netherlands
| | - Arjen Amelink
- Netherlands Organisation for Applied Scientific Research TNO, Department of Optics, Delft, The Netherlands
| | - Johannes F de Boer
- Vrije Universiteit Amsterdam, LaserLaB, Department of Physics and Astronomy, Amsterdam, The Netherlands
| |
Collapse
|
36
|
Weber TD, Mertz J. Non-mydriatic chorioretinal imaging in a transmission geometry and application to retinal oximetry. BIOMEDICAL OPTICS EXPRESS 2018; 9:3867-3882. [PMID: 30338161 PMCID: PMC6191618 DOI: 10.1364/boe.9.003867] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/07/2018] [Revised: 07/12/2018] [Accepted: 07/12/2018] [Indexed: 05/07/2023]
Abstract
The human retina is typically imaged in a reflection geometry, where light is delivered through the pupil and images are formed from the light reflected back from the retina. In this configuration, artifacts caused by retinal surface reflex are often encountered, which complicate quantitative interpretation of the reflection images. We present an alternative illumination method, which avoids these artifacts. The method uses deeply penetrating near-infrared (NIR) light delivered transcranially from the side of the head, and exploits multiple scattering to redirect a portion of the light towards the posterior eye. This unique transmission geometry simplifies absorption measurements and enables flash-free, non-mydriatic imaging as deep as the choroid. Images taken with this new transillumination approach are applied to retinal oximetry.
Collapse
Affiliation(s)
- Timothy D. Weber
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston, Massachusetts 02215,
USA
| | - Jerome Mertz
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston, Massachusetts 02215,
USA
- Photonics Center, Boston University, 8 Saint Mary’s Street, Boston, Massachusetts 02215,
USA
| |
Collapse
|
37
|
Ortega S, Fabelo H, Camacho R, de la Luz Plaza M, Callicó GM, Sarmiento R. Detecting brain tumor in pathological slides using hyperspectral imaging. BIOMEDICAL OPTICS EXPRESS 2018; 9:818-831. [PMID: 29552415 PMCID: PMC5854081 DOI: 10.1364/boe.9.000818] [Citation(s) in RCA: 48] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/08/2018] [Revised: 01/10/2018] [Accepted: 01/19/2018] [Indexed: 05/16/2023]
Abstract
Hyperspectral imaging (HSI) is an emerging technology for medical diagnosis. This research work presents a proof-of-concept on the use of HSI data to automatically detect human brain tumor tissue in pathological slides. The samples, consisting of hyperspectral cubes collected from 400 nm to 1000 nm, were acquired from ten different patients diagnosed with high-grade glioma. Based on the diagnosis provided by pathologists, a spectral library of normal and tumor tissues was created and processed using three different supervised classification algorithms. Results prove that HSI is a suitable technique to automatically detect high-grade tumors from pathological slides.
Collapse
Affiliation(s)
- Samuel Ortega
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), Campus de Tafira, 35017, Las Palmas de Gran Canaria, Las Palmas, Spain
| | - Himar Fabelo
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), Campus de Tafira, 35017, Las Palmas de Gran Canaria, Las Palmas, Spain
| | - Rafael Camacho
- Department of Pathological Anatomy, University Hospital Dr. Negrín, Las Palmas de Gran Canaria. Barranco de la Ballena, 35010, Las Palmas de Gran Canaria, Las Palmas, Spain
| | - María de la Luz Plaza
- Department of Pathological Anatomy, University Hospital Dr. Negrín, Las Palmas de Gran Canaria. Barranco de la Ballena, 35010, Las Palmas de Gran Canaria, Las Palmas, Spain
| | - Gustavo M. Callicó
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), Campus de Tafira, 35017, Las Palmas de Gran Canaria, Las Palmas, Spain
| | - Roberto Sarmiento
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), Campus de Tafira, 35017, Las Palmas de Gran Canaria, Las Palmas, Spain
| |
Collapse
|
38
|
|
39
|
Hyperspectral Image Enhancement and Mixture Deep-Learning Classification of Corneal Epithelium Injuries. SENSORS 2017; 17:s17112644. [PMID: 29144388 PMCID: PMC5713052 DOI: 10.3390/s17112644] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/19/2017] [Revised: 11/08/2017] [Accepted: 11/09/2017] [Indexed: 12/02/2022]
Abstract
In our preliminary study, the reflectance signatures obtained from hyperspectral imaging (HSI) of normal and abnormal corneal epithelium tissues of porcine show similar morphology with subtle differences. Here we present image enhancement algorithms that can be used to improve the interpretability of data into clinically relevant information to facilitate diagnostics. A total of 25 corneal epithelium images without the application of eye staining were used. Three image feature extraction approaches were applied for image classification: (i) image feature classification from histogram using a support vector machine with a Gaussian radial basis function (SVM-GRBF); (ii) physical image feature classification using deep-learning Convolutional Neural Networks (CNNs) only; and (iii) the combined classification of CNNs and SVM-Linear. The performance results indicate that our chosen image features from the histogram and length-scale parameter were able to classify with up to 100% accuracy; particularly, at CNNs and CNNs-SVM, by employing 80% of the data sample for training and 20% for testing. Thus, in the assessment of corneal epithelium injuries, HSI has high potential as a method that could surpass current technologies regarding speed, objectivity, and reliability.
Collapse
|
40
|
Carles G, Muyo G, van Hemert J, Harvey AR. Combined high contrast and wide field of view in the scanning laser ophthalmoscope through dual detection of light paths. JOURNAL OF BIOMEDICAL OPTICS 2017; 22:1-10. [PMID: 29098812 DOI: 10.1117/1.jbo.22.11.116002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2017] [Accepted: 10/11/2017] [Indexed: 06/07/2023]
Abstract
We demonstrate a multimode detection system in a scanning laser ophthalmoscope (SLO) that enables simultaneous operation in confocal, indirect, and direct modes to permit an agile trade between image contrast and optical sensitivity across the retinal field of view to optimize the overall imaging performance, enabling increased contrast in very wide-field operation. We demonstrate the method on a wide-field SLO employing a hybrid pinhole at its image plane, to yield a twofold increase in vasculature contrast in the central retina compared to its conventional direct mode while retaining high-quality imaging across a wide field of the retina, of up to 200 deg and 20 μm on-axis resolution.
Collapse
Affiliation(s)
- Guillem Carles
- University of Glasgow, School of Physics and Astronomy, Glasgow, United Kingdom
| | | | | | - Andrew R Harvey
- University of Glasgow, School of Physics and Astronomy, Glasgow, United Kingdom
| |
Collapse
|
41
|
Huang XR, Knighton RW, Spector YZ, Qiao J, Kong W, Zhao Q. Reflectance Spectrum and Birefringence of the Retinal Nerve Fiber Layer With Hypertensive Damage of Axonal Cytoskeleton. Invest Ophthalmol Vis Sci 2017; 58:2118-2129. [PMID: 28395028 PMCID: PMC5386346 DOI: 10.1167/iovs.16-20553] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022] Open
Abstract
Purpose Glaucoma damages the retinal nerve fiber layer (RNFL). This study used precise multimodal image registration to investigate the changes of the RNFL reflectance spectrum and birefringence in nerve fiber bundles with different degrees of axonal damage. Methods The reflectance spectrum of individual nerve fiber bundles in normal rats and rats with experimental glaucoma was measured from 400 to 830 nm and their birefringence was measured at 500 nm. Optical measurements of the same bundles were made at different distances from the optic nerve head (ONH). After the optical measurements, the axonal cytoskeleton of the RNFL was evaluated by confocal microscopy to assess the severity of cytoskeletal change. Results For normal bundles, the shape of the RNFL reflectance spectrum and the value of RNFL birefringence did not change along bundles. In treated retinas, damage to the cytoskeleton varied within and across retinas. The damage in retinal sectors was subjectively graded from normal-looking to severe. Change of spectral shape occurred near the ONH in all sectors studied. This change became more prominent and occurred farther from the ONH with increased damage severity. In contrast, RNFL birefringence did not show change in normal-looking sectors, but decreased in sectors with mild and moderate damage. The birefringence of severely damaged sectors was either within or below the normal range. Conclusions Varying degrees of cytoskeletal damage affect the RNFL reflectance spectrum and birefringence differently, supporting differences in the ultrastructural basis for the two optical properties. Both properties, however, may provide a means to detect disease and to estimate ultrastructural damage of the RNFL in glaucoma.
Collapse
Affiliation(s)
- Xiang-Run Huang
- Bascom Palmer Eye Institute, University of Miami Miller School of Medicine, Miami, Florida, United States
| | - Robert W Knighton
- Bascom Palmer Eye Institute, University of Miami Miller School of Medicine, Miami, Florida, United States
| | - Ye Z Spector
- Bascom Palmer Eye Institute, University of Miami Miller School of Medicine, Miami, Florida, United States
| | - Jianzhong Qiao
- Bascom Palmer Eye Institute, University of Miami Miller School of Medicine, Miami, Florida, United States
| | - Wei Kong
- Bascom Palmer Eye Institute, University of Miami Miller School of Medicine, Miami, Florida, United States
| | - Qi Zhao
- Bascom Palmer Eye Institute, University of Miami Miller School of Medicine, Miami, Florida, United States
| |
Collapse
|
42
|
Li H, Liu W, Dong B, Kaluzny JV, Fawzi AA, Zhang HF. Snapshot hyperspectral retinal imaging using compact spectral resolving detector array. JOURNAL OF BIOPHOTONICS 2017; 10:830-839. [PMID: 27434875 PMCID: PMC5063234 DOI: 10.1002/jbio.201600053] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/23/2016] [Revised: 05/17/2016] [Accepted: 06/14/2016] [Indexed: 05/07/2023]
Abstract
Hyperspectral retinal imaging captures the light spectrum from each imaging pixel. It provides spectrally encoded retinal physiological and morphological information, which could potentially benefit diagnosis and therapeutic monitoring of retinal diseases. The key challenges in hyperspectral retinal imaging are how to achieve snapshot imaging to avoid motions between the images from multiple spectral bands, and how to design a compact snapshot imager suitable for clinical use. Here, we developed a compact, snapshot hyperspectral fundus camera for rodents using a novel spectral resolving detector array (SRDA), on which a thin-film Fabry-Perot cavity filter was monolithically fabricated on each imaging pixel. We achieved hyperspectral retinal imaging with 16 wavelength bands (460 to 630 nm) at 20 fps. We also demonstrated false-color vessel contrast enhancement and retinal oxygen saturation (sO2 ) measurement through spectral analysis. This work could potentially bring hyperspectral retinal imaging from bench to bedside.
Collapse
Affiliation(s)
- Hao Li
- Department of Biomedical Engineering, Northwestern University, Evanston, IL 60208, USA
| | - Wenzhong Liu
- Department of Biomedical Engineering, Northwestern University, Evanston, IL 60208, USA
| | - Biqin Dong
- Department of Biomedical Engineering, Northwestern University, Evanston, IL 60208, USA
| | - Joel V. Kaluzny
- Department of Ophthalmology, Northwestern University, Chicago, IL 60611, USA
| | - Amani A. Fawzi
- Department of Ophthalmology, Northwestern University, Chicago, IL 60611, USA
- Corresponding authors: ;
| | - Hao F. Zhang
- Department of Biomedical Engineering, Northwestern University, Evanston, IL 60208, USA
- Department of Ophthalmology, Northwestern University, Chicago, IL 60611, USA
- Corresponding authors: ;
| |
Collapse
|
43
|
Affiliation(s)
- Lewis. E. MacKenzie
- School of Biomedical Sciences, University of Leeds, Garstang Building Leeds, Leeds, UK
| | - Andy. R. Harvey
- School of Physics and Astronomy, Kelvin Building University of Glasgow University Avenue, Glasgow, UK
| | | |
Collapse
|
44
|
HYPERSPECTRAL AUTOFLUORESCENCE IMAGING OF DRUSEN AND RETINAL PIGMENT EPITHELIUM IN DONOR EYES WITH AGE-RELATED MACULAR DEGENERATION. Retina 2017; 36 Suppl 1:S127-S136. [PMID: 28005671 DOI: 10.1097/iae.0000000000001325] [Citation(s) in RCA: 42] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
PURPOSE To elucidate the molecular pathogenesis of age-related macular degeneration (AMD) and interpretation of fundus autofluorescence imaging, the authors identified spectral autofluorescence characteristics of drusen and retinal pigment epithelium (RPE) in donor eyes with AMD. METHODS Macular RPE/Bruch membrane flat mounts were prepared from 5 donor eyes with AMD. In 12 locations (1-3 per eye), hyperspectral autofluorescence images in 10-nm-wavelength steps were acquired at 2 excitation wavelengths (λex 436, 480 nm). A nonnegative tensor factorization algorithm was used to recover 5 abundant emission spectra and their corresponding spatial localizations. RESULTS At λex 436 nm, the authors consistently localized a novel spectrum (SDr) with a peak emission near 510 nm in drusen and sub-RPE deposits. Abundant emission spectra seen previously (S0 in Bruch membrane and S1, S2, and S3 in RPE lipofuscin/melanolipofuscin, respectively) also appeared in AMD eyes, with the same shapes and peak wavelengths as in normal tissue. Lipofuscin/melanolipofuscin spectra localizations in AMD eyes varied widely in their overlap with drusen, ranging from none to complete. CONCLUSION An emission spectrum peaking at ∼510 nm (λex 436 nm) appears to be sensitive and specific for drusen and sub-RPE deposits. One or more abundant spectra from RPE organelles exhibit characteristic relationships with drusen.
Collapse
|
45
|
Chen S, Shu X, Nesper PL, Liu W, Fawzi AA, Zhang HF. Retinal oximetry in humans using visible-light optical coherence tomography [Invited]. BIOMEDICAL OPTICS EXPRESS 2017; 8:1415-1429. [PMID: 28663838 PMCID: PMC5480553 DOI: 10.1364/boe.8.001415] [Citation(s) in RCA: 30] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/21/2016] [Revised: 02/01/2017] [Accepted: 02/01/2017] [Indexed: 05/18/2023]
Abstract
We measured hemoglobin oxygen saturation (sO2) in the retinal circulation in healthy humans using visible-light optical coherence tomography (vis-OCT). The measurements showed clear oxygenation differences between central retinal arteries and veins close to the optic nerve head. Spatial variations at different vascular branching levels were also revealed. In addition, we presented theoretical and experimental results to establish that noises in OCT intensity followed Rice distribution. We used this knowledge to retrieve unbiased estimation of true OCT intensity to improve the accuracy of vis-OCT oximetry, which had inherently lower signal-to-nose ratio from human eyes due to safety and comfort limitations. We demonstrated that the new statistical-fitting sampling strategy could reduce the estimation error in sO2 by three percentage points (pp). The presented work aims to provide a foundation for using vis-OCT to achieve accurate retinal oximetry in clinical settings.
Collapse
Affiliation(s)
- Siyu Chen
- Department of Biomedical Engineering, Northwestern University, Evanston, IL 60208, USA
| | - Xiao Shu
- Department of Biomedical Engineering, Northwestern University, Evanston, IL 60208, USA
| | - Peter L. Nesper
- Department of Ophthalmology, Northwestern University, Chicago, IL 60611, USA
| | - Wenzhong Liu
- Department of Biomedical Engineering, Northwestern University, Evanston, IL 60208, USA
- Currently with Opticent Health, Evanston, IL 60208, USA
| | - Amani A. Fawzi
- Department of Ophthalmology, Northwestern University, Chicago, IL 60611, USA
| | - Hao F. Zhang
- Department of Biomedical Engineering, Northwestern University, Evanston, IL 60208, USA
- Department of Ophthalmology, Northwestern University, Chicago, IL 60611, USA
| |
Collapse
|
46
|
van der Putten MA, MacKenzie LE, Davies AL, Fernandez-Ramos J, Desai RA, Smith KJ, Harvey AR. A multispectral microscope for in vivo oximetry of rat dorsal spinal cord vasculature. Physiol Meas 2016; 38:205-218. [PMID: 28001129 DOI: 10.1088/1361-6579/aa5527] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Quantification of blood oxygen saturation (SO2) in vivo is essential for understanding the pathogenesis of diseases in which hypoxia is thought to play a role, including inflammatory disorders such as multiple sclerosis (MS) and rheumatoid arthritis (RA). We describe a low-cost multispectral microscope and oximetry technique for calibration-free absolute oximetry of surgically exposed blood vessels in vivo. We imaged the vasculature of the dorsal spinal cord in healthy rats, and varied inspired oxygen (FiO2) in order to evaluate the sensitivity of the imaging system to changes in SO2. The venous SO2 was calculated as 67.8 ± 10.4% (average ± standard deviation), increasing to 83.1 ± 11.6% under hyperoxic conditions (100% FiO2) and returning to 67.4 ± 10.9% for a second normoxic period; the venous SO2 was 50.9 ± 15.5% and 29.2 ± 24.6% during subsequent hypoxic states (18% and 15% FiO2 respectively). We discuss the design and performance of our multispectral imaging system, and the future scope for extending this oximetry technique to quantification of hypoxia in inflamed tissue.
Collapse
|
47
|
DeBuc DC. The Role of Retinal Imaging and Portable Screening Devices in Tele-ophthalmology Applications for Diabetic Retinopathy Management. Curr Diab Rep 2016; 16:132. [PMID: 27841014 DOI: 10.1007/s11892-016-0827-2] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Abstract
In the years since its introduction, retinal imaging has transformed our capability to visualize the posterior pole of the eye. Increasing practical advances in mobile technology, regular monitoring, and population screening for diabetic retinopathy management offer the opportunity for further development of cost-effective applications through remote assessment of the diabetic eye using portable retinal cameras, smart-phone-based devices and telemedicine networks. Numerous retinal imaging methods and mobile technologies in tele-ophthalmology applications have been reported for diabetic retinopathy screening and management. They provide several advantages of automation, sensitivity, specificity, portability, and miniaturization for the development of point-of-care diagnostics for eye complications in diabetes. The aim of this paper is to review the role of retinal imaging and mobile technologies in tele-ophthalmology applications for diabetic retinopathy screening and management. At large, although improvements in current technology and telemedicine services are still needed, telemedicine has demonstrated to be a worthy tool to support health caregivers in the effective management and prevention of diabetes and its complications.
Collapse
Affiliation(s)
- Delia Cabrera DeBuc
- Bascom Palmer Eye Institute, University of Miami Miller School of Medicine, 900 NW 17th Street, Miami, FL, 33136, USA.
| |
Collapse
|
48
|
Kaluzny J, Li H, Liu W, Nesper P, Park J, Zhang HF, Fawzi AA. Bayer Filter Snapshot Hyperspectral Fundus Camera for Human Retinal Imaging. Curr Eye Res 2016; 42:629-635. [PMID: 27767345 DOI: 10.1080/02713683.2016.1221976] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
PURPOSE To demonstrate the versatility and performance of a compact Bayer filter snapshot hyperspectral fundus camera for in-vivo clinical applications including retinal oximetry and macular pigment optical density measurements. METHODS 12 healthy volunteers were recruited under an Institutional Review Board (IRB) approved protocol. Fundus images were taken with a custom hyperspectral camera with a spectral range of 460-630 nm. We determined retinal vascular oxygen saturation (sO2) for the healthy population using the captured spectra by least squares curve fitting. Additionally, macular pigment optical density was localized and visualized using multispectral reflectometry from selected wavelengths. RESULTS We successfully determined the mean sO2 of arteries and veins of each subject (ages 21-80) with excellent intrasubject repeatability (1.4% standard deviation). The mean arterial sO2 for all subjects was 90.9% ± 2.5%, whereas the mean venous sO2 for all subjects was 64.5% ± 3.5%. The mean artery-vein (A-V) difference in sO2 varied between 20.5% and 31.9%. In addition, we were able to reveal and quantify macular pigment optical density. CONCLUSIONS We demonstrated a single imaging tool capable of oxygen saturation and macular pigment density measurements in vivo. The unique combination of broad spectral range, high spectral-spatial resolution, rapid and robust imaging capability, and compact design make this system a valuable tool for multifunction spectral imaging that can be easily performed in a clinic setting.
Collapse
Affiliation(s)
- Joel Kaluzny
- Department of Ophthalmology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Hao Li
- Department of Biomedical Engineering, Northwestern University, Evanston, IL, USA
| | - Wenzhong Liu
- Department of Biomedical Engineering, Northwestern University, Evanston, IL, USA
| | - Peter Nesper
- Department of Ophthalmology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Justin Park
- Department of Ophthalmology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Hao F Zhang
- Department of Ophthalmology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA.,Department of Biomedical Engineering, Northwestern University, Evanston, IL, USA
| | - Amani A Fawzi
- Department of Biomedical Engineering, Northwestern University, Evanston, IL, USA
| |
Collapse
|
49
|
Abstract
Indocyanine green (ICG) is the only near-infrared dye approved by the U.S. Food and Drug Administration for clinical use. When injected in blood, ICG binds primarily to plasma proteins and lipoproteins, resulting in enhanced fluorescence. Recently, the optofluidic laser has emerged as a novel tool in bio-analysis. Laser emission has advantages over fluorescence in signal amplification, narrow linewidth, and strong intensity, leading to orders of magnitude increase in detection sensitivity and imaging contrast. Here we successfully demonstrate, to the best of our knowledge, the first ICG lasing in human serum and whole blood with the clinical ICG concentrations and the pump intensity far below the clinically permissible level. Furthermore, we systematically study ICG laser emission within each major serological component (albumins, globulins, and lipoproteins) and reveal the critical elements and conditions responsible for lasing. Our work marks a critical step toward eventual clinical and biomedical applications of optofluidic lasers using FDA approved fluorophores, which may complement or even supersede conventional fluorescence-based sensing and imaging.
Collapse
Affiliation(s)
- Yu-Cheng Chen
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, 1101 Beal Ave., Ann Arbor, Michigan 48109, USA
| | - Qiushu Chen
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, 1101 Beal Ave., Ann Arbor, Michigan 48109, USA
| | - Xudong Fan
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, 1101 Beal Ave., Ann Arbor, Michigan 48109, USA
| |
Collapse
|
50
|
Garcia-Allende PB, Radrich K, Symvoulidis P, Glatz J, Koch M, Jentoft KM, Ripoll J, Ntziachristos V. Uniqueness in multispectral constant-wave epi-illumination imaging. OPTICS LETTERS 2016; 41:3098-3101. [PMID: 27367111 DOI: 10.1364/ol.41.003098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Multispectral tissue imaging based on optical cameras and continuous-wave tissue illumination is commonly used in medicine and biology. Surprisingly, there is a characteristic absence of a critical look at the quantities that can be uniquely characterized from optically diffuse matter by multispectral imaging. Here, we investigate the fundamental question of uniqueness in epi-illumination measurements from turbid media obtained at multiple wavelengths. By utilizing an analytical model, tissue-mimicking phantoms, and an in vivo imaging experiment we show that independent of the bands employed, spectral measurements cannot uniquely retrieve absorption and scattering coefficients. We also establish that it is, nevertheless, possible to uniquely quantify oxygen saturation and the Mie scattering power-a previously undocumented uniqueness condition.
Collapse
|