1
|
Campbell JM, Habibalahi A, Handley S, Agha A, Mahbub SB, Anwer AG, Goldys EM. Emerging clinical applications in oncology for non-invasive multi- and hyperspectral imaging of cell and tissue autofluorescence. JOURNAL OF BIOPHOTONICS 2023; 16:e202300105. [PMID: 37272291 DOI: 10.1002/jbio.202300105] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 05/02/2023] [Accepted: 05/16/2023] [Indexed: 06/06/2023]
Abstract
Hyperspectral and multispectral imaging of cell and tissue autofluorescence is an emerging technology in which fluorescence imaging is applied to biological materials across multiple spectral channels. This produces a stack of images where each matched pixel contains information about the sample's spectral properties at that location. This allows precise collection of molecularly specific data from a broad range of native fluorophores. Importantly, complex information, directly reflective of biological status, is collected without staining and tissues can be characterised in situ, without biopsy. For oncology, this can spare the collection of biopsies from sensitive regions and enable accurate tumour mapping. For in vivo tumour analysis, the greatest focus has been on oral cancer, whereas for ex vivo assessment head-and-neck cancers along with colon cancer have been the most studied, followed by oral and eye cancer. This review details the scope and progress of research undertaken towards clinical translation in oncology.
Collapse
Affiliation(s)
- Jared M Campbell
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, The University of Adelaide, Adelaide, South Australia, Australia
| | - Abbas Habibalahi
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, The University of Adelaide, Adelaide, South Australia, Australia
| | - Shannon Handley
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, The University of Adelaide, Adelaide, South Australia, Australia
| | - Adnan Agha
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, The University of Adelaide, Adelaide, South Australia, Australia
| | - Saabah B Mahbub
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, The University of Adelaide, Adelaide, South Australia, Australia
| | - Ayad G Anwer
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, The University of Adelaide, Adelaide, South Australia, Australia
| | - Ewa M Goldys
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, The University of Adelaide, Adelaide, South Australia, Australia
| |
Collapse
|
2
|
Tran MH, Fei B. Compact and ultracompact spectral imagers: technology and applications in biomedical imaging. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:040901. [PMID: 37035031 PMCID: PMC10075274 DOI: 10.1117/1.jbo.28.4.040901] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Accepted: 02/27/2023] [Indexed: 05/18/2023]
Abstract
Significance Spectral imaging, which includes hyperspectral and multispectral imaging, can provide images in numerous wavelength bands within and beyond the visible light spectrum. Emerging technologies that enable compact, portable spectral imaging cameras can facilitate new applications in biomedical imaging. Aim With this review paper, researchers will (1) understand the technological trends of upcoming spectral cameras, (2) understand new specific applications that portable spectral imaging unlocked, and (3) evaluate proper spectral imaging systems for their specific applications. Approach We performed a comprehensive literature review in three databases (Scopus, PubMed, and Web of Science). We included only fully realized systems with definable dimensions. To best accommodate many different definitions of "compact," we included a table of dimensions and weights for systems that met our definition. Results There is a wide variety of contributions from industry, academic, and hobbyist spaces. A variety of new engineering approaches, such as Fabry-Perot interferometers, spectrally resolved detector array (mosaic array), microelectro-mechanical systems, 3D printing, light-emitting diodes, and smartphones, were used in the construction of compact spectral imaging cameras. In bioimaging applications, these compact devices were used for in vivo and ex vivo diagnosis and surgical settings. Conclusions Compact and ultracompact spectral imagers are the future of spectral imaging systems. Researchers in the bioimaging fields are building systems that are low-cost, fast in acquisition time, and mobile enough to be handheld.
Collapse
Affiliation(s)
- Minh H. Tran
- University of Texas at Dallas, Department of Bioengineering, Richardson, Texas, United States
| | - Baowei Fei
- University of Texas at Dallas, Department of Bioengineering, Richardson, Texas, United States
- University of Texas Southwestern Medical Center, Department of Radiology, Dallas, Texas, United States
- University of Texas at Dallas, Center for Imaging and Surgical Innovation, Richardson, Texas, United States
- Address all correspondence to Baowei Fei,
| |
Collapse
|
3
|
An ultra-small nine-color spectrometer with a two-layer biparted ten-dichroic-mirror array and an image sensor. Sci Rep 2022; 12:16518. [PMID: 36192470 PMCID: PMC9529936 DOI: 10.1038/s41598-022-20814-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Accepted: 09/19/2022] [Indexed: 11/08/2022] Open
Abstract
An ultra-small (54 × 58 × 8.5 mm) and large aperture (1 × 7 mm) nine-color spectrometer-using an array of ten dichroic mirrors "biparted" as two layers-was developed and used for snapshot spectral imaging. Incident-light flux with a cross section smaller than the aperture size is split into nine color fluxes with 20-nm-width contiguous wavelength bands and central wavelengths of 530, 550, 570, 590, 610, 630, 650, 670, and 690 nm. Images of the nine color fluxes are simultaneously and efficiently measured by an image sensor. Unlike a conventional dichroic-mirror array, the developed dichroic-mirror array has a unique biparted configuration that not only increases the number of colors that can be measured simultaneously but also improves the image resolution of each color flux. The developed nine-color spectrometer was used for four-capillary-array electrophoresis. Eight dyes concurrently migrating in each capillary were simultaneously quantified by nine-color laser-induced fluorescence detection. Since the nine-color spectrometer is not only ultra-small and inexpensive but also has high light throughput and sufficient spectral resolution for most spectral-imaging applications, it has the potential to be widely used in various fields.
Collapse
|
4
|
Du X, Koronyo Y, Mirzaei N, Yang C, Fuchs DT, Black KL, Koronyo-Hamaoui M, Gao L. Label-free hyperspectral imaging and deep-learning prediction of retinal amyloid β-protein and phosphorylated tau. PNAS NEXUS 2022; 1:pgac164. [PMID: 36157597 PMCID: PMC9491695 DOI: 10.1093/pnasnexus/pgac164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Accepted: 08/15/2022] [Indexed: 01/16/2023]
Abstract
Alzheimer's disease (AD) is a major risk for the aging population. The pathological hallmarks of AD-an abnormal deposition of amyloid β-protein (Aβ) and phosphorylated tau (pTau)-have been demonstrated in the retinas of AD patients, including in prodromal patients with mild cognitive impairment (MCI). Aβ pathology, especially the accumulation of the amyloidogenic 42-residue long alloform (Aβ42), is considered an early and specific sign of AD, and together with tauopathy, confirms AD diagnosis. To visualize retinal Aβ and pTau, state-of-the-art methods use fluorescence. However, administering contrast agents complicates the imaging procedure. To address this problem from fundamentals, ex-vivo studies were performed to develop a label-free hyperspectral imaging method to detect the spectral signatures of Aβ42 and pS396-Tau, and predicted their abundance in retinal cross-sections. For the first time, we reported the spectral signature of pTau and demonstrated an accurate prediction of Aβ and pTau distribution powered by deep learning. We expect our finding will lay the groundwork for label-free detection of AD.
Collapse
Affiliation(s)
- Xiaoxi Du
- Department of Bioengineering, University of California, Los Angeles, Los Angeles, CA 90095, USA
| | - Yosef Koronyo
- Department of Neurosurgery, Maxine Dunitz Neurosurgical Research Institute, Cedars-Sinai Medical Center, Los Angeles, CA 90048, USA
| | - Nazanin Mirzaei
- Department of Neurosurgery, Maxine Dunitz Neurosurgical Research Institute, Cedars-Sinai Medical Center, Los Angeles, CA 90048, USA
| | - Chengshuai Yang
- Department of Bioengineering, University of California, Los Angeles, Los Angeles, CA 90095, USA
| | - Dieu-Trang Fuchs
- Department of Neurosurgery, Maxine Dunitz Neurosurgical Research Institute, Cedars-Sinai Medical Center, Los Angeles, CA 90048, USA
| | - Keith L Black
- Department of Neurosurgery, Maxine Dunitz Neurosurgical Research Institute, Cedars-Sinai Medical Center, Los Angeles, CA 90048, USA
| | - Maya Koronyo-Hamaoui
- Department of Neurosurgery, Maxine Dunitz Neurosurgical Research Institute, Cedars-Sinai Medical Center, Los Angeles, CA 90048, USA
- Department of Biomedical Sciences, Division of Applied Cell Biology and Physiology, Cedars-Sinai Medical Center, Los Angeles, CA 90048, USA
| | - Liang Gao
- Department of Bioengineering, University of California, Los Angeles, Los Angeles, CA 90095, USA
| |
Collapse
|
5
|
Browning CM, Mayes S, Mayes SA, Rich TC, Leavesley SJ. Microscopy is better in color: development of a streamlined spectral light path for real-time multiplex fluorescence microscopy. BIOMEDICAL OPTICS EXPRESS 2022; 13:3751-3772. [PMID: 35991911 PMCID: PMC9352297 DOI: 10.1364/boe.453657] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Revised: 05/24/2022] [Accepted: 05/26/2022] [Indexed: 06/15/2023]
Abstract
Spectroscopic image data has provided molecular discrimination for numerous fields including: remote sensing, food safety and biomedical imaging. Despite the various technologies for acquiring spectral data, there remains a trade-off when acquiring data. Typically, spectral imaging either requires long acquisition times to collect an image stack with high spectral specificity or acquisition times are shortened at the expense of fewer spectral bands or reduced spatial sampling. Hence, new spectral imaging microscope platforms are needed to help mitigate these limitations. Fluorescence excitation-scanning spectral imaging is one such new technology, which allows more of the emitted signal to be detected than comparable emission-scanning spectral imaging systems. Here, we have developed a new optical geometry that provides spectral illumination for use in excitation-scanning spectral imaging microscope systems. This was accomplished using a wavelength-specific LED array to acquire spectral image data. Feasibility of the LED-based spectral illuminator was evaluated through simulation and benchtop testing and assessment of imaging performance when integrated with a widefield fluorescence microscope. Ray tracing simulations (TracePro) were used to determine optimal optical component selection and geometry. Spectral imaging feasibility was evaluated using a series of 6-label fluorescent slides. The LED-based system response was compared to a previously tested thin-film tunable filter (TFTF)-based system. Spectral unmixing successfully discriminated all fluorescent components in spectral image data acquired from both the LED and TFTF systems. Therefore, the LED-based spectral illuminator provided spectral image data sets with comparable information content so as to allow identification of each fluorescent component. These results provide proof-of-principle demonstration of the ability to combine output from many discrete wavelength LED sources using a double-mirror (Cassegrain style) optical configuration that can be further modified to allow for high speed, video-rate spectral image acquisition. Real-time spectral fluorescence microscopy would allow monitoring of rapid cell signaling processes (i.e., Ca2+ and other second messenger signaling) and has potential to be translated to clinical imaging platforms.
Collapse
Affiliation(s)
- Craig M. Browning
- Chemical and Biomolecular Engineering, University of South Alabama, AL 36688, USA
- Systems Engineering, University of South Alabama, AL 36688, USA
- These authors contributed equally to this work
| | - Samantha Mayes
- Chemical and Biomolecular Engineering, University of South Alabama, AL 36688, USA
- These authors contributed equally to this work
| | - Samuel A. Mayes
- Chemical and Biomolecular Engineering, University of South Alabama, AL 36688, USA
- Systems Engineering, University of South Alabama, AL 36688, USA
| | - Thomas C. Rich
- Pharmacology, University of South Alabama, AL 36688, USA
- Center for Lung Biology, University of South Alabama, AL 36688, USA
| | - Silas J. Leavesley
- Chemical and Biomolecular Engineering, University of South Alabama, AL 36688, USA
- Pharmacology, University of South Alabama, AL 36688, USA
- Center for Lung Biology, University of South Alabama, AL 36688, USA
| |
Collapse
|
6
|
Dip F, Bregoli P, Falco J, White KP, Rosenthal RJ. Nerve autofluorescence in near-ultraviolet light markedly enhances nerve visualization in vivo. Surg Endosc 2022; 36:1999-2005. [PMID: 33835251 DOI: 10.1007/s00464-021-08484-0/tables/3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Accepted: 03/28/2021] [Indexed: 05/26/2023]
Abstract
BACKGROUND During surgery, surgeons must accurately localize nerves to avoid injuring them. Recently, we have discovered that nerves fluoresce in near-ultraviolet light (NUV) light. The aims of the current study were to determine the extent to which nerves fluoresce more brightly than background and vascular structures in NUV light, and identify the NUV intensity at which nerves are most distinguishable from other tissues. METHODS We exposed sciatic nerves within the posterior thigh in five 250-300 gm Wistar rats, then observed them at four different NUV intensity levels: 20%, 35%, 50%, and 100%. Brightness of fluorescence was measured by fluorescence spectroscopy, quantified as a fluorescence score using Image-J software, and statistically compared between nerves, background, and both an artery and vein by unpaired Student's t tests with Bonferroni adjustment to accommodate multiple comparisons. Sensitivity, specificity, and accuracy were calculated for each NUV intensity. RESULTS At 20, 35, 50, and 100% NUV intensity, fluorescence scores for nerves versus background tissues were 117.4 versus 40.0, 225.8 versus 88.0, 250.6 versus 121.4, and 252.8 versus 169.4, respectively (all p < 0.001). Fluorescence scores plateaued at 50% NUV intensity for nerves, but continued to rise for background. At 35%, 50%, and 100% NUV intensity, a fluorescence score of 200 was 100% sensitive, specific, and accurate identifying nerves. At 100 NUV intensity, artery and vein scores were 61.8 and 60.0, both dramatically lower than for nerves (p < 0.001). CONCLUSIONS At all NUV intensities ≥ 35%, a fluorescence score of 200 is 100% accurate distinguishing nerves from other anatomical structures in vivo.
Collapse
Affiliation(s)
- Fernando Dip
- Instituto Argentino de Diagnóstico y Tratamiento, Universidad de Buenos Aires, Buenos Aires, Argentina
- Cleveland Clinic Florida, Weston, FL, 33325, USA
| | - Pedro Bregoli
- Instituto Argentino de Diagnóstico y Tratamiento, Universidad de Buenos Aires, Buenos Aires, Argentina
| | - Jorge Falco
- Instituto Argentino de Diagnóstico y Tratamiento, Universidad de Buenos Aires, Buenos Aires, Argentina
| | - Kevin P White
- ScienceRight Research Consulting, London, ON, Canada
| | - Raúl J Rosenthal
- Cleveland Clinic Florida, Weston, FL, 33325, USA.
- Cleveland Clinic Florida, 2950 Cleveland Clinic Blvd., Weston, FL, 33331, USA.
| |
Collapse
|
7
|
Lee S, Namgoong JM, Kim Y, Cha J, Kim JK. Multimodal imaging of laser speckle contrast imaging combined with mosaic filter-based hyperspectral imaging for precise surgical guidance. IEEE Trans Biomed Eng 2021; 69:443-452. [PMID: 34260344 DOI: 10.1109/tbme.2021.3097122] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE To enable a real-time surgical guidance system that simultaneously monitors blood vessel perfusion, oxygen saturation, thrombosis, and tissue recovery by combining multiple optical imaging techniques into a single system: visible imaging, mosaic filter-based snapshot hyperspectral imaging (HSI), and laser speckle contrast imaging (LSCI). METHODS The multimodal optical imaging system was demonstrated by clamping blood vessels in the small intestines of rats to create areas of restricted blood flow. Subsequent tissue damage and regeneration were monitored during procedures. Using LSCI, vessel perfusion was measured, revealing the biological activity and survival of organ tissues. Blood oxygen saturation was monitored using HSI in the near-infrared region. Principal component analysis was used over the spectral dimension to identify an HSI wavelength combination optimized for hemodynamic biomarker visualization. HSI and LSCI were complimentary, identifying thrombus generation and tissue recovery, which was not possible in either modality alone. RESULTS AND CONCLUSION By analyzing multimodal tissue information from visible imaging, LSCI perfusion imaging, and HSI, a recovery prognosis could be determined based on the blood supply to the organ. The unique combination of the complementary imaging techniques into a single surgical microscope holds promise for improving the real-time determination of blood supply and tissue prognosis during surgery. SIGNIFICANCE Precise real-time monitoring for vascular anomalies promises to reduce the risk of organ damage in precise surgical operations such as tissue resection and transplantation. In addition, the convergence of label-free imaging technologies removes delays associated with the injection and diffusion of vascular monitoring dyes.
Collapse
|
8
|
Dip F, Bregoli P, Falco J, White KP, Rosenthal RJ. Nerve autofluorescence in near-ultraviolet light markedly enhances nerve visualization in vivo. Surg Endosc 2021; 36:1999-2005. [PMID: 33835251 DOI: 10.1007/s00464-021-08484-0] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Accepted: 03/28/2021] [Indexed: 11/27/2022]
Abstract
BACKGROUND During surgery, surgeons must accurately localize nerves to avoid injuring them. Recently, we have discovered that nerves fluoresce in near-ultraviolet light (NUV) light. The aims of the current study were to determine the extent to which nerves fluoresce more brightly than background and vascular structures in NUV light, and identify the NUV intensity at which nerves are most distinguishable from other tissues. METHODS We exposed sciatic nerves within the posterior thigh in five 250-300 gm Wistar rats, then observed them at four different NUV intensity levels: 20%, 35%, 50%, and 100%. Brightness of fluorescence was measured by fluorescence spectroscopy, quantified as a fluorescence score using Image-J software, and statistically compared between nerves, background, and both an artery and vein by unpaired Student's t tests with Bonferroni adjustment to accommodate multiple comparisons. Sensitivity, specificity, and accuracy were calculated for each NUV intensity. RESULTS At 20, 35, 50, and 100% NUV intensity, fluorescence scores for nerves versus background tissues were 117.4 versus 40.0, 225.8 versus 88.0, 250.6 versus 121.4, and 252.8 versus 169.4, respectively (all p < 0.001). Fluorescence scores plateaued at 50% NUV intensity for nerves, but continued to rise for background. At 35%, 50%, and 100% NUV intensity, a fluorescence score of 200 was 100% sensitive, specific, and accurate identifying nerves. At 100 NUV intensity, artery and vein scores were 61.8 and 60.0, both dramatically lower than for nerves (p < 0.001). CONCLUSIONS At all NUV intensities ≥ 35%, a fluorescence score of 200 is 100% accurate distinguishing nerves from other anatomical structures in vivo.
Collapse
Affiliation(s)
- Fernando Dip
- Instituto Argentino de Diagnóstico y Tratamiento, Universidad de Buenos Aires, Buenos Aires, Argentina
- Cleveland Clinic Florida, Weston, FL, 33325, USA
| | - Pedro Bregoli
- Instituto Argentino de Diagnóstico y Tratamiento, Universidad de Buenos Aires, Buenos Aires, Argentina
| | - Jorge Falco
- Instituto Argentino de Diagnóstico y Tratamiento, Universidad de Buenos Aires, Buenos Aires, Argentina
| | - Kevin P White
- ScienceRight Research Consulting, London, ON, Canada
| | - Raúl J Rosenthal
- Cleveland Clinic Florida, Weston, FL, 33325, USA.
- Cleveland Clinic Florida, 2950 Cleveland Clinic Blvd., Weston, FL, 33331, USA.
| |
Collapse
|
9
|
Rehman AU, Qureshi SA. A review of the medical hyperspectral imaging systems and unmixing algorithms' in biological tissues. Photodiagnosis Photodyn Ther 2020; 33:102165. [PMID: 33383204 DOI: 10.1016/j.pdpdt.2020.102165] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2020] [Revised: 12/18/2020] [Accepted: 12/21/2020] [Indexed: 01/27/2023]
Abstract
Hyperspectral fluorescence imaging (HFI) is a well-known technique in the medical research field and is considered a non-invasive tool for tissue diagnosis. This review article gives a brief introduction to acquisition methods, including the image preprocessing methods, feature selection and extraction methods, data classification techniques and medical image analysis along with recent relevant references. The process of fusion of unsupervised unmixing techniques with other classification methods, like the combination of support vector machine with an artificial neural network, the latest snapshot Hyperspectral imaging (HSI) and vortex analysis techniques are also outlined. Finally, the recent applications of hyperspectral images in cellular differentiation of various types of cancer are discussed.
Collapse
Affiliation(s)
- Aziz Ul Rehman
- Agri & Biophotonics Division, National Institute of Lasers and Optronics College, PIEAS, 45650, Islamabad, Pakistan; Department of Physics and Astronomy Macquarie University, Sydney, 2109, New South Wales, Australia.
| | - Shahzad Ahmad Qureshi
- Department of Computer and Information Sciences, Pakistan Institute of Engineering and Applied Sciences (PIEAS), Islamabad, 45650, Pakistan
| |
Collapse
|
10
|
Mehta N, Sahu SP, Shaik S, Devireddy R, Gartia MR. Dark-field hyperspectral imaging for label free detection of nano-bio-materials. WILEY INTERDISCIPLINARY REVIEWS-NANOMEDICINE AND NANOBIOTECHNOLOGY 2020; 13:e1661. [PMID: 32755036 DOI: 10.1002/wnan.1661] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/11/2019] [Revised: 05/21/2020] [Accepted: 06/19/2020] [Indexed: 12/12/2022]
Abstract
Nanomaterials are playing an increasingly important role in cancer diagnosis and treatment. Nanoparticle (NP)-based technologies have been utilized for targeted drug delivery during chemotherapies, photodynamic therapy, and immunotherapy. Another active area of research is the toxicity studies of these nanomaterials to understand the cellular uptake and transport of these materials in cells, tissues, and environment. Traditional techniques such as transmission electron microscopy, and mass spectrometry to analyze NP-based cellular transport or toxicity effect are expensive, require extensive sample preparation, and are low-throughput. Dark-field hyperspectral imaging (DF-HSI), an integration of spectroscopy and microscopy/imaging, provides the ability to investigate cellular transport of these NPs and to quantify the distribution of them within bio-materials. DF-HSI also offers versatility in non-invasively monitoring microorganisms, single cell, and proteins. DF-HSI is a low-cost, label-free technique that is minimally invasive and is a viable choice for obtaining high-throughput quantitative molecular analyses. Multimodal imaging modalities such as Fourier transform infrared and Raman spectroscopy are also being integrated with HSI systems to enable chemical imaging of the samples. HSI technology is being applied in surgeries to obtain molecular information about the tissues in real-time. This article provides brief overview of fundamental principles of DF-HSI and its application for nanomaterials, protein-detection, single-cell analysis, microbiology, surgical procedures along with technical challenges and future integrative approach with other imaging and measurement modalities. This article is categorized under: Diagnostic Tools > in vitro Nanoparticle-Based Sensing Diagnostic Tools > in vivo Nanodiagnostics and Imaging Implantable Materials and Surgical Technologies > Nanoscale Tools and Techniques in Surgery.
Collapse
Affiliation(s)
- Nishir Mehta
- Department of Mechanical and Industrial Engineering, Louisiana State University, Baton Rouge, Louisiana, USA
| | - Sushant P Sahu
- Department of Mechanical and Industrial Engineering, Louisiana State University, Baton Rouge, Louisiana, USA
| | - Shahensha Shaik
- Department of Mechanical and Industrial Engineering, Louisiana State University, Baton Rouge, Louisiana, USA
| | - Ram Devireddy
- Department of Mechanical and Industrial Engineering, Louisiana State University, Baton Rouge, Louisiana, USA
| | - Manas Ranjan Gartia
- Department of Mechanical and Industrial Engineering, Louisiana State University, Baton Rouge, Louisiana, USA
| |
Collapse
|
11
|
Shapey J, Xie Y, Nabavi E, Bradford R, Saeed SR, Ourselin S, Vercauteren T. Intraoperative multispectral and hyperspectral label-free imaging: A systematic review of in vivo clinical studies. JOURNAL OF BIOPHOTONICS 2019; 12:e201800455. [PMID: 30859757 PMCID: PMC6736677 DOI: 10.1002/jbio.201800455] [Citation(s) in RCA: 56] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/07/2018] [Revised: 02/26/2019] [Accepted: 03/08/2019] [Indexed: 05/21/2023]
Abstract
Multispectral and hyperspectral imaging (HSI) are emerging optical imaging techniques with the potential to transform the way surgery is performed but it is not clear whether current systems are capable of delivering real-time tissue characterization and surgical guidance. We conducted a systematic review of surgical in vivo label-free multispectral and HSI systems that have been assessed intraoperatively in adult patients, published over a 10-year period to May 2018. We analysed 14 studies including 8 different HSI systems. Current in-vivo HSI systems generate an intraoperative tissue oxygenation map or enable tumour detection. Intraoperative tissue oxygenation measurements may help to predict those patients at risk of postoperative complications and in-vivo intraoperative tissue characterization may be performed with high specificity and sensitivity. All systems utilized a line-scanning or wavelength-scanning method but the spectral range and number of spectral bands employed varied significantly between studies and according to the system's clinical aim. The time to acquire a hyperspectral cube dataset ranged between 5 and 30 seconds. No safety concerns were reported in any studies. A small number of studies have demonstrated the capabilities of intraoperative in-vivo label-free HSI but further work is needed to fully integrate it into the current surgical workflow.
Collapse
Affiliation(s)
- Jonathan Shapey
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London, UK
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| | - Yijing Xie
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| | - Eli Nabavi
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| | - Robert Bradford
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London, UK
| | - Shakeel R Saeed
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London, UK
- The Ear Institute, University College London, London, UK
- The Royal National Throat, Nose and Ear Hospital, London, UK
| | - Sebastien Ourselin
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| | - Tom Vercauteren
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| |
Collapse
|
12
|
Li J, Jiang W, Yao X, Cai F, He S. Fast quantitative fluorescence authentication of milk powder and vanillin by a line-scan hyperspectral system. APPLIED OPTICS 2018; 57:6276-6282. [PMID: 30117853 DOI: 10.1364/ao.57.006276] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2018] [Accepted: 06/27/2018] [Indexed: 06/08/2023]
Abstract
We present a fast hyperspectral line-scan fluorescence imaging system to verify the feasibility of quantitative fluorescence authentication of powders. Vanillin, which is restricted for use in milk powder, especially in milk powder for infants, is mixed with milk powder in different mass concentrations (5%, 10%, 30%, 50%, 70%, and 90%). Mixed powders are located on a motorized linear stage. A 405 nm line laser is utilized to excite the fluorescence of the sample. Based on galvo scanning, we can generate a laser line with high spatial resolution and high-intensity density on the samples. An imaging spectrometer with a complementary metal-oxide semiconductor (CMOS) camera as detector is built. The spectral range of the spectrometer is 365-810 nm, with about 1 nm spectral resolution. One snapshot of the CMOS can acquire the fluorescent spatial and spectral information of a line region in 100 ms. By scanning the motorized linear stage, we obtain the fluorescence hypercube of the sample. A 100×1926×1216 hypercube, which covers an area of 15 mm×5 mm, is obtained in 50 s. The imaging speed can be enhanced further by increasing the intensity of the excitation laser and the sensitivity of the area camera. Fully constrained least squares, a linear spectral mixture analysis, is utilized to analyze the hypercube obtained by our homemade imaging spectrometer, thus obtaining the pixel concentration of vanillin in each mixed powder. Linear regression analysis is used for the pixel concentration and mass concentration of vanillin. A linear relationship with coefficient of determination R2 equal to one is observed, which demonstrates the capability of fluorescence hyperspectral quantitative analysis in powders.
Collapse
|
13
|
Mehta N, Shaik S, Devireddy R, Gartia MR. Single-Cell Analysis Using Hyperspectral Imaging Modalities. J Biomech Eng 2018; 140:2665930. [PMID: 29211294 PMCID: PMC5816251 DOI: 10.1115/1.4038638] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2017] [Revised: 11/22/2017] [Indexed: 12/25/2022]
Abstract
Almost a decade ago, hyperspectral imaging (HSI) was employed by the NASA in satellite imaging applications such as remote sensing technology. This technology has since been extensively used in the exploration of minerals, agricultural purposes, water resources, and urban development needs. Due to recent advancements in optical re-construction and imaging, HSI can now be applied down to micro- and nanometer scales possibly allowing for exquisite control and analysis of single cell to complex biological systems. This short review provides a description of the working principle of the HSI technology and how HSI can be used to assist, substitute, and validate traditional imaging technologies. This is followed by a description of the use of HSI for biological analysis and medical diagnostics with emphasis on single-cell analysis using HSI.
Collapse
Affiliation(s)
- Nishir Mehta
- Department of Mechanical Engineering,
Louisiana State University,
Baton Rouge, LA 70803
| | - Shahensha Shaik
- Department of Mechanical Engineering,
Louisiana State University,
Baton Rouge, LA 70803
| | - Ram Devireddy
- Department of Mechanical Engineering,
Louisiana State University,
Baton Rouge, LA 70803
e-mail:
| | - Manas Ranjan Gartia
- Department of Mechanical Engineering,
Louisiana State University,
Baton Rouge, LA 70803
| |
Collapse
|
14
|
Madore WJ, De Montigny E, Deschênes A, Benboujja F, Leduc M, Mes-Masson AM, Provencher DM, Rahimi K, Boudoux C, Godbout N. Morphologic three-dimensional scanning of fallopian tubes to assist ovarian cancer diagnosis. JOURNAL OF BIOMEDICAL OPTICS 2017; 22:76012. [PMID: 28727868 DOI: 10.1117/1.jbo.22.7.076012] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/24/2017] [Accepted: 06/29/2017] [Indexed: 05/11/2023]
Abstract
The majority of high-grade serous ovarian cancers is now believed to originate in the fallopian tubes. Therefore, current practices include the pathological examination of excised fallopian tubes. Detection of tumors in the fallopian tubes using current clinical approaches remains difficult but is of critical importance to achieve accurate staging and diagnosis. Here, we present an intraoperative imaging system for the detection of human fallopian tube lesions. The system is based on optical coherence tomography (OCT) to access subepithelial tissue architecture. To demonstrate that OCT could identify lesions, we analyzed 180 OCT volumes taken from five different ovarian lesions and from healthy fallopian tubes, and compared them to standard pathological review. We demonstrated that qualitative features could be matched to pathological conditions. We then determined the feasibility of intraluminal imaging of intact human fallopian tubes by building a dedicated endoscopic single-fiber OCT probe to access the mucosal layer inside freshly excised specimens from five patients undergoing prophylactic surgeries. The probe insertion into the lumen acquired images over the entire length of the tubes without damaging the mucosa, providing the first OCT images of intact human fallopian tubes.
Collapse
Affiliation(s)
- Wendy-Julie Madore
- École Polytechnique Montréal, Centre d'Optique, Photonique et Lasers (COPL), Montreal, CanadabCentre de recherche du Centre hospitalier de l'Université (CRCHUM), Cancer and Imaging and Engineering Departments, Montreal, CanadacInstitut du cancer de Montréal, Montreal, Canada
| | - Etienne De Montigny
- École Polytechnique Montréal, Centre d'Optique, Photonique et Lasers (COPL), Montreal, CanadabCentre de recherche du Centre hospitalier de l'Université (CRCHUM), Cancer and Imaging and Engineering Departments, Montreal, Canada
| | - Andréanne Deschênes
- École Polytechnique Montréal, Centre d'Optique, Photonique et Lasers (COPL), Montreal, Canada
| | - Fouzi Benboujja
- École Polytechnique Montréal, Centre d'Optique, Photonique et Lasers (COPL), Montreal, Canada
| | - Mikaël Leduc
- École Polytechnique Montréal, Centre d'Optique, Photonique et Lasers (COPL), Montreal, Canada
| | - Anne-Marie Mes-Masson
- Centre de recherche du Centre hospitalier de l'Université (CRCHUM), Cancer and Imaging and Engineering Departments, Montreal, CanadacInstitut du cancer de Montréal, Montreal, CanadadUniversité de Montréal, Department of Medicine, Montreal, Canada
| | - Diane M Provencher
- Centre de recherche du Centre hospitalier de l'Université (CRCHUM), Cancer and Imaging and Engineering Departments, Montreal, CanadacInstitut du cancer de Montréal, Montreal, CanadaeUniversité de Montréal, Division of Gynecologic Oncology, Montreal, Canada
| | - Kurosh Rahimi
- Centre de recherche du Centre hospitalier de l'Université (CRCHUM), Cancer and Imaging and Engineering Departments, Montreal, CanadacInstitut du cancer de Montréal, Montreal, Canada
| | - Caroline Boudoux
- École Polytechnique Montréal, Centre d'Optique, Photonique et Lasers (COPL), Montreal, Canada
| | - Nicolas Godbout
- École Polytechnique Montréal, Centre d'Optique, Photonique et Lasers (COPL), Montreal, Canada
| |
Collapse
|
15
|
Tate TH, Keenan M, Black J, Utzinger U, Barton JK. Ultraminiature optical design for multispectral fluorescence imaging endoscopes. JOURNAL OF BIOMEDICAL OPTICS 2017; 22:36013. [PMID: 28334332 PMCID: PMC5363790 DOI: 10.1117/1.jbo.22.3.036013] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/21/2016] [Accepted: 03/06/2017] [Indexed: 05/21/2023]
Abstract
A miniature wide-field multispectral endoscopic imaging system was developed enabling reflectance and fluorescence imaging over a broad wavelength range. At 0.8-mm diameter, the endoscope can be utilized for natural orifice imaging in small lumens such as the fallopian tubes. Five lasers from 250 to 642 nm are coupled into a 125 - ? m diameter multimode fiber and transmitted to the endoscope distal tip for illumination. Ultraviolet and blue wavelengths excite endogenous fluorophores, which can provide differential fluorescence emission images for health and disease. Visible wavelengths provide reflectance images that can be combined for pseudo-white-light imaging and navigation. Imaging is performed by a 300 - ? m diameter three-element lens system connected to a 3000-element fiber. The lens system was designed for a 70-deg full field of view, working distance from 3 mm to infinity, and 40% contrast at the Nyquist cutoff of the fiber bundle. Measured performance characteristics are near design goals. The endoscope was utilized to obtain example monochromatic, pseudo-white-light, and composite fluorescence images of phantoms and porcine reproductive tract. This work shows the feasibility of packaging a highly capable multispectral fluorescence imaging system into a miniature endoscopic system that may have applications in early detection of cancer.
Collapse
Affiliation(s)
- Tyler H. Tate
- University of Arizona, College of Optical Sciences, Tucson, Arizona, United States
| | - Molly Keenan
- University of Arizona, Biomedical Engineering, Tucson, Arizona, United States
| | - John Black
- Glannaventa Inc., San Mateo, California, United States
| | - Urs Utzinger
- University of Arizona, College of Optical Sciences, Tucson, Arizona, United States
- University of Arizona, Biomedical Engineering, Tucson, Arizona, United States
| | - Jennifer K. Barton
- University of Arizona, College of Optical Sciences, Tucson, Arizona, United States
- University of Arizona, Biomedical Engineering, Tucson, Arizona, United States
| |
Collapse
|
16
|
Tate TH, Baggett B, Rice PFS, Koevary JW, Orsinger GV, Nymeyer AC, Welge WA, Saboda K, Roe DJ, Hatch KD, Chambers SK, Utzinger U, Barton JK. Multispectral fluorescence imaging of human ovarian and fallopian tube tissue for early-stage cancer detection. JOURNAL OF BIOMEDICAL OPTICS 2016; 21:56005. [PMID: 27220626 PMCID: PMC5996865 DOI: 10.1117/1.jbo.21.5.056005] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2016] [Accepted: 04/25/2016] [Indexed: 05/17/2023]
Abstract
With early detection, 5-year survival rates for ovarian cancer exceed 90%, yet no effective early screening method exists. Emerging consensus suggests over 50% of the most lethal form of the disease originates in the fallopian tube. Twenty-eight women undergoing oophorectomy or debulking surgery provided informed consent for the use of surgical discard tissue samples for multispectral fluorescence imaging. Using multiple ultraviolet and visible excitation wavelengths and emissions bands, 12 fluorescence and 6 reflectance images of 47 ovarian and 31 fallopian tube tissue samples were recorded. After imaging, each sample was fixed, sectioned, and stained for pathological evaluation. Univariate logistic regression showed cancerous tissue samples had significantly lower intensity than noncancerous tissue for 17 image types. The predictive power of multiple image types was evaluated using multivariate logistic regression (MLR) and quadratic discriminant analysis (QDA). Two MLR models each using two image types had receiver operating characteristic curves with area under the curve exceeding 0.9. QDA determined 56 image type combinations with perfect resubstituting using as few as five image types. Adaption of the system for future in vivo fallopian tube and ovary endoscopic imaging is possible, which may enable sensitive detection of ovarian cancer with no exogenous contrast agents.
Collapse
Affiliation(s)
- Tyler H. Tate
- University of Arizona, College of Optical Sciences, 1630 East University Boulevard, Tucson, Arizona 85721, United States
| | - Brenda Baggett
- University of Arizona, Department of Biomedical Engineering, 1657 East Helen Street, Tucson, Arizona 85721, United States
| | - Photini F. S. Rice
- University of Arizona, Department of Biomedical Engineering, 1657 East Helen Street, Tucson, Arizona 85721, United States
| | - Jennifer Watson Koevary
- University of Arizona, Department of Biomedical Engineering, 1657 East Helen Street, Tucson, Arizona 85721, United States
| | - Gabriel V. Orsinger
- University of Arizona, Department of Biomedical Engineering, 1657 East Helen Street, Tucson, Arizona 85721, United States
| | - Ariel C. Nymeyer
- University of Arizona, Department of Biomedical Engineering, 1657 East Helen Street, Tucson, Arizona 85721, United States
| | - Weston A. Welge
- University of Arizona, College of Optical Sciences, 1630 East University Boulevard, Tucson, Arizona 85721, United States
| | - Kathylynn Saboda
- University of Arizona Cancer Center, 1515 North Campbell Avenue, Tucson, Arizona 85724, United States
| | - Denise J. Roe
- University of Arizona Cancer Center, 1515 North Campbell Avenue, Tucson, Arizona 85724, United States
| | - Kenneth D. Hatch
- University of Arizona Cancer Center, 1515 North Campbell Avenue, Tucson, Arizona 85724, United States
| | - Setsuko K. Chambers
- University of Arizona Cancer Center, 1515 North Campbell Avenue, Tucson, Arizona 85724, United States
| | - Urs Utzinger
- University of Arizona, College of Optical Sciences, 1630 East University Boulevard, Tucson, Arizona 85721, United States
- University of Arizona, Department of Biomedical Engineering, 1657 East Helen Street, Tucson, Arizona 85721, United States
| | - Jennifer Kehlet Barton
- University of Arizona, College of Optical Sciences, 1630 East University Boulevard, Tucson, Arizona 85721, United States
- University of Arizona, Department of Biomedical Engineering, 1657 East Helen Street, Tucson, Arizona 85721, United States
| |
Collapse
|
17
|
Lu G, Fei B. Medical hyperspectral imaging: a review. JOURNAL OF BIOMEDICAL OPTICS 2014; 19:10901. [PMID: 24441941 PMCID: PMC3895860 DOI: 10.1117/1.jbo.19.1.010901] [Citation(s) in RCA: 791] [Impact Index Per Article: 79.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/21/2013] [Accepted: 12/13/2013] [Indexed: 05/13/2023]
Abstract
Hyperspectral imaging (HSI) is an emerging imaging modality for medical applications, especially in disease diagnosis and image-guided surgery. HSI acquires a three-dimensional dataset called hypercube, with two spatial dimensions and one spectral dimension. Spatially resolved spectral imaging obtained by HSI provides diagnostic information about the tissue physiology, morphology, and composition. This review paper presents an overview of the literature on medical hyperspectral imaging technology and its applications. The aim of the survey is threefold: an introduction for those new to the field, an overview for those working in the field, and a reference for those searching for literature on a specific application.
Collapse
Affiliation(s)
- Guolan Lu
- Emory University and Georgia Institute of Technology, The Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia 30322
| | - Baowei Fei
- Emory University and Georgia Institute of Technology, The Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia 30322
- Emory University, School of Medicine, Department of Radiology and Imaging Sciences, Atlanta, Georgia 30329
- Emory University, Department of Mathematics & Computer Science, Atlanta, Georgia 30322
- Emory University, Winship Cancer Institute, Atlanta, Georgia 30322
- Address all correspondence to: Baowei Fei, E-mail:
| |
Collapse
|
18
|
Lu G, Fei B. Medical hyperspectral imaging: a review. JOURNAL OF BIOMEDICAL OPTICS 2014; 19:96013. [PMID: 24441941 DOI: 10.1117/1.jbo.19.9.096013] [Citation(s) in RCA: 47] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/15/2014] [Accepted: 08/28/2014] [Indexed: 05/24/2023]
Abstract
Hyperspectral imaging (HSI) is an emerging imaging modality for medical applications, especially in disease diagnosis and image-guided surgery. HSI acquires a three-dimensional dataset called hypercube, with two spatial dimensions and one spectral dimension. Spatially resolved spectral imaging obtained by HSI provides diagnostic information about the tissue physiology, morphology, and composition. This review paper presents an overview of the literature on medical hyperspectral imaging technology and its applications. The aim of the survey is threefold: an introduction for those new to the field, an overview for those working in the field, and a reference for those searching for literature on a specific application.
Collapse
Affiliation(s)
- Guolan Lu
- Emory University and Georgia Institute of Technology, The Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia 30322
| | - Baowei Fei
- Emory University and Georgia Institute of Technology, The Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia 30322bEmory University, School of Medicine, Department of Radiology and Imaging Sciences, Atlanta, Georgia 30329cEmory Univ
| |
Collapse
|