1
|
Reinecke D, Ruess D, Meissner AK, Fürtjes G, von Spreckelsen N, Ion-Margineanu A, Khalid F, Blau T, Stehle T, Al-Shugri A, Büttner R, Goldbrunner R, Ruge MI, Neuschmelting V. Streamlined Intraoperative Brain Tumor Classification and Molecular Subtyping in Stereotactic Biopsies Using Stimulated Raman Histology and Deep Learning. Clin Cancer Res 2024; 30:3824-3836. [PMID: 38976016 DOI: 10.1158/1078-0432.ccr-23-3842] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2024] [Revised: 04/25/2024] [Accepted: 07/03/2024] [Indexed: 07/09/2024]
Abstract
PURPOSE Recent artificial intelligence algorithms aided intraoperative decision-making via stimulated Raman histology (SRH) during craniotomy. This study assesses deep learning algorithms for rapid intraoperative diagnosis from SRH images in small stereotactic-guided brain biopsies. It defines a minimum tissue sample size threshold to ensure diagnostic accuracy. EXPERIMENTAL DESIGN A prospective single-center study examined 121 SRH images from 84 patients with unclear intracranial lesions undergoing stereotactic brain biopsy. Unprocessed, label-free samples were imaged using a portable fiber laser Raman scattering microscope. Three deep learning models were tested to (i) identify tumorous/nontumorous tissue as qualitative biopsy control; (ii) subclassify into high-grade glioma (central nervous system World Health Organization grade 4), diffuse low-grade glioma (central nervous system World Health Organization grades 2-3), metastases, lymphoma, or gliosis; and (iii) molecularly subtype IDH and 1p/19q statuses of adult-type diffuse gliomas. Model predictions were evaluated against frozen section analysis and final neuropathologic diagnoses. RESULTS The first model identified tumorous/nontumorous tissue with 91.7% accuracy. Sample size on slides impacted accuracy in brain tumor subclassification (81.6%, κ = 0.72 frozen section; 73.9%, κ = 0.61 second model), with SRH images being smaller than hematoxylin and eosin images (4.1 ± 2.5 mm2 vs. 16.7 ± 8.2 mm2, P < 0.001). SRH images with more than 140 high-quality patches and a mean squeezed sample of 5.26 mm2 yielded 89.5% accuracy in subclassification and 93.9% in molecular subtyping of adult-type diffuse gliomas. CONCLUSIONS Artificial intelligence-based SRH image analysis is non-inferior to frozen section analysis in detecting and subclassifying brain tumors during small stereotactic-guided biopsies once a critical squeezed sample size is reached. Beyond frozen section analysis, it enables valid molecular glioma subtyping, allowing faster treatment decisions in the future; however, refinement is needed for long-term application.
Collapse
Affiliation(s)
- David Reinecke
- Department of Stereotactic and Functional Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
- Department of General Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Daniel Ruess
- Department of Stereotactic and Functional Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
- Centre for Integrated Oncology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Anna-Katharina Meissner
- Department of General Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Gina Fürtjes
- Department of General Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Niklas von Spreckelsen
- Department of General Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | | | | | - Tobias Blau
- Institute for Neuropathology, University of Essen, Essen, Germany
| | - Thomas Stehle
- Institute for Neuropathology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Abdulkader Al-Shugri
- Institute for Neuropathology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Reinhard Büttner
- Institute for Neuropathology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
- Institute of General Pathology and Pathological Anatomy, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Roland Goldbrunner
- Department of General Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
- Centre for Integrated Oncology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Maximilian I Ruge
- Department of Stereotactic and Functional Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
- Centre for Integrated Oncology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Volker Neuschmelting
- Department of General Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
- Centre for Integrated Oncology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| |
Collapse
|
2
|
Baker CR, Pease M, Sexton DP, Abumoussa A, Chambless LB. Artificial intelligence innovations in neurosurgical oncology: a narrative review. J Neurooncol 2024; 169:489-496. [PMID: 38958849 PMCID: PMC11341589 DOI: 10.1007/s11060-024-04757-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Accepted: 06/24/2024] [Indexed: 07/04/2024]
Abstract
PURPOSE Artificial Intelligence (AI) has become increasingly integrated clinically within neurosurgical oncology. This report reviews the cutting-edge technologies impacting tumor treatment and outcomes. METHODS A rigorous literature search was performed with the aid of a research librarian to identify key articles referencing AI and related topics (machine learning (ML), computer vision (CV), augmented reality (AR), virtual reality (VR), etc.) for neurosurgical care of brain or spinal tumors. RESULTS Treatment of central nervous system (CNS) tumors is being improved through advances across AI-such as AL, CV, and AR/VR. AI aided diagnostic and prognostication tools can influence pre-operative patient experience, while automated tumor segmentation and total resection predictions aid surgical planning. Novel intra-operative tools can rapidly provide histopathologic tumor classification to streamline treatment strategies. Post-operative video analysis, paired with rich surgical simulations, can enhance training feedback and regimens. CONCLUSION While limited generalizability, bias, and patient data security are current concerns, the advent of federated learning, along with growing data consortiums, provides an avenue for increasingly safe, powerful, and effective AI platforms in the future.
Collapse
Affiliation(s)
- Clayton R Baker
- Vanderbilt University School of Medicine, Nashville, TN, USA.
| | - Matthew Pease
- Department of Neurosurgery, Indiana University, Indianapolis, IN, USA
| | - Daniel P Sexton
- Department of Neurosurgery, Duke University, Durham, NC, USA
| | - Andrew Abumoussa
- Department of Neurosurgery, University of North Carolina at Chapel Hill Hospitals, Chapel Hill, NC, USA
| | - Lola B Chambless
- Department of Neurosurgery, Vanderbilt University Medical Center, Nashville, TN, USA
| |
Collapse
|
3
|
Zhu R, He H, Chen Y, Yi M, Ran S, Wang C, Wang Y. Deep learning for rapid virtual H&E staining of label-free glioma tissue from hyperspectral images. Comput Biol Med 2024; 180:108958. [PMID: 39094325 DOI: 10.1016/j.compbiomed.2024.108958] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2024] [Revised: 07/02/2024] [Accepted: 07/26/2024] [Indexed: 08/04/2024]
Abstract
Hematoxylin and eosin (H&E) staining is a crucial technique for diagnosing glioma, allowing direct observation of tissue structures. However, the H&E staining workflow necessitates intricate processing, specialized laboratory infrastructures, and specialist pathologists, rendering it expensive, labor-intensive, and time-consuming. In view of these considerations, we combine the deep learning method and hyperspectral imaging technique, aiming at accurately and rapidly converting the hyperspectral images into virtual H&E staining images. The method overcomes the limitations of H&E staining by capturing tissue information at different wavelengths, providing comprehensive and detailed tissue composition information as the realistic H&E staining. In comparison with various generator structures, the Unet exhibits substantial overall advantages, as evidenced by a mean structure similarity index measure (SSIM) of 0.7731 and a peak signal-to-noise ratio (PSNR) of 23.3120, as well as the shortest training and inference time. A comprehensive software system for virtual H&E staining, which integrates CCD control, microscope control, and virtual H&E staining technology, is developed to facilitate fast intraoperative imaging, promote disease diagnosis, and accelerate the development of medical automation. The platform reconstructs large-scale virtual H&E staining images of gliomas at a high speed of 3.81 mm2/s. This innovative approach will pave the way for a novel, expedited route in histological staining.
Collapse
Affiliation(s)
- Ruohua Zhu
- National Engineering Research Center of Ophthalmology and Optometry, School of Biomedical Engineering, Eye Hospital, Wenzhou Medical University, Xueyuan Road 270, Wenzhou, 325027, China
| | - Haiyang He
- National Engineering Research Center of Ophthalmology and Optometry, School of Biomedical Engineering, Eye Hospital, Wenzhou Medical University, Xueyuan Road 270, Wenzhou, 325027, China
| | - Yuzhe Chen
- National Engineering Research Center of Ophthalmology and Optometry, School of Biomedical Engineering, Eye Hospital, Wenzhou Medical University, Xueyuan Road 270, Wenzhou, 325027, China
| | - Ming Yi
- National Engineering Research Center of Ophthalmology and Optometry, School of Biomedical Engineering, Eye Hospital, Wenzhou Medical University, Xueyuan Road 270, Wenzhou, 325027, China
| | - Shengdong Ran
- National Engineering Research Center of Ophthalmology and Optometry, School of Biomedical Engineering, Eye Hospital, Wenzhou Medical University, Xueyuan Road 270, Wenzhou, 325027, China
| | - Chengde Wang
- Department of Neurosurgery, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou 325000, China.
| | - Yi Wang
- National Engineering Research Center of Ophthalmology and Optometry, School of Biomedical Engineering, Eye Hospital, Wenzhou Medical University, Xueyuan Road 270, Wenzhou, 325027, China; Wenzhou Institute, University of Chinese Academy of Sciences, Jinlian Road 1, Wenzhou, 325001, China.
| |
Collapse
|
4
|
Reinecke D, Maroouf N, Smith A, Alber D, Markert J, Goff NK, Hollon TC, Chowdury A, Jiang C, Hou X, Meissner AK, Fürtjes G, Ruge MI, Ruess D, Stehle T, Al-Shughri A, Körner LI, Widhalm G, Roetzer-Pejrimovsky T, Golfinos JG, Snuderl M, Neuschmelting V, Orringer DA. Fast intraoperative detection of primary CNS lymphoma and differentiation from common CNS tumors using stimulated Raman histology and deep learning. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.08.25.24312509. [PMID: 39252932 PMCID: PMC11383472 DOI: 10.1101/2024.08.25.24312509] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 09/11/2024]
Abstract
Accurate intraoperative diagnosis is crucial for differentiating between primary CNS lymphoma (PCNSL) and other CNS entities, guiding surgical decision-making, but represents significant challenges due to overlapping histomorphological features, time constraints, and differing treatment strategies. We combined stimulated Raman histology (SRH) with deep learning to address this challenge. We imaged unprocessed, label-free tissue samples intraoperatively using a portable Raman scattering microscope, generating virtual H&E-like images within less than three minutes. We developed a deep learning pipeline called RapidLymphoma based on a self-supervised learning strategy to (1) detect PCNSL, (2) differentiate from other CNS entities, and (3) test the diagnostic performance in a prospective international multicenter cohort and two additional independent test cohorts. We trained on 54,000 SRH patch images sourced from surgical resections and stereotactic-guided biopsies, including various CNS tumor/non-tumor lesions. Training and test data were collected from four tertiary international medical centers. The final histopathological diagnosis served as ground-truth. In the prospective test cohort of PCNSL and non-PCNSL entities (n=160), RapidLymphoma achieved an overall balanced accuracy of 97.81% ±0.91, non-inferior to frozen section analysis in detecting PCNSL (100% vs. 78.94%). The additional test cohorts (n=420, n=59) reached balanced accuracy rates of 95.44% ±0.74 and 95.57% ±2.47 in differentiating IDH-wildtype diffuse gliomas and various brain metastasis from PCNSL. Visual heatmaps revealed RapidLymphoma's capabilities to detect class-specific histomorphological key features. RapidLymphoma is valid and reliable in detecting PCNSL and differentiating from other CNS entities within three minutes, as well as visual feedback in an intraoperative setting. This leads to fast clinical decision-making and further treatment strategy planning.
Collapse
Affiliation(s)
- David Reinecke
- Department of Neurosurgery, New York University Grossman School of Medicine, New York, USA
- Department of General Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Nader Maroouf
- Department of Neurosurgery, New York University Grossman School of Medicine, New York, USA
| | - Andrew Smith
- Department of Neurosurgery, New York University Grossman School of Medicine, New York, USA
| | - Daniel Alber
- Department of Neurosurgery, New York University Grossman School of Medicine, New York, USA
| | - John Markert
- Department of Neurosurgery, New York University Grossman School of Medicine, New York, USA
- Heersink School of Medicine, University of Alabama at Birmingham, Birmingham, USA
| | - Nicolas K Goff
- Department of Neurosurgery, New York University Grossman School of Medicine, New York, USA
- Department of Neurosurgery, University of Texas at Austin Dell Medical School, Austin, USA
| | - Todd C Hollon
- Machine Learning in Neurosurgery Laboratory, Department of Neurosurgery, University of Michigan, Ann Arbor, USA
| | - Asadur Chowdury
- Machine Learning in Neurosurgery Laboratory, Department of Neurosurgery, University of Michigan, Ann Arbor, USA
| | - Cheng Jiang
- Machine Learning in Neurosurgery Laboratory, Department of Neurosurgery, University of Michigan, Ann Arbor, USA
| | - Xinhai Hou
- Machine Learning in Neurosurgery Laboratory, Department of Neurosurgery, University of Michigan, Ann Arbor, USA
| | - Anna-Katharina Meissner
- Department of General Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Gina Fürtjes
- Department of General Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Maximilian I Ruge
- Center for Integrated Oncology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
- Department of Stereotactic and Functional Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Daniel Ruess
- Center for Integrated Oncology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
- Department of Stereotactic and Functional Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Thomas Stehle
- Institute for Neuropathology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Abdulkader Al-Shughri
- Institute for Neuropathology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Lisa I Körner
- Department of Neurosurgery, Medical University of Vienna, Vienna, Austria
| | - Georg Widhalm
- Department of Neurosurgery, Medical University of Vienna, Vienna, Austria
| | - Thomas Roetzer-Pejrimovsky
- Division of Neuropathology and Neurochemistry, Department of Neurology, Medical University of Vienna, Vienna, Austria
- Comprehensive Center for Clinical Neurosciences & Mental Health, Medical University of Vienna, Vienna, Austria
| | - John G Golfinos
- Department of Neurosurgery, New York University Grossman School of Medicine, New York, USA
| | - Matija Snuderl
- Department of Pathology, New York Grossman School of Medicine, New York, USA
| | - Volker Neuschmelting
- Department of General Neurosurgery, Center for Neurosurgery, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
- Center for Integrated Oncology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Daniel A Orringer
- Department of Neurosurgery, New York University Grossman School of Medicine, New York, USA
- Department of Pathology, New York Grossman School of Medicine, New York, USA
| |
Collapse
|
5
|
Mannas MP, Deng FM, Ion-Margineanu A, Freudiger C, Jones D, Hoskoppal D, Melamed J, Wysock J, Orringer DA, Taneja SS. Intraoperative margin assessment with near real time pathology during partial gland ablation of prostate cancer: A feasibility study. Urol Oncol 2024:S1078-1439(24)00533-7. [PMID: 39129081 DOI: 10.1016/j.urolonc.2024.06.023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2024] [Revised: 05/27/2024] [Accepted: 06/20/2024] [Indexed: 08/13/2024]
Abstract
BACKGROUND In-field or in-margin recurrence after partial gland cryosurgical ablation (PGCA) of prostate cancer (PCa) remains a limitation of the paradigm. Stimulated Raman histology (SRH) is a novel microscopic technique allowing real time, label-free, high-resolution microscopic images of unprocessed, un-sectioned tissue which can be interpreted by humans or artificial intelligence (AI). We evaluated surgical team and AI interpretation of SRH for real-time pathologic feedback in the planning and treatment of PCa with PGCA. METHODS About 12 participants underwent prostate mapping biopsies during PGCA of their PCa between January and June 2022. Prostate biopsies were immediately scanned in a SRH microscope at 20 microns depth using 2 Raman shifts to create SRH images which were interpreted by the surgical team intraoperatively to guide PGCA, and retrospectively assessed by AI. The cores were then processed, hematoxylin and eosin stained as per normal pathologic protocols and used for ground truth pathologic assessment. RESULTS Surgical team interpretation of SRH intraoperatively revealed 98.1% accuracy, 100% sensitivity, 97.3% specificity for identification of PCa, while AI showed a 97.9% accuracy, 100% sensitivity and 97.5% specificity for identification of clinically significant PCa. 3 participants' PGCA treatments were modified after SRH visualized PCa adjacent to an expected MRI predicted tumor margin or at an untreated cryosurgical margin. CONCLUSION SRH allows for accurate rapid identification of PCa in PB by a surgical team interpretation or AI. PCa tumor mapping and margin assessment during PGCA appears to be feasible and accurate. Further studies evaluating impact on clinical outcomes are warranted.
Collapse
Affiliation(s)
- Miles P Mannas
- Dept. of Urologic Sciences, University of British Columbia, Vancouver, British Columbia, Canada; Vancouver Prostate Centre, University of British Columbia, Vancouver, British Columbia, Canada; Dept. of Urology, NYU Langone Health, New York, NY.
| | | | | | | | - Derek Jones
- Dept. of Pathology, NYU Langone Health, New York, NY
| | | | | | - James Wysock
- Dept. of Urology, NYU Langone Health, New York, NY
| | | | - Samir S Taneja
- Dept. of Urology, NYU Langone Health, New York, NY; Dept. of Radiology, NYU Langone Health, New York, NY; Dept. of Biomedical Engineering, NYU Langone Health, New York, NY
| |
Collapse
|
6
|
Kurland DB, Alber D, Smith A, Ahmed S, Orringer D, Frempong-Boadu A, Lau D. What Are We Transfusing? Evaluating the Quality and Clinical Utility of Intraoperatively Salvaged Red Blood Cells in Spinal Deformity Surgery: A Nonrandomized Controlled Trial. Neurosurgery 2024:00006123-990000000-01301. [PMID: 39087785 DOI: 10.1227/neu.0000000000003131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2024] [Accepted: 06/19/2024] [Indexed: 08/02/2024] Open
Abstract
BACKGROUND AND OBJECTIVES Intraoperative red blood cell (RBC) salvage is frequently used in contemporary spine surgery, despite clinical concern in its efficacy as a surrogate for blood-banked allogeneic packed RBCs (pRBCs). During spine surgery, salvaged RBCs (sRBCs) are exposed to injurious high-heat electrocautery, prolonged stasis, and abrasive pharmaceuticals, potentially making sRBCs a poor blood substitute. We therefore sought to scientifically and objectively define the quality of sRBCs in the context of complex spine surgery. METHODS This is a single-center, prospective, nonrandomized controlled trial of patients undergoing posterior-based multilevel thoracolumbar instrumented fusion for spinal deformity with planned use of intraoperative RBC salvage between June 2022 and July 2023. Surgeries were performed by fellowship-trained spinal neurosurgeons and orthopedic surgeons. The participants were split based on transfusion of sRBCs (given sufficient yield) vs no sRBC transfusion. Primary outcomes were RBC electrolyte composition, indices, deformability, and integrity, which were evaluated in comparison blood samples: Baseline, pRBC, and sRBC. Secondary outcomes were related to clinical effects of sRBC transfusion. Morphological assessment used Stimulated Raman Histology and machine learning. Deformability was assessed using ektacytometry. RESULTS A total of 174 patients were included. The mean age was 50.2years ±25.4, 58.6% was female, the mean level fused was 10.0 ± 3.9, and 58.0% received sRBCs (median 207.0 mL). sRBCs differed significantly on standard laboratory measures, had a high proportion (30.7%) of shrunken and irregularly spiculated morphologies, and demonstrated abnormal deformability and relaxation kinetics. The hemolysis index was significantly elevated in sRBCs (2.9 ± 1.8) compared with Baseline samples and pRBCs (P < .01). Transfusion of sRBCs was associated with suboptimal resuscitation and provided no practical clinical benefit. CONCLUSION RBCs salvaged during posterior thoracolumbar spine surgery are irreversibly injured, with hemolysis index exceeding Food and Drug Administration and Council of Europe transfusion standards in all samples, questioning their efficacy and safety as a blood substitute.
Collapse
Affiliation(s)
- David B Kurland
- Department of Neurosurgery, New York University Langone Medical Center, New York, New York, USA
| | - Daniel Alber
- Department of Neurosurgery, New York University Langone Medical Center, New York, New York, USA
| | - Andrew Smith
- Department of Neurosurgery, New York University Langone Medical Center, New York, New York, USA
| | - Shah Ahmed
- Department of Anesthesiology, New York University Langone Medical Center, New York, New York, USA
| | - Daniel Orringer
- Department of Neurosurgery, New York University Langone Medical Center, New York, New York, USA
| | - Anthony Frempong-Boadu
- Department of Neurosurgery, New York University Langone Medical Center, New York, New York, USA
| | - Darryl Lau
- Department of Neurosurgery, New York University Langone Medical Center, New York, New York, USA
| |
Collapse
|
7
|
Wong PF, McNeil C, Wang Y, Paparian J, Santori C, Gutierrez M, Homyk A, Nagpal K, Jaroensri T, Wulczyn E, Yoshitake T, Sigman J, Steiner DF, Rao S, Cameron Chen PH, Restorick L, Roy J, Cimermancic P. Clinical-Grade Validation of an Autofluorescence Virtual Staining System With Human Experts and a Deep Learning System for Prostate Cancer. Mod Pathol 2024; 37:100573. [PMID: 39069201 DOI: 10.1016/j.modpat.2024.100573] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Revised: 07/03/2024] [Accepted: 07/22/2024] [Indexed: 07/30/2024]
Abstract
The tissue diagnosis of adenocarcinoma and intraductal carcinoma of the prostate includes Gleason grading of tumor morphology on the hematoxylin and eosin stain and immunohistochemistry markers on the prostatic intraepithelial neoplasia-4 stain (CK5/6, P63, and AMACR). In this work, we create an automated system for producing both virtual hematoxylin and eosin and prostatic intraepithelial neoplasia-4 immunohistochemistry stains from unstained prostate tissue using a high-throughput hyperspectral fluorescence microscope and artificial intelligence and machine learning. We demonstrate that the virtual stainer models can produce high-quality images suitable for diagnosis by genitourinary pathologists. Specifically, we validate our system through extensive human review and computational analysis, using a previously validated Gleason scoring model, and an expert panel, on a large data set of test slides. This study extends our previous work on virtual staining from autofluorescence, demonstrates the clinical utility of this technology for prostate cancer, and exemplifies a rigorous standard of qualitative and quantitative evaluation for digital pathology.
Collapse
Affiliation(s)
- Pok Fai Wong
- Verily Life Sciences LLC, San Francisco, California
| | - Carson McNeil
- Verily Life Sciences LLC, San Francisco, California.
| | - Yang Wang
- Verily Life Sciences LLC, San Francisco, California.
| | | | | | | | - Andrew Homyk
- Verily Life Sciences LLC, San Francisco, California
| | | | | | | | | | - Julia Sigman
- Verily Life Sciences LLC, San Francisco, California
| | | | - Sudha Rao
- Verily Life Sciences LLC, San Francisco, California
| | | | | | | | | |
Collapse
|
8
|
Sarri B, Chevrier V, Poizat F, Heuke S, Franchi F, De Franqueville L, Traversari E, Ratone JP, Caillol F, Dahel Y, Hoibian S, Giovannini M, de Chaisemartin C, Appay R, Guasch G, Rigneault H. In vivo organoid growth monitoring by stimulated Raman histology. NPJ IMAGING 2024; 2:18. [PMID: 38948153 PMCID: PMC11213706 DOI: 10.1038/s44303-024-00019-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/07/2024] [Accepted: 05/21/2024] [Indexed: 07/02/2024]
Abstract
Patient-derived tumor organoids have emerged as a crucial tool for assessing the efficacy of chemotherapy and conducting preclinical drug screenings. However, the conventional histological investigation of these organoids necessitates their devitalization through fixation and slicing, limiting their utility to a single-time analysis. Here, we use stimulated Raman histology (SRH) to demonstrate non-destructive, label-free virtual staining of 3D organoids, while preserving their viability and growth. This novel approach provides contrast similar to conventional staining methods, allowing for the continuous monitoring of organoids over time. Our results demonstrate that SRH transforms organoids from one-time use products into repeatable models, facilitating the efficient selection of effective drug combinations. This advancement holds promise for personalized cancer treatment, allowing for the dynamic assessment and optimization of chemotherapy treatments in patient-specific contexts.
Collapse
Affiliation(s)
- Barbara Sarri
- Aix Marseille Univ, CNRS, Centrale Med, Institut Fresnel, Marseille, France
- Ligthcore Technologies, Marseille, France
| | - Véronique Chevrier
- CRCM, Inserm, CNRS, Institut Paoli-Calmettes, Aix-Marseille Univ, Epithelial Stem Cells and Cancer Lab, Marseille, France
| | - Flora Poizat
- Department of Biopathology, Institut Paoli-Calmettes, Marseille, France
| | - Sandro Heuke
- Aix Marseille Univ, CNRS, Centrale Med, Institut Fresnel, Marseille, France
| | - Florence Franchi
- Department of Biopathology, Institut Paoli-Calmettes, Marseille, France
| | | | - Eddy Traversari
- Department of Surgical Oncology, Institut Paoli-Calmette, Marseille, France
| | | | - Fabrice Caillol
- Department of Gastro-enterology, Institut Paoli-Calmettes, Marseille, France
| | - Yanis Dahel
- Department of Gastro-enterology, Institut Paoli-Calmettes, Marseille, France
| | - Solène Hoibian
- Department of Gastro-enterology, Institut Paoli-Calmettes, Marseille, France
| | - Marc Giovannini
- Department of Gastro-enterology, Institut Paoli-Calmettes, Marseille, France
| | | | - Romain Appay
- Aix- Marseille Univ, CNRS, Neurophysiopathology Institute, Marseille, France
| | - Géraldine Guasch
- CRCM, Inserm, CNRS, Institut Paoli-Calmettes, Aix-Marseille Univ, Epithelial Stem Cells and Cancer Lab, Marseille, France
| | - Hervé Rigneault
- Aix Marseille Univ, CNRS, Centrale Med, Institut Fresnel, Marseille, France
| |
Collapse
|
9
|
Monteiro C, Gomes MC, Bharmoria P, Freire MG, Coutinho JA, Custódio CA, Mano JF. Human Platelet Lysate-Derived Nanofibrils as Building Blocks to Produce Free-Standing Membranes for Cell Self-Aggregation. ACS NANO 2024; 18:15815-15830. [PMID: 38833572 PMCID: PMC11191744 DOI: 10.1021/acsnano.4c02790] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Revised: 05/12/2024] [Accepted: 05/22/2024] [Indexed: 06/06/2024]
Abstract
Amyloid-like fibrils are garnering keen interest in biotechnology as supramolecular nanofunctional units to be used as biomimetic platforms to control cell behavior. Recent insights into fibril functionality have highlighted their importance in tissue structure, mechanical properties, and improved cell adhesion, emphasizing the need for scalable and high-kinetics fibril synthesis. In this study, we present the instantaneous and bulk formation of amyloid-like nanofibrils from human platelet lysate (PL) using the ionic liquid cholinium tosylate as a fibrillating agent. The instant fibrillation of PL proteins upon supramolecular protein-ionic liquid interactions was confirmed from the protein conformational transition toward cross-β-sheet-rich structures. These nanofibrils were utilized as building blocks for the formation of thin and flexible free-standing membranes via solvent casting to support cell self-aggregation. These PL-derived fibril membranes reveal a nanotopographically rough surface and high stability over 14 days under cell culture conditions. The culture of mesenchymal stem cells or tumor cells on the top of the membrane demonstrated that cells are able to adhere and self-organize in a three-dimensional (3D) spheroid-like microtissue while tightly folding the fibril membrane. Results suggest that nanofibril membrane incorporation in cell aggregates can improve cell viability and metabolic activity, recreating native tissues' organization. Altogether, these PL-derived nanofibril membranes are suitable bioactive platforms to generate 3D cell-guided microtissues, which can be explored as bottom-up strategies to faithfully emulate native tissues in a fully human microenvironment.
Collapse
Affiliation(s)
- Cátia
F. Monteiro
- CICECO − Aveiro Institute
of Materials, Department of Chemistry, University
of Aveiro, Campus Universitário de Santiago, Aveiro 3810-193, Portugal
| | - Maria C. Gomes
- CICECO − Aveiro Institute
of Materials, Department of Chemistry, University
of Aveiro, Campus Universitário de Santiago, Aveiro 3810-193, Portugal
| | | | - Mara G. Freire
- CICECO − Aveiro Institute
of Materials, Department of Chemistry, University
of Aveiro, Campus Universitário de Santiago, Aveiro 3810-193, Portugal
| | - João A.
P. Coutinho
- CICECO − Aveiro Institute
of Materials, Department of Chemistry, University
of Aveiro, Campus Universitário de Santiago, Aveiro 3810-193, Portugal
| | - Catarina A. Custódio
- CICECO − Aveiro Institute
of Materials, Department of Chemistry, University
of Aveiro, Campus Universitário de Santiago, Aveiro 3810-193, Portugal
| | - João F. Mano
- CICECO − Aveiro Institute
of Materials, Department of Chemistry, University
of Aveiro, Campus Universitário de Santiago, Aveiro 3810-193, Portugal
| |
Collapse
|
10
|
Zhou W, Liu D, Fang T, Chen X, Jia H, Tian X, Hao C, Yue S. Rapid and Precise Diagnosis of Retroperitoneal Liposarcoma with Deep-Learned Label-Free Molecular Microscopy. Anal Chem 2024; 96:9353-9361. [PMID: 38810149 DOI: 10.1021/acs.analchem.3c05417] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/31/2024]
Abstract
The retroperitoneal liposarcoma (RLPS) is a rare malignancy whose only curative therapy is surgical resection. However, well-differentiated liposarcomas (WDLPSs), one of its most common types, can hardly be distinguished from normal fat during operation without an effective margin assessment method, jeopardizing the prognosis severely with a high recurrence risk. Here, we combined dual label-free nonlinear optical modalities, stimulated Raman scattering (SRS) microscopy and second harmonic generation (SHG) microscopy, to image two predominant tissue biomolecules, lipids and collagen fibers, in 35 RLPSs and 34 normal fat samples collected from 35 patients. The produced dual-modal tissue images were used for RLPS diagnosis based on deep learning. Dramatically decreasing lipids and increasing collagen fibers during tumor progression were reflected. A ResNeXt101-based model achieved 94.7% overall accuracy and 0.987 mean area under the ROC curve (AUC) in differentiating among normal fat, WDLPSs, and dedifferentiated liposarcomas (DDLPSs). In particular, WDLPSs were detected with 94.1% precision and 84.6% sensitivity superior to existing methods. The ablation experiment showed that such performance was attributed to both SRS and SHG microscopies, which increased the sensitivity of recognizing WDLPS by 16.0 and 3.6%, respectively. Furthermore, we utilized this model on RLPS margins to identify the tumor infiltration. Our method holds great potential for accurate intraoperative liposarcoma detection.
Collapse
Affiliation(s)
- Wanhui Zhou
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education, Institute of Medical Photonics, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing 100191, China
| | - Daoning Liu
- Key laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Hepato-Pancreato-Biliary Surgery/Sarcoma Center, Peking University Cancer Hospital & Institute, Beijing 100142, China
| | - Tinghe Fang
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education, Institute of Medical Photonics, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing 100191, China
| | - Xun Chen
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education, Institute of Medical Photonics, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing 100191, China
- School of Engineering Medicine, Beihang University, Beijing 100191, China
| | - Hao Jia
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education, Institute of Medical Photonics, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing 100191, China
| | - Xiuyun Tian
- Key laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Hepato-Pancreato-Biliary Surgery/Sarcoma Center, Peking University Cancer Hospital & Institute, Beijing 100142, China
| | - Chunyi Hao
- Key laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Hepato-Pancreato-Biliary Surgery/Sarcoma Center, Peking University Cancer Hospital & Institute, Beijing 100142, China
| | - Shuhua Yue
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education, Institute of Medical Photonics, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing 100191, China
| |
Collapse
|
11
|
Optical microscopy and transcriptomics reveal the origins of fluorescence in glioma surgery. Nat Biomed Eng 2024; 8:670-671. [PMID: 38992291 DOI: 10.1038/s41551-024-01218-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/13/2024]
|
12
|
Nasir-Moin M, Wadiura LI, Sacalean V, Juros D, Movahed-Ezazi M, Lock EK, Smith A, Lee M, Weiss H, Müther M, Alber D, Ratna S, Fang C, Suero-Molina E, Hellwig S, Stummer W, Rössler K, Hainfellner JA, Widhalm G, Kiesel B, Reichert D, Mischkulnig M, Jain R, Straehle J, Neidert N, Schnell O, Beck J, Trautman J, Pastore S, Pacione D, Placantonakis D, Oermann EK, Golfinos JG, Hollon TC, Snuderl M, Freudiger CW, Heiland DH, Orringer DA. Localization of protoporphyrin IX during glioma-resection surgery via paired stimulated Raman histology and fluorescence microscopy. Nat Biomed Eng 2024; 8:672-688. [PMID: 38987630 DOI: 10.1038/s41551-024-01217-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2022] [Accepted: 04/20/2024] [Indexed: 07/12/2024]
Abstract
The most widely used fluorophore in glioma-resection surgery, 5-aminolevulinic acid (5-ALA), is thought to cause the selective accumulation of fluorescent protoporphyrin IX (PpIX) in tumour cells. Here we show that the clinical detection of PpIX can be improved via a microscope that performs paired stimulated Raman histology and two-photon excitation fluorescence microscopy (TPEF). We validated the technique in fresh tumour specimens from 115 patients with high-grade gliomas across four medical institutions. We found a weak negative correlation between tissue cellularity and the fluorescence intensity of PpIX across all imaged specimens. Semi-supervised clustering of the TPEF images revealed five distinct patterns of PpIX fluorescence, and spatial transcriptomic analyses of the imaged tissue showed that myeloid cells predominate in areas where PpIX accumulates in the intracellular space. Further analysis of external spatially resolved metabolomics, transcriptomics and RNA-sequencing datasets from glioblastoma specimens confirmed that myeloid cells preferentially accumulate and metabolize PpIX. Our findings question 5-ALA-induced fluorescence in glioma cells and show how 5-ALA and TPEF imaging can provide a window into the immune microenvironment of gliomas.
Collapse
Affiliation(s)
- Mustafa Nasir-Moin
- Department of Neurosurgery, NYU Grossman School of Medicine, New York, NY, USA
| | | | - Vlad Sacalean
- Department of Neurosurgery, Medical Center - University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
- Microenvironment and Immunology Research Laboratory, Medical Center - University of Freiburg, Freiburg, Germany
| | - Devin Juros
- Department of Neurosurgery, NYU Grossman School of Medicine, New York, NY, USA
| | | | - Emily K Lock
- Department of Neurosurgery, NYU Grossman School of Medicine, New York, NY, USA
| | - Andrew Smith
- Department of Neurosurgery, NYU Grossman School of Medicine, New York, NY, USA
| | - Matthew Lee
- Department of Radiology, NYU Grossman School of Medicine, New York, NY, USA
| | - Hannah Weiss
- Department of Neurosurgery, NYU Grossman School of Medicine, New York, NY, USA
| | - Michael Müther
- Department of Neurosurgery, Münster University Hospital, Münster, Germany
| | - Daniel Alber
- Department of Neurosurgery, NYU Grossman School of Medicine, New York, NY, USA
| | | | - Camila Fang
- Department of Pathology, NYU Grossman School of Medicine, New York, NY, USA
| | - Eric Suero-Molina
- Department of Neurosurgery, Münster University Hospital, Münster, Germany
| | - Sönke Hellwig
- Department of Neurosurgery, Münster University Hospital, Münster, Germany
| | - Walter Stummer
- Department of Neurosurgery, Münster University Hospital, Münster, Germany
| | - Karl Rössler
- Department of Neurosurgery, Medical University Vienna, Vienna, Austria
| | - Johannes A Hainfellner
- Division of Neuropathology and Neurochemistry (Obersteiner Institute), Department of Neurology, Medical University Vienna, Vienna, Austria
| | - Georg Widhalm
- Department of Neurosurgery, Medical University Vienna, Vienna, Austria
| | - Barbara Kiesel
- Department of Neurosurgery, Medical University Vienna, Vienna, Austria
| | - David Reichert
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Mario Mischkulnig
- Department of Neurosurgery, Medical University Vienna, Vienna, Austria
| | - Rajan Jain
- Department of Radiology, NYU Grossman School of Medicine, New York, NY, USA
| | - Jakob Straehle
- Department of Neurosurgery, Medical Center - University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
- Berta-Ottenstein Clinician Scientist Program, Faculty of Medicine, University Freiburg, Freiburg, Germany
| | - Nicolas Neidert
- Department of Neurosurgery, Medical Center - University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
- Berta-Ottenstein Clinician Scientist Program, Faculty of Medicine, University Freiburg, Freiburg, Germany
| | - Oliver Schnell
- Department of Neurosurgery, Medical Center - University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
- Translational NeuroOncology Research Group, Medical Center - University of Freiburg, Freiburg, Germany
| | - Jürgen Beck
- Department of Neurosurgery, Medical Center - University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
- Center for NeuroModulation (NeuroModul), University of Freiburg, Freiburg, Germany
| | | | | | - Donato Pacione
- Department of Neurosurgery, NYU Grossman School of Medicine, New York, NY, USA
| | | | - Eric Karl Oermann
- Department of Neurosurgery, NYU Grossman School of Medicine, New York, NY, USA
- Center for Data Science, New York University, New York, USA
| | - John G Golfinos
- Department of Neurosurgery, NYU Grossman School of Medicine, New York, NY, USA
| | - Todd C Hollon
- Department of Neurosurgery, University of Michigan Medical School, Ann Arbor, MI, USA
| | - Matija Snuderl
- Department of Pathology, NYU Grossman School of Medicine, New York, NY, USA
| | | | - Dieter Henrik Heiland
- Department of Neurosurgery, Medical Center - University of Freiburg, Freiburg, Germany.
- Faculty of Medicine, University of Freiburg, Freiburg, Germany.
- Microenvironment and Immunology Research Laboratory, Medical Center - University of Freiburg, Freiburg, Germany.
- Comprehensive Cancer Center Freiburg (CCCF), Medical Center - University of Freiburg, Freiburg, Germany.
- German Cancer Consortium (DKTK), partner site Freiburg, Freiburg, Germany.
| | - Daniel A Orringer
- Department of Neurosurgery, NYU Grossman School of Medicine, New York, NY, USA.
- Department of Pathology, NYU Grossman School of Medicine, New York, NY, USA.
| |
Collapse
|
13
|
Raghunathan R, Vasquez M, Zhang K, Zhao H, Wong STC. Label-free optical imaging for brain cancer assessment. Trends Cancer 2024; 10:557-570. [PMID: 38575412 PMCID: PMC11168891 DOI: 10.1016/j.trecan.2024.03.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2024] [Revised: 03/12/2024] [Accepted: 03/13/2024] [Indexed: 04/06/2024]
Abstract
Advances in label-free optical imaging offer a promising avenue for brain cancer assessment, providing high-resolution, real-time insights without the need for radiation or exogeneous agents. These cost-effective and intricately detailed techniques overcome the limitations inherent in magnetic resonance imaging (MRI), computed tomography (CT), and positron emission tomography (PET) scans by offering superior resolution and more readily accessible imaging options. This comprehensive review explores a variety of such methods, including photoacoustic imaging (PAI), optical coherence tomography (OCT), Raman imaging, and IR microscopy. It focuses on their roles in the detection, diagnosis, and management of brain tumors. By highlighting recent advances in these imaging techniques, the review aims to underscore the importance of label-free optical imaging in enhancing early detection and refining therapeutic strategies for brain cancer.
Collapse
Affiliation(s)
- Raksha Raghunathan
- Department of Systems Medicine and Bioengineering and T.T. and W.F. Chao Center for BRAIN, Houston Methodist Neal Cancer Center, Houston Methodist Hospital, Houston, TX 77030, USA; Advanced Cellular and Tissue Microscopy Core, Houston Methodist Neal Cancer Center and Houston Methodist Research Institute, Houston, TX 77030, USA
| | - Matthew Vasquez
- Department of Systems Medicine and Bioengineering and T.T. and W.F. Chao Center for BRAIN, Houston Methodist Neal Cancer Center, Houston Methodist Hospital, Houston, TX 77030, USA; Advanced Cellular and Tissue Microscopy Core, Houston Methodist Neal Cancer Center and Houston Methodist Research Institute, Houston, TX 77030, USA
| | - Katherine Zhang
- Department of Systems Medicine and Bioengineering and T.T. and W.F. Chao Center for BRAIN, Houston Methodist Neal Cancer Center, Houston Methodist Hospital, Houston, TX 77030, USA; Advanced Cellular and Tissue Microscopy Core, Houston Methodist Neal Cancer Center and Houston Methodist Research Institute, Houston, TX 77030, USA
| | - Hong Zhao
- Department of Systems Medicine and Bioengineering and T.T. and W.F. Chao Center for BRAIN, Houston Methodist Neal Cancer Center, Houston Methodist Hospital, Houston, TX 77030, USA; Advanced Cellular and Tissue Microscopy Core, Houston Methodist Neal Cancer Center and Houston Methodist Research Institute, Houston, TX 77030, USA; Department of Medicine, Weill Cornell Medicine, New York, NY 10065, USA.
| | - Stephen T C Wong
- Department of Systems Medicine and Bioengineering and T.T. and W.F. Chao Center for BRAIN, Houston Methodist Neal Cancer Center, Houston Methodist Hospital, Houston, TX 77030, USA; Advanced Cellular and Tissue Microscopy Core, Houston Methodist Neal Cancer Center and Houston Methodist Research Institute, Houston, TX 77030, USA; Departments of Radiology, Pathology, and Laboratory Medicine and Brain and Mind Research Institute, Weill Cornell Medicine, New York, NY 10065, USA
| |
Collapse
|
14
|
Becker N, Camelo-Piragua S, Conway KS. A Contemporary Approach to Intraoperative Evaluation in Neuropathology. Arch Pathol Lab Med 2024; 148:649-658. [PMID: 37694565 DOI: 10.5858/arpa.2023-0097-ra] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/27/2023] [Indexed: 09/12/2023]
Abstract
CONTEXT.— Although the basic principles of intraoperative diagnosis in surgical neuropathology have not changed in the last century, the last several decades have seen dramatic changes in tumor classification, terminology, molecular classification, and modalities used for intraoperative diagnosis. As many neuropathologic intraoperative diagnoses are performed by general surgical pathologists, awareness of these recent changes is important for the most accurate intraoperative diagnosis. OBJECTIVE.— To describe recent changes in the practice of intraoperative surgical neuropathology, with an emphasis on new entities, tumor classification, and anticipated ancillary tests, including molecular testing. DATA SOURCES.— The sources for this review include the fifth edition of the World Health Organization Classification of Tumours of the Central Nervous System, primary literature on intraoperative diagnosis and newly described tumor entities, and the authors' clinical experience. CONCLUSIONS.— A significant majority of neuropathologic diagnoses require ancillary testing, including molecular analysis, for appropriate classification. Therefore, the primary goal for any neurosurgical intraoperative diagnosis is the identification of diagnostic tissue and the preservation of the appropriate tissue for molecular testing. The intraoperative pathologist should seek to place a tumor in the most accurate diagnostic category possible, but specific diagnosis at the time of an intraoperative diagnosis is often not possible. Many entities have seen adjustments to grading criteria, including the incorporation of molecular features into grading. Awareness of these changes can help to avoid overgrading or undergrading at the time of intraoperative evaluation.
Collapse
Affiliation(s)
- Nicole Becker
- From the Department of Pathology, University of Iowa, Iowa City (Becker)
| | - Sandra Camelo-Piragua
- the Department of Pathology, University of Michigan, Ann Arbor (Camelo-Piragua, Conway)
| | - Kyle S Conway
- the Department of Pathology, University of Michigan, Ann Arbor (Camelo-Piragua, Conway)
| |
Collapse
|
15
|
Wang Z, Han K, Liu W, Wang Z, Shi C, Liu X, Huang M, Sun G, Liu S, Guo Q. Fast Real-Time Brain Tumor Detection Based on Stimulated Raman Histology and Self-Supervised Deep Learning Model. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:1160-1176. [PMID: 38326533 PMCID: PMC11169153 DOI: 10.1007/s10278-024-01001-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Revised: 12/18/2023] [Accepted: 12/21/2023] [Indexed: 02/09/2024]
Abstract
In intraoperative brain cancer procedures, real-time diagnosis is essential for ensuring safe and effective care. The prevailing workflow, which relies on histological staining with hematoxylin and eosin (H&E) for tissue processing, is resource-intensive, time-consuming, and requires considerable labor. Recently, an innovative approach combining stimulated Raman histology (SRH) and deep convolutional neural networks (CNN) has emerged, creating a new avenue for real-time cancer diagnosis during surgery. While this approach exhibits potential, there exists an opportunity for refinement in the domain of feature extraction. In this study, we employ coherent Raman scattering imaging method and a self-supervised deep learning model (VQVAE2) to enhance the speed of SRH image acquisition and feature representation, thereby enhancing the capability of automated real-time bedside diagnosis. Specifically, we propose the VQSRS network, which integrates vector quantization with a proxy task based on patch annotation for analysis of brain tumor subtypes. Training on images collected from the SRS microscopy system, our VQSRS demonstrates a significant speed enhancement over traditional techniques (e.g., 20-30 min). Comparative studies in dimensionality reduction clustering confirm the diagnostic capacity of VQSRS rivals that of CNN. By learning a hierarchical structure of recognizable histological features, VQSRS classifies major tissue pathological categories in brain tumors. Additionally, an external semantic segmentation method is applied for identifying tumor-infiltrated regions in SRH images. Collectively, these findings indicate that this automated real-time prediction technique holds the potential to streamline intraoperative cancer diagnosis, providing assistance to pathologists in simplifying the process.
Collapse
Affiliation(s)
- Zijun Wang
- Academy of Artificial Intelligence, Beijing Institute of Petrochemical Technology, Beijing, 102617, China
| | - Kaitai Han
- Academy of Artificial Intelligence, Beijing Institute of Petrochemical Technology, Beijing, 102617, China
| | - Wu Liu
- Academy of Artificial Intelligence, Beijing Institute of Petrochemical Technology, Beijing, 102617, China
| | - Zhenghui Wang
- Academy of Artificial Intelligence, Beijing Institute of Petrochemical Technology, Beijing, 102617, China
| | - Chaojing Shi
- Academy of Artificial Intelligence, Beijing Institute of Petrochemical Technology, Beijing, 102617, China
| | - Xi Liu
- Academy of Artificial Intelligence, Beijing Institute of Petrochemical Technology, Beijing, 102617, China
| | - Mengyuan Huang
- Academy of Artificial Intelligence, Beijing Institute of Petrochemical Technology, Beijing, 102617, China
| | - Guocheng Sun
- Academy of Artificial Intelligence, Beijing Institute of Petrochemical Technology, Beijing, 102617, China
| | - Shitou Liu
- Academy of Artificial Intelligence, Beijing Institute of Petrochemical Technology, Beijing, 102617, China
| | - Qianjin Guo
- Academy of Artificial Intelligence, Beijing Institute of Petrochemical Technology, Beijing, 102617, China.
| |
Collapse
|
16
|
Jiang C, Gedeon A, Lyu Y, Landgraf E, Zhang Y, Hou X, Kondepudi A, Chowdury A, Lee H, Hollon T. Super-resolution of biomedical volumes with 2D supervision. CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS. IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION. WORKSHOPS 2024; 2024:6966-6977. [PMID: 39355755 PMCID: PMC11444667 DOI: 10.1109/cvprw63382.2024.00690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/03/2024]
Abstract
Volumetric biomedical microscopy has the potential to increase the diagnostic information extracted from clinical tissue specimens and improve the diagnostic accuracy of both human pathologists and computational pathology models. Unfortunately, barriers to integrating 3-dimensional (3D) volumetric microscopy into clinical medicine include long imaging times, poor depth/z-axis resolution, and an insufficient amount of high-quality volumetric data. Leveraging the abundance of high-resolution 2D microscopy data, we introduce masked slice diffusion for super-resolution (MSDSR), which exploits the inherent equivalence in the data-generating distribution across all spatial dimensions of biological specimens. This intrinsic characteristic allows for super-resolution models trained on high-resolution images from one plane (e.g., XY) to effectively generalize to others (XZ, YZ), overcoming the traditional dependency on orientation. We focus on the application of MSDSR to stimulated Raman histology (SRH), an optical imaging modality for biological specimen analysis and intraoperative diagnosis, characterized by its rapid acquisition of high-resolution 2D images but slow and costly optical z-sectioning. To evaluate MSDSR's efficacy, we introduce a new performance metric, SliceFID, and demonstrate MSDSR's superior performance over baseline models through extensive evaluations. Our findings reveal that MSDSR not only significantly enhances the quality and resolution of 3D volumetric data, but also addresses major obstacles hindering the broader application of 3D volumetric microscopy in clinical diagnostics and biomedical research.
Collapse
|
17
|
Tweel JED, Ecclestone BR, Boktor M, Dinakaran D, Mackey JR, Reza PH. Automated Whole Slide Imaging for Label-Free Histology Using Photon Absorption Remote Sensing Microscopy. IEEE Trans Biomed Eng 2024; 71:1901-1912. [PMID: 38231822 DOI: 10.1109/tbme.2024.3355296] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2024]
Abstract
OBJECTIVE Pathologists rely on histochemical stains to impart contrast in thin translucent tissue samples, revealing tissue features necessary for identifying pathological conditions. However, the chemical labeling process is destructive and often irreversible or challenging to undo, imposing practical limits on the number of stains that can be applied to the same tissue section. Here we present an automated label-free whole slide scanner using a PARS microscope designed for imaging thin, transmissible samples. METHODS Peak SNR and in-focus acquisitions are achieved across entire tissue sections using the scattering signal from the PARS detection beam to measure the optimal focal plane. Whole slide images (WSI) are seamlessly stitched together using a custom contrast leveling algorithm. Identical tissue sections are subsequently H&E stained and brightfield imaged. The one-to-one WSIs from both modalities are visually and quantitatively compared. RESULTS PARS WSIs are presented at standard 40x magnification in malignant human breast and skin samples. We show correspondence of subcellular diagnostic details in both PARS and H&E WSIs and demonstrate virtual H&E staining of an entire PARS WSI. The one-to-one WSI from both modalities show quantitative similarity in nuclear features and structural information. CONCLUSION PARS WSIs are compatible with existing digital pathology tools, and samples remain suitable for histochemical, immunohistochemical, and other staining techniques. SIGNIFICANCE This work is a critical advance for integrating label-free optical methods into standard histopathology workflows.
Collapse
|
18
|
Rich K, Tosefsky K, Martin KC, Bashashati A, Yip S. Practical Application of Deep Learning in Diagnostic Neuropathology-Reimagining a Histological Asset in the Era of Precision Medicine. Cancers (Basel) 2024; 16:1976. [PMID: 38893099 PMCID: PMC11171052 DOI: 10.3390/cancers16111976] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2024] [Revised: 05/10/2024] [Accepted: 05/20/2024] [Indexed: 06/21/2024] Open
Abstract
In the past few decades, neuropathology has experienced several paradigm shifts with the introduction of new technologies. Deep learning, a rapidly progressing subfield of machine learning, seems to be the next innovation to alter the diagnostic workflow. In this review, we will explore the recent changes in the field of neuropathology and how this has led to an increased focus on molecular features in diagnosis and prognosis. Then, we will examine the work carried out to train deep learning models for various diagnostic tasks in neuropathology, as well as the machine learning frameworks they used. Focus will be given to both the challenges and successes highlighted therein, as well as what these trends may tell us about future roadblocks in the widespread adoption of this new technology. Finally, we will touch on recent trends in deep learning, as applied to digital pathology more generally, and what this may tell us about the future of deep learning applications in neuropathology.
Collapse
Affiliation(s)
- Katherine Rich
- Bioinformatics Graduate Program, University of British Columbia, Vancouver, BC V6T 1Z4, Canada;
| | - Kira Tosefsky
- Faculty of Medicine, University of British Columbia, Vancouver, BC V6T 1Z4, Canada; (K.T.); (K.C.M.)
| | - Karina C. Martin
- Faculty of Medicine, University of British Columbia, Vancouver, BC V6T 1Z4, Canada; (K.T.); (K.C.M.)
- Department of Pathology & Laboratory Medicine, University of British Columbia, Vancouver, BC V6T 1Z4, Canada
| | - Ali Bashashati
- Department of Pathology & Laboratory Medicine, University of British Columbia, Vancouver, BC V6T 1Z4, Canada
- School of Biomedical Engineering, University of British Columbia, Vancouver, BC V6T 1Z4, Canada
| | - Stephen Yip
- Faculty of Medicine, University of British Columbia, Vancouver, BC V6T 1Z4, Canada; (K.T.); (K.C.M.)
- Department of Pathology & Laboratory Medicine, University of British Columbia, Vancouver, BC V6T 1Z4, Canada
| |
Collapse
|
19
|
Dunnington EL, Wong BS, Fu D. Innovative Approaches for Drug Discovery: Quantifying Drug Distribution and Response with Raman Imaging. Anal Chem 2024; 96:7926-7944. [PMID: 38625100 PMCID: PMC11108735 DOI: 10.1021/acs.analchem.4c01413] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/17/2024]
Affiliation(s)
| | | | - Dan Fu
- Department of Chemistry, University of Washington, Seattle, WA, 98195, USA
| |
Collapse
|
20
|
Ma L, Luo K, Liu Z, Ji M. Stain-Free Histopathology with Stimulated Raman Scattering Microscopy. Anal Chem 2024; 96:7907-7925. [PMID: 38713830 DOI: 10.1021/acs.analchem.4c02061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/09/2024]
Affiliation(s)
- Liyang Ma
- State Key Laboratory of Surface Physics and Department of Physics, Academy for Engineering and Technology, Key Laboratory of Micro and Nano Photonic Structures (Ministry of Education), Shanghai Key Laboratory of Metasurfaces for Light Manipulation, Fudan University, Shanghai 200433, China
| | - Kuan Luo
- State Key Laboratory of Surface Physics and Department of Physics, Academy for Engineering and Technology, Key Laboratory of Micro and Nano Photonic Structures (Ministry of Education), Shanghai Key Laboratory of Metasurfaces for Light Manipulation, Fudan University, Shanghai 200433, China
| | - Zhijie Liu
- State Key Laboratory of Surface Physics and Department of Physics, Academy for Engineering and Technology, Key Laboratory of Micro and Nano Photonic Structures (Ministry of Education), Shanghai Key Laboratory of Metasurfaces for Light Manipulation, Fudan University, Shanghai 200433, China
| | - Minbiao Ji
- State Key Laboratory of Surface Physics and Department of Physics, Academy for Engineering and Technology, Key Laboratory of Micro and Nano Photonic Structures (Ministry of Education), Shanghai Key Laboratory of Metasurfaces for Light Manipulation, Fudan University, Shanghai 200433, China
| |
Collapse
|
21
|
Huang X, Xue Z, Zhang D, Lee HJ. Pinpointing Fat Molecules: Advances in Coherent Raman Scattering Microscopy for Lipid Metabolism. Anal Chem 2024; 96:7945-7958. [PMID: 38700460 DOI: 10.1021/acs.analchem.4c01398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/05/2024]
Affiliation(s)
- Xiangjie Huang
- College of Biomedical Engineering & Instrument Science, and Key Laboratory for Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou 310027, China
| | - Zexin Xue
- College of Biomedical Engineering & Instrument Science, and Key Laboratory for Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou 310027, China
| | - Delong Zhang
- MOE Frontier Science Center for Brain Science & Brain-Machine Integration, Zhejiang University, Hangzhou 310027, China
- Zhejiang Key Laboratory of Micro-nano Quantum Chips and Quantum Control, and School of Physics, Zhejiang University, Hangzhou 310027, China
| | - Hyeon Jeong Lee
- College of Biomedical Engineering & Instrument Science, and Key Laboratory for Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou 310027, China
- MOE Frontier Science Center for Brain Science & Brain-Machine Integration, Zhejiang University, Hangzhou 310027, China
| |
Collapse
|
22
|
Mohamed AA, Sargent E, Williams C, Karve Z, Nair K, Lucke-Wold B. Advancements in Neurosurgical Intraoperative Histology. Tomography 2024; 10:693-704. [PMID: 38787014 PMCID: PMC11125713 DOI: 10.3390/tomography10050054] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2024] [Revised: 04/26/2024] [Accepted: 05/06/2024] [Indexed: 05/25/2024] Open
Abstract
Despite their relatively low incidence globally, central nervous system (CNS) tumors remain amongst the most lethal cancers, with only a few other malignancies surpassing them in 5-year mortality rates. Treatment decisions for brain tumors heavily rely on histopathological analysis, particularly intraoperatively, to guide surgical interventions and optimize patient outcomes. Frozen sectioning has emerged as a vital intraoperative technique, allowing for highly accurate, rapid analysis of tissue samples, although it poses challenges regarding interpretive errors and tissue distortion. Raman histology, based on Raman spectroscopy, has shown great promise in providing label-free, molecular information for accurate intraoperative diagnosis, aiding in tumor resection and the identification of neurodegenerative disease. Techniques including Stimulated Raman Scattering (SRS), Coherent Anti-Stokes Raman Scattering (CARS), Surface-Enhanced Raman Scattering (SERS), and Tip-Enhanced Raman Scattering (TERS) have profoundly enhanced the speed and resolution of Raman imaging. Similarly, Confocal Laser Endomicroscopy (CLE) allows for real-time imaging and the rapid intraoperative histologic evaluation of specimens. While CLE is primarily utilized in gastrointestinal procedures, its application in neurosurgery is promising, particularly in the context of gliomas and meningiomas. This review focuses on discussing the immense progress in intraoperative histology within neurosurgery and provides insight into the impact of these advancements on enhancing patient outcomes.
Collapse
Affiliation(s)
- Ali A. Mohamed
- Charles E. Schmidt College of Medicine, Florida Atlantic University, Boca Raton, FL 33431, USA
- College of Engineering and Computer Science, Florida Atlantic University, Boca Raton, FL 33431, USA
| | - Emma Sargent
- Charles E. Schmidt College of Medicine, Florida Atlantic University, Boca Raton, FL 33431, USA
| | - Cooper Williams
- Charles E. Schmidt College of Medicine, Florida Atlantic University, Boca Raton, FL 33431, USA
| | - Zev Karve
- Charles E. Schmidt College of Medicine, Florida Atlantic University, Boca Raton, FL 33431, USA
| | - Karthik Nair
- Charles E. Schmidt College of Medicine, Florida Atlantic University, Boca Raton, FL 33431, USA
| | - Brandon Lucke-Wold
- Department of Neurosurgery, University of Florida, Gainesville, FL 32611, USA
| |
Collapse
|
23
|
Wagner A, Brielmaier MC, Kampf C, Baumgart L, Aftahy AK, Meyer HS, Kehl V, Höhne J, Schebesch KM, Schmidt NO, Zoubaa S, Riemenschneider MJ, Ratliff M, Enders F, von Deimling A, Liesche-Starnecker F, Delbridge C, Schlegel J, Meyer B, Gempt J. Fluorescein-stained confocal laser endomicroscopy versus conventional frozen section for intraoperative histopathological assessment of intracranial tumors. Neuro Oncol 2024; 26:922-932. [PMID: 38243410 PMCID: PMC11066924 DOI: 10.1093/neuonc/noae006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Indexed: 01/21/2024] Open
Abstract
BACKGROUND The aim of this clinical trial was to compare Fluorescein-stained intraoperative confocal laser endomicroscopy (CLE) of intracranial lesions and evaluation by a neuropathologist with routine intraoperative frozen section (FS) assessment by neuropathology. METHODS In this phase II noninferiority, prospective, multicenter, nonrandomized, off-label clinical trial (EudraCT: 2019-004512-58), patients above the age of 18 years with any intracranial lesion scheduled for elective resection were included. The diagnostic accuracies of both CLE and FS referenced with the final histopathological diagnosis were statistically compared in a noninferiority analysis, representing the primary endpoint. Secondary endpoints included the safety of the technique and time expedited for CLE and FS. RESULTS A total of 210 patients were included by 3 participating sites between November 2020 and June 2022. Most common entities were high-grade gliomas (37.9%), metastases (24.1%), and meningiomas (22.7%). A total of 6 serious adverse events in 4 (2%) patients were recorded. For the primary endpoint, the diagnostic accuracy for CLE was inferior with 0.87 versus 0.91 for FS, resulting in a difference of 0.04 (95% confidence interval -0.10; 0.02; P = .367). The median time expedited until intraoperative diagnosis was 3 minutes for CLE and 27 minutes for FS, with a mean difference of 27.5 minutes (standard deviation 14.5; P < .001). CONCLUSIONS CLE allowed for a safe and time-effective intraoperative histological diagnosis with a diagnostic accuracy of 87% across all intracranial entities included. The technique achieved histological assessments in real time with a 10-fold reduction of processing time compared to FS, which may invariably impact surgical strategy on the fly.
Collapse
Affiliation(s)
- Arthur Wagner
- Department of Neurosurgery, Klinikum rechts der Isar Technical University Munich School of Medicine, Munich, Germany
| | - Maria Charlotte Brielmaier
- Department of Neurosurgery, Klinikum rechts der Isar Technical University Munich School of Medicine, Munich, Germany
| | - Charlotte Kampf
- Department of Neurosurgery, Klinikum rechts der Isar Technical University Munich School of Medicine, Munich, Germany
| | - Lea Baumgart
- Department of Neurosurgery, Klinikum rechts der Isar Technical University Munich School of Medicine, Munich, Germany
| | - Amir Kaywan Aftahy
- Department of Neurosurgery, Klinikum rechts der Isar Technical University Munich School of Medicine, Munich, Germany
| | - Hanno S Meyer
- Department of Neurosurgery, Klinikum rechts der Isar Technical University Munich School of Medicine, Munich, Germany
| | - Victoria Kehl
- Institute for AI and Informatics in Medicine & Muenchner Studienzentrum (MSZ), Technical University Munich School of Medicine, Munich, Germany
| | - Julius Höhne
- Department of Neurosurgery, Regensburg University Hospital, Regensburg, Germany
- Department of Neurosurgery, Paracelsus Medical University, Nürnberg, Germany
| | - Karl-Michael Schebesch
- Department of Neurosurgery, Regensburg University Hospital, Regensburg, Germany
- Department of Neurosurgery, Paracelsus Medical University, Nürnberg, Germany
| | - Nils O Schmidt
- Department of Neurosurgery, Regensburg University Hospital, Regensburg, Germany
| | - Saida Zoubaa
- Department of Neuropathology, Regensburg University Hospital, Regensburg, Germany
| | | | - Miriam Ratliff
- Department of Neurosurgery, University Hospital Mannheim, Mannheim, Germany
| | - Frederik Enders
- Department of Neurosurgery, University Hospital Mannheim, Mannheim, Germany
| | - Andreas von Deimling
- Department of Neuropathology, University Hospital Heidelberg and CCU Neuropathology, German Cancer Center (DKFZ), Heidelberg, Germany
| | | | - Claire Delbridge
- Department of Neuropathology, Klinikum rechts der Isar Technical University Munich School of Medicine, Munich, Germany
| | - Juergen Schlegel
- Department of Neuropathology, Klinikum rechts der Isar Technical University Munich School of Medicine, Munich, Germany
| | - Bernhard Meyer
- Department of Neurosurgery, Klinikum rechts der Isar Technical University Munich School of Medicine, Munich, Germany
| | - Jens Gempt
- Department of Neurosurgery, Klinikum rechts der Isar Technical University Munich School of Medicine, Munich, Germany
- Department of Neurosurgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
24
|
Burström G, Amini M, El-Hajj VG, Arfan A, Gharios M, Buwaider A, Losch MS, Manni F, Edström E, Elmi-Terander A. Optical Methods for Brain Tumor Detection: A Systematic Review. J Clin Med 2024; 13:2676. [PMID: 38731204 PMCID: PMC11084501 DOI: 10.3390/jcm13092676] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2024] [Revised: 04/28/2024] [Accepted: 04/30/2024] [Indexed: 05/13/2024] Open
Abstract
Background: In brain tumor surgery, maximal tumor resection is typically desired. This is complicated by infiltrative tumor cells which cannot be visually distinguished from healthy brain tissue. Optical methods are an emerging field that can potentially revolutionize brain tumor surgery through intraoperative differentiation between healthy and tumor tissues. Methods: This study aimed to systematically explore and summarize the existing literature on the use of Raman Spectroscopy (RS), Hyperspectral Imaging (HSI), Optical Coherence Tomography (OCT), and Diffuse Reflectance Spectroscopy (DRS) for brain tumor detection. MEDLINE, Embase, and Web of Science were searched for studies evaluating the accuracy of these systems for brain tumor detection. Outcome measures included accuracy, sensitivity, and specificity. Results: In total, 44 studies were included, covering a range of tumor types and technologies. Accuracy metrics in the studies ranged between 54 and 100% for RS, 69 and 99% for HSI, 82 and 99% for OCT, and 42 and 100% for DRS. Conclusions: This review provides insightful evidence on the use of optical methods in distinguishing tumor from healthy brain tissue.
Collapse
Affiliation(s)
- Gustav Burström
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
| | - Misha Amini
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
| | - Victor Gabriel El-Hajj
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
| | - Arooj Arfan
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
| | - Maria Gharios
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
| | - Ali Buwaider
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
| | - Merle S. Losch
- Department of Biomechanical Engineering, Faculty of Mechanical Engineering, Delft University of Technology, 2627 Delft, The Netherlands
| | - Francesca Manni
- Department of Electrical Engineering, Eindhoven University of Technology (TU/e), 5612 Eindhoven, The Netherlands;
| | - Erik Edström
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
- Capio Spine Center Stockholm, Löwenströmska Hospital, 194 80 Upplands-Väsby, Sweden
- Department of Medical Sciences, Örebro University, 701 85 Örebro, Sweden
| | - Adrian Elmi-Terander
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
- Capio Spine Center Stockholm, Löwenströmska Hospital, 194 80 Upplands-Väsby, Sweden
- Department of Medical Sciences, Örebro University, 701 85 Örebro, Sweden
- Department of Surgical Sciences, Uppsala University, 751 35 Uppsala, Sweden
| |
Collapse
|
25
|
Pillar N, Li Y, Zhang Y, Ozcan A. Virtual Staining of Nonfixed Tissue Histology. Mod Pathol 2024; 37:100444. [PMID: 38325706 DOI: 10.1016/j.modpat.2024.100444] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Revised: 01/19/2024] [Accepted: 01/29/2024] [Indexed: 02/09/2024]
Abstract
Surgical pathology workflow involves multiple labor-intensive steps, such as tissue removal, fixation, embedding, sectioning, staining, and microscopic examination. This process is time-consuming and costly and requires skilled technicians. In certain clinical scenarios, such as intraoperative consultations, there is a need for faster histologic evaluation to provide real-time surgical guidance. Currently, frozen section techniques involving hematoxylin and eosin (H&E) staining are used for intraoperative pathology consultations. However, these techniques have limitations, including a turnaround time of 20 to 30 minutes, staining artifacts, and potential tissue loss, negatively impacting accurate diagnosis. To address these challenges, researchers are exploring alternative optical imaging modalities for rapid microscopic tissue imaging. These modalities differ in optical characteristics, tissue preparation requirements, imaging equipment, and output image quality and format. Some of these imaging methods have been combined with computational algorithms to generate H&E-like images, which could greatly facilitate their adoption by pathologists. Here, we provide a comprehensive, organ-specific review of the latest advancements in emerging imaging modalities applied to nonfixed human tissue. We focused on studies that generated H&E-like images evaluated by pathologists. By presenting up-to-date research progress and clinical utility, this review serves as a valuable resource for scholars and clinicians, covering some of the major technical developments in this rapidly evolving field. It also offers insights into the potential benefits and drawbacks of alternative imaging modalities and their implications for improving patient care.
Collapse
Affiliation(s)
- Nir Pillar
- Electrical and Computer Engineering Department, University of California, Los Angeles, California; Bioengineering Department, University of California, Los Angeles, California; California NanoSystems Institute (CNSI), University of California, Los Angeles, California
| | - Yuzhu Li
- Electrical and Computer Engineering Department, University of California, Los Angeles, California; Bioengineering Department, University of California, Los Angeles, California; California NanoSystems Institute (CNSI), University of California, Los Angeles, California
| | - Yijie Zhang
- Electrical and Computer Engineering Department, University of California, Los Angeles, California; Bioengineering Department, University of California, Los Angeles, California; California NanoSystems Institute (CNSI), University of California, Los Angeles, California
| | - Aydogan Ozcan
- Electrical and Computer Engineering Department, University of California, Los Angeles, California; Bioengineering Department, University of California, Los Angeles, California; California NanoSystems Institute (CNSI), University of California, Los Angeles, California.
| |
Collapse
|
26
|
van Leeuwen FWB, Buckle T, Rietbergen DDD, van Oosterom MN. The realization of medical devices for precision surgery - development and implementation of ' stop-and-go' imaging technologies. Expert Rev Med Devices 2024; 21:349-358. [PMID: 38722051 DOI: 10.1080/17434440.2024.2341102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 04/05/2024] [Indexed: 05/31/2024]
Abstract
INTRODUCTION Surgery and biomedical imaging encompass a big share of the medical-device market. The ever-mounting demand for precision surgery has driven the integration of these two into the field of image-guided surgery. A key-question herein is how imaging modalities can guide the surgical decision-making process. Through performance-based design, chemists, engineers, and doctors need to build a bridge between imaging technologies and surgical challenges. AREAS-COVERED This perspective article highlights the complementary nature between the technological design of an image-guidance modality and the type of procedure performed. The specific roles of the involved professionals, imaging technologies, and surgical indications are addressed. EXPERT-OPINION Molecular-image-guided surgery has the potential to advance pre-, intra- and post-operative tissue characterization. To achieve this, surgeons need the access to well-designed indication-specific chemical-agents and detection modalities. Hereby, some technologies stimulate exploration ('go'), while others stimulate caution ('stop'). However, failing to adequately address the indication-specific needs rises the risk of incorrect tool employment and sub-optimal surgical performance. Therefore, besides the availability of new technologies, market growth is highly dependent on the practical nature and impact on real-life clinical care. While urology currently takes the lead in the widespread implementation of image-guidance technologies, the topic is generic and its popularity spreads rapidly within surgical oncology.
Collapse
Affiliation(s)
- Fijs W B van Leeuwen
- Interventional Molecular Imaging Laboratory, Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Tessa Buckle
- Interventional Molecular Imaging Laboratory, Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Daphne D D Rietbergen
- Interventional Molecular Imaging Laboratory, Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands
- Section of Nuclear Medicine, Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Matthias N van Oosterom
- Interventional Molecular Imaging Laboratory, Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands
| |
Collapse
|
27
|
Chadha RS, Guerrero JA, Wei L, Sanchez LM. Seeing is Believing: Developing Multimodal Metabolic Insights at the Molecular Level. ACS CENTRAL SCIENCE 2024; 10:758-774. [PMID: 38680555 PMCID: PMC11046475 DOI: 10.1021/acscentsci.3c01438] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Revised: 02/16/2024] [Accepted: 02/20/2024] [Indexed: 05/01/2024]
Abstract
This outlook explores how two different molecular imaging approaches might be combined to gain insight into dynamic, subcellular metabolic processes. Specifically, we discuss how matrix-assisted laser desorption/ionization mass spectrometry imaging (MALDI-MSI) and stimulated Raman scattering (SRS) microscopy, which have significantly pushed the boundaries of imaging metabolic and metabolomic analyses in their own right, could be combined to create comprehensive molecular images. We first briefly summarize the recent advances for each technique. We then explore how one might overcome the inherent limitations of each individual method, by envisioning orthogonal and interchangeable workflows. Additionally, we delve into the potential benefits of adopting a complementary approach that combines both MSI and SRS spectro-microscopy for informing on specific chemical structures through functional-group-specific targets. Ultimately, by integrating the strengths of both imaging modalities, researchers can achieve a more comprehensive understanding of biological and chemical systems, enabling precise metabolic investigations. This synergistic approach holds substantial promise to expand our toolkit for studying metabolites in complex environments.
Collapse
Affiliation(s)
- Rahuljeet S Chadha
- Division of Chemistry and Chemical Engineering, California Institute of Technology, Pasadena, California 91125 United States
| | - Jason A Guerrero
- Department of Chemistry and Biochemistry, University of California, Santa Cruz, Santa Cruz, California 95064 United States
| | - Lu Wei
- Division of Chemistry and Chemical Engineering, California Institute of Technology, Pasadena, California 91125 United States
| | - Laura M Sanchez
- Department of Chemistry and Biochemistry, University of California, Santa Cruz, Santa Cruz, California 95064 United States
| |
Collapse
|
28
|
Abraham TM, Levenson R. Current Landscape of Advanced Imaging Tools for Pathology Diagnostics. Mod Pathol 2024; 37:100443. [PMID: 38311312 DOI: 10.1016/j.modpat.2024.100443] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 12/13/2023] [Accepted: 01/26/2024] [Indexed: 02/10/2024]
Abstract
Histopathology relies on century-old workflows of formalin fixation, paraffin embedding, sectioning, and staining tissue specimens on glass slides. Despite being robust, this conventional process is slow, labor-intensive, and limited to providing two-dimensional views. Emerging technologies promise to enhance and accelerate histopathology. Slide-free microscopy allows rapid imaging of fresh, unsectioned specimens, overcoming slide preparation delays. Methods such as fluorescence confocal microscopy, multiphoton microscopy, along with more recent innovations including microscopy with UV surface excitation and fluorescence-imitating brightfield imaging can generate images resembling conventional histology directly from the surface of tissue specimens. Slide-free microscopy enable applications such as rapid intraoperative margin assessment and, with appropriate technology, three-dimensional histopathology. Multiomics profiling techniques, including imaging mass spectrometry and Raman spectroscopy, provide highly multiplexed molecular maps of tissues, although clinical translation remains challenging. Artificial intelligence is aiding the adoption of new imaging modalities via virtual staining, which converts methods such as slide-free microscopy into synthetic brightfield-like or even molecularly informed images. Although not yet commonplace, these emerging technologies collectively demonstrate the potential to modernize histopathology. Artificial intelligence-assisted workflows will ease the transition to new imaging modalities. With further validation, these advances may transform the century-old conventional histopathology pipeline to better serve 21st-century medicine. This review provides an overview of these enabling technology platforms and discusses their potential impact.
Collapse
Affiliation(s)
- Tanishq Mathew Abraham
- Department of Biomedical Engineering, University of California, Davis, Davis, California
| | - Richard Levenson
- Department of Pathology and Laboratory Medicine, UC Davis Health, Sacramento, California.
| |
Collapse
|
29
|
Meißner AK, Goldbrunner R, Neuschmelting V. [Intraoperative stimulated Raman histology for personalized brain tumor surgery]. CHIRURGIE (HEIDELBERG, GERMANY) 2024; 95:274-279. [PMID: 38334774 DOI: 10.1007/s00104-024-02038-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 01/11/2024] [Indexed: 02/10/2024]
Abstract
BACKGROUND In brain tumor surgery a personalized surgical approach is crucial to achieve a maximum safe tumor resection. The extent of resection decisively depends on the histological diagnosis. Stimulated Raman histology (SRH), a fiber laser-based optical imaging method, offers the possibility for evaluation of an intraoperative diagnosis in a few minutes. OBJECTIVE To provide an overview on the applications of SRH in neurosurgery and transference of the technique to other surgical disciplines. METHODS Description of the technique and review of the current literature on SRH. RESULTS The SRH technique was successfully used in multiple neuro-oncological tumor entities. Initial pilot projects showed the potential for analysis of extracranial tumors. CONCLUSION The use of SRH provides a near real-time diagnosis with high diagnostic accuracy and provides further developmental potential to improve personalized tumor surgery.
Collapse
Affiliation(s)
- Anna-Katharina Meißner
- Klinik für allgemeine Neurochirurgie, Zentrum für Neurochirurgie, Medizinische Fakultät und Universitätsklinik Köln, Universität zu Köln, Kerpener Str. 62, 50937, Köln, Deutschland
| | - Roland Goldbrunner
- Klinik für allgemeine Neurochirurgie, Zentrum für Neurochirurgie, Medizinische Fakultät und Universitätsklinik Köln, Universität zu Köln, Kerpener Str. 62, 50937, Köln, Deutschland
| | - Volker Neuschmelting
- Klinik für allgemeine Neurochirurgie, Zentrum für Neurochirurgie, Medizinische Fakultät und Universitätsklinik Köln, Universität zu Köln, Kerpener Str. 62, 50937, Köln, Deutschland.
| |
Collapse
|
30
|
Haugen EJ, Locke AK, Correa H, Baba JS, Mahadevan-Jansen A, Hiremath G. Characterization of lamina propria remodeling in pediatric eosinophilic esophagitis using second harmonic generation microscopy. TRANSLATIONAL MEDICINE COMMUNICATIONS 2024; 9:10. [PMID: 38698908 PMCID: PMC11065090 DOI: 10.1186/s41231-024-00170-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Accepted: 03/17/2024] [Indexed: 05/05/2024]
Abstract
Eosinophilic esophagitis (EoE) is a chronic inflammatory condition characterized by an intense infiltration of eosinophils into the esophageal epithelium. When not adequately controlled, eosinophilic inflammation can lead to changes in components of the extracellular matrix (ECM) of the lamina propria. Particularly, alterations to the collagen fiber matrix can lead to lamina propria fibrosis (LPF), which plays an important role in the fibrostenotic complications of EoE. Current approaches to assess LPF in EoE are prone to inter-observer inconsistencies and provide limited insight into the structural remodeling of the ECM. An objective approach to quantify LPF can eliminate inter-observer inconsistencies and provide novel insights into the fibrotic transformation of the lamina propria in EoE. Second harmonic generation (SHG) microscopy is a powerful modality for objectively quantifying disease associated alterations in ECM collagen structure that is finding increasing use for clinical research. We used SHG with morphometric analysis (SHG-MA) to characterize lamina propria collagen fibers and ECM porosity in esophageal biopsies collected from children with active EoE (n = 11), inactive EoE (n = 11), and non-EoE (n = 11). The collagen fiber width quantified by SHG-MA correlated positively with peak eosinophil count (r = 0.65, p < 0.005) and histopathologist scoring of LPF (r = 0.52, p < 0.005) in the esophageal biopsies. Patients with active EoE had a significant enlargement of ECM pores compared to inactive EoE and non-EoE (p < 0.005), with the mean pore area correlating positively with EoE activity (r = 0.76, p < 0.005) and LPF severity (r = 0.65, p < 0.005). These results indicate that SHG-MA can be utilized to objectively characterize and provide novel insights into lamina propria ECM structural remodeling in children with EoE, which could aid in monitoring disease progression.
Collapse
Affiliation(s)
- Ezekiel J. Haugen
- Vanderbilt Biophotonics Center, Vanderbilt University, Nashville, TN 37232, USA
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37232, USA
| | - Andrea K. Locke
- Vanderbilt Biophotonics Center, Vanderbilt University, Nashville, TN 37232, USA
- Department of Chemistry, Vanderbilt University, Nashville, TN 37232, USA
| | - Hernán Correa
- Division of Pediatric Pathology, Monroe Carell Jr. Children’s Hospital at Vanderbilt, Vanderbilt University Medical Center, Nashville, TN 27232, USA
| | - Justin S. Baba
- Vanderbilt Biophotonics Center, Vanderbilt University, Nashville, TN 37232, USA
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37232, USA
| | - Anita Mahadevan-Jansen
- Vanderbilt Biophotonics Center, Vanderbilt University, Nashville, TN 37232, USA
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37232, USA
| | - Girish Hiremath
- Vanderbilt Biophotonics Center, Vanderbilt University, Nashville, TN 37232, USA
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37232, USA
- Division of Pediatric Gastroenterology, Hepatology and Nutrition, Monroe Carell Jr. Children’s Hospital at Vanderbilt, Vanderbilt University Medical Center, Nashville, TN 37232, USA
| |
Collapse
|
31
|
Bou-Nassif R, Reiner AS, Pease M, Bale T, Cohen MA, Rosenblum M, Tabar V. Development and prospective validation of an artificial intelligence-based smartphone app for rapid intraoperative pituitary adenoma identification. COMMUNICATIONS MEDICINE 2024; 4:45. [PMID: 38480833 PMCID: PMC10937994 DOI: 10.1038/s43856-024-00469-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 02/28/2024] [Indexed: 03/17/2024] Open
Abstract
BACKGROUND Intraoperative pathology consultation plays a crucial role in tumor surgery. The ability to accurately and rapidly distinguish tumor from normal tissue can greatly impact intraoperative surgical oncology management. However, this is dependent on the availability of a specialized pathologist for a reliable diagnosis. We developed and prospectively validated an artificial intelligence-based smartphone app capable of differentiating between pituitary adenoma and normal pituitary gland using stimulated Raman histology, almost instantly. METHODS The study consisted of three parts. After data collection (part 1) and development of a deep learning-based smartphone app (part 2), we conducted a prospective study that included 40 consecutive patients with 194 samples to evaluate the app in real-time in a surgical setting (part 3). The smartphone app's sensitivity, specificity, positive predictive value, and negative predictive value were evaluated by comparing the diagnosis rendered by the app to the ground-truth diagnosis set by a neuropathologist. RESULTS The app exhibits a sensitivity of 96.1% (95% CI: 89.9-99.0%), specificity of 92.7% (95% CI: 74-99.3%), positive predictive value of 98% (95% CI: 92.2-99.8%), and negative predictive value of 86.4% (95% CI: 66.2-96.8%). An external validation of the smartphone app on 40 different adenoma tumors and a total of 191 scanned SRH specimens from a public database shows a sensitivity of 93.7% (95% CI: 89.3-96.7%). CONCLUSIONS The app can be readily expanded and repurposed to work on different types of tumors and optical images. Rapid recognition of normal versus tumor tissue during surgery may contribute to improved intraoperative surgical management and oncologic outcomes. In addition to the accelerated pathological assessments during surgery, this platform can be of great benefit in community hospitals and developing countries, where immediate access to a specialized pathologist during surgery is limited.
Collapse
Affiliation(s)
- Rabih Bou-Nassif
- Department of Neurosurgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
- Multidisciplinary Pituitary and Skull Base Tumor Center, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Anne S Reiner
- Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Matthew Pease
- Department of Neurosurgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
- Multidisciplinary Pituitary and Skull Base Tumor Center, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Tejus Bale
- Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Marc A Cohen
- Department of Neurosurgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
- Multidisciplinary Pituitary and Skull Base Tumor Center, Memorial Sloan Kettering Cancer Center, New York, NY, USA
- Department of Surgery, Head and Neck Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Marc Rosenblum
- Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Viviane Tabar
- Department of Neurosurgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
- Multidisciplinary Pituitary and Skull Base Tumor Center, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
| |
Collapse
|
32
|
Li Y, Pillar N, Li J, Liu T, Wu D, Sun S, Ma G, de Haan K, Huang L, Zhang Y, Hamidi S, Urisman A, Keidar Haran T, Wallace WD, Zuckerman JE, Ozcan A. Virtual histological staining of unlabeled autopsy tissue. Nat Commun 2024; 15:1684. [PMID: 38396004 PMCID: PMC10891155 DOI: 10.1038/s41467-024-46077-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2023] [Accepted: 02/09/2024] [Indexed: 02/25/2024] Open
Abstract
Traditional histochemical staining of post-mortem samples often confronts inferior staining quality due to autolysis caused by delayed fixation of cadaver tissue, and such chemical staining procedures covering large tissue areas demand substantial labor, cost and time. Here, we demonstrate virtual staining of autopsy tissue using a trained neural network to rapidly transform autofluorescence images of label-free autopsy tissue sections into brightfield equivalent images, matching hematoxylin and eosin (H&E) stained versions of the same samples. The trained model can effectively accentuate nuclear, cytoplasmic and extracellular features in new autopsy tissue samples that experienced severe autolysis, such as COVID-19 samples never seen before, where the traditional histochemical staining fails to provide consistent staining quality. This virtual autopsy staining technique provides a rapid and resource-efficient solution to generate artifact-free H&E stains despite severe autolysis and cell death, also reducing labor, cost and infrastructure requirements associated with the standard histochemical staining.
Collapse
Affiliation(s)
- Yuzhu Li
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA
- Bioengineering Department, University of California, Los Angeles, CA, 90095, USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA
| | - Nir Pillar
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA
- Bioengineering Department, University of California, Los Angeles, CA, 90095, USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA
| | - Jingxi Li
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA
- Bioengineering Department, University of California, Los Angeles, CA, 90095, USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA
| | - Tairan Liu
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA
- Bioengineering Department, University of California, Los Angeles, CA, 90095, USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA
| | - Di Wu
- Computer Science Department, University of California, Los Angeles, CA, 90095, USA
| | - Songyu Sun
- Computer Science Department, University of California, Los Angeles, CA, 90095, USA
| | - Guangdong Ma
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA
- School of Physics, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
| | - Kevin de Haan
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA
- Bioengineering Department, University of California, Los Angeles, CA, 90095, USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA
| | - Luzhe Huang
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA
- Bioengineering Department, University of California, Los Angeles, CA, 90095, USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA
| | - Yijie Zhang
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA
- Bioengineering Department, University of California, Los Angeles, CA, 90095, USA
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA
| | - Sepehr Hamidi
- Department of Pathology and Laboratory Medicine, David Geffen School of Medicine, University of California, Los Angeles, CA, 90095, USA
| | - Anatoly Urisman
- Department of Pathology, University of California, San Francisco, CA, 94143, USA
| | - Tal Keidar Haran
- Department of Pathology, Hadassah Hebrew University Medical Center, Jerusalem, 91120, Israel
| | - William Dean Wallace
- Department of Pathology, Keck School of Medicine, University of Southern California, Los Angeles, CA, 90033, USA
| | - Jonathan E Zuckerman
- Department of Pathology and Laboratory Medicine, David Geffen School of Medicine, University of California, Los Angeles, CA, 90095, USA
| | - Aydogan Ozcan
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA.
- Bioengineering Department, University of California, Los Angeles, CA, 90095, USA.
- California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA.
- Department of Surgery, University of California, Los Angeles, CA, 90095, USA.
| |
Collapse
|
33
|
Kren J, Skambath I, Kuppler P, Buschschlüter S, Detrez N, Burhan S, Huber R, Brinkmann R, Bonsanto MM. Mechanical characteristics of glioblastoma and peritumoral tumor-free human brain tissue. Acta Neurochir (Wien) 2024; 166:102. [PMID: 38396016 PMCID: PMC10891200 DOI: 10.1007/s00701-024-06009-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Accepted: 02/16/2024] [Indexed: 02/25/2024]
Abstract
BACKGROUND The diagnosis of brain tumor is a serious event for the affected patient. Surgical resection is a crucial part in the treatment of brain tumors. However, the distinction between tumor and brain tissue can be difficult, even for experienced neurosurgeons. This is especially true in the case of gliomas. In this project we examined whether the biomechanical parameters elasticity and stress relaxation behavior are suitable as additional differentiation criteria between tumorous (glioblastoma multiforme; glioblastoma, IDH-wildtype; GBM) and non-tumorous, peritumoral tissue. METHODS Indentation measurements were used to examine non-tumorous human brain tissue and GBM samples for the biomechanical properties of elasticity and stress-relaxation behavior. The results of these measurements were then used in a classification algorithm (Logistic Regression) to distinguish between tumor and non-tumor. RESULTS Differences could be found in elasticity spread and relaxation behavior between tumorous and non-tumorous tissue. Classification was successful with a sensitivity/recall of 83% (sd = 12%) and a precision of 85% (sd = 9%) for detecting tumorous tissue. CONCLUSION The findings imply that the data on mechanical characteristics, with particular attention to stress relaxation behavior, can serve as an extra element in differentiating tumorous brain tissue from non-tumorous brain tissue.
Collapse
Affiliation(s)
- Jessica Kren
- Department of Neurosurgery, University Hospital Schleswig-Holstein, Luebeck, Germany.
| | - Isabelle Skambath
- Department of Neurosurgery, University Hospital Schleswig-Holstein, Luebeck, Germany
| | - Patrick Kuppler
- Department of Neurosurgery, University Hospital Schleswig-Holstein, Luebeck, Germany
| | | | - Nicolas Detrez
- Medizinisches Laserzentrum Lübeck GmbH, Luebeck, Germany
| | - Sazgar Burhan
- Institute of Biomedical Optics, University of Luebeck, Luebeck, Germany
| | - Robert Huber
- Institute of Biomedical Optics, University of Luebeck, Luebeck, Germany
| | - Ralf Brinkmann
- Medizinisches Laserzentrum Lübeck GmbH, Luebeck, Germany
| | - Matteo Mario Bonsanto
- Department of Neurosurgery, University Hospital Schleswig-Holstein, Luebeck, Germany
| |
Collapse
|
34
|
Zhang W, Li Y, Fung AA, Li Z, Jang H, Zha H, Chen X, Gao F, Wu JY, Sheng H, Yao J, Skowronska-Krawczyk D, Jain S, Shi L. Multi-molecular hyperspectral PRM-SRS microscopy. Nat Commun 2024; 15:1599. [PMID: 38383552 PMCID: PMC10881988 DOI: 10.1038/s41467-024-45576-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Accepted: 01/26/2024] [Indexed: 02/23/2024] Open
Abstract
Lipids play crucial roles in many biological processes. Mapping spatial distributions and examining the metabolic dynamics of different lipid subtypes in cells and tissues are critical to better understanding their roles in aging and diseases. Commonly used imaging methods (such as mass spectrometry-based, fluorescence labeling, conventional optical imaging) can disrupt the native environment of cells/tissues, have limited spatial or spectral resolution, or cannot distinguish different lipid subtypes. Here we present a hyperspectral imaging platform that integrates a Penalized Reference Matching algorithm with Stimulated Raman Scattering (PRM-SRS) microscopy. Using this platform, we visualize and identify high density lipoprotein particles in human kidney, a high cholesterol to phosphatidylethanolamine ratio inside granule cells of mouse hippocampus, and subcellular distributions of sphingosine and cardiolipin in human brain. Our PRM-SRS displays unique advantages of enhanced chemical specificity, subcellular resolution, and fast data processing in distinguishing lipid subtypes in different organs and species.
Collapse
Affiliation(s)
- Wenxu Zhang
- Shu Chien-Gene Lay Dept. of Bioengineering, University of California San Diego, La Jolla, CA, USA
| | - Yajuan Li
- Shu Chien-Gene Lay Dept. of Bioengineering, University of California San Diego, La Jolla, CA, USA
| | - Anthony A Fung
- Shu Chien-Gene Lay Dept. of Bioengineering, University of California San Diego, La Jolla, CA, USA
| | - Zhi Li
- Shu Chien-Gene Lay Dept. of Bioengineering, University of California San Diego, La Jolla, CA, USA
| | - Hongje Jang
- Shu Chien-Gene Lay Dept. of Bioengineering, University of California San Diego, La Jolla, CA, USA
| | - Honghao Zha
- Shu Chien-Gene Lay Dept. of Bioengineering, University of California San Diego, La Jolla, CA, USA
| | - Xiaoping Chen
- Dept. of Neurology, Northwestern University School of Medicine, Chicago, IL, USA
| | - Fangyuan Gao
- Center for Translational Vision Research, School of Medicine, University of California Irvine, Irvine, CA, USA
| | - Jane Y Wu
- Dept. of Neurology, Northwestern University School of Medicine, Chicago, IL, USA
| | - Huaxin Sheng
- Dept. of Anesthesiology, Duke University School of Medicine, Durham, NC, USA
| | - Junjie Yao
- Dept. of Biomedical Engineering, Duke University, Durham, NC, USA
| | - Dorota Skowronska-Krawczyk
- Center for Translational Vision Research, School of Medicine, University of California Irvine, Irvine, CA, USA
| | - Sanjay Jain
- Dept. of Medicine, Washington University in St. Louis, St. Louis, MO, USA
- Dept. of Pathology & Immunology, Washington University in St. Louis, St. Louis, MO, USA
- Dept. of Pediatrics, Washington University in St. Louis, St. Louis, MO, USA
| | - Lingyan Shi
- Shu Chien-Gene Lay Dept. of Bioengineering, University of California San Diego, La Jolla, CA, USA.
| |
Collapse
|
35
|
Weber A, Enderle-Ammour K, Kurowski K, Metzger MC, Poxleitner P, Werner M, Rothweiler R, Beck J, Straehle J, Schmelzeisen R, Steybe D, Bronsert P. AI-Based Detection of Oral Squamous Cell Carcinoma with Raman Histology. Cancers (Basel) 2024; 16:689. [PMID: 38398080 PMCID: PMC10886627 DOI: 10.3390/cancers16040689] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Revised: 02/02/2024] [Accepted: 02/02/2024] [Indexed: 02/25/2024] Open
Abstract
Stimulated Raman Histology (SRH) employs the stimulated Raman scattering (SRS) of photons at biomolecules in tissue samples to generate histological images. Subsequent pathological analysis allows for an intraoperative evaluation without the need for sectioning and staining. The objective of this study was to investigate a deep learning-based classification of oral squamous cell carcinoma (OSCC) and the sub-classification of non-malignant tissue types, as well as to compare the performances of the classifier between SRS and SRH images. Raman shifts were measured at wavenumbers k1 = 2845 cm-1 and k2 = 2930 cm-1. SRS images were transformed into SRH images resembling traditional H&E-stained frozen sections. The annotation of 6 tissue types was performed on images obtained from 80 tissue samples from eight OSCC patients. A VGG19-based convolutional neural network was then trained on 64 SRS images (and corresponding SRH images) and tested on 16. A balanced accuracy of 0.90 (0.87 for SRH images) and F1-scores of 0.91 (0.91 for SRH) for stroma, 0.98 (0.96 for SRH) for adipose tissue, 0.90 (0.87 for SRH) for squamous epithelium, 0.92 (0.76 for SRH) for muscle, 0.87 (0.90 for SRH) for glandular tissue, and 0.88 (0.87 for SRH) for tumor were achieved. The results of this study demonstrate the suitability of deep learning for the intraoperative identification of tissue types directly on SRS and SRH images.
Collapse
Affiliation(s)
- Andreas Weber
- Institute for Surgical Pathology, Medical Center, University of Freiburg, 79106 Freiburg, Germany
- Faculty of Biology, University of Freiburg, 79104 Freiburg, Germany
| | - Kathrin Enderle-Ammour
- Institute for Surgical Pathology, Medical Center, University of Freiburg, 79106 Freiburg, Germany
| | - Konrad Kurowski
- Institute for Surgical Pathology, Medical Center, University of Freiburg, 79106 Freiburg, Germany
- Tumorbank Comprehensive Cancer Center Freiburg, Medical Center, University of Freiburg, 79106 Freiburg, Germany
- Core Facility for Histopathology and Digital Pathology, Medical Center, University of Freiburg, 79106 Freiburg, Germany
| | - Marc C. Metzger
- Department of Oral and Maxillofacial Surgery, Medical Center, University of Freiburg, 79106 Freiburg, Germany
| | - Philipp Poxleitner
- Department of Oral and Maxillofacial Surgery, Medical Center, University of Freiburg, 79106 Freiburg, Germany
- Center for Advanced Surgical Tissue Analysis (CAST), University of Freiburg, 79106 Freiburg, Germany
- Department of Oral and Maxillofacial Surgery and Facial Plastic Surgery, University Hospital, LMU Munich, 80337 Munich, Germany
| | - Martin Werner
- Institute for Surgical Pathology, Medical Center, University of Freiburg, 79106 Freiburg, Germany
- Tumorbank Comprehensive Cancer Center Freiburg, Medical Center, University of Freiburg, 79106 Freiburg, Germany
| | - René Rothweiler
- Department of Oral and Maxillofacial Surgery, Medical Center, University of Freiburg, 79106 Freiburg, Germany
| | - Jürgen Beck
- Center for Advanced Surgical Tissue Analysis (CAST), University of Freiburg, 79106 Freiburg, Germany
- Department of Neurosurgery, Medical Center, University of Freiburg, 79106 Freiburg, Germany
| | - Jakob Straehle
- Center for Advanced Surgical Tissue Analysis (CAST), University of Freiburg, 79106 Freiburg, Germany
- Department of Neurosurgery, Medical Center, University of Freiburg, 79106 Freiburg, Germany
| | - Rainer Schmelzeisen
- Department of Oral and Maxillofacial Surgery, Medical Center, University of Freiburg, 79106 Freiburg, Germany
- Center for Advanced Surgical Tissue Analysis (CAST), University of Freiburg, 79106 Freiburg, Germany
| | - David Steybe
- Department of Oral and Maxillofacial Surgery, Medical Center, University of Freiburg, 79106 Freiburg, Germany
- Center for Advanced Surgical Tissue Analysis (CAST), University of Freiburg, 79106 Freiburg, Germany
- Department of Oral and Maxillofacial Surgery and Facial Plastic Surgery, University Hospital, LMU Munich, 80337 Munich, Germany
| | - Peter Bronsert
- Institute for Surgical Pathology, Medical Center, University of Freiburg, 79106 Freiburg, Germany
- Tumorbank Comprehensive Cancer Center Freiburg, Medical Center, University of Freiburg, 79106 Freiburg, Germany
- Core Facility for Histopathology and Digital Pathology, Medical Center, University of Freiburg, 79106 Freiburg, Germany
| |
Collapse
|
36
|
Haj-Hosseini N, Lindblad J, Hasséus B, Kumar VV, Subramaniam N, Hirsch JM. Early Detection of Oral Potentially Malignant Disorders: A Review on Prospective Screening Methods with Regard to Global Challenges. J Maxillofac Oral Surg 2024; 23:23-32. [PMID: 38312957 PMCID: PMC10831018 DOI: 10.1007/s12663-022-01710-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Accepted: 03/10/2022] [Indexed: 11/28/2022] Open
Abstract
Oral cancer is a cancer type that is widely prevalent in low-and middle-income countries with a high mortality rate, and poor quality of life for patients after treatment. Early treatment of cancer increases patient survival, improves quality of life and results in less morbidity and a better prognosis. To reach this goal, early detection of malignancies using technologies that can be used in remote and low resource areas is desirable. Such technologies should be affordable, accurate, and easy to use and interpret. This review surveys different technologies that have the potentials of implementation in primary health and general dental practice, considering global perspectives and with a focus on the population in India, where oral cancer is highly prevalent. The technologies reviewed include both sample-based methods, such as saliva and blood analysis and brush biopsy, and more direct screening of the oral cavity including fluorescence, Raman techniques, and optical coherence tomography. Digitalisation, followed by automated artificial intelligence based analysis, are key elements in facilitating wide access to these technologies, to non-specialist personnel and in rural areas, increasing quality and objectivity of the analysis while simultaneously reducing the labour and need for highly trained specialists.
Collapse
Affiliation(s)
- Neda Haj-Hosseini
- Department of Biomedical Engineering, Linköping University, Linköping, Sweden
- Centre for Medical Image Science and Visualization, Linköping University, Linköping, Sweden
| | - Joakim Lindblad
- Centre for Image Analysis, Department of Information Technology, Uppsala University, Uppsala, Sweden
| | - Bengt Hasséus
- Department of Oral Medicine and Pathology, Institute of Odontology, University of Gothenburg, The Sahlgrenska Academy, Gothenburg, Sweden
- Clinic of Oral Medicine, Public Dental Service, Gothenburg, Region Västra Götaland Sweden
| | - Vinay Vijaya Kumar
- Department of Head and Neck Oncology, Sri Shankara Cancer Hospital and Research Centre, Bangalore, India
- Department of Surgical Sciences, Odontology and Maxillofacial Surgery, Medical Faculty, Uppsala University, Uppsala, Sweden
| | - Narayana Subramaniam
- Department of Head and Neck Oncology, Sri Shankara Cancer Hospital and Research Centre, Bangalore, India
| | - Jan-Michaél Hirsch
- Department of Surgical Sciences, Odontology and Maxillofacial Surgery, Medical Faculty, Uppsala University, Uppsala, Sweden
- Department of Research & Development, Public Dental Services Region Stockholm, Stockholm, Sweden
| |
Collapse
|
37
|
McNeil C, Wong PF, Sridhar N, Wang Y, Santori C, Wu CH, Homyk A, Gutierrez M, Behrooz A, Tiniakos D, Burt AD, Pai RK, Tekiela K, Patel H, Cameron Chen PH, Fischer L, Martins EB, Seyedkazemi S, Freedman D, Kim CC, Cimermancic P. An End-to-End Platform for Digital Pathology Using Hyperspectral Autofluorescence Microscopy and Deep Learning-Based Virtual Histology. Mod Pathol 2024; 37:100377. [PMID: 37926422 DOI: 10.1016/j.modpat.2023.100377] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 10/25/2023] [Accepted: 10/30/2023] [Indexed: 11/07/2023]
Abstract
Conventional histopathology involves expensive and labor-intensive processes that often consume tissue samples, rendering them unavailable for other analyses. We present a novel end-to-end workflow for pathology powered by hyperspectral microscopy and deep learning. First, we developed a custom hyperspectral microscope to nondestructively image the autofluorescence of unstained tissue sections. We then trained a deep learning model to use autofluorescence to generate virtual histologic stains, which avoids the cost and variability of chemical staining procedures and conserves tissue samples. We showed that the virtual images reproduce the histologic features present in the real-stained images using a randomized nonalcoholic steatohepatitis (NASH) scoring comparison study, where both real and virtual stains are scored by pathologists (D.T., A.D.B., R.K.P.). The test showed moderate-to-good concordance between pathologists' scoring on corresponding real and virtual stains. Finally, we developed deep learning-based models for automated NASH Clinical Research Network score prediction. We showed that the end-to-end automated pathology platform is comparable with an independent panel of pathologists for NASH Clinical Research Network scoring when evaluated against the expert pathologist consensus scores. This study provides proof of concept for this virtual staining strategy, which could improve cost, efficiency, and reliability in pathology and enable novel approaches to spatial biology research.
Collapse
Affiliation(s)
- Carson McNeil
- Verily Life Sciences LLC, South San Francisco, California.
| | - Pok Fai Wong
- Verily Life Sciences LLC, South San Francisco, California
| | | | - Yang Wang
- Verily Life Sciences LLC, South San Francisco, California
| | | | - Cheng-Hsun Wu
- Verily Life Sciences LLC, South San Francisco, California
| | - Andrew Homyk
- Verily Life Sciences LLC, South San Francisco, California
| | | | - Ali Behrooz
- Verily Life Sciences LLC, South San Francisco, California
| | - Dina Tiniakos
- Newcastle University, Newcastle upon Tyne, United Kingdom; Medical School, National and Kapodistrian University of Athens, Athens, Greece
| | | | | | | | - Hardik Patel
- Verily Life Sciences LLC, South San Francisco, California
| | | | | | | | | | | | - Charles C Kim
- Verily Life Sciences LLC, South San Francisco, California
| | | |
Collapse
|
38
|
Wu W, Xie B, Zhang X, Zheng C, Sun H, Jiang M, Hu T, Liu X, Zhang N, He K. Application of a Novel Miniaturized Histopathologic Microscope for Ex Vivo Identifying Cerebral Glioma Margins Rapidly During Surgery: A Parallel Control Study. J Craniofac Surg 2024; 35:228-232. [PMID: 37889070 DOI: 10.1097/scs.0000000000009787] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 09/11/2023] [Indexed: 10/28/2023] Open
Abstract
PURPOSE The purpose of our study is to assess the clinical performance of the DiveScope, a novel handheld histopathologic microscope in rapidly differentiating glioma from normal brain tissue during neurosurgery. METHODS Thirty-two ex vivo specimens from 18 patients were included in the present study. The excised suspicious tissue was sequentially stained with sodium fluorescein and methylene blue and scanned with DiveScope during surgery. The adjacent tissue was sent to the department of pathology for frozen section examination. They would eventually be sent to the pathology department later for hematoxylin and eosin staining for final confirmation. The positive likelihood ratio, negative likelihood ratio, sensitivity, specificity, and area under the curve of the device were calculated. In addition, the difference in time usage between DiveScope and frozen sections was compared for the initial judgment. RESULTS The sensitivity and specificity of the DiveScope after analyzing hematoxylin and eosin -staining sections, were 88.29% and 100%, respectively. In contrast, the sensitivity and specificity of the frozen sections histopathology were 100% and 75%, respectively. The area under the curve of the DiveScope and the frozen sections histopathology was not significant ( P =0.578). Concerning time usage, DiveScope is significantly much faster than the frozen sections histopathology no matter the size of tissue. CONCLUSION Compared with traditional pathological frozen sections, DiveScope was faster and displayed an equal accuracy for judging tumor margins intraoperatively.
Collapse
Affiliation(s)
- Weichi Wu
- Department of Neurosurgery, Institute of Precision Medicine, the First Affiliated Hospital of Sun Yat-sen University, Guangdong Provincial Key Laboratory of Brain Function and Disease, Sun Yat-sen University, Guangzhou, Guangdong, China
| | - Baoshu Xie
- Department of Neurosurgery, Institute of Precision Medicine, the First Affiliated Hospital of Sun Yat-sen University, Guangdong Provincial Key Laboratory of Brain Function and Disease, Sun Yat-sen University, Guangzhou, Guangdong, China
| | - Xiaowei Zhang
- Department of Neurosurgery, Institute of Precision Medicine, the First Affiliated Hospital of Sun Yat-sen University, Guangdong Provincial Key Laboratory of Brain Function and Disease, Sun Yat-sen University, Guangzhou, Guangdong, China
| | - Chen Zheng
- Department of Neurosurgery, Institute of Precision Medicine, the First Affiliated Hospital of Sun Yat-sen University, Guangdong Provincial Key Laboratory of Brain Function and Disease, Sun Yat-sen University, Guangzhou, Guangdong, China
| | - Huixin Sun
- Department of Neurosurgery, Institute of Precision Medicine, the First Affiliated Hospital of Sun Yat-sen University, Guangdong Provincial Key Laboratory of Brain Function and Disease, Sun Yat-sen University, Guangzhou, Guangdong, China
| | - Mingyang Jiang
- Department of Neurosurgery, Institute of Precision Medicine, the First Affiliated Hospital of Sun Yat-sen University, Guangdong Provincial Key Laboratory of Brain Function and Disease, Sun Yat-sen University, Guangzhou, Guangdong, China
| | | | - Xinman Liu
- Department of Neurosurgery, Institute of Precision Medicine, the First Affiliated Hospital of Sun Yat-sen University, Guangdong Provincial Key Laboratory of Brain Function and Disease, Sun Yat-sen University, Guangzhou, Guangdong, China
| | - Nu Zhang
- Department of Neurosurgery, Institute of Precision Medicine, the First Affiliated Hospital of Sun Yat-sen University, Guangdong Provincial Key Laboratory of Brain Function and Disease, Sun Yat-sen University, Guangzhou, Guangdong, China
| | - Kejun He
- Department of Neurosurgery, Institute of Precision Medicine, the First Affiliated Hospital of Sun Yat-sen University, Guangdong Provincial Key Laboratory of Brain Function and Disease, Sun Yat-sen University, Guangzhou, Guangdong, China
| |
Collapse
|
39
|
Sun D, Schaft EV, van Stempvoort BM, Gebbink TA, van ‘t Klooster M, van Eijsden P, van der Salm SMA, Willem Dankbaar J, Zijlmans M, Robe PA. Intraoperative mapping of epileptogenic foci and tumor infiltration in neuro-oncology patients with epilepsy. Neurooncol Adv 2024; 6:vdae125. [PMID: 39156617 PMCID: PMC11327616 DOI: 10.1093/noajnl/vdae125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/20/2024] Open
Abstract
Background Epileptogenesis and glioma growth have a bidirectional relationship. We hypothesized people with gliomas can benefit from the removal of epileptic tissue and that tumor-related epileptic activity may signify tumor infiltration in peritumoral regions. We investigated whether intraoperative electrocorticography (ioECoG) could improve seizure outcomes in oncological glioma surgery, and vice versa, what epileptic activity (EA) tells about tumor infiltration. Methods We prospectively included patients who underwent (awake) ioECoG-assisted diffuse-glioma resection through the oncological trajectory. The IoECoG-tailoring strategy relied on ictal and interictal EA (spikes and sharp waves). Brain tissue, where EA was recorded, was assigned for histopathological examination separate from the rest of the tumor. Weibull regression was performed to assess how residual EA and extent of resection (EOR) related to the time-to-seizure recurrence, and we investigated which type of EA predicted tumor infiltration. Results Fifty-two patients were included. Residual spikes after resection were associated with seizure recurrence in patients with isocitrate dehydrogenase (IDH) mutant astrocytoma or oligodendroglioma (HR = 7.6[1.4-40.0], P-value = .01), independent from the EOR. This was not observed in IDH-wildtype tumors. All tissue samples resected based on interictal spikes were infiltrated by tumor, even if the MRI did not show abnormalities. Conclusions Complete resection of epileptogenic foci in ioECoG may promote seizure control in IDH-mutant gliomas. The cohort size of IDH-wildtype tumors was too limited to draw definitive conclusions. Interictal spikes may indicate tumor infiltration even when this area appears normal on MRI. Integrating electrophysiology guidance into oncological tumor surgery could contribute to improved seizure outcomes and precise guidance for radical tumor resection.
Collapse
Affiliation(s)
- Dongqing Sun
- Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Eline V Schaft
- Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Bibi M van Stempvoort
- Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Tineke A Gebbink
- Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Maryse van ‘t Klooster
- Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Pieter van Eijsden
- Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Sandra M A van der Salm
- Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Jan Willem Dankbaar
- Department of Radiology and Nuclear Medicine, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Maeike Zijlmans
- Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands
- Stichting Epilepsie Instellingen Nederland, The Netherlands
| | - Pierre A Robe
- Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
40
|
Yu Y, Liu X, Li T, Zou X, Ding J, Xu N, Sahng X, Wang X, Huang P, Cheng C, Si S, Lu H, Zhang H, Li D. Optimization of the cavity length and pulse characterization based on germanene as a saturable absorber in an Er-doped fiber laser. APPLIED OPTICS 2023; 62:9156-9163. [PMID: 38108754 DOI: 10.1364/ao.504880] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Accepted: 11/08/2023] [Indexed: 12/19/2023]
Abstract
In this study, germanene-nanosheets (NSs) were synthesized by liquid-phase exfoliation, followed by an experimental investigation into the nonlinear saturable absorption characteristics and morphological structure of germanene. The germanene-NSs were employed as saturable absorbers, exhibiting saturation intensity and modulation depth values of 22.64M W/c m 2 and 4.48%, respectively. This demonstrated the feasibility of utilizing germanene-NSs passively mode-locked in an erbium-doped fiber laser (EDFL). By optimizing the cavity length, improvements in the output of EDFL characteristics were achieved, resulting in 883 fs pulses with a maximum average output power of 19.74 mW. The aforementioned experimental outcomes underscore the significant potential of germanene in the realms of ultrafast photonics and nonlinear optics.
Collapse
|
41
|
Liu CH, Fu LW, Chen HH, Huang SL. Toward cell nuclei precision between OCT and H&E images translation using signal-to-noise ratio cycle-consistency. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 242:107824. [PMID: 37832427 DOI: 10.1016/j.cmpb.2023.107824] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Revised: 08/31/2023] [Accepted: 09/19/2023] [Indexed: 10/15/2023]
Abstract
Medical image-to-image translation is often difficult and of limited effectiveness due to the differences in image acquisition mechanisms and the diverse structure of biological tissues. This work presents an unpaired image translation model between in-vivo optical coherence tomography (OCT) and ex-vivo Hematoxylin and eosin (H&E) stained images without the need for image stacking, registration, post-processing, and annotation. The model can generate high-quality and highly accurate virtual medical images, and is robust and bidirectional. Our framework introduces random noise to (1) blur redundant features, (2) defend against self-adversarial attacks, (3) stabilize inverse conversion, and (4) mitigate the impact of OCT speckles. We also demonstrate that our model can be pre-trained and then fine-tuned using images from different OCT systems in just a few epochs. Qualitative and quantitative comparisons with traditional image-to-image translation models show the robustness of our proposed signal-to-noise ratio (SNR) cycle-consistency method.
Collapse
Affiliation(s)
- Chih-Hao Liu
- Graduate Institute of Photonics and Optoelectronics, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan.
| | - Li-Wei Fu
- Graduate Institute of Communication Engineering, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan.
| | - Homer H Chen
- Graduate Institute of Communication Engineering, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan; Department of Electrical Engineering, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan; Graduate Institute of Networking and Multimedia, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan.
| | - Sheng-Lung Huang
- Graduate Institute of Photonics and Optoelectronics, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan; Department of Electrical Engineering, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan; All Vista Healthcare Center, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan.
| |
Collapse
|
42
|
Pal R, Lwin TM, Krishnamoorthy M, Collins HR, Chan CD, Prilutskiy A, Nasrallah MP, Dijkhuis TH, Shukla S, Kendall AL, Marshall MS, Carp SA, Hung YP, Shih AR, Martinez-Lage M, Zukerberg L, Sadow PM, Faquin WC, Nahed BV, Feng AL, Emerick KS, Mieog JSD, Vahrmeijer AL, Rajasekaran K, Lee JYK, Rankin KS, Lozano-Calderon S, Varvares MA, Tanabe KK, Kumar ATN. Fluorescence lifetime of injected indocyanine green as a universal marker of solid tumours in patients. Nat Biomed Eng 2023; 7:1649-1666. [PMID: 37845517 DOI: 10.1038/s41551-023-01105-2] [Citation(s) in RCA: 15] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2022] [Accepted: 09/10/2023] [Indexed: 10/18/2023]
Abstract
The surgical resection of solid tumours can be enhanced by fluorescence-guided imaging. However, variable tumour uptake and incomplete clearance of fluorescent dyes reduces the accuracy of distinguishing tumour from normal tissue via conventional fluorescence intensity-based imaging. Here we show that, after systemic injection of the near-infrared dye indocyanine green in patients with various types of solid tumour, the fluorescence lifetime (FLT) of tumour tissue is longer than the FLT of non-cancerous tissue. This tumour-specific shift in FLT can be used to distinguish tumours from normal tissue with an accuracy of over 97% across tumour types, and can be visualized at the cellular level using microscopy and in larger specimens through wide-field imaging. Unlike fluorescence intensity, which depends on imaging-system parameters, tissue depth and the amount of dye taken up by tumours, FLT is a photophysical property that is largely independent of these factors. FLT imaging with indocyanine green may improve the accuracy of cancer surgeries.
Collapse
Affiliation(s)
- Rahul Pal
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA, USA
| | - Thinzar M Lwin
- Department of Surgical Oncology, City of Hope Hospital, Duarte, CA, USA
| | - Murali Krishnamoorthy
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA, USA
| | - Hannah R Collins
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA, USA
| | - Corey D Chan
- Newcastle University Centre for Cancer, Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Andrey Prilutskiy
- Department of Pathology, University of Wisconsin School of Medicine and Public Health, Madison, WI, USA
| | - MacLean P Nasrallah
- Department of Pathology, Hospital of the University of Pennsylvania, Philadelphia, PA, USA
| | - Tom H Dijkhuis
- Department of Surgery, Leiden University Medical Center, Leiden, the Netherlands
| | - Shriya Shukla
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA, USA
| | - Amy L Kendall
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA, USA
| | - Michael S Marshall
- Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Stefan A Carp
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA, USA
| | - Yin P Hung
- Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Angela R Shih
- Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Maria Martinez-Lage
- Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Lawrence Zukerberg
- Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Peter M Sadow
- Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
- Department of Otolaryngology and Head and Neck Surgery, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, USA
| | - William C Faquin
- Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
- Department of Otolaryngology and Head and Neck Surgery, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, USA
| | - Brian V Nahed
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Allen L Feng
- Department of Otolaryngology and Head and Neck Surgery, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, USA
| | - Kevin S Emerick
- Department of Otolaryngology and Head and Neck Surgery, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, USA
| | - J Sven D Mieog
- Department of Surgery, Leiden University Medical Center, Leiden, the Netherlands
| | | | - Karthik Rajasekaran
- Department of Otorhinolaryngology-Head and Neck Surgery, University of Pennsylvania, Philadelphia, PA, USA
| | - John Y K Lee
- Department of Neurosurgery, Hospital of the University of Pennsylvania, Philadelphia, PA, USA
| | - Kenneth S Rankin
- The North of England Bone and Soft Tissue Tumour Service, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - Santiago Lozano-Calderon
- Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Mark A Varvares
- Department of Otolaryngology and Head and Neck Surgery, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, USA
| | - Kenneth K Tanabe
- Division of Gastrointestinal and Oncologic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Anand T N Kumar
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA, USA.
| |
Collapse
|
43
|
Yadav N, Pandey S, Gupta A, Dudani P, Gupta S, Rangarajan K. Data Privacy in Healthcare: In the Era of Artificial Intelligence. Indian Dermatol Online J 2023; 14:788-792. [PMID: 38099022 PMCID: PMC10718098 DOI: 10.4103/idoj.idoj_543_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2023] [Revised: 09/01/2023] [Accepted: 09/08/2023] [Indexed: 12/17/2023] Open
Abstract
Data Privacy has increasingly become a matter of concern in the era of large public digital respositories of data. This is particularly true in healthcare where data can be misused if traced back to patients, and brings with itself a myriad of possibilities. Bring custodians of data, as well as being at the helm of disigning studies and products that can potentially benefit products, healthcare professionals often find themselves unsure about ethical and legal constraints that undelie data sharing. In this review we touch upon the concerns, leal frameworks as well as some common practices in these respects.
Collapse
Affiliation(s)
- Neel Yadav
- Department of Radiodiagnosis and Interventional Radiology, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Saumya Pandey
- Department of Radiodiagnosis and Interventional Radiology, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Amit Gupta
- Department of Radiodiagnosis and Interventional Radiology, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Pankhuri Dudani
- Department of Dermatology, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Somesh Gupta
- Department of Dermatology, All India Institute of Medical Sciences, New Delhi, Delhi, India
| | - Krithika Rangarajan
- Department of Radiodiagnosis and Interventional Radiology, All India Institute of Medical Sciences, New Delhi, Delhi, India
| |
Collapse
|
44
|
Li K, Wu Q, Feng S, Zhao H, Jin W, Qiu H, Gu Y, Chen D. In situ detection of human glioma based on tissue optical properties using diffuse reflectance spectroscopy. JOURNAL OF BIOPHOTONICS 2023; 16:e202300195. [PMID: 37589177 DOI: 10.1002/jbio.202300195] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/27/2023] [Revised: 07/18/2023] [Accepted: 08/15/2023] [Indexed: 08/18/2023]
Abstract
Safely maximizing brain cancer removal without injuring adjacent healthy tissue is crucial for optimal treatment outcomes. However, it is challenging to distinguish cancer from noncancer intraoperatively. This study aimed to explore the feasibility of diffuse reflectance spectroscopy (DRS) as a label-free and real-time detection technology for discrimination between brain cancer and noncancer tissues. Fifty-five fresh cancer and noncancer specimens from 19 brain surgeries were measured with DRS, and the results were compared with co-registered clinical standard histopathology. Tissue optical properties were quantitatively obtained from the diffuse reflectance spectra and compared among different types of brain tissues. A machine learning-based classifier was trained to differentiate cancerous versus noncancerous tissues. Our method could achieve a sensitivity of 93% and specificity of 95% for discriminating high-grade glioma from normal white matter. Our results showed that DRS has the potential to be used for label-free, real-time in vivo cancer detection during brain surgery.
Collapse
Affiliation(s)
- Kerui Li
- School of Medical Technology, Beijing Institute of Technology, Beijing, China
| | - Qijia Wu
- Department of Neurosurgery, First Medical Center of PLA General Hospital, Beijing, China
| | - Shiyu Feng
- Department of Neurosurgery, First Medical Center of PLA General Hospital, Beijing, China
| | - Hongyou Zhao
- School of Medical Technology, Beijing Institute of Technology, Beijing, China
| | - Wei Jin
- Department of Pathology, Chinese PLA General Hospital, Beijing, China
| | - Haixia Qiu
- Department of Laser Medicine, First Medical Center of PLA General Hospital, Beijing, China
| | - Ying Gu
- School of Medical Technology, Beijing Institute of Technology, Beijing, China
- Department of Laser Medicine, First Medical Center of PLA General Hospital, Beijing, China
- Precision Laser Medical Diagnosis and Treatment Innovation Unit, Chinese Academy of Medical Sciences, Beijing, China
| | - Defu Chen
- School of Medical Technology, Beijing Institute of Technology, Beijing, China
| |
Collapse
|
45
|
Corso C, Mansuryan T, Tonello A, Arosa Y, Stepanenko Y, Couderc V, Krupa K. Tunable four-wave mixing enabled by a self-phase modulation of chirped pulses. OPTICS LETTERS 2023; 48:5531-5534. [PMID: 37910695 DOI: 10.1364/ol.502065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Accepted: 09/29/2023] [Indexed: 11/03/2023]
Abstract
We experimentally demonstrate how a concatenation of the standard and microstructure fiber segments permits adjusting the four-wave mixing sideband position over a large spectral range by varying the chirp of an input pulsed pump at a fixed wavelength in the presence of a self-phase modulation. The blue- and redshifted sidebands can stand aside over ∼200 nm and ∼450 nm from the pump, respectively, which agrees well with the numerical simulations. We validate our approach by showing the feasibility of CARS imaging.
Collapse
|
46
|
Kaynar G, Cakmakci D, Bund C, Todeschi J, Namer IJ, Cicek AE. PiDeeL: metabolic pathway-informed deep learning model for survival analysis and pathological classification of gliomas. Bioinformatics 2023; 39:btad684. [PMID: 37952175 PMCID: PMC10663986 DOI: 10.1093/bioinformatics/btad684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Revised: 10/19/2023] [Accepted: 11/10/2023] [Indexed: 11/14/2023] Open
Abstract
MOTIVATION Online assessment of tumor characteristics during surgery is important and has the potential to establish an intra-operative surgeon feedback mechanism. With the availability of such feedback, surgeons could decide to be more liberal or conservative regarding the resection of the tumor. While there are methods to perform metabolomics-based tumor pathology prediction, their model complexity predictive performance is limited by the small dataset sizes. Furthermore, the information conveyed by the feedback provided on the tumor tissue could be improved both in terms of content and accuracy. RESULTS In this study, we propose a metabolic pathway-informed deep learning model (PiDeeL) to perform survival analysis and pathology assessment based on metabolite concentrations. We show that incorporating pathway information into the model architecture substantially reduces parameter complexity and achieves better survival analysis and pathological classification performance. With these design decisions, we show that PiDeeL improves tumor pathology prediction performance of the state-of-the-art in terms of the Area Under the ROC Curve by 3.38% and the Area Under the Precision-Recall Curve by 4.06%. Similarly, with respect to the time-dependent concordance index (c-index), PiDeeL achieves better survival analysis performance (improvement of 4.3%) when compared to the state-of-the-art. Moreover, we show that importance analyses performed on input metabolite features as well as pathway-specific neurons of PiDeeL provide insights into tumor metabolism. We foresee that the use of this model in the surgery room will help surgeons adjust the surgery plan on the fly and will result in better prognosis estimates tailored to surgical procedures. AVAILABILITY AND IMPLEMENTATION The code is released at https://github.com/ciceklab/PiDeeL. The data used in this study are released at https://zenodo.org/record/7228791.
Collapse
Affiliation(s)
- Gun Kaynar
- Computer Engineering Department, Bilkent University, 06800 Ankara, Turkey
| | - Doruk Cakmakci
- School of Computer Science, McGill University, Montreal, QC, H3A 0E9, Canada
| | - Caroline Bund
- MNMS Platform, University Hospitals of Strasbourg, Strasbourg 67098, France
- ICube, University of Strasbourg, CNRS UMR, 7357, Strasbourg 67000, France
- Department of Nuclear Medicine and Molecular Imaging, ICANS, Strasbourg 67000, France
| | - Julien Todeschi
- Department of Neurosurgery, University Hospitals of Strasbourg, Strasbourg, 67091, France
| | - Izzie Jacques Namer
- MNMS Platform, University Hospitals of Strasbourg, Strasbourg 67098, France
- ICube, University of Strasbourg, CNRS UMR, 7357, Strasbourg 67000, France
- Department of Nuclear Medicine and Molecular Imaging, ICANS, Strasbourg 67000, France
| | - A Ercument Cicek
- Computer Engineering Department, Bilkent University, 06800 Ankara, Turkey
- Computational Biology Department, Carnegie Mellon University, Pittsburgh, PA 15213, United States
| |
Collapse
|
47
|
Zhu Y, Ge X, Ni H, Yin J, Lin H, Wang L, Tan Y, Prabhu Dessai CV, Li Y, Teng X, Cheng JX. Stimulated Raman photothermal microscopy toward ultrasensitive chemical imaging. SCIENCE ADVANCES 2023; 9:eadi2181. [PMID: 37889965 PMCID: PMC10610916 DOI: 10.1126/sciadv.adi2181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Accepted: 09/27/2023] [Indexed: 10/29/2023]
Abstract
Stimulated Raman scattering (SRS) microscopy has shown enormous potential in revealing molecular structures, dynamics, and couplings in complex systems. However, the sensitivity of SRS is fundamentally limited to the millimolar level due to shot noise and the small modulation depth. To overcome this barrier, we revisit SRS from the perspective of energy deposition. The SRS process pumps molecules to their vibrationally excited states. The subsequent relaxation heats up the surroundings and induces refractive index changes. By probing the refractive index changes with a laser beam, we introduce stimulated Raman photothermal (SRP) microscopy, where a >500-fold boost of modulation depth is achieved. The versatile applications of SRP microscopy on viral particles, cells, and tissues are demonstrated. SRP microscopy opens a way to perform vibrational spectroscopic imaging with ultrahigh sensitivity.
Collapse
Affiliation(s)
- Yifan Zhu
- Department of Chemistry, Boston University, Boston, MA 02215, USA
| | - Xiaowei Ge
- Department of Electrical and Computer Engineering, Boston University, Boston, MA 02215, USA
| | - Hongli Ni
- Department of Electrical and Computer Engineering, Boston University, Boston, MA 02215, USA
| | - Jiaze Yin
- Department of Electrical and Computer Engineering, Boston University, Boston, MA 02215, USA
| | - Haonan Lin
- Department of Biomedical Engineering, Boston University, Boston, MA 02215, USA
| | - Le Wang
- Department of Electrical and Computer Engineering, Boston University, Boston, MA 02215, USA
| | - Yuying Tan
- Department of Biomedical Engineering, Boston University, Boston, MA 02215, USA
| | | | - Yueming Li
- Department of Mechanical Engineering, Boston University, Boston, MA 02215, USA
| | - Xinyan Teng
- Department of Chemistry, Boston University, Boston, MA 02215, USA
| | - Ji-Xin Cheng
- Department of Chemistry, Boston University, Boston, MA 02215, USA
- Department of Electrical and Computer Engineering, Boston University, Boston, MA 02215, USA
- Department of Biomedical Engineering, Boston University, Boston, MA 02215, USA
- Photonics Center, Boston University, Boston, MA 02215, USA
| |
Collapse
|
48
|
Bin-Alamer O, Abou-Al-Shaar H, Gersey ZC, Huq S, Kallos JA, McCarthy DJ, Head JR, Andrews E, Zhang X, Hadjipanayis CG. Intraoperative Imaging and Optical Visualization Techniques for Brain Tumor Resection: A Narrative Review. Cancers (Basel) 2023; 15:4890. [PMID: 37835584 PMCID: PMC10571802 DOI: 10.3390/cancers15194890] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Revised: 09/26/2023] [Accepted: 10/04/2023] [Indexed: 10/15/2023] Open
Abstract
Advancements in intraoperative visualization and imaging techniques are increasingly central to the success and safety of brain tumor surgery, leading to transformative improvements in patient outcomes. This comprehensive review intricately describes the evolution of conventional and emerging technologies for intraoperative imaging, encompassing the surgical microscope, exoscope, Raman spectroscopy, confocal microscopy, fluorescence-guided surgery, intraoperative ultrasound, magnetic resonance imaging, and computed tomography. We detail how each of these imaging modalities contributes uniquely to the precision, safety, and efficacy of neurosurgical procedures. Despite their substantial benefits, these technologies share common challenges, including difficulties in image interpretation and steep learning curves. Looking forward, innovations in this field are poised to incorporate artificial intelligence, integrated multimodal imaging approaches, and augmented and virtual reality technologies. This rapidly evolving landscape represents fertile ground for future research and technological development, aiming to further elevate surgical precision, safety, and, most critically, patient outcomes in the management of brain tumors.
Collapse
Affiliation(s)
- Othman Bin-Alamer
- Center for Image-Guided Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA; (O.B.-A.); (H.A.-A.-S.); (Z.C.G.); (S.H.); (J.A.K.); (D.J.M.); (J.R.H.); (E.A.); (X.Z.)
- Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA
| | - Hussam Abou-Al-Shaar
- Center for Image-Guided Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA; (O.B.-A.); (H.A.-A.-S.); (Z.C.G.); (S.H.); (J.A.K.); (D.J.M.); (J.R.H.); (E.A.); (X.Z.)
- Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA
| | - Zachary C. Gersey
- Center for Image-Guided Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA; (O.B.-A.); (H.A.-A.-S.); (Z.C.G.); (S.H.); (J.A.K.); (D.J.M.); (J.R.H.); (E.A.); (X.Z.)
- Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA
| | - Sakibul Huq
- Center for Image-Guided Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA; (O.B.-A.); (H.A.-A.-S.); (Z.C.G.); (S.H.); (J.A.K.); (D.J.M.); (J.R.H.); (E.A.); (X.Z.)
- Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA
| | - Justiss A. Kallos
- Center for Image-Guided Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA; (O.B.-A.); (H.A.-A.-S.); (Z.C.G.); (S.H.); (J.A.K.); (D.J.M.); (J.R.H.); (E.A.); (X.Z.)
- Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA
| | - David J. McCarthy
- Center for Image-Guided Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA; (O.B.-A.); (H.A.-A.-S.); (Z.C.G.); (S.H.); (J.A.K.); (D.J.M.); (J.R.H.); (E.A.); (X.Z.)
- Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA
| | - Jeffery R. Head
- Center for Image-Guided Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA; (O.B.-A.); (H.A.-A.-S.); (Z.C.G.); (S.H.); (J.A.K.); (D.J.M.); (J.R.H.); (E.A.); (X.Z.)
- Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA
| | - Edward Andrews
- Center for Image-Guided Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA; (O.B.-A.); (H.A.-A.-S.); (Z.C.G.); (S.H.); (J.A.K.); (D.J.M.); (J.R.H.); (E.A.); (X.Z.)
- Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA
| | - Xiaoran Zhang
- Center for Image-Guided Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA; (O.B.-A.); (H.A.-A.-S.); (Z.C.G.); (S.H.); (J.A.K.); (D.J.M.); (J.R.H.); (E.A.); (X.Z.)
- Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA
| | - Constantinos G. Hadjipanayis
- Center for Image-Guided Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA; (O.B.-A.); (H.A.-A.-S.); (Z.C.G.); (S.H.); (J.A.K.); (D.J.M.); (J.R.H.); (E.A.); (X.Z.)
- Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA
| |
Collapse
|
49
|
Wang N, Zhang C, Wei X, Yan T, Zhou W, Zhang J, Kang H, Yuan Z, Chen X. Harnessing the power of optical microscopy for visualization and analysis of histopathological images. BIOMEDICAL OPTICS EXPRESS 2023; 14:5451-5465. [PMID: 37854561 PMCID: PMC10581782 DOI: 10.1364/boe.501893] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 08/29/2023] [Accepted: 09/01/2023] [Indexed: 10/20/2023]
Abstract
Histopathology is the foundation and gold standard for identifying diseases, and precise quantification of histopathological images can provide the pathologist with objective clues to make a more convincing diagnosis. Optical microscopy (OM), an important branch of optical imaging technology that provides high-resolution images of tissue cytology and structural morphology, has been used in the diagnosis of histopathology and evolved into a new disciplinary direction of optical microscopic histopathology (OMH). There are a number of ex-vivo studies providing applicability of different OMH approaches, and a transfer of these techniques toward in vivo diagnosis is currently in progress. Furthermore, combined with advanced artificial intelligence algorithms, OMH allows for improved diagnostic reliability and convenience due to the complementarity of retrieval information. In this review, we cover recent advances in OMH, including the exploration of new techniques in OMH as well as their applications, and look ahead to new challenges in OMH. These typical application examples well demonstrate the application potential and clinical value of OMH techniques in histopathological diagnosis.
Collapse
Affiliation(s)
- Nan Wang
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Chang Zhang
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
| | - Xinyu Wei
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
| | - Tianyu Yan
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Wangting Zhou
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Jiaojiao Zhang
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Huan Kang
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Zhen Yuan
- Faculty of Health Sciences, University of Macau, Macau, 999078, China
| | - Xueli Chen
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
- Inovation Center for Advanced Medical Imaging and Intelligent Medicine, Guangzhou Institute of Technology, Xidian University, Guangzhou, Guangdong 510555, China
| |
Collapse
|
50
|
Zhang A, Wu Z, Wu E, Wu M, Snyder MP, Zou J, Wu JC. Leveraging physiology and artificial intelligence to deliver advancements in health care. Physiol Rev 2023; 103:2423-2450. [PMID: 37104717 PMCID: PMC10390055 DOI: 10.1152/physrev.00033.2022] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Revised: 03/06/2023] [Accepted: 04/25/2023] [Indexed: 04/29/2023] Open
Abstract
Artificial intelligence in health care has experienced remarkable innovation and progress in the last decade. Significant advancements can be attributed to the utilization of artificial intelligence to transform physiology data to advance health care. In this review, we explore how past work has shaped the field and defined future challenges and directions. In particular, we focus on three areas of development. First, we give an overview of artificial intelligence, with special attention to the most relevant artificial intelligence models. We then detail how physiology data have been harnessed by artificial intelligence to advance the main areas of health care: automating existing health care tasks, increasing access to care, and augmenting health care capabilities. Finally, we discuss emerging concerns surrounding the use of individual physiology data and detail an increasingly important consideration for the field, namely the challenges of deploying artificial intelligence models to achieve meaningful clinical impact.
Collapse
Affiliation(s)
- Angela Zhang
- Stanford Cardiovascular Institute, School of Medicine, Stanford University, Stanford, California, United States
- Department of Genetics, School of Medicine, Stanford University, Stanford, California, United States
- Greenstone Biosciences, Palo Alto, California, United States
| | - Zhenqin Wu
- Department of Chemistry, Stanford University, Stanford, California, United States
| | - Eric Wu
- Department of Electrical Engineering, Stanford University, Stanford, California, United States
| | - Matthew Wu
- Greenstone Biosciences, Palo Alto, California, United States
| | - Michael P Snyder
- Department of Genetics, School of Medicine, Stanford University, Stanford, California, United States
| | - James Zou
- Department of Biomedical Informatics, School of Medicine, Stanford University, Stanford, California, United States
- Department of Computer Science, Stanford University, Stanford, California, United States
| | - Joseph C Wu
- Stanford Cardiovascular Institute, School of Medicine, Stanford University, Stanford, California, United States
- Greenstone Biosciences, Palo Alto, California, United States
- Division of Cardiovascular Medicine, Department of Medicine, Stanford University, Stanford, California, United States
- Department of Radiology, School of Medicine, Stanford University, Stanford, California, United States
| |
Collapse
|