251
|
A Brief History of Machine Learning in Neurosurgery. ACTA NEUROCHIRURGICA. SUPPLEMENT 2021; 134:245-250. [PMID: 34862547 DOI: 10.1007/978-3-030-85292-4_27] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
The history of machine learning in neurosurgery spans three decades and continues to develop at a rapid pace. The earliest applications of machine learning within neurosurgery were first published in the 1990s as researchers began developing artificial neural networks to analyze structured datasets and supervised tasks. By the turn of the millennium, machine learning had evolved beyond proof-of-concept; algorithms had success detecting tumors in unstructured clinical imaging, and unsupervised learning showed promise for tumor segmentation. Throughout the 2000s, the role of machine learning in neurosurgery was further refined. Well-trained models began to consistently best expert clinicians at brain tumor diagnosis. Additionally, the digitization of the healthcare industry provided ample data for analysis, both structured and unstructured. By the 2010s, the use of machine learning within neurosurgery had exploded. The rapid deployment of an exciting new toolset also led to the growing realization that it may offer marginal benefit at best over conventional logistical regression models for analyzing tabular datasets. Additionally, the widespread adoption of machine learning in neurosurgical clinical practice continues to lag until additional validation can ensure generalizability. Many exciting contemporary applications nonetheless continue to demonstrate the unprecedented potential of machine learning to revolutionize neurosurgery when applied to appropriate clinical challenges.
Collapse
|
252
|
Stumpo V, Staartjes VE, Regli L, Serra C. Machine Learning in Pituitary Surgery. ACTA NEUROCHIRURGICA. SUPPLEMENT 2021; 134:291-301. [PMID: 34862553 DOI: 10.1007/978-3-030-85292-4_33] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
Machine learning applications in neurosurgery are increasingly reported for diverse tasks such as faster and more accurate preoperative diagnosis, enhanced lesion characterization, as well as surgical outcome, complications and healthcare cost prediction. Even though the pertinent literature in pituitary surgery is less extensive with respect to other neurosurgical diseases, past research attempted to answer clinically relevant questions to better assist surgeons and clinicians. In the present chapter we review reported ML applications in pituitary surgery including differential diagnosis, preoperative lesion characterization (immunohistochemistry, cavernous sinus invasion, tumor consistency), surgical outcome and complication predictions (gross total resection, tumor recurrence, and endocrinological remission, cerebrospinal fluid leak, postoperative hyponatremia). Moreover, we briefly discuss from a practical standpoint the current barriers to clinical translation of machine learning research. On the topic of pituitary surgery, published reports can be considered mostly preliminary, requiring larger training populations and strong external validation. Thoughtful selection of clinically relevant outcomes of interest and transversal application of model development pipeline-together with accurate methodological planning and multicenter collaborations-have the potential to overcome current limitations and ultimately provide additional tools for more informed patient management.
Collapse
Affiliation(s)
- Vittorio Stumpo
- Machine Intelligence in Clinical Neuroscience (MICN) Laboratory, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Victor E Staartjes
- Machine Intelligence in Clinical Neuroscience (MICN) Laboratory, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland.
| | - Luca Regli
- Machine Intelligence in Clinical Neuroscience (MICN) Laboratory, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Carlo Serra
- Machine Intelligence in Clinical Neuroscience (MICN) Laboratory, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| |
Collapse
|
253
|
Stumpo V, Kernbach JM, van Niftrik CHB, Sebök M, Fierstra J, Regli L, Serra C, Staartjes VE. Machine Learning Algorithms in Neuroimaging: An Overview. ACTA NEUROCHIRURGICA. SUPPLEMENT 2021; 134:125-138. [PMID: 34862537 DOI: 10.1007/978-3-030-85292-4_17] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
Machine learning (ML) and artificial intelligence (AI) applications in the field of neuroimaging have been on the rise in recent years, and their clinical adoption is increasing worldwide. Deep learning (DL) is a field of ML that can be defined as a set of algorithms enabling a computer to be fed with raw data and progressively discover-through multiple layers of representation-more complex and abstract patterns in large data sets. The combination of ML and radiomics, namely the extraction of features from medical images, has proven valuable, too: Radiomic information can be used for enhanced image characterization and prognosis or outcome prediction. This chapter summarizes the basic concepts underlying ML application for neuroimaging and discusses technical aspects of the most promising algorithms, with a specific focus on Convolutional Neural Networks (CNNs) and Generative Adversarial Networks (GANs), in order to provide the readership with the fundamental theoretical tools to better understand ML in neuroimaging. Applications are highlighted from a practical standpoint in the last section of the chapter, including: image reconstruction and restoration, image synthesis and super-resolution, registration, segmentation, classification, and outcome prediction.
Collapse
Affiliation(s)
- Vittorio Stumpo
- Machine Intelligence in Clinical Neuroscience (MICN) Lab, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Julius M Kernbach
- Neurosurgical Artificial Intelligence Lab Aachen (NAILA), Department of Neurosurgery, RWTH University Hospital, Aachen, Germany
- Department of Neurosurgery, Faculty of Medicine, RWTH Aachen University, Aachen, Germany
| | - Christiaan H B van Niftrik
- Machine Intelligence in Clinical Neuroscience (MICN) Lab, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Martina Sebök
- Machine Intelligence in Clinical Neuroscience (MICN) Lab, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Jorn Fierstra
- Machine Intelligence in Clinical Neuroscience (MICN) Lab, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Luca Regli
- Machine Intelligence in Clinical Neuroscience (MICN) Lab, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Carlo Serra
- Machine Intelligence in Clinical Neuroscience (MICN) Lab, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Victor E Staartjes
- Machine Intelligence in Clinical Neuroscience (MICN) Lab, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland.
| |
Collapse
|
254
|
Ren F, Jiang Z, Han M, Zhang H, Yun B, Zhu H, Li Z. NIR‐II Fluorescence imaging for cerebrovascular diseases. VIEW 2021. [DOI: 10.1002/viw.20200128] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022] Open
Affiliation(s)
- Feng Ren
- Center for Molecular Imaging and Nuclear Medicine State Key Laboratory of Radiation Medicine and Protection School for Radiological and Interdisciplinary Sciences (RAD‐X) Soochow University, Collaborative Innovation Center of Radiation Medicine of Jiangsu Higher Education Institutions Suzhou 215123 P. R. China
| | - Zhilin Jiang
- Center for Molecular Imaging and Nuclear Medicine State Key Laboratory of Radiation Medicine and Protection School for Radiological and Interdisciplinary Sciences (RAD‐X) Soochow University, Collaborative Innovation Center of Radiation Medicine of Jiangsu Higher Education Institutions Suzhou 215123 P. R. China
| | - Mengxiao Han
- Center for Molecular Imaging and Nuclear Medicine State Key Laboratory of Radiation Medicine and Protection School for Radiological and Interdisciplinary Sciences (RAD‐X) Soochow University, Collaborative Innovation Center of Radiation Medicine of Jiangsu Higher Education Institutions Suzhou 215123 P. R. China
| | - Hao Zhang
- Center for Molecular Imaging and Nuclear Medicine State Key Laboratory of Radiation Medicine and Protection School for Radiological and Interdisciplinary Sciences (RAD‐X) Soochow University, Collaborative Innovation Center of Radiation Medicine of Jiangsu Higher Education Institutions Suzhou 215123 P. R. China
| | - Baofeng Yun
- Center for Molecular Imaging and Nuclear Medicine State Key Laboratory of Radiation Medicine and Protection School for Radiological and Interdisciplinary Sciences (RAD‐X) Soochow University, Collaborative Innovation Center of Radiation Medicine of Jiangsu Higher Education Institutions Suzhou 215123 P. R. China
| | - Hongqin Zhu
- Center for Molecular Imaging and Nuclear Medicine State Key Laboratory of Radiation Medicine and Protection School for Radiological and Interdisciplinary Sciences (RAD‐X) Soochow University, Collaborative Innovation Center of Radiation Medicine of Jiangsu Higher Education Institutions Suzhou 215123 P. R. China
| | - Zhen Li
- Center for Molecular Imaging and Nuclear Medicine State Key Laboratory of Radiation Medicine and Protection School for Radiological and Interdisciplinary Sciences (RAD‐X) Soochow University, Collaborative Innovation Center of Radiation Medicine of Jiangsu Higher Education Institutions Suzhou 215123 P. R. China
| |
Collapse
|
255
|
|
256
|
Mahdavi R, Yousefpour N, Abbasvandi F, Ataee H, Hoseinpour P, Akbari ME, Parniani M, Delshad B, Avatefi M, Nourinejad Z, Abdolhosseini S, Mehrvarz S, Hajighasemi F, Abdolahad M. Intraoperative pathologically-calibrated diagnosis of lymph nodes involved by breast cancer cells based on electrical impedance spectroscopy; a prospective diagnostic human model study. Int J Surg 2021; 96:106166. [PMID: 34768024 DOI: 10.1016/j.ijsu.2021.106166] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2021] [Revised: 10/19/2021] [Accepted: 11/03/2021] [Indexed: 02/07/2023]
Abstract
BACKGROUND Nodal status evaluation is a crucial step in determining prognostic factors and managing treatment strategies for breast cancer patients. Preoperative (CNB), intraoperative (SLNB), and even postoperative techniques (Formalin-Fixed Paraffin-Embedded sectioning, FFPE) have definite limitations of precision or sometimes are time-consuming for the result declaration. The primary purpose of this prospective study is to provide a precise complementary system for distinguishing lymph nodes (LNs) involved by cancerous cells in breast cancer patients intraoperatively. METHODS The proposed system, Electrical Lymph Scoring(ELS), is designed based on the dielectric properties of the under-test LNs. The system has a needle-shaped 2-electrode probe entered into SLNs or ALNs dissected from patients through standard surgical guidelines. Impedance magnitude in f = 1 kH (Z1kHz) and Impedance Phase Slope in frequency ranges of 100 kHz-500 kHz (IPS) were then extracted from the impedance spectroscopy data in a cohort study of 77 breast cancer patients(totally 282 dissected LNs) who had been undergone surgery before (n = 55) or after (n = 22) chemical therapies (non-neoadjuvant or neoadjuvant chemotherapy). A new admittance parameter(Yn') also proposed for LN detection in neoadjuvant chemotherapy patients. RESULTS Considering the permanent pathology result as the gold standard checked by two independent expert pathologists, a significant correlation was observed between the presence of cancerous cells in LNs and individual ranges of the ELS electrical responses. Compared with normal LNs containing fatty ambient and immune cells, LNs involved by cancerous clusters would reduce the Z1kHz and increase the IPS. These changes correlate with fat metabolism by cancer cells due to their Fatty Acid Oxidation (FAO) in LN, which results in different dielectric properties between high and low-fat content of normal and cancerous LNs, respectively. CONCLUSIONS By finding the best correlation between our defined impedimetric parameters and pathological states of tested LNs, a real-time intraoperative detection approach was developed for highly-sensitive (92%, P<0.001) diagnosis of involved sentinel or axillary LNs. The impact of real-time intraoperative scoring of SLNs would make a pre-estimation about the necessity of excising further LNs to help the surgeon for less invasive surgery, especially in the absence of frozen-section equipment.
Collapse
Affiliation(s)
- Reihane Mahdavi
- Nano Bioelectronics Devices Lab, Cancer Electronics Research Group, School of Electrical and Computer Engineering, Faculty of Engineering, University of Tehran, Tehran, P.O. Box 14395/515, Iran Nano Electronic Center of Excellence, Nano Bio Electronics Devices Lab, School of Electrical and Computer Engineering, University of Tehran, Tehran, P.O. Box 14395/515, Iran ATMP Department, Breast Cancer Research Center, Motamed Cancer Institute, ACECR, P.O. BOX 15179/64311, Tehran, Iran School of Electrical and Computer Engineering, Faculty of Engineering, Amirkabir University of Technology, Tehran, P.O. BOX 1591634311, Iran SEPAS Pathology Laboratory, P.O.Box: 1991945391, Tehran, Iran Cancer Research Center, Shahid Beheshti University of Medical Sciences, P.O. BOX 15179/64311, Tehran, Iran Pathology Department, Breast Cancer Research Center, Motamed Cancer Institute, ACECR, P.O. BOX 15179/64311, Tehran, Iran Cancer Institute, Imam-Khomeini Hospital, Tehran University of Medical Sciences, P.O. BOX 13145-158, Tehran, Iran
| | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
257
|
Heuke S, Rimke I, Sarri B, Gasecka P, Appay R, Legoff L, Volz P, Büttner E, Rigneault H. Shot-noise limited tunable dual-vibrational frequency stimulated Raman scattering microscopy. BIOMEDICAL OPTICS EXPRESS 2021; 12:7780-7789. [PMID: 35003866 PMCID: PMC8713670 DOI: 10.1364/boe.446348] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Accepted: 11/14/2021] [Indexed: 06/14/2023]
Abstract
We present a shot-noise limited SRS implementation providing a >200 mW per excitation wavelength that is optimized for addressing two molecular vibrations simultaneously. As the key to producing a 3 ps laser of different colors out of a single fs-laser (15 nm FWHM), we use ultra-steep angle-tunable optical filters to extract 2 narrow-band Stokes laser beams (1-2 nm & 1-2 ps), which are separated by 100 cm-1. The center part of the fs-laser is frequency doubled to pump an optical parametric oscillator (OPO). The temporal width of the OPO's output (1 ps) is matched to the Stokes beams and can be tuned from 650-980 nm to address simultaneously two Raman shifts separated by 100 cm-1 that are located between 500 cm-1 and 5000 cm-1. We demonstrate background-free SRS imaging of C-D labeled biological samples (bacteria and Drosophila). Furthermore, high quality virtual stimulated Raman histology imaging of a brain adenocarcinoma is shown for pixel dwell times of 16 µs.
Collapse
Affiliation(s)
- Sandro Heuke
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
- contributed equally to this work
| | - Ingo Rimke
- APE Angewandte Physik & Elektronik GmbH, Berlin, Germany
- contributed equally to this work
| | - Barbara Sarri
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
- Lightcore Technologies, Cannes, France
| | - Paulina Gasecka
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
| | - Romain Appay
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
- APHM, CHU Timone, Service d’Anatomie Pathologique et de Neuropathologie, Marseille, France
| | - Loic Legoff
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
| | - Peter Volz
- APE Angewandte Physik & Elektronik GmbH, Berlin, Germany
| | - Edlef Büttner
- APE Angewandte Physik & Elektronik GmbH, Berlin, Germany
| | - Hervé Rigneault
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
- Lightcore Technologies, Cannes, France
| |
Collapse
|
258
|
Le Reste P, Pilalis E, Aubry M, McMahon M, Cano L, Etcheverry A, Chatziioannou A, Chevet E, Fautrel A. Integration of Raman spectra with transcriptome data in glioblastoma multiforme defines tumour subtypes and predicts patient outcome. J Cell Mol Med 2021; 25:10846-10856. [PMID: 34773369 PMCID: PMC8642677 DOI: 10.1111/jcmm.16902] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2021] [Revised: 08/13/2021] [Accepted: 08/20/2021] [Indexed: 12/24/2022] Open
Abstract
Raman spectroscopy is an imaging technique that has been applied to assess molecular compositions of living cells to characterize cell types and states. However, owing to the diverse molecular species in cells and challenges of assigning peaks to specific molecules, it has not been clear how to interpret cellular Raman spectra. Here, we provide firm evidence that cellular Raman spectra (RS) and transcriptomic profiles of glioblastoma can be computationally connected and thus interpreted. We find that the dimensions of high-dimensional RS and transcriptomes can be reduced and connected linearly through a shared low-dimensional subspace. Accordingly, we were able to predict global gene expression profiles by applying the calculated transformation matrix to Raman spectra and vice versa. From these analyses, we extract a minimal gene expression signature associated with specific RS profiles and predictive of disease outcome.
Collapse
Affiliation(s)
- Pierre‐Jean Le Reste
- Department of NeurosurgeryUniversity HospitalRennesFrance
- INSERM U1242University of RennesRennesFrance
- REACT – Rennes Brain Cancer TeamRennesFrance
| | | | - Marc Aubry
- REACT – Rennes Brain Cancer TeamRennesFrance
- IGDR CNRSUniversity of RennesRennesFrance
| | - Mari McMahon
- INSERM U1242University of RennesRennesFrance
- REACT – Rennes Brain Cancer TeamRennesFrance
- Centre de Lutte Contre le Cancer Eugene MarquisRennesFrance
| | - Luis Cano
- H2P2 PlatformUMS CNRS 3480 – INSERM 018University of RennesRennesFrance
| | - Amandine Etcheverry
- REACT – Rennes Brain Cancer TeamRennesFrance
- IGDR CNRSUniversity of RennesRennesFrance
| | | | - Eric Chevet
- INSERM U1242University of RennesRennesFrance
- REACT – Rennes Brain Cancer TeamRennesFrance
- Centre de Lutte Contre le Cancer Eugene MarquisRennesFrance
| | - Alain Fautrel
- H2P2 PlatformUMS CNRS 3480 – INSERM 018University of RennesRennesFrance
| |
Collapse
|
259
|
El-Mashtoly SF, Gerwert K. Diagnostics and Therapy Assessment Using Label-Free Raman Imaging. Anal Chem 2021; 94:120-142. [PMID: 34852454 DOI: 10.1021/acs.analchem.1c04483] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
Affiliation(s)
- Samir F El-Mashtoly
- Center for Protein Diagnostics, Ruhr University Bochum, 44801 Bochum, Germany.,Department of Biophysics, Faculty of Biology and Biotechnology, Ruhr University Bochum, 44801 Bochum, Germany
| | - Klaus Gerwert
- Center for Protein Diagnostics, Ruhr University Bochum, 44801 Bochum, Germany.,Department of Biophysics, Faculty of Biology and Biotechnology, Ruhr University Bochum, 44801 Bochum, Germany
| |
Collapse
|
260
|
Xu L, Sanders L, Li K, Chow JCL. Chatbot for Health Care and Oncology Applications Using Artificial Intelligence and Machine Learning: Systematic Review. JMIR Cancer 2021; 7:e27850. [PMID: 34847056 PMCID: PMC8669585 DOI: 10.2196/27850] [Citation(s) in RCA: 118] [Impact Index Per Article: 29.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Revised: 07/02/2021] [Accepted: 09/18/2021] [Indexed: 01/01/2023] Open
Abstract
Background Chatbot is a timely topic applied in various fields, including medicine and health care, for human-like knowledge transfer and communication. Machine learning, a subset of artificial intelligence, has been proven particularly applicable in health care, with the ability for complex dialog management and conversational flexibility. Objective This review article aims to report on the recent advances and current trends in chatbot technology in medicine. A brief historical overview, along with the developmental progress and design characteristics, is first introduced. The focus will be on cancer therapy, with in-depth discussions and examples of diagnosis, treatment, monitoring, patient support, workflow efficiency, and health promotion. In addition, this paper will explore the limitations and areas of concern, highlighting ethical, moral, security, technical, and regulatory standards and evaluation issues to explain the hesitancy in implementation. Methods A search of the literature published in the past 20 years was conducted using the IEEE Xplore, PubMed, Web of Science, Scopus, and OVID databases. The screening of chatbots was guided by the open-access Botlist directory for health care components and further divided according to the following criteria: diagnosis, treatment, monitoring, support, workflow, and health promotion. Results Even after addressing these issues and establishing the safety or efficacy of chatbots, human elements in health care will not be replaceable. Therefore, chatbots have the potential to be integrated into clinical practice by working alongside health practitioners to reduce costs, refine workflow efficiencies, and improve patient outcomes. Other applications in pandemic support, global health, and education are yet to be fully explored. Conclusions Further research and interdisciplinary collaboration could advance this technology to dramatically improve the quality of care for patients, rebalance the workload for clinicians, and revolutionize the practice of medicine.
Collapse
Affiliation(s)
- Lu Xu
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada.,Department of Medical Biophysics, Western University, London, ON, Canada
| | - Leslie Sanders
- Department of Humanities, York University, Toronto, ON, Canada
| | - Kay Li
- Department of English, York University, Toronto, ON, Canada
| | - James C L Chow
- Department of Medical Physics, Radiation Medicine Program, Princess Margaret Cancer Centre, University Health Network, Toronto, ON, Canada.,Department of Radiation Oncology, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
261
|
Zhang L, Zou X, Huang J, Fan J, Sun X, Zhang B, Zheng B, Guo C, Fu D, Yao L, Ji M. Label-Free Histology and Evaluation of Human Pancreatic Cancer with Coherent Nonlinear Optical Microscopy. Anal Chem 2021; 93:15550-15558. [PMID: 34751027 DOI: 10.1021/acs.analchem.1c03861] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
Surgeries achieving maximal tumor resection remain the major effective treatment of pancreatic cancer. Rapid and precise intraoperative diagnosis of pancreatic tissues is critical for optimum surgical outcomes but is challenging for the current staining-based histological methods. We demonstrated that label-free coherent nonlinear optical microscopy with combined stimulated Raman scattering (SRS) and second harmonic generation (SHG) could reveal key diagnostic features of both normal and cancerous human pancreatic tissues. Adjacent pairs of tissue sections from resection margins of 37 patients were imaged by SRS and hematoxylin and eosin staining for direct comparison, demonstrating high diagnostic concordance (Cohen's kappa, κ > 0.97) between them. Fresh unprocessed tissues showed well-preserved histoarchitectures including pancreatic ducts, islets, acini, and nerves. Moreover, the area ratios of collagen fibers were analyzed and found to correlate with the drainage pancreatic amylase level (odds ratio = 28.0, p = 0.0017). Our results indicated that SRS/SHG histology provides potential for rapid intraoperative diagnosis of pancreatic cancer as well as a predictive value of postoperative pancreatic fistula.
Collapse
Affiliation(s)
- Lili Zhang
- State Key Laboratory of Surface Physics and Department of Physics, Human Phenome Institute, Academy for Engineering and Technology, Key Laboratory of Micro and Nano Photonic Structures (Ministry of Education), Fudan University, Shanghai 200433, China
| | - Xiang Zou
- Department of Pancreatic Surgery, Department of Neurosurgery, Department of Pathology, Huashan Hospital, Fudan University, Shanghai 200040, China
| | - Jing Huang
- State Key Laboratory of Surface Physics and Department of Physics, Human Phenome Institute, Academy for Engineering and Technology, Key Laboratory of Micro and Nano Photonic Structures (Ministry of Education), Fudan University, Shanghai 200433, China
| | - Jie Fan
- Department of Pancreatic Surgery, Department of Neurosurgery, Department of Pathology, Huashan Hospital, Fudan University, Shanghai 200040, China
| | - Xiangjie Sun
- Department of Pathology, Fudan University Shanghai Cancer Center, Shanghai 200032, China
| | - Bohan Zhang
- State Key Laboratory of Surface Physics and Department of Physics, Human Phenome Institute, Academy for Engineering and Technology, Key Laboratory of Micro and Nano Photonic Structures (Ministry of Education), Fudan University, Shanghai 200433, China
| | - Bin Zheng
- Department of Otolaryngology, Zhejiang Provincial People's Hospital, People's Hospital of Hangzhou Medical College, Hangzhou 310014, China
| | - Chongyuan Guo
- Shanghai Starriver Bilingual School, Shanghai 201108, China
| | - Deliang Fu
- Department of Pancreatic Surgery, Department of Neurosurgery, Department of Pathology, Huashan Hospital, Fudan University, Shanghai 200040, China
| | - Lie Yao
- Department of Pancreatic Surgery, Department of Neurosurgery, Department of Pathology, Huashan Hospital, Fudan University, Shanghai 200040, China
| | - Minbiao Ji
- State Key Laboratory of Surface Physics and Department of Physics, Human Phenome Institute, Academy for Engineering and Technology, Key Laboratory of Micro and Nano Photonic Structures (Ministry of Education), Fudan University, Shanghai 200433, China.,Yiwu Research Institute of Fudan University, Chengbei Road, Yiwu City, Zhejiang 322000, China
| |
Collapse
|
262
|
Zheng Y, Jiang Z, Shi J, Xie F, Zhang H, Luo W, Hu D, Sun S, Jiang Z, Xue C. Encoding histopathology whole slide images with location-aware graphs for diagnostically relevant regions retrieval. Med Image Anal 2021; 76:102308. [PMID: 34856455 DOI: 10.1016/j.media.2021.102308] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2019] [Revised: 10/14/2021] [Accepted: 11/17/2021] [Indexed: 01/18/2023]
Abstract
Content-based histopathological image retrieval (CBHIR) has become popular in recent years in histopathological image analysis. CBHIR systems provide auxiliary diagnosis information for pathologists by searching for and returning regions that are contently similar to the region of interest (ROI) from a pre-established database. It is challenging and yet significant in clinical applications to retrieve diagnostically relevant regions from a database consisting of histopathological whole slide images (WSIs). In this paper, we propose a novel framework for regions retrieval from WSI database based on location-aware graphs and deep hash techniques. Compared to the present CBHIR framework, both structural information and global location information of ROIs in the WSI are preserved by graph convolution and self-attention operations, which makes the retrieval framework more sensitive to regions that are similar in tissue distribution. Moreover, benefited from the graph structure, the proposed framework has good scalability for both the size and shape variation of ROIs. It allows the pathologist to define query regions using free curves according to the appearance of tissue. Thirdly, the retrieval is achieved based on the hash technique, which ensures the framework is efficient and adequate for practical large-scale WSI database. The proposed method was evaluated on an in-house endometrium dataset with 2650 WSIs and the public ACDC-LungHP dataset. The experimental results have demonstrated that the proposed method achieved a mean average precision above 0.667 on the endometrium dataset and above 0.869 on the ACDC-LungHP dataset in the task of irregular region retrieval, which are superior to the state-of-the-art methods. The average retrieval time from a database containing 1855 WSIs is 0.752 ms. The source code is available at https://github.com/zhengyushan/lagenet.
Collapse
Affiliation(s)
- Yushan Zheng
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China
| | - Zhiguo Jiang
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China; Image Processing Center, School of Astronautics, Beihang University, Beijing 102206, China.
| | - Jun Shi
- School of Software, Hefei University of Technology, Hefei 230601, China.
| | - Fengying Xie
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China; Image Processing Center, School of Astronautics, Beihang University, Beijing 102206, China
| | - Haopeng Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China; Image Processing Center, School of Astronautics, Beihang University, Beijing 102206, China
| | - Wei Luo
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China; Image Processing Center, School of Astronautics, Beihang University, Beijing 102206, China
| | - Dingyi Hu
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China; Image Processing Center, School of Astronautics, Beihang University, Beijing 102206, China
| | - Shujiao Sun
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China; Image Processing Center, School of Astronautics, Beihang University, Beijing 102206, China
| | - Zhongmin Jiang
- Department of Pathology, Tianjin Fifth Central Hospital, Tianjin 300450, China
| | - Chenghai Xue
- Wankangyuan Tianjin Gene Technology, Inc, Tianjin 300220, China; Tianjin Institute of Industrial Biotechnology, Chinese Academy of Sciences, Tianjin 300308, China
| |
Collapse
|
263
|
Shavlokhova V, Sandhu S, Flechtenmacher C, Koveshazi I, Neumeier F, Padrón-Laso V, Jonke Ž, Saravi B, Vollmer M, Vollmer A, Hoffmann J, Engel M, Ristow O, Freudlsperger C. Deep Learning on Oral Squamous Cell Carcinoma Ex Vivo Fluorescent Confocal Microscopy Data: A Feasibility Study. J Clin Med 2021; 10:5326. [PMID: 34830608 PMCID: PMC8618824 DOI: 10.3390/jcm10225326] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2021] [Revised: 11/11/2021] [Accepted: 11/13/2021] [Indexed: 12/12/2022] Open
Abstract
BACKGROUND Ex vivo fluorescent confocal microscopy (FCM) is a novel and effective method for a fast-automatized histological tissue examination. In contrast, conventional diagnostic methods are primarily based on the skills of the histopathologist. In this study, we investigated the potential of convolutional neural networks (CNNs) for automatized classification of oral squamous cell carcinoma via ex vivo FCM imaging for the first time. MATERIAL AND METHODS Tissue samples from 20 patients were collected, scanned with an ex vivo confocal microscope immediately after resection, and investigated histopathologically. A CNN architecture (MobileNet) was trained and tested for accuracy. RESULTS The model achieved a sensitivity of 0.47 and specificity of 0.96 in the automated classification of cancerous tissue in our study. CONCLUSION In this preliminary work, we trained a CNN model on a limited number of ex vivo FCM images and obtained promising results in the automated classification of cancerous tissue. Further studies using large sample sizes are warranted to introduce this technology into clinics.
Collapse
Affiliation(s)
- Veronika Shavlokhova
- Department of Oral and Maxillofacial Surgery, University Hospital Heidelberg, 69120 Heidelberg, Germany; (S.S.); (M.V.); (A.V.); (J.H.); (M.E.); (O.R.); (C.F.)
| | - Sameena Sandhu
- Department of Oral and Maxillofacial Surgery, University Hospital Heidelberg, 69120 Heidelberg, Germany; (S.S.); (M.V.); (A.V.); (J.H.); (M.E.); (O.R.); (C.F.)
| | | | | | | | | | - Žan Jonke
- Munich Innovation Labs GmbH, 80336 Munich, Germany; (V.P.-L.); (Ž.J.)
| | - Babak Saravi
- Department of Orthopedics and Trauma Surgery, Medical Centre-Albert-Ludwigs-University of Freiburg, Faculty of Medicine, Albert-Ludwigs-University of Freiburg, 79106 Freiburg, Germany;
| | - Michael Vollmer
- Department of Oral and Maxillofacial Surgery, University Hospital Heidelberg, 69120 Heidelberg, Germany; (S.S.); (M.V.); (A.V.); (J.H.); (M.E.); (O.R.); (C.F.)
| | - Andreas Vollmer
- Department of Oral and Maxillofacial Surgery, University Hospital Heidelberg, 69120 Heidelberg, Germany; (S.S.); (M.V.); (A.V.); (J.H.); (M.E.); (O.R.); (C.F.)
| | - Jürgen Hoffmann
- Department of Oral and Maxillofacial Surgery, University Hospital Heidelberg, 69120 Heidelberg, Germany; (S.S.); (M.V.); (A.V.); (J.H.); (M.E.); (O.R.); (C.F.)
| | - Michael Engel
- Department of Oral and Maxillofacial Surgery, University Hospital Heidelberg, 69120 Heidelberg, Germany; (S.S.); (M.V.); (A.V.); (J.H.); (M.E.); (O.R.); (C.F.)
| | - Oliver Ristow
- Department of Oral and Maxillofacial Surgery, University Hospital Heidelberg, 69120 Heidelberg, Germany; (S.S.); (M.V.); (A.V.); (J.H.); (M.E.); (O.R.); (C.F.)
| | - Christian Freudlsperger
- Department of Oral and Maxillofacial Surgery, University Hospital Heidelberg, 69120 Heidelberg, Germany; (S.S.); (M.V.); (A.V.); (J.H.); (M.E.); (O.R.); (C.F.)
| |
Collapse
|
264
|
Neary-Zajiczek L, Essmann C, Rau A, Bano S, Clancy N, Jansen M, Heptinstall L, Miranda E, Gander A, Pawar V, Fernandez-Reyes D, Shaw M, Davidson B, Stoyanov D. Stain-free identification of tissue pathology using a generative adversarial network to infer nanomechanical signatures. NANOSCALE ADVANCES 2021; 3:6403-6414. [PMID: 34913024 PMCID: PMC8577366 DOI: 10.1039/d1na00527h] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Accepted: 09/01/2021] [Indexed: 06/14/2023]
Abstract
Intraoperative frozen section analysis can be used to improve the accuracy of tumour margin estimation during cancer resection surgery through rapid processing and pathological assessment of excised tissue. Its applicability is limited in some cases due to the additional risks associated with prolonged surgery, largely from the time-consuming staining procedure. Our work uses a measurable property of bulk tissue to bypass the staining process: as tumour cells proliferate, they influence the surrounding extra-cellular matrix, and the resulting change in elastic modulus provides a signature of the underlying pathology. In this work we accurately localise atomic force microscopy measurements of human liver tissue samples and train a generative adversarial network to infer elastic modulus from low-resolution images of unstained tissue sections. Pathology is predicted through unsupervised clustering of parameters characterizing the distributions of inferred values, achieving 89% accuracy for all samples based on the nominal assessment (n = 28), and 95% for samples that have been validated by two independent pathologists through post hoc staining (n = 20). Our results demonstrate that this technique could increase the feasibility of intraoperative frozen section analysis for use during resection surgery and improve patient outcomes.
Collapse
Affiliation(s)
- Lydia Neary-Zajiczek
- Wellcome/EPSRC Centre for Surgical and Interventional Sciences London W1W 7TS UK
- Department of Computer Science, University College London London WC1E 6BT UK
| | - Clara Essmann
- Department of Computer Science, University College London London WC1E 6BT UK
| | - Anita Rau
- Wellcome/EPSRC Centre for Surgical and Interventional Sciences London W1W 7TS UK
| | - Sophia Bano
- Wellcome/EPSRC Centre for Surgical and Interventional Sciences London W1W 7TS UK
| | - Neil Clancy
- Wellcome/EPSRC Centre for Surgical and Interventional Sciences London W1W 7TS UK
- Department of Medical Physics and Biomedical Engineering, University College London London WC1E 6BT UK
| | - Marnix Jansen
- Department of Pathology, UCL Cancer Institute, University College London London WC1E 6BT UK
| | | | - Elena Miranda
- Biobank and Pathology Translational Technology Platform, UCL Cancer Institute, University College London London WC1E 6BT UK
| | - Amir Gander
- Department of Surgical Biotechnology, University College London London WC1E 6BT UK
| | - Vijay Pawar
- Department of Computer Science, University College London London WC1E 6BT UK
| | | | - Michael Shaw
- Wellcome/EPSRC Centre for Surgical and Interventional Sciences London W1W 7TS UK
- Department of Computer Science, University College London London WC1E 6BT UK
- National Physical Laboratory Teddington TW11 0LW UK
| | - Brian Davidson
- Wellcome/EPSRC Centre for Surgical and Interventional Sciences London W1W 7TS UK
| | - Danail Stoyanov
- Wellcome/EPSRC Centre for Surgical and Interventional Sciences London W1W 7TS UK
| |
Collapse
|
265
|
Deep-learning based classification distinguishes sarcomatoid malignant mesotheliomas from benign spindle cell mesothelial proliferations. Mod Pathol 2021; 34:2028-2035. [PMID: 34112957 DOI: 10.1038/s41379-021-00850-6] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Revised: 05/23/2021] [Accepted: 05/24/2021] [Indexed: 12/27/2022]
Abstract
Sarcomatoid mesothelioma is an aggressive malignancy that can be challenging to distinguish from benign spindle cell mesothelial proliferations based on biopsy, and this distinction is crucial to patient treatment and prognosis. A novel deep learning based classifier may be able to aid pathologists in making this critical diagnostic distinction. SpindleMesoNET was trained on cases of malignant sarcomatoid mesothelioma and benign spindle cell mesothelial proliferations. Performance was assessed through cross-validation on the training set, on an independent set of challenging cases referred for expert opinion ('referral' test set), and on an externally stained set from outside institutions ('externally stained' test set). SpindleMesoNET predicted the benign or malignant status of cases with AUC's of 0.932, 0.925, and 0.989 on the cross-validation, referral and external test sets, respectively. The accuracy of SpindleMesoNET on the referral set cases (92.5%) was comparable to the average accuracy of 3 experienced pathologists on the same slide set (91.7%). We conclude that SpindleMesoNET can accurately distinguish sarcomatoid mesothelioma from benign spindle cell mesothelial proliferations. A deep learning system of this type holds potential for future use as an ancillary test in diagnostic pathology.
Collapse
|
266
|
Lu SY, Satapathy SC, Wang SH, Zhang YD. PBTNet: A New Computer-Aided Diagnosis System for Detecting Primary Brain Tumors. Front Cell Dev Biol 2021; 9:765654. [PMID: 34722549 PMCID: PMC8555415 DOI: 10.3389/fcell.2021.765654] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Accepted: 09/27/2021] [Indexed: 11/13/2022] Open
Abstract
Brain tumors are among the leading human killers. There are over 120 different types of brain tumors, but they mainly fall into two groups: primary brain tumors and metastatic brain tumors. Primary brain tumors develop from normal brain cells. Early and accurate detection of primary brain tumors is vital for the treatment of this disease. Magnetic resonance imaging is the most common method to diagnose brain diseases, but the manual interpretation of the images suffers from high inter-observer variance. In this paper, we presented a new computer-aided diagnosis system named PBTNet for detecting primary brain tumors in magnetic resonance images. A pre-trained ResNet-18 was selected as the backbone model in our PBTNet, but it was fine-tuned only for feature extraction. Then, three randomized neural networks, Schmidt neural network, random vector functional-link, and extreme learning machine served as the classifiers in the PBTNet, which were trained with the features and their labels. The final predictions of the PBTNet were generated by the ensemble of the outputs from the three classifiers. 5-fold cross-validation was employed to evaluate the classification performance of the PBTNet, and experimental results demonstrated that the proposed PBTNet was an effective tool for the diagnosis of primary brain tumors.
Collapse
Affiliation(s)
- Si-Yuan Lu
- School of Computing and Mathematical Sciences, University of Leicester, Leicester, United Kingdom
| | | | - Shui-Hua Wang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester, United Kingdom
| | - Yu-Dong Zhang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester, United Kingdom
| |
Collapse
|
267
|
Li M, He H, Huang G, Lin B, Tian H, Xia K, Yuan C, Zhan X, Zhang Y, Fu W. A Novel and Rapid Serum Detection Technology for Non-Invasive Screening of Gastric Cancer Based on Raman Spectroscopy Combined With Different Machine Learning Methods. Front Oncol 2021; 11:665176. [PMID: 34646758 PMCID: PMC8504718 DOI: 10.3389/fonc.2021.665176] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2021] [Accepted: 09/06/2021] [Indexed: 12/04/2022] Open
Abstract
Gastric cancer (GC) is the fifth most common cancer in the world and a serious threat to human health. Due to its high morbidity and mortality, a simple, rapid and accurate early screening method for GC is urgently needed. In this study, the potential of Raman spectroscopy combined with different machine learning methods was explored to distinguish serum samples from GC patients and healthy controls. Serum Raman spectra were collected from 109 patients with GC (including 35 in stage I, 14 in stage II, 35 in stage III, and 25 in stage IV) and 104 healthy volunteers matched for age, presenting for a routine physical examination. We analyzed the difference in serum metabolism between GC patients and healthy people through a comparative study of the average Raman spectra of the two groups. Four machine learning methods, one-dimensional convolutional neural network, random forest, support vector machine, and K-nearest neighbor were used to explore identifying two sets of Raman spectral data. The classification model was established by using 70% of the data as a training set and 30% as a test set. Using unseen data to test the model, the RF model yielded an accuracy of 92.8%, and the sensitivity and specificity were 94.7% and 90.8%. The performance of the RF model was further confirmed by the receiver operating characteristic (ROC) curve, with an area under the curve (AUC) of 0.9199. This exploratory work shows that serum Raman spectroscopy combined with RF has great potential in the machine-assisted classification of GC, and is expected to provide a non-destructive and convenient technology for the screening of GC patients.
Collapse
Affiliation(s)
- Mengya Li
- Department of Laboratory Medicine, First Affiliated Hospital, Third Military Medical University (Army Medical University), Chongqing, China
| | - Haiyan He
- Department of Laboratory Medicine, First Affiliated Hospital, Third Military Medical University (Army Medical University), Chongqing, China
| | - Guorong Huang
- Department of Laboratory Medicine, First Affiliated Hospital, Third Military Medical University (Army Medical University), Chongqing, China
| | - Bo Lin
- Department of Laboratory Medicine, Chongqing University Cancer Hospital, Chongqing, China
| | - Huiyan Tian
- Department of Laboratory Medicine, First Affiliated Hospital, Third Military Medical University (Army Medical University), Chongqing, China
| | - Ke Xia
- Department of Laboratory Medicine, First Affiliated Hospital, Third Military Medical University (Army Medical University), Chongqing, China
| | - Changjing Yuan
- Department of Laboratory Medicine, First Affiliated Hospital, Third Military Medical University (Army Medical University), Chongqing, China
| | - Xinyu Zhan
- Department of Laboratory Medicine, First Affiliated Hospital, Third Military Medical University (Army Medical University), Chongqing, China
| | - Yang Zhang
- Department of Laboratory Medicine, Chongqing University Cancer Hospital, Chongqing, China
| | - Weiling Fu
- Department of Laboratory Medicine, First Affiliated Hospital, Third Military Medical University (Army Medical University), Chongqing, China
| |
Collapse
|
268
|
Wang S, Li C, Wang R, Liu Z, Wang M, Tan H, Wu Y, Liu X, Sun H, Yang R, Liu X, Chen J, Zhou H, Ben Ayed I, Zheng H. Annotation-efficient deep learning for automatic medical image segmentation. Nat Commun 2021; 12:5915. [PMID: 34625565 PMCID: PMC8501087 DOI: 10.1038/s41467-021-26216-9] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Accepted: 09/22/2021] [Indexed: 01/17/2023] Open
Abstract
Automatic medical image segmentation plays a critical role in scientific research and medical care. Existing high-performance deep learning methods typically rely on large training datasets with high-quality manual annotations, which are difficult to obtain in many clinical applications. Here, we introduce Annotation-effIcient Deep lEarning (AIDE), an open-source framework to handle imperfect training datasets. Methodological analyses and empirical evaluations are conducted, and we demonstrate that AIDE surpasses conventional fully-supervised models by presenting better performance on open datasets possessing scarce or noisy annotations. We further test AIDE in a real-life case study for breast tumor segmentation. Three datasets containing 11,852 breast images from three medical centers are employed, and AIDE, utilizing 10% training annotations, consistently produces segmentation maps comparable to those generated by fully-supervised counterparts or provided by independent radiologists. The 10-fold enhanced efficiency in utilizing expert labels has the potential to promote a wide range of biomedical applications.
Collapse
Affiliation(s)
- Shanshan Wang
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China.
- Peng Cheng Laboratory, Shenzhen, Guangdong, China.
- Pazhou Laboratory, Guangzhou, Guangdong, China.
| | - Cheng Li
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China.
| | - Rongpin Wang
- Department of Medical Imaging, Guizhou Provincial People's Hospital, Guiyang, Guizhou, China
| | - Zaiyi Liu
- Department of Medical Imaging, Guangdong General Hospital, Guangdong Academy of Medical Sciences, Guangzhou, Guangdong, China
| | - Meiyun Wang
- Department of Medical Imaging, Henan Provincial People's Hospital & the People's Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Hongna Tan
- Department of Medical Imaging, Henan Provincial People's Hospital & the People's Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Yaping Wu
- Department of Medical Imaging, Henan Provincial People's Hospital & the People's Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Xinfeng Liu
- Department of Medical Imaging, Guizhou Provincial People's Hospital, Guiyang, Guizhou, China
| | - Hui Sun
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China
| | - Rui Yang
- Department of Urology, Renmin Hospital of Wuhan University, Wuhan, Hubei, China
| | - Xin Liu
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China
| | - Jie Chen
- Peng Cheng Laboratory, Shenzhen, Guangdong, China
- School of Electronic and Computer Engineering, Shenzhen Graduate School, Peking University, Shenzhen, Guangdong, China
| | - Huihui Zhou
- Brain Cognition and Brain Disease Institute, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China
| | | | - Hairong Zheng
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China.
| |
Collapse
|
269
|
Williams S, Layard Horsfall H, Funnell JP, Hanrahan JG, Khan DZ, Muirhead W, Stoyanov D, Marcus HJ. Artificial Intelligence in Brain Tumour Surgery-An Emerging Paradigm. Cancers (Basel) 2021; 13:cancers13195010. [PMID: 34638495 PMCID: PMC8508169 DOI: 10.3390/cancers13195010] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Revised: 10/02/2021] [Accepted: 10/03/2021] [Indexed: 01/01/2023] Open
Abstract
Artificial intelligence (AI) platforms have the potential to cause a paradigm shift in brain tumour surgery. Brain tumour surgery augmented with AI can result in safer and more effective treatment. In this review article, we explore the current and future role of AI in patients undergoing brain tumour surgery, including aiding diagnosis, optimising the surgical plan, providing support during the operation, and better predicting the prognosis. Finally, we discuss barriers to the successful clinical implementation, the ethical concerns, and we provide our perspective on how the field could be advanced.
Collapse
Affiliation(s)
- Simon Williams
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
- Correspondence:
| | - Hugo Layard Horsfall
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Jonathan P. Funnell
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - John G. Hanrahan
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Danyal Z. Khan
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - William Muirhead
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Danail Stoyanov
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Hani J. Marcus
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| |
Collapse
|
270
|
Reichert D, Erkkilae MT, Gesperger J, Wadiura LI, Lang A, Roetzer T, Woehrer A, Andreana M, Unterhuber A, Wilzbach M, Hauger C, Drexler W, Kiesel B, Widhalm G, Leitgeb RA. Fluorescence Lifetime Imaging and Spectroscopic Co-Validation for Protoporphyrin IX-Guided Tumor Visualization in Neurosurgery. Front Oncol 2021; 11:741303. [PMID: 34595120 PMCID: PMC8476921 DOI: 10.3389/fonc.2021.741303] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2021] [Accepted: 08/24/2021] [Indexed: 12/19/2022] Open
Abstract
Maximal safe resection is a key strategy for improving patient prognosis in the management of brain tumors. Intraoperative fluorescence guidance has emerged as a standard in the surgery of high-grade gliomas. The administration of 5-aminolevulinic acid prior to surgery induces tumor-specific accumulation of protoporphyrin IX, which emits red fluorescence under blue-light illumination. The technology, however, is substantially limited for low-grade gliomas and weakly tumor-infiltrated brain, where low protoporphyrin IX concentrations are outweighed by tissue autofluorescence. In this context, fluorescence lifetime imaging has shown promise to distinguish spectrally overlapping fluorophores. We integrated frequency-domain fluorescence lifetime imaging in a surgical microscope and combined it with spatially registered fluorescence spectroscopy, which can be considered a research benchmark for sensitive protoporphyrin IX detection. Fluorescence lifetime maps and spectra were acquired for a representative set of fresh ex-vivo brain tumor specimens (low-grade gliomas n = 15, high-grade gliomas n = 80, meningiomas n = 41, and metastases n = 35). Combining the fluorescence lifetime with fluorescence spectra unveiled how weak protoporphyrin IX accumulations increased the lifetime respective to tissue autofluorescence. Infiltration zones (4.1ns ± 1.8ns, p = 0.017) and core tumor areas (4.8ns ± 1.3ns, p = 0.040) of low-grade gliomas were significantly distinguishable from non-pathologic tissue (1.6ns ± 0.5ns). Similarly, fluorescence lifetimes for infiltrated and reactive tissue as well as necrotic and core tumor areas were increased for high-grade gliomas and metastasis. Meningioma tumor specimens showed strongly increased lifetimes (12.2ns ± 2.5ns, p = 0.005). Our results emphasize the potential of fluorescence lifetime imaging to optimize maximal safe resection in brain tumors in future and highlight its potential toward clinical translation.
Collapse
Affiliation(s)
- David Reichert
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria.,Christian Doppler Laboratory OPTRAMED, Medical University of Vienna, Vienna, Austria
| | - Mikael T Erkkilae
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Johanna Gesperger
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria.,Division of Neuropathology and Neurochemistry, Department of Neurology, Medical University of Vienna, Vienna, Austria
| | - Lisa I Wadiura
- Department of Neurosurgery, Medical University of Vienna, Vienna, Austria
| | - Alexandra Lang
- Department of Neurosurgery, Medical University of Vienna, Vienna, Austria
| | - Thomas Roetzer
- Division of Neuropathology and Neurochemistry, Department of Neurology, Medical University of Vienna, Vienna, Austria
| | - Adelheid Woehrer
- Division of Neuropathology and Neurochemistry, Department of Neurology, Medical University of Vienna, Vienna, Austria
| | - Marco Andreana
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Angelika Unterhuber
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Marco Wilzbach
- Advanced Development Microsurgery, Carl Zeiss Meditec AG, Oberkochen, Germany
| | - Christoph Hauger
- Advanced Development Microsurgery, Carl Zeiss Meditec AG, Oberkochen, Germany
| | - Wolfgang Drexler
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Barbara Kiesel
- Department of Neurosurgery, Medical University of Vienna, Vienna, Austria
| | - Georg Widhalm
- Department of Neurosurgery, Medical University of Vienna, Vienna, Austria
| | - Rainer A Leitgeb
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria.,Christian Doppler Laboratory OPTRAMED, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
271
|
Karhade AV, Schwab JH. Introduction to The Spine Journal special issue on artificial intelligence and machine learning. Spine J 2021; 21:1601-1603. [PMID: 33785475 DOI: 10.1016/j.spinee.2021.03.028] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/23/2021] [Accepted: 03/23/2021] [Indexed: 02/03/2023]
Abstract
In the last 5 years, artificial intelligence (AI) algorithms have made rapid advances for diagnosis and prognosis in fields ranging from dermatology to anesthesiology. How do we make sense of the rise of AI in healthcare and specifically in spine? How much of what we see today is "hype" and what will remain when the dust settles? In this special issue, several reviews and original articles help us understand the state of AI in healthcare today, the avenues for future progress, and the implications for spine care. Continued engagement, skepticism, and collaboration with technical experts will allow for the development of AI systems that complement and expand our abilities to diagnose, predict, and operate.
Collapse
Affiliation(s)
- Aditya V Karhade
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
| | - Joseph H Schwab
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
272
|
Würthwein T, Wallmeier K, Brinkmann M, Hellwig T, Lüpken NM, Lemberger NS, Fallnich C. Multi-color stimulated Raman scattering with a frame-to-frame wavelength-tunable fiber-based light source. BIOMEDICAL OPTICS EXPRESS 2021; 12:6228-6236. [PMID: 34745731 PMCID: PMC8547978 DOI: 10.1364/boe.436299] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Revised: 08/13/2021] [Accepted: 08/16/2021] [Indexed: 06/13/2023]
Abstract
We present multi-color imaging by stimulated Raman scattering (SRS) enabled by an ultrafast fiber-based light source with integrated amplitude modulation and frame-to-frame wavelength tuning. With a relative intensity noise level of -153.7 dBc/Hz at 20.25 MHz the light source is well suited for SRS imaging and outperforms other fiber-based light source concepts for SRS imaging. The light source is tunable in under 5 ms per arbitrary wavelength step between 700 cm-1 and 3200 cm-1, which allows for addressing Raman resonances from the fingerprint to the CH-stretch region. Moreover, the compact and environmentally stable system is predestined for fast multi-color assessments of medical or rapidly evolving samples with high chemical specificity, paving the way for diagnostics and sensing outside of specialized laser laboratories.
Collapse
Affiliation(s)
- Thomas Würthwein
- Institute of Applied Physics, University of Münster, Corrensstraße 2, 48149 Münster, Germany
| | - Kristin Wallmeier
- Institute of Applied Physics, University of Münster, Corrensstraße 2, 48149 Münster, Germany
| | | | - Tim Hellwig
- Refined Laser Systems GmbH, Mendelstraße 11, 48149 Münster, Germany
| | - Niklas M. Lüpken
- Institute of Applied Physics, University of Münster, Corrensstraße 2, 48149 Münster, Germany
| | - Nick S. Lemberger
- Institute of Applied Physics, University of Münster, Corrensstraße 2, 48149 Münster, Germany
| | - Carsten Fallnich
- Institute of Applied Physics, University of Münster, Corrensstraße 2, 48149 Münster, Germany
- MESA+ Institute for Nanotechnology, University of Twente, P.O. Box 217, Enschede 7500 AE, The Netherlands
- Cells in Motion Interfaculty Centre, University of Münster, Münster, Germany
| |
Collapse
|
273
|
SMART on FHIR in spine: integrating clinical prediction models into electronic health records for precision medicine at the point of care. Spine J 2021; 21:1649-1651. [PMID: 32599144 PMCID: PMC7762727 DOI: 10.1016/j.spinee.2020.06.014] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/15/2020] [Accepted: 06/17/2020] [Indexed: 02/03/2023]
Abstract
Recent applications of artificial intelligence have shown great promise for improving the quality and efficiency of clinical care. Numerous clinical decision support tools exist in today's electronic health records (EHRs) such as medication dosing support, order facilitators (eg, procedure specific order sets), and point of care alerts. However, less has been done to integrate artificial intelligence (AI)-enabled risk predictors into EHRs despite wide availability of validated risk prediction tools. An interoperability standard known as SMART on FHIR (substitutable medical applications and reusable technologies on fast health interoperability resources) offers a promising path forward, enabling digital innovations to be seamlessly integrated with the EHR with regard to the user interface and patient data. For the next step in progress towards the goal of learning healthcare and informatics-enabled spine surgery, we propose the application of SMART on FHIR to integrate existing and new risk predictions tools in spine surgery through an EHR add-on-application.
Collapse
|
274
|
Chen R, Brown HM, Cooks RG. Metabolic profiles of human brain parenchyma and glioma for rapid tissue diagnosis by targeted desorption electrospray ionization mass spectrometry. Anal Bioanal Chem 2021; 413:6213-6224. [PMID: 34373931 PMCID: PMC8522078 DOI: 10.1007/s00216-021-03593-0] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Revised: 07/23/2021] [Accepted: 07/30/2021] [Indexed: 12/19/2022]
Abstract
Desorption electrospray ionization mass spectrometry (DESI-MS) is well suited for intraoperative tissue analysis since it requires little sample preparation and offers rapid and sensitive molecular diagnostics. Currently, intraoperative assessment of the tumor cell percentage of glioma biopsies can be made by measuring a single metabolite, N-acetylaspartate (NAA). The inclusion of additional biomarkers will likely improve the accuracy when distinguishing brain parenchyma from glioma by DESI-MS. To explore this possibility, mass spectra were recorded for extracts from 32 unmodified human brain samples with known pathology. Statistical analysis of data obtained from full-scan and multiple reaction monitoring (MRM) profiles identified discriminatory metabolites, namely gamma-aminobutyric acid (GABA), creatine, glutamic acid, carnitine, and hexane-1,2,3,4,5,6-hexol (abbreviated as hexol), as well as the established biomarker NAA. Brain parenchyma was readily differentiated from glioma based on these metabolites as measured both in full-scan mass spectra and by the intensities of their characteristic MRM transitions. New DESI-MS methods (5 min acquisition using full scans and MS/MS), developed to measure ion abundance ratios among these metabolites, were tested using smears of 29 brain samples. Ion abundance ratios based on signals for GABA, creatine, carnitine, and hexol all had sensitivities > 90%, specificities > 80%, and accuracies > 85%. Prospectively, the implementation of diagnostic ion abundance ratios should strengthen the discriminatory power of individual biomarkers and enhance method robustness against signal fluctuations, resulting in an improved DESI-MS method of glioma diagnosis.
Collapse
Affiliation(s)
- Rong Chen
- Department of Chemistry, Purdue University, 560 Oval Drive, West Lafayette, IN, 47907-2084, USA
| | - Hannah Marie Brown
- Department of Chemistry, Purdue University, 560 Oval Drive, West Lafayette, IN, 47907-2084, USA
| | - R Graham Cooks
- Department of Chemistry, Purdue University, 560 Oval Drive, West Lafayette, IN, 47907-2084, USA.
| |
Collapse
|
275
|
Li Z, Li Z, Chen Q, Ramos A, Zhang J, Boudreaux JP, Thiagarajan R, Bren-Mattison Y, Dunham ME, McWhorter AJ, Li X, Feng JM, Li Y, Yao S, Xu J. Detection of pancreatic cancer by convolutional-neural-network-assisted spontaneous Raman spectroscopy with critical feature visualization. Neural Netw 2021; 144:455-464. [PMID: 34583101 DOI: 10.1016/j.neunet.2021.09.006] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2021] [Revised: 08/23/2021] [Accepted: 09/03/2021] [Indexed: 02/02/2023]
Abstract
Pancreatic cancer is the deadliest cancer type with a five-year survival rate of less than 9%. Detection of tumor margins plays an essential role in the success of surgical resection. However, histopathological assessment is time-consuming, expensive, and labor-intensive. We constructed a lab-designed, hand-held Raman spectroscopic system that could enable intraoperative tissue diagnosis using convolutional neural network (CNN) models to efficiently distinguish between cancerous and normal pancreatic tissue. To our best knowledge, this is the first reported effort to diagnose pancreatic cancer by CNN-aided spontaneous Raman scattering with a lab-developed system designed for intraoperative applications. Classification based on the original one-dimensional (1D) Raman, two-dimensional (2D) Raman images, and the first principal component (PC1) from the principal component analysis on the 2D image, could all achieve high performance: the testing sensitivity, specificity, and accuracy were over 95%, and the area under the curve approached 0.99. Although CNN models often show great success in classification, it has always been challenging to visualize the CNN features in these models, which has never been achieved in the Raman spectroscopy application in cancer diagnosis. By studying individual Raman regions and by extracting and visualizing CNN features from max-pooling layers, we identified critical Raman peaks that could aid in the classification of cancerous and noncancerous tissues. 2D Raman PC1 yielded more critical peaks for pancreatic cancer identification than that of 1D Raman, as the Raman intensity was amplified by 2D Raman PC1. To our best knowledge, the feature visualization was achieved for the first time in the field of CNN-aided spontaneous Raman spectroscopy for cancer diagnosis. Based on these CNN feature peaks and their frequency at specific wavenumbers, pancreatic cancerous tissue was found to contain more biochemical components related to the protein contents (particularly collagen), whereas normal pancreatic tissue was found to contain more lipids and nucleic acid (particularly deoxyribonucleic acid/ribonucleic acid). Overall, the CNN model in combination with Raman spectroscopy could serve as a useful tool for the extraction of key features that can help differentiate pancreatic cancer from a normal pancreas.
Collapse
Affiliation(s)
- Zhongqiang Li
- Division of Electrical and Computer Engineering, College of Engineering, Louisiana State University, Baton Rouge, LA 70803, USA
| | - Zheng Li
- Division of Electrical and Computer Engineering, College of Engineering, Louisiana State University, Baton Rouge, LA 70803, USA
| | - Qing Chen
- Division of Computer Science & Engineering, College of Engineering, Louisiana State University, Baton Rouge, LA 70803, USA
| | - Alexandra Ramos
- Department of Comparative Biomedical Science, School of Veterinary Medicine, Louisiana State University, Baton Rouge, LA 70803, USA
| | - Jian Zhang
- Division of Computer Science & Engineering, College of Engineering, Louisiana State University, Baton Rouge, LA 70803, USA
| | - J Philip Boudreaux
- Department of Surgery, School of Medicine, Louisiana State University Health Science Center, New Orleans, LA 70112, USA
| | - Ramcharan Thiagarajan
- Department of Surgery, School of Medicine, Louisiana State University Health Science Center, New Orleans, LA 70112, USA
| | - Yvette Bren-Mattison
- Department of Surgery, School of Medicine, Louisiana State University Health Science Center, New Orleans, LA 70112, USA
| | - Michael E Dunham
- Department of Otolaryngology, School of Medicine, Louisiana State University Health Science Center, New Orleans, LA 70112, USA
| | - Andrew J McWhorter
- Department of Otolaryngology, School of Medicine, Louisiana State University Health Science Center, New Orleans, LA 70112, USA
| | - Xin Li
- Division of Electrical and Computer Engineering, College of Engineering, Louisiana State University, Baton Rouge, LA 70803, USA
| | - Ji-Ming Feng
- Department of Comparative Biomedical Science, School of Veterinary Medicine, Louisiana State University, Baton Rouge, LA 70803, USA
| | - Yanping Li
- School of Environment and Sustainability, University of Saskatchewan, Saskatoon, SK S7N 5C9, Canada
| | - Shaomian Yao
- Department of Comparative Biomedical Science, School of Veterinary Medicine, Louisiana State University, Baton Rouge, LA 70803, USA
| | - Jian Xu
- Division of Electrical and Computer Engineering, College of Engineering, Louisiana State University, Baton Rouge, LA 70803, USA.
| |
Collapse
|
276
|
Neurosurgical Advances for Malignant Gliomas: Intersection of Biology and Technology. ACTA ACUST UNITED AC 2021; 27:364-370. [PMID: 34570450 DOI: 10.1097/ppo.0000000000000548] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
ABSTRACT The intersection of biology and technology has led to many advancements for the field of neurosurgery. Molecular developments have led to the identification of specific mutations, allowing for more accurate discussions in regard to prognosis and treatment effect. Even amid the progress from basic science benchwork, malignant gliomas continue to have a bleak natural history in lieu of the resistance to chemotherapy and the diffuse nature of the disease, leaving room for further research to discover more effective treatment modalities. Novel imaging methods, including the emerging field of radiogenomics, involve the merging of molecular and radiographic data, enabling earlier, detailed molecular diagnoses and improved surveillance of this pathology. Furthermore, surgical advancements have led to safer and more extensive resections. This review aims to delineate the various advancements in the many facets that are used daily in the care of our glioma population, specifically pertaining to its biology, imaging modalities, and perioperative adjuncts used in the operating room.
Collapse
|
277
|
Accurate diagnosis of lung tissues for 2D Raman spectrogram by deep learning based on short-time Fourier transform. Anal Chim Acta 2021; 1179:338821. [PMID: 34535256 DOI: 10.1016/j.aca.2021.338821] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Revised: 06/29/2021] [Accepted: 06/30/2021] [Indexed: 02/06/2023]
Abstract
Multivariate statistical analysis methods have an important role in spectrochemical analyses to rapidly identify and diagnose cancer and the subtype. However, utilizing these methods to analyze lager amount spectral data is challenging, and poses a major bottleneck toward achieving high accuracy. Here, a new convolutional neural networks (CNN) method based on short-time Fourier transform (STFT) to diagnose lung tissues via Raman spectra readily is proposed. The models yield that the accuracies of the new method are higher than the conventional methods (principal components analysis -linear discriminant analysis and support vector machine) for validation group (95.2% vs 85.5%, 94.4%) and test group (96.5% vs 90.4%, 93.9%) after cross-validation. The results illustrate that the new method which converts one-dimensional Raman data into two-dimensional Raman spectrograms improve the discriminatory ability of lung tissues and can achieve automatically accurate diagnosis of lung tissues.
Collapse
|
278
|
Tariciotti L, Palmisciano P, Giordano M, Remoli G, Lacorte E, Bertani G, Locatelli M, Dimeco F, Caccavella VM, Prada F. Artificial intelligence-enhanced intraoperative neurosurgical workflow: state of the art and future perspectives. J Neurosurg Sci 2021; 66:139-150. [PMID: 34545735 DOI: 10.23736/s0390-5616.21.05483-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
BACKGROUND Artificial Intelligence (AI) and Machine Learning (ML) augment decision-making processes and productivity by supporting surgeons over a range of clinical activities: from diagnosis and preoperative planning to intraoperative surgical assistance. We reviewed the literature to identify current AI platforms applied to neurosurgical perioperative and intraoperative settings and describe their role in multiple subspecialties. METHODS A systematic review of the literature was conducted following the PRISMA guidelines. PubMed, EMBASE, and Scopus databases were searched from inception to December 31, 2020. Original articles were included if they: presented AI platforms implemented in perioperative, intraoperative settings and reported ML models' performance metrics. Due to the heterogeneity in neurosurgical applications, a qualitative synthesis was deemed appropriate. The risk of bias and applicability of predicted outcomes were assessed using the PROBAST tool. RESULTS 41 articles were included. All studies evaluated a supervised learning algorithm. A total of 10 ML models were described; the most frequent were neural networks (n = 15) and tree-based models (n = 13). Overall, the risk of bias was medium-high, but applicability was considered positive for all studies. Articles were grouped into 4 categories according to the subspecialty of interest: neuro-oncology, spine, functional and other. For each category, different prediction tasks were identified. CONCLUSIONS In this review, we summarize the state-of-art applications of AI for the intraoperative augmentation of neurosurgical workflows across multiple subspecialties. ML models may boost surgical team performances by reducing human errors and providing patient-tailored surgical plans, but further and higher-quality studies need to be conducted.
Collapse
Affiliation(s)
- Leonardo Tariciotti
- Unit of Neurosurgery, Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, Milan, Italy.,Department of Oncology and Hemato-Oncology, University of Milan, Milan, Italy.,NEVRALIS, Milan, Italy
| | - Paolo Palmisciano
- NEVRALIS, Milan, Italy.,Department of Neurosurgery, Trauma, Gamma Knife Center Cannizzaro Hospital, Catania, Italy
| | - Martina Giordano
- NEVRALIS, Milan, Italy.,Department of Neurosurgery, Fondazione Policlinico Universitario A Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy
| | - Giulia Remoli
- NEVRALIS, Milan, Italy.,National Center for Disease Prevention and Health Promotion, Italian National Institute of Health, Rome, Italy
| | - Eleonora Lacorte
- National Center for Disease Prevention and Health Promotion, Italian National Institute of Health, Rome, Italy
| | - Giulio Bertani
- Unit of Neurosurgery, Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, Milan, Italy
| | - Marco Locatelli
- Unit of Neurosurgery, Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, Milan, Italy.,Department of Pathophysiology and Transplantation, University of Milan, Milan, Italy.,Aldo Ravelli Research Center for Neurotechnology and Experimental Brain Therapeutics, University of Milan, Milan, Italy
| | - Francesco Dimeco
- Department of Neurosurgery, Fondazione IRCCS Istituto Neurologico C. Besta, Milan, Italy
| | - Valerio M Caccavella
- NEVRALIS, Milan, Italy - .,Department of Neurosurgery, Fondazione Policlinico Universitario A Gemelli IRCCS, Università Cattolica del Sacro Cuore, Rome, Italy
| | - Francesco Prada
- Department of Neurosurgery, Fondazione IRCCS Istituto Neurologico C. Besta, Milan, Italy.,Department of Neurological Surgery, University of Virginia Health Science Center, Charlottesville, VA, USA
| |
Collapse
|
279
|
Xing P, Dong J, Yu P, Zheng H, Liu X, Hu S, Zhu Z. Quantitative analysis of lithium in brine by laser-induced breakdown spectroscopy based on convolutional neural network. Anal Chim Acta 2021; 1178:338799. [PMID: 34482868 DOI: 10.1016/j.aca.2021.338799] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2021] [Revised: 05/27/2021] [Accepted: 06/15/2021] [Indexed: 12/22/2022]
Abstract
In this study, a simple and effective method for accurate determination of lithium in brine samples was developed by the combination of laser induced breakdown spectroscopy (LIBS) and convolutional neural network (CNN). Our results clearly demonstrate that the use of CNN could efficiently overcome the complex matrix effects, and thus allows for on-site Li quantitative determination in brine samples by LIBS. Specifically, two CNN models with different input data (M-CNN with matrix emission lines, and DP-CNN with double Li lines) were constructed based on the primary matrix features on spectrum and Boltzmann equation, respectively. It was observed that DP-CNN model could greatly improve the accuracy of Li analysis. We also compared the quantitative analysis capabilities of DP-CNN model with partial least squares regression (PLSR) and principal component analysis-support vector regression (PCA-SVR) model, and the results clearly showed DP-CNN offers the best quantification results (higher accuracy and less matrix interference). Finally, five real brine samples were successfully analyzed by the proposed DP-CNN model, confirming by the average absolute error of the prediction of 0.28 mg L-1 and the average relative error of 3.48%. These results clearly demonstrate that input data plays an important role in the training of CNN model in LIBS analysis, and the proposed DP-CNN provides an effective approach to solve the matrix effects encountered in LIBS for Li measurement in brine samples.
Collapse
Affiliation(s)
- Pengju Xing
- State Key Laboratory of Biogeology and Environmental Geology, School of Earth Sciences, China University of Geosciences, Wuhan, Hubei, 430078, China
| | - Junhang Dong
- State Key Laboratory of Biogeology and Environmental Geology, School of Earth Sciences, China University of Geosciences, Wuhan, Hubei, 430078, China; Faculty of Material Science and Chemistry, China University of Geosciences, Wuhan, Hubei, 430078, China
| | - Peiwen Yu
- State Key Laboratory of Biogeology and Environmental Geology, School of Earth Sciences, China University of Geosciences, Wuhan, Hubei, 430078, China
| | - Hongtao Zheng
- Faculty of Material Science and Chemistry, China University of Geosciences, Wuhan, Hubei, 430078, China
| | - Xing Liu
- State Key Laboratory of Biogeology and Environmental Geology, School of Earth Sciences, China University of Geosciences, Wuhan, Hubei, 430078, China
| | - Shenghong Hu
- State Key Laboratory of Biogeology and Environmental Geology, School of Earth Sciences, China University of Geosciences, Wuhan, Hubei, 430078, China
| | - Zhenli Zhu
- State Key Laboratory of Biogeology and Environmental Geology, School of Earth Sciences, China University of Geosciences, Wuhan, Hubei, 430078, China; Faculty of Material Science and Chemistry, China University of Geosciences, Wuhan, Hubei, 430078, China.
| |
Collapse
|
280
|
Singh A, Sharma A, Ahmed A, Sundramoorthy AK, Furukawa H, Arya S, Khosla A. Recent Advances in Electrochemical Biosensors: Applications, Challenges, and Future Scope. BIOSENSORS 2021; 11:336. [PMID: 34562926 PMCID: PMC8472208 DOI: 10.3390/bios11090336] [Citation(s) in RCA: 154] [Impact Index Per Article: 38.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/24/2021] [Revised: 08/25/2021] [Accepted: 08/31/2021] [Indexed: 05/11/2023]
Abstract
The electrochemical biosensors are a class of biosensors which convert biological information such as analyte concentration that is a biological recognition element (biochemical receptor) into current or voltage. Electrochemical biosensors depict propitious diagnostic technology which can detect biomarkers in body fluids such as sweat, blood, feces, or urine. Combinations of suitable immobilization techniques with effective transducers give rise to an efficient biosensor. They have been employed in the food industry, medical sciences, defense, studying plant biology, etc. While sensing complex structures and entities, a large data is obtained, and it becomes difficult to manually interpret all the data. Machine learning helps in interpreting large sensing data. In the case of biosensors, the presence of impurity affects the performance of the sensor and machine learning helps in removing signals obtained from the contaminants to obtain a high sensitivity. In this review, we discuss different types of biosensors along with their applications and the benefits of machine learning. This is followed by a discussion on the challenges, missing gaps in the knowledge, and solutions in the field of electrochemical biosensors. This review aims to serve as a valuable resource for scientists and engineers entering the interdisciplinary field of electrochemical biosensors. Furthermore, this review provides insight into the type of electrochemical biosensors, their applications, the importance of machine learning (ML) in biosensing, and challenges and future outlook.
Collapse
Affiliation(s)
- Anoop Singh
- Department of Physics, University of Jammu, Jammu 180006, India; (A.S.); (A.S.); (A.A.)
| | - Asha Sharma
- Department of Physics, University of Jammu, Jammu 180006, India; (A.S.); (A.S.); (A.A.)
| | - Aamir Ahmed
- Department of Physics, University of Jammu, Jammu 180006, India; (A.S.); (A.S.); (A.A.)
| | - Ashok K. Sundramoorthy
- Department of Chemistry, SRM Institute of Science and Technology, Kattankulathur 603203, India;
| | - Hidemitsu Furukawa
- Department of Mechanical System Engineering, Graduate School of Science and Engineering, Yamagata University, Yamagata 992-8510, Japan;
| | - Sandeep Arya
- Department of Physics, University of Jammu, Jammu 180006, India; (A.S.); (A.S.); (A.A.)
| | - Ajit Khosla
- Department of Mechanical System Engineering, Graduate School of Science and Engineering, Yamagata University, Yamagata 992-8510, Japan;
| |
Collapse
|
281
|
Lin P, Chen WT, Yousef KMA, Marchioni J, Zhu A, Capasso F, Cheng JX. Coherent Raman scattering imaging with a near-infrared achromatic metalens. APL PHOTONICS 2021; 6:096107. [PMID: 34553044 PMCID: PMC8442248 DOI: 10.1063/5.0059874] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/13/2021] [Accepted: 08/24/2021] [Indexed: 06/13/2023]
Abstract
Miniature handheld imaging devices and endoscopes based on coherent Raman scattering are promising for label-free in vivo optical diagnosis. Toward the development of these small-scale systems, a challenge arises from the design and fabrication of achromatic and high-end miniature optical components for both pump and Stokes laser wavelengths. Here, we report a metasurface converting a low-cost plano-convex lens into a water-immersion, nearly diffraction-limited and achromatic lens. The metasurface comprising amorphous silicon nanopillars is designed in a way that all incident rays arrive at the focus with the same phase and group delay, leading to corrections of monochromatic and chromatic aberrations of the refractive lens, respectively. Compared to the case without the metasurface, the hybrid metasurface-refractive lens has higher Strehl ratios than the plano-convex lens and a tighter depth of focus. The hybrid metasurface-refractive lens is utilized in spectroscopic stimulated Raman scattering and coherent anti-Stokes Raman scattering imaging for the differentiation of two different polymer microbeads. Subsequently, the hybrid metalens is harnessed for volumetric coherent Raman scattering imaging of bead and tissue samples. Finally, we discuss possible approaches to integrate such hybrid metalens in a miniature scanning system for label-free coherent Raman scattering endoscopes.
Collapse
Affiliation(s)
- Peng Lin
- Department of Electrical and Computer Engineering, Boston University, Boston, Massachusetts 02215, USA
| | - Wei Ting Chen
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, Massachusetts 02138, USA
| | | | | | - Alexander Zhu
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, Massachusetts 02138, USA
| | - Federico Capasso
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, Massachusetts 02138, USA
| | - Ji-Xin Cheng
- Authors to whom correspondence should be addressed: and
| |
Collapse
|
282
|
Chen Z, Yu W, Wong IHM, Wong TTW. Deep-learning-assisted microscopy with ultraviolet surface excitation for rapid slide-free histological imaging. BIOMEDICAL OPTICS EXPRESS 2021; 12:5920-5938. [PMID: 34692225 PMCID: PMC8515972 DOI: 10.1364/boe.433597] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Revised: 07/15/2021] [Accepted: 08/03/2021] [Indexed: 05/08/2023]
Abstract
Histopathological examination of tissue sections is the gold standard for disease diagnosis. However, the conventional histopathology workflow requires lengthy and laborious sample preparation to obtain thin tissue slices, causing about a one-week delay to generate an accurate diagnostic report. Recently, microscopy with ultraviolet surface excitation (MUSE), a rapid and slide-free imaging technique, has been developed to image fresh and thick tissues with specific molecular contrast. Here, we propose to apply an unsupervised generative adversarial network framework to translate colorful MUSE images into Deep-MUSE images that highly resemble hematoxylin and eosin staining, allowing easy adaptation by pathologists. By eliminating the needs of all sample processing steps (except staining), a MUSE image with subcellular resolution for a typical brain biopsy (5 mm × 5 mm) can be acquired in 5 minutes, which is further translated into a Deep-MUSE image in 40 seconds, simplifying the standard histopathology workflow dramatically and providing histological images intraoperatively.
Collapse
Affiliation(s)
- Zhenghui Chen
- Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| | - Wentao Yu
- Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| | - Ivy H. M. Wong
- Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| | - Terence T. W. Wong
- Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| |
Collapse
|
283
|
Faust K, Roohi A, Leon AJ, Leroux E, Dent A, Evans AJ, Pugh TJ, Kalimuthu SN, Djuric U, Diamandis P. Unsupervised Resolution of Histomorphologic Heterogeneity in Renal Cell Carcinoma Using a Brain Tumor-Educated Neural Network. JCO Clin Cancer Inform 2021; 4:811-821. [PMID: 32946287 DOI: 10.1200/cci.20.00035] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023] Open
Abstract
PURPOSE Applications of deep learning to histopathology have proven capable of expert-level performance, but approaches have largely focused on supervised classification tasks requiring context-specific training and deployment. More generalizable workflows that can be easily shared across subspecialties could help accelerate and broaden adoption. Here, we hypothesized that histology-optimized feature representations, generated by a convolutional neural network (CNN) during supervised learning, are transferable and can resolve meaningful differences in large-scale, discovery-type unsupervised analyses. METHODS We used a CNN, previously trained to recognize brain tumor histomorphologies, to extract 512 feature representations from > 550 digital whole-slide images (WSIs) of renal cell carcinomas (RCCs) from The Cancer Genome Atlas and other previously unencountered tumors. We use these extracted feature vectors to conduct unsupervised image-set clustering and analyze the clinical and biologic relevance of the intra- and interpatient subgroups generated. RESULTS Within individual WSIs, feature-based clustering could reliably segment tumor regions and other relevant histopathologic subpatterns (eg, adenosquamous and poorly differentiated regions). Across the larger RCC cohorts, clustering extracted features generated subgroups enriched for clinically relevant subtypes (eg, papillary RCC) and outcomes (eg, survival). Importantly, individual feature activation mapping highlighted salient subtype-specific patterns and features of malignancies (eg, nuclear grade, sarcomatous change) contributing to subgroupings. Moreover, some proposed clusters were enriched for recurring, human-based RCC-subtype misclassifications. CONCLUSION Our data support that CNNs, pretrained on large histologic datasets, can extend learned representations to novel scenarios and resolve clinically relevant intra- and interpatient tissue-pattern differences without explicit instruction or additional optimization. Repositioning of existing histology-educated networks could provide scalable approaches for image classification, quality assurance, and discovery of unappreciated patterns and subgroups of disease.
Collapse
Affiliation(s)
- Kevin Faust
- Princess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada.,Department of Computer Science, University of Toronto, Toronto, Ontario Canada
| | - Adil Roohi
- Princess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada.,Harvard Extension School, Cambridge, MA
| | - Alberto J Leon
- Ontario Institute for Cancer Research, Toronto, Ontario, Canada
| | - Emeline Leroux
- Laboratory Medicine Program, University Health Network, Toronto, Ontario, Toronto, Canada
| | - Anglin Dent
- Laboratory Medicine Program, University Health Network, Toronto, Ontario, Toronto, Canada
| | - Andrew J Evans
- Laboratory Medicine Program, University Health Network, Toronto, Ontario, Toronto, Canada.,Department of Laboratory Medicine and Pathobiology, University of Toronto, Toronto, Ontario, Canada
| | - Trevor J Pugh
- Princess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada.,Ontario Institute for Cancer Research, Toronto, Ontario, Canada.,Department of Medical Biophysics, University of Toronto, Toronto, Ontario, Canada
| | - Sangeetha N Kalimuthu
- Laboratory Medicine Program, University Health Network, Toronto, Ontario, Toronto, Canada.,Department of Laboratory Medicine and Pathobiology, University of Toronto, Toronto, Ontario, Canada
| | - Ugljesa Djuric
- Princess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada
| | - Phedias Diamandis
- Laboratory Medicine Program, University Health Network, Toronto, Ontario, Toronto, Canada.,Department of Laboratory Medicine and Pathobiology, University of Toronto, Toronto, Ontario, Canada.,Department of Medical Biophysics, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
284
|
Nagy M, Radakovich N, Nazha A. Machine Learning in Oncology: What Should Clinicians Know? JCO Clin Cancer Inform 2021; 4:799-810. [PMID: 32926637 DOI: 10.1200/cci.20.00049] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022] Open
Abstract
The volume and complexity of scientific and clinical data in oncology have grown markedly over recent years, including but not limited to the realms of electronic health data, radiographic and histologic data, and genomics. This growth holds promise for a deeper understanding of malignancy and, accordingly, more personalized and effective oncologic care. Such goals require, however, the development of new methods to fully make use of the wealth of available data. Improvements in computer processing power and algorithm development have positioned machine learning, a branch of artificial intelligence, to play a prominent role in oncology research and practice. This review provides an overview of the basics of machine learning and highlights current progress and challenges in applying this technology to cancer diagnosis, prognosis, and treatment recommendations, including a discussion of current takeaways for clinicians.
Collapse
Affiliation(s)
- Matthew Nagy
- Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, OH
| | - Nathan Radakovich
- Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, OH
| | - Aziz Nazha
- Center for Clinical Artificial Intelligence, Cleveland Clinic, Cleveland, OH.,Department of Hematology and Medical Oncology, Cleveland Clinic, Cleveland, OH
| |
Collapse
|
285
|
Comba A, Faisal SM, Varela ML, Hollon T, Al-Holou WN, Umemura Y, Nunez FJ, Motsch S, Castro MG, Lowenstein PR. Uncovering Spatiotemporal Heterogeneity of High-Grade Gliomas: From Disease Biology to Therapeutic Implications. Front Oncol 2021; 11:703764. [PMID: 34422657 PMCID: PMC8377724 DOI: 10.3389/fonc.2021.703764] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Accepted: 07/19/2021] [Indexed: 12/13/2022] Open
Abstract
Glioblastomas (GBM) are the most common and aggressive tumors of the central nervous system. Rapid tumor growth and diffuse infiltration into healthy brain tissue, along with high intratumoral heterogeneity, challenge therapeutic efficacy and prognosis. A better understanding of spatiotemporal tumor heterogeneity at the histological, cellular, molecular, and dynamic levels would accelerate the development of novel treatments for this devastating brain cancer. Histologically, GBM is characterized by nuclear atypia, cellular pleomorphism, necrosis, microvascular proliferation, and pseudopalisades. At the cellular level, the glioma microenvironment comprises a heterogeneous landscape of cell populations, including tumor cells, non-transformed/reactive glial and neural cells, immune cells, mesenchymal cells, and stem cells, which support tumor growth and invasion through complex network crosstalk. Genomic and transcriptomic analyses of gliomas have revealed significant inter and intratumoral heterogeneity and insights into their molecular pathogenesis. Moreover, recent evidence suggests that diverse dynamics of collective motion patterns exist in glioma tumors, which correlate with histological features. We hypothesize that glioma heterogeneity is not stochastic, but rather arises from organized and dynamic attributes, which favor glioma malignancy and influences treatment regimens. This review highlights the importance of an integrative approach of glioma histopathological features, single-cell and spatially resolved transcriptomic and cellular dynamics to understand tumor heterogeneity and maximize therapeutic effects.
Collapse
Affiliation(s)
- Andrea Comba
- Department of Neurosurgery, University of Michigan Medical School, Ann Arbor, MI, United States.,Department of Cell and Developmental Biology, University of Michigan Medical School, Ann Arbor, MI, United States.,Rogel Cancer Center, University of Michigan Medical School, Ann Arbor, MI, United States
| | - Syed M Faisal
- Department of Neurosurgery, University of Michigan Medical School, Ann Arbor, MI, United States.,Department of Cell and Developmental Biology, University of Michigan Medical School, Ann Arbor, MI, United States.,Rogel Cancer Center, University of Michigan Medical School, Ann Arbor, MI, United States
| | - Maria Luisa Varela
- Department of Neurosurgery, University of Michigan Medical School, Ann Arbor, MI, United States.,Department of Cell and Developmental Biology, University of Michigan Medical School, Ann Arbor, MI, United States.,Rogel Cancer Center, University of Michigan Medical School, Ann Arbor, MI, United States
| | - Todd Hollon
- Department of Neurosurgery, University of Michigan Medical School, Ann Arbor, MI, United States
| | - Wajd N Al-Holou
- Department of Neurosurgery, University of Michigan Medical School, Ann Arbor, MI, United States
| | - Yoshie Umemura
- Department of Neurosurgery, University of Michigan Medical School, Ann Arbor, MI, United States
| | - Felipe J Nunez
- Laboratory of Molecular and Cellular Therapy, Fundación Instituto Leloir, Buenos Aires, Argentina
| | - Sebastien Motsch
- School of Mathematical and Statistical Sciences, Arizona State University, Tempe, AZ, United States
| | - Maria G Castro
- Department of Neurosurgery, University of Michigan Medical School, Ann Arbor, MI, United States.,Department of Cell and Developmental Biology, University of Michigan Medical School, Ann Arbor, MI, United States.,Rogel Cancer Center, University of Michigan Medical School, Ann Arbor, MI, United States
| | - Pedro R Lowenstein
- Department of Neurosurgery, University of Michigan Medical School, Ann Arbor, MI, United States.,Department of Cell and Developmental Biology, University of Michigan Medical School, Ann Arbor, MI, United States.,Rogel Cancer Center, University of Michigan Medical School, Ann Arbor, MI, United States
| |
Collapse
|
286
|
Artificial intelligence for the next generation of precision oncology. NPJ Precis Oncol 2021; 5:79. [PMID: 34408248 PMCID: PMC8373978 DOI: 10.1038/s41698-021-00216-w] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Accepted: 07/21/2021] [Indexed: 12/14/2022] Open
|
287
|
Cen LP, Ji J, Lin JW, Ju ST, Lin HJ, Li TP, Wang Y, Yang JF, Liu YF, Tan S, Tan L, Li D, Wang Y, Zheng D, Xiong Y, Wu H, Jiang J, Wu Z, Huang D, Shi T, Chen B, Yang J, Zhang X, Luo L, Huang C, Zhang G, Huang Y, Ng TK, Chen H, Chen W, Pang CP, Zhang M. Automatic detection of 39 fundus diseases and conditions in retinal photographs using deep neural networks. Nat Commun 2021; 12:4828. [PMID: 34376678 PMCID: PMC8355164 DOI: 10.1038/s41467-021-25138-w] [Citation(s) in RCA: 81] [Impact Index Per Article: 20.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2020] [Accepted: 07/22/2021] [Indexed: 02/05/2023] Open
Abstract
Retinal fundus diseases can lead to irreversible visual impairment without timely diagnoses and appropriate treatments. Single disease-based deep learning algorithms had been developed for the detection of diabetic retinopathy, age-related macular degeneration, and glaucoma. Here, we developed a deep learning platform (DLP) capable of detecting multiple common referable fundus diseases and conditions (39 classes) by using 249,620 fundus images marked with 275,543 labels from heterogenous sources. Our DLP achieved a frequency-weighted average F1 score of 0.923, sensitivity of 0.978, specificity of 0.996 and area under the receiver operating characteristic curve (AUC) of 0.9984 for multi-label classification in the primary test dataset and reached the average level of retina specialists. External multihospital test, public data test and tele-reading application also showed high efficiency for multiple retinal diseases and conditions detection. These results indicate that our DLP can be applied for retinal fundus disease triage, especially in remote areas around the world.
Collapse
Affiliation(s)
- Ling-Ping Cen
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Jie Ji
- Network & Information Centre, Shantou University, Shantou, Guangdong, China
- Shantou University Medical College, Shantou, Guangdong, China
- XuanShi Med Tech (Shanghai) Company Limited, Shanghai, China
| | - Jian-Wei Lin
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Si-Tong Ju
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Hong-Jie Lin
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Tai-Ping Li
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Yun Wang
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Jian-Feng Yang
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Yu-Fen Liu
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Shaoying Tan
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Li Tan
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Dongjie Li
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Yifan Wang
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Dezhi Zheng
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Yongqun Xiong
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Hanfu Wu
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Jingjing Jiang
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Zhenggen Wu
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Dingguo Huang
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Tingkun Shi
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Binyao Chen
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Jianling Yang
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Xiaoling Zhang
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Li Luo
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Chukai Huang
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Guihua Zhang
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Yuqiang Huang
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Tsz Kin Ng
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
- Shantou University Medical College, Shantou, Guangdong, China
- Department of Ophthalmology and Visual Sciences, The Chinese University of Hong Kong, Shatin, Hong Kong
| | - Haoyu Chen
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Weiqi Chen
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
| | - Chi Pui Pang
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China
- Department of Ophthalmology and Visual Sciences, The Chinese University of Hong Kong, Shatin, Hong Kong
| | - Mingzhi Zhang
- Joint Shantou International Eye Centre of Shantou University and The Chinese University of Hong Kong, Shantou, Guangdong, China.
| |
Collapse
|
288
|
Abstract
Neurosurgeons receive extensive and lengthy training to equip themselves with various technical skills, and neurosurgery require a great deal of pre-, intra- and postoperative clinical data collection, decision making, care and recovery. The last decade has seen a significant increase in the importance of artificial intelligence (AI) in neurosurgery. AI can provide a great promise in neurosurgery by complementing neurosurgeons' skills to provide the best possible interventional and noninterventional care for patients by enhancing diagnostic and prognostic outcomes in clinical treatment and help neurosurgeons with decision making during surgical interventions to improve patient outcomes. Furthermore, AI is playing a pivotal role in the production, processing and storage of clinical and experimental data. AI usage in neurosurgery can also reduce the costs associated with surgical care and provide high-quality healthcare to a broader population. Additionally, AI and neurosurgery can build a symbiotic relationship where AI helps to push the boundaries of neurosurgery, and neurosurgery can help AI to develop better and more robust algorithms. This review explores the role of AI in interventional and noninterventional aspects of neurosurgery during pre-, intra- and postoperative care, such as diagnosis, clinical decision making, surgical operation, prognosis, data acquisition, and research within the neurosurgical arena.
Collapse
Affiliation(s)
- Mohammad Mofatteh
- Sir William Dunn School of Pathology, Medical Sciences Division, University of Oxford, South Parks Road, Oxford OX1 3RE, United Kingdom
- Lincoln College, University of Oxford, Turl Street, Oxford OX1 3DR, United Kingdom
| |
Collapse
|
289
|
Eichberg DG, Ivan ME, Komotar RJ. Intraoperative Stimulated Raman Histology for Anterior Skull Base Tumor Margins: Can We Improve Patient Survival and Time to Recurrence? World Neurosurg 2021; 149:265-266. [PMID: 33940674 DOI: 10.1016/j.wneu.2021.03.012] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Affiliation(s)
- Daniel G Eichberg
- Department of Neurosurgery, University of Miami Miller School of Medicine, Miami, USA.
| | - Michael E Ivan
- Department of Neurosurgery, University of Miami Miller School of Medicine, Miami, USA; Sylvestor Comprehensive Cancer Center, Miami, Florida, USA
| | - Ricardo J Komotar
- Department of Neurosurgery, University of Miami Miller School of Medicine, Miami, USA; Sylvestor Comprehensive Cancer Center, Miami, Florida, USA
| |
Collapse
|
290
|
Yu S, Li X, Lu W, Li H, Fu YV, Liu F. Analysis of Raman Spectra by Using Deep Learning Methods in the Identification of Marine Pathogens. Anal Chem 2021; 93:11089-11098. [PMID: 34339167 DOI: 10.1021/acs.analchem.1c00431] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
The need for efficient and accurate identification of pathogens in seafood and the environment has become increasingly urgent, given the current global pandemic. Traditional methods are not only time consuming but also lead to sample wastage. Here, we have proposed two new methods that involve Raman spectroscopy combined with a long short-term memory (LSTM) neural network and compared them with a method using a normal convolutional neural network (CNN). We used eight strains isolated from the marine organism Urechis unicinctus, including four kinds of pathogens. After the models were configured and trained, the LSTM methods that we proposed achieved average isolation-level accuracies exceeding 94%, not only meeting the requirement for identification but also indicating that the proposed methods were faster and more accurate than the normal CNN models. Finally, through a computational approach, we designed a loss function to explore the mechanism reflected by the Raman data, finding the Raman segments that most likely exhibited the characteristics of nucleic acids. These novel experimental results provide insights for developing additional deep learning methods to accurately analyze complex Raman data.
Collapse
Affiliation(s)
- Shixiang Yu
- Key Laboratory of Coastal Biology and Biological Resources Utilization, CAS Key Laboratory of Coastal Environmental Processes and Ecological Remediation, Yantai Institute of Coastal Zone Research, Chinese Academy of Sciences, Yantai 264003, P. R. China.,University of the Chinese Academy of Sciences, Beijing 100049, P. R. China
| | - Xin Li
- Key Laboratory of Coastal Biology and Biological Resources Utilization, CAS Key Laboratory of Coastal Environmental Processes and Ecological Remediation, Yantai Institute of Coastal Zone Research, Chinese Academy of Sciences, Yantai 264003, P. R. China.,University of the Chinese Academy of Sciences, Beijing 100049, P. R. China
| | - Weilai Lu
- State Key Laboratory of Microbial Resources, Institute of Microbiology, Chinese Academy of Sciences, Beijing 100101, P. R. China.,University of the Chinese Academy of Sciences, Beijing 100049, P. R. China
| | - Hanfei Li
- State Key Laboratory of Microbial Resources, Institute of Microbiology, Chinese Academy of Sciences, Beijing 100101, P. R. China.,University of the Chinese Academy of Sciences, Beijing 100049, P. R. China
| | - Yu Vincent Fu
- State Key Laboratory of Microbial Resources, Institute of Microbiology, Chinese Academy of Sciences, Beijing 100101, P. R. China.,University of the Chinese Academy of Sciences, Beijing 100049, P. R. China
| | - Fanghua Liu
- Key Laboratory of Coastal Biology and Biological Resources Utilization, CAS Key Laboratory of Coastal Environmental Processes and Ecological Remediation, Yantai Institute of Coastal Zone Research, Chinese Academy of Sciences, Yantai 264003, P. R. China.,National-Regional Joint Engineering Research Center for Soil Pollution Control and Remediation in South China, Guangdong Key Laboratory of Integrated Agro-environmental Pollution Control and Management, Institute of Eco-environmental and Soil Sciences, Guangdong Academy of Sciences, Guangzhou 510650, P. R. China
| |
Collapse
|
291
|
Rapoport BI, McDermott MW, Schwartz TH. Letter to the Editor. Time to move beyond the Simpson scale in meningioma surgery. J Neurosurg 2021; 135:661-662. [PMID: 33607616 DOI: 10.3171/2020.12.jns204213] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Affiliation(s)
| | - Michael W McDermott
- 2Herbert Wertheim College of Medicine, Florida International University, Miami, FL
| | | |
Collapse
|
292
|
Livermore LJ, Isabelle M, Bell IM, Edgar O, Voets NL, Stacey R, Ansorge O, Vallance C, Plaha P. Raman spectroscopy to differentiate between fresh tissue samples of glioma and normal brain: a comparison with 5-ALA-induced fluorescence-guided surgery. J Neurosurg 2021; 135:469-479. [PMID: 33007757 DOI: 10.3171/2020.5.jns20376] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Accepted: 05/22/2020] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Raman spectroscopy is a biophotonic tool that can be used to differentiate between different tissue types. It is nondestructive and no sample preparation is required. The aim of this study was to evaluate the ability of Raman spectroscopy to differentiate between glioma and normal brain when using fresh biopsy samples and, in the case of glioblastomas, to compare the performance of Raman spectroscopy to predict the presence or absence of tumor with that of 5-aminolevulinic acid (5-ALA)-induced fluorescence. METHODS A principal component analysis (PCA)-fed linear discriminant analysis (LDA) machine learning predictive model was built using Raman spectra, acquired ex vivo, from fresh tissue samples of 62 patients with glioma and 11 glioma-free brain samples from individuals undergoing temporal lobectomy for epilepsy. This model was then used to classify Raman spectra from fresh biopsies from resection cavities after functional guided, supramaximal glioma resection. In cases of glioblastoma, 5-ALA-induced fluorescence at the resection cavity biopsy site was recorded, and this was compared with the Raman spectral model prediction for the presence of tumor. RESULTS The PCA-LDA predictive model demonstrated 0.96 sensitivity, 0.99 specificity, and 0.99 accuracy for differentiating tumor from normal brain. Twenty-three resection cavity biopsies were taken from 8 patients after supramaximal resection (6 glioblastomas, 2 oligodendrogliomas). Raman spectroscopy showed 1.00 sensitivity, 1.00 specificity, and 1.00 accuracy for predicting tumor versus normal brain in these samples. In the glioblastoma cases, where 5-ALA-induced fluorescence was used, the performance of Raman spectroscopy was significantly better than the predictive value of 5-ALA-induced fluorescence, which showed 0.07 sensitivity, 1.00 specificity, and 0.24 accuracy (p = 0.0009). CONCLUSIONS Raman spectroscopy can accurately classify fresh tissue samples into tumor versus normal brain and is superior to 5-ALA-induced fluorescence. Raman spectroscopy could become an important intraoperative tool used in conjunction with 5-ALA-induced fluorescence to guide extent of resection in glioma surgery.
Collapse
Affiliation(s)
- Laurent J Livermore
- 1Nuffield Department of Clinical Neurosciences, and
- 3Department of Neurosurgery, Oxford University Hospitals NHS Foundation Trust, Oxford
| | - Martin Isabelle
- 4Renishaw plc, Spectroscopy Products Division, Gloucestershire
| | - Ian M Bell
- 4Renishaw plc, Spectroscopy Products Division, Gloucestershire
| | - Oliver Edgar
- 1Nuffield Department of Clinical Neurosciences, and
| | - Natalie L Voets
- 2Nuffield Department of Surgery, University of Oxford, John Radcliffe Hospital, Oxford
- 6FMRIB Centre, Nuffield Department of Clinical Neurosciences, University of Oxford, John Radcliffe Hospital, Oxford, United Kingdom
| | - Richard Stacey
- 3Department of Neurosurgery, Oxford University Hospitals NHS Foundation Trust, Oxford
| | - Olaf Ansorge
- 1Nuffield Department of Clinical Neurosciences, and
| | | | - Puneet Plaha
- 2Nuffield Department of Surgery, University of Oxford, John Radcliffe Hospital, Oxford
- 3Department of Neurosurgery, Oxford University Hospitals NHS Foundation Trust, Oxford
| |
Collapse
|
293
|
Peng F, Jeong S, Ho A, Evans CL. Recent progress in plasmonic nanoparticle-based biomarker detection and cytometry for the study of central nervous system disorders. Cytometry A 2021; 99:1067-1078. [PMID: 34328262 DOI: 10.1002/cyto.a.24489] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Revised: 05/28/2021] [Accepted: 07/19/2021] [Indexed: 11/07/2022]
Abstract
Neurological disorders affect hundreds of millions of people around the world, are often life-threatening, untreatable, and can result in debilitating symptoms. The high prevalence of these disorders, which feature biochemical or structural abnormalities in neuronal systems, has spurned innovations in both rapid and early detection to assist in the selection of appropriate treatment strategies to improve the patients' quality of life. Plasmonic nanoparticles (PNPs), a versatile and promising class of nanomaterials, are widely utilized in numerous imaging techniques, drug delivery systems, and biomarker detection methods. Recently, PNP-based nanoprobes have attracted considerable attention for the early diagnosis of neurological disorders. Gold nanoparticles (AuNPs), with high local surface plasmon resonance (LSPR) signals, have been particularly well exploited as probes for dynamic biomarker detection, with quantification sensitivity demonstrated down to the single-molecule level. In this review, we will discuss the possibilities of PNPs in the methodological development for rapid neurological disease identification. In addition, we will also describe a new digital cytometry method that combines dark-field imaging and machine learning for precise biomarker enumeration on single cells. The aim of this review is to attract researchers working on the future development of new plasmonic nanoprobe-based strategies for the diagnosis of neurological disorders.
Collapse
Affiliation(s)
- Fei Peng
- Wellman Center for Photomedicine, Massachusetts General Hospital, Harvard Medical School, Charlestown, Massachusetts, USA
| | - Sinyoung Jeong
- Wellman Center for Photomedicine, Massachusetts General Hospital, Harvard Medical School, Charlestown, Massachusetts, USA
| | - Alexander Ho
- Wellman Center for Photomedicine, Massachusetts General Hospital, Harvard Medical School, Charlestown, Massachusetts, USA
| | - Conor L Evans
- Wellman Center for Photomedicine, Massachusetts General Hospital, Harvard Medical School, Charlestown, Massachusetts, USA
| |
Collapse
|
294
|
Chirizzi C, Morasso C, Caldarone AA, Tommasini M, Corsi F, Chaabane L, Vanna R, Bombelli FB, Metrangolo P. A Bioorthogonal Probe for Multiscale Imaging by 19F-MRI and Raman Microscopy: From Whole Body to Single Cells. J Am Chem Soc 2021; 143:12253-12260. [PMID: 34320323 PMCID: PMC8397317 DOI: 10.1021/jacs.1c05250] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
![]()
Molecular imaging
techniques are essential tools for better investigating
biological processes and detecting disease biomarkers with improvement
of both diagnosis and therapy monitoring. Often, a single imaging
technique is not sufficient to obtain comprehensive information at
different levels. Multimodal diagnostic probes are key tools to enable
imaging across multiple scales. The direct registration of in vivo imaging markers with ex vivo imaging
at the cellular level with a single probe is still challenging. Fluorinated
(19F) probes have been increasingly showing promising potentialities
for in vivo cell tracking by 19F-MRI.
Here we present the unique features of a bioorthogonal 19F-probe that enables direct signal correlation of MRI with Raman
imaging. In particular, we reveal the ability of PERFECTA, a superfluorinated
molecule, to exhibit a remarkable intense Raman signal distinct from
cell and tissue fingerprints. Therefore, PERFECTA combines in a single
molecule excellent characteristics for both macroscopic in
vivo19F-MRI, across the whole body, and microscopic
imaging at tissue and cellular levels by Raman imaging.
Collapse
Affiliation(s)
- Cristina Chirizzi
- Laboratory of Supramolecular and Bio-Nanomaterials (SupraBioNanoLab), Department of Chemistry, Materials, and Chemical Engineering "Giulio Natta", Politecnico di Milano, Via Luigi Mancinelli 7, 20131 Milan, Italy
| | - Carlo Morasso
- Istituti Clinici Scientifici Maugeri IRCCS, Via S. Maugeri 4, 27100 Pavia, Italy
| | | | - Matteo Tommasini
- Department of Chemistry, Materials, and Chemical Engineering "Giulio Natta", Politecnico di Milano, Via Luigi Mancinelli 7, 20131 Milan, Italy
| | - Fabio Corsi
- Istituti Clinici Scientifici Maugeri IRCCS, Via S. Maugeri 4, 27100 Pavia, Italy.,Department of Biomedical and Clinical Sciences "Luigi Sacco", Università di Milano, Via G. B. Grassi 74, 20157 Milan, Italy
| | - Linda Chaabane
- Experimental Neurology (INSPE) and Experimental Imaging Center (CIS), Neuroscience Division, IRCCS Ospedale San Raffaele, Via Olgettina 60, 20132 Milan, Italy
| | - Renzo Vanna
- CNR-Institute for Photonics and Nanotechnologies (IFN-CNR), Department of Physics, Politecnico di Milano, Piazza Leonardo Da Vinci 32, 20133 Milan, Italy
| | - Francesca Baldelli Bombelli
- Laboratory of Supramolecular and Bio-Nanomaterials (SupraBioNanoLab), Department of Chemistry, Materials, and Chemical Engineering "Giulio Natta", Politecnico di Milano, Via Luigi Mancinelli 7, 20131 Milan, Italy
| | - Pierangelo Metrangolo
- Laboratory of Supramolecular and Bio-Nanomaterials (SupraBioNanoLab), Department of Chemistry, Materials, and Chemical Engineering "Giulio Natta", Politecnico di Milano, Via Luigi Mancinelli 7, 20131 Milan, Italy
| |
Collapse
|
295
|
Abstract
Measurement of biological systems containing biomolecules and bioparticles is a key task in the fields of analytical chemistry, biology, and medicine. Driven by the complex nature of biological systems and unprecedented amounts of measurement data, artificial intelligence (AI) in measurement science has rapidly advanced from the use of silicon-based machine learning (ML) for data mining to the development of molecular computing with improved sensitivity and accuracy. This review presents an overview of fundamental ML methodologies and discusses their applications in disease diagnostics, biomarker discovery, and imaging analysis. We next provide the working principles of molecular computing using logic gates and arithmetical devices, which can be employed for in situ detection, computation, and signal transduction for biological systems. This review concludes by summarizing the strengths and limitations of AI-involved biological measurement in fundamental and applied research.
Collapse
Affiliation(s)
- Chao Liu
- CAS Key Laboratory of Standardization and Measurement for Nanotechnology, CAS Center for Excellence in Nanoscience, National Center for Nanoscience and Technology, Beijing 100190, China;
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Jiashu Sun
- CAS Key Laboratory of Standardization and Measurement for Nanotechnology, CAS Center for Excellence in Nanoscience, National Center for Nanoscience and Technology, Beijing 100190, China;
- University of Chinese Academy of Sciences, Beijing 100049, China
| |
Collapse
|
296
|
Chen J, Lu C, Huang H, Zhu D, Yang Q, Liu J, Huang Y, Deng A, Han X. Cognitive Computing-Based CDSS in Medical Practice. HEALTH DATA SCIENCE 2021; 2021:9819851. [PMID: 38487503 PMCID: PMC10880153 DOI: 10.34133/2021/9819851] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Accepted: 06/28/2021] [Indexed: 03/17/2024]
Abstract
Importance. The last decade has witnessed the advances of cognitive computing technologies that learn at scale and reason with purpose in medicine studies. From the diagnosis of diseases till the generation of treatment plans, cognitive computing encompasses both data-driven and knowledge-driven machine intelligence to assist health care roles in clinical decision-making. This review provides a comprehensive perspective from both research and industrial efforts on cognitive computing-based CDSS over the last decade.Highlights. (1) A holistic review of both research papers and industrial practice about cognitive computing-based CDSS is conducted to identify the necessity and the characteristics as well as the general framework of constructing the system. (2) Several of the typical applications of cognitive computing-based CDSS as well as the existing systems in real medical practice are introduced in detail under the general framework. (3) The limitations of the current cognitive computing-based CDSS is discussed that sheds light on the future work in this direction.Conclusion. Different from medical content providers, cognitive computing-based CDSS provides probabilistic clinical decision support by automatically learning and inferencing from medical big data. The characteristics of managing multimodal data and computerizing medical knowledge distinguish cognitive computing-based CDSS from other categories. Given the current status of primary health care like high diagnostic error rate and shortage of medical resources, it is time to introduce cognitive computing-based CDSS to the medical community which is supposed to be more open-minded and embrace the convenience and low cost but high efficiency brought by cognitive computing-based CDSS.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | - Aijun Deng
- The Affiliated Hospital of Weifang Medical University, Shandong, China
| | - Xiaoxu Han
- National Clinical Research Center for Laboratory MedicineChina
- The First Affiliated Hospital, China Medical University, Liaoning, China
| |
Collapse
|
297
|
Sarri B, Appay R, Heuke S, Poizat F, Franchi F, Boissonneau S, Caillol F, Dufour H, Figarella‐Branger D, Giovaninni M, Rigneault H. Observation of the compatibility of stimulated Raman histology with pathology workflow and genome sequencing. TRANSLATIONAL BIOPHOTONICS 2021. [DOI: 10.1002/tbio.202000020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022] Open
Affiliation(s)
- Barbara Sarri
- Aix Marseille University CNRS, Centrale Marseille, Institut Fresnel Marseille France
- Lightcore Technologies Cannes France
| | - Romain Appay
- Aix Marseille University CNRS, Centrale Marseille, Institut Fresnel Marseille France
- Aix‐Marseille University APHM, CNRS, INP, Inst Neurophysiopathol, CHU Timone, Service d' Anatomie Pathologique et de Neuropathologie Marseille France
| | - Sandro Heuke
- Aix Marseille University CNRS, Centrale Marseille, Institut Fresnel Marseille France
| | - Flora Poizat
- Institut Paoli‐Calmettes Endoscopy and Gastroenterology Department Marseille France
| | - Florence Franchi
- Institut Paoli‐Calmettes Endoscopy and Gastroenterology Department Marseille France
| | - Sébastien Boissonneau
- Aix‐Marseille University APHM, CNRS, INP, Inst Neurophysiopathol, CHU Timone, Service d' Anatomie Pathologique et de Neuropathologie Marseille France
| | - Fabrice Caillol
- Institut Paoli‐Calmettes Endoscopy and Gastroenterology Department Marseille France
| | - Henry Dufour
- Aix‐Marseille University APHM, CNRS, INP, Inst Neurophysiopathol, CHU Timone, Service d' Anatomie Pathologique et de Neuropathologie Marseille France
| | - Dominique Figarella‐Branger
- Aix‐Marseille University APHM, CNRS, INP, Inst Neurophysiopathol, CHU Timone, Service d' Anatomie Pathologique et de Neuropathologie Marseille France
| | - Marc Giovaninni
- Institut Paoli‐Calmettes Endoscopy and Gastroenterology Department Marseille France
| | - Hervé Rigneault
- Aix Marseille University CNRS, Centrale Marseille, Institut Fresnel Marseille France
- Lightcore Technologies Cannes France
| |
Collapse
|
298
|
Petridis PD, Horenstein C, Pereira B, Wu P, Samanamud J, Marie T, Boyett D, Sudhakar T, Sheth SA, McKhann GM, Sisti MB, Bruce JN, Canoll P, Grinband J. BOLD Asynchrony Elucidates Tumor Burden in IDH-Mutated Gliomas. Neuro Oncol 2021; 24:78-87. [PMID: 34214170 DOI: 10.1093/neuonc/noab154] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023] Open
Abstract
BACKGROUND Gliomas comprise the most common type of primary brain tumor, are highly invasive, and often fatal. IDH-mutated gliomas are particularly challenging to image and there is currently no clinically accepted method for identifying the extent of tumor burden in these neoplasms. This uncertainty poses a challenge to clinicians who must balance the need to treat the tumor while sparing healthy brain from iatrogenic damage. The purpose of this study was to investigate the feasibility of using resting-state blood oxygen level dependent (BOLD) functional magnetic resonance imaging (fMRI) to detect glioma-related asynchrony in vascular dynamics for distinguishing tumor from healthy brain. METHODS Twenty-four stereotactically localized biopsies were obtained during open surgical resection from ten treatment-naïve patients with IDH-mutated gliomas who received standard of care preoperative imaging as well as echo-planar resting-state BOLD fMRI. Signal intensity for BOLD asynchrony and standard of care imaging was compared to cell counts of total cellularity (H&E), tumor density (IDH1 & Sox2), cellular proliferation (Ki67), and neuronal density (NeuN), for each corresponding sample. RESULTS BOLD asynchrony was directly related to total cellularity (H&E, p = 4 x 10 -5), tumor density (IDH1, p = 4 x 10 -5; Sox2, p = 3 x 10 -5), cellular proliferation (Ki67, p = 0.002), and as well as inversely related to neuronal density (NeuN, p = 1 x 10 -4). CONCLUSIONS Asynchrony in vascular dynamics, as measured by resting-state BOLD fMRI, correlates with tumor burden and provides a radiographic delineation of tumor boundaries in IDH-mutated gliomas.
Collapse
Affiliation(s)
- Petros D Petridis
- Vagelos College of Physicians & Surgeons, Columbia University, New York, New York USA.,Department of Psychiatry, New York University, New York, New York, USA
| | - Craig Horenstein
- Department of Radiology, School of Medicine at Hofstra/Northwell, Manhasset, New York USA
| | - Brianna Pereira
- Vagelos College of Physicians & Surgeons, Columbia University, New York, New York USA
| | - Peter Wu
- Vagelos College of Physicians & Surgeons, Columbia University, New York, New York USA
| | - Jorge Samanamud
- Department of Neurological Surgery, Columbia University, New York, New York USA
| | - Tamara Marie
- Department of Pediatrics Oncology, Columbia University, New York, New York USA
| | - Deborah Boyett
- Department of Neurological Surgery, Columbia University, New York, New York USA
| | - Tejaswi Sudhakar
- Department of Neurological Surgery, Columbia University, New York, New York USA
| | - Sameer A Sheth
- Department of Neurological Surgery, Baylor College of Medicine, Houston, Texas, USA
| | - Guy M McKhann
- Department of Neurological Surgery, Columbia University, New York, New York USA
| | - Michael B Sisti
- Department of Neurological Surgery, Columbia University, New York, New York USA
| | - Jeffrey N Bruce
- Department of Neurological Surgery, Columbia University, New York, New York USA
| | - Peter Canoll
- Department of Pathology & Cell Biology, Columbia University, New York, New York USA
| | - Jack Grinband
- Department of Radiology, Columbia University, New York, New York, USA.,Department of Psychiatry, Columbia University, New York, New York, USA
| |
Collapse
|
299
|
Soltani S, Guang Z, Zhang Z, Olson JJ, Robles FE. Label-free detection of brain tumors in a 9L gliosarcoma rat model using stimulated Raman scattering-spectroscopic optical coherence tomography. JOURNAL OF BIOMEDICAL OPTICS 2021; 26:JBO-210043R. [PMID: 34263579 PMCID: PMC8278780 DOI: 10.1117/1.jbo.26.7.076004] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/08/2021] [Accepted: 06/29/2021] [Indexed: 05/22/2023]
Abstract
SIGNIFICANCE In neurosurgery, it is essential to differentiate between tumor and healthy brain regions to maximize tumor resection while minimizing damage to vital healthy brain tissue. However, conventional intraoperative imaging tools used to guide neurosurgery are often unable to distinguish tumor margins, particularly in infiltrative tumor regions and low-grade gliomas. AIM The aim of this work is to assess the feasibility of a label-free molecular imaging tool called stimulated Raman scattering-spectroscopic optical coherence tomography (SRS-SOCT) to differentiate between healthy brain tissue and tumor based on (1) structural biomarkers derived from the decay rate of signals as a function of depth and (2) molecular biomarkers based on relative differences in lipid and protein composition extracted from the SRS signals. APPROACH SRS-SOCT combines the molecular sensitivity of SRS (based on vibrational spectroscopy) with the spatial and spectral multiplexing capabilities of SOCT to enable fast, spatially and spectrally resolved molecular imaging. SRS-SOCT is applied to image a 9L gliosarcoma rat tumor model, a well-characterized model that recapitulates human high-grade gliomas, including high proliferative capability, high vascularization, and infiltration at the margin. Structural and biochemical signatures acquired from SRS-SOCT are extracted to identify healthy and tumor tissues. RESULTS Data show that SRS-SOCT provides light-scattering-based signatures that correlate with the presence of tumors, similar to conventional OCT. Further, nonlinear phase changes from the SRS interaction, as measured with SRS-SOCT, provide an additional measure to clearly separate tumor tissue from healthy brain regions. We also show that the nonlinear phase signals in SRS-SOCT provide a signal-to-noise advantage over the nonlinear amplitude signals for identifying tumors. CONCLUSIONS SRS-SOCT can distinguish both spatial and spectral features that identify tumor regions in the 9L gliosarcoma rat model. This tool provides fast, label-free, nondestructive, and spatially resolved molecular information that, with future development, can potentially assist in identifying tumor margins in neurosurgery.
Collapse
Affiliation(s)
- Soheil Soltani
- Georgia Institute of Technology and Emory University, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
| | - Zhe Guang
- Georgia Institute of Technology and Emory University, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
| | - Zhaobin Zhang
- Emory University, Winship Cancer Institute, Atlanta, Georgia, United States
- Emory University School of Medicine, Department of Neurosurgery, Atlanta, Georgia, United States
| | - Jeffrey J. Olson
- Emory University, Winship Cancer Institute, Atlanta, Georgia, United States
- Emory University School of Medicine, Department of Neurosurgery, Atlanta, Georgia, United States
| | - Francisco E. Robles
- Georgia Institute of Technology and Emory University, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
- Emory University, Winship Cancer Institute, Atlanta, Georgia, United States
- Address all correspondence to Francisco E. Robles,
| |
Collapse
|
300
|
Murphy MP, Brown NM. CORR Synthesis: When Should the Orthopaedic Surgeon Use Artificial Intelligence, Machine Learning, and Deep Learning? Clin Orthop Relat Res 2021; 479:1497-1505. [PMID: 33595930 PMCID: PMC8208440 DOI: 10.1097/corr.0000000000001679] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Accepted: 01/22/2021] [Indexed: 01/31/2023]
Affiliation(s)
- Michael P Murphy
- Department of Orthopaedic Surgery and Rehabilitation, Loyola University Medical Center, Maywood, IL, USA
| | | |
Collapse
|