AI-Assisted In Situ Detection of Human Glioma Infiltration Using a Novel Computational Method for Optical Coherence Tomography

Rapid detection of IDH mutations in gliomas by intraoperative mass spectrometry

The development and performance of two mass spectrometry (MS) workflows for the intraoperative diagnosis of isocitrate dehydrogenase (IDH) mutations in glioma is implemented by independent teams at Mayo Clinic, Jacksonville, and Huashan Hospital, Shanghai. The infiltrative nature of gliomas makes rapid diagnosis necessary to guide the extent of surgical resection of central nervous system (CNS) tumors. The combination of tissue biopsy and MS analysis used here satisfies this requirement. The key feature of both described methods is the use of tandem MS to measure the oncometabolite 2-hydroxyglutarate (2HG) relative to endogenous glutamate (Glu) to characterize the presence of mutant tumor. The experiments i) provide IDH mutation status for individual patients and ii) demonstrate a strong correlation of 2HG signals with tumor infiltration. The measured ratio of 2HG to Glu correlates with IDH-mutant (IDH-mut) glioma (P < 0.0001) in the tumor core data of both teams. Despite using different ionization methods and different mass spectrometers, comparable performance in determining IDH mutations from core tumor biopsies was achieved with sensitivities, specificities, and accuracies all at 100%. None of the 31 patients at Mayo Clinic or the 74 patients at Huashan Hospital were misclassified when analyzing tumor core biopsies. Robustness of the methodology was evaluated by postoperative re-examination of samples. Both teams noted the presence of high concentrations of 2HG at surgical margins, supporting future use of intraoperative MS to monitor for clean surgical margins. The power of MS diagnostics is shown in resolving contradictory clinical features, e.g., in distinguishing gliosis from IDH-mut glioma.

Label-free optical imaging for brain cancer assessment

Advances in label-free optical imaging offer a promising avenue for brain cancer assessment, providing high-resolution, real-time insights without the need for radiation or exogeneous agents. These cost-effective and intricately detailed techniques overcome the limitations inherent in magnetic resonance imaging (MRI), computed tomography (CT), and positron emission tomography (PET) scans by offering superior resolution and more readily accessible imaging options. This comprehensive review explores a variety of such methods, including photoacoustic imaging (PAI), optical coherence tomography (OCT), Raman imaging, and IR microscopy. It focuses on their roles in the detection, diagnosis, and management of brain tumors. By highlighting recent advances in these imaging techniques, the review aims to underscore the importance of label-free optical imaging in enhancing early detection and refining therapeutic strategies for brain cancer.

Optical Methods for Brain Tumor Detection: A Systematic Review

Background: In brain tumor surgery, maximal tumor resection is typically desired. This is complicated by infiltrative tumor cells which cannot be visually distinguished from healthy brain tissue. Optical methods are an emerging field that can potentially revolutionize brain tumor surgery through intraoperative differentiation between healthy and tumor tissues. Methods: This study aimed to systematically explore and summarize the existing literature on the use of Raman Spectroscopy (RS), Hyperspectral Imaging (HSI), Optical Coherence Tomography (OCT), and Diffuse Reflectance Spectroscopy (DRS) for brain tumor detection. MEDLINE, Embase, and Web of Science were searched for studies evaluating the accuracy of these systems for brain tumor detection. Outcome measures included accuracy, sensitivity, and specificity. Results: In total, 44 studies were included, covering a range of tumor types and technologies. Accuracy metrics in the studies ranged between 54 and 100% for RS, 69 and 99% for HSI, 82 and 99% for OCT, and 42 and 100% for DRS. Conclusions: This review provides insightful evidence on the use of optical methods in distinguishing tumor from healthy brain tissue.

Detection of acute and early-delayed radiation-induced changes in the white matter of the rat brain based on numerical processing of optical coherence tomography data

Detection of radiation-induced changes of the brain white matter is important for brain neoplasms repeated surgery. We investigated the influence of irradiation on the scattering properties of the white matter using optical coherence tomography (OCT). Healthy Wistar rats undergone the irradiation of the brain right hemisphere. At seven time points from the irradiation procedure (2-14 weeks), an ex vivo OCT study was performed with subsequent calculation of attenuation coefficient values in the corpus callosum followed by immunohistochemical analysis. As a result, we discovered acute and early-delayed changes characterized by the edema of different severity, accompanied by a statistically significant decrease in attenuation coefficient values. In particular, these changes were found at 2 weeks after irradiation in the irradiated hemisphere, while at 6- and 12-week time points they affected both irradiated and contralateral hemisphere. Thus, radiation-induced changes occurring in white matter during the first 3 months after irradiation can be detected by OCT.

The LMIT: Light-mediated minimally-invasive theranostics in oncology

Minimally-invasive diagnosis and therapy have gradually become the trend and research hotspot of current medical applications. The integration of intraoperative diagnosis and treatment is a development important direction for real-time detection, minimally-invasive diagnosis and therapy to reduce mortality and improve the quality of life of patients, so called minimally-invasive theranostics (MIT). Light is an important theranostic tool for the treatment of cancerous tissues. Light-mediated minimally-invasive theranostics (LMIT) is a novel evolutionary technology that integrates diagnosis and therapeutics for the less invasive treatment of diseased tissues. Intelligent theranostics would promote precision surgery based on the optical characterization of cancerous tissues. Furthermore, MIT also requires the assistance of smart medical devices or robots. And, optical multimodality lay a solid foundation for intelligent MIT. In this review, we summarize the important state-of-the-arts of optical MIT or LMIT in oncology. Multimodal optical image-guided intelligent treatment is another focus. Intraoperative imaging and real-time analysis-guided optical treatment are also systemically discussed. Finally, the potential challenges and future perspectives of intelligent optical MIT are discussed.

Depth-resolved method for attenuation coefficient calculation from optical coherence tomography data for improved biological structure visualization

Optical coherence tomography (OCT) is a promising tool for intraoperative tissue morphology determination. Several studies suggest that attenuation coefficient derived from the OCT images, can differentiate between tissues of different morphology, such as normal and pathological structures of the brain, skin, and other tissues. In the present study, the depth-resolved method for attenuation coefficient calculation was adopted for the real-world situation of the depth-dependent OCT sensitivity and additive imaging noise with nonzero mean. It was shown that in the case of sharp focusing (~10 μm spot full width at half maximum [FWHM] or smaller at 1.3 μm central wavelength) only the proposed method for depth-dependent sensitivity compensation does not introduce misleading artifacts into the calculated attenuation coefficient distribution. At the same time, the scanning beam focus spot with FWHM greater than 10 μm at 1.3 μm central wavelength allows one to use multiple approaches to the attenuation coefficient calculation without introducing noticeable bias. This feature may hinder the need for robust corrections for the depth-resolved attenuation coefficient estimations from the community.

Advances in Intraoperative Glioma Tissue Sampling and Infiltration Assessment

Gliomas are infiltrative brain tumors that often involve functional tissue. While maximal safe resection is critical for maximizing survival, this is challenged by the difficult intraoperative discrimination between tumor-infiltrated and normal structures. Surgical expertise is essential for identifying safe margins, and while the intraoperative pathological review of frozen tissue is possible, this is a time-consuming task. Advances in intraoperative stimulation mapping have aided surgeons in identifying functional structures and, as such, has become the gold standard for this purpose. However, intraoperative margin assessment lacks a similar consensus. Nonetheless, recent advances in intraoperative imaging techniques and tissue examination methods have demonstrated promise for the accurate and efficient assessment of tumor infiltration and margin delineation within the operating room, respectively. In this review, we describe these innovative technologies that neurosurgeons should be aware of.

In situ detection of human glioma based on tissue optical properties using diffuse reflectance spectroscopy

Safely maximizing brain cancer removal without injuring adjacent healthy tissue is crucial for optimal treatment outcomes. However, it is challenging to distinguish cancer from noncancer intraoperatively. This study aimed to explore the feasibility of diffuse reflectance spectroscopy (DRS) as a label-free and real-time detection technology for discrimination between brain cancer and noncancer tissues. Fifty-five fresh cancer and noncancer specimens from 19 brain surgeries were measured with DRS, and the results were compared with co-registered clinical standard histopathology. Tissue optical properties were quantitatively obtained from the diffuse reflectance spectra and compared among different types of brain tissues. A machine learning-based classifier was trained to differentiate cancerous versus noncancerous tissues. Our method could achieve a sensitivity of 93% and specificity of 95% for discriminating high-grade glioma from normal white matter. Our results showed that DRS has the potential to be used for label-free, real-time in vivo cancer detection during brain surgery.

Intra-Operative Definition of Glioma Infiltrative Margins by Visualizing Immunosuppressive Tumor-Associated Macrophages

Accurate delineation of glioma infiltrative margins remains a challenge due to the low density of cancer cells in these regions. Here, a hierarchical imaging strategy to define glioma margins by locating the immunosuppressive tumor-associated macrophages (TAMs) is proposed. A pH ratiometric fluorescent probe CP2-M that targets immunosuppressive TAMs by binding to mannose receptor (CD206) is developed, and it subsequently senses the acidic phagosomal lumen, resulting in a remarkable fluorescence enhancement. With assistance of CP2-M, glioma xenografts in mouse models with a tumor-to-background ratio exceeding 3.0 for up to 6 h are successfully visualized. Furthermore, by intra-operatively mapping the pH distribution of exposed tissue after craniotomy, the glioma allograft in rat models is precisely excised. The overall survival of rat models significantly surpasses that achieved using clinically employed fluorescent probes. This work presents a novel strategy for locating glioma margins, thereby improving surgical outcomes for tumors with infiltrative characteristics.

Artificial Intelligence in Neurosurgery: A State-of-the-Art Review from Past to Future

In recent years, there has been a significant surge in discussions surrounding artificial intelligence (AI), along with a corresponding increase in its practical applications in various facets of everyday life, including the medical industry. Notably, even in the highly specialized realm of neurosurgery, AI has been utilized for differential diagnosis, pre-operative evaluation, and improving surgical precision. Many of these applications have begun to mitigate risks of intraoperative and postoperative complications and post-operative care. This article aims to present an overview of the principal published papers on the significant themes of tumor, spine, epilepsy, and vascular issues, wherein AI has been applied to assess its potential applications within neurosurgery. The method involved identifying high-cited seminal papers using PubMed and Google Scholar, conducting a comprehensive review of various study types, and summarizing machine learning applications to enhance understanding among clinicians for future utilization. Recent studies demonstrate that machine learning (ML) holds significant potential in neuro-oncological care, spine surgery, epilepsy management, and other neurosurgical applications. ML techniques have proven effective in tumor identification, surgical outcomes prediction, seizure outcome prediction, aneurysm prediction, and more, highlighting its broad impact and potential in improving patient management and outcomes in neurosurgery. This review will encompass the current state of research, as well as predictions for the future of AI within neurosurgery.

Multiple therapeutic approaches of glioblastoma multiforme: From terminal to therapy

Glioblastoma multiforme (GBM) is an aggressive brain cancer showing poor prognosis. Currently, treatment methods of GBM are limited with adverse outcomes and low survival rate. Thus, advancements in the treatment of GBM are of utmost importance, which can be achieved in recent decades. However, despite aggressive initial treatment, most patients develop recurrent diseases, and the overall survival rate of patients is impossible to achieve. Currently, researchers across the globe target signaling events along with tumor microenvironment (TME) through different drug molecules to inhibit the progression of GBM, but clinically they failed to demonstrate much success. Herein, we discuss the therapeutic targets and signaling cascades along with the role of the organoids model in GBM research. Moreover, we systematically review the traditional and emerging therapeutic strategies in GBM. In addition, we discuss the implications of nanotechnologies, AI, and combinatorial approach to enhance GBM therapeutics.

Advances in computational and translational approaches for malignant glioma

Gliomas are the most common primary brain tumors in adults and carry a dismal prognosis for patients. Current standard-of-care for gliomas is comprised of maximal safe surgical resection following by a combination of chemotherapy and radiation therapy depending on the grade and type of tumor. Despite decades of research efforts directed towards identifying effective therapies, curative treatments have been largely elusive in the majority of cases. The development and refinement of novel methodologies over recent years that integrate computational techniques with translational paradigms have begun to shed light on features of glioma, previously difficult to study. These methodologies have enabled a number of point-of-care approaches that can provide real-time, patient-specific and tumor-specific diagnostics that may guide the selection and development of therapies including decision-making surrounding surgical resection. Novel methodologies have also demonstrated utility in characterizing glioma-brain network dynamics and in turn early investigations into glioma plasticity and influence on surgical planning at a systems level. Similarly, application of such techniques in the laboratory setting have enhanced the ability to accurately model glioma disease processes and interrogate mechanisms of resistance to therapy. In this review, we highlight representative trends in the integration of computational methodologies including artificial intelligence and modeling with translational approaches in the study and treatment of malignant gliomas both at the point-of-care and outside the operative theater in silico as well as in the laboratory setting.

Emerging role of artificial intelligence in diagnosis, classification and clinical management of glioma

Glioma represents a dominant primary intracranial malignancy in the central nervous system. Artificial intelligence that mainly includes machine learning, and deep learning computational approaches, presents a unique opportunity to enhance clinical management of glioma through improving tumor segmentation, diagnosis, differentiation, grading, treatment, prediction of clinical outcomes (prognosis, and recurrence), molecular features, clinical classification, characterization of the tumor microenvironment, and drug discovery. A growing body of recent studies apply artificial intelligence-based models to disparate data sources of glioma, covering imaging modalities, digital pathology, high-throughput multi-omics data (especially emerging single-cell RNA sequencing and spatial transcriptome), etc. While these early findings are promising, future studies are required to normalize artificial intelligence-based models to improve the generalizability and interpretability of the results. Despite prominent issues, targeted clinical application of artificial intelligence approaches in glioma will facilitate the development of precision medicine of this field. If these challenges can be overcome, artificial intelligence has the potential to profoundly change the way patients with or at risk of glioma are provided with more rational care.

Nondestructive label-free detection of peritumoral white matter damage using cross-polarization optical coherence tomography

Introduction

To improve the quality of brain tumor resections, it is important to differentiate zones with myelinated fibers destruction from tumor tissue and normal white matter. Optical coherence tomography (OCT) is a promising tool for brain tissue visualization and in the present study, we demonstrate the ability of cross-polarization (CP) OCT to detect damaged white matter and differentiate it from normal and tumor tissues.

Materials and methods

The study was performed on 215 samples of brain tissue obtained from 57 patients with brain tumors. The analysis of the obtained OCT data included three stages: 1) visual analysis of structural OCT images; 2) quantitative assessment based on attenuation coefficients estimation in co- and cross-polarizations; 3) building of color-coded maps with subsequent visual analysis. The defining characteristics of structural CP OCT images and color-coded maps were determined for each studied tissue type, and then two classification tests were passed by 8 blinded respondents after a training.

Results

Visual assessment of structural CP OCT images allows detecting white matter areas with damaged myelinated fibers and differentiate them from normal white matter and tumor tissue. Attenuation coefficients also allow distinguishing all studied brain tissue types, while it was found that damage to myelinated fibers leads to a statistically significant decrease in the values of attenuation coefficients compared to normal white matter. Nevertheless, the use of color-coded optical maps looks more promising as it combines the objectivity of optical coefficient and clarity of the visual assessment, which leads to the increase of the diagnostic accuracy of the method compared to visual analysis of structural OCT images.

Conclusions

Alteration of myelinated fibers causes changes in the scattering properties of the white matter, which gets reflected in the nature of the received CP OCT signal. Visual assessment of structural CP OCT images and color-coded maps allows differentiating studied tissue types from each other, while usage of color-coded maps demonstrates higher diagnostic accuracy values in comparison with structural images (F-score = 0.85-0.86 and 0.81, respectively). Thus, the results of the study confirm the potential of using OCT as a neuronavigation tool during resections of brain tumors.

The neurosurgical benefit of contactless in vivo optical coherence tomography regarding residual tumor detection: A clinical study

Purpose

In brain tumor surgery, it is crucial to achieve complete tumor resection while conserving adjacent noncancerous brain tissue. Several groups have demonstrated that optical coherence tomography (OCT) has the potential of identifying tumorous brain tissue. However, there is little evidence on human in vivo application of this technology, especially regarding applicability and accuracy of residual tumor detection (RTD). In this study, we execute a systematic analysis of a microscope integrated OCT-system for this purpose.

Experimental design

Multiple 3-dimensional in vivo OCT-scans were taken at protocol-defined sites at the resection edge in 21 brain tumor patients. The system was evaluated for its intraoperative applicability. Tissue biopsies were obtained at these locations, labeled by a neuropathologist and used as ground truth for further analysis. OCT-scans were visually assessed with a qualitative classifier, optical OCT-properties were obtained and two artificial intelligence (AI)-assisted methods were used for automated scan classification. All approaches were investigated for accuracy of RTD and compared to common techniques.

Results

Visual OCT-scan classification correlated well with histopathological findings. Classification with measured OCT image-properties achieved a balanced accuracy of 85%. A neuronal network approach for scan feature recognition achieved 82% and an auto-encoder approach 85% balanced accuracy. Overall applicability showed need for improvement.

Conclusion

Contactless in vivo OCT scanning has shown to achieve high values of accuracy for RTD, supporting what has well been described for ex vivo OCT brain tumor scanning, complementing current intraoperative techniques and even exceeding them in accuracy, while not yet in applicability.

Deep learning-based optical coherence tomography image analysis of human brain cancer

Real-time intraoperative delineation of cancer and non-cancer brain tissues, especially in the eloquent cortex, is critical for thorough cancer resection, lengthening survival, and improving quality of life. Prior studies have established that thresholding optical attenuation values reveals cancer regions with high sensitivity and specificity. However, threshold of a single value disregards local information important to making more robust predictions. Hence, we propose deep convolutional neural networks (CNNs) trained on labeled OCT images and co-occurrence matrix features extracted from these images to synergize attenuation characteristics and texture features. Specifically, we adapt a deep ensemble model trained on 5,831 examples in a training dataset of 7 patients. We obtain 93.31% sensitivity and 97.04% specificity on a holdout set of 4 patients without the need for beam profile normalization using a reference phantom. The segmentation maps produced by parsing the OCT volume and tiling the outputs of our model are in excellent agreement with attenuation mapping-based methods. Our new approach for this important application has considerable implications for clinical translation.

Integrin subunit alpha V is a potent prognostic biomarker associated with immune infiltration in lower-grade glioma

As a member of integrin receptor family, ITGAV (integrin subunit α V) is involved in a variety of cell biological processes and overexpressed in various cancers, which may be a potential prognostic factor. However, its prognostic value and potential function in lower-grade glioma (LGG) are still unclear, and in terms of immune infiltration, it has not been fully elucidated. Here, the expression preference, prognostic value, and clinical traits of ITGAV were investigated using The Cancer Genome Atlas database (n = 528) and the Chinese Glioma Genome Atlas dataset (n = 458). Gene Ontology (GO) and Kyoto Encyclopedia of Genes and Genomes (KEGG) analyses and gene set enrichment analysis (GSEA) were used to explore the biological function of ITGAV. Using R package "ssGSEA" analysis, it was found thatthe ITGAV mRNA expression level showed intense correlation with tumor immunity, such as tumor-infiltrating immune cells and multiple immune-related genes. In addition, ITGAV is associated with some immune checkpoints and immune checkpoint blockade (ICB) and response to chemotherapy. and the expression of ITGAV protein in LGG patients was verified via immunohistochemistry (IHC). ITGAV expression was higher in LGG tissues than in normal tissues (P < 0.001) and multifactor analysis showed that ITGAV mRNA expression was an independent prognostic factor for LGG overall survival (OS; hazard ratio = 2.113, 95% confidence interval = 1.393-3.204, P < 0.001). GSEA showed that ITGAV expression was correlated with Inflammatory response, complement response, KRAS signal, and interferon response. ssGSEA results showed a positive correlation between ITGAV expression and Th2 cell infiltration level. ITGAV mRNA was overexpressed in LGG, and high ITGAV mRNA levels were found to be associated with poor protein expression and poor OS. ITGAV is therefore a potential biomarker for the diagnosis and prognosis of LGG and may be a potential immunotherapy target.

Innovations in the Diagnosis and Surgical Management of Low-Grade Gliomas

Low-grade gliomas are a broad category of tumors that can manifest at different stages of life. As a group, their prognosis has historically been considered to be favorable, and surgery is a mainstay of treatment. Advances in the molecular characterization of individual lesions has led to newer classification systems, a better understanding of the biological behavior of different neoplasms, and the identification of previously unrecognized entities. New prospective genetic and molecular data will help delineate better treatment paradigms and will continue to change the taxonomy of central nervous system tumors in the coming years. Advances in the field of radiomics will help predict the molecular profile of a particular tumor through noninvasive testing. Similarly, more precise methods of intraoperative tumor tissue analysis will aid surgical planning. Improved surgical outcomes propelled by novel surgical techniques and intraoperative adjuncts and emerging forms of medical treatment in the field of immunotherapy have enriched the management of these lesions. We review the contemporary management and innovations in the treatment of low-grade gliomas.

Binary dose level classification of tumour microvascular response to radiotherapy using artificial intelligence analysis of optical coherence tomography images

The dominant consequence of irradiating biological systems is cellular damage, yet microvascular damage begins to assume an increasingly important role as the radiation dose levels increase. This is currently becoming more relevant in radiation medicine with its pivot towards higher-dose-per-fraction/fewer fractions treatment paradigm (e.g., stereotactic body radiotherapy (SBRT)). We have thus developed a 3D preclinical imaging platform based on speckle-variance optical coherence tomography (svOCT) for longitudinal monitoring of tumour microvascular radiation responses in vivo. Here we present an artificial intelligence (AI) approach to analyze the resultant microvascular data. In this initial study, we show that AI can successfully classify SBRT-relevant clinical radiation dose levels at multiple timepoints (t = 2–4 weeks) following irradiation (10 Gy and 30 Gy cohorts) based on induced changes in the detected microvascular networks. Practicality of the obtained results, challenges associated with modest number of animals, their successful mitigation via augmented data approaches, and advantages of using 3D deep learning methodologies, are discussed. Extension of this encouraging initial study to longitudinal AI-based time-series analysis for treatment outcome predictions at finer dose level gradations is envisioned.

Intraoperative tissue classification methods in orthopedic and neurological surgeries: A systematic review

Accurate tissue differentiation during orthopedic and neurological surgeries is critical, given that such surgeries involve operations on or in the vicinity of vital neurovascular structures and erroneous surgical maneuvers can lead to surgical complications. By now, the number of emerging technologies tackling the problem of intraoperative tissue classification methods is increasing. Therefore, this systematic review paper intends to give a general overview of existing technologies. The review was done based on the PRISMA principle and two databases: PubMed and IEEE Xplore. The screening process resulted in 60 full-text papers. The general characteristics of the methodology from extracted papers included data processing pipeline, machine learning methods if applicable, types of tissues that can be identified with them, phantom used to conduct the experiment, and evaluation results. This paper can be useful in identifying the problems in the current status of the state-of-the-art intraoperative tissue classification methods and designing new enhanced techniques.

Intravital 3D visualization and segmentation of murine neural networks at micron resolution

Optical coherence tomography (OCT) allows label-free, micron-scale 3D imaging of biological tissues' fine structures with significant depth and large field-of-view. Here we introduce a novel OCT-based neuroimaging setting, accompanied by a feature segmentation algorithm, which enables rapid, accurate, and high-resolution in vivo imaging of 700 μm depth across the mouse cortex. Using a commercial OCT device, we demonstrate 3D reconstruction of microarchitectural elements through a cortical column. Our system is sensitive to structural and cellular changes at micron-scale resolution in vivo, such as those from injury or disease. Therefore, it can serve as a tool to visualize and quantify spatiotemporal brain elasticity patterns. This highly transformative and versatile platform allows accurate investigation of brain cellular architectural changes by quantifying features such as brain cell bodies' density, volume, and average distance to the nearest cell. Hence, it may assist in longitudinal studies of microstructural tissue alteration in aging, injury, or disease in a living rodent brain.

Rapid Automated Analysis of Skull Base Tumor Specimens Using Intraoperative Optical Imaging and Artificial Intelligence

BACKGROUND

Accurate specimen analysis of skull base tumors is essential for providing personalized surgical treatment strategies. Intraoperative specimen interpretation can be challenging because of the wide range of skull base pathologies and lack of intraoperative pathology resources.

OBJECTIVE

To develop an independent and parallel intraoperative workflow that can provide rapid and accurate skull base tumor specimen analysis using label-free optical imaging and artificial intelligence.

METHODS

We used a fiber laser-based, label-free, nonconsumptive, high-resolution microscopy method (<60 seconds per 1 × 1 mm2), called stimulated Raman histology (SRH), to image a consecutive, multicenter cohort of patients with skull base tumor. SRH images were then used to train a convolutional neural network model using 3 representation learning strategies: cross-entropy, self-supervised contrastive learning, and supervised contrastive learning. Our trained convolutional neural network models were tested on a held-out, multicenter SRH data set.

RESULTS

SRH was able to image the diagnostic features of both benign and malignant skull base tumors. Of the 3 representation learning strategies, supervised contrastive learning most effectively learned the distinctive and diagnostic SRH image features for each of the skull base tumor types. In our multicenter testing set, cross-entropy achieved an overall diagnostic accuracy of 91.5%, self-supervised contrastive learning 83.9%, and supervised contrastive learning 96.6%. Our trained model was able to segment tumor-normal margins and detect regions of microscopic tumor infiltration in meningioma SRH images.

CONCLUSION

SRH with trained artificial intelligence models can provide rapid and accurate intraoperative analysis of skull base tumor specimens to inform surgical decision-making.

OCT-Guided Surgery for Gliomas: Current Concept and Future Perspectives

Optical coherence tomography (OCT) has been recently suggested as a promising method to obtain in vivo and real-time high-resolution images of tissue structure in brain tumor surgery. This review focuses on the basics of OCT imaging, types of OCT images and currently suggested OCT scanner devices and the results of their application in neurosurgery. OCT can assist in achieving intraoperative precision identification of tumor infiltration within surrounding brain parenchyma by using qualitative or quantitative OCT image analysis of scanned tissue. OCT is able to identify tumorous tissue and blood vessels detection during stereotactic biopsy procedures. The combination of OCT with traditional imaging such as MRI, ultrasound and 5-ALA fluorescence has the potential to increase the safety and accuracy of the resection. OCT can improve the extent of resection by offering the direct visualization of tumor with cellular resolution when using microscopic OCT contact probes. The theranostic implementation of OCT as a part of intelligent optical diagnosis and automated lesion localization and ablation could achieve high precision, automation and intelligence in brain tumor surgery. We present this review for the increase of knowledge and formation of critical opinion in the field of OCT implementation in brain tumor surgery.

Artificial intelligence in disease diagnosis: a systematic literature review, synthesizing framework and future research agenda

Artificial intelligence can assist providers in a variety of patient care and intelligent health systems. Artificial intelligence techniques ranging from machine learning to deep learning are prevalent in healthcare for disease diagnosis, drug discovery, and patient risk identification. Numerous medical data sources are required to perfectly diagnose diseases using artificial intelligence techniques, such as ultrasound, magnetic resonance imaging, mammography, genomics, computed tomography scan, etc. Furthermore, artificial intelligence primarily enhanced the infirmary experience and sped up preparing patients to continue their rehabilitation at home. This article covers the comprehensive survey based on artificial intelligence techniques to diagnose numerous diseases such as Alzheimer, cancer, diabetes, chronic heart disease, tuberculosis, stroke and cerebrovascular, hypertension, skin, and liver disease. We conducted an extensive survey including the used medical imaging dataset and their feature extraction and classification process for predictions. Preferred reporting items for systematic reviews and Meta-Analysis guidelines are used to select the articles published up to October 2020 on the Web of Science, Scopus, Google Scholar, PubMed, Excerpta Medical Database, and Psychology Information for early prediction of distinct kinds of diseases using artificial intelligence-based techniques. Based on the study of different articles on disease diagnosis, the results are also compared using various quality parameters such as prediction rate, accuracy, sensitivity, specificity, the area under curve precision, recall, and F1-score.

Intelligent optical diagnosis and treatment system for automated image-guided laser ablation of tumors

PURPOSE

For tumor resections near critical structures, accurate identification of tumor boundaries and maximum removal are the keys to improve surgical outcome and patient survival rate, especially in neurosurgery. In this paper, we propose an intelligent optical diagnosis and treatment system for tumor removal, with automated lesion localization and laser ablation.

METHODS

The proposed system contains a laser ablation module, an optical coherence tomography (OCT) unit, and a robotic arm along with a stereo camera. The robotic arm can move the OCT sample arm and the laser ablation front-end to the suspected lesion area. The corresponding diagnosis and treatment procedures include computer-aided lesion segmentation using OCT, automated ablation planning, and laser control. The ablation process is controlled by a deflectable mirror, and a non-common-path ablation planning algorithm based on the transformation from lesion positions to mirror deflection angles is presented.

RESULTS

Phantom and animal experiments are carried out for system verification. The robot could reach the planned position with high precision, which is approximately 1.16 mm. Tissue classification with OCT images achieves 91.7% accuracy. The error of OCT-guided automated laser ablation is approximately 0.74 mm. Experiments on mouse brain tumors show that the proposed system is capable of clearing lesions efficiently and precisely. We also conducted an ex vivo porcine brain experiment to verify the whole process of the system.

CONCLUSION

An intelligent optical diagnosis and treatment system is proposed for tumor removal. Experimental results show that the proposed system and method are promising for precise and intelligent theranostics. Compared to conventional cancer diagnosis and treatment, the proposed system allows for automated operations monitored in real-time, with higher precision and efficiency.

Minimizing OCT quantification error via a surface-tracking imaging probe

OCT-based quantitative tissue optical properties imaging is a promising technique for intraoperative brain cancer assessment. The attenuation coefficient analysis relies on the depth-dependent OCT intensity profile, thus sensitive to tissue surface positions relative to the imaging beam focus. However, it is almost impossible to maintain a steady tissue surface during intraoperative imaging due to the patient's arterial pulsation and breathing, the operator's motion, and the complex tissue surface geometry of the surgical cavity. In this work, we developed an intraoperative OCT imaging probe with a surface-tracking function to minimize the quantification errors in optical attenuation due to the tissue surface position variations. A compact OCT imaging probe was designed and engineered to have a long working distance of ∼ 41 mm and a large field of view of 4 × 4 mm2 while keeping the probe diameter small (9 mm) to maximize clinical versatility. A piezo-based linear motor was integrated with the imaging probe and controlled based upon real-time feedback of tissue surface position inferred from OCT images. A GPU-assisted parallel processing algorithm was implemented, enabling detection and tracking of tissue surface in real-time and successfully suppressing more than 90% of the typical physiologically induced motion range. The surface-tracking intraoperative OCT imaging probe could maintain a steady beam focus inside the target tissue regardless of the surface geometry or physiological motions and enabled to obtain tissue optical attenuation reliably for assessing brain cancer margins in challenging intraoperative settings.

Diagnosing colorectal abnormalities using scattering coefficient maps acquired from optical coherence tomography

Optical coherence tomography (OCT) has shown potential in differentiating normal colonic mucosa from neoplasia. In this study of 33 fresh human colon specimens, we report the first use of texture features and computer vision-based imaging features acquired from en face scattering coefficient maps to characterize colorectal tissue. En face scattering coefficient maps were generated automatically using a new fast integral imaging algorithm. From these maps, a gray-level cooccurrence matrix algorithm was used to extract texture features, and a scale-invariant feature transform algorithm was used to derive novel computer vision-based features. In total, 25 features were obtained, and the importance of each feature in diagnosis was evaluated using a random forest model. Two classifiers were assessed on two different classification tasks. A support vector machine model was found to be optimal for distinguishing normal from abnormal tissue, with 94.7% sensitivity and 94.0% specificity, while a random forest model performed optimally in further differentiating abnormal tissues (i.e., cancerous tissue and adenomatous polyp) with 86.9% sensitivity and 85.0% specificity. These results demonstrated the potential of using OCT to aid the diagnosis of human colorectal disease.

Histological validation of in vivo assessment of cancer tissue inhomogeneity and automated morphological segmentation enabled by Optical Coherence Elastography

We present a non-invasive (albeit contact) method based on Optical Coherence Elastography (OCE) enabling the in vivo segmentation of morphological tissue constituents, in particular, monitoring of morphological alterations during both tumor development and its response to therapies. The method uses compressional OCE to reconstruct tissue stiffness map as the first step. Then the OCE-image is divided into regions, for which the Young’s modulus (stiffness) falls in specific ranges corresponding to the morphological constituents to be discriminated. These stiffness ranges (characteristic "stiffness spectra") are initially determined by careful comparison of the "gold-standard" histological data and the OCE-based stiffness map for the corresponding tissue regions. After such pre-calibration, the results of morphological segmentation of OCE-images demonstrate a striking similarity with the histological results in terms of percentage of the segmented zones. To validate the sensitivity of the OCE-method and demonstrate its high correlation with conventional histological segmentation we present results obtained in vivo on a murine model of breast cancer in comparative experimental study of the efficacy of two antitumor chemotherapeutic drugs with different mechanisms of action. The new technique allowed in vivo monitoring and quantitative segmentation of (1) viable, (2) dystrophic, (3) necrotic tumor cells and (4) edema zones very similar to morphological segmentation of histological images. Numerous applications in other experimental/clinical areas requiring rapid, nearly real-time, quantitative assessment of tissue structure can be foreseen.

Improved Diagnostic Imaging of Brain Tumors by Multimodal Microscopy and Deep Learning

Fluorescence-guided surgery is a state-of-the-art approach for intraoperative imaging during neurosurgical removal of tumor tissue. While the visualization of high-grade gliomas is reliable, lower grade glioma often lack visible fluorescence signals. Here, we present a hybrid prototype combining visible light optical coherence microscopy (OCM) and high-resolution fluorescence imaging for assessment of brain tumor samples acquired by 5-aminolevulinic acid (5-ALA) fluorescence-guided surgery. OCM provides high-resolution information of the inherent tissue scattering and absorption properties of tissue. We here explore quantitative attenuation coefficients derived from volumetric OCM intensity data and quantitative high-resolution 5-ALA fluorescence as potential biomarkers for tissue malignancy including otherwise difficult-to-assess low-grade glioma. We validate our findings against the gold standard histology and use attenuation and fluorescence intensity measures to differentiate between tumor core, infiltrative zone and adjacent brain tissue. Using large field-of-view scans acquired by a near-infrared swept-source optical coherence tomography setup, we provide initial assessments of tumor heterogeneity. Finally, we use cross-sectional OCM images to train a convolutional neural network that discriminates tumor from non-tumor tissue with an accuracy of 97%. Collectively, the present hybrid approach offers potential to translate into an in vivo imaging setup for substantially improved intraoperative guidance of brain tumor surgeries.