Predicting Discharge Disposition Following Meningioma Resection Using a Multi-Institutional Natural Language Processing Model

Artificial intelligence innovations in neurosurgical oncology: a narrative review

PURPOSE

Artificial Intelligence (AI) has become increasingly integrated clinically within neurosurgical oncology. This report reviews the cutting-edge technologies impacting tumor treatment and outcomes.

METHODS

A rigorous literature search was performed with the aid of a research librarian to identify key articles referencing AI and related topics (machine learning (ML), computer vision (CV), augmented reality (AR), virtual reality (VR), etc.) for neurosurgical care of brain or spinal tumors.

RESULTS

Treatment of central nervous system (CNS) tumors is being improved through advances across AI-such as AL, CV, and AR/VR. AI aided diagnostic and prognostication tools can influence pre-operative patient experience, while automated tumor segmentation and total resection predictions aid surgical planning. Novel intra-operative tools can rapidly provide histopathologic tumor classification to streamline treatment strategies. Post-operative video analysis, paired with rich surgical simulations, can enhance training feedback and regimens.

CONCLUSION

While limited generalizability, bias, and patient data security are current concerns, the advent of federated learning, along with growing data consortiums, provides an avenue for increasingly safe, powerful, and effective AI platforms in the future.

Natural Language Processing-Driven Artificial Intelligence Models for the Diagnosis of Lumbar Disc Herniation with L5 and S1 Radiculopathy: A Preliminary Evaluation

OBJECTIVE

To develop and validate natural language processing-driven artificial intelligence (AI) models for the diagnosis of lumbar disc herniation (LDH) with L5 and S1 radiculopathy using electronic health records (EHRs).

METHODS

EHRs of patients undergoing single-level percutaneous endoscopic lumbar discectomy for the treatment of LDH at the L4/5 or L5/S1 level between June 1, 2013, and December 31, 2021, were collected. The primary outcome was LDH with L5 and S1 radiculopathy, which was defined as nerve root compression recorded in the operative notes. Datasets were created using the history of present illness text and positive symptom text with radiculopathy (L5 or S1), respectively. The datasets were randomly split into a training set and a testing set in a 7:3 ratio. Two machine learning models, the long short-term memory network and Extreme Gradient Boosting, were developed using the training set. Performance evaluation of the models on the testing set was done using measures such as the receiver operating characteristic curve, area under the curve, accuracy, recall, F1-score, and precision.

RESULTS

The study included a total of 1681 patients, with 590 patients having L5 radiculopathy and 1091 patients having S1 radiculopathy. Among the 4 models developed, the long short-term memory model based on positive symptom text showed the best discrimination in the testing set, with precision (0.9054), recall (0.9405), accuracy (0.8950), F1-score (0.9226), and area under the curve (0.9485).

CONCLUSIONS

This study provides preliminary validation of the concept that natural language processing-driven AI models can be used for the diagnosis of lumbar disease using EHRs. This study could pave the way for future research that may develop more comprehensive and clinically impactful AI-driven diagnostic systems.

Applications of natural language processing tools in the surgical journey

Background

Natural language processing tools are becoming increasingly adopted in multiple industries worldwide. They have shown promising results however their use in the field of surgery is under-recognised. Many trials have assessed these benefits in small settings with promising results before large scale adoption can be considered in surgery. This study aims to review the current research and insights into the potential for implementation of natural language processing tools into surgery.

Methods

A narrative review was conducted following a computer-assisted literature search on Medline, EMBASE and Google Scholar databases. Papers related to natural language processing tools and consideration into their use for surgery were considered.

Results

Current applications of natural language processing tools within surgery are limited. From the literature, there is evidence of potential improvement in surgical capability and service delivery, such as through the use of these technologies to streamline processes including surgical triaging, data collection and auditing, surgical communication and documentation. Additionally, there is potential to extend these capabilities to surgical academia to improve processes in surgical research and allow innovation in the development of educational resources. Despite these outcomes, the evidence to support these findings are challenged by small sample sizes with limited applicability to broader settings.

Conclusion

With the increasing adoption of natural language processing technology, such as in popular forms like ChatGPT, there has been increasing research in the use of these tools within surgery to improve surgical workflow and efficiency. This review highlights multifaceted applications of natural language processing within surgery, albeit with clear limitations due to the infancy of the infrastructure available to leverage these technologies. There remains room for more rigorous research into broader capability of natural language processing technology within the field of surgery and the need for cross-sectoral collaboration to understand the ways in which these algorithms can best be integrated.

Towards a practical use of text mining approaches in electrodiagnostic data

Healthcare professionals produce abounding textual data in their daily clinical practice. Text mining can yield valuable insights from unstructured data. Extracting insights from multiple information sources is a major challenge in computational medicine. In this study, our objective was to illustrate how combining text mining techniques with statistical methodologies can yield new insights and contribute to the development of neurological and neuromuscular-related health information. We demonstrate how to utilize and derive knowledge from medical text, identify patient groups with similar diagnostic attributes, and examine differences between groups using demographical data and past medical history (PMH). We conducted a retrospective study for all patients who underwent electrodiagnostic (EDX) evaluation in Israel's Sheba Medical Center between May 2016 and February 2022. The data extracted for each patient included demographic data, test results, and unstructured summary reports. We conducted several analyses, including topic modeling that targeted clinical impressions and topic analysis to reveal age- and sex-related differences. The use of suspected clinical condition text enriched the data and generated additional attributes used to find associations between patients' PMH and the emerging diagnosis topics. We identified 6096 abnormal EMG results, of which 58% (n = 3512) were males. Based on the latent Dirichlet allocation algorithm we identified 25 topics that represent different diagnoses. Sex-related differences emerged in 7 topics, 3 male-associated and 4 female-associated. Brachial plexopathy, myasthenia gravis, and NMJ Disorders showed statistically significant age and sex differences. We extracted keywords related to past medical history (n = 37) and tested them for association with the different topics. Several topics revealed a close association with past medical history, for example, length-dependent symmetric axonal polyneuropathy with diabetes mellitus (DM), length-dependent sensory polyneuropathy with chemotherapy treatments and DM, brachial plexopathy with motor vehicle accidents, myasthenia gravis and NMJ disorders with botulin treatments, and amyotrophic lateral sclerosis with swallowing difficulty. Summarizing visualizations were created to easily grasp the results and facilitate focusing on the main insights. In this study, we demonstrate the efficacy of utilizing advanced computational methods in a corpus of textual data to accelerate clinical research. Additionally, using these methods allows for generating clinical insights, which may aid in the development of a decision-making process in real-life clinical practice.

Traditional Machine Learning Methods versus Deep Learning for Meningioma Classification, Grading, Outcome Prediction, and Segmentation: A Systematic Review and Meta-Analysis

BACKGROUND

Meningiomas are common intracranial tumors. Machine learning (ML) algorithms are emerging to improve accuracy in 4 primary domains: classification, grading, outcome prediction, and segmentation. Such algorithms include both traditional approaches that rely on hand-crafted features and deep learning (DL) techniques that utilize automatic feature extraction. The aim of this study was to evaluate the performance of published traditional ML versus DL algorithms in classification, grading, outcome prediction, and segmentation of meningiomas.

METHODS

A systematic review and meta-analysis were conducted. Major databases were searched through September 2021 for publications evaluating traditional ML versus DL models on meningioma management. Performance measures including pooled sensitivity, specificity, F1-score, area under the receiver-operating characteristic curve, positive and negative likelihood ratios (LR+, LR-) along with their respective 95% confidence intervals (95% CIs) were derived using random-effects models.

RESULTS

Five hundred thirty-four records were screened, and 43 articles were included, regarding classification (3 articles), grading (29), outcome prediction (7), and segmentation (6) of meningiomas. Of the 29 studies that reported on grading, 10 could be meta-analyzed with 2 DL models (sensitivity 0.89, 95% CI: 0.74-0.96; specificity 0.91, 95% CI: 0.45-0.99; LR+ 10.1, 95% CI: 1.33-137; LR- 0.12, 95% CI: 0.04-0.59) and 8 traditional ML (sensitivity 0.74, 95% CI: 0.62-0.83; specificity 0.93, 95% CI: 0.79-0.98; LR+ 10.5, 95% CI: 2.91-39.5; and LR- 0.28, 95% CI: 0.17-0.49). The insufficient performance metrics reported precluded further statistical analysis of other performance metrics.

CONCLUSIONS

ML on meningiomas is mostly carried out with traditional methods. For meningioma grading, traditional ML methods generally had a higher LR+, while DL models a lower LR-.

Machine Learning Using Multiparametric Magnetic Resonance Imaging Radiomic Feature Analysis to Predict Ki-67 in World Health Organization Grade I Meningiomas

BACKGROUND

Although World Health Organization (WHO) grade I meningiomas are considered "benign" tumors, an elevated Ki-67 is one crucial factor that has been shown to influence tumor behavior and clinical outcomes. The ability to preoperatively discern Ki-67 would confer the ability to guide surgical strategy.

OBJECTIVE

In this study, we develop a machine learning (ML) algorithm using radiomic feature analysis to predict Ki-67 in WHO grade I meningiomas.

METHODS

A retrospective analysis was performed for a cohort of 306 patients who underwent surgical resection of WHO grade I meningiomas. Preoperative magnetic resonance imaging was used to perform radiomic feature extraction followed by ML modeling using least absolute shrinkage and selection operator wrapped with support vector machine through nested cross-validation on a discovery cohort (n = 230), to stratify tumors based on Ki-67 <5% and ≥5%. The final model was independently tested on a replication cohort (n = 76).

RESULTS

An area under the receiver operating curve (AUC) of 0.84 (95% CI: 0.78-0.90) with a sensitivity of 84.1% and specificity of 73.3% was achieved in the discovery cohort. When this model was applied to the replication cohort, a similar high performance was achieved, with an AUC of 0.83 (95% CI: 0.73-0.94), sensitivity and specificity of 82.6% and 85.5%, respectively. The model demonstrated similar efficacy when applied to skull base and nonskull base tumors.

CONCLUSION

Our proposed radiomic feature analysis can be used to stratify WHO grade I meningiomas based on Ki-67 with excellent accuracy and can be applied to skull base and nonskull base tumors with similar performance achieved.