Postsurgical functional outcome prediction model using deep learning framework (Prediction One, Sony Network Communications Inc.) for hypertensive intracerebral hemorrhage

Machine Learning-Based Prediction for In-Hospital Mortality After Acute Intracerebral Hemorrhage Using Real-World Clinical and Image Data

BACKGROUND

Machine learning (ML) techniques are widely employed across various domains to achieve accurate predictions. This study assessed the effectiveness of ML in predicting early mortality risk among patients with acute intracerebral hemorrhage (ICH) in real-world settings.

METHODS AND RESULTS

ML-based models were developed to predict in-hospital mortality in 527 patients with ICH using raw brain imaging data from brain computed tomography and clinical data. The models' performances were evaluated using the area under the receiver operating characteristic curves and calibration plots, comparing them with traditional risk scores such as the ICH score and ICH grading scale. Kaplan-Meier curves were used to examine the post-ICH survival rates, stratified by ML-based risk assessment. The net benefit of ML-based models was evaluated using decision curve analysis. The area under the receiver operating characteristic curves were 0.91 (95% CI, 0.86-0.95) for the ICH score, 0.93 (95% CI, 0.89-0.97) for the ICH grading scale, 0.83 (95% CI, 0.71-0.91) for the ML-based model fitted with raw image data only, and 0.87 (95% CI, 0.76-0.93) for the ML-based model fitted using clinical data without specialist expertise. The area under the receiver operating characteristic curve increased significantly to 0.97 (95% CI, 0.94-0.99) when the ML model was fitted using clinical and image data assessed by specialists. All ML-based models demonstrated good calibration, and the survival rates showed significant differences between risk groups. Decision curve analysis indicated the highest net benefit when utilizing the findings assessed by specialists.

CONCLUSIONS

ML-based prediction models exhibit satisfactory performance in predicting post-ICH in-hospital mortality when utilizing raw imaging data or nonspecialist input. Nevertheless, incorporating specialist expertise notably improves performance.

Artificial Intelligence in Surgery: A Systematic Review of Use and Validation

Background: Artificial Intelligence (AI) holds promise for transforming healthcare, with AI models gaining increasing clinical use in surgery. However, new AI models are developed without established standards for their validation and use. Before AI can be widely adopted, it is crucial to ensure these models are both accurate and safe for patients. Without proper validation, there is a risk of integrating AI models into practice without sufficient evidence of their safety and accuracy, potentially leading to suboptimal patient outcomes. In this work, we review the current use and validation methods of AI models in clinical surgical settings and propose a novel classification system. Methods: A systematic review was conducted in PubMed and Cochrane using the keywords "validation", "artificial intelligence", and "surgery", following PRISMA guidelines. Results: The search yielded a total of 7627 articles, of which 102 were included for data extraction, encompassing 2,837,211 patients. A validation classification system named Surgical Validation Score (SURVAS) was developed. The primary applications of models were risk assessment and decision-making in the preoperative setting. Validation methods were ranked as high evidence in only 45% of studies, and only 14% of the studies provided publicly available datasets. Conclusions: AI has significant applications in surgery, but validation quality remains suboptimal, and public data availability is limited. Current AI applications are mainly focused on preoperative risk assessment and are suggested to improve decision-making. Classification systems such as SURVAS can help clinicians confirm the degree of validity of AI models before their application in practice.

Causal Effect Estimation on Imaging and Clinical Data for Treatment Decision Support of Aneurysmal Subarachnoid Hemorrhage

Aneurysmal subarachnoid hemorrhage is a medical emergency of brain that has high mortality and poor prognosis. Causal effect estimation of treatment strategies on patient outcomes is crucial for aneurysmal subarachnoid hemorrhage treatment decision-making. However, most existing studies on treatment decision-making support of this disease are unable to simultaneously compare the potential outcomes of different treatments for a patient. Furthermore, these studies fail to harmoniously integrate the imaging data with non-imaging clinical data, both of which are useful in clinical scenarios. In this paper, we estimate the causal effect of various treatments on patients with aneurysmal subarachnoid hemorrhage by integrating plain CT with non-imaging clinical data, which is represented using structured tabular data. Specifically, we first propose a novel scheme that uses multi-modality confounders distillation architecture to predict the treatment outcome and treatment assignment simultaneously. With these distilled confounder features, we design an imaging and non-imaging interaction representation learning strategy to use the complementary information extracted from different modalities to balance the feature distribution of different treatment groups. We have conducted extensive experiments using a clinical dataset of 656 subarachnoid hemorrhage cases, which was collected from the Hospital Authority Data Collaboration Laboratory in Hong Kong. Our method shows consistent improvements on the evaluation metrics of treatment effect estimation, achieving state-of-the-art results over strong competitors. Code is released at https://github.com/med-air/TOP-aSAH.

CT-based deep learning model for predicting hospital discharge outcome in spontaneous intracerebral hemorrhage

OBJECTIVES

To predict the functional outcome of patients with intracerebral hemorrhage (ICH) using deep learning models based on computed tomography (CT) images.

METHODS

A retrospective, bi-center study of ICH patients was conducted. Firstly, a custom 3D convolutional model was built for predicting the functional outcome of ICH patients based on CT scans from randomly selected ICH patients in H training dataset collected from H hospital. Secondly, clinical data and radiological features were collected at admission and the Extreme Gradient Boosting (XGBoost) algorithm was used to establish a second model, named the XGBoost model. Finally, the Convolution model and XGBoost model were fused to build the third "Fusion model." Favorable outcome was defined as modified Rankin Scale score of 0-3 at discharge. The prognostic predictive accuracy of the three models was evaluated using an H test dataset and an external Y dataset, and compared with the performance of ICH score and ICH grading scale (ICH-GS).

RESULTS

A total of 604 patients with ICH were included in this study, of which 450 patients were in the H training dataset, 50 patients in the H test dataset, and 104 patients in the Y dataset. In the Y dataset, the areas under the curve (AUCs) of the Convolution model, XGBoost model, and Fusion model were 0.829, 0.871, and 0.905, respectively. The Fusion model prognostic performance exceeded that of ICH score and ICH-GS (p = 0.043 and p = 0.045, respectively).

CONCLUSIONS

Deep learning models have good accuracy for predicting functional outcome of patients with spontaneous intracerebral hemorrhage.

CLINICAL RELEVANCE STATEMENT

The proposed deep learning Fusion model may assist clinicians in predicting functional outcome and developing treatment strategies, thereby improving the survival and quality of life of patients with spontaneous intracerebral hemorrhage.

KEY POINTS

• Integrating clinical presentations, CT images, and radiological features to establish deep learning model for functional outcome prediction of patients with intracerebral hemorrhage. • Deep learning applied to CT images provides great help in prognosing functional outcome of intracerebral hemorrhage patients. • The developed deep learning model performs better than clinical prognostic scores in predicting functional outcome of patients with intracerebral hemorrhage.

Artificial Intelligence and Machine Learning Applications in Critically Ill Brain Injured Patients

The utilization of Artificial Intelligence (AI) and Machine Learning (ML) is paving the way for significant strides in patient diagnosis, treatment, and prognostication in neurocritical care. These technologies offer the potential to unravel complex patterns within vast datasets ranging from vast clinical data and EEG (electroencephalogram) readings to advanced cerebral imaging facilitating a more nuanced understanding of patient conditions. Despite their promise, the implementation of AI and ML faces substantial hurdles. Historical biases within training data, the challenge of interpreting multifaceted data streams, and the "black box" nature of ML algorithms present barriers to widespread clinical adoption. Moreover, ethical considerations around data privacy and the need for transparent, explainable models remain paramount to ensure trust and efficacy in clinical decision-making.This article reflects on the emergence of AI and ML as integral tools in neurocritical care, discussing their roles from the perspective of both their scientific promise and the associated challenges. We underscore the importance of extensive validation in diverse clinical settings to ensure the generalizability of ML models, particularly considering their potential to inform critical medical decisions such as withdrawal of life-sustaining therapies. Advancement in computational capabilities is essential for implementing ML in clinical settings, allowing for real-time analysis and decision support at the point of care. As AI and ML are poised to become commonplace in clinical practice, it is incumbent upon health care professionals to understand and oversee these technologies, ensuring they adhere to the highest safety standards and contribute to the realization of personalized medicine. This engagement will be pivotal in integrating AI and ML into patient care, optimizing outcomes in neurocritical care through informed and data-driven decision-making.

Can AI predict walking independence in patients with stroke upon admission to a recovery-phase rehabilitation ward?

Ono K, Takahashi R, Morita K, Ara Y, Abe S, Ito S, Uno S, Abe M, Shirasaka T. Can AI predict walking independence in patients with stroke upon admission to a recovery-phase rehabilitation ward? Jpn J Compr Rehabil Sci 2024; 15: 1-7.

Objective

This study aimed to develop a prediction model for walking independence in patients with stroke in the recovery phase at the time of hospital discharge using Prediction One, an artificial intelligence (AI)-based predictive analysis tool, and to examine its utility.

Methods

Prediction One was used to develop a prediction model for walking independence for 280 patients with stroke admitted to a rehabilitation ward-based on physical and mental function information at admission. In 134 patients with stroke hospitalized during different periods, accuracy was confirmed by calculating the correct response rate, sensitivity, specificity, and positive and negative predictive values based on the results of AI-based predictions and actual results.

Results

The prediction accuracy (area under the curve, AUC) of the proposed model was 91.7%. The correct response rate was 79.9%, sensitivity was 95.7%, specificity was 62.5%, positive predictive value was 73.6%, and negative predictive value was 93.5%.

Conclusion

The accuracy of the prediction model developed in this study is not inferior to that of previous studies, and the simplicity of the model makes it highly practical.

Changes in diet, exercise and psychology of the quarantined population during the COVID-19 outbreak in Shanghai

BACKGROUND

In March 2022, a severe outbreak of COVID-19 broke out in Shanghai, with the virus spreading rapidly. In the most severe two months, more than 50,000 people were diagnosed with COVID-19. For this reason, Shanghai adopted three-district hierarchical management, requiring corresponding people to stay at home to contain the spread of the virus. Due to the requirements of prevention and control management, the diet, exercise and mental health of the corresponding population are affected to a certain extent.

OBJECTIVES

This article aimed to understand the population in the diet, exercise and psychological changes.

METHODS

This study carried out the research by distributing the electronic questionnaire and carried out the statistical analysis.

RESULTS

People reduced the intake of vegetables and fruits (P = 0.000<0.05), people did about an hour less exercise per week on average (P = 0.000<0.05), the number of steps they took per day decreased by nearly 2000 steps (P = 0.012<0.05), and there were significant changes in the way they exercised.

CONCLUSION

In terms of psychological state, people have some depression, anxiety and easy to feel tired after lockdown. This study can also provide reference for policy adjustment and formulation of normalized epidemic management in the future.

Machine learning prediction of symptomatic intracerebral hemorrhage after stroke thrombolysis: a cross-cultural validation in Caucasian and Han Chinese cohort

Background

Previous studies found that Asians seemed to have higher risk of HT after thrombolysis than Caucasians due to its race differences in genetic polymorphism. Whether the model developed by Caucasians could predict risk of symptomatic intracerebral hemorrhage (sICH) in Asians was unknown.

Objectives

To develop a machine learning-based model for predicting sICH after stroke thrombolysis in Caucasians and externally validate it in an independent Han Chinese cohort.

Design

The derivation Caucasian sample included 1738 ischemic stroke (IS) patients from the Virtual International Stroke Trials Archive (VISTA) data set, and the external validation Han Chinese cohort included 296 IS patients who were treated with intravenous thrombolysis.

Methods

Twenty-eight variables were collected across both samples. According to their properties, we classified them into six distinct clusters (ie, demographic variables, medical history, previous medication, baseline blood biomarkers, neuroimaging markers on initial CT scan and clinical characteristics). A support vector machine (SVM) model, which consisted of data processing, model training, testing and a 10-fold cross-validation, was developed to predict the risk of sICH after stroke thrombolysis. The receiving operating characteristic (ROC) was used to assess the prediction performance of the SVM model. A domain contribution analysis was then performed to test which cluster had the highest influence on the performance of the model.

Results

In total, 85 (4.9%) patients developed sICH in the Caucasians, and 29 (9.8%) patients developed sICH in the Han Chinese cohort. Eight features including age, NIHSS score, SBP (systolic blood pressure), DBP (diastolic blood pressure), ALP (alkaline phosphatase), ALT (alanine transaminase), glucose, and creatine level were included in the final model, all of which were from demographic, clinical characteristics, and blood biomarkers clusters, respectively. The SVM model showed a good predictive performance in both Caucasians (AUC = 0.87) and Han Chinese patients (AUC = 0.74). Domain contribution analysis showed that inclusion/exclusion of clinical characteristic cluster (NIHSS score, SBP, and DBP), had the highest influence on the performance of predicting sICH in both Caucasian and Han Chinese cohorts.

Conclusion

The established SVM model is feasible for predicting the risk of sICH after thrombolysis quickly and efficiently in both Caucasian and Han Chinese cohort.

Can Artificial Intelligence Be Applied to Diagnose Intracerebral Hemorrhage under the Background of the Fourth Industrial Revolution? A Novel Systemic Review and Meta-Analysis

Aim

We intended to provide the clinical evidence that artificial intelligence (AI) could be used to assist doctors in the diagnosis of intracerebral hemorrhage (ICH).

Methods

Studies published in 2021 were identified after the literature search of PubMed, Embase, and Cochrane. Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) was used to perform the quality assessment of studies. Data extraction of diagnosis effect included accuracy (ACC), sensitivity (SEN), specificity (SPE), positive predictive value (PPV), negative predictive value (NPV), area under curve (AUC), and Dice scores (Dices). The pooled effect with its 95% confidence interval (95%CI) was calculated by the random effects model. I-Square (I 2) was used to test heterogeneity. To check the stability of the overall results, sensitivity analysis was conducted by recalculating the pooled effect of the remaining studies after omitting the study with the highest quality or the random effects model was switched to the fixed effects model. Funnel plot was used to evaluate publication bias. To reduce heterogeneity, recalculating the pooled effect of the remaining studies after omitting the study with the lowest quality or perform subgroup analysis.

Results

Twenty-five diagnostic tests of ICH via AI and doctors with overall high quality were included. Pooled ACC, SEN, SPE, PPV, NPV, AUC, and Dices were 0.88 (0.83∼0.93), 0.85 (0.81∼0.89), 0.90 (0.88∼0.92), 0.80 (0.75∼0.85), 0.93 (0.91∼0.95), 0.84 (0.80∼0.89), and 0.90 (0.85∼0.95), respectively. There was no publication bias. All of results were stable as revealed by sensitivity analysis and were accordant as outcomes via subgroups analysis.

Conclusion

Under the background of the fourth industrial revolution, AI might be an effective and efficient tool to assist doctors in the clinical diagnosis of ICH.

A Magnetic Resonance Angiography-Based Study Comparing Machine Learning and Clinical Evaluation: Screening Intracranial Regions Associated with the Hemorrhagic Stroke of Adult Moyamoya Disease

OBJECTIVES

Moyamoya disease patients with hemorrhagic stroke usually have a poor prognosis. This study aimed to determine whether hemorrhagic moyamoya disease could be distinguished from MRA images using transfer deep learning and to screen potential regions that contain rich distinguishing information from MRA images in moyamoya disease.

MATERIALS AND METHODS

A total of 116 adult patients with bilateral moyamoya diseases suffering from hemorrhagic or ischemia complications were retrospectively screened. Based on original MRA images at the level of the basal cistern, basal ganglia, and centrum semiovale, we adopted the pretrained ResNet18 to build three models for differentiating hemorrhagic moyamoya disease. Grad-CAM was applied to visualize the regions of interest.

RESULTS

For the test set, the accuracies of model differentiation in the basal cistern, basal ganglia, and centrum semiovale were 93.3%, 91.5%, and 86.4%, respectively. Visualization of the regions of interest demonstrated that the models focused on the deep and periventricular white matter and abnormal collateral vessels in hemorrhagic moyamoya disease.

CONCLUSION

A transfer learning model based on MRA images of the basal cistern and basal ganglia showed a good ability to differentiate between patients with hemorrhagic moyamoya disease and those with ischemic moyamoya disease. The deep and periventricular white matter and collateral vessels at the level of the basal cistern and basal ganglia may contain rich distinguishing information.

Clinical Applications of Artificial Intelligence, Machine Learning, and Deep Learning in the Imaging of Gliomas: A Systematic Review

In neuro-oncology, magnetic resonance imaging (MRI) is a critically important, non-invasive radiologic assessment technique for brain tumor diagnosis, especially glioma. Deep learning improves MRI image characterization and interpretation through the utilization of raw imaging data and provides unprecedented enhancement of images and representation for detection and classification through deep neural networks. This systematic review and quality appraisal method aim to summarize deep learning approaches used in neuro-oncology imaging to aid healthcare professionals. Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, a total of 20 low-risk studies on the established use of deep learning models to identify glioma genetic mutations and grading were selected, based on a Quality Assessment of Diagnostic Accuracy Studies 2 score of ≥9. The included studies provided the deep learning models used alongside their outcome measures, the number of patients, and the molecular markers for brain glioma classification. In 19 studies, the researchers determined that the deep learning model improved the clinical outcome and treatment protocol in patients with a brain tumor. In five studies, the authors determined the sensitivity of the deep learning model used, and in four studies, the authors determined the specificity of the models. Convolutional neural network models were used in 16 studies. In eight studies, the researchers examined glioma grading by using different deep learning models compared with other models. In this review, we found that deep learning models significantly improve the diagnostic and classification accuracy of brain tumors, particularly gliomas without the need for invasive methods. Most studies have presented validated results and can be used in clinical practice to improve patient care and prognosis.

Relationship Between Medical Questionnaire and Influenza Rapid Test Positivity: Subjective Pretest Probability, "I Think I Have Influenza," Contributes to the Positivity Rate

Introduction Rapid influenza diagnostic tests (RIDTs) are considered essential for determining when to start influenza treatment using anti-influenza drugs, but their accuracy is about 70%. Under the COVID-19 pandemic, we hope to refrain from performing unnecessary RIDTs considering droplet infection of COVID-19 and influenza. We re-examined the medical questionnaire's importance and its relationship to the positivity of RIDTs. Then we built a positivity prediction model for RIDTs using automated artificial intelligence (AI). Methods We retrospectively investigated 96 patients who underwent RIDTs at the outpatient department from December 2019 to March 2020. We used a questionnaire sheet with 24 items before conducting RIDTs. The factors associated with the positivity of RIDTs were statistically analyzed. We then used an automated AI framework to produce the positivity prediction model using the 24 items, sex, and age, with five-fold cross-validation. Results Of the 47 women and 49 men (median age was 39 years), 56 patients were RIDT positive with influenza A. The AI-based model using 26 variables had an area under the curve (AUC) of 0.980. The stronger variables are subjective pretest probability, which is a numerically described score ranging from 0% to 100% of "I think I have influenza," cough, past hours after the onset, muscle pain, and maximum body temperature in order. Conclusion We easily built the RIDT positivity prediction model using automated AI. Its AUC was satisfactory, and it suggested the importance of a detailed medical interview. Both the univariate analysis and AI-based model suggested that subjective pretest probability, "I think I have influenza," might be useful.

Easily Created Prediction Model Using Automated Artificial Intelligence Framework (Prediction One, Sony Network Communications Inc., Tokyo, Japan) for Subarachnoid Hemorrhage Outcomes Treated by Coiling and Delayed Cerebral Ischemia

Introduction Reliable prediction models of subarachnoid hemorrhage (SAH) outcomes and delayed cerebral ischemia (DCI) are needed to decide the treatment strategy. Automated artificial intelligence (AutoAI) is attractive, but there are few reports on AutoAI-based models for SAH functional outcomes and DCI. We herein made models using an AutoAI framework, Prediction One (Sony Network Communications Inc., Tokyo, Japan), and compared it to other previous statistical prediction scores. Methods We used an open dataset of 298 SAH patients, who were with non-severe neurological grade and treated by coiling. Modified Rankin Scale 0-3 at six months was defined as a favorable functional outcome and DCI occurrence as another outcome. We randomly divided them into a 248-patient training dataset and a 50-patient test dataset. Prediction One made the model using training dataset with 5-fold cross-validation. We evaluated the model using the test dataset and compared the area under the curves (AUCs) of the created models. Those of the modified SAFIRE score and the Fisher computed tomography (CT) scale to predict the outcomes. Results The AUCs of the AutoAI-based models for functional outcome in the training and test dataset were 0.994 and 0.801, and those for the DCI occurrence were 0.969 and 0.650. AUCs for functional outcome calculated using modified SAFIRE score were 0.844 and 0.892. Those for the DCI occurrence calculated using the Fisher CT scale were 0.577 and 0.544. Conclusions We easily and quickly made AutoAI-based prediction models. The models' AUCs were not inferior to the previous prediction models despite the easiness.