Interobserver Agreement for the Computed Tomography Severity Grading Scales for Acute Traumatic Brain Injury

Imaging Findings in Acute Traumatic Brain Injury: a National Institute of Neurological Disorders and Stroke Common Data Element-Based Pictorial Review and Analysis of Over 4000 Admission Brain Computed Tomography Scans from the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) Study

In 2010, the National Institute of Neurological Disorders and Stroke (NINDS) created a set of common data elements (CDEs) to help standardize the assessment and reporting of imaging findings in traumatic brain injury (TBI). However, as opposed to other standardized radiology reporting systems, a visual overview and data to support the proposed standardized lexicon are lacking. We used over 4000 admission computed tomography (CT) scans of patients with TBI from the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) study to develop an extensive pictorial overview of the NINDS TBI CDEs, with visual examples and background information on individual pathoanatomical lesion types, up to the level of supplemental and emerging information (e.g., location and estimated volumes). We documented the frequency of lesion occurrence, aiming to quantify the relative importance of different CDEs for characterizing TBI, and performed a critical appraisal of our experience with the intent to inform updating of the CDEs. In addition, we investigated the co-occurrence and clustering of lesion types and the distribution of six CT classification systems. The median age of the 4087 patients in our dataset was 50 years (interquartile range, 29-66; range, 0-96), including 238 patients under 18 years old (5.8%). Traumatic subarachnoid hemorrhage (45.3%), skull fractures (37.4%), contusions (31.3%), and acute subdural hematoma (28.9%) were the most frequently occurring CT findings in acute TBI. The ranking of these lesions was the same in patients with mild TBI (baseline Glasgow Coma Scale [GCS] score 13-15) compared with those with moderate-severe TBI (baseline GCS score 3-12), but the frequency of occurrence was up to three times higher in moderate-severe TBI. In most TBI patients with CT abnormalities, there was co-occurrence and clustering of different lesion types, with significant differences between mild and moderate-severe TBI patients. More specifically, lesion patterns were more complex in moderate-severe TBI patients, with more co-existing lesions and more frequent signs of mass effect. These patients also had higher and more heterogeneous CT score distributions, associated with worse predicted outcomes. The critical appraisal of the NINDS CDEs was highly positive, but revealed that full assessment can be time consuming, that some CDEs had very low frequencies, and identified a few redundancies and ambiguity in some definitions. Whilst primarily developed for research, implementation of CDE templates for use in clinical practice is advocated, but this will require development of an abbreviated version. In conclusion, with this study, we provide an educational resource for clinicians and researchers to help assess, characterize, and report the vast and complex spectrum of imaging findings in patients with TBI. Our data provides a comprehensive overview of the contemporary landscape of TBI imaging pathology in Europe, and the findings can serve as empirical evidence for updating the current NINDS radiologic CDEs to version 3.0.

Validation of a deep learning model for traumatic brain injury detection and NIRIS grading on non-contrast CT: a multi-reader study with promising results and opportunities for improvement

PURPOSE

This study aimed to assess and externally validate the performance of a deep learning (DL) model for the interpretation of non-contrast computed tomography (NCCT) scans of patients with suspicion of traumatic brain injury (TBI).

METHODS

This retrospective and multi-reader study included patients with TBI suspicion who were transported to the emergency department and underwent NCCT scans. Eight reviewers, with varying levels of training and experience (two neuroradiology attendings, two neuroradiology fellows, two neuroradiology residents, one neurosurgery attending, and one neurosurgery resident), independently evaluated NCCT head scans. The same scans were evaluated using the version 5.0 of the DL model icobrain tbi. The establishment of the ground truth involved a thorough assessment of all accessible clinical and laboratory data, as well as follow-up imaging studies, including NCCT and magnetic resonance imaging, as a consensus amongst the study reviewers. The outcomes of interest included neuroimaging radiological interpretation system (NIRIS) scores, the presence of midline shift, mass effect, hemorrhagic lesions, hydrocephalus, and severe hydrocephalus, as well as measurements of midline shift and volumes of hemorrhagic lesions. Comparisons using weighted Cohen's kappa coefficient were made. The McNemar test was used to compare the diagnostic performance. Bland-Altman plots were used to compare measurements.

RESULTS

One hundred patients were included, with the DL model successfully categorizing 77 scans. The median age for the total group was 48, with the omitted group having a median age of 44.5 and the included group having a median age of 48. The DL model demonstrated moderate agreement with the ground truth, trainees, and attendings. With the DL model's assistance, trainees' agreement with the ground truth improved. The DL model showed high specificity (0.88) and positive predictive value (0.96) in classifying NIRIS scores as 0-2 or 3-4. Trainees and attendings had the highest accuracy (0.95). The DL model's performance in classifying various TBI CT imaging common data elements was comparable to that of trainees and attendings. The average difference for the DL model in quantifying the volume of hemorrhagic lesions was 6.0 mL with a wide 95% confidence interval (CI) of - 68.32 to 80.22, and for midline shift, the average difference was 1.4 mm with a 95% CI of - 3.4 to 6.2.

CONCLUSION

While the DL model outperformed trainees in some aspects, attendings' assessments remained superior in most instances. Using the DL model as an assistive tool benefited trainees, improving their NIRIS score agreement with the ground truth. Although the DL model showed high potential in classifying some TBI CT imaging common data elements, further refinement and optimization are necessary to enhance its clinical utility.

Comparing Predictive Utility of Head Computed Tomography Scan-Based Scoring Systems for Traumatic Brain Injury: A Retrospective Study

This study compared the predictive utility of Marshall, Rotterdam, Stockholm, Helsinki, and NeuroImaging Radiological Interpretation System (NIRIS) scorings based on early non-contrast brain computed tomography (CT) scans in patients with traumatic brain injury (TBI). The area under a receiver operating characteristic curve (AUROC) was used to determine the predictive utility of scoring systems. Subgroup analyses were performed among patients with head AIS scores > 1. A total of 996 patients were included, of whom 786 (78.9%) were males. In-hospital mortality, ICU admission, neurosurgical intervention, and prolonged total hospital length of stay (THLOS) were recorded for 27 (2.7%), 207 (20.8%), 82 (8.2%), and 205 (20.6%) patients, respectively. For predicting in-hospital mortality, all scoring systems had AUROC point estimates above 0.9 and 0.75 among all included patients and patients with head AIS > 1, respectively, without any significant differences. The Marshall and NIRIS scoring systems had higher AUROCs for predicting ICU admission and neurosurgery than the other scoring systems. For predicting THLOS ≥ seven days, although the NIRIS and Marshall scoring systems seemed to have higher AUROC point estimates when all patients were analyzed, five scoring systems performed roughly the same in the head AIS > 1 subgroup.

Prediction of In-Hospital Outcomes in Patients with Traumatic Brain Injury Using Computed Tomographic Scoring Systems: A Comparison Between Marshall, Rotterdam, and Neuroimaging Radiological Interpretation Systems

OBJECTIVE

This study aimed to compare the prognostic value of Marshall, Rotterdam, and Neuroimaging Radiological Interpretation Systems (NIRIS) in predicting the in-hospital outcomes of patients with traumatic brain injury.

METHODS

We identified 250 patients with traumatic brain injury in a retrospective single-center cohort from 2019 to 2020. Computed tomography (CT) scans were reviewed by two radiologists and scored according to three CT scoring systems. One-month outcomes were evaluated, including hospitalization, intensive care unit admission, neurosurgical procedure, and mortality. Logistic regression analysis was performed to identify scoring systems and outcome relationships. The best cutoff value was calculated using the receiver operating characteristic curve model.

RESULTS

Eighteen patients (7.2%) died in the 1-month follow-up. The mean age and Glasgow Coma Scale of survivors differed significantly from nonsurvivors. Subarachnoid hemorrhage and compressed/absent cisterns were dead patients' most frequent CT findings. All three scoring systems had good discrimination power in mortality prediction (area under the receiver operating characteristic curve of the Marshall, Rotterdam, and NIRIS was 0.78, 0.86, and 0.84, respectively). Regarding outcome, three systems directly correlated with unfavorable outcome prediction.

CONCLUSIONS

The Marshall, Rotterdam, and NIRIS are good predictive models for mortality and outcome prediction, with slight superiority of the Rotterdam in mortality prediction and the Marshall in intensive care unit admission and neurosurgical procedures.

Chinese Admission Warning Strategy for Predicting the Hospital Discharge Outcome in Patients with Traumatic Brain Injury

Objective: To develop and validate an admission warning strategy that incorporates the general emergency department indicators for predicting the hospital discharge outcome of patients with traumatic brain injury (TBI) in China. Methods: This admission warning strategy was developed in a primary cohort that consisted of 605 patients with TBI who were admitted within 6 h of injury. The least absolute shrinkage and selection operator and multivariable logistic regression analysis were used to develop the early warning strategy of selected indicators. Two sub-cohorts consisting of 180 and 107 patients with TBI were used for the external validation. Results: Indicators of the strategy included three categories: baseline characteristics, imaging and laboratory indicators. This strategy displayed good calibration and good discrimination. A high C-index was reached in the internal validation. The multicenter external validation cohort still showed good discrimination C-indices. Decision curve analysis (DCA) showed the actual needs of this strategy when the possibility threshold was 0.01 for the primary cohort, and at thresholds of 0.02–0.83 and 0.01–0.88 for the two sub-cohorts, respectively. In addition, this strategy exhibited a significant prognostic capacity compared to the traditional single predictors, and this optimization was also observed in two external validation cohorts. Conclusions: We developed and validated an admission warning strategy that can be quickly deployed in the emergency department. This strategy can be used as an ideal tool for predicting hospital discharge outcomes and providing objective evidence for early informed consent of the hospital discharge outcome to the family members of TBI patients.

Predictive Value of Rotterdam Score and Marshall Score in Traumatic Brain Injury: A Contemporary Review

This article conducts a contemporary comparative review of the medical literature to update and establish evidence as to which framework among Rotterdam and Marshall computed tomography (CT)-based scoring systems predicts traumatic brain injury (TBI) outcomes better. The scheme followed was following the recommendations of the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines for literature search. The search started on August 15, 2020 and ended on December 31, 2020. The combination terms used were Medical Subject Headings terms, combination keywords, and specific words used for describing various pathologies of TBI to identify the most relevant article in each database. PICO question to guide the search strategy was: “what is the use of Marshall (I) versus Rotterdam score (C) in TBI patients (P) for mortality risk stratification (O).” The review is based on 46 references which included a full review of 14 articles for adult TBI patients and 6 articles for pediatric TBI articles comparing Rotterdam and Marshall CT scores. The review includes 8,243 patients, of which 2,365 were pediatric and 5,878 were adult TBI patients. Marshall CT classification is not ordinal, is more descriptive, has better inter-rater reliability, and poor performance in a specific group of TBI patients requiring decompressive craniectomy. Rotterdam CT classification is ordinal, has better discriminatory power, and a better description of the dynamics of intracranial changes. The two scoring systems are complimentary. A combination of clinical parameters, severity, ischemic and hemodynamic parameters, and CT scoring system could predict the prognosis of TBI patients with significant accuracy. None of the classifications has good evidence for use in pediatric patients.