The sensitivity and negative predictive value of a pediatric cervical spine clearance algorithm that minimizes computerized tomography

Triage tools for detecting cervical spine injury in paediatric trauma patients

BACKGROUND

Paediatric cervical spine injury (CSI) after blunt trauma is rare but can have severe consequences. Clinical decision rules (CDRs) have been developed to guide clinical decision-making, minimise unnecessary tests and associated risks, whilst detecting all significant CSIs. Several validated CDRs are used to guide imaging decision-making in adults following blunt trauma and clinical criteria have been proposed as possible paediatric-specific CDRs. Little information is known about their accuracy.

OBJECTIVES

To assess and compare the diagnostic accuracy of CDRs or sets of clinical criteria, alone or in comparison with each other, for the evaluation of CSI following blunt trauma in children.

SEARCH METHODS

For this update, we searched CENTRAL, MEDLINE, Embase, and six other databases from 1 January 2015 to 13 December 2022. As we expanded the index test eligibility for this review update, we searched the excluded studies from the previous version of the review for eligibility. We contacted field experts to identify ongoing studies and studies potentially missed by the search. There were no language restrictions.

SELECTION CRITERIA

We included cross-sectional or cohort designs (retrospective and prospective) and randomised controlled trials that compared the diagnostic accuracy of any CDR or clinical criteria compared with a reference standard for the evaluation of paediatric CSI following blunt trauma. We included studies evaluating one CDR or comparing two or more CDRs (directly and indirectly). We considered X-ray, computed tomography (CT) or magnetic resonance imaging (MRI) of the cervical spine, and clinical clearance/follow-up as adequate reference standards.

DATA COLLECTION AND ANALYSIS

Two review authors independently screened titles and abstracts for relevance, and carried out eligibility, data extraction and quality assessment. A third review author arbitrated. We extracted data on study design, participant characteristics, inclusion/exclusion criteria, index test, target condition, reference standard and data (diagnostic two-by-two tables) and calculated and plotted sensitivity and specificity on forest plots for visual examination of variation in test accuracy. We assessed methodological quality using the Quality Assessment of Diagnostic Accuracy Studies Version 2 tool. We graded the certainty of the evidence using the GRADE approach.

MAIN RESULTS

We included five studies with 21,379 enrolled participants, published between 2001 and 2021. Prevalence of CSI ranged from 0.5% to 1.85%. Seven CDRs were evaluated. Three studies reported on direct comparisons of CDRs. One study (973 participants) directly compared the accuracy of three index tests with the sensitivities of NEXUS, Canadian C-Spine Rule and the PECARN retrospective criteria being 1.00 (95% confidence interval (CI) 0.48 to 1.00), 1.00 (95% CI 0.48 to 1.00) and 1.00 (95% CI 0.48 to 1.00), respectively. The specificities were 0.56 (95% CI 0.53 to 0.59), 0.52 (95% CI 0.49 to 0.55) and 0.32 (95% CI 0.29 to 0.35), respectively (moderate-certainty evidence). One study (4091 participants) compared the accuracy of the PECARN retrospective criteria with the Leonard de novo model; the sensitivities were 0.91 (95% CI 0.81 to 0.96) and 0.92 (95% CI 0.83 to 0.97), respectively. The specificities were 0.46 (95% CI 0.44 to 0.47) and 0.50 (95% CI 0.49 to 0.52) (moderate- and low-certainty evidence, respectively). One study (270 participants) compared the accuracy of two NICE (National Institute for Health and Care Excellence) head injury guidelines; the sensitivity of the CG56 guideline was 1.00 (95% CI 0.48 to 1.00) compared to 1.00 (95% CI 0.48 to 1.00) with the CG176 guideline. The specificities were 0.46 (95% CI 0.40 to 0.52) and 0.07 (95% CI 0.04 to 0.11), respectively (very low-certainty evidence). Two additional studies were indirect comparison studies. One study (3065 participants) tested the accuracy of the NEXUS criteria; the sensitivity was 1.00 (95% CI 0.88 to 1.00) and specificity was 0.20 (95% CI 0.18 to 0.21) (low-certainty evidence). One retrospective study (12,537 participants) evaluated the PEDSPINE criteria and found a sensitivity of 0.93 (95% CI 0.78 to 0.99) and specificity of 0.70 (95% CI 0.69 to 0.72) (very low-certainty evidence). We did not pool data within the broader CDR categories or investigate heterogeneity due to the small quantity of data and the clinical heterogeneity of studies. Two studies were at high risk of bias. We identified two studies that are awaiting classification pending further information and two ongoing studies.

AUTHORS' CONCLUSIONS

There is insufficient evidence to determine the diagnostic test accuracy of CDRs to detect CSIs in children following blunt trauma, particularly for children under eight years of age. Although most studies had a high sensitivity, this was often achieved at the expense of low specificity and should be interpreted with caution due to a small number of CSIs and wide CIs. Well-designed, large studies are required to evaluate the accuracy of CDRs for the cervical spine clearance in children following blunt trauma, ideally in direct comparison with each other.

Pediatric Thoracolumbar Spinal Injuries in United States Trauma Centers

OBJECTIVES

Injuries are the leading cause of morbidity and mortality in children ages 1 to 18 years. There are limited studies about pediatric thoracolumbar (TL) spinal injuries; the purpose of this study was to characterize TL spinal injuries among pediatric patients evaluated in US trauma centers.

METHODS

This was a retrospective cohort study of the National Trauma Data Bank. Patients aged 1 to 18 years with a thoracic or lumbar spinal injury sustained by blunt trauma during calendar years 2011 through 2016 were included. Cervical spinal injuries, death before arrival, or penetrating trauma were excluded. The data was abstracted, and missing data was addressed by imputations. Data was analyzed using descriptive statistics and multinomial logistic regressions.

RESULTS

A total of 20,062 patients were included in the study. Thoracolumbar spinal injuries were more commonly sustained by 16- to 17-year-olds (45.7%), boys (56.6%), and White (74.8%). The injuries were often from a motor vehicle collision (MVC) (55.2%) and resulted in a bone injury (82.3%). Mechanism of injury and age were significant in predicting injury type. A fall was more likely than MVC to result in disc injury (odds ratio [OR], 1.70; 95% confidence interval [CI], 1.24-2.33), strain injury (OR, 1.18; 95% CI, 1.05-1.34), or cord injury (OR, 1.27; 95% CI, 1.12-1.45). Younger children were more likely than adolescents to present with disc injury (OR, 2.79; 95% CI, 1.75-4.45), cord injury (OR, 1.46; 95% CI, 1.18-1.81), or strain injury (OR, 1.37; 95% CI, 1.09-1.72).

CONCLUSIONS

To our knowledge, this is the largest pediatric TL spinal study. Clinicians should consider TL spinal injuries when adolescents present after an MVC, and specifically, TL spinal cord injuries when young children present after a fall. Additionally, pediatric TL spinal injury prevention should highlight motor vehicle and fall safety.

Development of a New Emergency Medicine Spinal Immobilization Protocol for Pediatric Trauma Patients and First Applicability Test on Emergency Medicine Personnel

OBJECTIVES

The purpose of this study was to (i) develop a protocol that supports decision making for prehospital spinal immobilization in pediatric trauma patients based on evidence from current scientific literature and (ii) perform an applicability test on emergency medicine personnel.

METHODS

A structured search of the literature published between 1980 and 2019 was performed in MEDLINE using PubMed. Based on this literature search, a new Emergency Medicine Spinal Immobilization Protocol for pediatric trauma patients (E.M.S. IMMO Protocol Pediatric) was developed. Parameters found in the literature, such as trauma mechanism and clinical findings that accounted for a high probability of spinal injury, were included in the protocol. An applicability test was administered to German emergency medicine personnel using a questionnaire with case examples to assess correct decision making according to the protocol.

RESULTS

The E.M.S. IMMO Protocol Pediatric was developed based on evidence from published literature. In the applicability test involving 44 emergency medicine providers revealed that 82.9% of participants chose the correct type of immobilization based on the protocol. A total of 97.8% evaluated the E.M.S. IMMO Protocol Pediatric as helpful.

CONCLUSIONS

Based on the current literature, the E.M.S. IMMO Protocol Pediatric was developed in accordance with established procedures used in trauma care. The decision regarding immobilization is made on based on the cardiopulmonary status of the patient, and life-threatening injuries are treated with priority. If the patient presents in stable condition, the necessity for full immobilization is assessed based upon the mechanisms of injury, assessment of impairment, and clinical examination.

Pediatric evidence-based imaging guidelines for adult trauma providers significantly reduces radiation exposure to children

Introduction

Evidence suggests that stand-alone pediatric trauma centers outperform adult and combined adult/pediatric trauma centers in limiting radiation exposure to injured children. We sought to determine the impact of implementing evidence-based guidelines for pediatric imaging at a combined adult (level 1) and pediatric (level 2) center. The initiative focused on trauma/critical care surgeons as the pediatric surgeons did not participate in the resuscitation and initial evaluation of injured children.

Methods

Imaging guidelines were developed from existing clinical studies. After 3 months of education, guidelines were implemented, and regular feedback was given to providers regarding compliance. Data were collected from the trauma registry for all pediatric patients (aged less than 15 years), in calendar years 2017 (pre-guideline) and 2019 (post-guideline). All admissions were analyzed, with subgroup analysis of children with multisystem trauma admitted to the trauma surgery service.

Results

Following guideline implementation, mean computed tomography (CT) scans per injured child fell by over 50% (.93 vs .45). For patients admitted to the trauma service, the mean fell by 58% (1.82 vs 0.76). The number of patients receiving more than 1 CT significantly decreased for all children (26% vs 10%), and particularly those admitted to the trauma service (52% vs 17%). During this time, there was only one injury missed at the initial admission, which was clinically insignificant (non-displaced skull fracture).

Conclusions

Implementation of evidence-based guidelines for imaging eliminates disparity in practices between a combined adult/pediatric trauma center and stand-alone pediatric trauma centers.

Development and first application testing of a new protocol for CT-based stability evaluation of the injured upper cervical spine

PURPOSE

For trauma surgeons, the evaluation of the stability of the upper cervical spine may be demanding. The aim of this study was to develop a protocol for decision-making on upper cervical spine stability in trauma patients based on established parameters obtained by CT imaging as well as testing the protocol by having it applied by trauma surgeons.

METHODS

A structured literature search on upper cervical spine stability was performed. The best evaluated instability criteria in CT imaging were determined. Based on these parameters a protocol for stability evaluation of the injured upper cervical spine was developed. A first application testing was performed. In addition to the assessment of instability, the time required for the assessment was analyzed.

RESULTS

A protocol for CT-based stability evaluation of the injured upper cervical spine based on the current literature was developed and displayed in a flow chart. Testing of the protocol found the stability of the cervical spine was correctly assessed in 55 of 56 evaluations (98.2%). In one test run, a stable upper cervical spine was judged to be unstable. Further analysis showed that this case was based on a measurement error. The assessment time of CT-images decreased significantly during repeat application of the protocol (p < 0.0001), from 336 ± 108 s (first case) to 180 ± 30 s (fourth case).

CONCLUSION

The protocol can be applied quickly and safely by non-specialized trauma surgeons. Thus, the protocol can support the decision-making process in CT-based evaluation of the stability of the injured upper cervical spine.

Pediatric cervical spine injury in the United States: Defining the burden of injury, need for operative intervention, and disparities in imaging across trauma centers

BACKGROUND

Pediatric cervical spine injury (PCSI) in children is rare. Incidence of PCSI requiring intervention is not known, and imaging practices for screening in United States trauma centers are not well described.

METHODS

The 2016 NTDB was queried for patients younger than 15 years with PCSI. Incidence of PCSI, operative interventions, and imaging rates were analyzed by age and ACS accreditation status.

RESULTS

Of 84,554 children, 873 (1.03%) had PCSI. Patients <4 years were less likely to have PCSI (0.68% vs. 1.1%, RR 0.59, p < 0.001). 165 children (0.20%) required an intervention for PCSI. 12.8% of all children were screened for PCSI with imaging, 9.3% with CT, and 3.2% with plain X-rays. In spite of similar injury and intervention rates, stand-alone pediatric trauma centers were less likely than others to image patients without PCSI (11% vs. 13% p < 0.001), less likely to utilize CT scan (5.8% vs. 10.6% p < 0.001) and more likely to utilize plain films (5.2% vs. 2.4% p < 0.001).

CONCLUSION

Despite exceedingly low rates of PSCI requiring intervention (0.2%), imaging rates for screening are significant. Stand-alone pediatric trauma centers outperform others in limiting unnecessary imaging.

LEVEL OF EVIDENCE

IV.

A Standardized Protocol for Cervical Spine Evaluation in Children Reduces Imaging Utilization: A Pilot Study of the Pediatric Cervical Spine Clearance Working Group Protocol

BACKGROUND

Cervical spine injuries (CSI) have the potential to cause severe morbidity in children. Multiple imaging studies are used during evaluation of CSIs but come at a cost, both financially and in radiation exposure. To reduce resource utilization and radiation exposure, we implemented the Pediatric Cervical Spine Clearance Working Group (PCSCWG) standardized protocol (SP) for evaluating CSIs in children.

METHODS

Children below 18 years old presenting with concern for CSI at a level 1 pediatric trauma center were reviewed before (July 2015 to May 2016) and after (November 2017 to June 2018) protocol implementation. Demographics, injuries, and imaging utilization were extracted. The primary outcomes were the proportion of patients cleared with clinical exam, and the proportion undergoing x-ray, computed tomography, or magnetic resonance image. The secondary outcome was the estimated difference in imaging charges based on the annual reduction in radiographic studies.

RESULTS

During the study 359 children were evaluated for CSIs (248 pre-SP, 111 post-SP). Patients were similar with respect to age, injury severity score, and mechanism of injury. Protocol adherence was 87.4%. The prevalence of CSI was similar in the preprotocol and postprotocol cohorts (2.8% vs. 1.8%, P=0.567). Children treated after protocol implementation were significantly more likely to be cleared by clinical exam (15.3% vs. 43.2%, P<0.001). Significantly fewer children had x-rays (70.2% vs. 55.0%, P=0.005) and computed tomography scans (14.5% vs. 5.4%, P=0.013) in the postprotocol period. There was no difference in the utilization of magnetic resonance image (6.9% vs. 7.2%, P=0.904) or the proportion of children discharged with a cervical collar (10.1% vs. 12.6%, P=0.476). No patients in either group were found to have a previously undiagnosed injury at follow-up. The reduction in radiographic studies translates to an estimated annual reduction in imaging charges of $396,476.

CONCLUSIONS

The PCSCWG protocol for evaluating CSIs reduced the number of radiographic studies performed and estimated imaging charges while reliably identifying CSIs.

Cervical spine evaluation in pediatric trauma: A cost-effectiveness analysis

OBJECTIVE

The emergent evaluation of children with suspected traumatic cervical spine injuries (CSI) remains a challenge. Pediatric clinical pathways have been developed to stratify the risk of CSI and guide computed tomography (CT) utilization. The cost-effectiveness of their application has not been evaluated. Our objective was to examine the cost-effectiveness of three common strategies for the evaluation of children with suspected CSI after blunt injury.

METHODS

We developed a decision analytic model comparing these strategies to estimate clinical outcomes and costs for a hypothetical population of 0-17 year old patients with blunt neck trauma. Strategies included: 1) clinical pathway to stratify risk using NEXUS criteria and determine need for diagnostic testing; 2) screening radiographs as a first diagnostic; and 3) immediate CT scanning for all patients. We measured effectiveness with quality-adjusted life years (QALYs), and costs with 2018 U.S. dollars. Costs and effectiveness were discounted at 3% per year.

RESULTS

The use of the clinical pathway results in a gain of 0.04 QALYs and a cost saving of $2800 compared with immediate CT scanning of all patients. Use of the clinical pathway was less costly and more effective than immediate CT scan as long as the sensitivity of the clinical prediction rule was greater than 87% and when the sensitivity of x-ray was greater than 84%.

CONCLUSION

A strategy using a clinical pathway to first stratify risk before further diagnostic testing was less costly and more effective than either performing CT scanning or screening cervical radiographs on all patients.

[Development and first application testing of a new protocol for preclinical spinal immobilization in children : Assessment of indications based on the E.M.S. IMMO Protocol Pediatric]

BACKGROUND

To protect the spine from secondary damage, spinal immobilization is a standard procedure in prehospital trauma management. Immobilization protocols aim to support emergency medicine personnel in quick decision making but predominantly focus on the adult spine; however, trauma mechanisms and injury patterns in adults differ from those in children and applying adult prehospital immobilization protocols to pediatric patients may be insufficient. Adequate protocols for children with spinal injuries are currently unavailable.

OBJECTIVE

The aim of this study was (i) to develop a protocol that supports decision making for prehospital spinal immobilization in pediatric trauma patients based on evidence from current scientific literature and (ii) to perform a first analysis of the quality of results if the protocol is used by emergency personnel.

MATERIAL AND METHODS

Based on a structured literature search a new immobilization protocol was developed. Analysis of the quality of results was performed by a questionnaire containing four case scenarios in order to assess correct decision making. The decision about spinal immobilization was made without and with the utilization of the protocol.

RESULTS

The E.M.S. IMMO Protocol Pediatric was developed based on the literature. The analysis of the quality of results was performed involving 39 emergency medicine providers. It could be shown that if the E.M.S. IMMO Protocol Pediatric was used, the correct type of immobilization was chosen more frequently. A total of 38 out of 39 participants evaluated the protocol as helpful.

CONCLUSION

The E.M.S. IMMO Protocol Pediatric provides decision-making support whether pediatric spine immobilization is indicated with respect to the cardiopulmonary status of the patient. In a first analysis, the E.M.S. IMMO Protocol Pediatric improves decision making by emergency medical care providers.

Prediction of cervical spine injury in young pediatric patients: an optimal trees artificial intelligence approach

BACKGROUND

Cervical spine injuries (CSI) are a major concern in young pediatric trauma patients. The consequences of missed injuries and difficulties in injury clearance for non-verbal patients have led to a tendency to image young children. Imaging, particularly computed tomography (CT) scans, presents risks including radiation-induced carcinogenesis. In this study we leverage machine learning methods to develop highly accurate clinical decision rules to predict pediatric CSI.

METHODS

The PEDSPINE I registry was used to investigate CSI in blunt trauma patients under the age of three. Predictive models were built using Optimal Classification Trees, a novel machine learning approach offering high accuracy and interpretability, as well as other widely used machine learning methods.

RESULTS

The final Optimal Classification Trees model predicts injury based on overall Glasgow Coma Score (GCS) and patient age. This model has a sensitivity of 93.3% and specificity of 82.3% on the full dataset. It has comparable or superior performance to other machine learning methods as well as existing clinical decision rules.

CONCLUSIONS

This study developed a decision rule that achieves high injury identification while reducing unnecessary imaging. It demonstrates the value of machine learning in improving clinical decision protocols for pediatric trauma.

TYPE OF STUDY

Retrospective Prognosis Study.

LEVEL OF EVIDENCE

II.

Single-lateral cervical radiograph in pediatric trauma is equivalent to multiple views

BACKGROUND

Cervical spine injuries (CSI) are rare within the pediatric population. Due to the significant consequences of missed CSI, children are often imaged excessively. In an attempt to decrease imaging of the cervical spine in children, we reviewed abnormal cervical radiographs (XR) to determine if the diagnosis of CSI could be made using a single-lateral cervical radiograph (LAT). Furthermore, we reviewed cervical computed tomography (CT) and magnetic resonance imaging (MRI) to ensure there were no missed CSI.

METHODS

Electronic medical records of trauma patients treated at a Level I Pediatric Trauma Center with abnormal XR findings followed by confirmatory CT or MRI between 2012 and 2017 were reviewed. All abnormal imaging on XR was compared with the LAT. In addition, all abnormal CTs and MRIs were reviewed to ensure there were no false negative XR.

RESULTS

A total of 3,735 XR were performed with 26 abnormal interpretations. All bony CSI were visualized on LAT. Confirmatory imaging found 13 (50%) were false positive and 13 (50%) were true positive. Secondary analysis of CT identified 12 injuries with prior XR; 8 of 12 LAT identifying the injury and 4 of 12 false positive on CT. Secondary analysis of MRI identified nine injuries with prior XR; 5 of 9 LAT identifying the injury. The four false-negative reads on MRI were ligamentous injuries.

CONCLUSION

Radiographs are commonly performed when evaluating CSI. In our population, initial assessment with a single LAT was equivalent to a multiple view XR. On secondary review, the only false-negative LAT reports were due to ligamentous injuries. This data suggests limiting exposure to LAT would accomplish the goal of reducing imaging without missing bony CSI and when ligamentous injury is suspected MRI should be the confirmatory study rather than CT.

LEVEL OF EVIDENCE

Diagnostic Test, level III.

Implementation of a CT scan practice guideline for pediatric trauma patients reduces unnecessary scans without impacting outcomes

INTRODUCTION

Computed tomography (CT) scans are useful in the evaluation of trauma patients, but are costly and pose risks from ionizing radiation in children. Recent literature has demonstrated the use of CT scan guidelines in the management of pediatric trauma. The study objective is to review our treatment of pediatric blunt trauma patients and evaluate CT use before and after CT-guideline implementation.

METHODS

Our Pediatric Level 2 Trauma Center (TC) implemented a CT scan practice guideline for pediatric trauma patients in March 2014. The guideline recommended for or against CT of the head and abdomen/pelvis using published criteria from the Pediatric Emergency Care and Research Network. There was no chest CT guideline. We reviewed all pediatric trauma patients for CT scans obtained during initial evaluation before and after guideline implementation, excluding inpatient scans. The Trauma Registry Database was queried to include all pediatric (age < 15) trauma patients seen in our TC from 2010 to 2016, excluding penetrating mechanism and deaths in the TC. Scans were considered positive if organ injury was detected. Primary outcome was the proportion of patients undergoing CT and percent positive CTs. Secondary outcomes were hospital length of stay, readmissions, and mortality. Categorical and continuous variables were analyzed with χ and Wilcoxon rank-sum tests, respectively. p < 0.05 was considered significant.

RESULTS

We identified 1,934 patients: 1,106 pre- and 828 post-guideline. Absolute reductions in head, chest, and abdomen/pelvis CT scans were 17.7%, 11.5%, and 18.8%, respectively (p < 0.001). Percent positive head CTs were equivalent, but percent positive chest and abdomen CT increased after implementation. Secondary outcomes were unchanged.

CONCLUSIONS

Implementation of a pediatric CT guideline significantly decreases CT use, reducing the radiation exposure without a difference in outcome. Trauma centers treating pediatric patients should adopt similar guidelines to decrease unnecessary CT scans in children.

LEVEL OF EVIDENCE

Therapeutic study, level IV.

Statistical evaluation of diagnostic tests: A primer for pediatric surgeons

BACKGROUND/PURPOSE

Diagnostic tests are of paramount importance for informing decision making in the surgical setting. Certain statistical methods are necessary to properly analyze data for diagnostic or prognostic tests involving biomarkers and risk factor data. Our goal is to provide a useful primer for the surgical researcher when performing a diagnostic research study in order to best analyze their data.

METHODS

We present the key concepts and statistics for diagnostic tests and receiver operating characteristic (ROC) curve analysis, and we illustrate each with hypothetical surgery research examples. We use hypothetical data regarding CT imaging and WBC count in their diagnostic ability in predicting acute appendicitis, an extremely common surgical condition, while reviewing the statistical concepts of sensitivity, specificity, positive and negative predictive value, positive and negative likelihood ratio, relative risk, odds ratio, and ROC curves. Then we will consider a hypothetical a risk factor analysis on 30-day readmission to illustrate how multiple predictors can be combined.

CONCLUSIONS

The statistical concepts presented are useful to the pediatric surgeon researcher in assessing the ability of diagnostic tests, which will translate into decision making and patient management implications in the clinical setting.

TYPE OF STUDY

Review Article LEVEL OF EVIDENCE: N/A.