Validation of the PediBIRN-7 clinical prediction rule for pediatric abusive head trauma

BACKGROUND

The PediBIRN-7 clinical prediction rule incorporates the (positive or negative) predictive contributions of completed abuse evaluations to estimate abusive head trauma (AHT) probability after abuse evaluation. Applying definitional criteria as proxies for AHT and non-AHT ground truth, it performed with sensitivity 0.73 (95 % CI: 0.66-0.79), specificity 0.87 (95 % CI: 0.82-0.90), and ROC-AUC 0.88 (95 % CI: 0.85-0.92) in its derivation study.

OBJECTIVE

To validate the PediBIRN-7's AHT prediction performance in a novel, equivalent, patient population.

PARTICIPANTS AND SETTINGS

Consecutive, acutely head-injured children <3 years hospitalized for intensive care across eight sites between 2017 and 2020 with completed skeletal surveys and retinal exams (N = 342).

METHODS

Secondary analysis of an existing, cross-sectional, prospective dataset, including assignment of patient-specific estimates of AHT probability, calculation of AHT prediction performance measures (ROC-AUC, sensitivity, specificity, predictive values), and completion of sensitivity analyses to estimate best- and worst-case prediction performances.

RESULTS

Applying the same definitional criteria, the PediBIRN-7 performed with sensitivity 0.74 (95 % CI: 0.66-0.81), specificity 0.77 (95 % CI: 0.70-0.83), and ROC-AUC 0.83 (95 % CI: 0.78-0.88). The reduction in ROC-AUC was statistically insignificant (p = .07). Applying physicians' final consensus diagnoses as proxies for AHT and non-AHT ground truth, the PediBIRN-7 performed with sensitivity 0.73 (95 % CI: 0.66-0.79), specificity 0.87 (95 % CI: 0.82-0.90), and ROC-AUC 0.90 (95 % CI: 0.87-0.94). Sensitivity analyses demonstrated minimal changes in rule performance.

CONCLUSION

The PediBIRN-7's overall AHT prediction performance has been validated in a novel, equivalent, patient population. Its patient-specific estimates of AHT probability can inform physicians' AHT-related diagnostic reasoning after abuse evaluation.

Development of Fibro-PeN, a clinical prediction model for moderate-to-severe fibrosis in children with nonalcoholic fatty liver disease

BACKGROUND AND AIMS

Liver fibrosis is common in children with NAFLD and is an important determinant of outcomes. High-performing noninvasive models to assess fibrosis in children are needed. The objectives of this study were to evaluate the performance of existing pediatric and adult fibrosis prediction models and to develop a clinical prediction rule for identifying moderate-to-severe fibrosis in children with NAFLD.

APPROACH AND RESULTS

We enrolled children with biopsy-proven NAFLD in the Nonalcoholic Steatohepatitis Clinical Research Network within 90 days of liver biopsy. We staged liver fibrosis in consensus using the Nonalcoholic Steatohepatitis Clinical Research Network scoring system. We evaluated existing pediatric and adult models for fibrosis and developed a new pediatric model using the least absolute shrinkage and selection operator with linear and spline terms for discriminating moderate-to-severe fibrosis from none or mild fibrosis. The model was internally validated with 10-fold cross-validation. We evaluated 1055 children with NAFLD, of whom 26% had moderate-to-severe fibrosis. Existing models performed poorly in classifying fibrosis in children, with area under the receiver operator curves (AUC) ranging from 0.57 to 0.64. In contrast, our new model, fibrosis in pediatric NAFLD was derived from fourteen common clinical variables and had an AUC of 0.79 (95% CI: 0.77-0.81) with 72% sensitivity and 76% specificity for identifying moderate-to-severe fibrosis.

CONCLUSION

Existing fibrosis prediction models have limited clinical utility in children with NAFLD. Fibrosis in pediatric NAFLD offers improved performance characteristics for risk stratification by identifying moderate-to-severe fibrosis in children with NAFLD.

Effectiveness of implementation strategies for increasing clinicians' use of five validated imaging decision rules for musculoskeletal injuries: a systematic review

BACKGROUND

Strategies to enhance clinicians' adherence to validated imaging decision rules and increase the appropriateness of imaging remain unclear.

OBJECTIVE

To evaluate the effectiveness of various implementation strategies for increasing clinicians' use of five validated imaging decision rules (Ottawa Ankle Rules, Ottawa Knee Rule, Canadian C-Spine Rule, National Emergency X-Radiography Utilization Study and Canadian Computed Tomography Head Rule).

DESIGN

Systematic review.

METHODS

The inclusion criteria were experimental, quasi-experimental study designs comprising randomised controlled trials (RCTs), non-randomised controlled trials, and single-arm trials (i.e. prospective observational studies) of implementation interventions in any care setting. The search encompassed electronic databases up to March 11, 2024, including MEDLINE (via Ovid), CINAHL (via EBSCO), EMBASE (via Ovid), Cochrane CENTRAL, Web of Science, and Scopus. Two reviewers assessed the risk of bias of studies independently using the Cochrane Effective Practice and Organization of Care Group (EPOC) risk of bias tool. The primary outcome was clinicians' use of decision rules. Secondary outcomes included imaging use (indicated, non-indicated and overall) and knowledge of the rules.

RESULTS

We included 22 studies (5-RCTs, 1-non-RCT and 16-single-arm trials), conducted in emergency care settings in six countries (USA, Canada, UK, Australia, Ireland and France). One RCT suggested that reminders may be effective at increasing clinicians' use of Ottawa Ankle Rules but may also increase the use of ankle radiography. Two RCTs that combined multiple intervention strategies showed mixed results for ankle imaging and head CT use. One combining educational meetings and materials on Ottawa Ankle Rules reduced ankle injury imaging among ED physicians, while another, with similar efforts plus clinical practice guidelines and reminders for the Canadian CT Head Rule, increased CT imaging for head injuries. For knowledge, one RCT suggested that distributing guidelines had a limited short-term impact but improved clinicians' long-term knowledge of the Ottawa Ankle Rules.

CONCLUSION

Interventions such as pop-up reminders, educational meetings, and posters may improve adherence to the Ottawa Ankle Rules, Ottawa Knee Rule, and Canadian CT Head Rule. Reminders may reduce non-indicated imaging for knee and ankle injuries. The uncertain quality of evidence indicates the need for well-conducted RCTs to establish effectiveness of implementation strategies.

Performance of Febrile Infant Algorithms by Duration of Fever

OBJECTIVES

To analyze the performance of commonly used blood tests in febrile infants ≤90 days of age to identify patients at low risk for invasive bacterial infection (bacterial pathogen in blood or cerebrospinal fluid) by duration of fever.

METHODS

We conducted a secondary analysis of a prospective single-center registry that includes all consecutive infants ≤90 days of age with fever without a source evaluated at 1 pediatric emergency department between 2008 and 2021. We defined 3 groups based on caregiver-reported hours of fever (<2, 2-12, and ≥12) and analyzed the performance of the biomarkers and Pediatric Emergency Care Applied Research Network, American Academy of Pediatrics, and Step-by-Step clinical decision rules.

RESULTS

We included 2411 infants; 76 (3.0%) were diagnosed with an invasive bacterial infection. The median duration of fever was 4 (interquartile range, 2-12) hours, with 633 (26.3%) patients with fever of <2 hours. The area under the curve was significantly lower in patients with <2 hours for absolute neutrophil count (0.562 vs 0.609 and 0.728) and C-reactive protein (0.568 vs 0.760 and 0.812), but not for procalcitonin (0.749 vs 0.780 and 0.773). Among well-appearing infants older than 21 days and negative urine dipstick with <2 hours of fever, procalcitonin ≥0.14 ng/mL showed a better sensitivity (100% with specificity 53.8%) than that of the combination of biomarkers of Step-by-Step (50.0% and 82.2%), and of the American Academy of Pediatrics and Pediatric Emergency Care Applied Research Network rules (83.3% and 58.3%), respectively.

CONCLUSIONS

The performance of blood biomarkers, except for procalcitonin, in febrile young infants is lower in fever of very short duration, decreasing the accuracy of the clinical decision rules.

Clinical decision rules for appendicitis are not used by surgeons in training: A survey

BACKGROUNDS

We aimed to investigate surgeons in training knowledge of clinical decision rules (CDR) for diagnosing appendicitis and their attitudes toward implementing them.

METHODS

We included surgeons in training practicing in East Denmark who independently could decide to perform a diagnostic laparoscopy for suspected appendicitis. The survey was developed in Research Electronic Data Capture and face-validated before use. It consisted of three parts: (1) the characteristics of the surgeons, (2) their diagnostic approach, and (3) their knowledge and attitude toward introducing CDR in the clinic. Data were collected in January 2023.

RESULTS

We achieved 83 (90%) responses, and 52% of surgeons in training believed that appendicitis was difficult to diagnose. Their diagnostic approach mostly included symptoms and physical examinations for abdominal pain, and C-reactive protein. A total of 48% knew of at least one clinical decision rule, and 72% had never used a clinical decision rule. Regarding the necessity of CDR in clinical practice, surgeons in training options were divided into thirds: not needed, neither needed nor not needed, and needed. Surgeons in training indicated that CDR needed to be validated and easily applied before they would implement them.

CONCLUSION

Approximately 3/4 of surgeons in training had never utilized a clinical decision rule to diagnose appendicitis, and only half knew of their existence. The symptoms and findings incorporated in most CDR aligned with their diagnostic approach. They were conflicted if CDR needed to be implemented in clinical practice.

Paediatric meningitis in the conjugate vaccine era and a novel clinical decision model to predict bacterial aetiology

OBJECTIVES

The aims of this study were to assess aetiology and clinical characteristics in childhood meningitis, and develop clinical decision rules to distinguish bacterial meningitis from other similar clinical syndromes.

METHODS

Children aged <16 years hospitalised with suspected meningitis/encephalitis were included, and prospectively recruited at 31 UK hospitals. Meningitis was defined as identification of bacteria/viruses from cerebrospinal fluid (CSF) and/or a raised CSF white blood cell count. New clinical decision rules were developed to distinguish bacterial from viral meningitis and those of alternative aetiology.

RESULTS

The cohort included 3002 children (median age 2·4 months); 1101/3002 (36·7%) had meningitis, including 180 bacterial, 423 viral and 280 with no pathogen identified. Enterovirus was the most common pathogen in those aged <6 months and 10-16 years, with Neisseria meningitidis and/or Streptococcus pneumoniae commonest at age 6 months to 9 years. The Bacterial Meningitis Score had a negative predictive value of 95·3%. We developed two clinical decision rules, that could be used either before (sensitivity 82%, specificity 71%) or after lumbar puncture (sensitivity 84%, specificity 93%), to determine risk of bacterial meningitis.

CONCLUSIONS

Bacterial meningitis comprised 6% of children with suspected meningitis/encephalitis. Our clinical decision rules provide potential novel approaches to assist with identifying children with bacterial meningitis.

FUNDING

This study was funded by the Meningitis Research Foundation, Pfizer and the NIHR Programme Grants for Applied Research.

Derivation of a clinical decision rule to exclude cerebral venous sinus thrombosis in emergency department patients: A retrospective cohort study

OBJECTIVE

To derive a clinical decision rule to exclude cerebral venous sinus thrombosis (CVST) in the ED. A secondary aim was to derive a rule that incorporated clinical parameters and the non-contrast CT brain.

METHODS

Single-centre, retrospective cohort study. Patients suspected of CVST were identified from the radiology database for CT/MR venograms. Clinical features included in the rule were determined by literature review. The presence of these features in participants was determined by chart review. Variables were tested for univariate association with CVST using logistic regression. Variable selection was accomplished using a forward-stepwise process, calculating the sensitivity/specificity of a rule containing the variable of most significance, then repeating the process after adding the next most significant variable.

RESULTS

Forty-five out of 912 participants had confirmed CVST. The primary clinical rule was answering 'no' to all the following: any prothrombotic risk factor, age ≥54 years, confusion: sensitivity 95.6% (95% confidence interval [CI] 84.9-99.5%), specificity 40.9% (95% CI 37.6-44.2%), negative predictive value 99.4% (95% CI 97.9-99.9%) and positive predictive value 7.7% (95% CI 7.1-8.3%). The rule classified 39.5% of participants as CVST ruled out. The rule incorporating the non-contrast CT brain was answering 'no' to all the following: abnormal non-contrast CT brain, any prothrombotic risk-factor, age ≥54 years, confusion: sensitivity 100.0% (95% CI 91.6-100.0%), specificity 42.0% (95% CI 38.7-45.4%), negative predictive value 100.0% (95% CI not calculated) and positive predictive value 7.8% (95% CI 7.4-8.2%). The rule classified 40.0% of participants as CVST ruled out.

CONCLUSIONS

A clinical decision rule was derived to rule out CVST. These results require validation before adoption into clinical practice.

Evaluating Clinical Prediction Rules for Bacteremia Detection in the Emergency Department: A Retrospective Review

BACKGROUND

Bacteremia is a major cause of morbidity. Blood cultures are the gold standard for diagnosing bacteremia.

OBJECTIVE

To compare previously published clinical decision rules for predicting a true positive blood culture (bacteremia) in the emergency department.

METHODS

Retrospective analysis of medical records of patients who had a blood culture performed in a tertiary hospital emergency department in 2020 (12 months). Positive blood cultures were compared with randomly selected negative blood cultures (1:4 ratio). Blood cultures were analyzed per patient presentation. Clinical data from patient presentations were extracted and appraised against the modified-Shapiro (mShapiro) rule and systemic inflammatory response syndrome (SIRS) criteria to calculate diagnostic accuracy to detect bacteremia.

RESULTS

During the study period, 3870 blood cultures were taken from 2921 patients: 476 (12.3%) cultures were positive for bacterial growth, from 421 individual patient presentations (10 excluded as incomplete data). Of included patients, 338 were true positives and 73 contaminates, these were compared with 1446 patients with negative blood culture presentations. Evaluating mShapiro's rule and SIRS criteria to detect bacteremia vs. no bacteremia (negative + contaminated cultures) had a sensitivity of 94.4% (95% confidence interval [CI] 91.4-96.4%) and 84.9% (95% CI 80.7-88.3%), respectively, and a specificity of 37.9% (95% CI 35.5-40.1%) and 33.8% (95% CI 31.5-36.3%), respectively. Both had a high negative predictive value for bacteremia of 96.8% (95% CI 95.1-98.0) and 91.0% (95% CI 88.3-93.1) for mShapiro's rule and SIRS criteria, respectively.

CONCLUSIONS

In this cohort, mShapiro's rule performed better than the SIRS criteria at predicting bacteremia.

Prospective validity of a clinical prediction rule for response to non-surgical multidisciplinary management of knee osteoarthritis in tertiary care: a multisite prospective longitudinal study

OBJECTIVES

We tested a previously developed clinical prediction tool-a nomogram consisting of four patient measures (lower patient-expected benefit, lower patient-reported knee function, greater knee varus angle and severe medial knee radiological degeneration) that were related to poor response to non-surgical management of knee osteoarthritis. This study sought to prospectively evaluate the predictive validity of this nomogram to identify patients most likely to respond poorly to non-surgical management of knee osteoarthritis.

DESIGN

Multisite prospective longitudinal study.

SETTING

Advanced practice physiotherapist-led multidisciplinary service across six tertiary hospitals.

PARTICIPANTS

Participants with knee osteoarthritis deemed appropriate for trial of non-surgical management following an initial assessment from an advanced practice physiotherapist were eligible for inclusion.

INTERVENTIONS

Baseline clinical nomogram scores were collected before a trial of individualised non-surgical management commenced.

PRIMARY OUTCOME MEASURE

Clinical outcome (Global Rating of Change) was collected 6 months following commencement of non-surgical management and dichotomised to responder (a little better to a very great deal better) or poor responder (almost the same to a very great deal worse). Clinical nomogram accuracy was evaluated from receiver operating characteristics curve analysis and area under the curve, and sensitivity/specificity and positive/negative likelihood ratios were calculated.

RESULTS

A total of 242 participants enrolled. Follow-up scores were obtained from 210 participants (87% response rate). The clinical nomogram demonstrated an area under the curve of 0.70 (p<0.001), with greatest combined sensitivity 0.65 and specificity 0.64. The positive likelihood ratio was 1.81 (95% CI 1.32 to 2.36) and negative likelihood ratio 0.55 (95% CI 0.41 to 0.75).

CONCLUSIONS

The knee osteoarthritis clinical nomogram prediction tool may have capacity to identify patients at risk of poor response to non-surgical management. Further work is required to determine the implications for service delivery, feasibility and impact of implementing the nomogram in clinical practice.

Clinical prediction rules for multi surfaces walking independence using the Berg Balance Scale or Mini-Balance Evaluation Systems Test in persons with stroke

BACKGROUND

A Clinical prediction rule (CPR) for determining multi surfaces walking independence in persons with stroke has not been established.

OBJECTIVES

To develop a CPR for determining multi surfaces walking independence in persons with stroke.

METHODS

This was a multicenter retrospective analysis of 419 persons with stroke. We developed a Berg Balance Scale (BBS)-model CPR combining the BBS, comfortable walking speed (CWS) and cognitive impairment, and a Mini-Balance Evaluation Systems Test (Mini-BESTest)-model CPR combining the Mini-BESTest, CWS, and cognitive impairment. A logistic regression analysis was conducted with multi surfaces walking independence as the dependent variable and each factor as an independent variable. The identified factors were scored (0, 1) based on reported cutoff values. The CPR's accuracy was verified by the area under the curve (AUC). We used a bootstrap method internal validation and calculated the CPR's posttest probability.

RESULTS

The logistic regression analysis showed that the BBS, CWS, and cognitive impairment were factors in the BBS model, and the Mini-BESTest was a factor in the Mini-BESTest model. The CPRs were 0-3 points for the BBS model and 0-1 points for the Mini-BESTest model. The AUCs (bootstrap mean AUC) of the CPR score were 0.89 (0.90) for the BBS model and 0.72 (0.72) for the Mini-BESTest model. The negative predictive value (negative likelihood ratio) was 97% (0.054) for CPR scores < 2 for the BBS model and 94% (0.060) for CPR scores < 1 for the Mini-BESTest model.

CONCLUSIONS

The CPR developed herein is useful for determining multi surfaces walking independence.

Are Clinical Prediction Rules Used in Spinal Cord Injury Care? A Survey of Practice

Background

Accurate outcome prediction is desirable post spinal cord injury (SCI), reducing uncertainty for patients and supporting personalized treatments. Numerous attempts have been made to create clinical prediction rules that identify patients who are likely to recover function. It is unknown to what extent these rules are routinely used in clinical practice.

Objectives

To better understand knowledge of, and attitudes toward, clinical prediction rules amongst SCI clinicians in the United Kingdom.

Methods

An online survey was distributed via mailing lists of clinical special interest groups and relevant National Health Service Trusts. Respondents answered questions about their knowledge of existing clinical prediction rules and their general attitudes to using them. They also provided information about their level of experience with SCI patients.

Results

One hundred SCI clinicians completed the survey. The majority (71%) were unaware of clinical prediction rules for SCI; only 8% reported using them in clinical practice. Less experienced clinicians were less likely to be aware. Lack of familiarity with prediction rules was reported as being a barrier to their use. The importance of clinical expertise when making prognostic decisions was emphasized. All respondents reported interest in using clinical prediction rules in the future.

Conclusion

The results show widespread lack of awareness of clinical prediction rules amongst SCI clinicians in the United Kingdom. However, clinicians were positive about the potential for clinical prediction rules to support decision-making. More focus should be directed toward refining current rules and improving dissemination within the SCI community.

Accommodating misclassification effects on optimizing dynamic treatment regimes with Q-learning

Research on dynamic treatment regimes has enticed extensive interest. Many methods have been proposed in the literature, which, however, are vulnerable to the presence of misclassification in covariates. In particular, although Q-learning has received considerable attention, its applicability to data with misclassified covariates is unclear. In this article, we investigate how ignoring misclassification in binary covariates can impact the determination of optimal decision rules in randomized treatment settings, and demonstrate its deleterious effects on Q-learning through empirical studies. We present two correction methods to address misclassification effects on Q-learning. Numerical studies reveal that misclassification in covariates induces non-negligible estimation bias and that the correction methods successfully ameliorate bias in parameter estimation.

Diagnostic performance of clinical prediction rules to detect group A beta-haemolytic streptococci in people with acute pharyngitis: a systematic review

OBJECTIVE

To assess and compare the diagnostic performance of Clinical Prediction Rules (CPRs) developed to detect group A Beta-haemolytic streptococci in people with acute pharyngitis (or sore throat).

STUDY DESIGN

A systematic review.

METHODS

We searched PubMed, Embase and Web of Science (inception-September 2022) for studies deriving and/or validating CPRs comprised of ≥2 predictors from an individual's history or physical examination. Two authors independently screened articles, extracted data and assessed risk of bias in included studies. A meta-analysis was not possible due to heterogeneity. Instead we compared the performance of CPRs when they were validated in the same study population (head-to-head comparisons). We used a modified grading of recommendations, assessment, development, and evaluations (GRADE) approach to assess certainty of the evidence.

RESULTS

We included 63 studies, all judged at high risk of bias. Of 24 derived CPRs, 7 were externally validated (in 46 external validations). Five validation studies provided data for head-to-head comparison of four pairs of CPRs. Very low certainty evidence favoured the Centor CPR over the McIsaac (2 studies) and FeverPain CPRs (1 study) and found the Centor CPR was equivalent to the Walsh CPR (1 study). The AbuReesh and Steinhoff 2005 CPRs had a similar poor discriminative ability (1 study). Within and between study comparisons suggested the performance of the Centor CPR may be better in adults (>18 years).

CONCLUSION

Very low certainty evidence suggests a better performance of the Centor CPR. When deciding about antibiotic prescribing for pharyngitis patients, involving patients in a shared decision making discussion about the likely benefits and harms, including antibiotic resistance, is recommended. Further research of higher rigour, which compares CPRs across multiple settings, is needed.

Real-time artificial intelligence predicts adverse outcomes in acute pancreatitis in the emergency department: Comparison with clinical decision rule

OBJECTIVE

Artificial intelligence (AI) prediction is increasingly used for decision making in health care, but its application for adverse outcomes in emergency department (ED) patients with acute pancreatitis (AP) is not well understood. This study aimed to clarify this aspect.

METHODS

Data from 8274 ED patients with AP in three hospitals from 2009 to 2018 were analyzed. Demographic data, comorbidities, laboratory results, and adverse outcomes were included. Six algorithms were evaluated, and the one with the highest area under the curve (AUC) was implemented into the hospital information system (HIS) for real-time prediction. Predictive accuracy was compared between the AI model and Bedside Index for Severity in Acute Pancreatitis (BISAP).

RESULTS

The mean ± SD age was 56.1 ± 16.7 years, with 67.7% being male. The AI model was successfully implemented in the HIS, with Light Gradient Boosting Machine (LightGBM) showing the highest AUC for sepsis (AUC 0.961) and intensive care unit (ICU) admission (AUC 0.973), and eXtreme Gradient Boosting (XGBoost) showing the highest AUC for mortality (AUC 0.975). Compared to BISAP, the AI model had superior AUC for sepsis (BISAP 0.785), ICU admission (BISAP 0.778), and mortality (BISAP 0.817).

CONCLUSIONS

The first real-time AI prediction model implemented in the HIS for predicting adverse outcomes in ED patients with AP shows favorable initial results. However, further external validation is needed to ensure its reliability and accuracy.

A Single Dermatome Clinical Prediction Rule for Independent Walking 1 Year After Spinal Cord Injury

OBJECTIVE

To derive and validate a simple, accurate CPR to predict future independent walking ability after SCI at the bedside that does not rely on motor scores and is predictive for those initially classified in the middle of the SCI severity spectrum.

DESIGN

Retrospective cohort study. Binary variables were derived, indicating degrees of sensation to evaluate predictive value of pinprick and light touch variables across dermatomes. The optimal single sensory modality and dermatome was used to derive our CPR, which was validated on an independent dataset.

SETTING

Analysis of SCI Model Systems dataset.

PARTICIPANTS

Individuals with traumatic SCI. The data of 3679 participants (N=3679) were included with 623 participants comprising the derivation dataset and 3056 comprising the validation dataset.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Self-reported ability to walk both indoors and outdoors.

RESULTS

Pinprick testing at S1 over lateral heels, within 31 days of SCI, accurately identified future independent walkers 1 year after SCI. Normal pinprick in both lateral heels provided good prognosis, any pinprick sensation in either lateral heel provided fair prognosis, and no sensation provided poor prognosis. This CPR performed satisfactorily in the middle SCI severity subgroup.

CONCLUSIONS

In this large multi-site study, we derived and validated a simple, accurate CPR using only pinprick sensory testing at lateral heels that predicts future independent walking after SCI.

Using the Kaiser Score as a clinical decision rule for breast lesion classification: Does computer-assisted curve type analysis improve diagnosis?

PURPOSE

We aimed to investigate the effect of using visual or automatic enhancement curve type assessment on the diagnostic performance of the Kaiser Score (KS), a clinical decision rule for breast MRI.

METHOD

This IRB-approved retrospective study analyzed consecutive conventional BI-RADS 0, 4 or 5 patients who underwent biopsy after 1.5T breast MRI according to EUSOBI recommendations between 2013 and 2015. The KS includes five criteria (spiculations; signal intensity (SI)-time curve type; margins of the lesion; internal enhancement; and presence of edema) resulting in scores from 1 (=lowest) to 11 (=highest risk of breast cancer). Enhancement curve types (Persistent, Plateau or Wash-out) were assessed by two radiologists independently visually and using a pixel-wise color-coded computed parametric map of curve types. KS diagnostic performance differences between readings were compared by ROC analysis.

RESULTS

In total 220 lesions (147 benign, 73 malignant) including mass (n = 148) and non-mass lesions (n = 72) were analyzed. KS reading performance in distinguishing benign from malignant lesions did not differ between visual analysis and parametric map (P = 0.119; visual: AUC 0.875, sensitivity 95 %, specificity 63 %; and map: AUC 0.901, sensitivity 97 %, specificity 65 %). Additionally, analyzing mass and non-mass lesions separately, showed no difference between parametric map based and visual curve type-based KS analysis as well (P = 0.130 and P = 0.787).

CONCLUSIONS

The performance of the Kaiser Score is largely independent of the curve type assessment methodology, confirming its robustness as a clinical decision rule for breast MRI in any type of breast lesion in clinical routine.

A clinical decision rule to rule out bloodstream infection in the emergency department: retrospective multicentric observational cohort study

BACKGROUND

We aimed to identify patients at low risk of bloodstream infection (BSI) in the ED.

METHODS

We derived and validated a prediction model to rule out BSI in the ED without the need for laboratory testing by determining variables associated with a positive blood culture (BC) and assigned points according to regression coefficients. This retrospective study included adult patients suspected of having BSI (defined by at least one BC collection) from two European ED between 1 January 2017 and 31 December 2019. The primary end point was the BSI rate in the validation cohort for patients with a negative Bacteremia Rule Out Criteria (BAROC) score. The effect of adding laboratory variables to the model was evaluated as a second step in a two-step diagnostic strategy.

RESULTS

We analysed 2580 patients with a mean age of 64 years±21, of whom 46.1% were women. The derived BAROC score comprises 12 categorical clinical variables. In the validation cohort, it safely ruled out BSI without BCs in 9% (58/648) of patients with a sensitivity of 100% (95% CI 95% to 100%), a specificity of 10% (95% CI 8% to 13%) and a negative predictive value of 100% (95% CI 94% to 100%). Adding laboratory variables (creatinine ≥177 µmol/L (2.0 mg/dL), platelet count ≤150 000/mm3 and neutrophil count ≥12 000/mm3) to the model, ruled out BSI in 10.2% (58/570) of remaining patients who had been positive on the BAROC score. The BAROC score with laboratory results had a sensitivity of 100% (95% CI 94% to 100%), specificity of 11% (95% CI 9% to 14%) and negative predictive value of 100% (95% CI 94 to 100%). In the validation cohort, there was no evidence of a difference in discrimination between the area under the receiver operating characteristic for BAROC score with versus without laboratory testing (p=0.6).

CONCLUSION

The BAROC score safely identified patients at low risk of BSI and may reduce BC collection in the ED without the need for laboratory testing.

Added value of clinical decision rules for the management of enhancing breast MRI lesions: A systematic comparison of the Kaiser score and the Göttingen score

PURPOSE

We investigated the added value of two internationally used clinical decision rules in the management of enhancing lesions on breast MRI.

METHODS

This retrospective, institutional review board approved study included consecutive patients from two different populations. Patients received breast MRI according to the recommendations of the European Society of Breast Imaging (EUSOBI). Initially, all examinations were assessed by expert readers without using clinical decision rules. All lesions rated as category 4 or 5 according to the Breast Imaging Reporting and Data System were histologically confirmed. These lesions were re-evaluated by an expert reader blinded to the histology. He assigned each lesion a Göttingen score (GS) and a Kaiser score (KS) on different occasions. To provide an estimate on inter-reader agreement, a second fellowship-trained reader assessed a subset of these lesions. Subgroup analyses based on lesion type (mass vs. non-mass), size (>1 cm vs. ≤ 1 cm), menopausal status, and significant background parenchymal enhancement were conducted. The areas under the ROC curves (AUCs) for the GS and KS were compared, and the potential to avoid unnecessary biopsies was determined according to previously established cutoffs (KS > 4, GS > 3) RESULTS: 527 lesions in 506 patients were included (mean age: 51.8 years, inter-quartile-range: 43.0-61.0 years). 131/527 lesions were malignant (24.9 %; 95 %-confidence-interval: 21.3-28.8). In all subgroups, the AUCs of the KS (median = 0.91) were higher than those of the GS (median = 0.83). Except for "premenopausal patients" (p = 0.057), these differences were statistically significant (p ≤ 0.01). Kappa agreement was higher for the KS (0.922) than for the GS (0.358).

CONCLUSION

Both the KS and the GS provided added value for the management of enhancing lesions on breast MRI. The KS was superior to the GS in terms of avoiding unnecessary biopsies and showed superior inter-reader agreement; therefore, it may be regarded as the clinical decision rule of choice.

Development and validation of a clinical prediction rule for acute appendicitis in children in primary care

BACKGROUND

Recognising acute appendicitis in children presenting with acute abdominal pain in primary care is challenging. General practitioners (GPs) may benefit from a clinical prediction rule.

OBJECTIVES

To develop and validate a clinical prediction rule for acute appendicitis in children presenting with acute abdominal pain in primary care.

METHODS

In a historical cohort study data was retrieved from GP electronic health records included in the Integrated Primary Care Information database. We assigned children aged 4-18 years presenting with acute abdominal pain (≤ 7 days) to development (2010-2012) and validation (2013-2016) cohorts, using acute appendicitis within six weeks as the outcome. Multiple logistic regression was used to develop a prediction model based on predictors with > 50% data availability derived from existing rules for secondary care. We performed internal and external temporal validation and derived a point score to stratify risk of appendicitis into three groups, i.e. low-risk, medium-risk and high-risk.

RESULTS

The development and validation cohorts included 2,041 and 3,650 children, of whom 95 (4.6%) and 195 (5.3%) had acute appendicitis. The model included male sex, pain duration (<24, 24-48, > 48 h), nausea/vomiting, elevated temperature (≥ 37.3 °C), abnormal bowel sounds, right lower quadrant tenderness, and peritoneal irritation. Internal and temporal validation showed good discrimination (C-statistics: 0.93 and 0.90, respectively) and excellent calibration. In the three groups, the risks of acute appendicitis were 0.5%, 7.5%, and 41%.

CONCLUSION

Combined with further testing in the medium-risk group, the prediction rule could improve clinical decision making and outcomes.

A prediction model for cesarean delivery based on the glycemia in the second trimester: a nested case control study from two centers

OBJECTIVE

Maternal glycemia is associated with the risk of cesarean delivery (CD); therefore, our study aims to developed a prediction model based on glucose indicators in the second trimester to earlier identify the risk of CD.

METHODS

This was a nested case-control study, and data were collected from the 5th Central Hospital of Tianjin (training set) and Changzhou Second People's Hospital (testing set) from 2020 to 2021. Variables with significant difference in training set were incorporated to develop the random forest model. Model performance was assessed by calculating the area under the curve (AUC) and Komogorov-Smirnoff (KS), as well as accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).

RESULTS

A total of 504 eligible women were enrolled; of these, 169 underwent CD. Pre-pregnancy body mass index (BMI), first pregnancy, history of full-term birth, history of livebirth, 1 h plasma glucose (1hPG), glycosylated hemoglobin (HbA1c), fasting plasma glucose (FPG), and 2 h plasma glucose (2hPG) were used to develop the model. The model showed a good performance, with an AUC of 0.852 [95% confidence interval (CI): 0.809-0.895]. The pre-pregnancy BMI, 1hPG, 2hPG, HbA1c, and FPG were identifies as the more significant predictors. External validation confirmed the good performance of our model, with an AUC of 0.734 (95%CI: 0.664-0.804).

CONCLUSIONS

Our model based on glucose indicators in the second trimester performed well to predict the risk of CD, which may reach the earlier identification of CD risk and may be beneficial to make interventions in time to decrease the risk of CD.

Diagnostic Yield, Radiation Exposure, and the Role of Clinical Decision Rules to Limit Computed Tomographic Pulmonary Angiography-Associated Complications

OBJECTIVES

Computed tomographic pulmonary angiography (CT-PA) is associated with significant cost, contrast, and radiation exposure. Clinical decision rules (CDRs) reduce the need for diagnostic imaging; however, their utility in the medical intensive care unit (MICU) remains unknown. We explored the diagnostic yield and complications associated with CT-PA (radiation exposure and contrast-induced acute kidney injury [AKI]) while investigating the efficacy of CDRs to reduce unnecessary testing.

METHODS

All CT-PAs performed in an academic MICU for 4 years were retrospectively reviewed. The Wells and revised Geneva scores (CDRs) and radiation dose per CT-PA were calculated, and the incidence of post-CT-PA AKI was recorded.

RESULTS

A total of 439 studies were analyzed; the diagnostic yield was 11% (48 PEs). Positive CT-PAs were associated with a higher Wells score (5.8 versus 3.2, P < 0.001), but similar revised Geneva scores (6.4 versus 6.0, P = 0.32). A Wells score of ≥4 had a positive likelihood ratio of 2.1 with a negative predictive value of 98.2. More than half (88.9%) of patients with a Wells score of ≤4 developed an AKI, with 55.6% of those having recovery of renal function.

CONCLUSIONS

There is overutilization of CT-PA in the MICU. The Wells score retains its negative predictive value in critically ill adult patients and may aid to limit radiation exposure and contrast-induced AKI in MICU.

Diagnostic clinical prediction rules for categorising low back pain: A systematic review

BACKGROUND

Low back pain (LBP) is a common complex condition, where specific diagnoses are hard to identify. Diagnostic clinical prediction rules (CPRs) are known to improve clinical decision-making. A review of LBP diagnostic-CPRs by Haskins et al. (2015) identified six diagnostic-CPRs in derivation phases of development, with one tool ready for implementation. Recent progress on these tools is unknown. Therefore, this review aimed to investigate developments in LBP diagnostic-CPRs and evaluate their readiness for implementation.

METHODS

A systematic review was performed on five databases (Medline, Amed, Cochrane Library, PsycInfo, and CINAHL) combined with hand-searching and citation-tracking to identify eligible studies. Study and tool quality were appraised for risk of bias (Quality Assessment of Diagnostic Accuracy Studies-2), methodological quality (checklist using accepted CPR methodological standards), and CPR tool appraisal (GRade and ASsess Predictive).

RESULTS

Of 5021 studies screened, 11 diagnostic-CPRs were identified. Of the six previously known, three have been externally validated but not yet undergone impact analysis. Five new tools have been identified since Haskin et al. (2015); all are still in derivation stages. The most validated diagnostic-CPRs include the Lumbar-Spinal-Stenosis-Self-Administered-Self-Reported-History-Questionnaire and Diagnosis-Support-Tool-to-Identify-Lumbar-Spinal-Stenosis, and the StEP-tool which differentiates radicular from axial-LBP.

CONCLUSIONS

This updated review of LBP diagnostic CPRs found five new tools, all in the early stages of development. Three previously known tools have now been externally validated but should be used with caution until impact evaluation studies are undertaken. Future funding should focus on externally validating and assessing the impact of existing CPRs on clinical decision-making.

Performance of the Dutch clinical prediction rule for the ambulation outcome after spinal cord injury in a middle-income country clinical setting: an external validation study in the Thai retrospective cohort

OBJECTIVE

To perform external geographic and domain validation of the clinical prediction rule (CPR) of the ambulation outcome of patients with traumatic spinal cord injury (SCI) originally developed by van Middendorp, et al. (2011) in Thais with traumatic and non-traumatic SCI.

STUDY DESIGN

Retrospective cohort study.

SETTING

A tertiary rehabilitation facility in Chiang Mai, Thailand.

METHODS

A validation data set, including predictive (age and four neurological variables) and outcome (ambulation status) parameters was retrospectively collected from medical records of patients with traumatic and non-traumatic SCI admitted between December 2007 and December 2019. The performance of the original model was evaluated in both discrimination and calibration aspects, using an area under the receiver-operating characteristic curve (auROC) and calibration curves, respectively.

RESULTS

Three hundred and thirty-three patients with SCI were included in the validation set. The prevalence of ambulators was 59% (197 of 333 participants). An auROC of 0.93 (95% CI 0.90-0.96) indicated excellent discrimination whereas the calibration curve demonstrated underestimation, especially in patients with AIS grade D. Performance of the CPR was decreased but acceptable in patients with non-traumatic SCI.

CONCLUSIONS

Our external validation study demonstrated excellent discrimination but slightly underestimated calibration of the CPR of ambulation outcome after SCI. Regardless of the geographic and etiologic background of the population, the Dutch CPR could be applied to predict the ambulation outcome in patients with SCI.

Diagnostic test accuracy of D-dimer with or without a clinical decision rule in peripartum patients with suspected venous thromboembolism: A systematic review and meta-analysis

BACKGROUND

Pregnancy and the peripartum period is a hypercoagulable state increasing the risk of venous thromboembolism (VTE). There may be a role in utilising D-dimer in the peripartum setting.

AIMS

The purpose of this review was to summarise the latest evidence regarding the diagnostic accuracy of D-dimer in the peripartum setting with or without the addition of clinical decision rules.

METHODS

We searched PubMed and CENTRAL databases to identify articles that included studies of women who had suspected VTE, underwent a D-dimer index test to rule out VTE and where radiological imaging or clinical follow-up, to a minimum of 30 days, was used as the reference standard.

RESULTS

We included 11 studies in the systematic review and meta-analysis. The log diagnostic odds ratio (DOR) for identifying VTE using D-dimer was 1.56 (95% confidence interval (CI) 0.59-2.52). The pooled sensitivity was 87% (95% CI 76.8-93%), specificity was 63.2% (95% CI 47.1-76.7%), and the area under receiver operator characteristic (ROC) curves was 0.76. We included four studies evaluating D-dimer combined with YEARS to detect VTE. The log DOR for identifying VTE using D-dimer combined with YEARS was 1.13 (95% CI 0.005-2.25). The pooled sensitivity was 89.8% (95% CI 60.2-98.1%), specificity was 65.7% (95% CI 54.7-75.2%) and the area under ROC for studies included with the YEARS clinical decision rule was 0.49.

CONCLUSION

This review highlighted that D-dimer use in the peripartum period for detection of VTE had a high sensitivity and high DOR but a poor area under ROC, which may limit its use in clinical practice.

Use of Patient-Reported Symptom Data in Clinical Decision Rules for Predicting Influenza in a Telemedicine Setting

INTRODUCTION

Increased use of telemedicine could potentially streamline influenza diagnosis and reduce transmission. However, telemedicine diagnoses are dependent on accurate symptom reporting by patients. If patients disagree with clinicians on symptoms, previously derived diagnostic rules may be inaccurate.

METHODS

We performed a secondary data analysis of a prospective, nonrandomized cohort study at a university student health center. Patients who reported an upper respiratory complaint were required to report symptoms, and their clinician was required to report the same list of symptoms. We examined the performance of 5 previously developed clinical decision rules (CDRs) for influenza on both symptom reports. These predictions were compared against PCR diagnoses. We analyzed the agreement between symptom reports, and we built new predictive models using both sets of data.

RESULTS

CDR performance was always lower for the patient-reported symptom data, compared with clinician-reported symptom data. CDRs often resulted in different predictions for the same individual, driven by disagreement in symptom reporting. We were able to fit new models to the patient-reported data, which performed slightly worse than previously derived CDRs. These models and models built on clinician-reported data both suffered from calibration issues.

DISCUSSION

Patients and clinicians frequently disagree about symptom presence, which leads to reduced accuracy when CDRs built with clinician data are applied to patient-reported symptoms. Predictive models using patient-reported symptom data performed worse than models using clinician-reported data and prior results in the literature. However, the differences are minor, and developing new models with more data may be possible.

Influence of research evidence on the use of cardiovascular clinical prediction rules in primary care: an exploratory qualitative interview study

BACKGROUND

Cardiovascular clinical prediction rules (CPRs) are widely used in primary care. They accumulate research evidence through derivation, external validation, and impact studies. However, existing knowledge about the influence of research evidence on the use of CPRs is limited. Therefore, we explored how primary care clinicians' perceptions of and experiences with research influence their use of cardiovascular CPRs.

METHODS

We conducted an exploratory qualitative interview study with thematic analysis. Primary care clinicians were recruited from the WWAMI (Washington, Wyoming, Alaska, Montana and Idaho) region Practice and Research Network (WPRN). We used purposeful sampling to ensure maximum variation within the participant group. Data were collected by conducting semi-structured online interviews. We analyzed data using inductive thematic analysis to identify commonalities and differences within themes.

RESULTS

Of 29 primary care clinicians who completed the questionnaire, 15 participated in the interview. We identified two main themes relating to the influence of clinicians' perceptions of and experiences with cardiovascular CPR research on their decisions about using cardiovascular CPRs: "Seek and judge" and "be acquainted and assume." When clinicians are familiar with, trust, and feel confident in using research evidence, they might actively search and assess the evidence, which may then influence their decisions about using cardiovascular CPRs. However, clinicians, who are unfamiliar with, distrust, or find it challenging to use research evidence, might be passively acquainted with evidence but do not make their own judgment on the trustworthiness of such evidence. Therefore, these clinicians might not rely on research evidence when making decisions about using cardiovascular CPRs.

CONCLUSIONS

Clinicians' perceptions and experiences could influence how they use research evidence in decisions about using cardiovascular CPRs. This implies, when promoting evidence-based decisions, it might be useful to target clinicians' unfamiliarity, distrust, and challenges regarding the use of research evidence rather than focusing only on their knowledge and skills. Further, because clinicians often rely on evidence-unrelated factors, guideline developers and policymakers should recommend cardiovascular CPRs supported by high-quality evidence.

Efficacy of a Clinical Decision Rule to Enable Direct Oral Challenge in Patients With Low-Risk Penicillin Allergy: The PALACE Randomized Clinical Trial

Importance

Fewer than 5% of patients labeled with a penicillin allergy are truly allergic. The standard of care to remove the penicillin allergy label in adults is specialized testing involving prick and intradermal skin testing followed by an oral challenge with penicillin. Skin testing is resource intensive, limits practice to specialist-trained physicians, and restricts the global population who could undergo penicillin allergy delabeling.

Objective

To determine whether a direct oral penicillin challenge is noninferior to the standard of care of penicillin skin testing followed by an oral challenge in patients with a low-risk penicillin allergy.

Design, Setting, and Participants

This parallel, 2-arm, noninferiority, open-label, multicenter, international randomized clinical trial occurred in 6 specialized centers, 3 in North America (US and Canada) and 3 in Australia, from June 18, 2021, to December 2, 2022. Eligible adults had a PEN-FAST score lower than 3. PEN-FAST is a prospectively derived and internationally validated clinical decision rule that enables point-of-care risk assessment for adults reporting penicillin allergies.

Interventions

Patients were randomly assigned to either direct oral challenge with penicillin (intervention arm) or a standard-of-care arm of penicillin skin testing followed by oral challenge with penicillin (control arm).

Main Outcome and Measure

The primary outcome was a physician-verified positive immune-mediated oral penicillin challenge within 1 hour postintervention in the intention-to-treat population. Noninferiority was achieved if a 1-sided 95% CI of the risk difference (RD) did not exceed 5 percentage points (pp).

Results

A total of 382 adults were randomized, with 377 patients (median [IQR] age, 51 [35-65] years; 247 [65.5%] female) included in the analysis: 187 in the intervention group and 190 in the control group. Most patients had a PEN-FAST score of 0 or 1. The primary outcome occurred in 1 patient (0.5%) in the intervention group and 1 patient (0.5%) in the control group, with an RD of 0.0084 pp (90% CI, -1.22 to 1.24 pp). The 1-sided 95% CI was below the noninferiority margin of 5 pp. In the 5 days following the oral penicillin challenge, 9 immune-mediated adverse events were recorded in the intervention group and 10 in the control group (RD, -0.45 pp; 95% CI, -4.87 to 3.96 pp). No serious adverse events occurred.

Conclusions and Relevance

In this randomized clinical trial, direct oral penicillin challenge in patients with a low-risk penicillin allergy was noninferior compared with standard-of-care skin testing followed by oral challenge. In patients with a low-risk history, direct oral penicillin challenge is a safe procedure to facilitate the removal of a penicillin allergy label.

Trial Registration

ClinicalTrials.gov Identifier: NCT04454229.

The Risk of Developing Disabling Crohn's Disease: Validation of a Clinical Prediction Rule to Improve Treatment Decision Making

BACKGROUND

Crohn's disease (CD) is characterized by the development of complications over the course of the disease. It is crucial to identify predictive factors of disabling disease, in order to target patients for early intervention. We evaluated risk factors of disabling CD and developed a prognostic model.

METHODS

In total, 511 CD patients were retrospectively analyzed. Univariate and multivariate logistic regression analyses were used to identify demographic, clinical, and biological risk factors. A predictive nomogram model was developed in a subgroup of patients with noncomplicated CD (inflammatory pattern and no perianal disease).

RESULTS

The rate of disabling CD within 5 years after diagnosis was 74.6%. Disabling disease was associated with gender, location of disease, requirement of steroids for the first flare, and perianal lesions. In the subgroup of patients (310) with noncomplicated CD, the rate of disabling CD was 80%. In the multivariate analysis age at onset <40 years (OR = 3.46, 95% confidence interval [CI] = 1.52-7.90), extensive disease (L3/L4) (OR = 2.67, 95% CI = 1.18-6.06), smoking habit (OR = 2.09, 95% CI = 1.03-4.27), requirement of steroids at the first flare (OR = 2.20, 95% CI = 1.09-4.45), and albumin (OR = 0.59, 95% CI = 0.36-0.96) were associated with development of disabling disease. The developed predictive nomogram based on these factors presented good discrimination, with an area under the receiver operating characteristic curve of 0.723 (95% CI: 0.670-0.830).

CONCLUSION

We identified predictive factors of disabling CD and developed an easy-to-use prognostic model that may be used in clinical practice to help identify patients at high risk and address treatment effectively.

A prediction model for permanent pacemaker implantation after transcatheter aortic valve replacement

BACKGROUND

This study aims to develop a post-procedural risk prediction model for permanent pacemaker implantation (PPMI) in patients treated with transcatheter aortic valve replacement (TAVR).

METHODS

336 patients undergoing TAVR at a single institution were included for model derivation. For primary analysis, multivariate logistic regression model was used to evaluate predictors and a risk score system was devised based on the prediction model. For secondary analysis, a Cox proportion hazard model was performed to assess characteristics associated with the time from TAVR to PPMI. The model was validated internally via bootstrap and externally using an independent cohort.

RESULTS

48 (14.3%) patients in the derivation set had PPMI after TAVR. Prior right bundle branch block (RBBB, OR: 10.46; p < 0.001), pre-procedural aortic valve area (AVA, OR: 1.41; p = 0.004) and post- to pre-procedural AVA ratio (OR: 1.72; p = 0.043) were identified as independent predictors for PPMI. AUC was 0.7 and 0.71 in the derivation and external validation set. Prior RBBB (HR: 5.07; p < 0.001), pre-procedural AVA (HR: 1.33; p = 0.001), post-procedural AVA to prosthetic nominal area ratio (HR: 0.02; p = 0.039) and post- to pre-procedural troponin-T difference (HR: 1.72; p = 0.017) are independently associated with time to PPMI.

CONCLUSIONS

The post-procedural prediction model achieved high discriminative power and accuracy for PPMI. The risk score system was constructed and validated, providing an accessible tool in clinical setting regarding the Chinese population.

Predictors of poor outcome following lumbar spinal fusion surgery: a prospective observational study to derive two clinical prediction rules using British Spine Registry data

PURPOSE

Lumbar spinal fusion surgery (LSFS) is common for lumbar degenerative disorders. The objective was to develop clinical prediction rules to identify which patients are likely to have a favourable outcome to inform decisions regarding surgery and rehabilitation.

METHODS

A prospective observational study recruited 600 (derivation) and 600 (internal validation) consecutive adult patients undergoing LSFS for degenerative lumbar disorder through the British Spine Registry. Definition of good outcome (6 weeks, 12 months) was reduction in pain intensity (Numerical Rating Scale, 0-10) and disability (Oswestry Disability Index, ODI 0-50) > 1.7 and 14.3, respectively. Linear and logistic regression models were fitted and regression coefficients, Odds ratios and 95% CIs reported.

RESULTS

Lower BMI, higher ODI and higher leg pain pre-operatively were predictive of good disability outcome, higher back pain was predictive of good back pain outcome, and no previous surgery and higher leg pain were predictive of good leg pain outcome; all at 6 weeks. Working and higher leg pain were predictive of good ODI and leg pain outcomes, higher back pain was predictive of good back pain outcome, and higher leg pain was predictive of good leg pain outcome at 12 months. Model performance demonstrated reasonable to good calibration and adequate/very good discrimination.

CONCLUSIONS

BMI, ODI, leg and back pain and previous surgery are important considerations pre-operatively to inform decisions for surgery. Pre-operative leg and back pain and work status are important considerations to inform decisions for management following surgery. Findings may inform clinical decision making regarding LSFS and associated rehabilitation.

Ruling out acute coronary syndrome in primary care with a clinical decision rule and a capillary, high-sensitive troponin I point of care test: study protocol of a diagnostic RCT in the Netherlands (POB HELP)

INTRODUCTION

Chest pain is a common reason for consultation in primary care. To rule out acute coronary syndrome (ACS), general practitioners (GP) refer 40%-70% of patients with chest pain to the emergency department (ED). Only 10%-20% of those referred, are diagnosed with ACS. A clinical decision rule, including a high-sensitive cardiac troponin-I point-of-care test (hs-cTnI-POCT), may safely rule out ACS in primary care. Being able to safely rule out ACS at the GP level reduces referrals and thereby alleviates the burden on the ED. Moreover, prompt feedback to the patients may reduce anxiety and stress.

METHODS AND ANALYSIS

The POB HELP study is a clustered randomised controlled diagnostic trial investigating the (cost-)effectiveness and diagnostic accuracy of a primary care decision rule for acute chest pain, consisting of the Marburg Heart Score combined with a hs-cTnI-POCT (limit of detection 1.6 ng/L, 99th percentile 23 ng/L, cut-off value between negative and positive used in this study 3.8 ng/L). General practices are 2:1 randomised to the intervention group (clinical decision rule) or control group (regular care). In total 1500 patients with acute chest pain are planned to be included by GPs in three regions in The Netherlands. Primary endpoints are the number of hospital referrals and the diagnostic accuracy of the decision rule 24 hours, 6 weeks and 6 months after inclusion.

ETHICS AND DISSEMINATION

The medical ethics committee Leiden-Den Haag-Delft (the Netherlands) has approved this trial. Written informed consent will be obtained from all participating patients. The results of this trial will be disseminated in one main paper and additional papers on secondary endpoints and subgroup analyses.

TRIAL REGISTRATION NUMBERS

NL9525 and NCT05827237.

Influencing Factors of Quality of Life and Prediction Model Building in Patients with Primary Nephrotic Syndrome: A Single-Centre Retrospective Study

OBJECTIVE

This study aimed to explore the influencing factors of quality of life (QOL) and establish a prediction model in patients with primary nephrotic syndrome (PNS).

METHODS

A single-centre retrospective study was conducted on 245 patients with PNS admitted to Zibo Central Hospital from August 2020 to August 2022. According to the 36-Item Short-Form Health Survey (SF-36) for QOL evaluation, the patients were divided into the good QOL group (the total score ≥50 points) and poor QOL group (the total score <50 points). Univariate analysis was conducted by collecting clinical data from patients, and multiple logistic regression analysis was carried out on single factors with statistically significant differences to construct a clinical prediction model. The diagnostic efficacy of the prediction model was evaluated using the receiver operating characteristic (ROC) curve.

RESULTS

A total of 245 questionnaires were distributed, and 243 valid questionnaires were recovered, in which 143 cases had good QOL, with an average score of (71.86 ± 10.83) points, and 100 cases had poor QOL, with an average score of (40.03 ± 5.95) points. Statistical differences were observed in age, education level, monthly family average income, payment methods of medical expenses, albumin, 24-hour urinary protein quantification (24 h UPro) and serum uric acid (SUA) in both groups (p < 0.05), whereas no statistical difference was found in gender, body mass index (BMI) and marital status (p > 0.05). The multiple logistic regression analysis showed that age (X1), monthly family average income (X2), payment methods of medical expenses (X3), albumin (X4), 24 h UPro (X5) and SUA (X6) were risk factors for the QOL of patients with PNS, with Y = -12.105 + 0.130X1 + 0.457X2 + 0.448X3 + -0.161X4 + 0.823X5 + 0.025X6 as the regression prediction model. The results of ROC curve showed that the area under the curve (AUC) was 0.987 with standard error of 0.005 (p < 0.001), and 95% CI was 0.976-0.998.

CONCLUSIONS

Age, monthly family average income, payment methods of medical expenses, albumin, 24 h UPro and SUA are risk factors that affect the QOL of patients with PNS, and the construction of prediction model has good evaluation value and can provide a reference for clinical practice.

Validation of a Clinical Decision Rule for Ultrasound Identification of MRSA Skin Abscesses in Children

OBJECTIVE

The aim of this study was to validate an adult-derived clinical decision rule for ultrasound identification of methicillin-resistant Staphylococcus aureus (MRSA) skin abscesses in a pediatric cohort.

METHODS

We conducted a retrospective study of skin and soft tissue infections in patients <21 years presenting to the emergency department who had radiology performed ultrasounds completed and wound cultures obtained. Ultrasound scans were reviewed for edge definition, volume, and shape by 2 pediatric emergency physicians with expertise in point-of-care ultrasound, with approximately 25% of scans reviewed by both experts to evaluate interrater reliability. A third, blinded expert weighed in for discrepancies before analysis. Test performance characteristics were calculated for the clinical decision rule in children.

RESULTS

Two hundred nine patients were enrolled, with mean age of 9.8 (±6.7) years; 87 (42%) were male. Sixty-nine (33%) patients had a wound culture positive for MRSA. The clinical decision rule had a sensitivity of 86% (95% confidence interval [CI], 75%-93%), specificity of 32% (95% CI, 25%-41%), positive predictive value of 38% (95% CI, 35%-42%), negative predictive value of 82% (95% CI, 71%-89%), positive likelihood ratio of 1.26 (95% CI, 1.08-1.46), negative likelihood ratio of 0.45 (95% CI, 0.24-0.84), and an odds ratio of 2.8 (95% CI, 1.31-5.97).

CONCLUSIONS

This clinical decision rule for ultrasound identification of MRSA abscesses had moderately high sensitivity and negative predictive value in pediatric patients, with similar sensitivity compared with the original adult validation group. Ultrasound may help identify MRSA abscesses, allowing for improved antibiotic choices and outcomes for children with MRSA abscesses.

Development and external validation of a prognostic tool for nonsevere COVID-19 inpatients

To develop a machine learning model and nomogram to predict the probability of persistent virus shedding (PVS) in hospitalized patients with coronavirus disease 2019 (COVID-19), the clinical symptoms and signs, laboratory parameters, cytokines, and immune cell data of 429 patients with nonsevere COVID-19 were retrospectively reviewed. Two models were developed using the Akaike information criterion (AIC). The performance of these two models was analyzed and compared by the receiver operating characteristic (ROC) curve, calibration curve, net reclassification index (NRI), and integrated discrimination improvement (IDI). The final model included the following independent predictors of PVS: sex, C-reactive protein (CRP) level, interleukin-6 (IL-6) level, the neutrophil-lymphocyte ratio (NLR), monocyte count (MC), albumin (ALB) level, and serum potassium level. The model performed well in both the internal validation (corrected C-statistic = 0.748, corrected Brier score = 0.201) and external validation datasets (corrected C-statistic = 0.793, corrected Brier score = 0.190). The internal calibration was very good (corrected slope = 0.910). The model developed in this study showed high discriminant performance in predicting PVS in nonsevere COVID-19 patients. Because of the availability and accessibility of the model, the nomogram designed in this study could provide a useful prognostic tool for clinicians and medical decision-makers.

A New Clinical Prediction Rule for Infective Endocarditis in Emergency Department Patients With Fever: Definition and First Validation of the CREED Score

Background Infective endocarditis (IE) could be suspected in any febrile patients admitted to the emergency department (ED). This study was aimed at assessing clinical criteria predictive of IE and identifying and prospectively validating a sensible and easy-to-use clinical prediction score for the diagnosis of IE in the ED. Methods and Results We conducted a retrospective observational study, enrolling consecutive patients with fever admitted to the ED between January 2015 and December 2019 and subsequently hospitalized. Several clinical and anamnestic standardized variables were collected and evaluated for the association with IE diagnosis. We derived a multivariate prediction model by logistic regression analysis. The identified predictors were assigned a score point value to obtain the Clinical Rule for Infective Endocarditis in the Emergency Department (CREED) score. To validate the CREED score we conducted a prospective observational study between January 2020 and December 2021, enrolling consecutive febrile patients hospitalized after the ED visit, and evaluating the association between the CREED score values and the IE diagnosis. A total of 15 689 patients (median age, 71 [56-81] years; 54.1% men) were enrolled in the retrospective cohort, and IE was diagnosed in 267 (1.7%). The CREED score included 12 variables: male sex, anemia, dialysis, pacemaker, recent hospitalization, recent stroke, chest pain, specific infective diagnosis, valvular heart disease, valvular prosthesis, previous endocarditis, and clinical signs of suspect endocarditis. The CREED score identified 4 risk groups for IE diagnosis, with an area under the receiver operating characteristic curve of 0.874 (0.849-0.899). The prospective cohort included 13 163 patients, with 130 (1.0%) IE diagnoses. The CREED score had an area under the receiver operating characteristic curve of 0.881 (0.848-0.913) in the validation cohort, not significantly different from the one calculated in the retrospective cohort (P=0.578). Conclusions In this study, we propose and prospectively validate the CREED score, a clinical prediction rule for the diagnosis of IE in patients with fever admitted to the ED. Our data reflect the difficulty of creating a meaningful tool able to identify patients with IE among this general and heterogeneous population because of the complexity of the disease and its low prevalence in the ED setting.

Risk of death by suicide following self-harm presentations to healthcare: development and validation of a multivariable clinical prediction rule (OxSATS)

BACKGROUND

Assessment of suicide risk in individuals who have self-harmed is common in emergency departments, but is often based on tools developed for other purposes.

OBJECTIVE

We developed and validated a predictive model for suicide following self-harm.

METHODS

We used data from Swedish population-based registers. A cohort of 53 172 individuals aged 10+ years, with healthcare episodes of self-harm, was split into development (37 523 individuals, of whom 391 died from suicide within 12 months) and validation (15 649 individuals, 178 suicides within 12 months) samples. We fitted a multivariable accelerated failure time model for the association between risk factors and time to suicide. The final model contains 11 factors: age, sex, and variables related to substance misuse, mental health and treatment, and history of self-harm. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis guidelines were followed for the design and reporting of this work.

FINDINGS

An 11-item risk model to predict suicide was developed using sociodemographic and clinical risk factors, and showed good discrimination (c-index 0.77, 95% CI 0.75 to 0.78) and calibration in external validation. For risk of suicide within 12 months, using a 1% cut-off, sensitivity was 82% (75% to 87%) and specificity was 54% (53% to 55%). A web-based risk calculator is available (Oxford Suicide Assessment Tool for Self-harm or OxSATS).

CONCLUSIONS

OxSATS accurately predicts 12-month risk of suicide. Further validations and linkage to effective interventions are required to examine clinical utility.

CLINICAL IMPLICATIONS

Using a clinical prediction score may assist clinical decision-making and resource allocation.

Assessment and prediction of glioblastoma therapy response: challenges and opportunities

Glioblastoma is the most aggressive type of primary adult brain tumour. The median survival of patients with glioblastoma remains approximately 15 months, and the 5-year survival rate is <10%. Current treatment options are limited, and the standard of care has remained relatively constant since 2011. Over the last decade, a range of different treatment regimens have been investigated with very limited success. Tumour recurrence is almost inevitable with the current treatment strategies, as glioblastoma tumours are highly heterogeneous and invasive. Additionally, another challenging issue facing patients with glioblastoma is how to distinguish between tumour progression and treatment effects, especially when relying on routine diagnostic imaging techniques in the clinic. The specificity of routine imaging for identifying tumour progression early or in a timely manner is poor due to the appearance similarity of post-treatment effects. Here, we concisely describe the current status and challenges in the assessment and early prediction of therapy response and the early detection of tumour progression or recurrence. We also summarize and discuss studies of advanced approaches such as quantitative imaging, liquid biomarker discovery and machine intelligence that hold exceptional potential to aid in the therapy monitoring of this malignancy and early prediction of therapy response, which may decisively transform the conventional detection methods in the era of precision medicine.

Measuring the performance of prediction models to personalize treatment choice

When data are available from individual patients receiving either a treatment or a control intervention in a randomized trial, various statistical and machine learning methods can be used to develop models for predicting future outcomes under the two conditions, and thus to predict treatment effect at the patient level. These predictions can subsequently guide personalized treatment choices. Although several methods for validating prediction models are available, little attention has been given to measuring the performance of predictions of personalized treatment effect. In this article, we propose a range of measures that can be used to this end. We start by defining two dimensions of model accuracy for treatment effects, for a single outcome: discrimination for benefit and calibration for benefit. We then amalgamate these two dimensions into an additional concept, decision accuracy, which quantifies the model's ability to identify patients for whom the benefit from treatment exceeds a given threshold. Subsequently, we propose a series of performance measures related to these dimensions and discuss estimating procedures, focusing on randomized data. Our methods are applicable for continuous or binary outcomes, for any type of prediction model, as long as it uses baseline covariates to predict outcomes under treatment and control. We illustrate all methods using two simulated datasets and a real dataset from a trial in depression. We implement all methods in the R package predieval. Results suggest that the proposed measures can be useful in evaluating and comparing the performance of competing models in predicting individualized treatment effect.

Performance of Vibration-Controlled Transient Elastography and Clinical Prediction Models In Liver Transplant Recipients

Hepatic fibrosis is a strong predictor of clinical outcomes following liver transplantation (LT).1 Despite the centrality of hepatic fibrosis in clinical outcomes, the published literature with noninvasive fibrosis assessment in LT recipients is limited and liver biopsy, despite its invasive nature, remains the reference standard. Vibration-controlled transient elastography (VCTE) and clinical prediction models (CPM) are point-of-care tests that can provide noninvasive assessment of hepatic fibrosis2-4; however, the data comparing the diagnostic performance of VCTE and CPM in LT recipients are lacking. The current study evaluated the diagnostic performance of VCTE and CPM in LT recipients using best practices in regulatory sciences for biomarker development.

Cost-effectiveness of running a paediatric oncology unit in Ethiopia

OBJECTIVE

To estimate the cost-effectiveness of running a paediatric oncology unit in Ethiopia to inform the revision of the Ethiopia Essential Health Service Package (EEHSP), which ranks the treatment of childhood cancers at a low and medium priority.

METHODS

We built a decision analytical model-a decision tree-to estimate the cost-effectiveness of running a paediatric oncology unit compared with a do-nothing scenario (no paediatric oncology care) from a healthcare provider perspective. We used the recently (2018-2019) conducted costing estimate for running the paediatric oncology unit at Tikur Anbessa Specialized Hospital (TASH) and employed a mixed costing approach (top-down and bottom-up). We used data on health outcomes from other studies in similar settings to estimate the disability-adjusted life years (DALYs) averted of running a paediatric oncology unit compared with a do-nothing scenario over a lifetime horizon. Both costs and effects were discounted (3%) to the present value. The primary outcome was incremental cost in US dollars (USDs) per DALY averted, and we used a willingness-to-pay (WTP) threshold of 50% of the Ethiopian gross domestic product per capita (USD 477 in 2019). Uncertainty was tested using one-way and probabilistic sensitivity analyses.

RESULTS

The incremental cost and DALYs averted per child treated in the paediatric oncology unit at TASH were USD 876 and 2.4, respectively, compared with no paediatric oncology care. The incremental cost-effectiveness ratio of running a paediatric oncology unit was USD 361 per DALY averted, and it was cost-effective in 90% of 100 000 Monte Carlo iterations at a USD 477 WTP threshold.

CONCLUSIONS

The provision of paediatric cancer services using a specialised oncology unit is most likely cost-effective in Ethiopia, at least for easily treatable cancer types in centres with minimal to moderate capability. We recommend reassessing the priority-level decision of childhood cancer treatment in the current EEHSP.

Development and validation of a predictive model for major complications after extracorporeal shockwave lithotripsy in patients with ureteral stones: based on a large prospective cohort

The risk factors of complications after SWL are not well characterized. Therefore, based on a large prospective cohort, we aimed to develop and validate a nomogram for predicting major complications after extracorporeal shockwave lithotripsy (SWL) in patients with ureteral stones. The development cohort included 1522 patients with ureteral stones who underwent SWL between June 2020 and August 2021 in our hospital. Five hundred and fifty-three patients with ureteral stones participated in the validation cohort from September 2020 to April 2022. The data were prospectively recorded. Backward stepwise selection was applied using the likelihood ratio test with Akaike's information criterion as the stopping rule. The efficacy of this predictive model was assessed concerning its clinical usefulness, calibration, and discrimination. Finally, 7.2% (110/1522) of patients in the development cohort and 8.7% (48/553) of those in the validation cohort suffered from major complications. We identified five predictive factors for major complications: age, gender, stone size, Hounsfield unit of stone, and hydronephrosis. This model showed good discrimination with an area under the receiver operating characteristic curves of 0.885 (0.872-0.940) and good calibration (P = 0.139). The decision curve analysis showed that the model was clinically valuable. In this large prospective cohort, we found that older age, female gender, higher Hounsfield unit, size, and grade of hydronephrosis were risk predictors of major complications after SWL. This nomogram will be helpful in preoperative risk stratification to provide individualized treatment recommendations for each patient. Furthermore, early identification and appropriate management of high-risk patients may decrease postoperative morbidity.

Comparing GPs' antibiotic prescribing decisions to a clinical prediction rule: an online vignette study

BACKGROUND

The 'STARWAVe' clinical prediction rule (CPR) uses seven factors to guide risk assessment and antibiotic prescribing in children with cough (Short illness duration, Temperature, Age, Recession, Wheeze, Asthma, Vomiting).

AIM

To assess the influence of STARWAVe factors on GPs' unaided risk assessments and prescribing decisions.

DESIGN AND SETTING

Clinical vignettes administered to 188 UK GPs online.

METHOD

GPs were randomly assigned to view 32 (out of a possible 64) vignettes online depicting children with cough. The vignettes comprised the seven STARWAVe factors, which were varied systematically. For each vignette, GPs assessed risk of deterioration in one of two ways (sliding-scale versus risk-category selection) and indicated whether they would prescribe antibiotics. Finally, GPs saw an additional vignette, suggesting that the parent was concerned. Mixed-effects regressions were used to measure the influence of STARWAVe factors, risk-elicitation method, and parental concern on GPs' assessments and decisions.

RESULTS

Six STARWAVe risk factors correctly increased GPs' risk assessments (bssliding-scale≥0.66, odds ratios [ORs]category-selection≥1.75, Ps≤0.001), whereas one incorrectly reduced them (short illness duration: b sliding-scale -0.30, ORcategory-selection 0.80, P≤0.039). Conversely, one STARWAVe factor increased prescribing odds (temperature: OR 5.22, P<0.001), whereas the rest either reduced them (short illness duration, age, and recession: ORs≤0.70, Ps<0.001) or had no significant impact (wheeze, asthma, and vomiting: Ps≥0.065). Parental concern increased risk assessments (b sliding-scale 1.29, ORcategory-selection 2.82, P≤0.003) but not prescribing odds (P = 0.378).

CONCLUSION

GPs use some, but not all, STARWAVe factors when making unaided risk assessments and prescribing decisions. Such discrepancies must be considered when introducing CPRs to clinical practice.

Derivation and validation of clinical prediction rules for diagnosis of infectious mononucleosis: a prospective cohort study

OBJECTIVES

Infectious mononucleosis (IM) is a clinical syndrome that is characterised by lymphadenopathy, fever and sore throat. Although generally not considered a serious illness, IM can lead to significant loss of time from school or work due to profound fatigue, or the development of chronic illness. This study aimed to derive and externally validate clinical prediction rules (CPRs) for IM caused by Epstein-Barr virus (EBV).

DESIGN

Prospective cohort study.

SETTING AND PARTICIPANTS

328 participants were recruited prospectively for the derivation cohort, from seven university-affiliated student health centres in Ireland. Participants were young adults (17-39 years old, mean age 20.6 years) with sore throat and one other additional symptom suggestive of IM. The validation cohort was a retrospective cohort of 1498 participants from a student health centre at the University of Georgia, USA.

MAIN OUTCOME MEASURES

Regression analyses were used to develop four CPR models, internally validated in the derivation cohort. External validation was carried out in the geographically separate validation cohort.

RESULTS

In the derivation cohort, there were 328 participants, of whom 42 (12.8%) had a positive EBV serology test result. Of 1498 participants in the validation cohort, 243 (16.2%) had positive heterophile antibody tests for IM. Four alternative CPR models were developed and compared. There was moderate discrimination and good calibration for all models. The sparsest CPR included presence of enlarged/tender posterior cervical lymph nodes and presence of exudate on the pharynx. This model had moderate discrimination (area under the receiver operating characteristic curve (AUC): 0.70; 95% CI: 0.62-0.79) and good calibration. On external validation, this model demonstrated reasonable discrimination (AUC: 0.69; 95% CI: 0.67-0.72) and good calibration.

CONCLUSIONS

The alternative CPRs proposed can provide quantitative probability estimates of IM. Used in conjunction with serological testing for atypical lymphocytosis and immunoglobulin testing for viral capsid antigen, CPRs can enhance diagnostic decision-making for IM in community settings.

Comparing blood biomarkers to clinical decision rules to select patients suspected of traumatic brain injury for head computed tomography

INTRODUCTION

Traumatic brain injury (TBI) is a major public health concern in the U.S. Recommendations for patients admitted in the emergency department (ED) to receive head computed tomography (CT) scan are currently guided by various clinical decision rules.

OBJECTIVE

To compare how a blood biomarker approach compares with clinical decision rules in terms of predicting a positive head CT in adult patients suspected of TBI.

METHODS

We retrospectively identified patients transported to our emergency department and underwent a noncontrast head CT due to suspicion of TBI and who had blood samples available. Published thresholds for serum and plasma glial fibrillary acidic protein (GFAP), ubiquitin carboxyl-terminal hydrolase-L1 (UCH-L1), and serum S100β were used to make CT recommendations. These blood biomarker-based recommendations were compared to those achieved under widely used clinical head CT decision rules (Canadian, New Orleans, NEXUS II, and ACEP Clinical Policy).

RESULTS

Our study included 463 patients, of which 122 (26.3%) had one or more abnormalities presenting on head CT. Individual blood biomarkers achieved high negative predictive value (NPV) for abnormal head CT findings (88%-98%), although positive predictive value (PPV) was consistently low (25%-42%). A composite biomarker-based decision rule (GFAP+UCH-L1)'s NPV of 100% and PPV of 29% were comparable or better than those achieved under the clinical decision rules.

CONCLUSION

Blood biomarkers perform at least as well as clinical rules in terms of selecting TBI patients for head CT and may be easier to implement in the clinical setting. A prospective study is necessary to validate this approach.

Development of clinical prediction rule for the requirement of endoscopic papillary large balloon dilation (EPLBD) on endoscopic CBD stone clearance

INTRODUCTION

To develop a simplified scoring system for clinical prediction of difficulty in CBD stone removal to assist endoscopists working in resource-limited settings in deciding whether to proceed with an intervention or refer patients to a center capable of performing additional procedures and interventions.

METHODS

This study included patients with CBD stones who underwent ERCP at Pattani Hospital between August 2017 and December 2021. Retrospective cohort data was collected and patients were categorized into two groups: bile duct stones successfully treated by endoscopic biliary sphincterotomy and extraction compared to the former method combined with EPLBD. We explored potential predictors using multivariable logistic regression. The chosen logistic coefficients were transformed into a scoring system based on risk with internal validation via bootstrapping procedure.

RESULTS

Among the 155 patients who had successful endoscopic therapy for bile duct stones, there were 79 (50.97%) cases of endoscopic biliary sphincterotomy, EPLBD and extraction versus 76 (49.03%) cases without EPLBD. The factors used to derive a scoring system included the size of CBD stones >15 mm, the difference between the stone and distal CBD diameter >2mm, distal CBD arm length <36 mm and stone shape. The score-based model's area under ROC was 0.88 (95% CI: 0.83, 0.93). For clinical use, the range of scores from 0 to 16, was divided into two subcategories based on CBD stone removal difficulty requiring EPLBD to derive the PPV. For scores <5 and ≥ 5, the PPV was 23.40 (p <0.001) and 93.44 (p <0.001) respectively. The Bootstrap sampling method indicated a prediction ability of 0.88 (AuROC, 95% CI: 0.83, 0.94).

CONCLUSION

This scoring system has acceptable prediction performance in assisting endoscopists in their choice of stone removal procedure.

Derivation and Validation of a Clinical Prediction Rule for Upper Limb Functional Outcomes After Traumatic Cervical Spinal Cord Injury

IMPORTANCE

Traumatic cervical spinal cord injury (SCI) can result in debilitating paralysis. Following cervical SCI, accurate early prediction of upper limb recovery can serve an important role in guiding the appropriateness and timing of reconstructive therapies.

OBJECTIVE

To develop a clinical prediction rule to prognosticate upper limb functional recovery after cervical SCI.

DESIGN, SETTING, AND PARTICIPANTS

This prognostic study was a retrospective review of a longitudinal cohort study including patients enrolled in the National SCI model systems (SCIMS) database in US. Eligible patients were 15 years or older with tetraplegia (neurological level of injury C1-C8, American Spinal Cord Injury Association [ASIA] impairment scale [AIS] A-D), with early (within 1 month of SCI) and late (1-year follow-up) clinical examinations from 2011 to 2016. The data analysis was conducted from September 2021 to June 2022.

MAIN OUTCOMES AND MEASURES

The primary outcome was a composite of dependency in eating, bladder management, transfers, and locomotion domains of functional independence measure at 1-year follow-up. Each domain ranges from 1 to 7 with a lower score indicating greater functional dependence. Composite dependency was defined as a score of 4 or higher in at least 3 chosen domains. Multivariable logistic regression was used to predict the outcome based on early neurological variables. Discrimination was quantified using C statistics, and model performance was internally validated with bootstrapping and 10-fold cross-validation. The performance of the prediction score was compared with AIS grading. Data were split into derivation (2011-2014) and temporal-validation (2015-2016) cohorts.

RESULTS

Among 2373 patients with traumatic cervical SCI, 940 had complete 1-year outcome data (237 patients [25%] aged 60 years or older; 753 men [80%]). The primary outcome was present in 118 patients (13%), which included 92 men (78%), 83 (70%) patients who were younger than 60 years, and 73 (62%) patients experiencing AIS grade A SCI. The variables significantly associated with the outcome were age (age 60 years or older: OR, 2.31; 95% CI, 1.26-4.19), sex (men: OR, 0.60; 95% CI, 0.31-1.17), light-touch sensation at C5 (OR, 0.44; 95% CI, 0.44-1.01) and C8 (OR, 036; 95% CI, 0.24-0.53) dermatomes, and motor scores of the elbow flexors (C5) (OR, 0.74; 95% CI, 0.60-0.89) and wrist extensors (C6) (OR, 0.61; 95% CI, 0.49-0.75). A multivariable model including these variables had excellent discrimination in distinguishing dependent from independent patients in the temporal-validation cohort (C statistic, 0.90; 95% CI, 0.88-0.93). A clinical prediction score (range, 0 to 45 points) was developed based on these measures, with higher scores increasing the probability of dependency. The discrimination of the prediction score was significantly higher than from AIS grading (change in AUC, 0.14; 95% CI, 0.10-0.18; P < .001).

CONCLUSIONS AND RELEVANCE

The findings of this study suggest that this prediction rule may help prognosticate upper limb function following cervical SCI. This tool can be used to set patient expectations, rehabilitation goals, and aid decision-making regarding the appropriateness and timing for upper limb reconstructive surgeries.