The bronchiolitis severity score: An assessment of face validity, construct validity, and interobserver reliability

Validity of Clinical Severity Scores for Respiratory Syncytial Virus: A Systematic Review

BACKGROUND

Respiratory syncytial virus (RSV) is a widespread respiratory pathogen, and RSV-related acute lower respiratory tract infections are the most common cause of respiratory hospitalization in children <2 years of age. Over the last 2 decades, a number of severity scores have been proposed to quantify disease severity for RSV in children, yet there remains no overall consensus on the most clinically useful score.

METHODS

We conducted a systematic review of English-language publications in peer-reviewed journals published since January 2000 assessing the validity of severity scores for children (≤24 months of age) with RSV and/or bronchiolitis, and identified the most promising scores. For included articles, (1) validity data were extracted, (2) quality of reporting was assessed using the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis checklist (TRIPOD), and (3) quality was assessed using the Prediction Model Risk Of Bias Assessment Tool (PROBAST). To guide the assessment of the validity data, standardized cutoffs were employed, and an explicit definition of what we required to determine a score was sufficiently validated.

RESULTS

Our searches identified 8541 results, of which 1779 were excluded as duplicates. After title and abstract screening, 6670 references were excluded. Following full-text screening and snowballing, 32 articles, including 31 scores, were included. The most frequently assessed scores were the modified Tal score and the Wang Bronchiolitis Severity Score; none of the scores were found to be sufficiently validated according to our definition. The reporting and/or design of all the included studies was poor. The best validated score was the Bronchiolitis Score of Sant Joan de Déu, and a number of other promising scores were identified.

CONCLUSIONS

No scores were found to be sufficiently validated. Further work is warranted to validate the existing scores, ideally in much larger datasets.

Pre-school wheeze hospital presentations: A demographic profile and review of clinical management

AIM

Pre-school wheeze is a common hospital presentation in Australasia. The aim of this study was to describe the regional hospital presentation and cost of pre-school wheeze.

METHODS

Audit of children diagnosed with pre-school wheeze at two hospitals in Auckland, New Zealand from October 2017 to September 2019. Guideline adherence was determined.

RESULTS

One hundred and ninety-two children made 247 pre-school wheeze hospital presentations. Pre-school wheeze accounted for a larger proportion of acute hospital presentations for Māori versus non-Māori children (rate ratio 1.76, 95% confidence intervals 1.32-2.31). Hospital representations with pre-school wheeze occurred in 38/192 (20%) children. The proportion with a pre-school wheeze representation was larger for Māori than non-Māori (30% vs. 16%, P = 0.02). Pre-school wheeze event median length of stay increased as household deprivation increased (P = 0.01). Clinical severity of 247 pre-school wheeze episodes was mild (n = 64, 26%), moderate (n = 153, 62%) and severe (n = 30, 12%). Of 244 episodes, inhaled bronchodilators only were given for 149 (61%), oxygen for 54 (22%) and intravenous treatment for 41 (17%). Hospital guideline use was evident in 164/247 (66%) episodes. Neither clinical severity nor treatment intensity varied with child sex, age or ethnicity or household deprivation. The estimated median (interquartile range) direct medical costs of each pre-school wheeze episode were NZ$1279 (NZ$774-2158).

CONCLUSIONS

In Auckland, pre-school wheeze accounts for a larger proportion of acute hospital presentations for Māori compared with non-Māori and Māori children have increased odds of pre-school wheeze readmissions. Length of hospital stay for pre-school wheeze episodes increased with household deprivation. In this audit pre-school wheeze guideline adherence was poor.

Performance Characteristics of a Machine-Learning Tool to Predict 7-Day Hospital Readmissions

OBJECTIVES

To develop an institutional machine-learning (ML) tool that utilizes demographic, socioeconomic, and medical information to stratify risk for 7-day readmission after hospital discharge; assess the validity and reliability of the tool; and demonstrate its discriminatory capacity to predict readmissions.

PATIENTS AND METHODS

We performed a combined single-center, cross-sectional, and prospective study of pediatric hospitalists assessing the face and content validity of the developed readmission ML tool. The cross-sectional analyses used data from questionnaire Likert scale responses regarding face and content validity. Prospectively, we compared the discriminatory capacity of provider readmission risk versus the ML tool to predict 7-day readmissions assessed via area under the receiver operating characteristic curve analyses.

RESULTS

Overall, 80% (15 of 20) of hospitalists reported being somewhat to very confident with their ability to accurately predict readmission risk; 53% reported that an ML tool would influence clinical decision-making (face validity). The ML tool variable exhibiting the highest content validity was history of previous 7-day readmission. Prospective provider assessment of risk of 413 discharges showed minimal agreement with the ML tool (κ = 0.104 [95% confidence interval 0.028-0.179]). Both provider gestalt and ML calculations poorly predicted 7-day readmissions (area under the receiver operating characteristic curve: 0.67 vs 0.52; P = .11).

CONCLUSIONS

An ML tool for predicting 7-day hospital readmissions after discharge from the general pediatric ward had limited face and content validity among pediatric hospitalists. Both provider and ML-based determinations of readmission risk were of limited discriminatory value. Before incorporating similar tools into real-time discharge planning, model calibration efforts are needed.

Characterization of Cardiopulmonary Interactions and Exploring Their Prognostic Value in Acute Bronchiolitis: A Prospective Cardiopulmonary Ultrasound Study

We aimed to delineate cardiopulmonary interactions in acute bronchiolitis and to evaluate the capacity of a combined cardiopulmonary ultrasonography to predict the need for respiratory support. This was a prospective observational single-center study that includes infants <12 month of age admitted to a hospital due to acute bronchiolitis. All the included patients underwent clinical, laboratory and cardiopulmonary ultrasonographic evaluation at the same time point within 24 h of hospital admission. The existence of significant correlation between cardiac and respiratory parameters was the primary outcome. The association of different cardiopulmonary variables with the need of respiratory support higher than O₂, the length of stay hospitalization, the PICU stay and the duration of respiratory support were a secondary outcome. We enrolled 112 infants (median age 1 (0.5–3) months; 62% males) hospitalized with acute bronchiolitis. Increased values of the pulmonary variables (BROSJOD score, pCO₂ and LUS) showed moderate correlations with NT-proBNP and all echocardiographic parameters indicative of pulmonary hypertension and myocardial dysfunction (Tei index). Up to 36 (32%) infants required respiratory support during the hospitalization. This group presented with higher lung ultrasound score (p < 0.001) and increased values of NT-proBNP (p < 0.001), the Tei index (p < 0.001) and pulmonary artery pressures (p < 0.001). All the analyzed respiratory and cardiac variables showed moderate-to-strong correlations with the LOS of hospitalization and the time of respiratory support. Lung ultrasound and echocardiography showed a moderate-to-strong predictive accuracy for the need of respiratory support in the ROC analysis, with the AUC varying from 0.74 to 0.87. Those cases of bronchiolitis with a worse pulmonary status presented with a more impaired cardiac status. Cardiopulmonary ultrasonography could be a useful tool to easily identify high-risk populations for complicated acute bronchiolitis hospitalization.