Monitoring Severity of Respiratory Syncytial Virus (RSV) in Infants and Young Children Using the Pediatric RSV Electronic Severity and Outcome Rating System (PRESORS): Results of Initial Quantitative Validation

Measuring respiratory syncytial virus infection severity in hospitalized children using the Pediatric Respiratory Syncytial Virus Electronic Severity and Outcome Rating System (PRESORS)

BACKGROUND

The Pediatric Respiratory Syncytial Virus Electronic Severity and Outcome Rating System (PRESORS) was developed to assess the severity of respiratory syncytial virus (RSV) infection in children. Because young children cannot report how they feel or function, ratings are based on observations by the child's caregiver (Observer-Reported Outcome questionnaire [ObsRO]) and clinician (Clinician-Reported Outcome questionnaire [ClinRO]). This prospective study aimed to evaluate the psychometric properties of the PRESORS.

METHODS

The PRESORS version 6 ObsRO and ClinRO were evaluated in children with RSV infection requiring hospitalization in centers in the United States, Argentina, and Chile. Assessments were performed from days 1 to 7 by the child's caregiver and clinician. To assess inter-rater reliability, two clinicians independently performed the ClinRO near in time.

RESULTS

A total of 124 children aged ≤36 months were enrolled (mean age, 8 months). Factor analysis demonstrated that RSV severity consists of two dimensions, respiratory signs and illness behavior, and that these dimensions were consistent over time. The inter-rater reliability for the ClinRO was 0.66 (95% confidence interval [CI], 0.55-0.75) but improved to 0.79 (95% CI, 0.71-0.86) after removing one outlying site, suggesting that quantifying RSV severity is not trivial, even using qualified raters, but that an adequate inter-rater reliability is achievable with the PRESORS through adequate training. ClinRO and ObsRO displayed acceptable internal consistency and acceptable convergent validity with the Respiratory Syncytial Virus Network Scale, global impression scores, and key hospital characteristics.

CONCLUSIONS

The PRESORS is relevant and appropriate for assessing the severity of RSV infection in infants requiring hospitalization.

Exploration of Caregiver Interrater Agreement and Test-Retest Reliability on the Infant Cleft Observer Outcomes (iCOO)

Caregiver and observer-reported measures are frequently used as outcomes for research on infants and young children who are unable to report on their own health. Our team developed the Infant with Clefts Observation Outcomes Instrument (iCOO) for infants with cleft lip with or without cleft palate. This exploratory study compared test-retest and interrater reliabilities to inform whether differences in caregiver perspective might affect the iCOO.

This study is a secondary analysis comparing caregiver interrater agreement to test-retest reliability. Twenty-five pairs of caregivers completed the iCOO before surgery, 1 week later for test-retest reliability, 2 days after surgery, and 2 months after surgery. Reliability was assessed using intraclass correlations (ICCs) and t-tests were used to compare ratings between caregivers.

Infants had cleft lip (28%) or cleft lip and palate (72%). Primary caregivers were predominantly mothers (92%) and secondary caregivers were predominantly fathers (80%). Test-retest reliability met psychometric standards for most items on the iCOO (81%-86% of items). Caregiver agreement on the iCOO items was lower than test-retest reliability (33%-46% of items met psychometric standards). Caregivers did not systematically differ in whether they rated infants as healthier or less healthy than the other caregiver (5%-16% of items had statistically significant differences).

Caregivers used the measure consistently, but had different experiences and perceptions of their infant's health and functioning. Future studies are needed to explore mechanisms for the differences in test-retest and interrater reliability. Whenever possible, the same caregiver should provide ratings of the infant, including on the iCOO.