Are Caregivers Who Respond to the Child HCAHPS Survey Reflective of All Hospitalized Pediatric Patients?

Variation in parental experiences with their child's hospitalization over the COVID-19 pandemic

BACKGROUND

Hospitals and healthcare workers have been greatly impacted by the COVID-19 pandemic. The potential impacts upon the patient experience have been less documented, particularly in the pediatric setting. Our aim was to examine how parental experiences with their child's hospitalization varied during the COVID-19 pandemic at two children's hospitals in Alberta, Canada.

METHODS

A random sample of parents were surveyed within six weeks of their child's discharge from Alberta's two children's hospitals. Surveys were administered using the Alberta Pediatric Inpatient Experiences Survey (APIES) - a validated instrument used to assess parental experiences during their child's hospitalization. Surveys were linked with administrative inpatient records. Three cohorts were created based on hospital discharge date: Pre-COVID (Pre: April 2019 to March 2020), COVID year one (C1: April 2020 to March 2021), and COVID year two (C2: April 2021 to March 2022). We examined 48 survey questions, including four overall rating scales. Survey responses were Likert scales. These were transformed to normalized scores from 0 (worst) to 100 (best). Differences between cohorts were assessed using ANOVA and the post-hoc Tukey test.

RESULTS

A total of 3,611 surveys (1,314 Pre; 997 C1; 1,300 C2) were completed over the three-year period. Five questions showed differences between the Pre and C1 periods, six showed differences between Pre and C2, and 13 showed differences between C1 and C2. Among these questions, scores pre-COVID were lower than COVID year one, while results in COVID year two were lower than pre-COVID and COVID year one. Thirty-one survey questions showed no statistical differences between the three time periods. For the overall ratings, only hospital rating showed a difference in any of the periods (91.4 C1 vs. 90.2 C2). Overall ratings of doctors, nurses, and recommendation of the hospital to others showed no differences.

CONCLUSION

This study showed that the experiences of parents during the first year of the COVID-19 pandemic were mildly better or comparable to historical results. This changed over the following year, where lower scores were reported on 13 questions.

Case-mix adjustment of patient-reported experience measures in National Regional Center for Pediatric

BACKGROUND

The aim of the study was to identify case-mix adjusters for the Chinese version of the Child Hospital Consumer Assessment of Healthcare Providers and Systems (Child-HCAHPS) and assess the impact of case-mix adjustment on patient experience measures in China.

METHODS

This study analyzed data collected from six National Regional Center for Pediatric across China retrospectively. Participants were children aged ≤17 years and their guardians who completed the survey. The Chinese Child-HCAHPS was used to measure pediatric inpatient care experience. Candidate case-mix adjusters were assessed using a summary measure of explanatory power. Changes in scores and rankings of the six centers were quantified to assess the impact of adjustment.

RESULTS

A total of 2708 respondents completed the survey from January to March 2021, with a response rate of 7-15%. The child's global health status and the respondent being the child's mother were identified as case-mix adjusters, and case-mix adjustment models for 18 patient experience items were constructed. Kendall's τ correlation of hospital rankings before and after adjustment ranged from 0.73 to 1.00.

CONCLUSIONS

Although the impact of case-mix adjustment may appear modest in our sample, it demonstrated the feasibility, necessity, and methodology for further development of case-mix adjustment models in pediatric healthcare facilities in China.

IMPACT

Case-mix adjustment models adjust for factors that are unamendable by healthcare providers that may affect patient experience ratings, thereby improving the comparability of institutional-level ratings. Standardized case-mix adjustment protocols for quality measures need to be modified in different settings. This is the first study to identify adjustment variables and the possible impact of case-mix adjustment on pediatric inpatients' experience measures in a Chinese population. This study provided evidence on the feasibility and necessity for further development of case-mix adjustment models for pediatric healthcare facilities in China.

Caregiver Satisfaction with Emergency Department Care for Pediatric Patients with Neurodevelopmental Disorders

OBJECTIVE

Children with neurodevelopmental disorders (NDDs) often encounter increased adversity when navigating the health care system. In this study, we explored the pediatric emergency department (PED) experience for patients with NDDs and their caregivers compared with that of patients without NDDs.

METHODS

Data for this study were obtained from National Research Corporation patient experience survey questionnaires and electronic medical record (EMR) data for patients presenting to a PED between May 2018 and September 2019. ED satisfaction was determined by the top-box approach; ED ratings of 9/10 or 10/10 were considered to reflect high ED satisfaction. Demographics, Emergency Severity Index, ED length of stay, time from arrival to triage, time to provider assessment, and diagnoses were extracted from the EMR. Patients with NDDs were identified based on International Classification of Diseases, Tenth Revision codes; patients with intellectual disabilities, pervasive and specific developmental disorders, or attention-deficit/hyperactivity disorders were included in the NDD cohort. One-to-one propensity score matching between patients with and without NDDs was performed, and a multivariable logistic regression model was built on the matched cohort.

RESULTS

Patients with NDDs represented over 7% of survey respondents. Matching was successful for 1162 patients with NDDs (99.5%), resulting in a matched cohort sample size of 2324. Caregivers of patients with NDDs had 25% lower odds of reporting high ED satisfaction (95% confidence interval [CI], 0.62-0.91, p = 0.004).

CONCLUSION

Caregivers of patients with NDDs make up a significant proportion of survey respondents and are more likely to rate the ED poorly than caregivers of patients without NDDs. This suggests an opportunity for targeted interventions in this population to improve patient care and experience.

Evaluation of a protocol for eliciting narrative accounts of pediatric inpatient experiences of care

OBJECTIVE

To evaluate the measurement properties of a set of six items designed to elicit narrative accounts of pediatric inpatient experience.

DATA SOURCES

Data came from 163 participants recruited from a probability-based online panel of U.S. adults. Participants were family members of a child who had an overnight hospital stay in the past 12 months.

STUDY DESIGN

Cross-sectional survey with follow-up phone interviews.

DATA COLLECTION/EXTRACTION METHODS

Participants completed an online (n = 129) or phone (n = 34) survey about their child's hospitalization experience. The survey contained closed-ended items from the Child Hospital Consumer Assessment of Healthcare Providers and Systems (Child HCAHPS) survey, followed by the six narrative items. Approximately 2 weeks after completing the survey, 47 participants additionally completed a one-hour, semi-structured phone interview, the results of which served as a "gold standard" for evaluating the fidelity of narrative responses. Qualitative content analysis was used to code narrative and interview responses for domains of patient experience and actionability.

PRINCIPAL FINDINGS

The average narrative was 248 words (SD = 319). Seventy-nine percent of narratives mentioned a topic included in the Child HCAHPS survey; 89% mentioned a topic not covered by that survey; and 75% included at least one detailed description of an actionable event. Overall, there was 66% correspondence between narrative and interview responses. Correspondence was higher on the phone than in the online condition (75% vs. 59%).

CONCLUSIONS

Narratives elicited from rigorously designed multi-item sets can provide detailed, substantive information about pediatric inpatient experiences that hospitals could use to improve child and family experiences during pediatric hospitalization. They add context to closed-ended survey item responses and provide information about experiences of care important to children and families that are not included in quantitative surveys.

Do Pediatrician Interpersonal and Personality Characteristics Affect Patient Experience?

BACKGROUND AND OBJECTIVES

Previous studies have demonstrated associations between patient experience scores and physician's demographic characteristics such as gender and race. There is a paucity of data, however, on the effect of broader pediatrician characteristics on caregivers' experience of their children's care. This study assessed pediatric caregiver experience of care ratings within a children's hospital and examined the effects of pediatricians' interpersonal and personality traits on caregiver experience ratings.

METHODS

This cross-sectional study included caregivers of children under 18 years old (n = 26,703) and physicians within children's hospital system (n = 65). Caregivers of children who received care from 2017 to 2019 provided their rating (0-10) of care experience via the standardized National Research Corporation Health Survey. Top box provider ratings were used for analyses. Physician's interpersonal and personality data were collected. Multilevel logistic regression analyses were used to examine the effects of physician interpersonal characteristics (empathy, compassion) and personality (perfectionism, Big Five personality traits [openness, conscientiousness, extraversion, agreeableness, neuroticism]) on experience of care rating.

RESULTS

The odds of caregivers of Spanish-speaking children to provide a high physician rating were 75% higher than the odds for non-Spanish-speaking patients. At the physician level, lower agreeableness (odds ratio [OR] = 0.63, P = .002), and lower narcissistic perfectionism (OR = 0.98, P = .016) were associated with an increased likelihood of a high care experience rating. The odds of nonemergency medicine pediatricians receiving high ratings were approximately 4.17 times higher than that of EM pediatricians.

CONCLUSIONS

Current results may inform future interventions that address pediatrician personality characteristics associated with caregivers of children experience outcomes.

Improving Patient Experience Scores Using Simultaneous Interpretation on Family-Centered Rounds

OBJECTIVES

Patients speaking a primary language other than English face barriers to equitable care, particularly patient-provider communications. There is no gold standard for providing inpatient medical interpretation on family-centered rounds (FCR). We aimed to implement simultaneous, in-person interpretation of FCR for Spanish-speaking families and hypothesized improved satisfaction in care.

METHODS

In-person, Spanish Equipment-Assisted Simultaneous Medical Interpretation (EASMI) was implemented in March 2018 on FCR. Child Hospital Consumer Assessment of Healthcare Providers and Systems (Child HCAHPS) experience scores on communication domains were analyzed for Spanish and English-speaking families pre- (n = 118) and postimplementation (n = 552). Postimplementation, we conducted medical team surveys (n = 104) and semistructured interviews with Spanish-speaking families (n = 25) to determine satisfaction with interpretation modalities (phone, video, and EASMI).

RESULTS

Spanish-speaking families exhibited statistically significant improvements in Child HCAHPS top box scores compared to English-speaking families in multiple communication and informed care-related domains. For example, "How often did your child's doctors explain things to you in a way that was easy to understand?" top box scores improved from 58% to 95% for Spanish-speaking families, compared to 85% to 83% for English speakers, with the differential effect of the intervention showing statistical significance (P = .001). Medical team surveys demonstrated high satisfaction with EASMI. Qualitative themes from interviews and open-ended survey responses emphasized multiple care benefits with EASMI, including a perceived reduction of communication errors and increased family participation.

CONCLUSIONS

EASMI was associated with significant improvements in Child HCAHPS scores in communication domains and increased medical team and family members' satisfaction with interpretation. EASMI presents a novel method for equitable FCR for Spanish-speaking families.

Response Bias for Press Ganey Ambulatory Surgery Surveys after Knee Surgery

The Press Ganey Ambulatory Surgery (PGAS) survey is an emerging tool used to capture patient satisfaction after elective surgery. Evaluating patient satisfaction is important; however, quality improvement (QI) surveys used to capture the patient experience may be subject to nonresponse bias. An orthopaedic registry was used to retrospectively identify patients who underwent ambulatory knee surgery from June 2015 to December 2019. Multivariable logistic regression was performed to identify independent predictors of PGAS survey nonresponse and response. In the cohort of 1,161 patients, 142 (12.2%) completed the PGAS survey. Multiple logistic regression demonstrated that male sex, Black race, not living with a caretaker, student or unemployment status, and worse preoperative Patient-Reported Outcomes Measurement Information System (PROMIS) fatigue were predictors of nonresponse. The results of this study highlight the presence of nonresponse bias in the PGAS survey after elective knee surgery.

Drivers of paediatric inpatient experience: retrospective analysis of casemix factors for the Alberta Paediatric Inpatient Experience Survey in Alberta, Canada

OBJECTIVE

In Alberta, the Alberta Paediatric Inpatient Experience Survey (APIES) is used as a proxy-reported measure of paediatric experience. To our knowledge, the influence of casemix factors on patient experience as measured by paediatric patient experience surveys have not been reported within Canadian paediatric samples. In this paper, we sought to determine the patient and respondent factors associated with paediatric inpatient experiences in Alberta, Canada.

DESIGN

Retrospective analysis of patient experience survey data.

SETTING

Inpatiet acute care hospitals in Alberta, Canada.

INTERVENTION AND MAIN OUTCOME MEASURES

Retrospective analyses were conducted using APIES surveys linked with eligible inpatient records (n=6262). Descriptive statistics were reported. χ² tests were performed to assess distribution of casemix between general and paediatric hospitals. Logistic regression was performed with overall hospital experience as the dependent variable with casemix and hospital variables as independent variables.

RESULTS

Casemix characteristics were unevenly distributed between general and paediatric hospitals. Compared with reference categories, older respondents, healthier patients and treatment at paediatric facilities had increased odds of providing most-positive ratings. Increased respondent education was associated with decreased odds of providing most-positive ratings. Likelihood-ratio tests showed that most casemix variables improved model fit, except for respondent relationship to the patient.

CONCLUSIONS

To improve reports of paediatric inpatient experience, administrators and providers require reliable and comparable measurement. Both the Child Hospital Consumer Assessment of Healthcare Providers and Systems and other measures of patient and family experience need to consider patient and respondent characteristics when interpreting results. Considered with other research from patient experience in Alberta, we discuss future directions and quality improvement implications.

Reliability and validity of an instrument to assess pediatric inpatients' experience of care in China

BACKGROUND

The Child Hospital Consumer Assessment of Healthcare Providers and Systems (Child HCAHPS) is a standard instrument to measure pediatric inpatients' experience of care. Currently, no Chinese version of the Child HCAHPS exists for Chinese patients. Therefore, this study aimed to create a Chinese version of the Child HCAHPS and investigate its validity and reliability in a Chinese setting.

METHODS

Using the approach recommended in guidelines from the Agency for Healthcare Research and Quality for translating HCAHPS surveys, we produced a Chinese version of the Child HCAHPS. A two-month field test with seven hospitals across five provinces in China was performed to assess its validity. Construct validity was assessed using confirmatory factor analysis. We evaluated convergent validity by factor loading, average variance extracted (AVE), and construct reliability (CR). Cronbach's alpha and corrected item-total correlation (CITC) were used to reflect hospital-level unit reliabilities for the survey's item composites. The correlation of the measure score with the overall rating was calculated to evaluate criterion validity.

RESULTS

An overall response rate of 63% was achieved, and 2,258 respondents completed the questionnaire. Confirmatory factor analysis showed a comparative fit index (CFI) of 0.905, a non-normed fix index of 0.886, and a root mean square error of approximation (RMSEA) of 0.089. Most items had factor loadings over 0.7. Cronbach's alpha coefficient on the overall level was 0.981, and all measures' CITC exceeded 0.6, demonstrating good to excellent hospital-level reliability of the composite and single-item measures. All composite measures had good to excellent internal consistency reliability (0.716 to 0.994). Item-to-composite correlation ranged from 0.510 to 0.997. Composite-to-composite correlations ranged from 0.488 to 0.997. According to the survey result, for all the 18 composite or single-item measures, mean top-box scores ranged from 56% ("Involving teens in care") to 87% ("Informed in Emergency Room").

CONCLUSIONS

The Chinese version of the Child HCAHPS demonstrated acceptable validity and reliability. The application of this tool can help benchmark ongoing healthcare improvement initiatives in China.

Does the Narrative Voice Influence Parental Perceptions of Pediatrician Blogs?

OBJECTIVE

To determine parental perceptions of pediatrician blog posts by narrative voice.

METHODS

Three blog posts each on 2 topics (vaccines and sleep) were written by an established physician blogger and varied by narrative voice (personal, third person objective and mixed). Topics were chosen to be applicable to all parents. Blog posts were evaluated by a communications expert, 2 research investigators, and 3 parents to confirm differences in narrative voice. We sampled parents of children 0 to 18 years old in 4 primary and subspecialty care clinics, and 1 inpatient medical unit. Participants were randomized to read 2 blog posts (1 per topic) that varied by narrative voice. Participants rated their perceptions of the accuracy, reliability, and appeal for each blog posts on a 5-point Likert Scale. The Kruskal-Wallis test was used to compare the distribution of parental rankings for accuracy, reliability, and appeal.

RESULTS

The average participant age (n = 258) was 39.8 (SD 9.7), 83% were female. Blog posts written in the third person objective voice were rated as more accurate and reliable than those in the personal or mixed voice. There was effect modification by topic, with parents rating the sleep blog posts as more accurate than the vaccine blog posts. There was no difference in the appeal of information by narrative voice or topic of blog post.

CONCLUSIONS

The narrative voice used to convey information on pediatrician blog posts can influence reader perception of accuracy and reliability. Physician bloggers can enhance parental trust of their content using study findings.

What Do Patients Want? A Qualitative Analysis of Patient, Provider, and Administrative Perceptions and Expectations About Patients' Hospital Stays

Patient experience is increasingly recognized as a measure of health care quality and patient-centered care and is currently measured through the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS). The HCAHPS survey may miss key factors important to patients, and in particular, to underserved patient populations. We performed a qualitative study utilizing semi-structured interviews with 45 hospitalized English- and Spanish-speaking patients and 6 focus groups with physicians, nurses, and administrators at a large, urban safety-net hospital. Four main themes were important to patients: (1) the hospital environment including cleanliness and how hospital policies and procedures impact patients’ perceived autonomy, (2) whole-person care, (3) communication with and between care teams and utilizing words that patients can understand, and (4) responsiveness and attentiveness to needs. We found that several key themes that were important to patients are not fully addressed in the HCAHPS survey and there is a disconnect between what patients and care teams believe patients want and what hospital policies drive in the care environment.

Association of Demographics and Hospital Stay Characteristics With Patient Experience in Hospitalized Pediatric Patients

There is limited research on patient experience in hospitalized pediatric patients. Our aim was to investigate the association of patient demographics and hospital stay characteristics with experience in a tertiary-care, freestanding children's hospital. We conducted a retrospective cross-sectional study of patient experience surveys. We designated the highest rating as "top-box" and examined data across 8 domains, including overall assessment (OA). A total of 4602 surveys were analyzed. Top-box percentages were lower for younger patients in 6 domains, including OA (0-<1 year old: 57.6%; 1-<4 years old: 61.3%; 4-<12 years old: 68.4%; ≥12 years old: 70.2%; P < .001), and were lower for patients with private insurance in 5 domains, including OA (private 63.2%, public 68.9%; P < .001). There was no association between other demographics (gender, race/ethnicity, primary language) and OA. Overall assessment was also not associated with length of stay (P = .071) and number of consulting services (P = .703). The most important domain predictor of OA was personal issues (odds ratio = 4.79), which assessed concern, sensitivity, and communication from staff. In conclusion, patient experience was associated with age and insurance status but not hospital stay characteristics.

Parental preferences for survey mode of administration, interview versus self-administered, with an asthma management questionnaire

Background: National asthma guidelines encourage use of patient surveys to aid clinical assessment. Little is known about how these should be administered in acute care settings such as the emergency department (ED).Objective: Evaluate if parents have a preference for interview versus self-administered surveys in an ED, understand the sociodemographic and clinical characteristics by choice of survey mode of administration, and assess if there is a difference by mode in the parent's perception of an asthma management tool.Methods: A research assistant (RA) surveyed parents of children 2-17 years of age seeking ED asthma care. Parents chose to either self-administer or have an RA-administered survey that included the Pediatric Asthma Control and Communication Instrument-ED version (PACCI-ED). We compared sociodemographic and clinical characteristics and perceptions about the PACCI-ED by mode of survey administration.Results: Of 174 parent participants, 60% chose interviewer-administered surveys. Parents who chose interviewer-administered versus self-administered surveys had lower income, lower educational attainment, and children with uncontrolled asthma (p < .05). Bivariate and multivariate analyses showed that parents who chose interviewer-administered versus self-administered surveys tended to rate the PACCI-ED more favorably.Conclusions: EDs wishing to systematically use an asthma survey may need to plan appropriate resources for staff to administer them, particularly if they serve populations of lower socioeconomic status.

Parental Perceptions of the Internet and Social Media as a Source of Pediatric Health Information

OBJECTIVE

1) To evaluate differences in how parents use the Internet and social media for health information by child age. 2) To examine parental perceptions of health information on social media.

METHODS

We conducted a cross-sectional survey of parents of children 0 to 18 years seen in clinics and an inpatient medical unit. Survey questions focused on: patterns of Internet and social media use, for what topics, and parental ratings of the accuracy, reliability, and appeal of information from social media. Parents' responses were categorized by age of their youngest child in years (0-4, 5-11, 12-18).

RESULTS

A total of 258 parents completed the survey. The mean age was 39.8 years, 83% were female, 59% were white. The most common topics parents read about online were: sleep, mental health, and car safety. Nearly all parents (96%) used social media, with 68% using social media for health information. There were no significant differences in the proportion of parents who reported using social media for health information by child age. Only half of parents discussed information from social media with their physician. Parents of children age ≥5 years rated health information on social media as significantly more accurate than parents of younger children. There were no significant differences in ratings of reliability and appeal by child age.

CONCLUSIONS

Parents of children of all ages use social media for a variety of important topics related to child health. As many parents do not discuss it with their physician, there are missed opportunities for pediatricians to provide high-quality information.