Quality Measures to Assess Care Transitions for Hospitalized Children

BACKGROUND

Transitions between sites of care are inherent to all hospitalizations, yet we lack pediatric-specific transitions-of-care quality measures. We describe the development and validation of new transitions-of-care quality measures obtained from medical record data.

METHODS

After an evidence review, a multistakeholder panel prioritized quality measures by using the RAND/University of California, Los Angeles modified Delphi method. Three measures were endorsed, operationalized, and field-tested at 3 children's hospitals and 2 community hospitals: quality of hospital-to-home transition record content, timeliness of discharge communication between inpatient and outpatient providers, and ICU-to-floor transition note quality. Summary scores were calculated on a scale from 0 to 100; higher scores indicated better quality. We examined between-hospital variation in scores, associations of hospital-to-home transition quality scores with readmission and emergency department return visit rates, and associations of ICU-to-floor transition quality scores with ICU readmission and length of stay.

RESULTS

A total of 927 charts from 5 hospitals were reviewed. Mean quality scores were 65.5 (SD 18.1) for the hospital-to-home transition record measure, 33.3 (SD 47.1) for the discharge communication measure, and 64.9 (SD 47.1) for the ICU-to-floor transition measure. The mean adjusted hospital-to-home transition summary score was 61.2 (SD 17.1), with significant variation in scores between hospitals (P < .001). Hospital-to-home transition quality scores were not associated with readmissions or emergency department return visits. ICU-to-floor transition note quality scores were not associated with ICU readmissions or hospital length of stay.

CONCLUSIONS

These quality measures were feasible to implement in diverse settings and varied across hospitals. The development of these measures is an important step toward standardized evaluation of the quality of pediatric transitional care.

Patient Characteristics Associated with Differences in Admission Frequency for Diabetic Ketoacidosis in United States Children's Hospitals

OBJECTIVES

To determine across and within hospital differences in the predictors of 365-day admission frequency for diabetic ketoacidosis (DKA) in children at US children's hospitals.

STUDY DESIGN

Multicenter retrospective cohort analysis of 12,449 children 2-18 years of age with a diagnosis of DKA in 42 US children's hospitals between 2004 and 2012. The main outcome of interest was the maximum number of DKA admissions experienced by each child within any 365-day interval during a 5-year follow-up period. The association between patient characteristics and the maximum number of DKA admissions within a 365-day interval was examined across and within hospitals.

RESULTS

In the sample, 28.3% of patients admitted for DKA experienced at least 1 additional DKA admission within the following 365 days. Across hospitals, patient characteristics associated with increasing DKA admission frequency were public insurance (OR 1.97, 95% CI 1.71-2.26), non-Hispanic black race (OR 2.40, 95% CI 2.02-2.85), age ≥ 12 (OR 1.98, 95% CI 1.7-2.32), female sex (OR 1.41, 95% CI 1.29-1.55), and mental health comorbidity (OR 1.36, 95% CI 1.13-1.62). Within hospitals, non-Hispanic black race was associated with higher odds of 365-day admission in 59% of hospitals, and public insurance was associated with higher odds in 56% of hospitals. Older age, female sex, and mental health comorbidity were associated with higher odds of 365-day admission in 42%, 29%, and 15% of hospitals, respectively.

CONCLUSIONS

Across children's hospitals, certain patient characteristics are associated with more frequent DKA admissions. However, these factors are not associated with increased DKA admission frequency for all hospitals.

Standardized Clinical Pathways for Hospitalized Children and Outcomes

BACKGROUND AND OBJECTIVE

Clinical pathways standardize care for common health conditions. We sought to assess whether institution-wide implementation of multiple standardized pathways was associated with changes in utilization and physical functioning after discharge among pediatric inpatients.

METHODS

Interrupted time series analysis of admissions to a tertiary care children's hospital from December 1, 2009 through March 30, 2014. On the basis of diagnosis codes, included admissions were eligible for 1 of 15 clinical pathways implemented during the study period; admissions from both before and after implementation were included. Postdischarge physical functioning improvement was assessed with the Pediatric Quality of Life Inventory 4.0 Generic Core or Infant Scales. Average hospitalization costs, length of stay, readmissions, and physical functioning improvement scores were calculated by month relative to pathway implementation. Segmented linear regression was used to evaluate differences in intercept and trend over time before and after pathway implementation.

RESULTS

There were 3808 and 2902 admissions in the pre- and postpathway groups, respectively. Compared with prepathway care, postpathway care was associated with a significant halt in rising costs (prepathway vs postpathway slope difference -$155 per month [95% confidence interval -$246 to -$64]; P = .001) and significantly decreased length of stay (prepathway vs post-pathway slope difference -0.03 days per month [95% confidence interval -0.05 to -0.02]; P = .02), without negatively affecting patient physical functioning improvement or readmissions.

CONCLUSIONS

Implementation of multiple evidence-based, standardized clinical pathways was associated with decreased resource utilization without negatively affecting patient physical functioning improvement. This approach could be widely implemented to improve the value of care provided.

Caregiver Perceptions of Hospital to Home Transitions According to Medical Complexity: A Qualitative Study

OBJECTIVE

To explore caregiver needs and preferences for achievement of high-quality pediatric hospital to home transitions and to describe similarities and differences in caregiver needs and preferences according to child medical complexity.

METHODS

Qualitative study using semistructured telephone interviews of 18 caregivers of patients aged 1 month to 18 years discharged from Seattle Children's Hospital between September 2013 and January 2014. Grounded theory methodology was used to elucidate needs and preferences identified to be important to caregivers. Medical complexity was determined using the Pediatric Medical Complexity Algorithm. Thematic comparisons between medical complexity groups were facilitated using a profile matrix.

RESULTS

A multidimensional theoretical framework consisting of 3 domains emerged to represent caregiver needs and preferences for hospital to home transitions. Caregiver self-efficacy for home care management emerged as the central domain in the framework. Caregivers identified several needs to promote their sense of self-efficacy including: support from providers familiar with the child, opportunities to practice home care skills, and written instructions containing contingency plan information. Many needs were consistent across medical complexity groups; however, some needs and preferences were only emphasized by caregivers of children with chronic conditions or caregivers of children with medical complexity. Distinct differences in caregiver preferences for how to meet these needs were also noted on the basis of the child's level of medical complexity.

CONCLUSIONS

Caregivers identified several needs and preferences for enhancement of their sense of self-efficacy during hospital to home transitions. These findings inform quality improvement efforts to develop family-centered transition systems of care that address the needs and preferences of broad pediatric populations.

Development and Pilot Testing of Caregiver-Reported Pediatric Quality Measures for Transitions Between Sites of Care

BACKGROUND

Few measures exist to assess pediatric transition quality between care settings. The study objective was to develop and pilot test caregiver-reported quality measures for pediatric hospital and emergency department (ED) to home transitions.

METHODS

On the basis of an evidence review, we developed draft caregiver-reported quality measures for transitions between sites of care. Using the RAND-UCLA Modified Delphi method, a multistakeholder panel endorsed measures for further development. Measures were operationalized into 2 surveys, which were administered to caregivers of patients (n = 2839) discharged from Seattle Children's Hospital between July 1 and September 1, 2014. Caregivers were randomized to mail or telephone survey mode. Measure scores were computed as a percentage of eligible caregivers who endorsed receiving the indicated care. Differences in scores were examined according to survey mode and caregiver characteristics.

RESULTS

The Delphi panel endorsed 6 of 8 hospital to home transition measures and 2 of 3 ED to home transitions measures. Scores differed significantly according to mode for 1 measure. Caregivers with lower levels of educational attainment and/or Spanish-speaking caregivers reported significantly higher scores on 3 of the measures. The largest difference was reported for the measure that assessed whether caregivers received assistance with scheduling follow-up appointments; 92% score for caregivers with lower educational attainment versus 79% for caregivers with higher educational attainment (P < .001).

CONCLUSIONS

We developed 8 new, evidence-based quality measures to assess transition quality from the perspective of caregivers. Pilot testing of these measures in a single institution yielded valuable insights for future testing and implementation of these measures.

Effect of Telephone vs Video Interpretation on Parent Comprehension, Communication, and Utilization in the Pediatric Emergency Department: A Randomized Clinical Trial

IMPORTANCE

Consistent professional interpretation improves communication with patients who have limited English proficiency. Remote modalities (telephone and video) have the potential for wide dissemination.

OBJECTIVE

To test the effect of telephone vs. video interpretation on communication during pediatric emergency care.

DESIGN, SETTING, AND PARTICIPANTS

Randomized trial of telephone vs. video interpretation at a free-standing, university-affiliated pediatric emergency department (ED). A convenience sample of 290 Spanish-speaking parents of pediatric ED patients with limited English proficiency were approached from February 24 through August 16, 2014, of whom 249 (85.9%) enrolled; of these, 208 (83.5%) completed the follow-up survey (91 parents in the telephone arm and 117 in the video arm). Groups did not differ significantly by consent or survey completion rate, ED factors (eg, ED crowding), child factors (eg, triage level, medical complexity), or parent factors (eg, birth country, income). Investigators were blinded to the interpretation modality during outcome ascertainment. Intention-to-treat data were analyzed August 25 to October 20, 2014.

INTERVENTIONS

Telephone or video interpretation for the ED visit, randomized by day.

MAIN OUTCOMES AND MEASURES

Parents were surveyed 1 to 7 days after the ED visit to assess communication and interpretation quality, frequency of lapses in interpreter use, and ability to name the child's diagnosis. Two blinded reviewers compared parent-reported and medical record-abstracted diagnoses and classified parent-reported diagnoses as correct, incorrect, or vague.

RESULTS

Among 208 parents who completed the survey, those in the video arm were more likely to name the child's diagnosis correctly than those in the telephone arm (85 of 114 [74.6%] vs. 52 of 87 [59.8%]; P = .03) and less likely to report frequent lapses in interpreter use (2 of 117 [1.7%] vs. 7 of 91 [7.7%]; P = .04). No differences were found between the video and telephone arms in parent-reported quality of communication (101 of 116 [87.1%] vs. 74 of 89 [83.1%]; P = .43) or interpretation (58 of 116 [50.0%] vs. 42 of 89 [47.2%]; P = .69). Video interpretation was more costly (per-patient mean [SD] cost, $61 [$36] vs. $31 [$20]; P < .001). Parent-reported adherence to the assigned modality was higher for the video arm (106 of 114 [93.0%] vs .68 of 86 [79.1%]; P = .004).

CONCLUSIONS AND RELEVANCE

Families with limited English proficiency who received video interpretation were more likely to correctly name the child's diagnosis and had fewer lapses in interpreter use. Use of video interpretation shows promise for improving communication and patient care in this population.

TRIAL REGISTRATION

clinicaltrials.gov Identifier: NCT01986179.

The Influence of Provider Communication Behaviors on Parental Vaccine Acceptance and Visit Experience

OBJECTIVES

We investigated how provider vaccine communication behaviors influence parental vaccination acceptance and visit experience.

METHODS

In a cross-sectional observational study, we videotaped provider-parent vaccine discussions (n = 111). We coded visits for the format providers used for initiating the vaccine discussion (participatory vs presumptive), parental verbal resistance to vaccines after provider initiation (yes vs no), and provider pursuit of recommendations in the face of parental resistance (pursuit vs mitigated or no pursuit). Main outcomes were parental verbal acceptance of recommended vaccines at visit's end (all vs ≥ 1 refusal) and parental visit experience (highly vs lower rated).

RESULTS

In multivariable models, participatory (vs presumptive) initiation formats were associated with decreased odds of accepting all vaccines at visit's end (adjusted odds ratio [AOR] = 0.04; 95% confidence interval [CI] = 0.01, 0.15) and increased odds of a highly rated visit experience (AOR = 17.3; 95% CI = 1.5, 200.3).

CONCLUSIONS

In the context of 2 general communication formats used by providers to initiate vaccine discussions, there appears to be an inverse relationship between parental acceptance of vaccines and visit experience. Further exploration of this inverse relationship in longitudinal studies is needed.

Pain and Health-Related Quality of Life After Pediatric Inpatient Surgery

Around 4 million children undergo inpatient surgery in the United States each year, however little is known about the impact of surgery and postoperative pain on children's health-related quality of life (HRQOL) during the weeks and months after surgery. We measured pain and HRQOL in a large, heterogeneous pediatric postsurgical population from baseline to 1-month follow-up. Over a 20-month period, parents of 915 children age 2 to 18 years (mean = 9.6 years), 50% male, 56% white, admitted to surgical services at a children's hospital enrolled in the study. Parent participants reported on sociodemographics, child HRQOL, and pain characteristics at baseline and 1 month after discharge. Although most of the children recovered to baseline by 1 month after hospital discharge, 23% of children had a significant decline in HRQOL. Logistic regression analyses found that increasing child age (odds ratio = 2.1 for age 13-18 years) and the presence of moderate-severe postsurgical pain at 1 month (odds ratio = 5.7) were significantly associated with deterioration in HRQOL from baseline to 1-month follow-up (P < .05 for each variable). Although HRQOL returns to the baseline level for most children, a sizeable proportion have significant deterioration in HRQOL associated with continued postsurgical pain at 1 month after hospital discharge from surgery.

PERSPECTIVE

This study addresses an important gap in the literature, examining pain and health-related quality of life in a broad population of children undergoing a wide range of inpatient surgeries. Evaluation of inpatient health services from a patient and family perspective is essential in evaluating outcomes of surgical care.

Communication practices and antibiotic use for acute respiratory tract infections in children

PURPOSE

This study examined relationships between provider communication practices, antibiotic prescribing, and parent care ratings during pediatric visits for acute respiratory tract infection (ARTI).

METHODS

A cross-sectional study was conducted of 1,285 pediatric visits motivated by ARTI symptoms. Children were seen by 1 of 28 pediatric providers representing 10 practices in Seattle, Washington, between December 2007 and April 2009. Providers completed post-visit surveys reporting on children's presenting symptoms, physical examination findings, assigned diagnoses, and treatments prescribed. Parents completed post-visit surveys reporting on provider communication practices and care ratings for the visit. Multivariate analyses identified key predictors of prescribing antibiotics for ARTI and of parent visit ratings.

RESULTS

Suggesting actions parents could take to reduce their child's symptoms (providing positive treatment recommendations) was associated with decreased risk of antibiotic prescribing whether done alone or in combination with negative treatment recommendations (ruling out the need for antibiotics) [adjusted risk ratio (aRR) 0.48; 95% CI, 0.24-0.95; and aRR 0.15; 95% CI, 0.06-0.40, respectively]. Parents receiving combined positive and negative treatment recommendations were more likely to give the highest possible visit rating (aRR 1.16; 95% CI, 1.01-1.34).

CONCLUSION

Combined use of positive and negative treatment recommendations may reduce the risk of antibiotic prescribing for children with viral ARTIs and at the same time improve visit ratings. With the growing threat of antibiotic resistance at the community and individual level, these communication techniques may assist frontline providers in helping to address this pervasive public health problem.

Racial disparities in failure-to-rescue among children undergoing congenital heart surgery

OBJECTIVE

To determine if racial/ethnic disparities exist among children undergoing congenital heart surgery, using failure-to-rescue (FTR) as a measure of hospital-based quality.

STUDY DESIGN

This is a retrospective, repeated cross-sectional analysis using admissions from the 2003, 2006, and 2009 Kids' Inpatient Database. All pediatric admissions (≤ 18 years) with a Risk Adjustment for Congenital Heart Surgery procedure were included. Logistic regression models examining complications, FTR, and overall mortality were constructed.

RESULTS

Hispanic ethnicity (OR 1.13, 95% CI 1.01-1.26) was associated with increased odds of experiencing a complication when compared with white race. However, black race (OR 1.66, 95% CI 1.33-2.07) and other race/ethnicity (OR 1.40, 95% CI 1.10-1.79) were risk factors for FTR. Although Hispanic ethnicity was associated with increased odds of experiencing a complication, it was not associated with FTR. In hospital fixed-effects models, black race and other race/ethnicity remained as "within hospital" risk factors for FTR.

CONCLUSIONS

Black children and children of other race/ethnicity had higher rates of mortality after experiencing a complication. This suggests that racial disparities may exist in hospital-based cardiac care or response to care.

Evaluation of a quality improvement intervention to increase use of telephonic interpretation

BACKGROUND

Language barriers are associated with poor health care outcomes, and barriers exist for timely in-person interpretation. Although available on-demand, telephonic interpretation remains underutilized. This study evaluates whether a quality improvement (QI) intervention was associated with rates of interpretation and parent-reported language service use at a children's hospital.

METHODS

The QI intervention was developed by a multidisciplinary team and included provider education, electronic alerts, standardized dual-handset telephones, and 1-touch dialing in all hospital rooms. Interpreter use was tracked for 12 months before, 5 months during, and 12 months after the intervention. Weekly rates of interpretation per limited English proficient (LEP) patient-day were evaluated by using segmented linear regression. LEP parents were surveyed about professional interpretation and delays in care. Responses before, during, and after the intervention were compared by using the χ(2) test for trend.

RESULTS

Telephonic interpretation rates increased by 53% after the intervention (baseline 0.38 per patient-day, increased 0.20 [0.13-0.28]). Overall (telephonic and in-person) interpretation increased by 54% (baseline 0.96, increased by 0.51 [0.38-0.64]). Parent-reported interpreter use improved, including more frequent use of professional interpreters (53.3% before, 71.8% during, 69.3% after, P trend = .001), less frequent use of ad hoc interpreters (52.4% before, 38.1% during, 41.4% after, P trend = .03), and fewer interpretation-related delays in care (13.3% before, 7.9% during, 6.0% after, P trend = .01).

CONCLUSIONS

This QI intervention was associated with increased telephonic interpreter use and improved parent-reported use of professional language services. This is a promising approach to deliver safe, timely, and equitable care for the growing population of LEP children and families.

Impact of English proficiency on care experiences in a pediatric emergency department

OBJECTIVE

To compare emergency department care experiences of Spanish-speaking, limited-English-proficient (SSLEP) and English-proficient (EP) parents and to assess how SSLEP care experiences vary by parent-perceived interpretation accuracy.

METHODS

The National Research Corporation Picker Institute's Family Experience Survey (FES) was administered from November 26, 2010, to July 17, 2011, to 478 EP and 152 SSLEP parents. Problem scores for 3 FES dimensions were calculated: information/education, partnership with clinicians, and access/coordination of care. Adjusted associations between language proficiency (SSLEP vs EP) and dimension problem scores were examined by multivariate Poisson regression. Unadjusted Poisson regression analysis was used to examine the association between perceived interpretation accuracy and FES problem scores for SSLEP parents who received interpretation.

RESULTS

SSLEP parents had a higher risk of reporting problems with access/coordination of care compared to EP parents (risk ratio 1.6, 95% confidence interval 1.2, 2.1). There were no differences in reported care experiences related to information/education or partnership with clinicians. Among SSLEP parents who received professional interpretation, those reporting poor accuracy had a higher risk of also reporting problems with information/education (risk ratio 2.1, 95% confidence interval 1.2, 3.6).

CONCLUSIONS

In a pediatric emergency department with around-the-clock access to professional interpretation, SSLEP parents report poorer experiences than EP parents with access/coordination of care, including perceived wait times. Their experiences with provision of information/education and partnership with clinicians approximate those of EP parents. However, SSLEP parents who perceive poor interpretation accuracy report more problems understanding information provided about their child's illness and care.

Standardizing morphine use for ventilated preterm neonates with a nursing-driven comfort protocol

OBJECTIVE

To test whether implementing a nursing-driven comfort protocol standardizes morphine use in one neonatal intensive care unit (NICU) and to examine how non-standard morphine (N-SM) relates to days of ventilation, days of total parenteral nutrition (TPN) and length of stay (LOS).

STUDY DESIGN

This was a retrospective/prospective observational study using pharmacy records, medical records, and an outcomes database. Comfort protocol implementation began February 2011 and was applied to preterm, ventilated neonates <1500 grams. Pre- and post-implementation proportions of N-SM days were compared using the binomial test. A percent 'P'-chart spanning 30 quarters was constructed with statistical-process control analysis. Multivariable linear regression adjusting for acuity assessed the relationship between N-SM use and days of ventilation, TPN and LOS.

RESULT

Hundred and thirty-four patients met inclusion criteria, 116 prior to and 18 after implementation. The proportion of patients given N-SM for one or more days decreased from 59 to 35% after protocol implementation (P = 0.017). A 9-month period of decreased N-SM days was observed after protocol implementation. Controlling for acuity, each additional day of N-SM use was associated with 0.47 more days of ventilation (95% confidence interval (CI): 0.26-0.69, P < 0.001) and 0.52 more days of TPN (95% CI: 0.35-0.68, P < 0.001). Exposure to N-SM was associated with 17 additional days of hospitalization (P = 0.009, 95% CI: 4.5-30).

CONCLUSION

Implementing a nursing-driven comfort protocol significantly reduced N-SM use. N-SM in the NICU is negatively associated with key clinical outcomes. Testing similar protocols in other settings is warranted.

Bacterial prevalence and antimicrobial prescribing trends for acute respiratory tract infections

BACKGROUND AND OBJECTIVES

Antimicrobials are frequently prescribed for acute respiratory tract infections (ARTI), although many are viral. We aimed to determine bacterial prevalence rates for 5 common childhood ARTI - acute otitis media (AOM), sinusitis, bronchitis, upper respiratory tract infection, and pharyngitis- and to compare these rates to nationally representative antimicrobial prescription rates for these ARTI.

METHODS

We performed (1) a meta-analysis of English language pediatric studies published between 2000 and 2011 in Medline, Embase, and the Cochrane library to determine ARTI bacterial prevalence rates; and (2) a retrospective cohort analysis of children age <18 years evaluated in ambulatory clinics sampled by the 2000-2010 National Ambulatory Medical Care Survey (NAMCS) to determine estimated US ARTI antimicrobial prescribing rates.

RESULTS

From the meta-analysis, the AOM bacterial prevalence was 64.7% (95% confidence interval [CI], 50.5%-77.7%); Streptococcus pyogenes prevalence during pharyngitis was 20.2% (95% CI, 15.9%-25.2%). No URI or bronchitis studies met inclusion criteria, and 1 sinusitis study met inclusion criteria, identifying bacteria in 78% of subjects. Based on these condition-specific bacterial prevalence rates, the expected antimicrobial rescribing rate for ARTI overall was 27.4% (95% CI, 26.5%-28.3%). However, antimicrobial agents were prescribed in NAMCS during 56.9% (95% CI, 50.8%-63.1%) of ARTI encounters, representing an estimated 11.4 million potentially preventable antimicrobial prescriptions annually.

CONCLUSIONS

An estimated 27.4% of US children who have ARTI have bacterial illness in the post-pneumococcal conjugate vaccine era. Antimicrobials are prescribed almost twice as often as expected during outpatient ARTI visits, representing an important target for ongoing antimicrobial stewardship interventions.

Developing measures for pediatric quality: methods and experiences of the CHIPRA pediatric quality measures program grantees

BACKGROUND

Monitoring quality is an important way of understanding how the health care system is serving children and families. The Children's Health Insurance Program Reauthorization Act of 2009 (CHIPRA) Pediatric Quality Measures Program (PQMP) funded efforts to develop and enhance measures to assess care for children and adolescents. We describe the processes used by the PQMP grantees to develop measures to assess the health care of children and adolescents in Medicaid and the Children's Health Insurance Program.

METHODS

Key steps in the measures development process include identifying concepts, reviewing and synthesizing evidence, prioritizing concepts, defining how measures should be calculated, and measure testing. Stakeholder engagement throughout the process is critical. Case studies illustrate how PQMP grantees adapted the process to respond to the nature of measures they were charged to develop and overcome challenges encountered.

RESULTS

PQMP grantees used varied approaches to measures development but faced common challenges, some specific to the field of pediatrics and some general to all quality measures. Major challenges included the limited evidence base, data systems difficult or unsuited for measures reporting, and conflicting stakeholder priorities.

CONCLUSIONS

As part of the PQMP, grantees were able to explore innovative methods to overcome measurement challenges, including new approaches to building the evidence base and stakeholder consensus, integration of alternative data sources, and implementation of new testing methods. As a result, the PQMP has developed new quality measures for pediatric care while also building an infrastructure, expertise, and enhanced methods for measures development that promise to provide more relevant and meaningful tools for improving the quality of children's health care.

Using Medicaid and CHIP claims data to support pediatric quality measurement: lessons from 3 centers of excellence in measure development

OBJECTIVE

We sought to explore the claims data-related issues relevant to quality measure development for Medicaid and the Children's Health Insurance Program (CHIP), illustrating the challenges encountered and solutions developed around 3 distinct performance measure topics: care coordination for children with complex needs, quality of care for high-prevalence conditions, and hospital readmissions.

METHODS

Each of 3 centers of excellence presents an example that illustrates the challenges of using claims data for quality measurement.

RESULTS

Our Centers of Excellence in pediatric quality measurement used innovative methods to develop algorithms that use Medicaid claims data to identify children with complex needs; overcome some shortcomings of existing data for measuring quality of care for common conditions such as otitis media; and identify readmissions after hospitalizations for lower respiratory infections.

CONCLUSIONS

Our experience constructing quality measure specifications using claims data suggests that it will be challenging to measure key quality of care constructs for Medicaid-insured children at a national level in a timely and consistent way. Without better data to underpin pediatric quality measurement, Medicaid and CHIP will have difficulty using some existing measures for accountability, value-based purchasing, and quality improvement both across states and within states.

Pediatric medical complexity algorithm: a new method to stratify children by medical complexity

OBJECTIVES

The goal of this study was to develop an algorithm based on International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM), codes for classifying children with chronic disease (CD) according to level of medical complexity and to assess the algorithm's sensitivity and specificity.

METHODS

A retrospective observational study was conducted among 700 children insured by Washington State Medicaid with ≥1 Seattle Children's Hospital emergency department and/or inpatient encounter in 2010. The gold standard population included 350 children with complex chronic disease (C-CD), 100 with noncomplex chronic disease (NC-CD), and 250 without CD. An existing ICD-9-CM-based algorithm called the Chronic Disability Payment System was modified to develop a new algorithm called the Pediatric Medical Complexity Algorithm (PMCA). The sensitivity and specificity of PMCA were assessed.

RESULTS

Using hospital discharge data, PMCA's sensitivity for correctly classifying children was 84% for C-CD, 41% for NC-CD, and 96% for those without CD. Using Medicaid claims data, PMCA's sensitivity was 89% for C-CD, 45% for NC-CD, and 80% for those without CD. Specificity was 90% to 92% in hospital discharge data and 85% to 91% in Medicaid claims data for all 3 groups.

CONCLUSIONS

PMCA identified children with C-CD (who have accessed tertiary hospital care) with good sensitivity and good to excellent specificity when applied to hospital discharge or Medicaid claims data. PMCA may be useful for targeting resources such as care coordination to children with C-CD.

Variation in outcomes of quality measurement by data source

OBJECTIVE

To evaluate selected Children's Health Insurance Program Reauthorization Act claims-based quality measures using claims data alone, electronic health record (EHR) data alone, and both data sources combined.

METHODS

Our population included pediatric patients from 46 clinics in the OCHIN network of community health centers, who were continuously enrolled in Oregon's public health insurance program during 2010. Within this population, we calculated selected pediatric care quality measures according to the Children's Health Insurance Program Reauthorization Act technical specifications within administrative claims. We then calculated these measures in the same cohort, by using EHR data, by using the technical specifications plus clinical data previously shown to enhance capture of a given measure. We used the k statistic to determine agreement in measurement when using claims versus EHR data. Finally, we measured quality of care delivered to the study population, when using a combined dataset of linked, patient-level administrative claims and EHR data.

RESULTS

When using administrative claims data, 1.0% of children (aged 3-17) had a BMI percentile recorded, compared with 71.9% based on the EHR data (k agreement [k] # 0.01), and 72.0% in the combined dataset. Among children turning 2 in 2010, 20.2% received all recommended immunizations according to the administrative claims data, 17.2% according to the EHR data (k = 0.82), and 21.4% according to the combined dataset.

CONCLUSIONS

Children's care quality measures may not be accurate when assessed using only administrative claims. Adding EHR data to administrative claims data may yield more complete measurement.

Individualized plans of care to improve outcomes among children and adults with chronic illness: a systematic review

BACKGROUND

Adults and children with chronic illness often require services from multiple providers. Individualized plans of care (IPCs) are sometimes developed to improve care coordination. However, their association with improved outcomes is unknown.

METHODS

We searched literature published between January 2001 and October 2011, using Medline, CINAHL, EMBASE, PsychINFO, and bibliographic review. Eligible studies involved an IPC with input from the patient and/or family of individuals with chronic illness, evaluated outcomes, and were conducted in the United States. We assessed evidence quality using Oxford Centre for Evidence-Based Medicine criteria.

RESULTS

15 studies met inclusion criteria. Studies were heterogeneous regarding populations and outcomes examined and were generally low quality. Most described IPC use within a multifaceted care coordination intervention. The strongest evidence links IPC use and symptom improvement in depressed adults; the weakest evidence exists for outcomes in children. Vague descriptions of the IPCs' limited analysis.

CONCLUSIONS

Current evidence supporting an association between IPC use and improved outcomes, particularly among children, is sparse. Well-designed evaluations of clearly described IPCs are needed to examine who should be involved in their development, what they should include, and how often they should be updated to improve outcomes of care for this vulnerable population.

Common and costly hospitalizations for pediatric mental health disorders

BACKGROUND AND OBJECTIVES

Inpatient pediatric mental health is a priority topic for national quality measurement and improvement, but nationally representative data on the patients admitted or their diagnoses are lacking. Our objectives were: to describe pediatric mental health hospitalizations at general medical facilities admitting children nationally; to assess which pediatric mental health diagnoses are frequent and costly at these hospitals; and to examine whether the most frequent diagnoses are similar to those at free-standing children's hospitals.

METHODS

We examined all discharges in 2009 for patients aged 3 to 20 years in the nationally representative Kids' Inpatient Database (KID) and in the Pediatric Health Information System (free-standing children's hospitals). Main outcomes were frequency of International Classification of Diseases, Ninth Revision, Clinical Modification-defined mental health diagnostic groupings (primary and nonprimary diagnosis) and, using KID, resource utilization (defined by diagnostic grouping aggregate annual charges).

RESULTS

Nearly 10% of pediatric hospitalizations nationally were for a primary mental health diagnosis, compared with 3% of hospitalizations at free-standing children's hospitals. Predictors of hospitalizations for a primary mental health problem were older age, male gender, white race, and insurance type. Nationally, the most frequent and costly primary mental health diagnoses were depression (44.1% of all mental health admissions; $1.33 billion), bipolar disorder (18.1%; $702 million), and psychosis (12.1%; $540 million).

CONCLUSIONS

We identified the child mental health inpatient diagnoses with the highest frequency and highest costs as depression, bipolar disorder, and psychosis, with substance abuse an important comorbid diagnosis. These diagnoses can be used as priority conditions for pediatric mental health inpatient quality measurement.

The architecture of provider-parent vaccine discussions at health supervision visits

OBJECTIVE

To characterize provider-parent vaccine communication and determine the influence of specific provider communication practices on parent resistance to vaccine recommendations.

METHODS

We conducted a cross-sectional observational study in which we videotaped provider-parent vaccine discussions during health supervision visits. Parents of children aged 1 to 19 months old were screened by using the Parent Attitudes about Childhood Vaccines survey. We oversampled vaccine-hesitant parents (VHPs), defined as a score ≥50. We developed a coding scheme of 15 communication practices and applied it to all visits. We used multivariate logistic regression to explore the association between provider communication practices and parent resistance to vaccines, controlling for parental hesitancy status and demographic and visit characteristics.

RESULTS

We analyzed 111 vaccine discussions involving 16 providers from 9 practices; 50% included VHPs. Most providers (74%) initiated vaccine recommendations with presumptive (e.g., "Well, we have to do some shots") rather than participatory (e.g., "What do you want to do about shots?") formats. Among parents who voiced resistance to provider initiation (41%), significantly more were VHPs than non-VHPs. Parents had significantly higher odds of resisting vaccine recommendations if the provider used a participatory rather than a presumptive initiation format (adjusted odds ratio: 17.5; 95% confidence interval: 1.2-253.5). When parents resisted, 50% of providers pursued their original recommendations (e.g., "He really needs these shots"), and 47% of initially resistant parents subsequently accepted recommendations when they did.

CONCLUSIONS

How providers initiate and pursue vaccine recommendations is associated with parental vaccine acceptance.