Practice-level effects of interventions to improve asthma care in primary care settings: the Pediatric Asthma Care Patient Outcomes Research Team

Predicting Continuity of Asthma Care Using a Machine Learning Model: Retrospective Cohort Study

Continuity of care (COC) has been shown to possess numerous health benefits for chronic diseases. Specifically, the establishment of its level can facilitate clinical decision-making and enhanced allocation of healthcare resources. However, the use of a generalizable predictive methodology to determine the COC in patients has been underinvestigated. To fill this research gap, this study aimed to develop a machine learning model to predict the future COC of asthma patients and explore the associated factors. We included 31,724 adult outpatients with asthma who received care from the University of Washington Medicine between 2011 and 2018, and examined 138 features to build the machine learning model. Following the 10-fold cross-validations, the proposed model yielded an accuracy of 88.20%, an average area under the receiver operating characteristic curve of 0.96, and an average F1 score of 0.86. Further analysis revealed that the severity of asthma, comorbidities, insurance, and age were highly correlated with the COC of patients with asthma. This study used predictive methods to obtain the COC of patients, and our excellent modeling strategy achieved high performance. After further optimization, the model could facilitate future clinical decisions, hospital management, and improve outcomes.

Optimal designs for group randomized trials and group administered treatments with outcomes at the subject and group level

With group randomized trials complete groups of subject are randomized to treatment conditions. Such grouping also occurs in individually randomized trials where treatment is administered in groups. Outcomes may be measured at the level of the subject, but also at the level of the group. The optimal design determines the number of groups and the number of subjects per group in the intervention and control conditions. It is found by taking a budgetary constraint into account, where costs are associated with implementing the intervention and control, and with taking measurements on subject and groups. The optimal design is found such that the effect of treatment is estimated with highest efficiency, and the total costs do not exceed the budget that is available. The design that is optimal for the outcome at the subject level is not necessarily optimal for the outcome at the group level. Multiple-objective optimal designs consider both outcomes simultaneously. Their aim is to find a design that has high efficiencies for both outcome measures. An Internet application for finding the multiple-objective optimal design is demonstrated on the basis of an example from smoking prevention in primary education, and another example on consultation time in primary care.

Local opinion leaders: effects on professional practice and healthcare outcomes

BACKGROUND

Clinical practice is not always evidence-based and, therefore, may not optimise patient outcomes. Local opinion leaders (OLs) are individuals perceived as credible and trustworthy, who disseminate and implement best evidence, for instance through informal one-to-one teaching or community outreach education visits. The use of OLs is a promising strategy to bridge evidence-practice gaps. This is an update of a Cochrane review published in 2011.

OBJECTIVES

To assess the effectiveness of local opinion leaders to improve healthcare professionals' compliance with evidence-based practice and patient outcomes.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, three other databases and two trials registers on 3 July 2018, together with searching reference lists of included studies and contacting experts in the field.

SELECTION CRITERIA

We considered randomised studies comparing the effects of local opinion leaders, either alone or with a single or more intervention(s) to disseminate evidence-based practice, with no intervention, a single intervention, or the same single or more intervention(s). Eligible studies were those reporting objective measures of professional performance, for example, the percentage of patients being prescribed a specific drug or health outcomes, or both. We included all studies independently of the method used to identify OLs.

DATA COLLECTION AND ANALYSIS

We used standard Cochrane procedures in this review. The main comparison was (i) between any intervention involving OLs (OLs alone, OLs with a single or more intervention(s)) versus any comparison intervention (no intervention, a single intervention, or the same single or more intervention(s)). We also made four secondary comparisons: ii) OLs alone versus no intervention, iii) OLs alone versus a single intervention, iv) OLs, with a single or more intervention(s) versus the same single or more intervention(s), and v) OLs with a single or more intervention(s) versus no intervention.

MAIN RESULTS

We included 24 studies, involving more than 337 hospitals, 350 primary care practices, 3005 healthcare professionals, and 29,167 patients (not all studies reported this information). A majority of studies were from North America, and all were conducted in high-income countries. Eighteen of these studies (21 comparisons, 71 compliance outcomes) contributed to the median adjusted risk difference (RD) for the main comparison. The median duration of follow-up was 12 months (range 2 to 30 months). The results suggested that the OL interventions probably improve healthcare professionals' compliance with evidence-based practice (10.8% absolute improvement in compliance, interquartile range (IQR): 3.5% to 14.6%; moderate-certainty evidence).Results for the secondary comparisons also suggested that OLs probably improve compliance with evidence-based practice (moderate-certainty evidence): i) OLs alone versus no intervention: RD (IQR): 9.15% (-0.3% to 15%); ii) OLs alone versus a single intervention: RD (range): 13.8% (12% to 15.5%); iii) OLs, with a single or more intervention(s) versus the same single or more intervention(s): RD (IQR): 7.1% (-1.4% to 19%); iv) OLs with a single or more intervention(s) versus no intervention: RD (IQR):10.25% (0.6% to 15.75%).It is uncertain if OLs alone, or in combination with other intervention(s), may lead to improved patient outcomes (3 studies; 5 dichotomous outcomes) since the certainty of evidence was very low. For two of the secondary comparisons, the IQR included the possibility of a small negative effect of the OL intervention. Possible explanations for the occasional negative effects are, for example, the possibility that the OLs may have prioritised some outcomes, at the expense of others, or that an unaccounted outcome difference at baseline, may have given a faulty impression of a negative effect of the intervention at follow-up. No study reported on costs or cost-effectiveness.We were unable to determine the comparative effectiveness of different approaches to identifying OLs, as most studies used the sociometric method. Nor could we determine which methods used by OLs to educate their peers were most effective, as the methods were poorly described in most studies. In addition, we could not determine whether OL teams were more effective than single OLs.

AUTHORS' CONCLUSIONS

Local opinion leaders alone, or in combination with other interventions, can be effective in promoting evidence-based practice, but the effectiveness varies both within and between studies.The effect on patient outcomes is uncertain. The costs and the cost-effectiveness of the intervention(s) is unknown. These results are based on heterogeneous studies differing in types of intervention, setting, and outcomes. In most studies, the role and actions of the OL were not clearly described, and we cannot, therefore, comment on strategies to enhance their effectiveness. It is also not clear whether the methods used to identify OLs are important for their effectiveness, or whether the effect differs if education is delivered by single OLs or by multidisciplinary OL teams. Further research may help us to understand how these factors affect the effectiveness of OLs.

Determinants of inter-practice variation in childhood asthma and respiratory infections: cross-sectional study of a national sentinel network

OBJECTIVES

Respiratory infections are associated with acute exacerbations of asthma and accompanying morbidity and mortality. In this study we explore inter-practice variations in respiratory infections in children with asthma and study the effect of practice-level factors on these variations.

DESIGN

Cross-sectional study.

SETTING

We analysed data from 164 general practices in the Royal College of General PractitionersResearch and Surveillance Centresentinel network in England.

PARTICIPANTS

Children 5-12 years.

INTERVENTIONS

None. In this observational study, we used regression analysis to explore the impact of practice-level determinants on the number of respiratory infections in children with asthma.

PRIMARY AND SECONDARY OUTCOME MEASURES

We describe the distribution of childhood asthma and the determinants of upper/lower respiratory tract infections in these children.

RESULTS

83.5% (137/164) practices were in urban locations; the mean number of general practitioners per practice was 7; and the mean duration since qualification 19.7 years. We found almost 10-fold difference in the rate of asthma (1.5-11.8 per 100 children) and 50-fold variation in respiratory infection rates between practices. Larger practices with larger lists of asthmatic children had greater rates of respiratory infections among these children.

CONCLUSION

We showed that structural/environmental variables are consistent predictors of a range of respiratory infections among children with asthma. However, contradictory results between measures of practice clinical care show that a purely structural explanation for variability in respiratory infections is limited. Further research is needed to understand how the practice factors influence individual risk behaviours relevant to respiratory infections.

The Seven Stages of Man: The Role of Developmental Stage on Medication Adherence in Respiratory Diseases

The circumstances and drivers of the decision to initiate, implement, or persist with a medication differ for individuals at each developmental stage. For school-age children with asthma, the social environment of their family's cultural beliefs and the influence of peer networks and school policies are strong determinants of medication adherence. The stage of adolescence can be a particularly challenging time because there is a reduction in parental supervision of asthma management as the young person strives to become more autonomous. To illustrate the importance of such factors, adherence interventions in children and young adults with asthma have used peer-based supports and social supports, particularly social media platforms. In older patients, it is internal rather than external factors and age-related decline that pose challenges to medication adherence. Seniors face the challenges of polypharmacy, reduced social support, increased isolation, and loss of cognitive function. Strategies to promote adherence must be tailored to the developmental stage and respective behavioral determinants of the target group. This review considers the different attitudes toward medication and the different adherence behaviors in young and elderly patients with chronic respiratory conditions, specifically asthma and chronic obstructive pulmonary disease. Opportunities to intervene to optimize adherence are suggested.

Utilization of a patient-centered asthma passport tool in a subspecialty clinic

INTRODUCTION

Despite available and effective tools for asthma self-assessment (Asthma Control Test, ACT) and self-management (Asthma Action Plan, AAP), they are underutilized in outpatient specialty clinics. We evaluated the impact of a patient-centered checklist, the Asthma Passport, on improving ACT and AAP utilization in clinic.

METHODS

This was a randomized, interventional quality-improvement project in which the Asthma Passport was distributed to 120 pediatric asthma patients over the duration of 16 weeks. The passport's checklist consisted of tasks to be completed by the patient/family, including completion of the ACT and AAP. We compared rates of completion of the ACT and AAP for those who received the passport versus the control group, and assessed patient/caregiver and provider satisfaction.

RESULTS

Based on electronic medical record data from 222 participants, the ACT completion rate was not significantly different between the passport and control groups, however, the AAP completion rate was significantly greater than control (30.0% vs. 17.7%, p = 0.04). When per-protocol analysis was limited to groups who completed and returned their passports, ACT and AAP completion rates were significantly greater than control (73.8% vs. 44.1% (p = 0.002) and 35.7% vs. 17.7% (p = 0.04), respectively). Nearly all participants reported high satisfaction with care, and surveyed providers viewed the passport favorably.

CONCLUSIONS

A patient-centered checklist significantly improved the completion rate of the AAP. For patient's who completed and returned the asthma passport, the ACT completion rate was also improved. Participants and providers reported high satisfaction with the checklist, suggesting that it can effectively promote asthma self-management and self-assessment without burdening clinicians or clinic workflow.

Assessing asthma severity based on claims data: a systematic review

INTRODUCTION

Asthma is one of the most common chronic diseases in Germany. Substantial economic evaluation of asthma cost requires knowledge of asthma severity, which is in general not part of claims data. Algorithms need to be defined to use this data source.

AIMS AND OBJECTIVES

The aim of this study was to systematically review the international literature to identify algorithms for the stratification of asthma patients according to disease severity based on available information in claims data.

METHODS

A systematic literature review was conducted in September 2015 using the DIMDI SmartSearch, a meta search engine including several databases with a national and international scope, e.g. BIOSIS, MEDLINE, and EMBASE. Claims data based studies that categorize asthma patients according to their disease severity were identified.

RESULTS

The systematic research yielded 54 publications assessing asthma severity based on claims data. Thirty-nine studies used a standardized algorithm such as HEDIS, Leidy, the GINA based approach or CACQ. Sixteen publications applied a variety of different criteria for the severity categorisation such as asthma diagnoses, asthma-related drug prescriptions, emergency department visits, and hospitalisations.

CONCLUSION

There is no best practice method for the categorisation of asthma severity with claims data. Rather, a combination of algorithms seems to be a pragmatic approach. A transfer to the German context is not entirely possible without considering particular conditions associated with German claims data.

Effectiveness of a multi-level asthma intervention in increasing controller medication use: a randomized control trial

INTRODUCTION

Poor self-management by families is an important factor in explaining high rates of asthma morbidity in Puerto Rico, and for this reason we previously tested a family intervention called CALMA that was found effective in improving most asthma outcomes, but not effective in increasing the use of controller medications. CALMA-plus was developed to address this issue by adding to CALMA, components of provider training and screening for asthma in clinics.

METHODS

Study participants were selected from claims Medicaid data in San Juan, Puerto Rico. After screening, 404 children in eight clinics were selected after forming pairs of clinics and randomizing the clinics) to CALMA-only or CALMA-plus.

RESULTS

For all three primary outcomes at 12 months, the mean differences between treatment arms were small but in the predicted direction. However, after adjusting for clinic variation, the study failed to demonstrate that the CALMA-plus intervention was more efficacious than the CALMA-only intervention for increasing controller medication use, or decreasing asthma symptoms. Both groups had lower rates of asthma symptoms and service utilization, consistent with previous results of the CALMA-only intervention.

CONCLUSIONS

Compliance of providers with the intervention and training, small number of clinics available and the multiple barriers experienced by providers for medicating may have been related to the lack of difference observed between the groups. Future interventions should respond to the limitations of the present study design and provide more resources to providers that will increase provider participation in training and implementation of the intervention.

Population-level cost-effectiveness of implementing evidence-based practices into routine care

OBJECTIVE

The objective of this research was to apply a new methodology (population-level cost-effectiveness analysis) to determine the value of implementing an evidence-based practice in routine care.

DATA SOURCES/STUDY SETTING

Data are from sequentially conducted studies: a randomized controlled trial and an implementation trial of collaborative care for depression. Both trials were conducted in the same practice setting and population (primary care patients prescribed antidepressants).

STUDY DESIGN

The study combined results from a randomized controlled trial and a pre-post-quasi-experimental implementation trial.

DATA COLLECTION/EXTRACTION METHODS

The randomized controlled trial collected quality-adjusted life years (QALYs) from survey and medication possession ratios (MPRs) from administrative data. The implementation trial collected MPRs and intervention costs from administrative data and implementation costs from survey.

PRINCIPAL FINDINGS

In the randomized controlled trial, MPRs were significantly correlated with QALYs (p = .03). In the implementation trial, patients at implementation sites had significantly higher MPRs (p = .01) than patients at control sites, and by extrapolation higher QALYs (0.00188). Total costs (implementation, intervention) were nonsignificantly higher ($63.76) at implementation sites. The incremental population-level cost-effectiveness ratio was $33,905.92/QALY (bootstrap interquartile range -$45,343.10/QALY to $99,260.90/QALY).

CONCLUSIONS

The methodology was feasible to operationalize and gave reasonable estimates of implementation value.

Pediatrician qualifications and asthma management behaviors and their association with patient race/ethnicity

OBJECTIVE

We sought to understand if pediatrician characteristics and asthma assessment and treatment varied in association with the proportion of African-American and Latino children in the pediatrician's practice.

METHODS

We conducted a cross-sectional survey of 500 American Academy of Pediatrics members between November 2005 and May 2006. Standardized vignettes were used to test how different indicators of a patient's asthma status affect pediatrician asthma assessments and recommendations. Linear and logistic regression models were used to examine the association of pediatrician assessments and treatment recommendations for these vignettes, respectively, with the proportion of reported African-American and Latino children seen in their practice.

RESULTS

There were 270 respondents (response rate = 54%). Based on pediatrician-reported percentage of minority patients, there were no differences in board certification status, recognition of poorly controlled asthma nor in the likelihood of appropriately increasing long-term controller medications to treat poorly controlled asthma (p > 0.05 for all analyses).

CONCLUSIONS

Caring primarily for minority children by AAP pediatricians appears unrelated to training qualifications or in their reported knowledge of how to appropriately assess and treat asthma. Therefore, studies of asthma care disparities should focus on understanding the knowledge-base of non-AAP pediatric providers who care for minority populations and exploring other potential contributory provider-level factors (e.g. communication skills).

Interventions to modify health care provider adherence to asthma guidelines: a systematic review

BACKGROUND AND OBJECTIVE

Health care provider adherence to asthma guidelines is poor. The objective of this study was to assess the effect of interventions to improve health care providers' adherence to asthma guidelines on health care process and clinical outcomes.

METHODS

Data sources included Medline, Embase, Cochrane CENTRAL Register of Controlled Trials, Cumulative Index to Nursing and Allied Health Literature, Educational Resources Information Center, PsycINFO, and Research and Development Resource Base in Continuing Medical Education up to July 2012. Paired investigators independently assessed study eligibility. Investigators abstracted data sequentially and independently graded the evidence.

RESULTS

Sixty-eight eligible studies were classified by intervention: decision support, organizational change, feedback and audit, clinical pharmacy support, education only, quality improvement/pay-for-performance, multicomponent, and information only. Half were randomized trials (n = 35). There was moderate evidence for increased prescriptions of controller medications for decision support, feedback and audit, and clinical pharmacy support and low-grade evidence for organizational change and multicomponent interventions. Moderate evidence supports the use of decision support and clinical pharmacy interventions to increase provision of patient self-education/asthma action plans. Moderate evidence supports use of decision support tools to reduce emergency department visits, and low-grade evidence suggests there is no benefit for this outcome with organizational change, education only, and quality improvement/pay-for-performance.

CONCLUSIONS

Decision support tools, feedback and audit, and clinical pharmacy support were most likely to improve provider adherence to asthma guidelines, as measured through health care process outcomes. There is a need to evaluate health care provider-targeted interventions with standardized outcomes.

Electronic health record-based assessment of oral corticosteroid use in a population of primary care patients with asthma: an observational study

Background

Oral corticosteroid prescriptions are often used in clinical studies as an indicator of asthma exacerbations. However, there is rarely the ability to link a prescription to its associated diagnosis. The objective of this study was to characterize patterns of oral corticosteroid prescription orders for asthma patients using an electronic health record database, which links each prescription order to the diagnosis assigned at the time the order was placed.

Methods

This was a retrospective cohort study of the electronic health records of asthma patients enrolled in the Geisinger Health System from January 1, 2001 to August 23, 2010. Eligible patients were 12–85 years old, had a primary care physician in the Geisinger Health System, and had asthma. Each oral corticosteroid order was classified as being prescribed for an asthma-related or non-asthma-related condition based on the associated diagnosis. Asthma-related oral corticosteroid use was classified as either chronic or acute. In patient-level analyses, we determined the number of asthma patients with asthma-related and non-asthma-related prescription orders and the number of patients with acute versus chronic use. Prescription-level analyses ascertained the percentages of oral corticosteroid prescription orders that were for asthma-related and non-asthma-related conditions.

Results

Among the 21,199 asthma patients identified in the electronic health record database, 15,017 (70.8%) had an oral corticosteroid prescription order. Many patients (N = 6,827; 45.5%) had prescription orders for both asthma-related and non-asthma-related conditions, but some had prescription orders exclusively for asthma-related (N = 3,450; 23.0%) or non-asthma-related conditions (N = 4,740; 31.6%). Among the patients receiving a prescription order, most (87.5%) could be classified as acute users. A total of 60,355 oral corticosteroid prescription orders were placed for the asthma patients in this study—31,397 (52.0%) for non-asthma-related conditions, 24,487 (40.6%) for asthma-related conditions, and 4,471 (7.4%) for both asthma-related and non-asthma-related conditions.

Conclusions

Oral corticosteroid prescriptions for asthma patients are frequently ordered for conditions unrelated to asthma. A prescription for oral corticosteroids may be an unreliable marker of asthma exacerbations in retrospective studies utilizing administrative claims data. Investigators should consider co-morbid conditions for which oral corticosteroid use may also be indicated and/or different criteria for assessing oral corticosteroid use for asthma.

InSpire to Promote Lung Assessment in Youth: Evolving the Self-Management Paradigms of Young People With Asthma

Background

Asthma is the most common chronic disease in childhood, disproportionately affecting urban, minority, and disadvantaged children. Individualized care plans supported by daily lung-function monitoring can reduce morbidity and mortality. However, despite 20 years of interventions to increase adherence, only 50% of US youth accurately follow their care plans, which leads to millions of preventable hospitalizations, emergency room visits, and sick days every year. We present a feasibility study of a novel, user-centered approach to increasing young people’s lung-function monitoring and asthma self-care. Promoting Lung Assessment in Youth (PLAY) helps young people become active managers of their asthma through the Web 2.0 principles of participation, cocreation, and information sharing. Specifically, PLAY combines an inexpensive, portable spirometer with the motivational power and convenience of mobile phones and virtual-community gaming.

Objective

The objective of this study was to develop and pilot test InSpire, a fully functional interface between a handheld spirometer and an interactive game and individualized asthma-care instant-messaging system housed on a mobile phone.

Methods

InSpire is an application for mobile smartphones that creates a compelling world in which youth collaborate with their physicians on managing their asthma. Drawing from design-theory on global timer mechanics and role playing, we incentivized completing spirometry maneuvers by making them an engaging part of a game young people would want to play. The data can be sent wirelessly to health specialists and return care recommendations to patients in real-time. By making it portable and similar to applications normally desired by the target demographic, InSpire is able to seamlessly incorporate asthma management into their lifestyle.

Results

We describe the development process of building and testing the InSpire prototype. To our knowledge, the prototype is a first-of-its kind mobile one-stop shop for asthma management. Feasibility testing in children aged 7 to 14 with asthma assessed likability of the graphical user interface as well as young people’s interest in our incentivizing system. Nearly 100% of children surveyed said they would play games like those in PLAY if they involved breathing into a spirometer. Two-thirds said they would prefer PLAY over the spirometer alone, whereas 1/3 would prefer having both. No children said they would prefer the spirometer over PLAY.

Conclusions

Previous efforts at home-monitoring of asthma in children have experienced rapid decline in adherence. An inexpensive monitoring technology combined with the computation, interactive communication, and display ability of a mobile phone is a promising approach to sustainable adherence to lung-function monitoring and care plans. An exciting game that redefines the way youth conduct health management by inviting them to collaborate in their health better can be an incentive and a catalyst for more far-reaching goals.

The effects of combining Web-based eHealth with telephone nurse case management for pediatric asthma control: a randomized controlled trial

Background

Asthma is the most common pediatric illness in the United States, burdening low-income and minority families disproportionately and contributing to high health care costs. Clinic-based asthma education and telephone case management have had mixed results on asthma control, as have eHealth programs and online games.

Objectives

To test the effects of (1) CHESS+CM, a system for parents and children ages 4–12 years with poorly controlled asthma, on asthma control and medication adherence, and (2) competence, self-efficacy, and social support as mediators. CHESS+CM included a fully automated eHealth component (Comprehensive Health Enhancement Support System [CHESS]) plus monthly nurse case management (CM) via phone. CHESS, based on self-determination theory, was designed to improve competence, social support, and intrinsic motivation of parents and children.

Methods

We identified eligible parent–child dyads from files of managed care organizations in Madison and Milwaukee, Wisconsin, USA, sent them recruitment letters, and randomly assigned them (unblinded) to a control group of treatment as usual plus asthma information or to CHESS+CM. Asthma control was measured by the Asthma Control Questionnaire (ACQ) and self-reported symptom-free days. Medication adherence was a composite of pharmacy refill data and medication taking. Social support, information competence, and self-efficacy were self-assessed in questionnaires. All data were collected at 0, 3, 6, 9, and 12 months. Asthma diaries kept during a 3-week run-in period before randomization provided baseline data.

Results

Of 305 parent–child dyads enrolled, 301 were randomly assigned, 153 to the control group and 148 to CHESS+CM. Most parents were female (283/301, 94%), African American (150/301, 49.8%), and had a low income as indicated by child’s Medicaid status (154/301, 51.2%); 146 (48.5%) were single and 96 of 301 (31.9%) had a high school education or less. Completion rates were 127 of 153 control group dyads (83.0%) and 132 of 148 CHESS+CM group dyads (89.2%). CHESS+CM group children had significantly better asthma control on the ACQ (d = –0.31, 95% confidence limits [CL] –0.56, –0.06, P = .011), but not as measured by symptom-free days (d = 0.18, 95% CL –0.88, 1.60, P = 1.00). The composite adherence scores did not differ significantly between groups (d = 1.48%, 95% CL –8.15, 11.11, P = .76). Social support was a significant mediator for CHESS+CM’s effect on asthma control (alpha = .200, P = .01; beta = .210, P = .03). Self-efficacy was not significant (alpha = .080, P = .14; beta = .476, P = .01); neither was information competence (alpha = .079, P = .09; beta = .063, P = .64).

Conclusions

Integrating telephone case management with eHealth benefited pediatric asthma control, though not medication adherence. Improved methods of measuring medication adherence are needed. Social support appears to be more effective than information in improving pediatric asthma control.

Trial Registration

Clinicaltrials.gov NCT00214383; http://clinicaltrials.gov/ct2/show/NCT00214383 (Archived by WebCite at http://www.webcitation.org/68OVwqMPz)

Audit and feedback: effects on professional practice and healthcare outcomes

BACKGROUND

Audit and feedback is widely used as a strategy to improve professional practice either on its own or as a component of multifaceted quality improvement interventions. This is based on the belief that healthcare professionals are prompted to modify their practice when given performance feedback showing that their clinical practice is inconsistent with a desirable target. Despite its prevalence as a quality improvement strategy, there remains uncertainty regarding both the effectiveness of audit and feedback in improving healthcare practice and the characteristics of audit and feedback that lead to greater impact.

OBJECTIVES

To assess the effects of audit and feedback on the practice of healthcare professionals and patient outcomes and to examine factors that may explain variation in the effectiveness of audit and feedback.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL) 2010, Issue 4, part of The Cochrane Library. www.thecochranelibrary.com, including the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register (searched 10 December 2010); MEDLINE, Ovid (1950 to November Week 3 2010) (searched 09 December 2010); EMBASE, Ovid (1980 to 2010 Week 48) (searched 09 December 2010); CINAHL, Ebsco (1981 to present) (searched 10 December 2010); Science Citation Index and Social Sciences Citation Index, ISI Web of Science (1975 to present) (searched 12-15 September 2011).

SELECTION CRITERIA

Randomised trials of audit and feedback (defined as a summary of clinical performance over a specified period of time) that reported objectively measured health professional practice or patient outcomes. In the case of multifaceted interventions, only trials in which audit and feedback was considered the core, essential aspect of at least one intervention arm were included.

DATA COLLECTION AND ANALYSIS

All data were abstracted by two independent review authors. For the primary outcome(s) in each study, we calculated the median absolute risk difference (RD) (adjusted for baseline performance) of compliance with desired practice compliance for dichotomous outcomes and the median percent change relative to the control group for continuous outcomes. Across studies the median effect size was weighted by number of health professionals involved in each study. We investigated the following factors as possible explanations for the variation in the effectiveness of interventions across comparisons: format of feedback, source of feedback, frequency of feedback, instructions for improvement, direction of change required, baseline performance, profession of recipient, and risk of bias within the trial itself. We also conducted exploratory analyses to assess the role of context and the targeted clinical behaviour. Quantitative (meta-regression), visual, and qualitative analyses were undertaken to examine variation in effect size related to these factors.

MAIN RESULTS

We included and analysed 140 studies for this review. In the main analyses, a total of 108 comparisons from 70 studies compared any intervention in which audit and feedback was a core, essential component to usual care and evaluated effects on professional practice. After excluding studies at high risk of bias, there were 82 comparisons from 49 studies featuring dichotomous outcomes, and the weighted median adjusted RD was a 4.3% (interquartile range (IQR) 0.5% to 16%) absolute increase in healthcare professionals' compliance with desired practice. Across 26 comparisons from 21 studies with continuous outcomes, the weighted median adjusted percent change relative to control was 1.3% (IQR = 1.3% to 28.9%). For patient outcomes, the weighted median RD was -0.4% (IQR -1.3% to 1.6%) for 12 comparisons from six studies reporting dichotomous outcomes and the weighted median percentage change was 17% (IQR 1.5% to 17%) for eight comparisons from five studies reporting continuous outcomes. Multivariable meta-regression indicated that feedback may be more effective when baseline performance is low, the source is a supervisor or colleague, it is provided more than once, it is delivered in both verbal and written formats, and when it includes both explicit targets and an action plan. In addition, the effect size varied based on the clinical behaviour targeted by the intervention.

AUTHORS' CONCLUSIONS

Audit and feedback generally leads to small but potentially important improvements in professional practice. The effectiveness of audit and feedback seems to depend on baseline performance and how the feedback is provided. Future studies of audit and feedback should directly compare different ways of providing feedback.

Anti-leukotriene agents compared to inhaled corticosteroids in the management of recurrent and/or chronic asthma in adults and children

BACKGROUND

Anti-leukotrienes (5-lipoxygenase inhibitors and leukotriene receptors antagonists) serve as alternative monotherapy to inhaled corticosteroids (ICS) in the management of recurrent and/or chronic asthma in adults and children.

OBJECTIVES

To determine the safety and efficacy of anti-leukotrienes compared to inhaled corticosteroids as monotherapy in adults and children with asthma and to provide better insight into the influence of patient and treatment characteristics on the magnitude of effects.

SEARCH METHODS

We searched MEDLINE (1966 to Dec 2010), EMBASE (1980 to Dec 2010), CINAHL (1982 to Dec 2010), the Cochrane Airways Group trials register, and the Cochrane Central Register of Controlled Trials (Dec 2010), abstract books, and reference lists of review articles and trials. We contacted colleagues and the international headquarters of anti-leukotrienes producers.

SELECTION CRITERIA

We included randomised trials that compared anti-leukotrienes with inhaled corticosteroids as monotherapy for a minimum period of four weeks in patients with asthma aged two years and older.

DATA COLLECTION AND ANALYSIS

Two review authors independently assessed the methodological quality of trials and extracted data. The primary outcome was the number of patients with at least one exacerbation requiring systemic corticosteroids. Secondary outcomes included patients with at least one exacerbation requiring hospital admission, lung function tests, indices of chronic asthma control, adverse effects, withdrawal rates and biological inflammatory markers.

MAIN RESULTS

Sixty-five trials met the inclusion criteria for this review. Fifty-six trials (19 paediatric trials) contributed data (representing total of 10,005 adults and 3,333 children); 21 trials were of high methodological quality; 44 were published in full-text. All trials pertained to patients with mild or moderate persistent asthma. Trial durations varied from four to 52 weeks. The median dose of inhaled corticosteroids was quite homogeneous at 200 µg/day of microfine hydrofluoroalkane-propelled beclomethasone or equivalent (HFA-BDP eq). Patients treated with anti-leukotrienes were more likely to suffer an exacerbation requiring systemic corticosteroids (N = 6077 participants; risk ratio (RR) 1.51, 95% confidence interval (CI) 1.17, 1.96). For every 28 (95% CI 15 to 82) patients treated with anti-leukotrienes instead of inhaled corticosteroids, there was one additional patient with an exacerbation requiring rescue systemic corticosteroids. The magnitude of effect was significantly greater in patients with moderate compared with those with mild airway obstruction (RR 2.03, 95% CI 1.41, 2.91 versus RR 1.25, 95% CI 0.97, 1.61), but was not significantly influenced by age group (children representing 23% of the weight versus adults), anti-leukotriene used, duration of intervention, methodological quality, and funding source. Significant group differences favouring inhaled corticosteroids were noted in most secondary outcomes including patients with at least one exacerbation requiring hospital admission (N = 2715 participants; RR 3.33; 95% CI 1.02 to 10.94), the change from baseline FEV(1) (N = 7128 participants; mean group difference (MD) 110 mL, 95% CI 140 to 80) as well as other lung function parameters, asthma symptoms, nocturnal awakenings, rescue medication use, symptom-free days, the quality of life, parents' and physicians' satisfaction. Anti-leukotriene therapy was associated with increased risk of withdrawals due to poor asthma control (N = 7669 participants; RR 2.56; 95% CI 2.01 to 3.27). For every thirty one (95% CI 22 to 47) patients treated with anti-leukotrienes instead of inhaled corticosteroids, there was one additional withdrawal due to poor control. Risk of side effects was not significantly different between both groups.

AUTHORS' CONCLUSIONS

As monotherapy, inhaled corticosteroids display superior efficacy to anti-leukotrienes in adults and children with persistent asthma; the superiority is particularly marked in patients with moderate airway obstruction. On the basis of efficacy, the results support the current guidelines' recommendation that inhaled corticosteroids remain the preferred monotherapy. 

Comparative-effectiveness research in distributed health data networks

Comparative-effectiveness research (CER) can be conducted within a distributed health data network. Such networks allow secure access to separate data sets from different data partners and overcome many practical obstacles related to patient privacy, data security, and proprietary concerns. A scalable network architecture supports a wide range of CER activities and meets the data infrastructure needs envisioned by the Federal Coordinating Council for Comparative Effectiveness Research.

Strategies for addressing barriers to publishing pediatric quality improvement research

BACKGROUND

Advancing the science of quality improvement (QI) requires dissemination of the results of QI. However, the results of few QI interventions reach publication.

OBJECTIVE

To identify barriers to publishing results of pediatric QI research and provide practical strategies that QI researchers can use to enhance publishability of their work.

METHODS

We reviewed and summarized a workshop conducted at the Pediatric Academic Societies 2007 meeting in Toronto, Ontario, Canada, on conducting and publishing QI research. We also interviewed 7 experts (QI researchers, administrators, journal editors, and health services researchers who have reviewed QI manuscripts) about common reasons that QI research fails to reach publication. We also reviewed recently published pediatric QI articles to find specific examples of tactics to enhance publishability, as identified in interviews and the workshop.

RESULTS

We found barriers at all stages of the QI process, from identifying an appropriate quality issue to address to drafting the manuscript. Strategies for overcoming these barriers included collaborating with research methodologists, creating incentives to publish, choosing a study design to include a control group, increasing sample size through research networks, and choosing appropriate process and clinical quality measures. Several well-conducted, successfully published QI studies in pediatrics offer guidance to other researchers in implementing these strategies in their own work.

CONCLUSION

Specific, feasible approaches can be used to improve opportunities for publication in pediatric, QI, and general medical journals.

Local opinion leaders: effects on professional practice and health care outcomes

BACKGROUND

Clinical practice is not always evidence-based and, therefore, may not optimise patient outcomes. Opinion leaders disseminating and implementing 'best evidence' is one method that holds promise as a strategy to bridge evidence-practice gaps.

OBJECTIVES

To assess the effectiveness of the use of local opinion leaders in improving professional practice and patient outcomes.

SEARCH STRATEGY

We searched Cochrane EPOC Group Trials Register, the Cochrane Central Register of Controlled Trials, MEDLINE, EMBASE, HMIC, Science Citation Index, Social Science Citation Index, ISI Conference Proceedings and World Cat Dissertations up to 5 May 2009. In addition, we searched reference lists of included articles.

SELECTION CRITERIA

Studies eligible for inclusion were randomised controlled trials investigating the effectiveness of using opinion leaders to disseminate evidence-based practice and reporting objective measures of professional performance and/or health outcomes.

DATA COLLECTION AND ANALYSIS

Two review authors independently extracted data from each study and assessed its risk of bias. For each trial, we calculated the median risk difference (RD) for compliance with desired practice, adjusting for baseline where data were available. We reported the median adjusted RD for each of the main comparisons.

MAIN RESULTS

We included 18 studies involving more than 296 hospitals and 318 PCPs. Fifteen studies (18 comparisons) contributed to the calculations of the median adjusted RD for the main comparisons. The effects of interventions varied across the 63 outcomes from 15% decrease in compliance to 72% increase in compliance with desired practice. The median adjusted RD for the main comparisons were: i) Opinion leaders compared to no intervention, +0.09; ii) Opinion leaders alone compared to a single intervention, +0.14; iii) Opinion leaders with one or more additional intervention(s) compared to the one or more additional intervention(s), +0.10; iv) Opinion leaders as part of multiple interventions compared to no intervention, +0.10. Overall, across all 18 studies the median adjusted RD was +0.12 representing a 12% absolute increase in compliance in the intervention group.

AUTHORS' CONCLUSIONS

Opinion leaders alone or in combination with other interventions may successfully promote evidence-based practice, but effectiveness varies both within and between studies. These results are based on heterogeneous studies differing in terms of type of intervention, setting, and outcomes measured. In most of the studies the role of the opinion leader was not clearly described, and it is therefore not possible to say what the best way is to optimise the effectiveness of opinion leaders.

Evaluation of a practice-based intervention to improve the management of pediatric asthma

Pediatric asthma remains a significant burden upon patients, families, and the healthcare system. Despite the availability of evidence-based best practice asthma management guidelines for over a decade, published studies suggest that many primary care physicians do not follow them. This article describes the Provider Quality Improvement (PQI) intervention with six diverse community-based practices. A pediatrician and a nurse practitioner conducted the year-long intervention, which was part of a larger CDC-funded project, using problem-based learning within an academic detailing model. Process and outcome assessments included (1) pre- and post-intervention chart reviews to assess eight indicators of quality care, (2) post-intervention staff questionnaires to assess contact with the intervention team and awareness of practice changes, and (3) individual semi-structured interviews with physician and nurse champions in five of the six practices. The chart review indicated that all six practices met predefined performance improvement criteria for at least four of eight indicators of quality care, with two practices meeting improvement criteria for all eight indicators. The response rate for the staff questionnaires was high (72%) and generally consistent across practices, demonstrating high staff awareness of the intervention team, the practice "asthma champions," and changes in practice patterns. In the semi-structured interviews, several respondents attributed the intervention's acceptability and success to the expertise of the PQI team and expressed the belief that sustaining changes would be critically dependent on continued contact with the team. Despite significant limitations, this study demonstrated that interventions that are responsive to individual practice cultures can successfully change practice patterns.

The Child Asthma Link Line: a coalition-initiated, telephone-based, care coordination intervention for childhood asthma

BACKGROUND

Childhood asthma is a complex chronic disease that poses significant challenges regarding management, and there is evidence of disparities in care. Many medical, psychosocial, and health system factors contribute to recognized poor control of this most prevalent illness among children, with resultant excessive use of emergency departments and hospitalizations for care. Recent national guidelines emphasize the need for community-based initiatives to address these critical issues. To address health system fragmentation and impact asthma outcomes, the Philadelphia Allies Against Asthma coalition developed and implemented the Child Asthma Link Line, a telephone-based care coordination and system integration program, which has been in operation since 2001. This study evaluates the effectiveness of the Child Asthma Link Line integration model to improve asthma management by measuring utilization markers of morbidity.

METHODS

Medicaid Managed Care Organization claims data for 59 children who received the Link Line intervention in 2003 are compared to a matched sample of 236 children who did not receive the Link Line intervention. Children in the two study groups are ages 3 through 12 years and matched on 2003 emergency department visits, age, gender, and race/ethnicity. Primary outcome variables analyzed in this study are emergency department visits, hospitalizations, and office visit claims from the follow-up year (2004).

RESULTS

Link Line intervention children were significantly less likely to have follow-up hospitalizations than matched sample children (p = .02). Children enrolled in the Link Line were also more likely to attend outpatient office visits in the follow-up year (p = .045). In addition, Link Line children with multiple emergency department visits in 2003 were significantly less likely to have an emergency department visit in 2004 (p = .046).

CONCLUSION

This coalition-developed, telephone-based, system-level intervention had a significant impact on childhood asthma morbidity as measured by utilization endpoints of follow-up hospitalizations and emergency department visits. Telephone-based care coordination and service integration may be a viable and economic way to impact childhood asthma and other chronic diseases.

Can a community evidence-based asthma care program improve clinical outcomes?: a longitudinal study

RATIONALE

Asthma is associated with significant morbidity. Previous studies highlight significant variations in asthma management approaches within primary care settings where the adoption of published asthma guidelines is typically suboptimal.

OBJECTIVE

To determine whether the implementation of an evidence-based asthma care program in community primary care settings leads to improved clinical outcomes in asthma patients. METHODS, MEASUREMENTS, AND MAIN RESULTS: A community-based participatory research project was implemented at 8 primary care practices across Ontario, Canada, consisting of elements based on the Canadian Asthma Consensus Guidelines (asthma care map, program standards, management flow chart and action plan). A total of 1408 patients aged 2-55 years participated. Conditional logistic regression analyses were used to calculate the odds ratios (OR) comparing baseline to follow-up while adjusting for age, gender, socioeconomic status and other covariates. At 12-month follow-up, there were statistically significant reductions in self-reported asthma exacerbations from 77.8% to 54.5% [OR = 0.35; 95% confidence interval (CI): 0.28-0.43]; emergency room visits due to asthma from 9.9% to 5.5% (OR = 0.47; 95% CI: 0.32-0.62); school absenteeism in children from 19.9% to 10.2% (OR = 0.37; 95% CI: 0.25-0.54); productivity loss in adults from 12.0% to 10.3% (OR = 0.49; 95% CI: 0.34-0.71); uncontrolled daytime asthma symptoms from 62.4% to 41.4% (OR = 0.34; 95% CI: 0.27-0.42); and uncontrolled nighttime asthma symptoms from 46.4% to 25.4% (OR = 0.29; 95% CI: 0.23-0.37).

CONCLUSIONS

Development and implementation of a community-based primary care asthma care program led to risk reductions in exacerbations, symptoms, urgent health service use and productivity loss related to asthma.

A review of the evidence for the medical home for children with special health care needs

CONTEXT

The receipt of health care in a medical home is increasingly touted as a fundamental basis for improved care for persons with chronic conditions, yet the evidence for this claim has not been systematically assessed.

OBJECTIVE

Our goal was to determine the evidence for the federal Maternal and Child Health Bureau recommendation that children with special health care needs receive ongoing comprehensive care within a medical home.

METHODS

We searched the nursing and medical literature, references of selected articles, and requested expert recommendations. Search terms included children with special health care needs, medical home-related interventions, and health-related outcomes. Articles that met defined criteria (eg, children with special health care needs, United States-based, quantitative) were selected. We extracted data, including design, population characteristics, sample size, intervention, and findings from each article.

RESULTS

We selected 33 articles that reported on 30 distinct studies, 10 of which were comparison-group studies. None of the studies examined the medical home in its entirety. Although tempered by weak designs, inconsistent definitions and extent of medical home attributes, and inconsistent outcome measures, the preponderance of evidence supported a positive relationship between the medical home and desired outcomes, such as better health status, timeliness of care, family centeredness, and improved family functioning.

CONCLUSIONS

The evidence provides moderate support for the hypothesis that medical homes provide improved health-related outcomes for children with special health care needs. Additional studies with comparison groups encompassing all or most of the attributes of the medical home need to be undertaken.

Addressing the unit of analysis in medical care studies: a systematic review

OBJECTIVE

We assessed the frequency that patients are incorrectly used as the unit of analysis among studies of physicians' patient care behavior in articles published in high impact journals.

METHODS

We surveyed 30 high-impact journals across 6 medical fields for articles susceptible to unit of analysis errors published from 1994 to 2005. Three reviewers independently abstracted articles using previously published criteria to determine the presence of analytic errors.

RESULTS

One hundred fourteen susceptible articles were found published in 15 journals, 4 journals published the majority (71 of 114 or 62.3%) of studies, 40 were intervention studies, and 74 were noninterventional studies. The unit of analysis error was present in 19 (48%) of the intervention studies and 31 (42%) of the noninterventional studies (overall error rate 44%). The frequency of the error decreased between 1994-1999 (N = 38; 65% error) and 2000-2005 (N = 76; 33% error) (P = 0.001).

CONCLUSIONS

Although the frequency of the error in published studies is decreasing, further improvement remains desirable.

Interventions designed to improve the quality and efficiency of medication use in managed care: a critical review of the literature - 2001-2007

Background

Managed care organizations use a variety of strategies to reduce the cost and improve the quality of medication use. The effectiveness of such policies is not well understood. The objective of this research was to update a previous systematic review of interventions, published between 1966 and 2001, to improve the quality and efficiency of medication use in the US managed care setting.

Methods

We searched MEDLINE and EMBASE for publications from July 2001 to January 2007 describing interventions targeting drug use conducted in the US managed care setting. We categorized studies by intervention type and adequacy of research design using commonly accepted criteria. We summarized the outcomes of well-controlled strategies and documented the significance and magnitude of effects for key study outcomes.

Results

We identified 164 papers published during the six-year period. Predominant strategies were: educational interventions (n = 20, including dissemination of educational materials, and group or one-to-one educational outreach); monitoring and feedback (n = 22, including audit/feedback and computerized monitoring); formulary interventions (n = 66, including tiered formulary and patient copayment); collaborative care involving pharmacists (n = 15); and disease management with pharmacotherapy as a primary focus (n = 41, including care for depression, asthma, and peptic ulcer disease). Overall, 51 studies met minimum criteria for methodological adequacy. Effective interventions included one-to-one academic detailing, computerized alerts and reminders, pharmacist-led collaborative care, and multifaceted disease management. Further, changes in formulary tier-design and related increases in copayments were associated with reductions in medication use and increased out-of-pocket spending by patients. The dissemination of educational materials alone had little or no impact, while the impact of group education was inconclusive.

Conclusion

There is good evidence for the effectiveness of several strategies in changing drug use in the managed care environment. However, little is known about the cost-effectiveness of these interventions. Computerized alerts showed promise in improving short-term outcomes but little is known about longer-term outcomes. Few well-designed, published studies have assessed the potential negative clinical effects of formulary-related interventions despite their widespread use. However, some evidence suggests increases in cost sharing reduce access to essential medicines for chronic illness.

Outcome measures for asthma disease management

PURPOSE OF REVIEW

Many interventions have been undertaken in managing asthma in a population-based framework. The identification of successful interventions would guide policy implementation to improve outcomes in patient morbidity and mortality and healthcare costs.

RECENT FINDINGS

Several studies have focussed on emergency room interventions in asthma management. Many support the existence of the "teachable moment" to lead to interventions that are effective. Other popular interventions are community-based educational programmes, targeting clinician and patient behavior modification. In some cases, it is unclear how these interventions impact patient-specific outcomes such as quality of life, symptom-free days, or missed days of school or work as these were not measured. Most studies separate patients on the basis of age (adults versus children), adding yet another level of complexity to the development of useful interventions.

SUMMARY

Several of the interventions failed to show a significant improvement of patient-centered asthma outcomes when they were measured. This was despite an improvement in surrogate measures, such as attendance of follow-up appointments. Many studies did not (or were not designed to) show a durable response. Further research is needed to understand this chronic disease and devise effective interventions with appropriate outcomes for measuring their effectiveness.

Local opinion leaders: effects on professional practice and health care outcomes

BACKGROUND

Clinical practice is not always evidence-based and, therefore, may not optimise patient outcomes. Opinion leaders disseminating and implementing 'best evidence' is one innovative method that holds promise as a strategy to bridge evidence-practice gaps.

OBJECTIVES

To assess the effectiveness of the use of local opinion leaders in improving the behaviour of health care professionals and patient outcomes.

SEARCH STRATEGY

We searched MEDLINE, Health Star, SIGLE and the Cochrane Effective Practice and Organisation of Care Group Trials Register. We did not apply date restrictions to our search strategy. Searches were last updated in February 2005. In addition, we searched reference lists of all potential studies that were identified.

SELECTION CRITERIA

Studies eligible for inclusion were randomized controlled trials that used objective measures of performance/provider behaviour and/or patient health outcomes.

DATA COLLECTION AND ANALYSIS

Two reviewers extracted data from each study and assessed its methodological quality. We calculated the absolute difference in the risk of 'non-compliance' with desired practice, adjusting for baseline levels of non-compliance where these data were available.

MAIN RESULTS

Twelve studies met our eligibility criteria. The adjusted absolute risk difference of non-compliance with desired practice varied from -6% (favouring control) to +25% (favouring opinion leader intervention). Overall, the median adjusted risk difference (ARD) was 0.10 representing a 10% absolute decrease in non-compliance in the intervention group.

AUTHORS' CONCLUSIONS

The use of local opinion leaders can successfully promote evidence-based practice. However the feasibility of its widespread use remains uncertain.