Systematic review of studies of quality of clinical care in general practice in the UK, Australia and New Zealand

Developing implementation research capacity: longitudinal evaluation of the King's College London Implementation Science Masterclass, 2014-2019

BACKGROUND

Despite an increasing number of training opportunities in implementation science becoming available, the demand for training amongst researchers and practitioners is unmet. To address this training shortfall, we developed the King's College London 'Implementation Science Masterclass' (ISM), an innovative 2-day programme (and currently the largest of its kind in Europe), developed and delivered by an international faculty of implementation experts.

METHODS

This paper describes the ISM and provides delegates' quantitative and qualitative evaluations (gathered through a survey at the end of the ISM) and faculty reflections over the period it has been running (2014-2019).

RESULTS

Across the 6-year evaluation, a total of 501 delegates have attended the ISM, with numbers increasing yearly from 40 (in 2014) to 147 (in 2019). Delegates represent a diversity of backgrounds and 29 countries from across the world. The overall response rate for the delegate survey was 64.5% (323/501). Annually, the ISM has been rated 'highly' in terms of delegates' overall impression (92%), clear and relevant learning objectives (90% and 94%, respectively), the course duration (85%), pace (86%) and academic level 87%), and the support provided on the day (92%). Seventy-one percent of delegates reported the ISM would have an impact on how they approached their future work. Qualitative feedback revealed key strengths include the opportunities to meet with an international and diverse pool of experts and individuals working in the field, the interactive nature of the workshops and training sessions, and the breadth of topics and contexts covered.

CONCLUSIONS

Yearly, the UK ISM has grown, both in size and in its international reach. Rated consistently favourably by delegates, the ISM helps to tackle current training demands from all those interested in learning and building their skills in implementation science. Evaluation of the ISM will continue to be an annual iterative process, reflective of changes in the evidence base and delegates changing needs as the field evolves.

Development of type 2 diabetes mellitus quality indicators in general practice by a modified Delphi method in Beijing, China

BACKGROUND

The service capacity of primary care has improved in China. General practice also takes growing responsibility in the management of type 2 diabetes mellitus, but there are concerns about the paucity of evidence of the quality of care delivered. And there is an absence of systematic quality indicators of type 2 diabetes mellitus in general practice in China. This study aimed to develop a set of type 2 diabetes mellitus quality indicators to facilitate quality measurement in general practice in China.

METHODS

Preliminary quality indicators were generated and refined by literature review and an expert consultation meeting. Two rounds of email-based Delphi survey and a consensus meeting were carried out to identify quality indicators. Delphi questionnaires with 43 indicators were sent to 30 participants in the first round. There were 16 general practitioners and 10 community health service center leaders from primary care, 3 endocrinologists and a primary care researcher in the first round. And 27 out of the 30 participants participated in the second round. The consensus meeting was held among 9 participants to refine the indicators and a last round of rating was carried out in the meeting. The indicators were rated in terms of importance and feasibility. The agreement criteria were defined as median ≥ 7.0 and ≥ 85.0% of ratings in the 7-9 tertile for importance; median ≥ 7.0 and ≥ 65.0, 70.0, 75.0% of ratings in the 7-9 tertile for feasibility respectively in the three rounds of rating.

RESULTS

After 2 rounds of Delphi survey and the consensus meeting, total 38 indicators achieved consensus for inclusion in the final set of indicators. The final set of indicators were grouped into 7 domains: access (5 indicators), monitoring (12 indicators), health counseling (7 indicators), records (2 indicators), health status (7 indicators), patient satisfaction (2 indicators) and self-management (3 indicators).

CONCLUSIONS

A set of 38 potential quality indicators of type 2 diabetes mellitus in general practice were identified by an iterative Delphi process in Beijing, China. Preliminary approach for measurement and data collection were described. However, the indicators still need to be validated by testing in a further study.

Physical Activity Levels and Diabetes Prevalence in US Adults: Findings from NHANES 2015-2016

INTRODUCTION

Diabetes is a major public health problem that is strongly influenced by lifestyle-related factors, with previous epidemiologic studies finding an inverse relationship between physical activity and the prevalence of diabetes. We aimed to quantify the prevalence of diabetes and determine whether a dose-response relationship is present between physical activity levels and diabetes.

METHODS

Population characteristics were compared between diabetic and nondiabetic subjects. Multiple logistic regression models were used to assess the association between different levels of physical activity and diabetes. Restricted cubic spline analysis was used to examine the dose-response relationship between physical activity and diabetes prevalence.

RESULTS

Compared with those in the lowest physical activity quartile, participants in the highest quartile had a 42% lower prevalence of diabetes (odds ratio = 0.58, 95% confidence interval = 0.44-0.75, p < 0.001). A nonlinear dose-response relationship was observed (p nonlinearity < 0.05), with increased physical activity associated with a decreased prevalence of diabetes, with steeper reductions in the prevalence of diabetes at low activity levels than at high activity levels. These results were robust in both subgroup and sensitivity analyses.

CONCLUSIONS

Higher levels of physical activity are associated with a lower prevalence of diabetes. The data indicated the presence of a nonlinear dose-response relationship in all of the included subjects, with steeper reductions in the prevalence of diabetes at low activity levels than at high activity levels. Increasing physical activity is therefore potentially a useful intervention for reducing the prevalence of diabetes.

Assessing and Improving the Quality in Mental Health Services

Background: The mental health of the population consists of the three essential pillars of quality of life, economy, and society. Mental health services take care of the prevention and treatment of mental disorders and through them maintain, improve, and restore the mental health of the population. The purpose of this study is to describe the methodology for qualitative and quantitative evaluation and improvement of the mental health service system. Methods: This is a narrative review study that searches the literature to provide criteria, indicators, and methodology for evaluating and improving the quality of mental health services and the related qualitative and quantitative indicators. The bibliography was searched in popular databases PubMed, Google Scholar, CINAHL, using the keywords “mental”, “health”, “quality”, “indicators”, alone or in combinations thereof. Results: Important quality indicators of mental health services have been collected and presented, and modified where appropriate. The definition of each indicator is presented here, alongside its method of calculation and importance. Each indicator belongs to one of the eight dimensions of quality assessment: (1) Suitability of services, (2) Accessibility of patients to services, (3) Acceptance of services by patients, (4) Ability of healthcare professionals to provide services, (5) Efficiency of health professionals and providers, (6) Continuity of service over time (ensuring therapeutic continuity), (7) Efficiency of health professionals and services, (8) Safety (for patients and for health professionals). Discussion/Conclusions: Accessibility and acceptability of service indicators are important for the attractiveness of services related to their use by the population. Profitability indicators are important economic indicators that affect the viability and sustainability of services, factors that are now taken into account in any health policy. All of the indicators mentioned are related to public health, affecting the quality of life, morbidity, mortality, and life expectancy, directly or indirectly. The systematic measurement and monitoring of indicators and the measurement and quantification of quality through them, are the basis for evidence-based health policy for improvement of the quality of mental health services.

Inappropriateness of health care in Canada: a systematic review protocol

BACKGROUND

There is increasing recognition in Canada and globally that a substantial proportion of health care delivered is inappropriate as evidenced by (1) harmful and/or ineffective practices being overused, (2) effective clinical practices being underused, and (3) other clinical practices being misused. Inappropriate health care leads to negative patient experiences, poor health outcomes, and inefficient use of scarce health care resources. The purpose of this study is to conduct a systematic review of inappropriate health care in Canada. Our specific objectives are to (1) systematically search and critically review published and grey literature for studies on inappropriate health care in Canada; (2) estimate the nature and magnitude of inappropriate health care in Canada and its provincial and territorial jurisdictions.

METHODS

We will include all quantitative study designs reporting objective or subjective measurements of inappropriate health care in Canada over the last 10 years. We will search the following online databases: MEDLINE, Cochrane Central Register of Controlled Trials, EconLit, and ISI-Web of Knowledge, which contains Web of Science Core Collection-Citation Indexes, Science Citation Index Expanded, Conference Proceedings Citation Index-Science, and Conference Proceedings Citation Index-Social Science & Humanities. We will also search grey literature sources to identify provincial and national audits of inappropriate health care. Two authors will independently screen, assess data quality, and extract data for synthesis. Study findings will be synthesized narratively. We will organize our data into three care categorizations: preventive care, acute care, and chronic care. We will provide a compendium of inappropriate health care for each care category for Canada and each Canadian province and territory, where sufficient data exists, by calculating (1) overall medians of underuse, overuse, and misuse of clinical practices and (2) the range of medians of underuse, overuse, and misuse for each clinical practice investigated.

DISCUSSION

This review will result in the first-ever evidence-based compendium of inappropriate health care in Canada. We will also develop detailed reports of inappropriate health care for each Canadian province and territory.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42018093495.

Concordance between self-report and medical records of preventive healthcare delivery among a sample of disadvantaged patients from four aboriginal community controlled health services

BACKGROUND

This cross-sectional study aimed to explore, among a sample of patients attending one of four Aboriginal Health Services (ACCHSs), the degree of concordance between self-report and medical records for whether screening for key healthcare items had ever been undertaken, or had been undertaken within the recommended timeframe.

METHODS

Across the four ACCHSs, a convenience sample of 109 patients was recruited. Patients completed a self-report computer survey assessing when they last had preventive care items undertaken at the service. ACCHS staff completed a medical record audit for matching items. The degree of concordance (i.e. the percentage of cases in which self-reports matched responses from the medical record) was calculated.

RESULTS

Concordance was relatively high for items including assessment of Body Mass Index and blood pressure, but was substantially lower for items including assessment of waist circumference, alcohol intake, physical activity, and diet.

CONCLUSIONS

Reliance on either patient self-report or medical record data for assessing the level of preventive care service delivery by ACCHSs requires caution. Efforts to improve documentation of some preventive care delivery in medical records are needed. These findings are likely to also apply to patients in other general practice settings.

Variations in achievement of evidence-based, high-impact quality indicators in general practice: An observational study

BACKGROUND

There are widely recognised variations in the delivery and outcomes of healthcare but an incomplete understanding of their causes. There is a growing interest in using routinely collected 'big data' in the evaluation of healthcare. We developed a set of evidence-based 'high impact' quality indicators (QIs) for primary care and examined variations in achievement of these indicators using routinely collected data in the United Kingdom (UK).

METHODS

Cross-sectional analysis of routinely collected, electronic primary care data from a sample of general practices in West Yorkshire, UK (n = 89). The QIs covered aspects of care (including processes and intermediate clinical outcomes) in relation to diabetes, hypertension, atrial fibrillation, myocardial infarction, chronic kidney disease (CKD) and 'risky' prescribing combinations. Regression models explored the impact of practice and patient characteristics. Clustering within practice was accounted for by including a random intercept for practice.

RESULTS

Median practice achievement of the QIs ranged from 43.2% (diabetes control) to 72.2% (blood pressure control in CKD). Considerable between-practice variation existed for all indicators: the difference between the highest and lowest performing practices was 26.3 percentage points for risky prescribing and 100 percentage points for anticoagulation in atrial fibrillation. Odds ratios associated with the random effects for practices emphasised this; there was a greater than ten-fold difference in the likelihood of achieving the hypertension indicator between the lowest and highest performing practices. Patient characteristics, in particular age, gender and comorbidity, were consistently but modestly associated with indicator achievement. Statistically significant practice characteristics were identified less frequently in adjusted models.

CONCLUSIONS

Despite various policy and improvement initiatives, there are enduring inappropriate variations in the delivery of evidence-based care. Much of this variation is not explained by routinely collected patient or practice variables, and is likely to be attributable to differences in clinical and organisational behaviour.

Developing 'high impact' guideline-based quality indicators for UK primary care: a multi-stage consensus process

BACKGROUND

Quality indicators (QIs) are an important tool for improving clinical practice and are increasingly being developed from evidence-based guideline recommendations. We aimed to identify, select and apply guideline recommendations to develop a set of QIs to measure the implementation of evidence-based practice using routinely recorded clinical data in United Kingdom (UK) primary care.

METHODS

We reviewed existing national clinical guidelines and QIs and used a four-stage consensus development process to derive a set of 'high impact' QIs relevant to primary care based upon explicit prioritisation criteria. We then field tested the QIs using remotely extracted, anonymised patient records from 89 randomly sampled primary care practices in the Yorkshire region of England.

RESULTS

Out of 2365 recommendations and QIs originally reviewed, we derived a set of 18 QIs (5 single, 13 composites - comprising 2-9 individual recommendations) for field testing. QIs predominantly addressed chronic disease management, in particular diabetes, cardiovascular and renal disease, and included both processes and outcomes of care. Field testing proved to be critical for further refinement and final selection.

CONCLUSIONS

We have demonstrated a rigorous and transparent methodology to develop a set of high impact, evidence-based QIs for primary care from clinical guideline recommendations. While the development process was successful in developing a limited set of QIs, it remains challenging to derive robust new QIs from clinical guidelines in the absence of established systems for routine, structured recording of clinical care.

A cross-sectional study assessing the association between online ratings and structural and quality of care measures: results from two German physician rating websites

Background

Even though physician rating websites (PRWs) have been gaining in importance in both practice and research, little evidence is available on the association of patients’ online ratings with the quality of care of physicians. It thus remains unclear whether patients should rely on these ratings when selecting a physician. The objective of this study was to measure the association between online ratings and structural and quality of care measures for 65 physician practices from the German Integrated Health Care Network “Quality and Efficiency” (QuE).

Methods

Online reviews from two German PRWs were included which covered a three-year period (2011 to 2013) and included 1179 and 991 ratings, respectively. Information for 65 QuE practices was obtained for the year 2012 and included 21 measures related to structural information (N = 6), process quality (N = 10), intermediate outcomes (N = 2), patient satisfaction (N = 1), and costs (N = 2). The Spearman rank coefficient of correlation was applied to measure the association between ratings and practice-related information.

Results

Patient satisfaction results from offline surveys and the patients per doctor ratio in a practice were shown to be significantly associated with online ratings on both PRWs. For one PRW, additional significant associations could be shown between online ratings and cost-related measures for medication, preventative examinations, and one diabetes type 2-related intermediate outcome measure. There again, results from the second PRW showed significant associations with the age of the physicians and the number of patients per practice, four process-related quality measures for diabetes type 2 and asthma, and one cost-related measure for medication.

Conclusions

Several significant associations were found which varied between the PRWs. Patients interested in the satisfaction of other patients with a physician might select a physician on the basis of online ratings. Even though our results indicate associations with some diabetes and asthma measures, but not with coronary heart disease measures, there is still insufficient evidence to draw strong conclusions. The limited number of practices in our study may have weakened our findings.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-015-1051-5) contains supplementary material, which is available to authorized users.

Does a local financial incentive scheme reduce inequalities in the delivery of clinical care in a socially deprived community? A longitudinal data analysis

BACKGROUND

Socioeconomic deprivation is associated with inequalities in health care and outcomes. Despite concerns that the Quality and Outcomes Framework pay-for-performance scheme in the UK would exacerbate inequalities in primary care delivery, gaps closed over time. Local schemes were promoted as a means of improving clinical engagement by addressing local health priorities. We evaluated equity in achievement of target indicators and practice income for one local scheme.

METHODS

We undertook a longitudinal survey over four years of routinely recorded clinical data for all 83 primary care practices. Sixteen indicators were developed that covered five local clinical and public health priorities: weight management; alcohol consumption; learning disabilities; osteoporosis; and chlamydia screening. Clinical indicators were logit transformed from a percentage achievement scale and modelled allowing for clustering of repeated measures within practices. This enabled our study of target achievements over time with respect to deprivation. Practice income was also explored.

RESULTS

Higher practice deprivation was associated with poorer performance for five indicators: alcohol use registration (OR 0.97; 95 % confidence interval 0.96,0.99); recorded chlamydia test result (OR 0.97; 0.94,0.99); osteoporosis registration (OR 0.98; 0.97,0.99); registration of repeat prednisolone prescription (OR 0.98; 0.96,0.99); and prednisolone registration with record of dual energy X-ray absorptiometry (DEXA) scan/referral (OR 0.92; 0.86,0.97); practices in deprived areas performed better for one indicator (registration of osteoporotic fragility fracture (OR 1.26; 1.04,1.51). The deprivation-achievement gap widened for one indicator (registered females aged 65-74 with a fracture referred for a DEXA scan; OR 0.97; 0.95,0.99). Two other indicators indicated a similar trend over two years before being withdrawn (registration of fragility fracture and over-75 s with a fragility fracture assessed and treated for osteoporosis risk). For one indicator the deprivation-achievement gap reduced over time (repeat prednisolone prescription (OR 1.01; 1.01,1.01). Larger practices and those serving more affluent areas earned more income per patient than smaller practices and those serving more deprived areas (t = -3.99; p =0.0001).

CONCLUSIONS

Any gaps in achievement between practices were modest but mostly sustained or widened over the duration of the scheme. Given that financial rewards may not reflect the amount of work undertaken by practices serving more deprived patients, future pay-for-performance schemes also need to address fairness of rewards in relation to workload.

Addressing implementation challenges during guideline development - a case study of Swedish national guidelines for methods of preventing disease

Background

Many of the world’s life threatening diseases (e.g. cancer, heart disease, stroke) could be prevented by eliminating life-style habits such as tobacco use, unhealthy diet, physical inactivity and excessive alcohol use. Incorporating evidence-based research on methods to change unhealthy lifestyle habits in clinical practice would be equally valuable. However gaps between guideline development and implementation are well documented, with implications for health care quality, safety and effectiveness. The development phase of guidelines has been shown to be important both for the quality in guideline content and for the success of implementation. There are, however, indications that guidelines related to general disease prevention methods encounter specific barriers compared to guidelines that are diagnosis-specific. In 2011 the Swedish National board for Health and Welfare launched guidelines with a preventive scope. The aim of this study was to investigate how implementation challenges were addressed during the development process of these disease preventive guidelines.

Methods

Seven semi-structured interviews were conducted with members of the guideline development management group. Archival data detailing the guideline development process were also collected and used in the analysis. Qualitative data were analysed using content analysis as the analytical framework.

Results

The study identified several strategies and approaches that were used to address implementation challenges during guideline development. Four themes emerged from the analysis: broad agreements and consensus about scope and purpose; a formalized and structured development procedure; systematic and active involvement of stakeholders; and openness and transparency in the specific guideline development procedure. Additional factors concerning the scope of prevention and the work environment of guideline developers were perceived to influence the possibilities to address implementation issues.

Conclusions

This case study provides examples of how guideline developers perceive and approach the issue of implementation during the development and early launch of prevention guidelines. Models for guideline development could benefit from an initial assessment of how the guideline topic, its target context and stakeholders will affect the upcoming implementation.

Quality of care in primary health care settings in the Eastern Mediterranean region: a systematic review of the literature

PURPOSE

This systematic review aims at offering a comprehensive synthesis of studies addressing quality of care in the primary healthcare (PHC) sector of the Eastern Mediterranean Region (EMR).

DATA SOURCES

A systematic search was conducted using Medline, Embase and Global Health Library (IMEMR) electronic databases to identify studies related to quality in PHC between years 2000 and 2012.

STUDY SELECTION/DATA EXTRACTION

One hundred and fifty-nine (159) studies fulfilled the eligibility criteria. Each paper was independently reviewed by two reviewers, and the following information was extracted/calculated: dimension of care investigated (structure, processes and outcomes), focus, disease groups, study design, sample size, unit of analysis, response rate, country, setting (public or private) and level of rigor (LOR) score.

RESULTS OF DATA SYNTHESIS

Most of the studies were descriptive/cross-sectional in nature with a relatively modest LOR score. Assessment of quality of care revealed that the process dimension of quality, specifically clinical practice and patient-provider relationship, is an area of major concern. However, interventions targeting enhanced quality in PHC in the EMR countries had favorable and effective outcomes in terms of clinical practice.

CONCLUSION

These findings highlight gaps in evidence on quality in PHC in the EMR; such evidence is key for decision-making. Researchers and policy-makers should address these gaps to generate contextualized information and knowledge that ensures relevance and targeted high-impact interventions.

Challenges of disseminating clinical practice guidelines in a weak health system: the case of HIV and infant feeding recommendations in Tanzania

BACKGROUND

Clinical guidelines aim to improve patient outcomes by providing recommendations on appropriate healthcare for specific clinical conditions. Scientific evidence produced over time leads to change in clinical guidelines, and a serious challenge may emerge in the process of communicating the changes to healthcare practitioners and getting new practices adopted. There is very little information on the major barriers to implementing clinical guidelines in low-income settings. Looking at how continual updates to clinical guidelines within a particular health intervention are communicated may shed light on the processes at work. The aim of this paper is to explore how the content of a series of diverging infant feeding guidelines have been communicated to managers in the Prevention of Mother to Child Transmission of HIV Programme (PMTCT) with the aim of generating knowledge about both barriers and facilitating factors in the dissemination of new and updated knowledge in clinical guidelines in the context of weak healthcare systems.

METHODS

A total of 22 in-depth interviews and two focus group discussions were conducted in 2011. All informants were linked to the PMTCT programme in Tanzania. The informants included managers at regional and district levels and health workers at health facility level.

RESULTS

The informants demonstrated partial and incomplete knowledge about the recommendations. There was lack of scientific reasoning behind various infant feeding recommendations. The greatest challenges to the successful communication of the infant feeding guidelines were related to slowness of communication, inaccessible jargon-ridden English language in the manuals, lack of summaries, lack of supportive supervision to make the guidelines comprehensible, and the absence of a reading culture.

CONCLUSION

The study encountered substantial gaps in knowledge about the diverse HIV and infant feeding policies. These gaps were partly related to the challenges of communicating the clinical guidelines. There is a need for caution in assuming that important changes in guidelines for clinical practice can easily be translated to and implemented in local programme settings, not least in the context of weak healthcare systems.

Indicators of mental health in various Iranian populations

Background:

Promoting mental health and preventing mental disorders are of the main concerns for every country. Achieving these goals requires effective indexes for evaluating mental health. Therefore, to develop mental health enhancement programs in Iran, there is a need to measure the state of mental health in Iran.

Objectives:

This study aimed to select a set of mental health indicators that can be used to monitor the status of mental health in Iran.

Materials and Methods:

This research work used Q-methodology which combines both quantitative and qualitative research methods for establishment of mental health indicators in Iran. In this study, 30 participants were chosen by purposive sampling from different types of professionals in the field of mental health.

Results:

Twenty seven mental health indicators were obtained from the Q-methodology. The most important indicators obtained in this study are as follows: annual prevalence of mental disorders, suicide rates, number of mental health professionals, mental health expenditures and suicide related deaths.

Conclusions:

This study provides mental health indices for measuring mental health status in Iran. These mental health indices can be used to measure progress in the reform policies and community mental health services.

Best strategies to implement clinical pathways in an emergency department setting: study protocol for a cluster randomized controlled trial

BACKGROUND

The clinical pathway is a tool that operationalizes best evidence recommendations and clinical practice guidelines in an accessible format for 'point of care' management by multidisciplinary health teams in hospital settings. While high-quality, expert-developed clinical pathways have many potential benefits, their impact has been limited by variable implementation strategies and suboptimal research designs. Best strategies for implementing pathways into hospital settings remain unknown. This study will seek to develop and comprehensively evaluate best strategies for effective local implementation of externally developed expert clinical pathways.

DESIGN/METHODS

We will develop a theory-based and knowledge user-informed intervention strategy to implement two pediatric clinical pathways: asthma and gastroenteritis. Using a balanced incomplete block design, we will randomize 16 community emergency departments to receive the intervention for one clinical pathway and serve as control for the alternate clinical pathway, thus conducting two cluster randomized controlled trials to evaluate this implementation intervention. A minimization procedure will be used to randomize sites. Intervention sites will receive a tailored strategy to support full clinical pathway implementation. We will evaluate implementation strategy effectiveness through measurement of relevant process and clinical outcomes. The primary process outcome will be the presence of an appropriately completed clinical pathway on the chart for relevant patients. Primary clinical outcomes for each clinical pathway include the following: Asthma--the proportion of asthmatic patients treated appropriately with corticosteroids in the emergency department and at discharge; and Gastroenteritis--the proportion of relevant patients appropriately treated with oral rehydration therapy. Data sources include chart audits, administrative databases, environmental scans, and qualitative interviews. We will also conduct an overall process evaluation to assess the implementation strategy and an economic analysis to evaluate implementation costs and benefits.

DISCUSSION

This study will contribute to the body of evidence supporting effective strategies for clinical pathway implementation, and ultimately reducing the research to practice gaps by operationalizing best evidence care recommendations through effective use of clinical pathways.

TRIAL REGISTRATION

ClinicalTrials.gov: NCT01815710.

Is organizational justice associated with clinical performance in the care for patients with diabetes in primary care? Evidence from the improving Quality of care in Diabetes study

BACKGROUND

Type 2 diabetes is an increasingly prevalent illness, and there is considerable variation in the quality of care provided to patients with diabetes in primary care.

OBJECTIVES

The aim of this study was to explore whether organizational justice and organizational citizenship behaviour are associated with the behaviours of clinical staff when providing care for patients with diabetes.

METHODS

The data were from an ongoing prospective multicenter study, the 'improving Quality of care in Diabetes' (iQuaD) study. Participants (N = 467) were clinical staff in 99 primary care practices in the UK. The outcome measures were six self-reported clinical behaviours: prescribing for glycaemic control, prescribing for blood pressure control, foot examination, giving advice about weight management, providing general education about diabetes and giving advice about self-management. Organizational justice perceptions were collected using a self-administered questionnaire. The associations between organizational justice and behavioural outcomes were tested using linear multilevel regression modelling.

RESULTS

Higher scores on the procedural component of organizational justice were associated with more frequent weight management advice, self-management advice and provision of general education for patients with diabetes. The associations between justice and clinical behaviours were not explained by individual or practice characteristics, but evidence was found for the partial mediating role of organizational citizenship behaviour.

CONCLUSIONS

Quality improvement efforts aimed at increasing advice and education provision in diabetes management in primary care could target also perceptions of procedural justice.

The treatment of anal fistulas with biologically derived products: is innovation better than conventional surgical treatment? An update

New technical approaches involving biologically derived products have been applied in the treatment for anal fistulas in order to avoid the risk of fecal incontinence. The aim of this review was to evaluate the scientific evidence present in the literature regarding these techniques. Trials comparing surgery (fistulotomy, advancement mucosal flap closure and placement of seton) versus fibrin glue, fistula plug or acellular dermal matrix were considered. In fibrin glue versus traditional surgical treatment the healing rate was higher in the surgery group, and the recurrence rate was lower in the traditional surgery group, but these results were not statistically relevant. In acellular dermal matrix (ADM) versus traditional surgical treatment the recurrence rate of fistulas was significantly lower in the ADM group, but non-significant differences were recorded in incontinence and anal deformity. Our review shows that there are no significant advantages of the new techniques involving biologically derived products. Further randomized controlled trials are needed.

Effectiveness of organisational infrastructures to promote evidence-based nursing practice

BACKGROUND

Nurses and midwives form the bulk of the clinical health workforce and play a central role in all health service delivery. There is potential to improve health care quality if nurses routinely use the best available evidence in their clinical practice. Since many of the factors perceived by nurses as barriers to the implementation of evidence-based practice (EBP) lie at the organisational level, it is of interest to devise and assess the effectiveness of organisational infrastructures designed to promote EBP among nurses.

OBJECTIVES

To assess the effectiveness of organisational infrastructures in promoting evidence-based nursing.

SEARCH METHODS

We searched the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register, the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, EMBASE, CINAHL, LILACS, BIREME, IBECS, NHS Economic Evaluations Database, Social Science Citation Index, Science Citation Index and Conference Proceedings Citation Indexes up to 9 March 2011.We developed a new search strategy for this update as the strategy published in 2003 omitted key terms. Additional search methods included: screening reference lists of relevant studies, contacting authors of relevant papers regarding any further published or unpublished work, and searching websites of selected research groups and organisations. 

SELECTION CRITERIA

We considered randomised controlled trials, controlled clinical trials, interrupted times series (ITSs) and controlled before and after studies of an entire or identified component of an organisational infrastructure intervention aimed at promoting EBP in nursing. The participants were all healthcare organisations comprising nurses, midwives and health visitors.

DATA COLLECTION AND ANALYSIS

Two authors independently extracted data and assessed risk of bias. For the ITS analysis, we reported the change in the slopes of the regression lines, and the change in the level effect of the outcome at 3, 6, 12 and 24 months follow-up.

MAIN RESULTS

We included one study from the USA (re-analysed as an ITS) involving one hospital and an unknown number of nurses and patients. The study evaluated the effects of a standardised evidence-based nursing procedure on nursing care for patients at risk of developing healthcare-acquired pressure ulcers (HAPUs). If a patient's admission Braden score was below or equal to 18 (i.e. indicating a high risk of developing pressure ulcers), nurses were authorised to initiate a pressure ulcer prevention bundle (i.e. a set of evidence-based clinical interventions) without waiting for a physician order. Re-analysis of data as a time series showed that against a background trend of decreasing HAPU rates, if that trend was assumed to be real, there was no evidence of an intervention effect at three months (mean rate per quarter 0.7%; 95% confidence interval (CI) 1.7 to 3.3; P = 0.457). Given the small percentages post intervention it was not statistically possible to extrapolate effects beyond three months.

AUTHORS' CONCLUSIONS

Despite extensive searching of published and unpublished research we identified only one low-quality study; we excluded many studies due to non-eligible study design. If policy-makers and healthcare organisations wish to promote evidence-based nursing successfully at an organisational level, they must ensure the funding and conduct of well-designed studies to generate evidence to guide policy.

Consultations with general practitioners on patient safety measures based on routinely collected data in primary care

OBJECTIVES

To gauge the opinions of doctors working, or interested, in general practice on monitoring patient safety using administrative data. The findings will inform the development of routinely collected data-based patient safety indicators in general practice and elsewhere in primary care.

DESIGN

Non-systematic participant recruitment, using personal contacts and colleagues' recommendations.

SETTING

Face-to-face consultations at participants' places of work, between June 2010 and February 2011.

PARTICIPANTS

Four general practitioners (GPs) and a final year medical student. The four clinicians had between eight to 34 years of clinical practice experience, and held non-clinical positions in addition to their clinical roles.

MAIN OUTCOME MEASURES

Views on safety issues and improvement priorities, measurement methods, uses of administrative data, role of administrative data in patient safety and experiences of quality and safety initiatives.

RESULTS

Medication and communication were the most commonly identified areas of patient safety concern. Perceived safety barriers included incident-reporting reluctance, inadequate medical education and low computer competency. Data access, financial constraints, policy changes and technology handicaps posed challenges to data use. Suggested safety improvements included better communication between providers and local partnerships between GPs.

CONCLUSIONS

The views of GPs and other primary care staff are pivotal to decisions on the future of English primary care and the health system. Broad views of general practice safety issues were shown, with possible reasons for patient harm and quality and safety improvement obstacles. There was general consensus on areas requiring urgent attention and strategies to enhance data use for safety monitoring.

Patient Care Teams in treatment of diabetes and chronic heart failure in primary care: an observational networks study

Background

Patient care teams have an important role in providing medical care to patients with chronic disease, but insight into how to improve their performance is limited. Two potentially relevant determinants are the presence of a central care provider with a coordinating role and an active role of the patient in the network of care providers. In this study, we aimed to develop and test measures of these factors related to the network of care providers of an individual patient.

Methods

We performed an observational study in patients with type 2 diabetes or chronic heart failure, who were recruited from three primary care practices in The Netherlands. The study focused on medical treatment, advice on physical activity, and disease monitoring. We used patient questionnaires and chart review to measure connections between the patient and care providers, and a written survey among care providers to measure their connections. Data on clinical performance were extracted from the medical records. We used network analysis to compute degree centrality coefficients for the patient and to identify the most central health professional in each network. A range of other network characteristics were computed including network centralization, density, size, diversity of disciplines, and overlap among activity-specific networks. Differences across the two chronic conditions and associations with disease monitoring were explored.

Results

Approximately 50% of the invited patients participated. Participation rates of health professionals were close to 100%. We identified 63 networks of 25 patients: 22 for medical treatment, 16 for physical exercise advice, and 25 for disease monitoring. General practitioners (GPs) were the most central care providers for the three clinical activities in both chronic conditions. The GP's degree centrality coefficient varied substantially, and higher scores seemed to be associated with receiving more comprehensive disease monitoring. The degree centrality coefficient of patients also varied substantially but did not seem to be associated with disease monitoring.

Conclusions

Our method can be used to measure connections between care providers of an individual patient, and to examine the association between specific network parameters and healthcare received. Further research is needed to refine the measurement method and to test the association of specific network parameters with quality and outcomes of healthcare.

Instrument development, data collection, and characteristics of practices, staff, and measures in the Improving Quality of Care in Diabetes (iQuaD) Study

Background

Type 2 diabetes is an increasingly prevalent chronic illness and an important cause of avoidable mortality. Patients are managed by the integrated activities of clinical and non-clinical members of primary care teams. This study aimed to: investigate theoretically-based organisational, team, and individual factors determining the multiple behaviours needed to manage diabetes; and identify multilevel determinants of different diabetes management behaviours and potential interventions to improve them. This paper describes the instrument development, study recruitment, characteristics of the study participating practices and their constituent healthcare professionals and administrative staff and reports descriptive analyses of the data collected.

Methods

The study was a predictive study over a 12-month period. Practices (N = 99) were recruited from within the UK Medical Research Council General Practice Research Framework. We identified six behaviours chosen to cover a range of clinical activities (prescribing, non-prescribing), reflect decisions that were not necessarily straightforward (controlling blood pressure that was above target despite other drug treatment), and reflect recommended best practice as described by national guidelines. Practice attributes and a wide range of individually reported measures were assessed at baseline; measures of clinical outcome were collected over the ensuing 12 months, and a number of proxy measures of behaviour were collected at baseline and at 12 months. Data were collected by telephone interview, postal questionnaire (organisational and clinical) to practice staff, postal questionnaire to patients, and by computer data extraction query.

Results

All 99 practices completed a telephone interview and responded to baseline questionnaires. The organisational questionnaire was completed by 931/1236 (75.3%) administrative staff, 423/529 (80.0%) primary care doctors, and 255/314 (81.2%) nurses. Clinical questionnaires were completed by 326/361 (90.3%) primary care doctors and 163/186 (87.6%) nurses. At a practice level, we achieved response rates of 100% from clinicians in 40 practices and > 80% from clinicians in 67 practices. All measures had satisfactory internal consistency (alpha coefficient range from 0.61 to 0.97; Pearson correlation coefficient (two item measures) 0.32 to 0.81); scores were generally consistent with good practice. Measures of behaviour showed relatively high rates of performance of the six behaviours, but with considerable variability within and across the behaviours and measures.

Discussion

We have assembled an unparalleled data set from clinicians reporting on their cognitions in relation to the performance of six clinical behaviours involved in the management of people with one chronic disease (diabetes mellitus), using a range of organisational and individual level measures as well as information on the structure of the practice teams and across a large number of UK primary care practices. We would welcome approaches from other researchers to collaborate on the analysis of this data.

Applying psychological theories to evidence-based clinical practice: identifying factors predictive of lumbar spine x-ray for low back pain in UK primary care practice

Background

Psychological models predict behaviour in a wide range of settings. The aim of this study was to explore the usefulness of a range of psychological models to predict the health professional behaviour 'referral for lumbar spine x-ray in patients presenting with low back pain' by UK primary care physicians.

Methods

Psychological measures were collected by postal questionnaire survey from a random sample of primary care physicians in Scotland and north England. The outcome measures were clinical behaviour (referral rates for lumbar spine x-rays), behavioural simulation (lumbar spine x-ray referral decisions based upon scenarios), and behavioural intention (general intention to refer for lumbar spine x-rays in patients with low back pain). Explanatory variables were the constructs within the Theory of Planned Behaviour (TPB), Social Cognitive Theory (SCT), Common Sense Self-Regulation Model (CS-SRM), Operant Learning Theory (OLT), Implementation Intention (II), Weinstein's Stage Model termed the Precaution Adoption Process (PAP), and knowledge. For each of the outcome measures, a generalised linear model was used to examine the predictive value of each theory individually. Linear regression was used for the intention and simulation outcomes, and negative binomial regression was used for the behaviour outcome. Following this 'theory level' analysis, a 'cross-theoretical construct' analysis was conducted to investigate the combined predictive value of all individual constructs across theories.

Results

Constructs from TPB, SCT, CS-SRM, and OLT predicted behaviour; however, the theoretical models did not fit the data well. When predicting behavioural simulation, the proportion of variance explained by individual theories was TPB 11.6%, SCT 12.1%, OLT 8.1%, and II 1.5% of the variance, and in the cross-theory analysis constructs from TPB, CS-SRM and II explained 16.5% of the variance in simulated behaviours. When predicting intention, the proportion of variance explained by individual theories was TPB 25.0%, SCT 21.5%, CS-SRM 11.3%, OLT 26.3%, PAP 2.6%, and knowledge 2.3%, and in the cross-theory analysis constructs from TPB, SCT, CS-SRM, and OLT explained 33.5% variance in intention. Together these results suggest that physicians' beliefs about consequences and beliefs about capabilities are likely determinants of lumbar spine x-ray referrals.

Conclusions

The study provides evidence that taking a theory-based approach enables the creation of a replicable methodology for identifying factors that predict clinical behaviour. However, a number of conceptual and methodological challenges remain.

Credible knowledge: a pilot evaluation of a modified GRADE method using parent-implemented interventions for children with autism

BACKGROUND

Decision-making in child and youth mental health (CYMH) care requires recommendations that are developed through an efficient and effective method and are based on credible knowledge. Credible knowledge is informed by two sources: scientific evidence, and practice-based evidence, that reflects the "real world" experience of service providers. Current approaches to developing these recommendations in relation to CYMH will typically include evidence from one source or the other but do not have an objective method to combine the two. To this end, a modified version of the Grading Recommendations Assessment, Development and Evaluation (GRADE) approach was pilot-tested, a novel method for the CYMH field.

METHODS

GRADE has an explicit methodology that relies on input from scientific evidence as well as a panel of experts. The panel established the quality of evidence and derived detailed recommendations regarding the organization and delivery of mental health care for children and youth or their caregivers. In this study a modified GRADE method was used to provide precise recommendations based on a specific CYMH question (i.e. What is the current credible knowledge concerning the effects of parent-implemented, early intervention with their autistic children?).

RESULTS

Overall, it appeared that early, parent-implemented interventions for autism result in positive effects that outweigh any undesirable effects. However, as opposed to overall recommendations, the heterogeneity of the evidence required that recommendations be specific to particular interventions, based on the questions of whether the benefits of a particular intervention outweighs its harms.

CONCLUSIONS

This pilot project provided evidence that a modified GRADE method may be an effective and practical approach to making recommendations in CYMH, based on credible knowledge. Key strengths of the process included separating the assessments of the quality of the evidence and the strength of recommendations, transparency in decision-making, and the objectivity of the methods. Most importantly, this method combined the evidence and clinical experience in a more timely, explicit and simple process as compared to previous approaches. The strengths, limitations and modifications of the approach as they pertain to CYMH, are discussed.

The translation research in a dental setting (TRiaDS) programme protocol

Background

It is well documented that the translation of knowledge into clinical practice is a slow and haphazard process. This is no less true for dental healthcare than other types of healthcare. One common policy strategy to help promote knowledge translation is the production of clinical guidance, but it has been demonstrated that the simple publication of guidance is unlikely to optimise practice. Additional knowledge translation interventions have been shown to be effective, but effectiveness varies and much of this variation is unexplained. The need for researchers to move beyond single studies to develop a generalisable, theory based, knowledge translation framework has been identified.

For dentistry in Scotland, the production of clinical guidance is the responsibility of the Scottish Dental Clinical Effectiveness Programme (SDCEP). TRiaDS (Translation Research in a Dental Setting) is a multidisciplinary research collaboration, embedded within the SDCEP guidance development process, which aims to establish a practical evaluative framework for the translation of guidance and to conduct and evaluate a programme of integrated, multi-disciplinary research to enhance the science of knowledge translation.

Methods

Set in General Dental Practice the TRiaDS programmatic evaluation employs a standardised process using optimal methods and theory. For each SDCEP guidance document a diagnostic analysis is undertaken alongside the guidance development process. Information is gathered about current dental care activities. Key recommendations and their required behaviours are identified and prioritised. Stakeholder questionnaires and interviews are used to identify and elicit salient beliefs regarding potential barriers and enablers towards the key recommendations and behaviours. Where possible routinely collected data are used to measure compliance with the guidance and to inform decisions about whether a knowledge translation intervention is required. Interventions are theory based and informed by evidence gathered during the diagnostic phase and by prior published evidence. They are evaluated using a range of experimental and quasi-experimental study designs, and data collection continues beyond the end of the intervention to investigate the sustainability of an intervention effect.

Discussion

The TRiaDS programmatic approach is a significant step forward towards the development of a practical, generalisable framework for knowledge translation research. The multidisciplinary composition of the TRiaDS team enables consideration of the individual, organisational and system determinants of professional behaviour change. In addition the embedding of TRiaDS within a national programme of guidance development offers a unique opportunity to inform and influence the guidance development process, and enables TRiaDS to inform dental services practitioners, policy makers and patients on how best to translate national recommendations into routine clinical activities.

Quality of care and health-related quality of life of climacteric stage women cared for in family medicine clinics in Mexico

Objectives

1) To design and validate indicators to measure the quality of the process of care that climacteric stage women receive in family medicine clinics (FMC). 2) To assess the quality of care that climacteric stage women receive in FMC. 3) To determine the association between quality of care and health-related quality of life (HR-QoL) among climacteric stage women.

Methods

The study had two phases: I. Design and validation of indicators to measure the quality of care process by using the RAND/UCLA Appropriateness Method. II. Evaluation of the quality of care and its association with HR-QoL through a cross-sectional study conducted in two FMC located in Mexico City that included 410 climacteric stage women. The quality of care was measured by estimating the percentage of recommended care received (PRCR) by climacteric stage women in three process components: health promotion, screening, and treatment. The HR-QoL was measured using the Cervantes scale (0-155). The association between quality of care and HR-QoL was estimated through multiple linear regression analysis.

Results

The lowest mean of PRCR was for the health promotion component (24.1%) and the highest for the treatment component (86.6%). The mean of HR-QoL was 50.1 points. The regression analysis showed that in the treatment component, for every 10 additional points of the PRCR, the global HR-QoL improved 2.8 points on the Cervantes scale (coefficient -0.28, P < 0.0001).

Conclusion

The indicators to measure quality of care for climacteric stage women are applicable and feasible in family medicine settings. There is a positive association between the quality of the treatment component and HR-QoL; this would encourage interventions to improve quality of care for climacteric stage women.

Measurement of quality improvement in family practice over two-year period using electronic database quality indicators: retrospective cohort study from Israel

AIM

To investigate the associations between family physicians' characteristics and the change in quality of health care indicators (QI) over a two-year period.

METHODS

The retrospective cohort study included 161 (60.5%) of 266 family physicians who worked for the Clalit health fund in Israel in the period from January 2003 until December 2005. Family physicians' background characteristics included seniority, location of the clinic (urban or rural), workload, sex, managerial responsibilities, and board certification. The performance in 11 QIs, including indicators of diabetes follow-up (n=4) and control (n=2), hospitalization for chronic obstructive pulmonary disease and congestive heart failure (n=2), and preventive medicine measures (influenza immunization for high risk patients and mammography) was evaluated at the end of 2003 and 2005.

RESULTS

There was an improvement in all the QIs except mammography. The improvement was significant for 8/10 QIs, the greatest being in achieving low-density lipoprotein cholesterol (+18.2%) and HbA1c (+5.9%) targets in diabetic patients. Multivariate regression model showed that the most significant factor associated with better QIs in December 2003 was board certification, while 2 years later it was female sex and having a managerial position. Being a board-certified physician remained positively associated with high QIs for diabetes control.

CONCLUSION

There was an improvement in most QIs in the period of 2 years. Initially, board certification was significantly associated with high QIs, but clinic managers and female physicians showed the ability to improve their scores. Research should continue to find ways to make all physicians responsive to their QIs.

Factors predicting team climate, and its relationship with quality of care in general practice

Background

Quality of care in general practice may be affected by the team climate perceived by its health and non-health professionals. Better team working is thought to lead to higher effectiveness and quality of care. However, there is limited evidence available on what affects team functioning and its relationship with quality of care in general practice. This study aimed to explore individual and practice factors that were associated with team climate, and to explore the relationship between team climate and quality of care.

Methods

Cross sectional survey of a convenience sample of 14 general practices and their staff in South Tyneside in the northeast of England. Team climate was measured using the short version of Team Climate Inventory (TCI) questionnaire. Practice characteristics were collected during a structured interview with practice managers. Quality was measured using the practice Quality and Outcome Framework (QOF) scores.

Results

General Practitioners (GP) had a higher team climate scores compared to other professionals. Individual's gender and tenure, and number of GPs in the practice were significantly predictors of a higher team climate. There was no significant correlation between mean practice team climate scores (or subscales) with QOF scores.

Conclusion

The absence of a relationship between a measure of team climate and quality of care in this exploratory study may be due to a number of methodological problems. Further research is required to explore how to best measure team functioning and its relationship with quality of care.

Can't do it, won't do it! Developing a theoretically framed intervention to encourage better decontamination practice in Scottish dental practices

Background

Guidance on the cleaning of dental instruments in primary care has recently been published. The aims of this study are to determine if the publication of the guidance document was enough to influence decontamination best practice and to design an implementation intervention strategy, should it be required.

Methods

A postal questionnaire assessing current decontamination practice and beliefs was sent to a random sample of 200 general dental practitioners.

Results

Fifty-seven percent (N = 113) of general dental practitioners responded. The survey showed large variation in what dentists self-reported doing, perceived as necessary or practical to do, were willing to do, felt able to do, as well as what they planned to change. Only 15% self-reported compliance with the five key guideline-recommended individual-level decontamination behaviours; only 2% reported compliance with all 11 key practice-level behaviours. The results also showed that our participants were almost equally split between dentists who were completely unmotivated to implement best decontamination practice or else highly motivated. The results suggested there was scope for further enhancing the implementation of decontamination guidance, and that an intervention with the greatest likelihood of success would require a tailored format, specifically targeting components of the theory of planned behaviour (attitude, perceived behavioural control, intention) and implementation intention theory (action planning).

Conclusion

Considerable resources are devoted to encouraging clinicians to implement evidence-based practice using interventions with erratic success records, or no known applicability to a specific clinical behaviour, selected mainly by means of researchers' intuition or optimism. The methodology used to develop this implementation intervention is not limited to decontamination or to a single segment of primary care. It is also in accordance with the preliminary stages of the framework for evaluating complex interventions suggested by the medical research council. The next phases of this work are to test the intervention feasibility and evaluate its effectiveness in a randomised control trial.

Can the collective intentions of individual professionals within healthcare teams predict the team's performance: developing methods and theory

Background

Within implementation research, using theory-based approaches to understanding the behaviours of healthcare professionals and the quality of care that they reflect and designing interventions to change them is being promoted. However, such approaches lead to a new range of methodological and theoretical challenges pre-eminent among which are how to appropriately relate predictors of individual's behaviour to measures of the behaviour of healthcare professionals. The aim of this study was to explore the relationship between the theory of planned behaviour proximal predictors of behaviour (intention and perceived behavioural control, or PBC) and practice level behaviour. This was done in the context of two clinical behaviours – statin prescription and foot examination – in the management of patients with diabetes mellitus in primary care. Scores for the predictor variables were aggregated over healthcare professionals using four methods: simple mean of all primary care team members' intention scores; highest intention score combined with PBC of the highest intender in the team; highest intention score combined with the highest PBC score in the team; the scores (on both constructs) of the team member identified as having primary responsibility for the clinical behaviour.

Methods

Scores on theory-based cognitive variables were collected by postal questionnaire survey from a sample of primary care doctors and nurses from northeast England and the Netherlands. Data on two clinical behaviours were patient reported, and collected by postal questionnaire survey. Planned analyses explored the predictive value of various aggregations of intention and PBC in explaining variance in the behavioural data.

Results

Across the two countries and two behaviours, responses were received from 37 to 78% of healthcare professionals in 57 to 93% practices; 51% (UK) and 69% (Netherlands) of patients surveyed responded. None of the aggregations of cognitions predicted statin prescription. The highest intention in the team (irrespective of PBC) was a significant predictor of foot examination.

Conclusion

These approaches to aggregating individually-administered measures may be a methodological advance of theoretical importance. Using simple means of individual-level measures to explain team-level behaviours is neither theoretically plausible nor empirically supported; the highest intention was both predictive and plausible. In studies aiming to understand the behaviours of teams of healthcare professionals in managing chronic diseases, some sort of aggregation of measures from individuals is necessary. This is not simply a methodological point, but a necessary step in advancing the theoretical and practical understanding of the processes that lead to implementation of clinical behaviours within healthcare teams.

Recorded quality of care for depression in general practice: an observational study

BACKGROUND

Depression is a leading cause of disease and disability internationally, and is responsible for many primary care consultations. Little is known about the quality of primary care for depression in the UK.

AIM

To determine the prevalence of good-quality primary care for depression, and to analyse variations in quality by patient and practice characteristics.

DESIGN OF STUDY

Retrospective observational study.

SETTING

Eighteen general practices in England.

METHOD

Medical records were examined for 279 patients. The percentage of eligible participants diagnosed with depression who received the care specified by each of six quality indicators in 2002 and 2004 was assessed. Associations between quality achievement and age, sex, patient deprivation score, timepoint, and practice size were estimated using logistic regression.

RESULTS

There was very wide variation in achievement of different indicators (range 1-97%). Achievement was higher for indicators referring to treatment and follow-up than for indicators referring to history taking. Achievement of quality indicators was low overall (37%). Quality did not vary significantly by patient or practice characteristics.

CONCLUSION

There is substantial scope for improvement in the quality of primary care for depression, if the highest achievement rates could be matched for all indicators. Given the lack of variation by practice characteristics, system-level and educational interventions may be the best ways to improve quality. The equitable distribution of quality by patient deprivation score is an important achievement that may be challenging to maintain as quality improves.

Improving the delivery of care for patients with diabetes through understanding optimised team work and organisation in primary care

BACKGROUND

Type 2 diabetes is an increasingly prevalent chronic illness and is an important cause of avoidable mortality. Patients are managed by the integrated activities of clinical and non-clinical members of the primary care team. Studies of the quality of care for patients with diabetes suggest less than optimum care in a number of areas.

AIM

The aim of this study is to improve the quality of care for patients with diabetes cared for in primary care in the UK by identifying individual, team, and organisational factors that predict the implementation of best practice.

DESIGN

Participants will be clinical and non-clinical staff within 100 general practices sampled from practices who are members of the MRC General Practice Research Framework. Self-completion questionnaires will be developed to measure the attributes of individual health care professionals, primary care teams (including both clinical and non-clinical staff), and their organisation in primary care. Questionnaires will be administered using postal survey methods. A range of validated theories will be used as a framework for the questionnaire instruments. Data relating to a range of dimensions of the organisational structure of primary care will be collected via a telephone interview at each practice using a structured interview schedule. We will also collect data relating to the processes of care, markers of biochemical control, and relevant indicator scores from the quality and outcomes framework (QOF). Process data (as a proxy indicator of clinical behaviours) will be collected from practice databases and via a postal questionnaire survey of a random selection of patients from each practice. Levels of biochemical control will be extracted from practice databases. A series of analyses will be conducted to relate the individual, team, and organisational data to the process, control, and QOF data to identify configurations associated with high quality care.

STUDY REGISTRATION

UKCRN ref:DRN120 (ICPD).

Developing the protocol for the evaluation of the health foundation's 'engaging with quality initiative' - an emergent approach

In 2004 a UK charity, The Health Foundation, established the 'Engaging with Quality Initiative' to explore and evaluate the benefits of engaging clinicians in quality improvement in healthcare. Eight projects run by professional bodies or specialist societies were commissioned in various areas of acute care. A developmental approach to the initiative was adopted, accompanied by a two level evaluation: eight project self-evaluations and a related external evaluation. This paper describes how the protocol for the external evaluation was developed. The challenges faced included large variation between and within the projects (in approach, scope and context, and in understanding of quality improvement), the need to support the project teams in their self-evaluations while retaining a necessary objectivity, and the difficulty of evaluating the moving target created by the developmental approach adopted in the initiative. An initial period to develop the evaluation protocol proved invaluable in helping us to explore these issues.

Patients' perspective in Chilean primary care: a questionnaire validation study

OBJECTIVE

The aim of this study was to adapt and validate an instrument for assessing quality of care from the patients' perspective in the context of Chilean primary care.

METHODS

The 'Health Centre Assessment Questionnaire' is made up of six multiple-item scales and two single-item scales addressing eight key areas of primary care activity. A further two single-item scales ask about the overall satisfaction and the way in which the centre deals with patients' health issues. The adaptation process was developed according to methods described in the specialized literature. The instrument was initially pre-tested in a sample of 100 primary care patients. The validation was carried out in 10 urban public primary healthcare centres where 2896 patients were invited to complete the questionnaire. The validity and reliability of the instrument was assessed using standard psychometric techniques.

RESULTS

Ninety nine per cent (2870) of those approached completed the questionnaire. It was acceptable to most of the patients as reflected by the high response rate, and a full range of possible scores in most of the scales. Reliability was good as reflected by high internal consistency and homogeneity. Validity was supported by the confirmation of scaling assumptions, the moderate correlations between multiple-item scales, and by the confirmation of our 'a priori' hypothesis.

CONCLUSIONS

The questionnaire could be a useful instrument for assessing a number of important dimensions in Chilean primary care. It is acceptable, reliable and valid. Further work is required to evaluate its validity against external criteria and its test-retest reliability.

Organizational culture, team climate and diabetes care in small office-based practices

Background

Redesigning care has been proposed as a lever for improving chronic illness care. Within primary care, diabetes care is the most widespread example of restructured integrated care. Our goal was to assess to what extent important aspects of restructured care such as multidisciplinary teamwork and different types of organizational culture are associated with high quality diabetes care in small office-based general practices.

Methods

We conducted cross-sectional analyses of data from 83 health care professionals involved in diabetes care from 30 primary care practices in the Netherlands, with a total of 752 diabetes mellitus type II patients participating in an improvement study. We used self-reported measures of team climate (Team Climate Inventory) and organizational culture (Competing Values Framework), and measures of quality of diabetes care and clinical patient characteristics from medical records and self-report. We conducted multivariate analyses of the relationship between culture, climate and HbA1c, total cholesterol, systolic blood pressure and a sum score on process indicators for the quality of diabetes care, adjusting for potential patient- and practice level confounders and practice-level clustering.

Results

A strong group culture was negatively associated to the quality of diabetes care provided to patients (β = -0.04; p = 0.04), whereas a more 'balanced culture' was positively associated to diabetes care quality (β = 5.97; p = 0.03). No associations were found between organizational culture, team climate and clinical patient outcomes.

Conclusion

Although some significant associations were found between high quality diabetes care in general practice and different organizational cultures, relations were rather marginal. Variation in clinical patient outcomes could not be attributed to organizational culture or teamwork. This study therefore contributes to the discussion about the legitimacy of the widespread idea that aspects of redesigning care such as teamwork and culture can contribute to higher quality of care. Future research should preferably combine quantitative and qualitative methods, focus on possible mediating or moderating factors and explore the use of instruments more sensitive to measure such complex constructs in small office-based practices.

Self reported receipt of care consistent with 32 quality indicators: national population survey of adults aged 50 or more in England

OBJECTIVE

To assess the receipt of effective healthcare interventions in England by adults aged 50 or more with serious health conditions.

DESIGN

National structured survey questionnaire with face to face interviews covering medical panel endorsed quality of care indicators for both publicly and privately provided care.

SETTING

Private households across England.

PARTICIPANTS

8688 participants in the English longitudinal study of ageing, of whom 4417 reported diagnoses of one or more of 13 conditions.

MAIN OUTCOME MEASURES

Percentage of indicated interventions received by eligible participants for 32 clinical indicators and seven questions on patient centred care, and aggregate scores.

RESULTS

Participants were eligible for 19 082 items of indicated care. Receipt of indicated care varied substantially by condition. The percentage of indicated care received by eligible participants was highest for ischaemic heart disease (83%, 95% confidence interval 80% to 86%), followed by hearing problems (79%, 77% to 81%), pain management (78%, 73% to 83%), diabetes (74%, 72% to 76%), smoking cessation (74%, 71% to 76%), hypertension (72%, 69% to 76%), stroke (65%, 54% to 76%), depression (64%, 57% to 70%), patient centred care (58%, 57% to 60%), poor vision (58%, 54% to 63%), osteoporosis (53%, 49% to 57%), urinary incontinence (51%, 47% to 54%), falls management (44%, 37% to 51%), osteoarthritis (29%, 26% to 32%), and overall (62%, 62% to 63%). Substantially more indicated care was received for general medical (74%, 73% to 76%) than for geriatric conditions (57%, 55% to 58%), and for conditions included in the general practice pay for performance contract (75%, 73% to 76%) than excluded from it (58%, 56% to 59%).

CONCLUSIONS

Shortfalls in receipt of basic recommended care by adults aged 50 or more with common health conditions in England were most noticeable in areas associated with disability and frailty, but few areas were exempt. Efforts to improve care have substantial scope to achieve better health outcomes and particularly need to include chronic conditions that affect quality of life of older people.

Chocolate bar as an incentive did not increase response rate among physiotherapists: a randomised controlled trial

Background

The aim of this study was to assess the effect of a small incentive, a bar of dark chocolate, on response rate in a study of physiotherapy performance in patients with knee osteoarthritis.

Findings

Norwegian physiotherapists from private practice were randomised in blocks to an intervention group (n = 1027) receiving a bar of dark chocolate together with a data-collection form, and a control group (n = 1027) that received the data-collection form only. The physiotherapists were asked to prospectively complete the data-collection form by reporting treatments provided to one patient with knee osteoarthritis through 12 treatment sessions. The outcome measure was response rate of completed forms.

Out of the 510 physiotherapists that responded, 280 had completed the data-collection form by the end of the study period. There was no difference between the chocolate and no-chocolate group in response rate of those who sent in completed forms. In the chocolate group, 142 (13.8%) returned completed forms compared to 138 (13.4%) in the control group, ARR = 0.4 (95% CI: -3.44 to 2.6).

Conclusion

A bar of dark chocolate did not increase response rate in a prospective study of physiotherapy performance. Stronger incentives than chocolate seem to be necessary to increase the response rate among professionals who are asked to report about their practice.

Trial Registration

Current Controlled Trials register: ISRCTN02397855

Insights about the process and impact of implementing nursing guidelines on delivery of care in hospitals and community settings

Background

Little is known about the impact of implementing nursing-oriented best practice guidelines on the delivery of patient care in either hospital or community settings.

Methods

A naturalistic study with a prospective, before and after design documented the implementation of six newly developed nursing best practice guidelines (asthma, breastfeeding, delirium-dementia-depression (DDD), foot complications in diabetes, smoking cessation and venous leg ulcers). Eleven health care organisations were selected for a one-year project. At each site, clinical resource nurses (CRNs) worked with managers and a multidisciplinary steering committee to conduct an environmental scan and develop an action plan of activities (i.e. education sessions, policy review). Process and patient outcomes were assessed by chart audit (n = 681 pre-implementation, 592 post-implementation). Outcomes were also assessed for four of six topics by in-hospital/home interviews (n = 261 pre-implementation, 232 post-implementation) and follow-up telephone interviews (n = 152 pre, 121 post). Interviews were conducted with 83/95 (87%) CRN's, nurses and administrators to describe recommendations selected, strategies used and participants' perceived facilitators and barriers to guideline implementation.

Results

While statistically significant improvements in 5% to 83% of indicators were observed in each organization, more than 80% of indicators for breastfeeding, DDD and smoking cessation did not change. Statistically significant improvements were found in > 50% of indicators for asthma (52%), diabetes foot care (83%) and venous leg ulcers (60%). Organizations with > 50% improvements reported two unique implementation strategies which included hands-on skill practice sessions for nurses and the development of new patient education materials. Key facilitators for all organizations included education sessions as well as support from champions and managers while key barriers were lack of time, workload pressure and staff resistance.

Conclusion

Implementation of nursing best practice guidelines can result in improved practice and patient outcomes across diverse settings yet many indicators remained unchanged. Mobilization of the nursing workforce to actively implement guidelines and to monitor the delivery of their care is important so that patients may learn about and receive recommended healthcare.

On the trail of quality and safety in health care

Initiatives to improve patient care have had only limited success. Richard Grol, Donald Berwick, and Michel Wensing call for steps to encourage a new generation of researchers to investigate how to speed up progress

Quality of diabetes care in the UK: comparison of published quality-of-care reports with results of the Quality and Outcomes Framework for Diabetes

AIMS

To conduct a systematic review of published observational studies of quality of diabetes care in primary care in the UK and to compare the results with the quality of care data from the Quality and Outcomes Framework (QOF) of the new General Practice Contract in the UK.

METHODS

medline and embase were searched for articles published from 1999 to June 2006. We also searched for reference lists of studies that fitted our inclusion criteria. All members of the Primary Care Diabetes Europe were contacted and asked to send lists of any relevant published articles. Abstracts were reviewed and data were collected independently by two authors.

RESULTS

Abstracts of 742 papers were identified, of which six papers fulfilled the final selection criteria. The total number of people included in the six published studies was 83 098 (a range of 504 to 54 180 people) compared with the UK QOF data of 1.8 million people with diabetes. The quality indicators for assessment of care varied between different published studies, making comparisons more difficult. Overall, there was a trend towards improvement in both process and outcome of care in the published studies. The quality of care achieved as a result of QOF was greater than that found in published studies.

CONCLUSIONS

There have been improvements in both process and outcome measures recorded in publications of quality of diabetes care in the UK between 2000 and 2004. Modest financial incentives in primary care are a successful method of improving care for people with diabetes.

Applying psychological theories to evidence-based clinical practice: identifying factors predictive of managing upper respiratory tract infections without antibiotics

BACKGROUND

Psychological models can be used to understand and predict behaviour in a wide range of settings. However, they have not been consistently applied to health professional behaviours, and the contribution of differing theories is not clear. The aim of this study was to explore the usefulness of a range of psychological theories to predict health professional behaviour relating to management of upper respiratory tract infections (URTIs) without antibiotics.

METHODS

Psychological measures were collected by postal questionnaire survey from a random sample of general practitioners (GPs) in Scotland. The outcome measures were clinical behaviour (using antibiotic prescription rates as a proxy indicator), behavioural simulation (scenario-based decisions to managing URTI with or without antibiotics) and behavioural intention (general intention to managing URTI without antibiotics). Explanatory variables were the constructs within the following theories: Theory of Planned Behaviour (TPB), Social Cognitive Theory (SCT), Common Sense Self-Regulation Model (CS-SRM), Operant Learning Theory (OLT), Implementation Intention (II), Stage Model (SM), and knowledge (a non-theoretical construct). For each outcome measure, multiple regression analysis was used to examine the predictive value of each theoretical model individually. Following this 'theory level' analysis, a 'cross theory' analysis was conducted to investigate the combined predictive value of all significant individual constructs across theories.

RESULTS

All theories were tested, but only significant results are presented. When predicting behaviour, at the theory level, OLT explained 6% of the variance and, in a cross theory analysis, OLT 'evidence of habitual behaviour' also explained 6%. When predicting behavioural simulation, at the theory level, the proportion of variance explained was: TPB, 31%; SCT, 26%; II, 6%; OLT, 24%. GPs who reported having already decided to change their management to try to avoid the use of antibiotics made significantly fewer scenario-based decisions to prescribe. In the cross theory analysis, perceived behavioural control (TPB), evidence of habitual behaviour (OLT), CS-SRM cause (chance/bad luck), and intention entered the equation, together explaining 36% of the variance. When predicting intention, at the theory level, the proportion of variance explained was: TPB, 30%; SCT, 29%; CS-SRM 27%; OLT, 43%. GPs who reported that they had already decided to change their management to try to avoid the use of antibiotics had a significantly higher intention to manage URTIs without prescribing antibiotics. In the cross theory analysis, OLT evidence of habitual behaviour, TPB attitudes, risk perception, CS-SRM control by doctor, TPB perceived behavioural control and CS-SRM control by treatment entered the equation, together explaining 49% of the variance in intention.

CONCLUSION

The study provides evidence that psychological models can be useful in understanding and predicting clinical behaviour. Taking a theory-based approach enables the creation of a replicable methodology for identifying factors that predict clinical behaviour. However, a number of conceptual and methodological challenges remain.

Quality of chronic disease care in general practice: the development and validation of a provider interview tool

BACKGROUND

This article describes the development and psychometric evaluation of an interview instrument to assess provider-reported quality of general practice care for patients with diabetes, cardiovascular disease and asthma--the Australian General Practice Clinical Care Interview (GPCCI).

METHODS

We administered the GPCCI to 28 general practitioners (family physicians) in 10 general practices. We conducted an item analysis and assessed the internal consistency of the instrument. We next assessed the quality of care recorded in the medical records of 462 of the general practitioners' patients with Type 2 diabetes, ischaemic heart disease/hypertension and/or moderate to severe asthma. This was then compared with results of the GPCCI for each general practice.

RESULTS

Good internal consistency was found for the overall GPCCI (Cronbach's alpha = 0.75). As far as the separate sub-scales were concerned, diabetes had good internal consistency (0.76) but the internal consistency of the heart disease and asthma subscales was not strong (0.49 and 0.16 respectively). There was high inter-rater reliability of the adjusted scores of data extracted from patients' medical notes for each of the three conditions. Correlations of the overall GPCCI and patients' medical notes audit, combined across the three conditions and aggregated to practice level, showed that a strong relationship (r = 0.84, p = 0.003) existed between the two indices of clinical care.

CONCLUSION

This study suggests that the GPCCI has good internal consistency and concurrent validity with patients' medical records in Australian general practice and warrants further evaluation of its properties, validity and utility.

Patient Engagement and Coaching for Health: The PEACH study--a cluster randomised controlled trial using the telephone to coach people with type 2 diabetes to engage with their GPs to improve diabetes care: a study protocol

Background

The PEACH study is based on an innovative 'telephone coaching' program that has been used effectively in a post cardiac event trial. This intervention will be tested in a General Practice setting in a pragmatic trial using existing Practice Nurses (PN) as coaches for people with type 2 diabetes (T2D). Actual clinical care often fails to achieve standards, that are based on evidence that self-management interventions (educational and psychological) and intensive pharmacotherapy improve diabetes control. Telephone coaching in our study focuses on both. This paper describes our study protocol, which aims to test whether goal focused telephone coaching in T2D can improve diabetes control and reduce the treatment gap between guideline based standards and actual clinical practice.

Methods/design

In a cluster randomised controlled trial, general practices employing Practice Nurses (PNs) are randomly allocated to an intervention or control group. We aim to recruit 546 patients with poorly controlled T2D (HbA1c >7.5%) from 42 General Practices that employ PNs in Melbourne, Australia. PNs from General Practices allocated to the intervention group will be trained in diabetes telephone coaching focusing on biochemical targets addressing both patient self-management and engaging patients to work with their General Practitioners (GPs) to intensify pharmacological treatment according to the study clinical protocol. Patients of intervention group practices will receive 8 telephone coaching sessions and one face-to-face coaching session from existing PNs over 18 months plus usual care and outcomes will be compared to the control group, who will only receive only usual care from their GPs. The primary outcome is HbA1c levels and secondary outcomes include cardiovascular disease risk factors, behavioral risk factors and process of care measures.

Discussion

Understanding how to achieve comprehensive treatment of T2D in a General Practice setting is the focus of the PEACH study. This study explores the potential role for PNs to help reduce the treatment and outcomes gap in people with T2D by using telephone coaching. The intervention, if found to be effective, has potential to be sustained and embedded within real world General Practice.

OECD Health Care Quality Indicator Project. The expert panel on primary care prevention and health promotion

PURPOSE

This article describes a project undertaken as part of the Organization for Economic Co-operation and Development (OECD)'s Healthcare Quality Indicator (HCQI) Project, which aimed to develop a set of quality indicators representing the domains of primary care, prevention and health promotion, and which could be used to assess the performance of primary care systems.

METHODS

Existing quality indicators from around the world were mapped to an organizing framework which related primary care, prevention, and health promotion. The indicators were judged against the US Institute of Medicine's assessment criteria of importance and scientific soundness, and only those which met these criteria and were likely to be feasible were included. An initial large set of indicators was reduced by the primary care expert panel using a modified Delphi process.

RESULTS

A set of 27 indicators was produced. Six of them were related to health promotion, covering health-related behaviours that are typically targeted by health education and outreach campaigns, 13 to preventive care with a focus on prenatal care and immunizations and eight to primary clinical care mainly addressing activities related to risk reduction. The indicators selected placed a strong emphasis on the public health aspects of primary care.

CONCLUSIONS

This project represents an important but preliminary step towards a set of measures to evaluate and compare primary care quality. Further work is required to assess the operational feasibility of the indicators and the validity of any benchmarking data drawn from international comparisons. A conceptual framework needs to be developed that comprehensively captures the complex construct of primary care as a basis for the selection of additional indicators.

Can the quality of care in family practice be measured using administrative data?

OBJECTIVE

To explore the feasibility of using administrative data to develop process indicators for measuring quality in primary care.

DATA SOURCES/STUDY SETTING

The Population Health Research Data Repository (Repository) housed at the Manitoba Centre for Health Policy which includes physician claims, hospital discharge abstracts, pharmaceutical use (Drug Program Information Network (DPIN)), and the Manitoba Immunization Monitoring Program (MIMS) for all residents of Manitoba, Canada who used the health care system during the 2001/02 fiscal year. Family physicians were identified from the Physician Resource Database. Indicators were developed based on a literature review and focus group validation.

DATA COLLECTION/EXTRACTION METHODS

Data files were extracted from administrative data available in the Repository. We extracted data based on the ICD-9-CM codes and ATC-class drugs prescribed and then linked them to the Physician Resource Database. Physician practices were defined by allocating patients to their most responsible physician. Every family physician in Manitoba that met the inclusion criteria (having either 5 or 10 eligible patients depending on the indicator) was 'scored' on each indicator. Physicians were then grouped according to the proportion of the patients allocated to their practice who received the recommended care for the specific indicator.

PRINCIPAL FINDINGS

Using administrative health data we were able to develop and measure eight indicators of quality of care covering both preventive care services and chronic disease management. The number of eligible physicians and patients varied for each indicator as did the percent of patients with recommended care, per physician. For example, the childhood immunization indicator included 544 physicians who, on average, provided immunization for 65 percent of their patients.

CONCLUSIONS

Quality of care provided by family physicians can be measured using administrative data. Despite the limitations addressed in this paper, this work establishes a practical methodology to measure quality of care provided by family physicians that can be used for quality improvement initiatives.

A cluster-randomized educational intervention to reduce inappropriate prescription patterns for elderly patients in general practice--The Prescription Peer Academic Detailing (Rx-PAD) study [NCT00281450]

Background

Age-related alterations in metabolism and excretion of medications increase the risk of adverse drug events in the elderly. Inappropriate polypharmacy and prescription practice entails increased burdens of impaired quality of life and drug related morbidity and mortality. The main objective of this trial is to evaluate effects of a tailored educational intervention towards general practitioners (GPs) aimed at supporting the implementation of a safer drug prescribing practice for elderly patients ≥ 70 years.

Methods/design

Approximately 80 peer continuing medical education (CME) groups (about 600 GPs) in southern Norway will be recruited to a cluster randomized trial. Participating groups will be randomized either to an intervention- or a control group. The control group will not receive any intervention towards prescription patterns in elderly, but will be the target of an educational intervention for prescription of antibiotics for respiratory tract infections. A multifaceted intervention has been tailored, where key components are educational outreach visits to the CME-groups, work-shops, audit and feedback. Prescription Peer Academic Detailers (Rx-PADs), who are trained GPs, will conduct the educational outreach visits. During these visits, a set of quality indicators (QIs), i.e. explicit recommendations for safer prescribing for elderly patients, will be presented and discussed. Software will be handed out for installation in participants' practice computers to enable extraction of pre-defined prescription data. These data will subsequently be linked to corresponding data from the Norwegian Prescription Database (NorPD). Individual feedback reports will be sent all participating GPs during and one year after the intervention. Feedback reports will include QI-scores on individual- and group levels, before and after the intervention. The main outcome of this trial is the change in proportions of inappropriate prescriptions (QIs) for elderly patients ≥ 70 years following intervention, compared to baseline levels.

Discussion

Improvement of prescription patterns in medical practice is a challenging task. Evidence suggests that a thorough evaluation of diagnostic indications for drug treatment in the elderly and/or a reduction of potentially inappropriate drugs may impose significant clinical benefits. Our hypothesis is that an educational intervention program will be effective in improving prescribing patterns for elderly patients in GP settings.