Methodological issues in the use of guidelines and audit to improve clinical effectiveness in breast cancer in one United Kingdom health region

Oncology communities of practice: insights from a qualitative analysis

Background

A community of practice (cop) is formally defined as a group of people who share a concern or a passion for something they do and who learn how to do it better as they interact regularly. Communities of practice represent a promising approach for improving cancer care outcomes. However, little research is available to guide the development of oncology cops. In 2015, our urban community hospital launched an oncology cop, with the goals of decreasing barriers to access, fostering collaboration, and improving practitioner knowledge of guidelines and services in cancer care. Here, we share insights from a qualitative analysis of feedback from participants in our cop. The objective of the project was to identify participant perspectives about preferred cop features, with a view to improving the quality of our community hospital's oncology cop.

Methods

After 5 in-person meetings of our oncology cop, participants were surveyed about what the cop should start, stop, and continue doing. Qualitative methods were used to analyze the feedback.

Results

The survey collected 250 comments from 117 unique cop participants, including family physicians, specialist physicians, nurses, and allied health care practitioners. Analysis identified participant perspectives about the key features of the cop and avenues for improvement across four themes: supporting knowledge exchange, identifying and addressing practice gaps, enhancing interprofessional collaboration, and fostering a culture of partnership.

Conclusions

Based on the results, we identified several considerations that could be helpful in improving our cop. Our findings might help guide the development of oncology cops at other institutions.

Building an oncology community of practice to improve cancer care

Background

Communities of practice (cops) have been shown to be effective models for achieving quality outcomes in health care.

Objective

Here, we describe the application of the cop model to the Canadian oncology context.

Methods

We established an oncology cop at our urban community hospital and its networks. Goals were to decrease barriers to access, foster collaboration, and improve knowledge of guidelines in cancer care. We hosted 6 in-person multidisciplinary meetings, focusing on screening, diagnosis, and management of common solid tumours. Health care providers affiliated with our hospital were invited to attend and to complete post-meeting surveys. Likert scales assessed whether cop goals were realized.

Results

Meetings attracted a mean of 57 attendees (range: 48-65 attendees), with a mean of 84% completing the surveys and consenting to the analysis. Attendees included family physicians (mean: 41%), specialist physicians (mean: 24%), nurses (mean: 10%), and allied health care providers (mean: 22%). Repeat attendance increased during the series, with 85% of attendees at the final meeting having attended 1 or more prior meetings. Across the series, most participants agreed or strongly agreed that the cop reduced barriers (mean: 76.0% ± 7.9%) and improved access to cancer care services (mean: 82.4% ± 8.1%) and subject matter experts (mean: 91.7% ± 4.2%); fostered teamwork (mean: 84.5% ± 6.8%) and a culture of collaboration (mean: 94.8% ± 4.2%); improved knowledge of cancer care services (mean: 93.3% ± 4.8%), standards of practice (mean: 92.3% ± 3.1%), and quality indicators (mean: 77.5% ± 6.3%); and improved cancer-related practice (mean: 88.8% ± 4.6%) and satisfaction in caring for cancer patients (mean: 82.9% ± 6.8%). Participant feedback carried a potential for bias.

Conclusions

We demonstrated the feasibility of oncology cops and found that participants perceived their value in reducing barriers to access, fostering collaboration, and improving knowledge of guidelines in cancer care.

Interprofessional education: effects on professional practice and healthcare outcomes (update)

BACKGROUND

The delivery of effective, high-quality patient care is a complex activity. It demands health and social care professionals collaborate in an effective manner. Research continues to suggest that collaboration between these professionals can be problematic. Interprofessional education (IPE) offers a possible way to improve interprofessional collaboration and patient care.

OBJECTIVES

To assess the effectiveness of IPE interventions compared to separate, profession-specific education interventions; and to assess the effectiveness of IPE interventions compared to no education intervention.

SEARCH METHODS

For this update we searched the Cochrane Effective Practice and Organisation of Care Group specialised register, MEDLINE and CINAHL, for the years 2006 to 2011. We also handsearched the Journal of Interprofessional Care (2006 to 2011), reference lists of all included studies, the proceedings of leading IPE conferences, and websites of IPE organisations.

SELECTION CRITERIA

Randomised controlled trials (RCTs), controlled before and after (CBA) studies and interrupted time series (ITS) studies of IPE interventions that reported objectively measured or self reported (validated instrument) patient/client or healthcare process outcomes.

DATA COLLECTION AND ANALYSIS

At least two review authors independently assessed the eligibility of potentially relevant studies. For included studies, at least two review authors extracted data and assessed study quality. A meta-analysis of study outcomes was not possible due to heterogeneity in study designs and outcome measures. Consequently, the results are presented in a narrative format.

MAIN RESULTS

This update located nine new studies, which were added to the six studies from our last update in 2008. This review now includes 15 studies (eight RCTs, five CBA and two ITS studies). All of these studies measured the effectiveness of IPE interventions compared to no educational intervention. Seven studies indicated that IPE produced positive outcomes in the following areas: diabetes care, emergency department culture and patient satisfaction; collaborative team behaviour and reduction of clinical error rates for emergency department teams; collaborative team behaviour in operating rooms; management of care delivered in cases of domestic violence; and mental health practitioner competencies related to the delivery of patient care. In addition, four of the studies reported mixed outcomes (positive and neutral) and four studies reported that the IPE interventions had no impact on either professional practice or patient care.

AUTHORS' CONCLUSIONS

This updated review reports on 15 studies that met the inclusion criteria (nine studies from this update and six studies from the 2008 update). Although these studies reported some positive outcomes, due to the small number of studies and the heterogeneity of interventions and outcome measures, it is not possible to draw generalisable inferences about the key elements of IPE and its effectiveness. To improve the quality of evidence relating to IPE and patient outcomes or healthcare process outcomes, the following three gaps will need to be filled: first, studies that assess the effectiveness of IPE interventions compared to separate, profession-specific interventions; second, RCT, CBA or ITS studies with qualitative strands examining processes relating to the IPE and practice changes; third, cost-benefit analyses.

Interprofessional education: effects on professional practice and health care outcomes

BACKGROUND

Patient care is a complex activity which demands that health and social care professionals work together in an effective manner. The evidence suggests, however, that these professionals do not collaborate well together. Interprofessional education (IPE) offers a possible way to improve collaboration and patient care.

OBJECTIVES

To assess the effectiveness of IPE interventions compared to education interventions in which the same health and social care professionals learn separately from one another; and to assess the effectiveness of IPE interventions compared to no education intervention.

SEARCH STRATEGY

We searched the Cochrane Effective Practice and Organisation of Care Group specialised register, MEDLINE and CINAHL, for the years 1999 to 2006. We also handsearched the Journal of Interprofessional Care (1999 to 2006), reference lists of the six included studies and leading IPE books, IPE conference proceedings, and websites of IPE organisations.

SELECTION CRITERIA

Randomised controlled trials (RCTs), controlled before and after (CBA) studies and interrupted time series (ITS) studies of IPE interventions that reported objectively measured or self reported (validated instrument) patient/client and/or healthcare process outcomes.

DATA COLLECTION AND ANALYSIS

Two reviewers independently assessed the eligibility of potentially relevant studies, and extracted data from, and assessed study quality of, included studies. A meta-analysis of study outcomes was not possible given the small number of included studies and the heterogeneity in methodological designs and outcome measures. Consequently, the results are presented in a narrative format.

MAIN RESULTS

We included six studies (four RCTs and two CBA studies). Four of these studies indicated that IPE produced positive outcomes in the following areas: emergency department culture and patient satisfaction; collaborative team behaviour and reduction of clinical error rates for emergency department teams; management of care delivered to domestic violence victims; and mental health practitioner competencies related to the delivery of patient care. In addition, two of the six studies reported mixed outcomes (positive and neutral) and two studies reported that the IPE interventions had no impact on either professional practice or patient care.

AUTHORS' CONCLUSIONS

This updated review found six studies that met the inclusion criteria, in contrast to our first review that found no eligible studies. Although these studies reported some positive outcomes, due to the small number of studies, the heterogeneity of interventions, and the methodological limitations, it is not possible to draw generalisable inferences about the key elements of IPE and its effectiveness. More rigorous IPE studies (i.e. those employing RCTs, CBA or ITS designs with rigorous randomisation procedures, better allocation concealment, larger sample sizes, and more appropriate control groups) are needed to provide better evidence of the impact of IPE on professional practice and healthcare outcomes. These studies should also include data collection strategies that provide insight into how IPE affects changes in health care processes and patient outcomes.

Audits can improve neurosurgical practice--illustrated by endoscopic third ventriculostomy

OBJECTIVE

A single-center, retrospective study was performed to evaluate the effect of audit on the patient selection for endoscopic third ventriculostomy (ETV).

MATERIALS AND METHODS

Between 01.01.99 and 07.31.01, 134 patients underwent ETV (group 1). During this period, there was no consensus within the neurosurgical community as to patient selection criteria for ETV. A review of our clinical practice in August 2001 demonstrated significantly lower ETV success rates for patients <6 months of age, patients with communicating hydrocephalus (HC) and for patients with prior shunt surgery. Thus, stricter patient selection criteria were established. Between 08.01.01 and 12.31.02, 54 patients were operated (group 2). The two groups were compared with respect to age, type of HC, previous shunt surgeries and ETV success rates. The primary outcome event was ETV malfunction, defined as symptoms and/or signs of increased intracranial pressure leading to repeat ETV or shunt implantation. Follow-up was done through outpatient clinics and telephone interviews. Average follow-up time was 12 months (range 0-44 months). No patient was lost to follow-up.

RESULTS

The overall 1-year ETV success rate in group 2 (65%) was significantly higher than in group 1 (53%) (p < 0.04). Group 2 had a significantly higher proportion of patients >6 months of age (p = 0.013) and with obstructive HC (p = 0.001).

CONCLUSION

Patient selection criteria critically affect the overall ETV success rate. An audit of our results led to a significant change in clinical practice, thereby improving the ETV success rates and patient care.

Organisational design for an integrated oncological department

Objective

The outcomes of a Strength, Weakness, Opportunities and Threat (SWOT) analysis of three Integrated Oncological Departments were compared with their present situation three years later to define factors that can influence a successful implementation and development of an Integrated Oncological Department in- and outside (i.e. home care) the hospital.

Research design

Comparative Qualitative Case Study.

Methods

Auditing based on care-as-usual norms by an external, experienced auditing committee.

Research setting

Integrated Oncological Departments of three hospitals.

Results

Successful multidisciplinary care in an integrated, oncological department needs broad support inside the hospital and a well-defined organisational plan.

Lessons from developing and running a clinical database for colorectal cancer

BACKGROUND

Recent policy developments in the UK require the routine monitoring of the performance of cancer services. Developing and using clinical databases is one approach to meet this objective, but to date their implementation has been challenging.

OBJECTIVE

To describe the development of the Thames Cancer Registry clinical database for colorectal cancer, and to present the lessons learnt in the first five years since its establishment.

METHODS

Planning of this clinical database began in 1998. Detailed variables for the data set were derived by analysis of national standards and guidelines. Structured pro formas were designed to abstract data from clinical notes. A pilot study over 12 months collected 400 cases from seven hospital trusts in one cancer network. Data collection over the wider North Thames area began in 1999.

RESULTS

The number of new records entered each year into the database rose from 747 in 1999 to 1107 in 2002. By 2004, it held a total of 8500. However, participation and completeness of data collection varied between trusts. Currently only 18 of 26 trusts in the area submit data and only 12 have done so every year. Overall completeness for key demographic and treatment variables has been between 80 and 100% but less so for more detailed diagnostic and treatment variables (40-60%). Barriers to implementation in trusts could be grouped as organizational, professional and data-related. Organizational barriers have included changes in the cancer networks, variability in trust commitment to different data sets and lack of personnel to enter data consistently. Professional barriers have included competing priorities and varying commitments within the multidisciplinary clinical teams. Data-related barriers include the wide range of database formats that are used in trusts, and a tendency for data to be collected at the end of the year rather than continuously.

CONCLUSIONS

Creating and maintaining a clinical database is a time-consuming and complex undertaking. Completeness of ascertainment and quality are major issues of concern. Key lessons from this project have been that the commitment of clinicians and the ability of trusts to provide consistent support for data collection are crucial.

The quality of early-stage breast cancer treatment: what can we do to improve?

Early-stage breast cancer is a highly curable disease with well-established protocols, including surgery, and the adjuvant modalities of regional radiation therapy, chemotherapy, and hormonal therapy. Yet, there is clear evidence that these adjuvant modalities are underused significantly. This article reviews the evidence that supports the use of efficacious local and systemic therapies in early-stage breast cancer, reasons for underuse, and interventions that have proven to be effective in ensuring the delivery of appropriate breast cancer care and suggests strategies to improve the quality of breast cancer care.

Effect of the UK government's 2-week target on waiting times in women with breast cancer in southeast England

A government target of a maximum 2-week wait for women referred urgently with suspected breast cancer was introduced in April 1999. We have assessed changes in the distributions of waiting times and the proportions of cases meeting proposed targets before and after this date, using clinical audit data on 5750 women attending 19 hospitals in southeast England during the period July 1997-December 2000, who were subsequently found to have breast cancer. The proportion of cases being seen within 2 weeks of referral rose from 66.0 to 75.2%, and the median wait to first appointment fell from 13.6 to 12.3 days, following the introduction of the government target. The proportion of cases waiting 5 weeks or less between first hospital appointment and treatment fell from 83.8 to 80.3%, and median waits for treatment increased from 21.4 to 24.1 days. We also examined the effects on waiting times of various sociodemographic and care related factors. A total of 85.7% of screening cases vs 67.9% of symptomatic cases were seen within 2 weeks, and 95.0% of cases treated with tamoxifen received treatment within 5 weeks, as opposed to 77.6% of cases treated with surgery, 81.2% of chemotherapy cases and 52.8% of radiotherapy cases. While waiting times from GP referral to first hospital appointment have improved since the introduction of the government target, times from first appointment to treatment have increased, and consequently total waiting times have changed little.

The importance of quality assurance in surgical oncology

AIMS

The aims were to review the existing methods of quality assurance in surgical oncology and to determine a relationship between surgery-related factors and the variety in outcomes in the treatment of solid cancers.

METHODS

The literature was reviewed by searching Medline and Cancerlit databases.

RESULTS

Wide variations were found in virtually all tumour types. Clear evidence was found that an improvement in the quality of the surgical procedure could have major implications for the prognosis and quality of life of cancer patients.

CONCLUSIONS

These findings emphasize the need for strict quality control procedures in surgical oncology and might imply a considerable change in cancer treatment strategies, because the routine use of adjuvant therapies could be questioned.

Variations in treatment and survival in breast cancer

To achieve optimum quality of care for women with breast cancer in the UK, uniformity of care in accordance with consensus guidelines is needed. This review highlights variations in provision of care for women with breast cancer, with particular emphasis on care received in the UK, examines differences in survival, and discusses the factors that may underlie these differences. Strong variation in treatment was identified, which appeared to affect survival significantly. These findings reinforce the need for women with breast cancer to be treated by dedicated specialists working within a multidisciplinary team to provide a high standard of care.