Using Data to Improve Healthcare: A Case Study of Pancreatic Enzyme Replacement in Pancreatic Cancer

OBJECTIVES

In the UK, guidelines recommend pancreatic enzyme replacement therapy (PERT) to all people with unresectable pancreatic cancer. In 2023, we published a national audit of PERT which showed suboptimal prescribing and wide regional variation in England. The aim of this manuscript was to describe how we used the PERT audit to drive improvements in healthcare.

METHODS

Building on the PERT audit, we deployed an online dashboard which will deliver ongoing updates of the PERT audit. We developed a collaborative intervention with cancer nurse specialists (CNS) to improve care delivered to people with pancreatic cancer. The intervention called Creating a natiOnAL CNS pancrEatic cancer network to Standardise and improve CarE (COALESCE) will use the dashboard to evaluate improvements in prescribing of PERT.

RESULTS

We demonstrated how large databases of electronic healthcare records (EHRs) can be used to improve cancer care. The PERT audit was implemented into a dashboard for tracking the progress of COALESCE. We will measure improvements in PERT prescribing as the intervention with CNS progresses.

CONCLUSIONS

Improving healthcare is an ongoing and iterative process. By implementing the PERT dashboard, we created a resource-efficient, automated evaluation method enabling COALESCE to deliver a sustainable change. National-scale databases of EHRs enable rapid cycles of audits, providing regular feedback to interventions, working systematically to deliver change. Here, the focus is on pancreatic cancer. However, this methodology is transferable to other areas of healthcare.

IMPLICATIONS FOR NURSING PRACTICE

Nurses play a key role in collecting good quality data which are needed in clinical audits to identify shortcomings in healthcare. Nurse-driven interventions can be designed to improve healthcare. In this study, we capitalize on the unique role of CNS coordinating care for every patient with cancer. COALESCE is the first national collaborative study which uses CNS as researchers and change agents.

Multidisciplinary team meetings and their impact on survival in rectal cancer. Population-based analysis in Catalonia (Spain)

BACKGROUND

Multidisciplinary team meetings (MTMs) are considered a pillar of cancer care; however, evidence of the independent benefit of MTMs on survival in rectal cancer is controversial.

METHODS

This population-based cohort analysis included patients undergoing surgery for primary rectal cancer with curative intent. We drew data derived from three clinical audits conducted in Catalonia from 2011 to 2020. The primary outcome was 2-year survival. Multivariable Cox regression analysis was used to assess the hazard ratio for death in patients whose cases were versus were not discussed in a preoperative MTM.

RESULTS

A total of 5249 patients were included (66.1 % male, 58.3 % aged 60-79 years, 63.2 % receiving anterior resection): 4096 cases were discussed in a preoperative MTM, and 1153 were not. Multivariable Cox proportional hazards regression analysis showed that the MTM group had better survival than those with no preoperative MTM (hazard ratio 1.22, 95 % confidence interval 1.02-1.48), after adjusting for potential confounders.

CONCLUSIONS

Preoperative MTM may be associated with improved survival in patients with rectal cancer in Catalonia. Efforts to ensure universal access to MTMs for all newly diagnosed patients should be supported.

Evaluation of hospital quality of care outcomes in a teaching hospital in Ethiopia: a retrospective database study

OBJECTIVES

We aimed to evaluate hospital mortality rates, readmission rates and length of hospital stay (LOS) among adult medical patients admitted to a teaching hospital in Ethiopia.

DESIGN

We performed a retrospective study using routinely collected electronic data.

SETTING

Data were collected from Yekatit 12 Hospital Medical College between January 2021 and July 2023.

PARTICIPANTS

The analysis included 3499 (4111 admissions) adult medical patients with complete data.

OUTCOME MEASURES

We used mortality rates, readmission rates and LOS to measure the quality of the outcomes for the top 15 admission diagnoses. A multivariable Cox proportional hazard model was used to identify the statistically significant predictors of mortality with p values<0.05 and a 95% CI. The Kaplan-Meier curve was used to estimate the failure rate (mortality) of the admitted patients.

RESULTS

The median age of patients was 50 years and men accounted for 1827 (52.3%) of all admitted cases. Non-communicable diseases accounted for 2537 (72.5%) admissions. In descending order, stroke, 644 (18.29%); heart failure, 640 (18.41%); and severe pneumonia, 422 (12.06%) were the three most common causes of admission. The readmission rate was 25.67% (1056/411), and 61.9% of them were readmitted within 30 days of index discharge. The overall median LOS was 8 days. The median LOSs in the index admission (11 vs 8 days, p value=0.001) of readmitted patients was significantly higher than not readmitted. The in-hospital mortality rate was 438 (12.5%), with the highest number of deaths occurred between days 30 and 50 of admission. The mortality rate is significantly higher among patients with communicable diseases (adjusted HR, 1.64, 95% CI: 1.34, 2.10) and elderly patients (≥65 years) (adjusted HR, 1.79, 95% CI: 1.44, 2.22). Septicemia, chronic liver diseases with complications and HIV with complications were the three common causes of death with a proportional mortality rate of 55.2%, 27.93% and 22.46%, respectively.

CONCLUSIONS

Mortality, median LOSs and readmission rate were comparable to other national and international studies. Multicentre compressive research using these three quality patient outcomes is required to establish national standards and evaluate institutional performance.

Compliance of Surgical Care in Patients with Carcinoma Endometrium in a Tertiary Care Centre in South India, to European Society of Gynaecologic Oncology (ESGO) Quality Indicators

To analyse the compliance of surgical care provided to patients diagnosed with carcinoma endometrium, to the European Society of Gynaeacological Oncology (ESGO) quality indicators. This is a retrospective audit done in the Department of Gynaecologic Oncology. Electronic medical records of patients who underwent surgical management of carcinoma endometrium from January 2020 to December 2021 were assessed. A total of 163 patients had undergone primary surgery, and 2 patients had surgery for recurrence. The audit showed that the target for categories of general indicators and pre-operative work-up was met. There was lack in compliance to the intraoperative management, with only 34% among presumed early-stage disease undergoing successful MIS, 31% undergoing sentinel lymph node procedure and 53% among them being done using indocyanine green with 18% bilateral mapping rate. None of the patients had complete molecular classification. Compliance to adjuvant treatment provided was adequate. Minimal required elements in surgical reports were in 81% and pathological reports in 91% of patients falling short of the set target. The audit helped us identify the need to increase MIS and use and adapt sentinel lymph node procedure with ICG dye more aggressively. There also is a need for improvement in documentation of pertinent information on surgical and pathology reporting. Molecular classification should be routinely incorporated into the diagnostic algorithm to aid in adjuvant therapy.

[Evaluation of medication self-administration feasibility in a university hospital: Clinical audits and recommendations]

The French Health Authority recently published guidelines about patient self-administration of medications for voluntary hospitalized patients under medical supervision. This study aimed to assess medication management practices in our hospital and provide recommendations for self-administration medication. A prospective monocentric study was performed from January to June 2023, involving patient and nurse surveys based on the guidelines from the French Health Authority. A total of 207 patients participated in the survey, with a mean age of 59.6years. Among them, 56% were inclined to self-manage treatments initiated during hospitalization. Among patients with regular treatments, 62% were inclined to self-manage them in the hospital. In weekday hospitalization units, 92% of patients were inclined to self-manage their regular treatments, and 75% of those initiated during hospitalization. Among the 26 surveyed nurses, 71% reported patient autonomy for taking drugs in narrative transmissions, and 88% verified medication intake through self-administration, while 96% digitally traced it. The concept of self-administration of medication appears promising, especially within weekday hospitalization units, particularly for patients with a good understanding of their treatment. Nurses currently assess patient autonomy without specific monitoring tools. Collaborative efforts among healthcare professionals, with pharmacists playing a central role, are essential for the success of this innovative approach.

Predictors of paediatric difficult intubation according to the experience of a university hospital in a low- and middle-income country: A prospective observational study

BACKGROUND

Difficult airway management is one of the main challenges in paediatric anaesthesia, particularly in low- and middle-income countries.

AIMS

The aim of this study was to investigate the main predictors of difficult paediatric intubation.

METHODS

In this observational study, we included all children aged less than five years undergoing intra-abdominal surgery with endotracheal intubation. Patients were divided into two groups according to the incidence of difficult intubation. Then, we investigated predictors for difficult paediatric intubation.

RESULTS

We included 217 children, and difficult intubation was observed in 10% of them. Predictors were as follows: Mallampati III-IV class (adjusted odds ratio = 2.21; 95% confidence interval = 1.1-6.4), limited mouth opening (adjusted odds ratio = 2.4; 95% confidence interval = 1.8-3.5), facial dysmorphia (adjusted odds ratio = 2.6; 95% confidence interval = 1.32-7.4) and anaesthesia without muscle relaxant (adjusted odds ratio = 1.8; 95% confidence interval = 1.0-5.1) or without opioids during crash inductions (adjusted odds ratio = 1.7; 95% confidence interval = 1.01-4.8).

CONCLUSION

Facial dysmorphia and limited mouth opening were predictors of difficult intubation in children. Furthermore, it seems that Mallampati class and anaesthesia technique may also predict challenging intubation, which may guide us to change our perioperative practice.

The Leicester, Leicestershire and Rutland quality improvement project and integrated chronic kidney disease system: implementation within a primary care network

BACKGROUND

The optimisation of patients in primary care is a prime opportunity to manage patient care within the community and reduce the burden of referrals on secondary care. This paper presents a quality improvement clinical programme taking place within an NHS Primary Care Network as part of the wider Leicester Leicestershire Rutland integrated chronic kidney disease programme.

METHOD

Patients are optimised to guidelines from the National Institute for Health and Care Excellence, by a primary care clinical team who are supported by nephrology consultants and nephrology pharmacists. Multidisciplinary team meetings take place with secondary care specialists and primary care staff. Learning is passed to the community clinicians for better patient treatment locally.

RESULTS

A total of 526 patients were reviewed under this project.The total number of referrals to secondary care which were discharged following first outpatient appointment, reduced from 42.9% to 10%. This reduction of 32.9% represents the optimisation of patient cases through this quality improvement project. Patients can be optimised and managed within the community, reducing the number of unnecessary referrals to secondary care.

CONCLUSION

This programme has the potential to offer significant improvement in patient outcomes when expanded to a larger patient base. Medicine management and the use of clinical staff are optimised in both primary and secondary care.

Evaluation of the degree of implementation of zero projects in critical care units of Galicia (Spain) through internal audits

OBJECTIVE

The objective of this study was to assess the implementation of Zero Projects in Critical Care Units (CCUs) through Internal Audits (IA).

MATERIALS AND METHODS

Design: Real-time observational safety analysis. A questionnaire was developed with defined items to ensure objectivity. After IAs, a survey was conducted with the auditors.

SCOPE

11 CCUs in hospitals of the Servizo Galego de Saúde and Ribera-POVISA.

PATIENTS OR PARTICIPANTS

24 auditors in 9 teams composed of medical, nursing, and quality personnel from health areas and 34 patients were assessed.

MAIN VARIABLES OF INTEREST

Compliance with the quality standard (≥60% of items), strengths, areas for improvement, auditor's interest in IA, conformity with the organization and items.

RESULTS

100% CCUs met the quality standard. 18.03% of items were fulfilled by all CCUs. Strengths: staff motivation, positive reception of auditors, and use of computer tools in some CCUs. Areas for improvement: deficit of automatic systems for controlling endotracheal tube cuff pressure (compliance rate in 9.1% of CCUs), training needs, communication issues, and not using checklists (45.5% of the reports). Auditors found IA very interesting, and 19% suggested improving organization and items.

CONCLUSIONS

All CCUs met the previously agreed-upon quality standard. Numerous improvement opportunities were identified and communicated to the audited CCUs. For greater homogeneity and objectivity, a review of previously agreed items and definitions is required.

Evaluation of the adherence to surgical antibiotic prophylaxis recommendations and associated factors in a University Hospital: A cross-sectional study

BACKGROUND

Surgical antibiotic prophylaxis (SAP) is an important preventive measure, aiming to minimize surgical site infections. However, despite evidence-based guidelines, adherence to SAP protocols remains suboptimal in clinical practice. The aim of this study was to assess the adequacy of SAP in a high-complexity hospital and investigate associated factors.

METHODS

A cross-sectional design was conducted, involving surgeries performed by expert teams in cardiology, urology, neurology, and gastrointestinal. SAP prescriptions were evaluated based on indication, antibiotic choice, dosage, and duration, according to the hospital protocol. Data analysis included descriptive statistics and association tests between protocol adherence and patient demographics, clinical variables, surgical teams, and types of surgeries.

RESULTS

Out of 1,864 surgeries, only 20.7% adhered to SAP protocols. Lower adherence rates were observed for antibiotic choice and duration of prophylaxis. Neurological surgeries exhibited significantly lower adherence, particularly concerning antibiotic choice and duration. Factors associated with nonadherence included elevated preoperative blood glucose levels, prolonged hospitalization, and extended surgical duration. Logistic regression analysis identified surgical teams as significant factors influencing protocol adherence.

CONCLUSIONS

Despite the relatively high adherence to antibiotic dosage, challenges persist in antibiotic choice and duration adjustment. Poor glycemic control, prolonged surgery, and surgical teams were variables associated with inappropriate practice.

Harnessing policy to promote inclusive medical product evidence: development of a reference standard and structured audit of clinical trial diversity policies

ABSTRACT

Objective

To develop a reference standard based on US Food and Drug Administration and stakeholder guidance for pharmaceutical companies' policies on diversity in clinical trials and to assess these policies.

Design

Development of a reference standard and structured audit for clinical trial diversity policies.

Setting

50 pharmaceutical companies selected from the top 500 by their market capitalizations in 2021 (the 25 largest companies and 25 non-large companies, randomly selected from the remaining 475 companies).

Population

Data from pharmaceutical company websites and annual reports. Policy guidance from the Pharmaceutical Research and Manufacturers of America, International Federation of Pharmaceutical Manufacturers and Associations, Biotechnology Industry Organization, International Committee of Medical Journal Editors, the US Food and Drug Administration, European Medicines Agency, and World Health Organization, up to 15 May 2023.

Main outcome measures

Multicomponent measure based on distinct themes derived from FDA and stakeholder guidance.

Results

Reviewing FDA and stakeholder guidance identified 14 distinct themes recommended for improving diversity in clinical trials, which were built into a reference standard: (1) enrollment targets that reflect the prevalence of targeted conditions in populations, (2) broad eligibility criteria for trials, (3) diversity in the workforce, (4) identification and remedy of barriers to trial recruitment and retention, (5) incorporation of patient input into trial design, (6) health literacy, (7) multidimensional approaches to diversity, (8) sites with diverse providers and patient populations, (9) data collection after product approval, (10) diverse enrollment in every country where trials are conducted, (11) diverse enrollment should be a focus for all phases of clinical trials, not just later stage or pivotal trials, (12) varied trial design, (13) expanded access, and (14) public reporting of the personal characteristics of participants in trials. Applying this reference standard, 48% (24/50) of companies had no public policy on diversity in clinical trials; among those with policies, content varied widely. Large companies were more likely to have a public policy than non-large companies (21/25, 84% v 5/25, 20%, P<0.001). Large companies most frequently committed to using epidemiological based trial enrollment targets representing the prevalence of indicated conditions in various populations (n=15, 71%), dealing with barriers to trial recruitment (n=15, 71%), and improving patient awareness of trial opportunities (n=14, 67%). The location of the company was not associated with having a public diversity policy (P=0.17). The average company policy had five of the 14 commitments (36%, range 0-8) recommended in FDA and stakeholder guidance.

Conclusions

The findings of the study showed that many pharmaceutical companies did not have public policies on diversity in clinical trials, although policies were more common in large than non-large companies. Policies that were publicly available varied widely and lacked important commitments recommended by stakeholder guidance. The results of the study suggest that corporate policies can be better leveraged to promote representation and fair inclusion in research, and implementation of FDA and stakeholder guidance.

Optimizing patient-controlled analgesia: a narrative review based on a single center audit process

Intravenous patient-controlled analgesia (PCA) is valuable for delivering opioids in a flexible and timely manner. Although it is designed to offer personalized analgesia driven by the patients themselves, users often report insufficient pain relief, which can be addressed by optimizing its settings and multimodal analgesia. We adopted a systematic approach to modify PCA protocols by utilizing a serial audit process based on institutional PCA data. This review retrospectively examined the process, encompassing data from 13,230 patients who had used PCA devices. The two modifications to the fentanyl-based PCA protocols resulted in three distinct phases. In the first phase, high opioid consumption and unintended PCA withdrawal were the common issues. These were addressed in the second phase by omitting the routine use of basal infusion. However, this led to increased delivery-to-demand ratios, mitigated in the third phase by increasing the bolus dose from 15 μg to 20 μg. These serial protocol changes have produced varied outcomes across different surgical departments, underscoring the need for careful and gradual adjustments and thorough impact assessments. Drawing insights from this audit process, we incorporated findings from the literature on PCA settings and multimodal analgesic approaches. This review underscores the significance of iterative feedback and refinement of analgesic protocols to achieve optimal postoperative pain management. Additionally, it discusses critical considerations regarding the postoperative audit processes.

Analysing false-positive errors when Australian radiographers use preliminary image evaluation

INTRODUCTION

Diagnostic errors in the emergency departments can have major implications on patient outcomes. Preliminary Image Evaluation (PIE) is a brief comment written by a radiographer describing an acute or traumatic pathology on a radiograph and can be used to complement referrer's image interpretation in the absence of the radiologist report. Currently, no studies exist that focus their analysis on false-positive (FP) errors in PIE. The purpose of this study was to investigate the regions of the body that cause the most FP errors and recognise other areas in image interpretation that may need additional attention.

METHODS

A longitudinal retrospective clinical audit was conducted to determine the accuracy of radiographer PIE's over 5 years from January 2016 to December 2020. PIE's were compared to the radiologist report to assess for diagnostic accuracy. FP and unsure errors were further categorised by anatomical region and age.

RESULTS

Over this period, a sample size of 11,090 PIE audits were included in the study demonstrating an overall PIE accuracy of 87.7%. Foot, ankle and chest regions caused the most FP errors, while ankle, shoulder and elbow caused the most unsure cases. 76% of the unsure cases were negative for any pathology when compared to the radiologist report. The paediatric population accounted for 21.3% of FP cases and 33.6% of unsure cases.

CONCLUSION

Findings in this study should be used to tailor education specific to radiographer image interpretation. Improving radiography image interpretation skills can assist in improving referrer diagnostic accuracy, thus improving patient outcomes.

Preoperative investigation practices for elective surgical patients: clinical audit

BACKGROUND

The findings of pre-operative investigations help to identify risk factors that may affect the course of surgery or post-operative recovery by contributing to informed consent conversations between the surgical team and the patient, as well as guiding surgical and anesthetic planning. Certainly, preoperative tests are valuable when they offer additional information beyond what can be gathered from a patient's history and physical examination alone. Preoperative testing practices differ significantly among hospitals, and even within the same hospital, clinicians may have varying approaches to requesting tests. This study aimed to investigate preoperative testing practices and compare them with the latest guidelines from the National Institute for Health and Care Excellence (NICE).

METHODS

This three-month institutionally based study was carried out at the Debre Tabor Comprehensive Specialized Hospital from May 1 to July 30, 2023, including individuals aged 16 years and older who were not pregnant and had undergone elective surgery in the gynecological, orthopedic, and general units. Data on the sociodemographic characteristics, the existence of comorbidities, the invasiveness of surgery, and the tests taken into consideration by the guideline were gathered using a self-administered questionnaire. After rigorously analyzing and revising the results of preoperative investigation approaches, we compared them to the standard of recommendations. Moreover, the data was analyzed and graphically presented using Microsoft Excel 2013.

RESULTS

During the data collection period, 247 elective patients underwent general, orthopedic, and gynecological operations. The majority of patients, 107 (43.32%), were between the ages of 16 and 40 and had an American Society of Anesthesiologists (ASA) class one (92.71%). 350 investigations were requested in total. Of these, 71 (20.28%) tests were ordered without a justified reason or in contravention of NICE recommendations.

CONCLUSIONS

In our hospital's surgical clinical practice, unnecessary preoperative testing is still common, especially when it comes to organ function tests, electrocardiograms (ECGs), and complete blood counts (FBCs). When deciding whether preoperative studies are required, it is critical to consider aspects including a complete patient history, a physical examination, and the invasiveness of the surgery.

Pre-treatment assessment of chemotherapy for cancer patients: a multi-site evidence implementation project of 74 hospitals in China

BACKGROUND

Chemotherapy, whilst treating tumours, can also lead to numerous adverse reactions such as nausea and vomiting, fatigue and kidney toxicity, threatening the physical and mental health of patients. Simultaneously, misuse of chemotherapeutic drugs can seriously endanger patients' lives. Therefore, to maintain the safety of chemotherapy for cancer patients and to reduce the incidence of adverse reactions to chemotherapy, many guidelines state that a comprehensive assessment of the cancer patient should be conducted and documented before chemotherapy. This recommended procedure, however, has yet to be extensively embraced in Chinese hospitals. As such, this study aimed to standardise the content of pre-chemotherapy assessment for cancer patients in hospitals and to improve nurses' adherence to pre-chemotherapy assessment of cancer patients by conducting a national multi-site evidence implementation in China, hence protecting the safety of cancer patients undergoing chemotherapy and reducing the incidence of adverse reactions to chemotherapy in patients.

METHODS

The national multi-site evidence implementation project was launched by a JBI Centre of Excellence in China and conducted using the JBI approach to evidence implementation. A pre- and post-audit approach was used to evaluate the effectiveness of the project. This project had seven phases: training, planning, baseline audit, evidence implementation, two rounds of follow-up audits (3 and 9 months after evidence implementation, respectively) and sustainability assessment. A live online broadcast allowed all participating hospitals to come together to provide a summary and feedback on the implementation of the project.

RESULTS

Seventy-four hospitals from 32 cities in China participated in the project, four withdrew during the project's implementation, and 70 hospitals completed the project. The pre-and post-audit showed a significant improvement in the compliance rate of nurses performing pre-chemotherapy assessments for cancer patients. Patient satisfaction and chemotherapy safety were also improved through the project's implementation, and the participating nurses' enthusiasm and belief in implementing evidence into practice was increased.

CONCLUSION

The study demonstrated the feasibility of academic centres working with hospitals to promote the dissemination of evidence in clinical practice to accelerate knowledge translation. Further research is needed on the effectiveness of cross-regional and cross-organisational collaborations to facilitate evidence dissemination.

Barriers to research progress for perioperative care practitioners working in cardiothoracic surgery

Policy and research literature worldwide support the need to build research capacity and capability among non-medical practitioners within healthcare systems. However, there exists a paucity of evidence on whether practitioners in cardiothoracic surgery are attuned to this and on what barriers or enablers exist. A survey was carried out with non-medical practitioners working in cardiothoracic surgery in the United Kingdom to explore attitudes towards health research and audit, and to identify current challenges and barriers to surgical research and audit as perceived by cardiothoracic nurses and allied health professionals. A total of 160 completed questionnaires were returned. 99% of respondents supported the need for research and believed that evidence-based surgical care improves outcomes for patients. Seventy-two percent reported that their employer motivates them to take part in national research or audit but, only 22% were allocated time to do so within their role; 96% reported their interest in being involved in research and audit, yet only 30% believed they had the skills to undertake research, and 96% reported needing additional training. More work is needed to increase awareness, capacity and capability among cardiothoracic surgery care practitioners, and indeed other specialities to achieve research progress.

Do medical specialists accept claims-based Audit and Feedback for quality improvement? A focus group study

OBJECTIVES

Audit and Feedback (A&F) is a widely used quality improvement (QI) intervention in healthcare. However, not all feedback is accepted by professionals. While claims-based feedback has been previously used for A&F interventions, its acceptance by medical specialists is largely unknown. This study examined medical specialists' acceptance of claims-based A&F for QI.

DESIGN

Qualitative design, with focus group discussions. Transcripts were analysed using discourse analysis.

SETTING AND PARTICIPANTS

A total of five online focus group discussions were conducted between April 2021 and September 2022 with 21 medical specialists from varying specialties (urology; paediatric surgery; gynaecology; vascular surgery; orthopaedics and trauma surgery) working in academic or regional hospitals in the Netherlands.

RESULTS

Participants described mixed views on using claims-based A&F for QI. Arguments mentioned in favour were (1) A&F stimulates reflective learning and improvement and (2) claims-based A&F is more reliable than other A&F. Arguments in opposition were that (1) A&F is insufficient to create behavioural change; (2) A&F lacks clinically meaningful interpretation; (3) claims data are invalid for feedback on QI; (4) claims-based A&F is unreliable and (5) A&F may be misused by health insurers. Furthermore, participants described several conditions for the implementation of A&F which shape their acceptance.

CONCLUSIONS

Using claims-based A&F for QI is, for some clinical topics and under certain conditions, accepted by medical specialists. Acceptance of claims-based A&F can be shaped by how A&F is implemented into clinical practice. When designing A&F for QI, it should be considered whether claims data, as the most resource-efficient data source, can be used or whether it is necessary to collect more specific data.

Improving the clinical monitoring of extrapyramidal symptoms: a local quality improvement project

BACKGROUND

Extrapyramidal symptoms (EPS) can cause significant morbidity and impact negatively on patients' quality of life. Clinical guidelines provide recommendations regarding screening frequency and the use of structured tools to ensure adequate monitoring of EPS. Despite this, the literature indicates that the documentation and monitoring of EPS remain suboptimal.

AIMS

To devise an intervention that would lead to the improvement in the documentation and hence monitoring of EPS.

METHODS

An initial paper chart survey was conducted to assess the current extent of documentation and monitoring of EPS carried out in patient files of three distinct settings in our Mental Health Service (MHS): inpatient, rehabilitation, and assertive outreach. An intervention aimed at improving practice was subsequently designed and implemented. This involved adoption by the MHS of a new EPS monitoring tool and delivery of an educational session regarding its use. The extent of documentation and monitoring of EPS was re-surveyed post-intervention.

RESULTS

Initially, only 14.8% of inpatient records contained evidence of EPS documentation while no evidence at all was found across the other two MHS settings. Following the intervention, there was evidence of guideline concordant EPS monitoring using a structured tool in the clinical records of 75% of inpatients, 79.6% in the rehabilitation setting, and 18% in the assertive outreach programme.

CONCLUSION

Documentation of EPS monitoring improved significantly across several settings affiliated with a Dublin North City MHS following the systematic adoption of the Extrapyramidal Symptom Scale (EPSS) and clinician education regarding its use.

Process evaluation of a tailored nudge intervention to promote appropriate care and treatment of older patients at the end-of-life

BACKGROUND

Non-beneficial treatment affects a considerable proportion of older people in hospital, and some will choose to decline invasive treatments when they are approaching the end of their life. The Intervention for Appropriate Care and Treatment (InterACT) intervention was a 12-month stepped wedge randomised controlled trial with an embedded process evaluation in three hospitals in Brisbane, Australia. The aim was to increase appropriate care and treatment decisions for older people at the end-of-life, through implementing a nudge intervention in the form of a prospective feedback loop. However, the trial results indicated that the expected practice change did not occur. The process evaluation aimed to assess implementation using the Consolidated Framework for Implementation Research, identify barriers and enablers to implementation and provide insights into the lack of effect of the InterACT intervention.

METHODS

Qualitative data collection involved 38 semi-structured interviews with participating clinicians, members of the executive advisory groups overseeing the intervention at a site level, clinical auditors, and project leads. Online interviews were conducted at two times: implementation onset and completion. Data were coded to the Consolidated Framework for Implementation Research and deductively analysed.

RESULTS

Overall, clinicians felt the premise and clinical reasoning behind InterACT were strong and could improve patient management. However, several prominent barriers affected implementation. These related to the potency of the nudge intervention and its integration into routine clinical practice, clinician beliefs and perceived self-efficacy, and wider contextual factors at the health system level.

CONCLUSIONS

An intervention designed to change clinical practice for patients at or near to end-of-life did not have the intended effect. Future interventions targeting this area of care should consider using multi-component strategies that address the identified barriers to implementation and clinician change of practice.

TRIAL REGISTRATION

Australia New Zealand Clinical Trial Registry (ANZCTR), ACTRN12619000675123p (approved 06/05/2019).

Development of clinically meaningful quality indicators for contemporary lung cancer care, and piloting and evaluation in a retrospective cohort; experiences of the Embedding Research (and Evidence) in Cancer Healthcare (EnRICH) Program

OBJECTIVES

Lung cancer continues to be the most common cause of cancer-related death and the leading cause of morbidity and burden of disease across Australia. There is an ongoing need to identify and reduce unwarranted clinical variation that may contribute to these poor outcomes for patients with lung cancer. An Australian national strategy acknowledges clinical quality outcome data as a critical component of a continuously improving healthcare system but there is a need to ensure clinical quality indicators adequately measure evidence-based contemporary care, including novel and emerging treatments. This study aimed to develop a suite of lung cancer-specific, evidence-based, clinically acceptable quality indicators to measure quality of care and outcomes, and an associated comparative feedback dashboard to provide performance data to clinicians and hospital administrators.

DESIGN

A multistage modified Delphi process was undertaken with a Clinical Advisory Group of multidisciplinary lung cancer specialists, with patient representation, to update and prioritise potential indicators of lung cancer care derived from a targeted review of published literature and reports from national and international lung cancer quality registries. Quality indicators were piloted and evaluated with multidisciplinary teams in a retrospective observational cohort study using clinical audit data from the Embedding Research (and Evidence) in Cancer Healthcare Program, a prospective clinical cohort of over 2000 patients with lung cancer diagnosed from May 2016 to October 2021.

SETTING AND PARTICIPANTS

Six tertiary specialist cancer centres in metropolitan and regional New South Wales, Australia.

RESULTS

From an initial 37 potential quality indicators, a final set of 10 indicators spanning diagnostic, treatment, quality of life and survival domains was agreed.

CONCLUSIONS

These indicators build on and update previously available measures of lung cancer care and outcomes in use by national and international lung cancer clinical quality registries which, to our knowledge, have not been recently updated to reflect the changing lung cancer treatment paradigm.

Exploring important service characteristics of telephone cancer information and support services for callers: protocol for a systematic review of qualitative research

INTRODUCTION

As cancer incidence continues to rise, challenges remain in how to communicate accurate, timely information to people with cancer, their families and healthcare professionals. One option is to provide support and comprehensive, tailored information via a telephone cancer information and support service (CISS). This systematic review aims to summarise the service characteristics of telephone CISS and identify what aspects of services are important from callers' perspectives.

METHODS AND ANALYSIS

A comprehensive literature search will be conducted for articles published from database inception to 30 March 2023 (OVID MEDLINE, EMBASE, CINAHL, PsycINFO and SocINDEX). Published, peer-reviewed, articles reporting qualitative research on the service characteristics of telephone CISS important to callers in any language will be included. One researcher will complete the searches, two researchers will independently screen results for eligible studies and a third researcher will resolve any disagreement. A narrative and thematic synthesis of studies will be provided. Study characteristics will be independently extracted by one researcher and checked by a second. Included studies' methodological quality will be evaluated independently by two researchers using the 2022 Critical Appraisal Skills Programme Qualitative Studies Checklist. Grading of Recommendations Assessment, Development and Evaluation-Confidence in the Evidence from Reviews of Qualitative research tool will assess the confidence of the review findings.

ETHICS AND DISSEMINATION

Ethics approval is not required for this research as it is a planned systematic review of published literature. Findings will be presented at leading cancer, health economic and supportive care conferences, published in a peer-reviewed journal, and disseminated via websites and social media.

PROSPERO REGISTRATION NUMBER

CRD42023413897.

The quality of care delivered to residents in long-term care in Australia: an indicator-based review of resident records (CareTrack Aged study)

BACKGROUND

This study estimated the prevalence of evidence-based care received by a population-based sample of Australian residents in long-term care (LTC) aged ≥ 65 years in 2021, measured by adherence to clinical practice guideline (CPG) recommendations.

METHODS

Sixteen conditions/processes of care amendable to estimating evidence-based care at a population level were identified from prevalence data and CPGs. Candidate recommendations (n = 5609) were extracted from 139 CPGs which were converted to indicators. National experts in each condition rated the indicators via the RAND-UCLA Delphi process. For the 16 conditions, 236 evidence-based care indicators were ratified. A multi-stage sampling of LTC facilities and residents was undertaken. Trained aged-care nurses then undertook manual structured record reviews of care delivered between 1 March and 31 May 2021 (our record review period) to assess adherence with the indicators.

RESULTS

Care received by 294 residents with 27,585 care encounters in 25 LTC facilities was evaluated. Residents received care for one to thirteen separate clinical conditions/processes of care (median = 10, mean = 9.7). Adherence to evidence-based care indicators was estimated at 53.2% (95% CI: 48.6, 57.7) ranging from a high of 81.3% (95% CI: 75.6, 86.3) for Bladder and Bowel to a low of 12.2% (95% CI: 1.6, 36.8) for Depression. Six conditions (skin integrity, end-of-life care, infection, sleep, medication, and depression) had less than 50% adherence with indicators.

CONCLUSIONS

This is the first study of adherence to evidence-based care for people in LTC using multiple conditions and a standardised method. Vulnerable older people are not receiving evidence-based care for many physical problems, nor care to support their mental health nor for end-of-life care. The six conditions in which adherence with indicators was less than 50% could be the focus of improvement efforts.

Audit and feedback to reduce unwarranted clinical variation at scale: a realist study of implementation strategy mechanisms

BACKGROUND

Unwarranted clinical variation in hospital care includes the underuse, overuse, or misuse of services. Audit and feedback is a common strategy to reduce unwarranted variation, but its effectiveness varies widely across contexts. We aimed to identify implementation strategies, mechanisms, and contextual circumstances contributing to the impact of audit and feedback on unwarranted clinical variation.

METHODS

Realist study examining a state-wide value-based healthcare program implemented between 2017 and 2021 in New South Wales, Australia. Three initiatives within the program included audit and feedback to reduce unwarranted variation in inpatient care for different conditions. Multiple data sources were used to formulate the initial audit and feedback program theory: a systematic review, realist review, program document review, and informal discussions with key program stakeholders. Semi-structured interviews were then conducted with 56 participants to refute, refine, or confirm the initial program theories. Data were analysed retroductively using a context-mechanism-outcome framework for 11 transcripts which were coded into the audit and feedback program theory. The program theory was validated with three expert panels: senior health leaders (n = 19), Agency for Clinical Innovation (n = 11), and Ministry of Health (n = 21) staff.

RESULTS

The program's audit and feedback implementation strategy operated through eight mechanistic processes. The strategy worked well when clinicians (1) felt ownership and buy-in, (2) could make sense of the information provided, (3) were motivated by social influence, and (4) accepted responsibility and accountability for proposed changes. The success of the strategy was constrained when the audit process led to (5) rationalising current practice instead of creating a learning opportunity, (6) perceptions of unfairness and concerns about data integrity, 7) development of improvement plans that were not followed, and (8) perceived intrusions on professional autonomy.

CONCLUSIONS

Audit and feedback strategies may help reduce unwarranted clinical variation in care where there is engagement between auditors and local clinicians, meaningful audit indicators, clear improvement plans, and respect for clinical expertise. We contribute theoretical development for audit and feedback by proposing a Model for Audit and Feedback Implementation at Scale. Recommendations include limiting the number of audit indicators, involving clinical staff and local leaders in feedback, and providing opportunities for reflection.

Strength in numbers: Utilization of an innovative electronic audit to enhance the completion of central line maintenance audits

BACKGROUND

Health care systems use auditing processes to monitor compliance with evidence-based practices. The auditing process for a bundle targeting central line-associated bloodstream infection prevention at a large children's hospital was suboptimal. The purpose of this project was to implement a revised audit and feedback data collection process. The specific aims of the project were to evaluate (1) the number of completed audits and, (2) central line maintenance bundle compliance rates before and after implementing a new process.

METHODS

An innovative, electronic audit process was developed to allow data entry in real-time as central line-associated bloodstream infection prevention champions conducted audits. Data were fed into a robust electronic dashboard, allowing units to readily visualize their performance. Data was analyzed over a 52-month period (26 months pre- and post-implementation).

RESULTS

The number of central line maintenance bundle audits significantly increased post-implementation from an average of 36 to 64 per month, P = .001. Central line maintenance bundle compliance scores also increased from an average compliance score of 76.3% to 89.3%, P = .001. Special cause variation was also noted in the statistical process control charts.

DISCUSSION

This project demonstrated the effectiveness of using an electronic process to capture audit data to assist with quality improvement efforts.

CONCLUSIONS

Other institutions may consider implementing a similar electronic audit process to capture infection prevention compliance data.

Care and three-year outcomes of children with Benign Epilepsy with Centro-Temporal Spikes in England

PURPOSE

Benign Epilepsy with Centro-Temporal Spikes (BECTS) is a pediatric epilepsy with typically good seizure control. Although BECTS may increase patients' risk of developing neurological comorbidities, their clinical care and short-term outcomes are poorly quantified.

METHODS

We retrospectively assessed adherence to National Institute for Health and Care Excellence (NICE) guidelines relating to specialist referral, electroencephalogram (EEG) conduct and annual review in the care of patients with BECTS, and measured their seizure, neurodevelopmental and learning outcomes at three years post-diagnosis.

RESULTS

Across ten centers in England, we identified 124 patients (74 male) diagnosed with BECTS between 2015 and 2017. Patients had a mean age at diagnosis of 8.0 (95% CI = 7.6-8.4) years. 24/95 (25%) patients were seen by a specialist within two weeks of presentation; 59/100 (59%) received an EEG within two weeks of request; and 59/114 (52%) were reviewed annually. At three years post-diagnosis, 32/114 (28%) experienced ongoing seizures; 26/114 (23%) had reported poor school progress; 15/114 (13%) were diagnosed with a neurodevelopmental disorder (six autism spectrum disorder, six attention-deficit/hyperactivity disorder); and 10/114 (8.8%) were diagnosed with a learning difficulty (three processing deficit, three dyslexia). Center-level random effects models estimated neurodevelopmental diagnoses in 9% (95% CI: 2-16%) of patients and learning difficulty diagnoses in 7% (95% CI: 2-12%).

CONCLUSIONS

In this multicenter work, we found variable adherence to NICE guidelines in the care of patients with BECTS and identified a notable level of neurological comorbidity. Patients with BECTS may benefit from enhanced cognitive and behavioral assessment and monitoring.