Improving care at scale: process evaluation of a multi-component quality improvement intervention to reduce mortality after emergency abdominal surgery (EPOCH trial)

Hospital-level evaluation of the effect of a national quality improvement programme: time-series analysis of registry data

BACKGROUND AND OBJECTIVES

A clinical trial in 93 National Health Service hospitals evaluated a quality improvement programme for emergency abdominal surgery, designed to improve mortality by improving the patient care pathway. Large variation was observed in implementation approaches, and the main trial result showed no mortality reduction. Our objective therefore was to evaluate whether trial participation led to care pathway implementation and to study the relationship between care pathway implementation and use of six recommended implementation strategies.

METHODS

We performed a hospital-level time-series analysis using data from the Enhanced Peri-Operative Care for High-risk patients trial. Care pathway implementation was defined as achievement of >80% median reliability in 10 measured care processes. Mean monthly process performance was plotted on run charts. Process improvement was defined as an observed run chart signal, using probability-based 'shift' and 'runs' rules. A new median performance level was calculated after an observed signal.

RESULTS

Of 93 participating hospitals, 80 provided sufficient data for analysis, generating 800 process measure charts from 20 305 patient admissions over 27 months. No hospital reliably implemented all 10 processes. Overall, only 279 of the 800 processes were improved (3 (2-5) per hospital) and 14/80 hospitals improved more than six processes. Mortality risk documented (57/80 (71%)), lactate measurement (42/80 (53%)) and cardiac output guided fluid therapy (32/80 (40%)) were most frequently improved. Consultant-led decision making (14/80 (18%)), consultant review before surgery (17/80 (21%)) and time to surgery (14/80 (18%)) were least frequently improved. In hospitals using ≥5 implementation strategies, 9/30 (30%) hospitals improved ≥6 care processes compared with 0/11 hospitals using ≤2 implementation strategies.

CONCLUSION

Only a small number of hospitals improved more than half of the measured care processes, more often when at least five of six implementation strategies were used. In a longer term project, this understanding may have allowed us to adapt the intervention to be effective in more hospitals.

Comprehensive Geriatric Assessment in the perioperative setting; where next?

Comprehensive Geriatric Assessment (CGA) is being employed in the perioperative setting to improve outcomes for older surgical patients. Traditionally CGA is delivered by a geriatrician led multidisciplinary team but with the acknowledged workforce challenges in geriatric medicine, it has been suggested that non-geriatricians may be able to deliver CGA. HOW-CGA developed a toolkit to facilitate the delivery of CGA by non-geriatricians in the perioperative setting. Across two hospital sites uptake and implementation of this toolkit was limited by a potential lack of face validity, behavioural and cultural barriers and an acknowledgement that geriatric medicine expertise is key to CGA and optimisation. In-keeping with this finding there has been an observed expansion in geriatrician led CGA services for older surgical patients in the UK. In order to demonstrate the effectiveness of perioperative CGA services, implementation science should be combined with health services research methodology and the use of big data through linked national audit.

Understanding the influences on successful quality improvement in emergency general surgery: learning from the RCS Chole-QuIC project

BACKGROUND

Acute gallstone disease is the highest volume Emergency General Surgical presentation in the UK. Recent data indicate wide variations in the quality of care provided across the country, with national guidance for care delivery not implemented in most UK hospitals. Against this backdrop, the Royal College of Surgeons of England set up a 13-hospital quality improvement collaborative (Chole-QuIC) to support clinical teams to reduce time to surgery for patients with acute gallstone disease requiring emergency cholecystectomy.

METHODS

Prospective, mixed-methods process evaluation to answer the following: (1) how was the collaborative delivered by the faculty and received, understood and enacted by the participants; (2) what influenced teams' ability to improve care for patients requiring emergency cholecystectomy? We collected and analysed a range of data including field notes, ethnographic observations of meetings, and project documentation. Analysis was based on the framework approach, informed by Normalisation Process Theory, and involved the creation of comparative case studies based on hospital performance during the project.

RESULTS

Chole-QuIC was delivered as planned and was well received and understood by participants. Four hospitals were identified as highly successful, based upon a substantial increase in the number of patients having surgery in line with national guidance. Conversely, four hospitals were identified as challenged, achieving no significant improvement. The comparative analysis indicate that six inter-related influences appeared most associated with improvement: (1) achieving clarity of purpose amongst site leads and key stakeholders; (2) capacity to lead and effective project support; (3) ideas to action; (4) learning from own and others' experience; (5) creating additional capacity to do emergency cholecystectomies; and (6) coordinating/managing the patient pathway.

CONCLUSION

Collaborative-based quality improvement is a viable strategy for emergency surgery but success requires the deployment of effective clinical strategies in conjunction with improvement strategies. In particular, achieving clarity of purpose about proposed changes amongst key stakeholders was a vital precursor to improvement, enabling the creation of additional surgical capacity and new pathways to be implemented effectively. Protected time, testing ideas, and the ability to learn quickly from data and experience were associated with greater impact within this cohort.

Qualitative process evaluation of the Perioperative Quality Improvement Programme (PQIP): study protocol

INTRODUCTION

The Perioperative Quality Improvement Programme (PQIP) is designed to measure complications after major elective surgery and improve these through feedback of data to clinicians. Previous research suggests that despite the significant resources which go into collecting data for national clinical audits, the information they contain is not always used effectively to improve local services.

METHODS AND ANALYSIS

We will conduct a formative process evaluation of PQIP comprising a multisited qualitative study to analyse PQIP's programme theory, barriers, facilitators and wider contextual factors that influence implementation. The research will be carried out with the PQIP project team and six National Health Service (NHS) Trusts in England, selected according to geographical location, type of hospital, size and level of engagement with PQIP. We will include one Trust which has not expressed interest in the PQIP for comparison and to explore the role of secular trend in any changes in practice. We will use semi-structured interviews (up to 144 in Trusts and 12 with the project team), non-participant observations (up to 150  hours) and documentary analysis. We will track the lifecycle of perioperative data, exploring the transformations it undergoes from creation to use. We will use framework analysis with categories both from our research questions and from themes emerging from the data.

ETHICS AND DISSEMINATION

Ethical approval has been granted from the University College London Research Ethics Committee (ref 10375/001). Permissions to conduct research at NHS Trusts have been granted by local Research and Development offices in coordination with the Health Research Authority. We will follow guidelines for data security, confidentiality and information governance. Findings will be shared at regular time points with the PQIP project team to inform the implementation of the programme, and with participating NHS Trusts to help them reflect on how they currently use data for improvement of perioperative services.

Effectiveness of a national quality improvement programme to improve survival after emergency abdominal surgery (EPOCH): a stepped-wedge cluster-randomised trial

BACKGROUND

Emergency abdominal surgery is associated with poor patient outcomes. We studied the effectiveness of a national quality improvement (QI) programme to implement a care pathway to improve survival for these patients.

METHODS

We did a stepped-wedge cluster-randomised trial of patients aged 40 years or older undergoing emergency open major abdominal surgery. Eligible UK National Health Service (NHS) hospitals (those that had an emergency general surgical service, a substantial volume of emergency abdominal surgery cases, and contributed data to the National Emergency Laparotomy Audit) were organised into 15 geographical clusters and commenced the QI programme in a random order, based on a computer-generated random sequence, over an 85-week period with one geographical cluster commencing the intervention every 5 weeks from the second to the 16th time period. Patients were masked to the study group, but it was not possible to mask hospital staff or investigators. The primary outcome measure was mortality within 90 days of surgery. Analyses were done on an intention-to-treat basis. This study is registered with the ISRCTN registry, number ISRCTN80682973.

FINDINGS

Treatment took place between March 3, 2014, and Oct 19, 2015. 22 754 patients were assessed for elegibility. Of 15 873 eligible patients from 93 NHS hospitals, primary outcome data were analysed for 8482 patients in the usual care group and 7374 in the QI group. Eight patients in the usual care group and nine patients in the QI group were not included in the analysis because of missing primary outcome data. The primary outcome of 90-day mortality occurred in 1210 (16%) patients in the QI group compared with 1393 (16%) patients in the usual care group (HR 1·11, 0·96-1·28).

INTERPRETATION

No survival benefit was observed from this QI programme to implement a care pathway for patients undergoing emergency abdominal surgery. Future QI programmes should ensure that teams have both the time and resources needed to improve patient care.

FUNDING

National Institute for Health Research Health Services and Delivery Research Programme.