How to study improvement interventions: a brief overview of possible study types

A graduate medical education (GME) quality improvement curriculum leads to improved knowledge and participation in high quality improvement projects by trainees

BACKGROUND

There is increased awareness about the need for quality improvement (QI) education for trainees within clinical training programs. However, formal integration of a QI curriculum into graduate medical education (GME) remains a work-in-progress. We describe the creation and implementation of a novel, virtual QI curriculum complemented by virtual-based workshops.

OBJECTIVE

To determine the impact of a GME QI curriculum on 1) trainee QI knowledge; 2) Quality of QI projects.

METHODS

The GME Quality Improvement curriculum was transitioned to an optional formal curriculum in 2020. It is led by three faculty with expertise in QI training and education. The team developed four, web-based learning modules that focused on fundamental QI concepts. These modules are completed monthly and are paired with virtual workshops that facilitate applying learned QI concepts to project development. We evaluated the effectiveness of the curriculum by assessing participants' performance on knowledge-based quizzes before and after each online module. We used IBM SPSS (version 28), to conduct a two-sided paired samples t-test, comparing each post-session test scores with their corresponding pre-session scores. The alpha, or statistical threshold significance threshold, was 0.05. Additionally, two independent judges with expertise in QI evaluated the quality of the projects presented at the annual QI showcase using a standardized scoring rubric. The poster evaluation forms included 8 questions, rated on a scale from 1 to 5. Projects were graded into 4 quartiles (poor, fair, good, excellent).

RESULTS

In the knowledge assessment quiz, the difference between the mean pre- and post-session quiz scores was statistically significant (p < 0.01). The average score of the quality of the projects presented at the annual showcase was 31, in the fourth quartile which was graded as "excellent" quality.

CONCLUSION

A GME-led QI curriculum was effective in improving knowledge of QI concepts and producing high-quality scholarly projects.

A feasibility and pilot additive randomised control trial of attachment security priming during behavioural activation

BACKGROUND

There is some initial evidence that attachment security priming may be useful for promoting engagement in therapy and improving clinical outcomes.

AIMS

This study sought to assess whether outcomes for behavioural activation delivered in routine care could be enhanced via the addition of attachment security priming.

METHOD

This was a pragmatic two-arm feasibility and pilot additive randomised control trial. Participants were recruited with depression deemed suitable for a behavioural activation intervention at Step 2 of a Talking Therapies for Anxiety and Depression service. Ten psychological wellbeing practitioners were trained in implementing attachment security priming. Study participants were randomised to either behavioural activation (BA) or BA plus an attachment prime. The diagrammatic prime was integrated into the depression workbook. Feasibility outcomes were training satisfaction, recruitment, willingness to participate and study attrition rates. Pilot outcomes were comparisons of clinical outcomes, attendance, drop-out and stepping-up rates.

RESULTS

All practitioners recruited to the study, and training satisfaction was high. Of the 39 patients that were assessed for eligibility, 24 were randomised (61.53%) and there were no study drop-outs. No significant differences were found between the arms with regards to drop-out, attendance, stepping-up or clinical outcomes.

CONCLUSIONS

Further controlled research regarding the utility of attachment security priming is warranted in larger studies that utilise manipulation checks and monitor intervention adherence.

Changing prescribing practice for rapid tranquillization-a quality improvement project based on the Plan-Do-Study-Act method

PURPOSE

It is unclear how the evidence from clinical trials best translates into complex clinical settings. The aim of this quality improvement (QI) project was to change prescribing practice for rapid tranquillization in inpatient mental health care services examining the effectiveness of the Plan-Do-Study-Act (PDSA) method.

METHODS

A prospective QI project was conducted to ensure that intramuscular (IM) diazepam was substituted with IM lorazepam for benzodiazepine rapid tranquillization in inpatient mental health care. We monitored the prescription and administration of medication for rapid tranquillization before (N = 371), during (N = 1130) and after (N = 364) the QI intervention. Seven iterative PDSA cycles with a multiple-component intervention approach were conducted to gradually turn the prescribing practice in the desired direction. Simultaneously, a standard monitoring regimen was introduced to ensure patient safety.

RESULTS

Lorazepam administrations gradually replaced diazepam during the intervention period which was sustained post-intervention where lorazepam comprised 96% of benzodiazepine administrations for rapid tranquillization. The mean dose of benzodiazepine administered remained stable from pre (14.40 mg diazepam equivalents) to post (14.61 mg) intervention phase. Close to full compliance (> 80%) with vital signs monitoring was achieved by the end of the observation period.

CONCLUSION

It was possible to increase the quality of treatment of acute agitation in a large inpatient mental health care setting using a stepwise approach based on iterative PDSA cycles and continuous data feedback. This approach might be valuable in other prescribing practice scenarios with feedback from local stakeholders and opinion leaders.

Implementation of a comprehensive clinical risk management system in a university hospital

BACKGROUND

Adverse events during hospital treatment are common and can lead to serious harm. This study reports the implementation of a comprehensive clinical risk management system in a university hospital and assesses the impact of clinical risk management on patient harms.

METHODS

The clinical risk management system was rolled out over a period of eight years and consisted of a training of interdisciplinary risk management teams, external and internal risk audits, and the implementation of a critical incident reporting system (CIRS). The risks identified during the audits were analyzed according to the type, severity, and implementation of preventive measures. Other key figures of the risk management system were obtained from the annual risk reports. The number of liability cases was used as primary outcome measurement.

RESULTS

Of the 1,104 risks identified during the risk audits, 56.2% were related to organization, 21.3% to documentation, 15.3% to treatment, and 7.2% to patient information and consent. The highest proportion of serious risks was found in the category organization (22.7%), the lowest in the category documentation (13.6%). Critical incident reporting identified between 241 and 370 critical incidents per year, for which in 79.5% to 83% preventive measures were implemented within twelve months. The frequency of incident reports per department correlated with the number of active risk managers and risk team meetings. Compared with the years prior to the introduction of the clinical risk management system, an average annual reduction of harms by 60.1% (95% CI: 57.1; 63.1) was observed two years after the implementation was completed. On average, the rate of harms dropped by 5% per year for each 10% increase in roll-out of the clinical risk management system (incidence rate ratio: 0.95; 95% CI: 0.93; 0.97) .

CONCLUSION

The results of this project demonstrate the effectiveness of clinical risk management in detecting treatment-related risks and in reducing harm to patients.

What can Safety Cases offer for patient safety? A multisite case study

BACKGROUND

The Safety Case is a regulatory technique that requires organisations to demonstrate to regulators that they have systematically identified hazards in their systems and reduced risks to being as low as reasonably practicable. It is used in several high-risk sectors, but only in a very limited way in healthcare. We examined the first documented attempt to apply the Safety Case methodology to clinical pathways.

METHODS

Data are drawn from a mixed-methods evaluation of the Safer Clinical Systems programme. The development of a Safety Case for a defined clinical pathway was a centrepiece of the programme. We base our analysis on 143 interviews covering all aspects of the programme and on analysis of 13 Safety Cases produced by clinical teams.

RESULTS

The principles behind a proactive, systematic approach to identifying and controlling risk that could be curated in a single document were broadly welcomed by participants, but was not straightforward to deliver. Compiling Safety Cases helped teams to identify safety hazards in clinical pathways, some of which had been previously occluded. However, the work of compiling Safety Cases was demanding of scarce skill and resource. Not all problems identified through proactive methods were tractable to the efforts of front-line staff. Some persistent hazards, originating from institutional and organisational vulnerabilities, appeared also to be out of the scope of control of even the board level of organisations. A particular dilemma for organisational senior leadership was whether to prioritise fixing the risks proactively identified in Safety Cases over other pressing issues, including those that had already resulted in harm.

CONCLUSIONS

The Safety Case approach was recognised by those involved in the Safer Clinical Systems programme as having potential value. However, it is also fraught with challenge, highlighting the limitations of efforts to transfer safety management practices to healthcare from other sectors.

Quality and reporting of large-scale improvement programmes: a review of maternity initiatives in the English NHS, 2010-2023

BACKGROUND

Large-scale improvement programmes are a frequent response to quality and safety problems in health systems globally, but have mixed impact. The extent to which they meet criteria for programme quality, particularly in relation to transparency of reporting and evaluation, is unclear.

AIM

To identify large-scale improvement programmes focused on intrapartum care implemented in English National Health Service maternity services in the period 2010-2023, and to conduct a structured quality assessment.

METHODS

We drew on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidance to inform the design and reporting of our study. We identified relevant programmes using multiple search strategies of grey literature, research databases and other sources. Programmes that met a prespecified definition of improvement programme, that focused on intrapartum care and that had a retrievable evaluation report were subject to structured assessment using selected features of programme quality.

RESULTS

We identified 1434 records via databases and other sources. 14 major initiatives in English maternity services could not be quality assessed due to lack of a retrievable evaluation report. Quality assessment of the 15 improvement programmes meeting our criteria for assessment found highly variable quality and reporting. Programme specification was variable and mostly low quality. Only eight reported the evidence base for their interventions. Description of implementation support was poor and none reported customisation for challenged services. None reported reduction of inequalities as an explicit goal. Only seven made use of explicit patient and public involvement practices, and only six explicitly used published theories/models/frameworks to guide implementation. Programmes varied in their reporting of the planning, scope and design of evaluation, with weak designs evident.

CONCLUSIONS

Poor transparency of reporting and weak or absent evaluation undermine large-scale improvement programmes by limiting learning and accountability. This review indicates important targets for improving quality in large-scale programmes.

Grand rounds in methodology: key considerations for implementing machine learning solutions in quality improvement initiatives

Machine learning (ML) solutions are increasingly entering healthcare. They are complex, sociotechnical systems that include data inputs, ML models, technical infrastructure and human interactions. They have promise for improving care across a wide range of clinical applications but if poorly implemented, they may disrupt clinical workflows, exacerbate inequities in care and harm patients. Many aspects of ML solutions are similar to other digital technologies, which have well-established approaches to implementation. However, ML applications present distinct implementation challenges, given that their predictions are often complex and difficult to understand, they can be influenced by biases in the data sets used to develop them, and their impacts on human behaviour are poorly understood. This manuscript summarises the current state of knowledge about implementing ML solutions in clinical care and offers practical guidance for implementation. We propose three overarching questions for potential users to consider when deploying ML solutions in clinical care: (1) Is a clinical or operational problem likely to be addressed by an ML solution? (2) How can an ML solution be evaluated to determine its readiness for deployment? (3) How can an ML solution be deployed and maintained optimally? The Quality Improvement community has an essential role to play in ensuring that ML solutions are translated into clinical practice safely, effectively, and ethically.

Economic evaluations of adult critical care pharmacy services: a scoping review

OBJECTIVES

To summarise the extent and type of evidence available regarding economic evaluations of adult critical care pharmacy services in the context of UK practice.

METHODS

A literature search was conducted in eight electronic databases and hand searching of full-text reference lists. Of 2409 journal articles initially identified, 38 were included in the final review. Independent literature review was undertaken by two investigators in a two-step process against the inclusion and exclusion criteria; title and abstract screening were followed by full-text screening. Included studies were taken from high-income economy countries that contained economic data evaluating any key aspect of adult critical care pharmacy services. Grey literature and studies that could not be translated into the English language were excluded.

RESULTS

The majority were before-and-after studies (18, 47%) or other observational studies (17, 45%), and conducted in North America (25, 66%). None of the included studies were undertaken in the UK. Seven studies (18%) included cost-benefit analysis; all demonstrated positive cost-benefit values for clinical pharmacist activities.

CONCLUSIONS

Further high-quality primary research focussing on the economic evaluation of UK adult critical care pharmacy services is needed, before undertaking a future systematic review. There is an indication of a cost-benefit value for critical care pharmacist activities. The lack of UK-based economic evaluations is a limitation to further development and standardisation of critical care pharmacy services nationally.

A hidden gem in multidisciplinary antimicrobial stewardship: a systematic review on bedside nurses' activities in daily practice regarding antibiotic use

Background

Antimicrobial stewardship (AMS), the set of actions to ensure antibiotics are used appropriately, is increasingly targeted at all those involved in the antimicrobial pathway, including nurses. Several healthcare organizations have issued position statements on how bedside nurses can be involved in AMS. However, it remains unclear how nurses, in reality, contribute to appropriate antibiotic use.

Objectives

To systematically search the literature to describe the activities bedside nurses perform regarding antibiotic use in daily clinical practice, in relation to the activities proposed by the aforementioned position statements.

Methods

We searched MEDLINE, Embase, CINAHL and grey literature until March 2021. Studies were included if they described activities regarding antibiotic use performed by bedside nurses. Methodological rigour was assessed by applying the Mixed Method Appraisal Tool.

Results

A total of 118 studies were included. The majority of the proposed nurses' activities were found in daily practice, categorized into assessment of clinical status, collection of specimens, management of antimicrobial medication, prompting review and educating patient and relatives. Nurses may take the lead in these clinical processes and are communicators in all aspects of the antimicrobial pathway. Patient advocacy appears to be a strong driver of bedside nurses' activities.

Conclusions

Nurses' activities are already integrated in the day-to-day nursing practice and are grounded in the essence of nursing, being a patient advocate and showing nursing leadership in safeguarding the antimicrobial treatment process. An essential element of the nursing role is communication with other stakeholders in the patient-centred antimicrobial pathway. Educating, engaging and empowering nurses in this already integrated role, could lead to a solid, impactful nursing contribution to AMS.

Comparison of the Quality of Recovery-15 score in patients undergoing oncoplastic breast-conserving surgery under monitored anesthesia care versus general anesthesia: a prospective quality improvement study

PURPOSE

Whether changing the institutional practice from general anesthesia (GA) to monitored anesthesia care (MAC) affects postoperative quality of recovery for oncoplastic breast-conserving surgery (BCS) is currently unknown. We designed this quasi-experimental study to evaluate a quality improvement (QI) initiative instituted in Edmonton, AB, Canada.

METHODS

We chose a prospective controlled cohort study design for this QI study, where patients underwent oncoplastic BCS under MAC in one hospital and BCS under GA at another hospital (control). A total of 125 patients undergoing surgery between May 2021 and February 2022 were enrolled. Exclusion criteria were male sex, total mastectomy, or age under 18. All other patients were included. The primary outcome was the change in Quality of Recovery-15 score at 24 hr compared with a preoperative baseline. Secondary outcomes included intra- and postoperative time profiles, perioperative analgesic and antiemetic use and length of hospital stay. Statistical analysis included a propensity score analysis to account for confounding variables.

RESULTS

Sixty-four patients received GA and 61 MAC. No enrolled patients were lost to follow up but two were excluded secondarily. No patients receiving MAC needed conversion to GA or unplanned airway management. Monitored anesthesia care was associated with superior outcomes for the primary outcome (β/SE[β], 3.31; 99.5% confidence interval, 0.45 to 6.17; P = 0.001) and most secondary outcomes, when accounting for confounding factors.

CONCLUSIONS

A care transformation initiative for patients undergoing oncoplastic BCS under MAC was associated with a higher quality recovery profile and shorter length of stay without any increase in perioperative or postoperative adverse events.

Teamwork and mental workload in postsurgical pediatric patient handovers: Prospective effect evaluation of an improvement intervention for OR-PICU patient transitions

Postsurgical handover of pediatric patients from operating rooms (OR) to pediatric intensive care units (PICU) is a critical step. This transition is susceptible to errors and inefficiencies particularly if poor multidisciplinary teamwork occurs. Despite wide adoption of standardized handover interventions, comprehensive investigations into joint effects for patient care and provider outcomes are scarce. We aimed to improve OR-PICU handovers quality and sought to evaluate the intervention with particular attention to patient care effects and provider outcomes. A prospective, before-after-study design with an interrupted-series and a multi-source, mixed-methods evaluation approach was established. Drawing upon a participative plan-do-study-act approach, a standardized, checklist-based handover process was designed and implemented. For effect assessments, we observed OR-PICU handovers on site (pre implementation: n = 31, post: n = 30), respectively, with standardized expert observation and provider self-report tools (n = 111, n = 110). Setting was a tertiary Pediatric University Hospital. Supplementary qualitative, semi-structured interviews were conducted, and a general inductive content analysis approach was used to identify key facilitators and barriers on implementation. Improvement efforts focused on stepwise implementation of (1) standardized handover process and (2) a checklist for multi-professional OR-PICU handover communication. We observed significant increases in team and patient setup (pre: 79.3%, post: 98.6%, p < .01), enhanced team engagement (pre: 50%, post: 81.7%, p < .01), and comprehensive information transfer by the anesthesia sub-team (pre: 78.6%, post: 87.3%, p < .01). Expert-rated teamwork outcomes were consistently higher, yet self-reported teamwork did not change over time. Provider perceived stress and disruptions did not change, mental workload tended to decrease over time (pre: M = 3.2, post: 2.9, p = .08). Comprehensiveness of post-operative patient information reported by PICU physician increased significantly: pre: 65.9%, post: 76.2%, p < .05. After implementation, providers acknowledged the importance of standardized handover practices and associated benefits for facilitation of information transfer and comprehensiveness. Among reported barriers were obstacles during implementation as well as insufficient consideration of professionals' individual workflow after surgery.

CONCLUSION

 A multidisciplinary intervention for postsurgical pediatric patient handovers was associated with improved expert-rated teamwork and fewer omissions of key patient information over time. Inconsistent results were obtained for provider-rated mental workload and teamwork outcomes. The findings contribute to a better understanding concerning the interplay of teamwork and provider cognitions in the course of establishing safe patient transitions in pediatric care.

WHAT IS KNOWN

• Transfer of critically ill children conveys significant challenges for interprofessional communication and teamwork. Prospective research into interventions for safe and efficient handover practices of OR PICU patient transitions is necessary. • Checklists are assumed to facilitate cognitive load among providers in acute clinical environments.

WHAT IS NEW

• A standardized, checklist-based handover intervention was associated with improvements in team set-up and information transfer. Provider outcomes such as mental workload and stress did not change over time. • The combination of teamwork and provider assessments allows a more nuanced understanding of implementation barriers and sustainable effects in course of OR-PICU handover interventions.

How is return on investment from quality improvement programmes conceptualised by mental healthcare leaders and why: a qualitative study

BACKGROUND

Return on Investment (ROI), whereby the ratio of costs to benefits is assessed, is encouraged in-order to justify the value of Quality Improvement (QI) programmes. We previously performed a literature review to develop a ROI conceptual framework for QI programmes. We concluded that, QI-ROI is conceptualised as any monetary and non-monetary benefit. In the current study, we explored if this finding is shared by mental healthcare leaders. We also investigated the stability of this conceptualisation against influencing factors and potential for disinvestment.

METHODS

We performed qualitative interviews with leaders in an NHS mental health organisation. There were 16 participants: nine board members and seven senior leaders. The interviews were held online via Microsoft Teams and lasted an hour on average. We performed deductive-inductive analysis to seek data from our initial ROI framework and any new data.

RESULTS

We found that in mental healthcare, QI-ROI is also conceptualised as any valued monetary and non-monetary benefits. There was a strong emphasis on benefits to external partners and a de-emphasis of benefit monetisation. This conceptualisation was influenced by the 1) perceived mandates to improve quality and manage scarce resources, 2) expectations from QI, 3) health and social care values, 4) ambiguity over expectations, and 5) uncertainty over outcomes. Uncertainty, ambiguity, and potential for disinvestment posed a threat to the stability of this conceptualisation but did not ultimately change it. Health and social care values supported maintaining the QI-ROI as any benefit, with a focus on patients and staff outcomes. Socio-political desires to improve quality were strong drivers for QI investment.

CONCLUSION

Mental healthcare leaders primarily conceptualise QI-ROI as any valued benefit. The inclusion of externalised outcomes which are hard to attribute may be challenging. However, mental healthcare services do collaborate with external partners. The de-emphases of benefit monetisation may also be controversial due to the need for financial accountability. Mental healthcare leaders recognise the importance of efficiency savings. However, they raised concerns over the legitimacy and utility of traditional ROI as a tool for assessing QI value. Further research is needed to bring more clarity on these aspects of the QI-ROI concept.

Unpacking the 'process of sustaining'-identifying threats to sustainability and the strategies used to address them: a longitudinal multiple case study

BACKGROUND

Although sustainability remains a recognised challenge for Quality Improvement (QI) initiatives, most available research continues to investigate sustainability at the end of implementation. As a result, the learning and continuous adjustments that shape sustainability outcomes are lost. With little understanding of the actions and processes that influence sustainability within QI initiatives, there is limited practical guidance and direction on how to enhance the sustainability of QI initiatives. This study aims to unpack the 'process of sustaining', by exploring threats to sustainability encountered throughout the implementation of QI Initiatives and identifying strategies used by QI teams to address these threats over time.

METHODS

A longitudinal multiple case study design was employed to follow 4 QI initiatives over a 3-year period. A standardised sustainability tool was used quarterly to collect perceptions of sustainability threats and actions throughout implementation. Interviews (n=38), observations (32.5 h), documentary analysis, and a focus group (n=10) were conducted to enable a greater understanding of how the process of sustaining is supported in practice. Data were analysed using the Consolidated Framework for Sustainability (CFS) to conduct thematic analysis.

RESULTS

Analysis identified five common threats to sustainability: workforce stability, improvement timelines, organisational priorities, capacity for improvement, and stakeholder support. Each of these threats impacted multiple sustainability constructs demonstrating the complexity of the issues encountered. In response to threats, 12 strategies to support the process of sustaining were identified under three themes: engagement (five strategies that promoted the development of relationships), integration (three strategies that supported initiatives to become embedded within local systems), and adaptation (four strategies that enhanced understanding of, and response to, emergent conditions and contextual needs).

CONCLUSIONS

Sustaining improvements from QI initiatives requires continuous investment in relationships, resilience to integrate improvements in local systems, and flexibility to understand emergent conditions. Findings provide practitioners, funders, and researchers with a better understanding of, and preparation for, the threats associated with sustaining improvements from QI initiatives and offer insight into specific actions that can be taken to mitigate these risks. This learning can be used to inform future initiative design and support, to optimise the sustainability of healthcare improvements.

TRIAL REGISTRATION

Not applicable.

Exploring quality improvement for diabetes care in First Nations communities in Canada: a multiple case study

BACKGROUND

Indigenous peoples in Canada experience higher rates of diabetes and worse outcomes than non-Indigenous populations in Canada. Strategies are needed to address underlying health inequities and improve access to quality diabetes care. As part of the national FORGE AHEAD Research Program, this study explores two primary healthcare teams' quality improvement (QI) process of developing and implementing strategies to improve the quality of diabetes care in First Nations communities in Canada.

METHODS

This study utilized a community-based participatory and qualitative case study methodology. Multiple qualitative data sources were analyzed to understand: (1) how knowledge and information was used to inform the teams' QI process; (2) how the process was influenced by the context of primary care services within communities; and (3) the factors that supported or hindered their QI process.

RESULTS

The findings of this study demonstrate how teams drew upon multiple sources of knowledge and information to inform their QI work, the importance of strengthening relationships and building relationships with the community, the influence of organizational support and capacity, and the key factors that facilitated QI efforts.

CONCLUSIONS

This study contributes to the ongoing calls for research in understanding the process and factors affecting the implementation of QI strategies, particularly within Indigenous communities. The knowledge generated may help inform community action and the future development, implementation and scale-up of QI programs in Indigenous communities in Canada and globally.

The effects of revised peer-counselor support on the PMTCT cascade of care: results from a cluster-randomized trial in Kenya (the EMMA study)

BACKGROUND

This study evaluated the effect of revisions to existing peer-counselor services, called Mentor Mothers (MM), at maternal and child health clinics on medication adherence for women living with HIV (WLWH) in Kenya and on early infant HIV testing.

METHODS

The Enhanced Mentor Mother Program study was a 12-site, two-arm cluster-randomized trial enrolling pregnant WLWH from March 2017 to June 2018 (with data collection through September 2020). Six clinics were randomized to continued MM-supported standard care (SC). Six clinics were randomized to the intervention arm (INT = SC plus revised MM services to include more one-on-one interactions). Primary outcomes for mothers were defined as: (PO1) the proportion of days covered (PDC) with antiretroviral therapy (ART) ≥ 0.90 during the last 24-weeks of pregnancy; and (PO2) ≥ 0.90 PDC during the first 24-weeks postpartum. Secondary outcomes were infant HIV testing according to national guidelines (at 6, 24, and 48 weeks). Crude and adjusted risk differences between study arms are reported.

RESULTS

We enrolled 363 pregnant WLHV. After excluding known transfers and subjects with incomplete data extraction, data were analyzed for 309 WLWH (151 SC, 158 INT). A small share achieved high PDC during the prenatal and postnatal periods (0.33 SC/0.24 INT achieved PO1; 0.30 SC/0.31 INT achieved PO2; crude or adjusted risk differences were not statistically significant). In addition, ~ 75% in both study arms completed viral load testing during year two after enrollment, with > 90% suppressed in both arms. For infants, ≥ 90% in both arms had at least one HIV test through study follow up (76 weeks) but testing on schedule according to PMTCT guidelines was uncommon.

CONCLUSIONS

While national guidelines in Kenya recommended that all HIV-infected pregnant women take a daily antiretroviral regimen for life following a HIV diagnosis, results presented here indicate that a minor share achieved high medication coverage during the prenatal and postnatal periods analyzed. In addition, adjustments to Mentor-Mother services showed no improvement in study outcomes. The lack of effect for this behavioral intervention is relatively consistent with the existing literature to improve mother-infant outcomes along the PMTCT care cascade.

CLINICAL TRIAL NUMBER

NCT02848235. Date of first trial registration 28/07/2016.

Programme responses for men who perpetrate intimate partner violence in the context of alcohol or other drugs: a scoping review

Purpose

Substance use plays a significant role in the perpetration of much intimate partner violence (IPV). However, responses to these two issues are rarely integrated. Single focus programme responses can lead to poor outcomes for men as well as their families experiencing these intersecting issues. This scoping paper aims to establish the current state of knowledge on contextual factors influencing the development and implementation of combined programmes.

Design/methodology/approach

Four electronic databases were systematically searched in May 2021 and December 2021. Twenty-one peer-reviewed studies reporting on ten programmes were included.

Findings

This scoping review revealed that combined programme responses are an underdeveloped area of research and evaluation. The limited evidence base indicated systemic barriers hindering services’ capacity to expand this field of work, affecting implementation and outcomes. Support is required from the wider service systems to intervene in men’s perpetration of IPV in the context of substance use.

Practical implications

Findings in this scoping review demonstrate the importance of fostering a coordinated and collective response to IPV in the context of substance use. Combined programmes have the potential to reduce siloed practices, enabling more holistic responses for men with intersecting issues. However, researchers and policymakers must also address contextual issues hindering or enabling combined programmes’ implementation and development.

Originality/value

Mapping the evidence based on combined programmes provides direction for further development and research to expand this field of inquiry.

Grand rounds in methodology: four critical decision points in statistical process control evaluations of quality improvement initiatives

Quality improvement (QI) projects often employ statistical process control (SPC) charts to monitor process or outcome measures as part of ongoing feedback, to inform successive Plan-Do-Study-Act cycles and refine the intervention (formative evaluation). SPC charts can also be used to draw inferences on effectiveness and generalisability of improvement efforts (summative evaluation), but only if appropriately designed and meeting specific methodological requirements for generalisability. Inadequate design decreases the validity of results, which not only reduces the chance of publication but could also result in patient harm and wasted resources if incorrect conclusions are drawn. This paper aims to bring together much of what has been written in various tutorials, to suggest a process for using SPC in QI projects. We highlight four critical decision points that are often missed, how these are inter-related and how they affect the inferences that can be drawn regarding effectiveness of the intervention: (1) the need for a stable baseline to enable drawing inferences on effectiveness; (2) choice of outcome measures to assess effectiveness, safety and intervention fidelity; (3) design features to improve the quality of QI projects; (4) choice of SPC analysis aligned with the type of outcome, and reporting on the potential influence of other interventions or secular trends.These decision points should be explicitly reported for readers to interpret and judge the results, and can be seen as supplementing the Standards for Quality Improvement Reporting Excellence guidelines. Thinking in advance about both formative and summative evaluation will inform more deliberate choices and strengthen the evidence produced by QI projects.

Service redesign interventions to reduce waiting time for paediatric rehabilitation and therapy services: A systematic review of the literature

Despite well-documented benefits of rehabilitation and therapy services for children with disabilities, long waiting lists to access these services are common. There is a growing body of evidence, primarily from mixed or adult services, demonstrating that waiting times can be reduced through strategies that target wasteful processes and support services to keep up with demand. However, providers of rehabilitation and therapy services for children face additional complexities related to the long-term nature of many developmental conditions and the need to consider timing of interventions with developmental milestones and education transition points. This review aimed to synthesise available evidence on service redesign strategies in reducing waiting time for paediatric therapy services. We conducted a systematic review of studies conducted in outpatient paediatric rehabilitation or therapy settings, including physical and mental health services, evaluating a service redesign intervention and presenting comparative data on time to access care. Two reviewers independently applied inclusion criteria, assessed risk of bias and extracted data. Findings were analysed descriptively and the certainty of evidence was synthesised according to criteria for health service research. From 1934 studies identified, 33 met the criteria for inclusion. Interventions were categorised as rapid response strategies, process efficiency interventions or substitution strategies (using alternative providers in place of medical specialists). Reductions in waiting time were reported in 30 studies. Evidence is limited by study designs with high risk of bias, but this is mitigated by consistency of findings and large effect sizes. There is moderate-certainty evidence that service redesign strategies similar to those used in adult populations can be applied in paediatric rehabilitation and therapy settings to reduce waiting time.

AWHONN postpartum discharge education: patient knowledge and sustainability

Objective

The objective is to evaluate whether the implementation of the Association of Women’s Health, Obstetric and Neonatal Nurses (AWHONN) postpartum discharge educational initiative is associated with improved patient knowledge of warning signs of severe maternal morbidity (SMM) and if the initiative is self-sustaining.

Design

A pre–post design was used to evaluate patient knowledge of warning signs of SMM (Plan–Do–Study–Act, PDSA cycle 1) and if the quality improvement initiative was self-sustaining (PDSA cycle 2). Patient understanding of warning signs of SMM prior to initiation of the AWHONN education (Usual Discharge) was compared with understanding of those who were discharged after implementation (POST-BIRTH discharge). The initiative was designed to be self-sustaining. The POST-BIRTH flyer describes nine warning signs of SMM. Eligible participants were English-speaking patients discharged with a live newborn who were able to be contacted within 2 weeks. Participants completed a telephone administered nine-item survey to assess knowledge of SMM. The primary outcome was the percentage of correct answers. To evaluate sustainability, whether the POST-BIRTH fliers and discharge checklist were still being used at 19 months postinitiative was planned.

Results

For PDSA cycle 1, in the Usual Discharge group, 347 patients were discharged, 164 (44.7%) were eligible and 151 (92.1%) completed the survey. In the POST-BIRTH discharge group, 268 patients were discharged, 199 (74.3%) were eligible and 183 (92.0%) completed the survey. Compared with the Usual Discharge group, the POST-BIRTH group had significantly more correct responses (30% vs 60%, p<0.001). In PDSA cycle 2, POST-BIRTH flyers were still being used universally on one of the two floors from which postpartum patients are discharged, but not the other.

Conclusion

The implementation of an educational initiative for postpartum patients is associated with improved knowledge of warning signs of SMM. The use of the education was self-sustaining on one discharge floor but not the other.

A cross-sector systematic review and synthesis of knowledge on telemedicine interventions in chronic wound management-Implications from a system perspective

Based on initially identified needs for further telemedicine (TM) and chronic wound management research, the objective of this article is twofold: to conduct a systematic review of existing knowledge on TM interventions in chronic wound management-including barriers and opportunities-across the specialist and primary care sectors, and to incorporate the review findings into a system framework that can be further developed and validated through empirical data. We conclude that there is a pressing need for broader and more comprehensive empirical explorations into quality improvement and integration of TM in chronic wound management, including using system frameworks that can capture cross-sector system perspectives and associated implications. Of practical consideration, we suggest that the design and execution of TM improvement interventions and associated research projects should be conducted in close cooperation with managers and practitioners knowledgeable about barriers and opportunities that can influence the implementation of important interventions within chronic wound management.

The use of patient experience feedback in rehabilitation quality improvement and codesign activities: Scoping review of the literature

Objective

To characterize the literature, reported enablers, and gaps on the use of patient experience feedback for person-centered rehabilitation quality improvement and codesign activities.

Design

Scoping Review.

Data sources

Scientific databases (PubMed, CINAHL, Rehabdata, Scopus, Web of Science, ProQuest), website searches (e.g. Beryl Institute), snowballing, and key-informant recommendations.

Methods

Two independent reviewers performed title and abstract screenings and full-text reviews. Eligibility focused on English-language, peer-reviewed (all time) and gray literature (last five years) that used patient experience feedback in rehabilitation improvement activities. The aims, settings, methods, findings, implications, and reported limitations were extracted, followed by content analyses identifying reported enablers and gaps.

Results

Among the 901 unique references and 52 full texts reviewed, ten were included: four used patient experience surveys for improving patient experiences; six used codesign methodologies to engage patient feedback in service improvement activities. Implementation enablers included securing managerial support, having a structured methodology and facilitator, using efficient processes, engaging staff experiences, and using appreciative inquiry. Reported study gaps included limited follow-up, low sample sizes, analytical limitations, lack of reported limitations, or narrow range of perspectives (e.g. not from people with severe impairments).

Conclusion

Few examples of the use of patient experience feedback in quality improvement or codesign activities were found in the rehabilitation literature. Patient experience improvement activities relied exclusively on retrospective survey data, which were not combined with often more actionable forms (e.g. qualitative, real time) of patient experience feedback. Further research might consider design of activities that collect and use patient experience feedback for rehabilitation service improvements.

Methodologic attributes of quality improvement studies in neonatology: a systematic survey

Introduction

Quality improvement (QI) is a growing field of inquiry in healthcare, including neonatology. However, there is limited information on the study setting, and the methodologic approaches used to develop, implement and evaluate QI interventions in neonatology studies. In this study, we describe these intervention characteristics and approaches.

Methods

Articles were taken from a previous publication. There, we searched MEDLINE for publications of QI studies from 2016 to 16 April 2020. We retrieved all relevant full-text publications and sampled 100 of these articles for data abstraction, stratified by the year of publication. For each QI study, we described several methodological characteristics that included: the clinical topic of QI, setting, whether the study was multicentre, stakeholder engagement, root cause analysis and related problem identification methods, implementation techniques for QI interventions, types of outcomes and statistical analysis methods used.

Results

We assessed 100 studies; most were conducted in the USA (56%). Academic settings and multicentre settings comprised 44% and 24% of studies, respectively. Most studies reported stakeholder engagement (81%), but infrequently reported engagement with leadership (32%) and caregivers (10%). Frequently used techniques for implementing interventions include provider education (82%), formal QI methods (42%) and audit, feedback and benchmarking (40%). Both patient-important clinical outcomes (78%) and process outcomes (89%) were frequently reported. P values were frequently reported (80%), but other statistical techniques were infrequently used.

Conclusion

QI studies in neonatology use diverse multicomponent interventions. Reporting of these methodologic details can be useful in designing, implementing and evaluating QI studies in clinical practice.

The Implementation of Improvement Interventions for "Low Performing" and "High Performing" Organisations in Health, Education and Local Government: A Phased Literature Review

BACKGROUND

There is limited understanding about whether and how improvement interventions are effective in supporting failing healthcare organisations and improving the quality of care in high-performing organisations. The aim of this review was to examine the underlying concepts guiding the design of interventions aimed at low and high performing healthcare organisations, processes of implementation, unintended consequences, and their impact on costs and quality of care. The review includes articles in the healthcare sector and other sectors such as education and local government.

METHODS

We carried out a phased rapid systematic review of the literature. Phase one was used to develop a theoretical framework of organisational failure and turnaround, and the types of interventions implemented to improve quality. The framework was used to inform phase 2, which was targeted and focused on organisational failure and turnaround in healthcare, education and local government settings. We used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement to guide the reporting of the methods and findings and the Mixed Methods Appraisal Tool (MMAT) as a quality assessment tool. The review protocol was registered with PROSPERO (CRD: 42019131024).

RESULTS

Failure is frequently defined as the inability of organisations to meet pre-established performance standards and turnaround as a linear process. Improvement interventions are designed accordingly and are focused on the organisation, with limited system-level thinking. Successful interventions included restructuring senior leadership teams, inspections, and organisational restructuring by external organisations. Limited attention was paid to the potential negative consequences of the interventions and their costs.

CONCLUSION

Dominant definitions of success/failure and turnaround have led to the reduced scope of improvement interventions, the linear perception of turnaround, and lack of consideration of organisations within the wider system in which they operate. Future areas of research include an analysis of the costs of delivering these interventions in relation to their impact on quality of care.

Using a Plastic Drape to Reduce Hypothermia in Premature Neonates During Peripherally Inserted Central Catheter Placement

BACKGROUND

Premature neonates require assisted heating devices for thermoregulation in the neonatal intensive care unit (NICU). Traditional use of a cloth blanket and cloth towels during peripherally inserted central catheter (PICC) placement may hinder heat transfer from the assisted heating mechanisms, increasing the risk for neonatal hypothermia.

PURPOSE

This quality improvement project's goal was to reduce the hypothermia rate in very low birth-weight (VLBW) neonates by replacing cloth blanket/towels with a plastic drape during PICC placement.

METHODS

The FOCUS-PDSA method was used to implement the intervention (plastic drape) over 3 months, during 58 PICC procedures in a level 3 NICU. A pre-/posttest design was used to evaluate the impact of the intervention on hypothermia rates compared with a baseline cloth group and a concurrent cloth cohort.

RESULTS

After the 3-month implementation period, the hypothermia rate for the intervention group was lower than that for the baseline cloth group (5.2% and 11.3%, respectively), but this difference was not statistically significant. Post-PICC hypothermia rates were significantly lower for the intervention group than for the concurrent cloth cohort (P = .004).

IMPLICATIONS FOR PRACTICE

Preliminary evidence demonstrated the plastic drape reduced the hypothermia rate in the NICU for VLBW neonates during PICC placement compared with cloth blanket/towels. A plastic drape shows promise in improving nursing practice by providing improved thermoregulation for premature neonates during PICC placement.

IMPLICATIONS FOR RESEARCH

Further research is recommended to replicate findings with larger samples of PICC insertions, using a plastic drape in the operating room and other NICU procedures.

Between-hospital variations in 3-year survival among patients with newly diagnosed gastric, colorectal, and lung cancer

Due to increases in cancer survivability, quality assessments of cancer care must include long-term outcomes. This multicenter retrospective cohort study evaluated between-hospital variations in the 3-year survival rates of patients with gastric, colorectal, and lung cancer irrespective of treatment modality. We linked cancer registry data and administrative data from patients aged 18–99 years who were diagnosed with gastric, colorectal, or lung cancer between 2013 and 2015 in Osaka Prefecture, Japan. The 3-year survival rates were adjusted for potential prognostic factors using multilevel logistic regression models. Between-hospital variations were visually evaluated using funnel plots. We analyzed 10,296 gastric cancer patients from 30 hospitals, 9276 colorectal cancer patients from 30 hospitals, and 7978 lung cancer patients from 28 hospitals. The 3-year survival rate was 70.2%, 75.2%, and 45.0% for gastric, colorectal, and lung cancer, respectively. In the funnel plots, the adjusted survival rates of gastric and colorectal cancer for all hospitals lay between the lower and upper control limits of two standard deviations of the average survival rates. However, the adjusted survival rates of lung cancer for four hospitals lay below the lower limit while that for two hospitals lay above the upper limit. Older age, men, advanced cancer stage, comorbidities, functional disability, emergency admission, current/ex-smokers, and underweight were independently associated with poorer survival. In conclusion, there were between-hospital variations in 3-year survival for lung cancer even after adjusting for case mix. Quality improvement initiatives may be needed to raise the consistency of care.

Scale-up of ABC care bundle for intracerebral haemorrhage across two hyperacute stroke units in one region in England: a mixed methods evaluation of a quality improvement project

Background

Intracerebral haemorrhage (ICH) accounts for 10%–15% of strokes in the UK, but is responsible for half of all annual global stroke deaths. The ABC bundle for ICH was developed and implemented at Salford Royal Hospital, and was associated with a 44% reduction in 30-day case fatality. Implementation of the bundle was scaled out to the other hyperacute stroke units (HASUs) in the region from April 2017. A mixed methods evaluation was conducted alongside to investigate factors influencing implementation of the bundle across new settings, in order to provide lessons for future spread.

Methods

A harmonised quality improvement registry at each HASU captured consecutive patients with spontaneous ICH from October 2016 to March 2018 to capture process and outcome measures for preimplementation (October 2016 to March 2017) and implementation (April 2017 to March 2018) time periods. Statistical analyses were performed to determine differences in process measures and outcomes before and during implementation. Multiple qualitative methods (interviews, non-participant observation and project document analysis) captured how the bundle was implemented across the HASUs.

Results

HASU1 significantly reduced median anticoagulant reversal door-to-needle time from 132 min (IQR: 117–342) preimplementation to 76 min (64–113.5) after implementation and intensive blood pressure lowering door to target time from 345 min (204–866) preimplementation to 84 min (60–117) after implementation. No statistically significant improvements in process targets were observed at HASU2. No significant change was seen in 30-day mortality at either HASU. Qualitative evaluation identified the importance of facilitation during implementation and identified how contextual changes over time impacted on implementation. This identified the need for continued implementation support.

Conclusion

The findings show how the ABC bundle can be successfully implemented into new settings and how challenges can impede implementation. Findings have been used to develop an implementation strategy to support future roll out of the bundle outside the region.

Home Visiting as an Equitable Intervention for Perinatal Depression: A Scoping Review

Objective

Maternal mental health disorders are a leading complication of childbirth. While few systems are adequately able to identify and treat depression, people experiencing perinatal depression may benefit from the intervention of home visiting. The intent of home visiting interventions is to alleviate stressors of parenthood for people facing additional risk factors. The aim of this scoping review is to investigate the effect of home visiting on perinatal depression grounded in published studies.

Methods

We conducted a scoping review of the existing literature of studies relevant to perinatal depression and home visiting. We entered keywords in five search databases: MEDLINE, PsycInfo, CINAHL, Social Work Abstracts, and Google Scholar. All relevant literature published between January 1999-December 2019 was reviewed. Duplicates, books, and errata were excluded from the study. As a scoping review, we included all studies published in English describing the inclusion of maternal depression in home visits. We hypothesize birthing people with perinatal depression will benefit from home visiting interventions.

Results

The results from the scoping review and describe the use of home visiting to improve perinatal mental health. An initial 12,652 records were identified in the search. After duplicates were removed, the titles of 2,140 articles were assessed for applicability, however 29 identified for full-text eligibility and were included in this analysis. The majority of the studies included in this review were quantitative (n = 23), followed by qualitative (n = 3), and mixed methods (n = 3). Nearly all studies (n = 28) using validated instruments such as the Edinburgh Postnatal Depression Scale to determine depressive symptoms.

Discussion

This review offers preliminary qualitative insights on the efficacy of home visiting for administrating perinatal depression care. Studies show that home visiting programs can provide treatment for perinatal depression and reduce the effects of depression for birthing people. Our review suggests that the efficacy of home visiting programs beginning in the postpartum period are less predictable than prenatal home visiting intervention among various populations, including people experiencing both high-risk and low-risk situations.

What Should Be the Topics of a Prospective Study on Ovarian Masses in Children?—Results of a Multicenter Retrospective Study and a Scoping Literature Review

Purpose: to determine management problems of ovarian masses in girls in order to form a baseline for prospective randomized studies of the established topics and quality improvement of our management. Materials and Methods: We performed a national analysis of clinical aspects of ovarian masses in girls operated on in Poland, analyzed retrospectively medical files of all consecutive patients aged 0–18 who underwent surgeries for ovarian lesions between 2012 and 2017 at 17 pediatric surgical departments and complemented the analysis with a scoping review of a recent primary research related to ovarian masses in children. Results: The study group comprised 595 patients. Forty-four (7.39%) girls were diagnosed with malignant tumors. The overall preservation rate was 64.54%. The analysis revealed that positive tumor markers (OR = 10.3), lesions larger than 6 cm (OR = 4.17) and solid mass on ultrasound examination (OR = 5.34) are interdependent variables differentiating malignant tumors from non-malignant lesions (X42 = 79.1; p = 0.00000). Our scoping review revealed 10 major branches of research within the topic of ovarian masses in pediatric population. Conclusions: We have developed an overview of the field with the emphasis on the local environment. Our next step is a multi-institutional prospective study of a quality improvement project implementation based on the obtained knowledge.

Two sides of the same coin: Quality improvement and program evaluation in health professions education

Health professions education is in constant pursuit of new ways of teaching and assessment in order to improve the training of healthcare professionals. Educators are often challenged with designing, implementing, and evaluating programs in the context of their professional practice, particularly those in response to dynamic and emerging social needs. This article explores the synergies and intersections of two approaches-quality improvement and program evaluation-and the potential utility of their combinations within our field to design, evaluate, and most importantly, improve educational programming. We argue that the inclusion of established quality improvement frameworks within program evaluation provides a proven mechanism for driving change, can optimize programming within the multi-contextual education systems, and, ultimately, that these two approaches are complementary to one another. These combinations hold great promise for optimizing programming in alignment with social missions, where it has been difficult for institutions worldwide to generate and capture evidence of social accountability.

The Use of Lean Six Sigma Methodology in the Reduction of Patient Length of Stay Following Anterior Cruciate Ligament Reconstruction Surgery

Background: The purpose of this study was to reduce the length of stay of anterior cruciate ligament reconstruction patients within a private hospital in Ireland, reducing any non-value-added activity in the patient pathway, with the goal of increasing patient flow, bed capacity, and revenue generation within the hospital system, while maintaining patient satisfaction. Methods: We used a pre-/post-intervention design and Lean Six Sigma methods and tools to assess and improve the current process. Results: A reduction in inpatient length of stay by 57%, and a reduction in identified non-value-added activity by 88%, resulted in a new day-case surgery pathway for anterior cruciate ligament reconstruction patients. The pathway evidenced no re-admissions and demonstrated patient satisfaction. Conclusion: Six months post-project commencement, we had successfully achieved our goals of reducing our anterior cruciate ligament reconstruction patient's length of stay. This study contributes to the growing body of published evidence which shows that adopting a Lean Six Sigma approach can be successfully employed to optimise care and surgical pathways in healthcare.

Improvements in Patient Safety Structures and Culture following Implementation of a National Public Program: An Observational Study in Three Brazilian Hospitals

<b><i>Objective:</i></b> The aim of this study was to observe and describe the changes in the structures for patient safety (PS) and PS culture (PSC) at the level of health facilities, following the implementation of the National Patient Safety Program (NPSP). <b><i>Methods:</i></b> An observational, longitudinal, and descriptive study including follow-up of changes in structure and activities for PS and assessments of PSC before and 15 months after the NPSP enforcement. Three Brazilian hospitals with different management logistics participated in the study (federal public, state public, and private). PSC was measured using the AHRQ’s instrument, adapted and validated for the Brazilian context (Hospital Survey on Patient Safety Culture [HSOPSC]). Changes in structure and activities to improve PS were mapped against the NPSP objectives. Changes in PSC were assessed by the hospital and discussed considering a change theory based on the literature. <b><i>Results:</i></b> Structural changes occurred in all hospitals but at a different pace and extension. A PS unit, adoption of some PS protocols, and training on PS occurred in the three hospitals. PSC significantly improved in all facilities. Public hospitals had the worst baseline PSC but showed greater improvements. The state hospital presented few structural changes and soon had the lowest ratings of PSC. <b><i>Conclusions:</i></b> This study demonstrates that external regulatory initiatives can trigger, even if unevenly, actions promoting PS and relevant internal structural changes, which in turn seem to increase awareness and improvement in PSC.

Written communication about the use of medications in medical records in a Brazilian hospital

BACKGROUND

Effective communication regarding the use of medications in hospital environments is a process that contributes to patient safety. Despite its importance, written communication about the medication use process in medical records remains insufficiently investigated.

AIM

To describe the documentation in medical records regarding the medication use process by pharmacists, physicians and nurses on admission, during the hospital stay, and at hospital discharge.

METHOD

A retrospective cross-sectional chart review study was carried out in medical records of patients admitted to a teaching hospital in Northeast Brazil. The study considered all patients admitted between December 2016 and February 2017, aged 18 or older and hospitalised for at least 48 hours. Clinical notes made by pharmacists, physicians and nurses were examined at three transition points of care. Data were collected using a questionnaire relating to the use of medications prior to hospital admission, changes in the prescribed medications during the hospital stay and discharge, as well as prescription non-conformities. Communication failures between the three healthcare professional groups were analysed and classified. The study was authorised by the Hospital's Board of Directors and approved by the Research Ethics Committee of the Federal University of Sergipe.

RESULTS

This study included 202 medical records of patients with a mean age of 51.48 (SD 6.42, range: 19-97) years. There was no record of a patient or relative interview on allergies and adverse drug reactions in 54 (26.8%) physician notes, 44 (21.9%) nursing notes, and 9 (25.0%) pharmacist notes. Moreover, 1,588 changes in prescriptions were identified during data collection, and 1,198 (75.4%) of these were unjustified.

CONCLUSION

Medication-related information in medical records was incomplete and inconsistent in the clinical notes of the three studied professions, especially in pharmacists' documentation. Future studies should focus on investigating the consequences of interprofessional communication in patient care.

Palliative Care Clinical Trials: Building Capability and Capacity

Clinical trials are a key component of expanding the evidence base in palliative care. A key strategic objective of the Victorian Comprehensive Cancer Centre (VCCC), a multisite cancer center alliance, was to increase palliative care clinical trial expertise. The palliative care services within the VCCC alliance presented substantial trial development opportunities with large number of patients and established relationships, but few trial-active centers. Objectives: To establish a multi-site "Building Capability in Palliative Care Clinical Trials" program as a service development, and to assess the strategies, activities, and the outcomes resulting from this program. Methods: A series of strategies and activities were developed linked to the key program objectives of increasing the number of clinical sites and skilled clinicians conducting clinical trials, increasing the number of trials available and patients participating, broadening research opportunities in palliative care, and establishing the program sustainability. Results: In the two years of implementation, the program resulted in the establishment and conduct of several Phase 4 postmarketing pharmacovigilance studies, nine Phase 2 and 3 trials across five palliative care services, and a Phase 1 clinical trial. During the program, 150 patients were recruited to clinical trials, and 258 prospective pharmacovigilance monitoring cases were recorded. Five investigator-initiated trials were developed by clinical trial fellows and achieved competitive (n = 3) or commercial (n = 2) funding. Clinicians reported that undertaking clinical trials had increased attention to the evidence base of care provision, and increased service research activity more broadly. Long-term sustainability remains a challenge, particularly in the context of the COVID-19 pandemic. Conclusions: Clinical trials in palliative care services are feasible, acceptable, and result in increased attention to the evidence base of care. The strategies detailing the framework, activities, and outcomes have been collated to facilitate implementation of clinical trials in other sites and with other trial-naive disciplinary groups.

Lean Six Sigma Redesign of a Process for Healthcare Mandatory Education in Basic Life Support-A Pilot Study

Healthcare staff are required to undertake mandatory training programs to ensure they maintain key clinical competencies. This study was conducted in a private hospital in Ireland, where the processes for accessing mandatory training were found to be highly complex and non-user friendly, resulting in missed training opportunities, specific training license expiration, and underutilized training slots which resulted in lost time for both the trainers and trainees. A pilot study was undertaken to review the process for accessing mandatory training with a focus on the mandatory training program of Basic Life Support (BLS). This was chosen due to its importance in patient resuscitation and its requirement in the hospital achieving Joint Commission International (JCI) accreditation. A pre- and post-team-based intervention design was used with Lean Six Sigma (LSS) methodology employed to redesign the process of booking, scheduling, and delivery of BLS training leading to staff individual BLS certification for a period of two years. The redesign of the BLS training program resulted in a new blended delivery method, and the initiation of a pilot project led to a 50% increase in the volume of BLS classes and a time saving of 154 h 30 min for staff and 48 h 14 min for BLS instructors. The success of the BLS process access pilot has functioned as a platform for the redesign of other mandatory education programs and will be of interest to hospitals with mandatory training requirements that are already facing healthcare challenges and demands on staff time.

Healthcare Quality Improvement Analytics: An Example Using Computerized Provider Order Entry

Evaluation of sustainability after quality improvement (QI) projects in healthcare settings is an essential part of monitoring and future QI planning. With limitations in adopting quasi-experimental study design in real-world practice, healthcare professionals find it challenging to present the sustained effect of QI changes effectively. To provide quantitative methodological approaches for demonstrating the sustainability of QI projects for healthcare professionals, we conducted data analyses based on a QI project to improve the computerized provider order entry system to reduce patients' dosing frequencies in Korea. Data were collected for 5 years: 24-month pre-intervention, 12-month intervention, and 24-month post-intervention. Then, analytic approaches including control chart, Analysis of Variance (ANOVA), and segmented regression were performed. The control chart intuitively displayed how the outcomes changed over the entire period, and ANOVA was used to test whether the outcomes differed between groups. Last, segmented regression analysis was conducted to evaluate longitudinal effects of interventions over time. We found that the impact of QI projects in healthcare settings should be initiated following the Plan-Do-Study-Act cycle and evaluated long-term effects while widening the scope of QI evaluation with sustainability. This study can serve as a guide for healthcare professionals to use a number of statistical methodologies in their QI evaluations.

Integrated care pathways in neurosurgery: A systematic review

Introduction

Integrated care pathways (ICPs) are a pre-defined framework of evidence based, multidisciplinary practice for specific patients. They have the potential to enhance continuity of care, patient safety, patient satisfaction, efficiency gains, teamwork and staff education. In order to inform the development of neurosurgical ICPs in the future, we performed a systematic review to aggregate examples of neurosurgical ICP, to consider their impact and design features that may be associated with their success.

Methods

Electronic databases MEDLINE, EMBASE, and CENTRAL were searched for relevant literature published from date of inception to July 2020. Primary studies reporting details of neurosurgical ICPs, across all pathologies and age groups were eligible for inclusion. Patient outcomes in each case were also recorded.

Results

Twenty-four studies were included in our final dataset, from the United States, United Kingdom, Italy, China, Korea, France, Netherlands and Switzerland, and a number of sub-specialties. 3 for cerebrospinal fluid diversion, 1 functional, 2 neurovascular, 1 neuro-oncology, 2 paediatric, 2 skull base, 10 spine, 1 for trauma, 2 miscellaneous (other craniotomies). All were single centre studies with no regional or national examples. Thirteen were cohort studies while 11 were case series which lacked a control group. Effectiveness was typically evaluated using hospital or professional performance metrics, such as length of stay (n = 11, 45.8%) or adverse events (n = 17, 70.8%) including readmission, surgical complications and mortality. Patient reported outcomes, including satisfaction, were evaluated infrequently (n = 3, 12.5%). All studies reported a positive impact. No study reported how the design of the ICP was informed by published literature or other methods

Conclusions

ICPs have been successfully developed across numerous neurosurgical sub-specialities. However, there is often a lack of clarity over their design and weaknesses in their evaluation, including an underrepresentation of the patient’s perspective.

Telling the story of complex change: an Impact Framework for the real world

Background

In the National Health Service (NHS) in England, traditional approaches to evidencing impact and value have an important role to play but are unlikely to demonstrate the full value of national quality improvement programmes and large-scale change initiatives in health and care. This type of work almost always takes place in complex and complicated settings, in that it involves multiple players, numerous interventions and a host of other confounding factors. Improvement work is usually emergent, with cause and effect only understood in hindsight; challenges around contribution and attribution can lead the key players to question how they can be certain that the described or observed changes are due to their intervention and would not have happened without them. In this complex environment, there is a risk of oversimplifying the observed impact and focusing instead on those things that are easier to measure, missing that which is important but more difficult to evidence.

Methods

Between 2016 and 2019, an action-orientated approach, drawing on realist and development evaluation approaches, was taken to designing and testing the Impact Framework. First, we undertook a pragmatic review of tools and approaches used by others to capture and demonstrate their impact both within and outside the health and care environment. Following the identification and review of these tools and approaches, and in consultation with national improvement teams in England about their evaluation challenges and aspirations, we developed a set of underpinning principles to inform the design and build of the framework. The principles were informed and finessed following conversations with improvement teams and programme leads in NHS England with respect to the challenges that they were facing and their aspirations in terms of demonstrating their impact and learning as they worked.

Results

The ‘Impact Framework’ described in this article offers a practical approach to capturing the impact of improvement work at any scale, taking account of unintended outcomes, considering attribution and contribution, and using a narrative approach to uncover the difference made by improvement initiatives in rich detail. In this article, we describe how the Impact Framework has been used with one of NHS England’s national programmes, Time for Care, which was delivered between 2016 and 2020.

Conclusions

The Impact Framework continues to be used, developed and further tested by national improvement programmes being delivered by NHS England and NHS Improvement and is updated regularly. The framework has been developed to be accessible to frontline teams and is supported by a set of resources to help improvement teams and individuals to use by themselves (https://www.england.nhs.uk/sustainableimprovement/impact-framework/).

How prescribing available pharmacotherapies for alcohol use disorder can impact the healthcare system: A retrospective quality improvement study

Alcohol use disorder is a multifactorial undertreated chronic disorder influenced by genetic, psychological, and environmental factors. Numerous pharmacotherapies are available and effective but are underutilized in healthcare. The purpose of this retrospective quality improvement study is to determine the impact of education sessions on the availability and efficacy of medications (focusing on Naltrexone) to treat alcohol use disorder in the healthcare system. Control charts were implemented to monitor the system change in two comparable urban areas. Dispensing rates increased at three points after a series of presentations. The first increase from baseline was 2.47 times, the second 3.7, and the third 4.81. Coinciding with these, weekly visits to the emergency department also decreased by 35% and stabilized at a 15% reduction. It was also observed that alcohol use disorder hospital admission rates decreased by 21%, but bounced back once the education sessions ended. Combined with counselling, pharmacotherapies can be effective in combating alcohol use disorder, while potentially reducing demands on the healthcare system.

Improvement of quality of care for gestational syphilis in the municipality of Rio de Janeiro

OBJECTIVE

To analyze the effect of a multifaceted intervention in the care of pregnant women with syphilis in primary health care.

METHODS

This is a quality improvement project performed in 26 basic care units in the municipality of Rio de Janeiro, between January and December 2017. It has a quasi-experimental mixed design, with previous, later and time series analyses. We evaluated the care provided to all pregnant women with syphilis whose prenatal care that ended during the studied period, using ten quality criteria and one indicator. The intervention was multifaceted, covering permanent education, improvement of records and information systems, audit and feedback, patient education, organizational changes and work processes. We estimated absolute and relative improvements of the criteria and their statistical significance (α = 5%). The facilitators and hinders of the intervention were analyzed according to the Model for Understanding Success in Quality.

RESULTS

After the intervention, there was a total absolute improvement of 6.7% (64.4% versus 71.0%) and relative of 28.8% (p > 0.05). Eight of the ten quality criteria had an improvement, which was significant in four of them (p < 0.05). The monthly indicator of adequate treatment also improved (p < 0.05), but maintained low performance throughout the project. The increase in the compliance of the treatment scheme with the protocol (91.4% versus 99.1%) positively stood out, but the main opportunities for improvement were testing (42.8% versus 48.5%) and treatment of sexual partnerships (42.8% versus 44.2%). Regulatory pressures to improve the monthly indicator and the political-economic crisis experienced by the municipality modulated the effect of the intervention.

CONCLUSION

The project was useful to identify priorities and guide interventions to improve the quality of care for syphilis, although there is still ample room for improvement. The identified problems, as well as the contextual modulators of the effect, should be considered in future interventions.

Completeness of reporting of quality improvement studies in neonatology is inadequate: a systematic literature survey

INTRODUCTION

Quality improvement (QI) is a growing field of inquiry in healthcare, but the reporting quality of QI studies in neonatology remains unclear. We conducted a systematic survey of the literature to assess the reporting quality of QI studies and factors associated with reporting quality.

METHODS

We searched Medline for publications of QI studies from 2016 to 16 April 2020. Pairs of reviewers independently screened citations and assessed reporting quality using a 31-item modified Standards for Quality Improvement Reporting Excellence, 2nd edition (SQUIRE 2.0) checklist. We reported the number (percentage) of studies that reported each item and their corresponding 95% CIs. We used Poisson regression to explore factors associated with reporting quality, namely, journal endorsement of SQUIRE 2.0, declaration of funding sources, year of publication and number of authors. The results were reported as incidence rate ratio (IRR) and 95% CI.

RESULTS

Of 1921 citations, 336 were eligible; among them, we randomly selected 100 articles to assess reporting quality. The mean (standard deviation) number of SQUIRE 2.0 items adhered to was 22.0 (4.5). Percentage of articles reporting each item varied from 26% to 100%. Journal endorsement of SQUIRE 2.0 (IRR=1.11, 95% CI 1.02 to 1.21, p=0.015), declaration of funding sources and increasing number of authors were significantly associated with better reporting.

CONCLUSIONS

Reporting quality of QI studies in neonatology is inadequate. Endorsing the SQUIRE 2.0 guideline is a step that journals can implement to enhance the completeness of reporting.

Measuring and publishing quality improvement

Misalignment of measures, measurement and analysis with the goals and methods of quality improvement efforts in healthcare may create confusion and decrease effectiveness. In healthcare, measurement is used for accountability, research, and quality improvement, so distinguishing between these is an important first step. Using a case vignette, this paper focuses on using measurement for improvement to gain insight into the dynamic nature of healthcare systems and to assess the impact of interventions. This involves an understanding of the variation in the data over time. Statistical process control (SPC) charting is an effective and powerful analysis tool for this. SPC provides ongoing assessment of system functioning and enables an improvement team to assess the impact of its own interventions and external forces on the system. Once improvement work is completed, the Standards for Quality Improvement Reporting Excellence (SQUIRE) guidelines is a valuable tool to describe the rationale, context, and study of the interventions. SQUIRE can be used to plan improvement work as well as structure a manuscript for publication in peer-reviewed journals.

How to specify healthcare process improvements collaboratively using rapid, remote consensus-building: a framework and a case study of its application

BACKGROUND

Practical methods for facilitating process improvement are needed to support high quality, safe care. How best to specify (identify and define) process improvements - the changes that need to be made in a healthcare process - remains a key question. Methods for doing so collaboratively, rapidly and remotely offer much potential, but are under-developed. We propose an approach for engaging diverse stakeholders remotely in a consensus-building exercise to help specify improvements in a healthcare process, and we illustrate the approach in a case study.

METHODS

Organised in a five-step framework, our proposed approach is informed by a participatory ethos, crowdsourcing and consensus-building methods: (1) define scope and objective of the process improvement; (2) produce a draft or prototype of the proposed process improvement specification; (3) identify participant recruitment strategy; (4) design and conduct a remote consensus-building exercise; (5) produce a final specification of the process improvement in light of learning from the exercise. We tested the approach in a case study that sought to specify process improvements for the management of obstetric emergencies during the COVID-19 pandemic. We used a brief video showing a process for managing a post-partum haemorrhage in women with COVID-19 to elicit recommendations on how the process could be improved. Two Delphi rounds were then conducted to reach consensus.

RESULTS

We gathered views from 105 participants, with a background in maternity care (n = 36), infection prevention and control (n = 17), or human factors (n = 52). The participants initially generated 818 recommendations for how to improve the process illustrated in the video, which we synthesised into a set of 22 recommendations. The consensus-building exercise yielded a final set of 16 recommendations. These were used to inform the specification of process improvements for managing the obstetric emergency and develop supporting resources, including an updated video.

CONCLUSIONS

The proposed methodological approach enabled the expertise and ingenuity of diverse stakeholders to be captured and mobilised to specify process improvements in an area of pressing service need. This approach has the potential to address current challenges in process improvement, but will require further evaluation.

Implementation effect of institutional policy of EGD observation time on neoplasm detection

BACKGROUND AND AIMS

The observation time in EGD is associated with detection rate of premalignant or neoplastic lesions in the upper GI (UGI) tract. The aim of this study was to evaluate an institutional policy of EGD observation time on the detection rate of UGI neoplasms.

METHODS

From July 2017 to March 2019, all endoscopists were requested to comply with our institutional policy of spending more than 3 minutes of observation time in every screening EGD. Observation time was defined as the time from when the endoscope reached the duodenum to when it was withdrawn. We obtained a neoplasm detection rate (NDR) during this period and compared it with that of a baseline period from 2009 to 2015.

RESULTS

During the study period, 30,506 EGDs were performed. Mean subject age was 49.9 ± 10.5 years, and 56.5% were men. All endoscopists achieved an average EGD observation time of more than 3 minutes during this period. Mean observation time was 3:35 ± 0:50, which was significantly longer than the baseline (2:38 ± 0:21, P < .001). NDR was .33%, which was higher than the baseline (.23%, P < .001). Even after adjusting for subjects' age and gender, smoking history, and endoscopists' biopsy sampling rate, prolonged EGD observation time of more than 3 minutes increased the NDR of UGI neoplasms (odds ratio, 1.51; 95% confidence interval, 1.21-1.75).

CONCLUSIONS

This study provides evidence that implementing a protocol of a prolonged observation time could increase NDR. Observation time should be an important quality indicator of the EGD examination.