Using a dark logic model to explore adverse effects in audit and feedback: a qualitative study of gaming in colonoscopy

Nationally Automated Colonoscopy Performance Feedback Increases Polyp Detection: The NED APRIQOT Randomized Controlled Trial

BACKGROUND & AIMS

Postcolonoscopy colorectal cancer incidence and mortality rates are higher for endoscopists with low polyp detection rates. Using the UK's National Endoscopy Database (NED), which automatically captures real-time data, we assessed if providing feedback of case-mix-adjusted mean number of polyps (aMNP), as a key performance indicator, improved endoscopists' performance. Feedback was delivered via a theory-informed, evidence-based audit and feedback intervention.

METHODS

This multicenter, prospective, NED Automated Performance Reports to Improve Quality Outcomes Trial randomized National Health Service endoscopy centers to intervention or control. Intervention-arm endoscopists were e-mailed tailored monthly reports automatically generated within NED, informed by qualitative interviews and behavior change theory. The primary outcome was endoscopists' aMNP during the 9-month intervention.

RESULTS

From November 2020 to July 2021, 541 endoscopists across 36 centers (19 intervention; 17 control) performed 54,770 procedures during the intervention, and 15,960 procedures during the 3-month postintervention period. Comparing the intervention arm with the control arm, endoscopists during the intervention period: aMNP was nonsignificantly higher (7%; 95% CI, -1% to 14%; P = .08). The unadjusted MNP (10%; 95% CI, 1%-20%) and polyp detection rate (10%; 95% CI, 4%-16%) were significantly higher. Differences were not maintained in the postintervention period. In the intervention arm, endoscopists accessing NED Automated Performance Reports to Improve Quality Outcomes Trial webpages had a higher aMNP than those who did not (aMNP, 118 vs 102; P = .03).

CONCLUSIONS

Although our automated feedback intervention did not increase aMNP significantly in the intervention period, MNP and polyp detection rate did improve significantly. Engaged endoscopists benefited most and improvements were not maintained postintervention; future work should address engagement in feedback and consider the effectiveness of continuous feedback.

CLINICAL TRIALS REGISTRY

 www.isrctn.org ISRCTN11126923 .

Adverse Events Reporting in Digital Interventions Evaluations for Psychosis: A Systematic Literature Search and Individual Level Content Analysis of Adverse Event Reports

BACKGROUND

Digital health interventions (DHIs) have significant potential to upscale treatment access to people experiencing psychosis but raise questions around patient safety. Adverse event (AE) monitoring is used to identify, record, and manage safety issues in clinical trials, but little is known about the specific content and context contained within extant AE reports. This study aimed to assess current AE reporting in DHIs.

STUDY DESIGN

A systematic literature search was conducted by the iCharts network (representing academic, clinical, and experts by experience) to identify trials of DHIs in psychosis. Authors were invited to share AE reports recorded in their trials. A content analysis was conducted on the shared reports.

STUDY RESULTS

We identified 593 AE reports from 18 DHI evaluations, yielding 19 codes. Only 29 AEs (4.9% of total) were preidentified by those who shared AEs as being related to the intervention or trial procedures. While overall results support the safety of DHIs, DHIs were linked to mood problems and psychosis exacerbation in a few cases. Additionally, 27% of studies did not report information on relatedness for all or at least some AEs; 9.6% of AE reports were coded as unclear because it could not be determined what had happened to participants.

CONCLUSIONS

The results support the safety of DHIs, but AEs must be routinely monitored and evaluated according to best practice. Individual-level analyses of AEs have merit to understand safety in this emerging field. Recommendations for best practice reporting in future studies are provided.

Initiatives to increase colonoscopy capacity - is there an impact on polyp detection? A UK National Endoscopy Database analysis

BACKGROUND

 To address mismatch between routine endoscopy capacity and demand, centers often implement initiatives to increase capacity, such as weekend working or using locums/agency staff (insourcing). However, there are concerns that such initiatives may negatively impact quality. We investigated polyp detection for weekend vs. weekday and insourced vs. standard procedures using data from the UK National Endoscopy Database.

METHODS

 We conducted a national, retrospective, cross-sectional study of diagnostic colonoscopies performed during 01/01-04/04/2019. The primary outcome was mean number of polyps (MNP) and the secondary outcome was polyp detection rate (PDR). Multi-level mixed-effect regression, fitting endoscopist as a random effect, was used to examine associations between procedure day (weekend/weekday) and type (insourced/standard) and these outcomes, adjusting for patient age, sex, and indication.

RESULTS

 92 879 colonoscopies (weekends: 19 977 [21.5 %]; insourced: 9909 [10.7 %]) were performed by 2496 endoscopists. For weekend colonoscopies, patients were less often male or undergoing screening-related procedures; for insourced colonoscopies, patients were younger and less often undergoing screening-related procedures (all P < 0.05). Fully adjusted MNP was significantly lower for weekend vs. weekday (incidence rate ratio [IRR] 0.86 [95 %CI 0.83-0.89]) and for insourced vs. standard procedures (IRR 0.91 [95 %CI 0.87-0.95]). MNP was highest for weekday standard procedures and lowest for weekend insourced procedures; there was no interaction between procedure day and type. Similar associations were found for PDR.

CONCLUSIONS

 Strategies to increase colonoscopy capacity may negatively impact polyp detection and should be monitored for quality. Reasons for this unwarranted variation require investigation.

Midwives' and obstetricians' practice, perspectives and experiences in relation to altered fetal movement: A focused ethnographic study

BACKGROUND

Reducing avoidable stillbirth is a global priority. The stillbirth rate in England compares unfavourably to that of some other high-income countries. Poorly-managed episodes of altered fetal movement have been highlighted as a key contributor to avoidable stillbirth, and strategies introduced in England in 2016 to reduce perinatal mortality included recommendations for the management of reduced fetal movement. Despite a downward trend in stillbirth rates across the UK, the effects of policies promoting awareness of fetal movement remain uncertain.

OBJECTIVE

To provide in-depth knowledge of how practice and clinical guidance relating to altered fetal movement are perceived, enacted and experienced by midwives and obstetricians, and explore the relationship between recommended fetal movement care and actual fetal movement care.

DESIGN

A focused ethnographic approach comprising over 180 h of observation, 15 interviews, and document analysis was used to explore practice at two contrasting UK maternity units.

SETTINGS

Antenatal services at two UK maternity units, one in the Midlands and one in the North of England.

PARTICIPANTS

Thirty-six midwives, obstetricians and sonographers and 40 pregnant women participated in the study across 52 observed care episodes and relevant unit activity. Twelve midwives and three obstetricians additionally participated in formal semi-structured interviews.

METHODS

Fieldnotes, interview transcripts, policy documents, maternity notes and clinical guidelines were analysed using a modified constant comparison method to identify important themes.

RESULTS

fetal movement practice was mostly consistent and in line with guideline recommendations. Notwithstanding, most midwives and obstetricians had concerns about this area of care, including challenges in diagnosis, conflicting evidence about activity, heightened maternal anxiety, and high rates of monitoring and intervention in otherwise low-risk pregnancies. To address these issues, midwives spent considerable time reassuring women through information and regular monitoring, and coaching them to perceive fetal movement more accurately.

CONCLUSIONS

Practice relating to altered fetal movement might be more uniform than in the past. However, a heightened focus on fetal movement is associated by some midwives and obstetricians with potential harms, including increased anxiety in pregnancy, and high rates of monitoring and intervention in pregnancies where there are no 'objective concerns'. Challenges in diagnosing a significant change in fetal movement with accuracy might mean that interventions and resources are not being directed towards those pregnancies most at risk. More research is needed to determine how healthcare professionals can engage in conversations about fetal movement and stillbirth to support safe outcomes and positive experiences in pregnancy and birth.

REGISTRATION

Not registered.

TWEETABLE ABSTRACT

Midwives and obstetricians take #reducedfetalmovement seriously but worry this 'unreliable' symptom increases anxiety, monitoring and intervention in many 'low risk' pregnancies.

Pediatric endoscopy: how can we improve patient outcomes and ensure best practices?

INTRODUCTION

Strategies to promote high-quality endoscopy in children require consensus around pediatric-specific quality standards and indicators. Using a rigorous guideline development process, the international Pediatric Endoscopy Quality Improvement Network (PEnQuIN) was developed to support continuous quality improvement efforts within and across pediatric endoscopy services.

AREAS COVERED

This review presents a framework, informed by the PEnQuIN guidelines, for assessing endoscopist competence, granting procedural privileges, audit and feedback, and for skill remediation, when required. As is critical for promoting quality, PEnQuIN indicators can be benchmarked at the individual endoscopist, endoscopy facility, and endoscopy community levels. Furthermore, efforts to incorporate technologies, including electronic medical records and artificial intelligence, into endoscopic quality improvement processes can aid in creation of large-scale networks to facilitate comparison and standardization of quality indicator reporting across sites.

EXPERT OPINION

PEnQuIN quality standards and indicators provide a framework for continuous quality improvement in pediatric endoscopy, benefiting individual endoscopists, endoscopy facilities, and the broader endoscopy community. Routine and reliable measurement of data, facilitated by technology, is required to identify and drive improvements in care. Engaging all stakeholders in endoscopy quality improvement processes is crucial to enhancing patient outcomes and establishing best practices for safe, efficient, and effective pediatric endoscopic care.

Visual identifiers for people with dementia in hospitals: a qualitative study to unravel mechanisms of action for improving quality of care

BACKGROUND

Hospitalised people with dementia (PwD) experience worse care and more patient safety incidents than non-dementia patients. Visual identifiers are commonly used to identify patients who have a diagnosis of dementia, with the aim of promoting more personalised care. However, little is known about how they work in practice, nor about the potential unintended consequences that might arise from their use. We aim to identify the mechanisms through which visual identifiers could support good care for PwD, how and why their use may have negative consequences and the conditions for their effective use.

METHODS

We conducted interviews with 21 dementia leads and healthcare professionals, 19 carers and two PwD, and produced case studies of visual identification systems in four UK acute hospital trusts between 2019 and 2021. Analysis drew on the concept of classification to identify and explore mechanisms of action.

RESULTS

We identified four mechanisms through which visual identifiers could help towards providing good care for PwD: enabling coordination of care at organisational level; signalling eligibility for dementia-specific interventions; informing prioritisation of resources on wards; and acting as a quick reference cue for staff. But identifier effectiveness could be undermined by: lack of standardisation and consistency; a lack of closely coupled information about individual needs; and stigma associated with a dementia diagnosis. Identifier effectiveness was dependent on their implementation being supported through staff training, resources directed and efforts to develop a supportive culture for caring for this patient group.

CONCLUSION

Our research highlights the potential mechanisms of action of visual identifiers and their possible negative consequences. Optimising the use of identifiers requires consensus on the rules of classification and the symbols used, and closely coupled patient information. Organisations need to provide support, offer the right resources and training and engage meaningfully with carers and patients about the use of identifiers.

How did healthcare professionals define patient engagement in quality management? A survey study

BACKGROUND

Patient and family engagement (PFE) can positively impact the patient experience and care process outcomes. There is no unique type of PFE, and the process is usually defined by the quality management department or professionals responsible for this process in the hospital. The objective of this study is to define PFE in quality management based on the professional's perspective.

METHOD

A survey was carried out with 90 professionals from Brazilian hospitals. There were two questions aimed at understanding the concept. The first was a multiple-choice question to identify synonyms. The second was an open-ended question to develop the definition. A content analysis methodology was employed by applying techniques for thematic and inferential analysis.

RESULTS

Three words were classified as synonyms by more than 60% of respondents: involvement, participation, and centered care. The participants described patient participation at both the individual (related to the treatment) and organizational levels (related to quality improvement). The PFE in the treatment is related to the development, discussion and decision-making about the therapeutic plan, participation in each step of care, and knowledge of the institution's quality and safety processes. At the organizational level, engagement in quality improvement includes the involvement of the P/F in all processes of the institution, from strategic planning to the design or improvement processes, as well as active participation in institutional committees or commissions.

CONCLUSION

The professionals defined engagement in two levels (individual and organizational) and the results suggest that their point of view can influence the practice in the hospitals. Professionals of hospitals that implemented mechanisms of consult defined PFE more in the individual level. On the other hand, professionals of hospitals that implemented mechanisms of involvement considered PFE more focus in the organizational level.