The incidence of diagnostic error in medicine

A wide variety of research studies suggest that breakdowns in the diagnostic process result in a staggering toll of harm and patient deaths. These include autopsy studies, case reviews, surveys of patient and physicians, voluntary reporting systems, using standardised patients, second reviews, diagnostic testing audits and closed claims reviews. Although these different approaches provide important information and unique insights regarding diagnostic errors, each has limitations and none is well suited to establishing the incidence of diagnostic error in actual practice, or the aggregate rate of error and harm. We argue that being able to measure the incidence of diagnostic error is essential to enable research studies on diagnostic error, and to initiate quality improvement projects aimed at reducing the risk of error and harm. Three approaches appear most promising in this regard: (1) using 'trigger tools' to identify from electronic health records cases at high risk for diagnostic error; (2) using standardised patients (secret shoppers) to study the rate of error in practice; (3) encouraging both patients and physicians to voluntarily report errors they encounter, and facilitating this process.

Antibiotic misuse: a prospective clinical audit in a French university hospital

The aim of the study presented here was to prospectively audit antibiotic prescriptions given to patients attending L'Archet Hospital in Nice, France, with details of the initial medical examination included in the audit procedure. A total of 122 antibiotic treatments were evaluated, i.e. 31% of all antibiotic therapies initiated in the eight participating departments over the 9-week study period. Forty-two (34%) treatments were found to be unnecessary due to misdiagnosis, and 36 (30%) other treatments were inappropriate. Misdiagnosis, due to the misinterpretation or lack of clinical, microbiological and/or imaging data is thus a major cause of antibiotic misuse. Improvement in the diagnostic process should become part of antibiotic policy.

Epidemiology of trauma presentations to a major trauma centre in the North West of England during the COVID-19 level 4 lockdown

PURPOSE

The COVID-19 pandemic has impacted healthcare systems globally, little is known about the trauma patterns during a national lockdown. The aim of this study is to delineate the trauma patterns and outcomes at Aintree University Teaching Hospital level 1 Major Trauma Centre (MTC) during the COVID-19 lockdown imposed by the U.K. government.

METHODS

A retrospective cohort study data from the Merseyside and Cheshire Trauma Audit and Research Network database were analysed. The 7-week 'lockdown period' was compared to a 7-week period prior to the lockdown and also to an equivalent 7-week period corresponding to the previous year.

RESULTS

A total of 488 patients were included in the study. Overall, there was 37.6% and 30.0% reduction in the number of traumatic injuries during lockdown. Road traffic collisions (RTC) reduced by 42.6% and 46.6%. RTC involving a car significantly reduced during lockdown, conversely, bike-related RTC significantly increased. No significant changes were noted in deliberate self-harm, trauma severity and crude mortality during lockdown. There was 1 mortality from COVID-19 infection in the lockdown cohort.

CONCLUSION

Trauma continues during lockdown, our MTC has continued to provide a full service during lockdown. However, trauma patterns have changed and departments should adapt to balance these alongside the COVID-19 pandemic. As the U.K. starts its cautious transition out of lockdown, trauma services are required to be flexible during changes in national social restrictions and changing trauma patterns. COVID-19 and lockdown state were found to have no significant impact on survival outcomes for trauma.

Study protocol: Audit and Best Practice for Chronic Disease Extension (ABCDE) Project

BACKGROUND

A growing body of international literature points to the importance of a system approach to improve the quality of care in primary health care settings. Continuous Quality Improvement (CQI) concepts and techniques provide a theoretically coherent and practical way for primary care organisations to identify, address, and overcome the barriers to improvements. The Audit and Best Practice for Chronic Disease (ABCD) study, a CQI-based quality improvement project conducted in Australia's Northern Territory, has demonstrated significant improvements in primary care service systems, in the quality of clinical service delivery and in patient outcomes related to chronic illness care. The aims of the extension phase of this study are to examine factors that influence uptake and sustainability of this type of CQI activity in a variety of Indigenous primary health care organisations in Australia, and to assess the impact of collaborative CQI approaches on prevention and management of chronic illness and health outcomes in Indigenous communities.

METHODS/DESIGN

The study will be conducted in 40-50 Indigenous community health centres from 4 States/Territories (Northern Territory, Western Australia, New South Wales and Queensland) over a five year period. The project will adopt a participatory, quality improvement approach that features annual cycles of: 1) organisational system assessment and audits of clinical records; 2) feedback to and interpretation of results with participating health centre staff; 3) action planning and goal setting by health centre staff to achieve system changes; and 4) implementation of strategies for change. System assessment will be carried out using a System Assessment Tool and in-depth interviews of key informants. Clinical audit tools include two essential tools that focus on diabetes care audit and preventive service audit, and several optional tools focusing on audits of hypertension, heart disease, renal disease, primary mental health care and health promotion. The project will be carried out in a form of collaborative characterised by a sequence of annual learning cycles with action periods for CQI activities between each learning cycle. Key outcome measures include uptake and integration of CQI activities into routine service activity, state of system development, delivery of evidence-based services, intermediate patient outcomes (e.g. blood pressure and glucose control), and health outcomes (complications, hospitalisations and mortality).

CONCLUSION

The ABCD Extension project will contribute directly to the evidence base on effectiveness of collaborative CQI approaches on prevention and management of chronic disease in Australia's Indigenous communities, and to inform the operational and policy environments that are required to incorporate CQI activities into routine practice.

Nonoperative management of penetrating kidney injuries: a prospective audit

PURPOSE

The role of nonoperative management for penetrating kidney injuries is unknown. Therefore, we review the management and outcome of penetrating kidney injuries at a center with a high incidence of penetrating trauma.

MATERIALS AND METHODS

Data from all patients presenting with hematuria and/or kidney injury discovered on imaging or at surgery admitted to the trauma center at Groote Schuur Hospital in Cape Town, South Africa during a 19-month period (January 2007 to July 2008) were prospectively collected and reviewed. These data were analyzed for demographics, injury mechanism, perioperative management, nephrectomy rate and nonoperative success. Patients presenting with hematuria and with an acute abdomen underwent a single shot excretory urogram. Those presenting with hematuria without an indication for laparotomy underwent computerized tomography with contrast material.

RESULTS

A total of 92 patients presented with hematuria following penetrating abdominal trauma. There were 75 (80.4%) proven renal injuries. Of the patients 84 were men and the median age was 26 years (range 14 to 51). There were 50 stab wounds and 42 gunshot renal injuries. Imaging modalities included computerized tomography in 60 cases and single shot excretory urography in 18. There were 9 patients brought directly to the operating room without further imaging. A total of 47 patients with 49 proven renal injuries were treated nonoperatively. In this group 4 patients presented with delayed hematuria, of whom 1 had a normal angiogram and 3 underwent successful angioembolization of arteriovenous fistula (2) and false aneurysm (1). All nonoperatively managed renal injuries were successfully treated without surgery. There were 18 nephrectomies performed for uncontrollable bleeding (11), hilar injuries (2) and shattered kidney (3). Post-nephrectomy complications included 1 infected renal bed hematoma requiring percutaneous drainage. Of the injuries found at laparotomy 12 were not explored, 2 were drained and 5 were treated with renorrhaphy.

CONCLUSIONS

Penetrating trauma is associated with a high nephrectomy rate (24.3%). However, a high nonoperative success rate (100%) is achievable with minimal morbidity (9%).

Importance of health system context for evaluating utilization patterns across systems

Measuring health services provided to patients can be difficult when patients see providers across multiple health systems and all visits are rarely captured in a single data source covering all systems where patients receive care. Studies that account for only one system will omit the out-of-system health-care use at the patient level. Combining data across systems and comparing utilization patterns across health systems creates complications for both aggregation and accuracy because data-generating processes (DGPs) tend to vary across systems. We develop a hybrid methodology for aggregation across systems, drawing on the strengths of the DGP in each system, and demonstrate its validity for answering research questions requiring cross-system assessments of health-care utilization. Positive and negative predictive probabilities can be useful to assess the impact of the hybrid methodology. We illustrate these issues comparing public sector (administrative records from the US Department of Veterans Affairs system) and private sector (billing records from the US Medicare system) patient level data to identify primary-care utilization. Understanding the context of a particular health system and its effect on the DGP is important in conducting effective valid evaluations.

Screening for the metabolic side effects of antipsychotic medication: findings of a 6-year quality improvement programme in the UK

OBJECTIVES

To increase the frequency and quality of screening for the metabolic syndrome in people prescribed continuing antipsychotic medication.

DESIGN

An audit-based, quality improvement programme (QIP) with customised feedback to participating mental health services after each audit, including benchmarked data on their relative and absolute performance against an evidence-based practice standard and the provision of bespoke change interventions.

SETTING

Adult, assertive outreach, community psychiatric services in the UK.

PARTICIPANTS

6 audits were conducted between 2006 and 2012. 21 mental health Trusts participated in the baseline audit in 2006, submitting data on screening for 1966 patients, while 32 Trusts participated in the 2012 audit, submitting data on 1591 patients.

RESULTS

Over the 6 years of the programme, there was a statistically significant increase in the proportion of patients for whom measures for all 4 aspects of the metabolic syndrome had been documented in the clinical records in the previous year, from just over 1 in 10 patients in 2006 to just over 1 in 3 by 2012. The proportion of patients with no evidence of any screening fell from almost ½ to 1 in 7 patients over the same period.

CONCLUSIONS

The findings suggest that audit-based QIPs can help improve clinical practice in relation to physical healthcare screening. Nevertheless, they also reveal that only a minority of community psychiatric patients prescribed antipsychotic medication is screened for the metabolic syndrome in accordance with best practice recommendations, and therefore potentially remediable causes of poor physical health remain undetected and untreated.

Qualitative study of views and experiences of performance management for healthcare-associated infections

BACKGROUND

Centrally led performance management regimes using standard setting, monitoring, and incentives have become a prominent feature of infection prevention and control (IPC) in health systems.

AIM

To characterize views and experiences of regulation and performance management relating to IPC in English hospitals.

METHODS

Two qualitative datasets containing 139 interviews with healthcare workers and managers were analysed. Data directly relevant to performance management and IPC were extracted. Data analysis was based on the constant comparative method.

FINDINGS

Participants reported that performance management regimes had mobilized action around specific infections. The benefits of establishing organizational structures of accountability were seen in empirical evidence of decreasing infection rates. Performance management was not, however, experienced as wholly benign, and setting targets in one area was seen to involve risks of 'tunnel vision' and the marginalization of other potentially important issues. Financial sanctions were viewed especially negatively; performance management was associated with risks of creating a culture of fearfulness, suppressing learning and disrupting inter-professional relationships.

CONCLUSION

Centrally led performance management may have some important roles in IPC, but identifying where it is appropriate and determining its limits is critical. Persisting with harsh regimes may affect relationships and increase resistance to continued improvement efforts, but leaving all improvement to local teams may also be a flawed strategy.

Associations between post-operative rehabilitation of hip fracture and outcomes: national database analysis (90 characters)

BACKGROUND

Rehabilitation programmes are used to improve hip fracture outcomes. There is little published trial clinical trial or population-based data on the effects of the type or provider of rehabilitation treatments on hip fracture outcomes. We evaluated the associations of rehabilitation interventions with post-operative hip fracture outcomes.

METHODS

Cross-sectional (2013-2015) analysis of data from the English National Hip Fracture Database (NHFD) from all 191 English hospitals treating hip fractures. Of 62,844 NHFD patients, we included 17,708 patients with rehabilitation treatment and 30-day mobility data, and 34,142 patients with rehabilitation treatment and discharge destination data. The intervention was early mobilisation rehabilitation treatments delivered by a physiotherapist (PT, physical therapist in North America) or other clinical staff as identifiable in NHFD. We used ordinal logistic and propensity scoring regression models to adjust for confounding variables including age, sex, pre-fracture mobility, operative delay, and cognitive function and peri-operative risk scores.

RESULTS

In both the adjusted multivariate and propensity-weighted analyses, mobilisation on the day or the day following surgery is associated with better mobility function 30 days after discharge. However patients mobilised by a PT did not have better mobility compared to mobilisation by other professionals. Patients who received a PT assessment were not protected from poorer mobility 30 days after discharge, compared with those who did not receive an assessment. The discharge destination outcome is also better in mobilised than unmobilised patients, whether done by a PT or another health professional, and the difference persists, slightly attenuated, after propensity weighting.

CONCLUSIONS

In addition to the type of health professional initiating mobilisation, data on rehabilitation treatment activity and post-operative gait speed is needed to determine optimum rehabilitation dosage and functional outcome. After adjustment patients mobilised by non-PTs did as well as patients mobilised by PTs, suggesting that PTs' current roles in very early rehabilitation should be reconsidered, with a view to redeploying them to more specialised later rehabilitation activity.

Quality-improvement program for ultrasound-based fetal anatomy screening using large-scale clinical audit

OBJECTIVE

A large-scale audit and peer review of ultrasound images may improve sonographer performance, but is rarely performed consistently as it is time-consuming and expensive. The aim of this study was to perform a large-scale audit of routine fetal anatomy scans to assess if a full clinical audit cycle can improve clinical image-acquisition standards.

METHODS

A large-scale, clinical, retrospective audit was conducted of ultrasound images obtained during all routine anomaly scans performed from 18 + 0 to 22 + 6 weeks' gestation at a UK hospital during 2013 (Cycle 1), to build a baseline understanding of the performance of sonographers. Targeted actions were undertaken in response to the findings with the aim of improving departmental performance. A second full-year audit was then performed of fetal anatomy ultrasound images obtained during the following year (Cycle 2). An independent pool of experienced sonographers used an online tool to assess all scans in terms of two parameters: scan completeness (i.e. were all images archived?) and image quality using objective scoring (i.e. were images of high quality?). Both were assessed in each audit at the departmental level and at the individual sonographer level. A random sample of 10% of scans was used to assess interobserver reproducibility.

RESULTS

In Cycle 1 of the audit, 103 501 ultrasound images from 6257 anomaly examinations performed by 22 sonographers were assessed; in Cycle 2, 153 557 images from 6406 scans performed by 25 sonographers were evaluated. The analysis was performed including the images obtained by the 20 sonographers who participated in both cycles. Departmental median scan completeness improved from 72% in the first year to 78% at the second assessment (P < 0.001); median image-quality score for all fetal views improved from 0.83 to 0.86 (P < 0.001). The improvement was greatest for those sonographers who performed poorest in the first audit; with regards to scan completeness, the poorest performing 15% of sonographers in Cycle 1 improved by more than 30 percentage points, and with regards to image quality, the poorest performing 11% in Cycle 1 showed a more than 10% improvement. Interobserver repeatability of scan completeness and image-quality scores across different fetal views were similar to those in the published literature.

CONCLUSIONS

A clinical audit and a set of targeted actions helped improve sonographer scan-acquisition completeness and scan quality. Such adherence to recommended clinical acquisition standards may increase the likelihood of correct measurement and thereby fetal growth assessment, and should allow better detection of abnormalities. As such a large-scale audit is time consuming, further advantages would be achieved if this process could be automated. © 2018 The Authors. Ultrasound in Obstetrics & Gynecology published by John Wiley & Sons Ltd on behalf of the International Society of Ultrasound in Obstetrics and Gynecology.

Simple prescribing errors and allergy documentation in medical hospital admissions in Australia and New Zealand

This study aimed to quantify and compare the prevalence of simple prescribing errors made by clinicians in the first 24 hours of a general medical patient's hospital admission. Four public or private acute care hospitals across Australia and New Zealand each audited 200 patients' drug charts. Patient demographics, pharmacist review and pre-defined prescribing errors were recorded. At least one simple error was present on the medication charts of 672/715 patients, with a linear relationship between the number of medications prescribed and the number of errors (r = 0.571, p < 0.001). The four sites differed significantly in the prevalence of different types of simple prescribing errors. Pharmacists were more likely to review patients aged > or = 75 years (39.9% vs 26.0%; p < 0.001) and those with more than 10 drug prescriptions (39.4% vs 25.7%; p < 0.001). Patients reviewed by a pharmacist were less likely to have inadequate documentation of allergies (13.5% vs 29.4%, p < 0.001). Simple prescribing errors are common, although their nature differs from site to site. Clinical pharmacists target patients with the most complex health situations, and their involvement leads to improved documentation.

Prospective audit and feedback on antibiotic use in neonatal intensive care: a retrospective cohort study

BACKGROUND

Antimicrobial stewardship programs potentially lead to appropriate antibiotic use, yet the optimal approach for neonates is uncertain. Such a program was implemented in a tertiary care neonatal intensive care unit in October 2012. We evaluated the impact of this program on antimicrobial use and its association with clinical outcomes.

METHODS

In a retrospective cohort study, we examined 1580 neonates who received antimicrobials in the 13-months before and 13-months during program implementation. Prospective audit and feedback was given 5 days a week on each patient who was receiving antibiotic. Pharmacy and microbiology data were linked to clinical data from the local Canadian Neonatal Network database. The primary outcome was days of antibiotic therapy per 1000 patient-days; secondary outcomes included mortality, necrotizing enterocolitis, and antibiotic duration for culture-positive and culture-negative late-onset sepsis. The breadth of antibiotic exposure was compared using the Antibiotic Spectrum Index.

RESULTS

Overall antibiotic use decreased to 339 days of therapy per 1000 patient-days from 395 (14%, P < 0.001), without an increase in mortality. There was no difference in duration of therapy in culture-negative or culture-positive sepsis, rates of necrotizing enterocolitis, or breadth of antibiotic exposure. Fewer antibiotic starts occurred during program implementation (63% versus 59%, P < 0.001). The use of narrow-spectrum agents decreased (P < 0.001) whereas the use of cefotaxime increased (P = 0.016) during program implementation.

CONCLUSIONS

Daily prospective audit and feedback was not associated with a change in antibiotic duration or clinical outcomes, however there were fewer babies started on antibiotics, suggesting that additional interventions are required to inform and sustain changes in antibiotic prescribing practices.

Modelling the costs and consequences of reducing healthcare-associated infections by improving hand hygiene in an average hospital in England

OBJECTIVE

To assess the potential clinical and economic impact of introducing an electronic audit and feedback system into current practice to improve hand hygiene compliance in a hypothetical general hospital in England, to reduce the incidence of healthcare-associated infections (HCAIs).

METHODS

Decision analysis estimated the impact of introducing an electronic audit and feedback system into current practice to improve hand hygiene compliance among front-line healthcare practitioners (HCPs).

RESULTS

The model assumed 4.7% of adult inpatients (ie, ≥18 years of age) and 1.72% of front-line HCPs acquire a HCAI in current practice. The model estimated that if use of the electronic audit and feedback system could lead to a reduction in the incidence of HCAIs of between 5% and 25%, then the annual number of HCAIs avoided could range between 184 and 921 infections per hospital and HCAI-related mortality could range between 6 and 31 deaths per annum per hospital. Additionally, up to 86 days of absence among front-line HCPs could be avoided and up to 7794 hospital bed days could be released for alternative use. Accordingly, the total annual hospital cost attributable to HCAIs could be reduced by between 3% and 23%, depending on the effectiveness of the electronic audit and feedback system. If introduction of the electronic audit and feedback system into current practice could lead to a reduction in the incidence of HCAIs by at least 15%, it would have a ≥0.75 probability of affording the National Health Service (NHS) a cost-effective intervention.

CONCLUSION

If the introduction of the electronic audit and feedback system into current practice in a hypothetical general hospital in England can improve hand hygiene compliance among front-line HCPs leading to a reduction in the incidence of HCAIs by ≥15%, it would potentially afford the NHS a cost-effective intervention.

Balancing regulatory controls and incentives: toward smarter and more transparent oversight in long-term care

Government oversight of long-term care involves inspections of patients' records, limited observations of patients and care practices, reviews of policies and procedures, and distribution of publicly available information. Although many providers bemoan the stifling consequences of excessive regulation, oversight in this area remains a highly legitimate endeavor for the public, though the public has limited trust in the existing regulatory regime. This distrust stems from many sources, not least of which includes considerable variation, both within and across states, in the way government oversight occurs. Reforming the current regulatory structure requires that we regulate "smarter" and more consistently. This means improving and maximizing use of the data already being collected, but it also means explicitly rationalizing the regulator's responsibility to review performance and apply sanctions when necessary. Oversight should more closely resemble consultancy, with regulators sharing information with providers about how to improve quality. Ideally, there needs to be an iterative process in which state inspectors identify performance problems and the nation's quality improvement organizations then help providers design quality improvement interventions to ameliorate the problems identified. The benefits of a revised regulatory approach are especially apparent in the aftermath of Hurricane Katrina, where more effective oversight would have identified nursing home residents at risk for low-quality care before the disaster occurred while better identifying those in need of evacuation or assistance afterward.

Assessing asthma control in UK primary care: use of routinely collected prospective observational consultation data to determine appropriateness of a variety of control assessment models

BACKGROUND

Assessing asthma control using standardised questionnaires is recommended as good clinical practice but there is little evidence validating their use within primary care. There is however, strong empirical evidence to indicate that age, weight, gender, smoking, symptom pattern, medication use, health service resource use, geographical location, deprivation, and organisational issues, are factors strongly associated with asthma control. A good control measure is therefore one whose variation is most explained by these factors.

METHOD

Eight binary (Yes = poor control, No = good control) models of asthma control were constructed from a large UK primary care dataset: the Royal College of Physicians 3-Questions (RCP-3Qs); the Jones Morbidity Index; three composite measures; three single component models. Accounting for practice clustering of patients, we investigated the effects of each model for assessing control. The binary models were assessed for goodness-of-fit statistics using Pseudo R-squared and Akaikes Information Criteria (AIC), and for performance using Area Under the Receiver Operator Characteristic (AUROC). In addition, an expanded RCP-3Q control scale (0-9) was derived and assessed with linear modelling. The analysis identified which model was best explained by the independent variables and thus could be considered a good model of control assessment.

RESULTS

1,205 practices provided information on 64,929 patients aged 13+ years. The RCP-3Q model provided the best fit statistically, with a Pseudo R-squared of 18%, and an AUROC of 0.79. By contrast, the composite model based on the GINA definition of controlled asthma had a higher AIC, an AUROC of 0.72, and only 10% variability explained. In addition, although the Peak Expiratory Flow Rate (PEFR) model had the lowest AIC, it had an AUROC of 71% and only 6% of variability explained. However, compared with the RCP-3Qs binary model, the linear RCP-3Q Total Score Model (Scale 0-9), was found to be a more robust 'tool' for assessing asthma control with a lower AIC (28,6163) and an R-squared of 33%.

CONCLUSION

In the absence of a gold standard for assessing asthma control in primary care, the results indicate that the RCP-3Qs is an effective control assessment tool but, for maximum effect, the expanded scoring model should be used.

Understanding the implementation and adoption of an information technology intervention to support medicine optimisation in primary care: qualitative study using strong structuration theory

OBJECTIVES

Using strong structuration theory, we aimed to understand the adoption and implementation of an electronic clinical audit and feedback tool to support medicine optimisation for patients in primary care.

DESIGN

This is a qualitative study informed by strong structuration theory. The analysis was thematic, using a template approach. An a priori set of thematic codes, based on strong structuration theory, was developed from the literature and applied to the transcripts. The coding template was then modified through successive readings of the data.

SETTING

Clinical commissioning group in the south of England.

PARTICIPANTS

Four focus groups and five semi-structured interviews were conducted with 18 participants purposively sampled from a range of stakeholder groups (general practitioners, pharmacists, patients and commissioners).

RESULTS

Using the system could lead to improved medication safety, but use was determined by broad institutional contexts; by the perceptions, dispositions and skills of users; and by the structures embedded within the technology. These included perceptions of the system as new and requiring technical competence and skill; the adoption of the system for information gathering; and interactions and relationships that involved individual, shared or collective use. The dynamics between these external, internal and technological structures affected the adoption and implementation of the system.

CONCLUSIONS

Successful implementation of information technology interventions for medicine optimisation will depend on a combination of the infrastructure within primary care, social structures embedded in the technology and the conventions, norms and dispositions of those utilising it. Future interventions, using electronic audit and feedback tools to improve medication safety, should consider the complexity of the social and organisational contexts and how internal and external structures can affect the use of the technology in order to support effective implementation.

A combined measure of procedural volume and outcome to assess hospital quality of colorectal cancer surgery, a secondary analysis of clinical audit data

OBJECTIVE

To identify, on the basis of past performance, those hospitals that demonstrate good outcomes in sufficient numbers to make it likely that they will provide adequate quality of care in the future, using a combined measure of volume and outcome (CM-V&O). To compare this CM-V&O with measures using outcome-only (O-O) or volume-only (V-O), and verify 2010-quality of care assessment on 2011 data.

DESIGN

Secondary analysis of clinical audit data.

SETTING

The Dutch Surgical Colorectal Audit database of 2010 and 2011, the Netherlands.

PARTICIPANTS

8911 patients (test population, treated in 2010) and 9212 patients (verification population, treated in 2011) who underwent a resection of primary colorectal cancer in 89 Dutch hospitals.

MAIN OUTCOME MEASURES

Outcome was measured by Observed/Expected (O/E) postoperative mortality and morbidity. CM-V&O states 2 criteria; 1) outcome is not significantly worse than average, and 2) outcome is significantly better than substandard, with 'substandard care' being defined as an unacceptably high O/E threshold for mortality and/or morbidity (which we set at 2 and 1.5 respectively).

RESULTS

Average mortality and morbidity in 2010 were 4.1 and 24.3% respectively. 84 (94%) hospitals performed 'not worse than average' for mortality, but only 21 (24%) of those were able to prove they were also 'better than substandard' (O/E<2). For morbidity, 42 hospitals (47%) met the CM-V&O. Morbidity in 2011 was significantly lower in these hospitals (19.8 vs. 22.8% p<0.01). No relationship was found between hospitals' 2010 performance on O-O en V-O, and the quality of their care in 2011.

CONCLUSION

CM-V&O for morbidity can be used to identify hospitals that provide adequate quality and is associated with better outcomes in the subsequent year.

Remote Video Auditing in the Surgical Setting

Remote video auditing, a method first adopted by the food preparation industry, was later introduced to the health care industry as a novel approach to improving hand hygiene practices. This strategy yielded tremendous and sustained improvement, causing leaders to consider the potential effects of such technology on the complex surgical environment. This article outlines the implementation of remote video auditing and the first year of activity, outcomes, and measurable successes in a busy surgery department in the eastern United States. A team of anesthesia care providers, surgeons, and OR personnel used low-resolution cameras, large-screen displays, and cell phone alerts to make significant progress in three domains: application of the Universal Protocol for preventing wrong site, wrong procedure, wrong person surgery; efficiency metrics; and cleaning compliance. The use of cameras with real-time auditing and results-sharing created an environment of continuous learning, compliance, and synergy, which has resulted in a safer, cleaner, and more efficient OR.

Effects of study methodology on adverse outcome occurrence and mortality

PURPOSE

To assess the impact of variables related to setting, study design and definition on adverse outcome occurrence and mortality in hospitalized patients.

DATA SOURCES

Pubmed and Embase.

STUDY SELECTION

Articles in English from 1980 onwards, in non-selected patients or surgical patients only.

DATA EXTRACTION

Data were extracted independently by two authors using a predefined form. Included study methodology variables were general variables such as setting, patient variables like age, study variables like number of reviewers and definition and the resulting adverse outcome occurrence and mortality.

RESULTS

Eleven studies reporting on 76 617 non-selected patients and 18 studies representing 136 292 surgical patients were included. Adverse outcomes were estimated to occur in 16% (12-19%) of non-selected patients and in 18% (14-22%) of surgical patients, taking into account the heterogeneity between studies. The study methodology variables were not statistically significant in explaining variation in adverse outcome occurrence, but the individual studies, when used as a random effect variable, were significant. Conversely, the study variable was not significant to explain variation in mortality rates, whereas the study methodology variables were: having more than one reviewer increased mortality by 30-80%, older study populations resulted in higher mortality and including a cause in the definition halved the mortality rate.

CONCLUSION

Study methodology variables do not explain differences in adverse outcome occurrence between studies. Other inter-study differences are more important. However, study methodology is an important predictor for mortality differences and should be taken into account when interpreting differences between studies.

Clinical audit in the final year of undergraduate medical education: towards better care of future generations

BACKGROUND

In Australia, in an environment undergoing rapidly changing requirements for health services, there is an urgent need for future practitioners to be knowledgeable, skilful and self-motivated in ensuring the quality and safety of their practice. Postgraduate medical education and vocational programs have responded by incorporating training in quality improvement into continuing professional development requirements, but undergraduate medical education has been slower to respond.

AIMS

This article describes the clinical audit programme undertaken by all students in the final year of the medical course at the University of Notre Dame, Fremantle, Australia, and examines the educational worth of this approach.

METHODS

Data were obtained from curricular documents, including the clinical audit handbook, and from evaluation questionnaires administered to students and supervisors.

RESULTS

The clinical audit programme is based on sound educational principles, including situated and participatory learning and reflective practice. It has demonstrated multi-dimensional benefits for students in terms of learning the complexities of conducting an effective audit in professional practice, and for health services in terms of facilitating quality improvement.

CONCLUSION

Although this programme was developed in a medical course, the concept is readily transferable to a variety of other health professional curricula in which students undertake clinical placements.

Addressing the deficiencies in the evidence-base for primary practice in regional Australia - sentinel practices data sourcing (SPDS) project: a pilot study

BACKGROUND

Chronic disease risk on a population level can be quantified through health surveys, either continuous or periodic. To date, information gathered from primary care interactions, using sentinel sites, has not been investigated as a potentially valuable surveillance system in Australia.

METHODS

A pilot study was conducted in a single General Practice in a regional area of New South Wales, Australia to assess the feasibility of accessing data obtained through a computerised chronic disease management program that has been designed for desktop application (Pen Computer Systems (PCS) Clinical Audit Tool: ™ PCS CAT). Collated patient data included information on chronic disease management and prevention, prevalence of overweight and obesity, mental health indicators, medication profiling and home medicine reviews, as well as uptake of preventive health services (immunisation and cervical cancer screening).

RESULTS

Higher than national average estimates were found for the age-adjusted prevalence of chronic diseases such as hypertension (14.3% for sample vs 10.4%, nationally), anxiety disorders (4.4% vs 3.8%) and obesity/overweight (67.1 vs 63.4%). Preventive health assessment items were undersubscribed, ranging from 6-20% in eligible patients.

CONCLUSIONS

This pilot study has demonstrated that the scope of data collected by patient visits to their General Practitioners, facilitated through the Medicare-funded primary health care system in Australia, offers a feasible opportunity for monitoring of chronic disease prevalence and its associated risk factors. The inclusion of a larger number of sentinel sites that are generalizable to the population being served would provide an accurate and region-specific system for the purposes of population health planning at the primary care level in order to improve the overall health of the community.

Understanding how and why audits work: protocol for a realist review of audit programmes to improve hospital care

INTRODUCTION

Many types of audits are commonly used in hospital care to promote quality improvements. However, the evidence on the effectiveness of audits is mixed. The objectives of this proposed realist review are (1) to understand how and why audits might, or might not, work in terms of delivering the intended outcome of improved quality of hospital care and (2) to examine under what circumstances audits could potentially be effective. This protocol will provide the rationale for using a realist review approach and outline the method.

METHODS AND ANALYSIS

This review will be conducted using an iterative four-stage approach. The first and second steps have already been executed. The first step was to develop an initial programme theory based on the literature that explains how audits are supposed to work. Second, a systematic literature search was conducted using relevant databases. Third, data will be extracted and coded for concepts relating to context, outcomes and their interrelatedness. Finally, the data will be synthesised in a five-step process: (1) organising the extracted data into evidence tables, (2) theming, (3) formulating chains of inference from the identified themes, (4) linking the chains of inference and formulating CMO configurations and (5) refining the initial programme theory. The reporting of the review will follow the 'Realist and Meta-Review Evidence Synthesis: Evolving Standards' (RAMESES) publication standards.

ETHICS AND DISSEMINATION

This review does not require formal ethical approval. A better understanding of how and why these audits work, and how context impacts their effectiveness, will inform stakeholders in deciding how to tailor and implement audits within their local context. We will use a range of dissemination strategies to ensure that findings from this realist review are broadly disseminated to academic and non-academic audiences.

PROSPERO REGISTRATION NUMBER

CRD42016039882.

CLINICAL AUDIT OF IMAGE QUALITY IN RADIOLOGY USING VISUAL GRADING CHARACTERISTICS ANALYSIS

The aim of this work was to assess whether an audit of clinical image quality could be efficiently implemented within a limited time frame using visual grading characteristics (VGC) analysis. Lumbar spine radiography, bedside chest radiography and abdominal CT were selected. For each examination, images were acquired or reconstructed in two ways. Twenty images per examination were assessed by 40 radiology residents using visual grading of image criteria. The results were analysed using VGC. Inter-observer reliability was assessed. The results of the visual grading analysis were consistent with expected outcomes. The inter-observer reliability was moderate to good and correlated with perceived image quality (r(2) = 0.47). The median observation time per image or image series was within 2 min. These results suggest that the use of visual grading of image criteria to assess the quality of radiographs provides a rapid method for performing an image quality audit in a clinical environment.

Using electronic clinical practice audits as needs assessment to produce effective continuing medical education programming

BACKGROUND

The traditional needs assessment used in developing continuing medical education programs typically relies on surveying physicians and tends to only capture perceived learning needs. Instead, using tools available in electronic medical record systems to perform a clinical audit on a physician's practice highlights physician-specific practice patterns.

AIM

The purpose of this study was to test the feasibility of implementing an electronic clinical audit needs assessment process for family physicians in Canada.

METHOD

A clinical audit of 10 preventative care interventions and 10 chronic disease interventions was performed on family physician practices in Alberta, Canada. The physicians used the results from the audit to produce personalized learning needs, which were then translated into educational programming.

RESULTS

A total of 26 family practices and 4489 patient records were audited. Documented completion rates for interventions ranged from 13% for ensuring a patient's tetanus vaccine is current to 97% of pregnant patients receiving the recommended prenatal vitamins.

CONCLUSIONS

Electronic medical record-based needs assessments may provide a better basis for developing continuing medical education than a more traditional survey-based needs assessment. This electronic needs assessment uses the physician's own patient outcome information to assist in determining learning objectives that reflect both perceived and unperceived needs.

Improved detection of adenomas and sessile serrated polyps is maintained with continuous audit of colonoscopy

BACKGROUND

The audit process may help improve performance indicators for colonoscopy quality but it is unclear whether this is sustained over several years.

METHODS

44138 procedures for 28 endoscopists from 2004 to 2019 were analysed for polyp detection rate and withdrawal time. From 2012, 14 endoscopists were analysed with additional data on polyp histology and number of polyps removed.

RESULTS

Polyp detection increased from 40.7% in 2004 to 62.2% in 2019; removal of polyps>1 cm remained constant (11%). Adenoma detection rate was 25.8% in 2012 and 28.3% in 2019. Sessile serrated polyp (SSP) detection rate increased from 4.5% to 14.7%; most of the increase was in the first 2 years of the histology part of the audit. There was a significant correlation of adenoma detection rate with mean number of adenomas (r=0.72, p=0.004) and a significant correlation of SSP detection with mean number of SSPs (r=0.85, p=0.0001).

CONCLUSION

The audit process appears to encourage a higher rate of polyp detection. This was due to increased detection of smaller polyps and increased detection of SSPs.