Clinical Performance Feedback Intervention Theory (CP-FIT): a new theory for designing, implementing, and evaluating feedback in health care based on a systematic review and meta-synthesis of qualitative research

BACKGROUND

Providing health professionals with quantitative summaries of their clinical performance when treating specific groups of patients ("feedback") is a widely used quality improvement strategy, yet systematic reviews show it has varying success. Theory could help explain what factors influence feedback success, and guide approaches to enhance effectiveness. However, existing theories lack comprehensiveness and specificity to health care. To address this problem, we conducted the first systematic review and synthesis of qualitative evaluations of feedback interventions, using findings to develop a comprehensive new health care-specific feedback theory.

METHODS

We searched MEDLINE, EMBASE, CINAHL, Web of Science, and Google Scholar from inception until 2016 inclusive. Data were synthesised by coding individual papers, building on pre-existing theories to formulate hypotheses, iteratively testing and improving hypotheses, assessing confidence in hypotheses using the GRADE-CERQual method, and summarising high-confidence hypotheses into a set of propositions.

RESULTS

We synthesised 65 papers evaluating 73 feedback interventions from countries spanning five continents. From our synthesis we developed Clinical Performance Feedback Intervention Theory (CP-FIT), which builds on 30 pre-existing theories and has 42 high-confidence hypotheses. CP-FIT states that effective feedback works in a cycle of sequential processes; it becomes less effective if any individual process fails, thus halting progress round the cycle. Feedback's success is influenced by several factors operating via a set of common explanatory mechanisms: the feedback method used, health professional receiving feedback, and context in which feedback takes place. CP-FIT summarises these effects in three propositions: (1) health care professionals and organisations have a finite capacity to engage with feedback, (2) these parties have strong beliefs regarding how patient care should be provided that influence their interactions with feedback, and (3) feedback that directly supports clinical behaviours is most effective.

CONCLUSIONS

This is the first qualitative meta-synthesis of feedback interventions, and the first comprehensive theory of feedback designed specifically for health care. Our findings contribute new knowledge about how feedback works and factors that influence its effectiveness. Internationally, practitioners, researchers, and policy-makers can use CP-FIT to design, implement, and evaluate feedback. Doing so could improve care for large numbers of patients, reduce opportunity costs, and improve returns on financial investments.

TRIAL REGISTRATION

PROSPERO, CRD42015017541.

When getting there is not enough: a nationwide cross-sectional study of 998 maternal deaths and 1451 near-misses in public tertiary hospitals in a low-income country

OBJECTIVE

To investigate the burden and causes of life-threatening maternal complications and the quality of emergency obstetric care in Nigerian public tertiary hospitals.

DESIGN

Nationwide cross-sectional study.

SETTING

Forty-two tertiary hospitals.

POPULATION

Women admitted for pregnancy, childbirth and puerperal complications.

METHODS

All cases of severe maternal outcome (SMO: maternal near-miss or maternal death) were prospectively identified using the WHO criteria over a 1-year period.

MAIN OUTCOME MEASURES

Incidence and causes of SMO, health service events, case fatality rate, and mortality index (% of maternal death/SMO).

RESULTS

Participating hospitals recorded 91 724 live births and 5910 stillbirths. A total of 2449 women had an SMO, including 1451 near-misses and 998 maternal deaths (2.7, 1.6 and 1.1% of live births, respectively). The majority (91.8%) of SMO cases were admitted in critical condition. Leading causes of SMO were pre-eclampsia/eclampsia (23.4%) and postpartum haemorrhage (14.4%). The overall mortality index for life-threatening conditions was 40.8%. For all SMOs, the median time between diagnosis and critical intervention was 60 minutes (IQR: 21-215 minutes) but in 21.9% of cases, it was over 4 hours. Late presentation (35.3%), lack of health insurance (17.5%) and non-availability of blood/blood products (12.7%) were the most frequent problems associated with deficiencies in care.

CONCLUSIONS

Improving the chances of maternal survival would not only require timely application of life-saving interventions but also their safe, efficient and equitable use. Maternal mortality reduction strategies in Nigeria should address the deficiencies identified in tertiary hospital care and prioritise the prevention of severe complications at lower levels of care.

TWEETABLE ABSTRACT

Of 998 maternal deaths and 1451 near-misses reported in a network of 42 Nigerian tertiary hospitals in 1 year.

Diagnostic reference levels and complexity indices in interventional radiology: a national programme

OBJECTIVES

To propose national diagnostic reference levels (DRLs) for interventional radiology and to evaluate the impact of the procedural complexity on patient doses.

METHODS

Eight interventional radiology units from Spanish hospitals were involved in this project. The participants agreed to undergo common quality control procedures for X-ray systems. Kerma area product (KAP) was collected from a sample of 1,649 procedures. A consensus document established the criteria to evaluate the complexity of seven types of procedures. DRLs were set as the 3rd quartile of KAP values.

RESULTS

The KAP (3rd quartile) in Gy cm² for the procedures included in the survey were: lower extremity arteriography (n = 784) 78; renal arteriography (n = 37) 107; transjugular hepatic biopsies (THB) (n = 30) 45; biliary drainage (BD) (n = 314) 30; uterine fibroid embolization (UFE) (n = 56) 214; colon endoprostheses (CE) (n = 31) 169; hepatic chemoembolization (HC) (n = 269) 303; femoropopliteal revascularization (FR) (n = 62) 119; and iliac stent (n = 66) 170. The complexity involved the increases in the following KAP factors from simple to complex procedures: THB x4; BD x13; UFE x3; CE x3; HC x5; FR x5 and IS x4.

CONCLUSIONS

The evaluation of the procedure complexity in patient doses will allow the proper use of DRLs for the optimization of interventional radiology.

KEY POINTS

• National DRLs for interventional procedures have been proposed given level of complexity • For clinical audits, the level of complexity should be taken into account. • An evaluation of the complexity levels of the procedure should be made.

Clinical audit, a valuable tool to improve quality of care: General methodology and applications in nephrology

Evaluation and improvement of quality of care provided to the patients are of crucial importance in the daily clinical practice and in the health policy planning and financing. Different tools have been developed, including incident analysis, health technology assessment and clinical audit. The clinical audit consist of measuring a clinical outcome or a process, against well-defined standards set on the principles of evidence-based medicine in order to identify the changes needed to improve the quality of care. In particular, patients suffering from chronic renal diseases, present many problems that have been set as topics for clinical audit projects, such as hypertension, anaemia and mineral metabolism management. Although the results of these studies have been encouraging, demonstrating the effectiveness of audit, overall the present evidence is not clearly in favour of clinical audit. These findings call attention to the need to further studies to validate this methodology in different operating scenarios. This review examines the principle of clinical audit, focusing on experiences performed in nephrology settings.

Cumulative effective dose from recurrent CT examinations in Europe: proposal for clinical guidance based on an ESR EuroSafe Imaging survey

In recent years, the issue of cumulative effective dose received from recurrent computed tomography examinations has become a subject of increasing concern internationally. Evidence, predominantly from the USA, has shown that a significant number of patients receive a cumulative effective dose of 100 mSv or greater. To obtain a European perspective, EuroSafe Imaging carried out a survey to collect European data on cumulative radiation exposure of patients from recurrent computed tomography examinations. The survey found that a relatively low percentage of patients (0.5%) received a cumulative effective dose equal to or higher than 100 mSv from computed tomography, most of them having an oncological disease. However, there is considerable variation between institutions as these values ranged from 0 to 2.72%, highlighting that local practice or, depending on the institution and its medical focus, local patient conditions are likely to be a significant factor in the levels of cumulative effective dose received, rather than this simply being a global phenomenon. This paper also provides some practical actions to support the management of cumulative effective dose and to refine or improve practice where recurrent examinations are required. These actions are focused around increasing awareness of referring physicians through encouraging local dialogue, actions focused on optimisation where a team approach is critical, better use of modern equipment and the use of Dose Management and Clinical Decision Support Systems together with focused clinical audits. The proper use of cumulative effective dose should be part of training programmes for referrers and practitioners, including what information to give to patients. Radiation is used to the benefit of patients in diagnostic procedures such as CT examinations, and in therapeutic procedures like the external radiation treatment for cancer. However, radiation is also known to increase the risk of cancer. To oversee this risk, the cumulative effective dose (CED) received by a patient from imaging procedures over his or her life is important. In this paper, the authors, on behalf of EuroSafe Imaging, report on a survey carried out in Europe that aims to estimate the proportion of patients that undergo CT examinations and are exposed to a CED of more than 100 mSv. At the same time, the survey enquires about and underlines radiologists' measures and radiology departments' strategies to limit such exposure. Over the period of 2015-2018, respondents reported that 0.5% (0-2.72%) of patients were exposed to a CED of ≥ 100 mSv from imaging procedures. The background radiation dose in Europe depends on the location, but it is around 2.5 mSv per year. It is obvious that patients with cancer, chronic diseases and trauma run the highest risk of having a high CED. However, even if the number of patients exposed to ≥ 100 mSv is relatively low, it is important to lower this number even further. Measures could consist in using procedures that do not necessitate radiation, using very low dose procedures, being very critical in requiring imaging procedures and increasing awareness about the issue. KEY POINTS: • A relatively low percentage of patients (0.5%) received a cumulative effective dose from CT computed tomography equal to or greater than 100 mSv, in Europe, most of them having an oncological disease. • There is a wide range in the number of patients who receive cumulative effective dose equal to or greater than 100 mSv (0-2.72%) and optimisation should be improved. • Increasing the awareness of referring physicians through encouraging local dialogue, concrete actions focused on optimisation and development of dose management systems is suggested.

Current status of laparoscopy for acute abdomen in Italy: a critical appraisal of 2012 clinical guidelines from two consecutive nationwide surveys with analysis of 271,323 cases over 5 years

BACKGROUND

Several authors have demonstrated the safety and feasibility of laparoscopy in selected cases of abdominal emergencies. The aim of the study was to analyse the current Italian practice on the use of laparoscopy in abdominal emergencies and to evaluate the impact of the 2012 national guidelines on the daily surgical activity.

METHODS

Two surveys (42 closed-ended questions) on the use of laparoscopy in acute abdomen were conducted nationwide with an online questionnaire, respectively, before (2010) and after (2014) the national guidelines publication. Data from two surveys were compared using Chi-square or Fisher's exact test, and data were considered significant when p < 0.05.

RESULTS

Two-hundred and one and 234 surgical units answered to the surveys in 2010 and 2014, respectively. Out of 144,310 and 127,013 overall surgical procedures, 23,407 and 20,102, respectively, were abdominal emergency operations. Respectively 24.74 % (in 2010) versus 30.27 % (in 2014) of these emergency procedures were approached laparoscopically, p = 0.42. The adoption of laparoscopy increased in all the considered clinical scenarios, with statistical significance in acute appendicitis (44 vs. 64.7 %; p = 0.004). The percentage of units approaching Hinchey III acute diverticulitis with laparoscopy in 26-75 % of cases (14.0 vs. 29.7 %; p = 0.009), those with >25 % of surgeons confident with laparoscopic approach to acute diverticulitis (29.9 vs. 54 %; p = 0.0009), the units with >50 % of surgeons confident with laparoscopic approach to acute appendicitis, cholecystitis and perforated duodenal ulcer, all significantly increased in the time frame. The majority of respondents declared that the 2012 national guidelines influenced their clinical practice.

CONCLUSIONS

The surveys showed an increasing use of laparoscopy for patients with abdominal emergencies. The 2012 national guidelines profoundly influenced the Italian surgical practice in the laparoscopic approach to the acute abdomen.

A 10-year retrospective analysis of clinical profiles, laboratory characteristics and management of pyogenic liver abscesses in a chinese hospital

Background/Aims

Pyogenic liver abscess (PLA) is a serious, life threatening condition with a high mortality rate that represents a diagnostic and therapeutic challenge. The aim of this study was to collect demographic data and clinical, laboratory and microbiological characteristics of PLA patients treated between 2000 and 2010. We also aimed to collect information regarding our management experience of these cases.

Methods

As a retrospective review, 47 patients with PLA in a tertiary referral center were examined to determine their demographic characteristics, clinical features, and laboratory, imaging, and microbiologic findings as well as the treatment outcome.

Results

Cryptogenic PLA was the most frequently identified type of PLA, while benign biliary tract disease was the most frequently identifiable cause of PLA (18/47 patients; 38.3%). Leukocytosis and elevated alanine transaminase were common laboratory findings and were observed in 35 (74.5%) and 22 (46.8%) patients, respectively. Increased fibrinogen was also detected in 11 of 15 investigated cases (73.3%). Notably, infection-induced thrombocytopenia occurred in 8 patients (17%). Diabetes mellitus was associated with the occurrence of infection induced shock when compared to the non-diabetic group (p<0.05). Patients with two or more comorbid diseases had longer hospitalizations when compared to patients with one comorbid disease or those without comorbidities (p<0.001). The number of days needed to establish diagnosis was correlated with the length of hospitalization (p<0.001). The overall hospital mortality rate was 2.1% (1/47).

Conclusions

Characteristics of PLA patients from the past 10 years are presented. The number of days needed to establish a PLA diagnosis was correlated with the length of the hospital stay. The hospital stay of PLA patients can be further improved by early diagnosis and effective treatments during the early stages of PLA progression.

National quality registries: how to improve the quality of data?

BACKGROUND

Data of quality registries are increasingly used by healthcare providers, patients, health insurance companies, and governments for monitoring quality of care, hospital benchmarking and outcome research. To provide all stakeholders with reliable information and outcomes, reliable data are of the utmost importance.

METHODS

This article describes methods for quality assurance of data-used by the Dutch Institute for Clinical Auditing (DICA)-regarding: the design of a registry, data collection, data analysis, and external data verification. For the Dutch Lung Cancer Audit for Surgery (DLCA-S) results of data analysis and data verification were assessed with descriptive statistics.

RESULTS

Of all registered patients in the DLCA-S in 2016 (n=2,391), 98.2% was analysable and completeness of data for calculations of transparent outcomes was 90.7%. Data verification for the year 2014 showed a case ascertainment of 99.4%. Of 15 selected hospitals, 14 were verified. All these hospitals received the conclusion 'sufficient quality' on case ascertainment, mortality (0% under-registration) and complicated course (3.3% wrongly registered complications). One hospital was not able to deliver patients lists, and therefore not verified.

CONCLUSIONS

Quality of data can be promoted in many different ways. A completeness indicator and data verification are useful tools to improve data quality. Both methods were used to demonstrate the reliability of registered data in the DLCA-S. Opportunities for further improvement are standardised reporting and adequate data extraction.

Incidence and significance of postoperative complications occurring between discharge and 30 days: a prospective cohort study

BACKGROUND

Accurate documentation of complications is fundamental to clinical audit and research. While it is established that accurate diagnosis of surgical site infection (SSI) requires follow-up for 30 days; for other complications, there are minimal data quantifying their importance between discharge and 30 days.

METHODS

In this prospective cohort study, inpatients undergoing general or vascular surgery were reviewed daily for complications by the medical team and a research fellow. A standardized telephone questionnaire was performed 30 days following surgery. All complications were documented and classified according to severity.

RESULTS

A total of 237 of 388 patients who completed the telephone survey developed a complication, including 77 who developed a complication for the first time after discharge from hospital. Overall 135 (33%) of a total of 405 complications were identified after discharge. These complications included 36 of 63 (57%) SSI, 6 of 12 small bowel obstructions, and three of four major thromboembolic events and a number of space SSI, urinary infections, functional gastrointestinal problems, and pain management problems. Cardiac, respiratory, and neurologic complications were mainly diagnosed in hospital. Of the 135 "postdischarge" complications, 89 were managed in the community and 46 (34%) resulted in admission to hospital, including seven which required a major intervention. There was one death.

CONCLUSIONS

One-third of complications occurred after discharge, and one-third of these resulted in readmission to hospital. Research and audit based on inpatient data alone significantly underestimates morbidity rates. Discharge planning should include contingency plans for managing problems commonly diagnosed after discharge form hospital.

Diabetes care in refugee camps: the experience of UNRWA

United Nations Relief and Works Agency for Palestine Refugees in the Near East (UNRWA) was established in 1949 and has delivered health care services for over 65 years. The epidemiological transition in disease burden is changing the context in which UNRWA's health programme operates and poses new challenges that require new ways of providing health services. Hypertension and diabetes are two major health problems for Palestine refugees. UNRWA has been providing diabetes and hypertension care since 1992 in its primary health care centres. Of late, through a structured process of care delivery the UNRWA health system is making significant strides in addressing diabetes and hypertension and consequently the nine voluntary global targets as envisaged in the WHO Global Action Plan for the Prevention and Control of NCDs 2013-2020. Given that most developing countries either have no or only rudimentary services for diabetes and hypertension at the primary care level and may face similar resource and capacity constraints, UNRWA's efforts can serve as a model and inspiration to set up similar initiatives.

Adjusted Hospital Outcomes of Abdominal Aortic Aneurysm Surgery Reported in the Dutch Surgical Aneurysm Audit

OBJECTIVE/BACKGROUND

The Dutch Surgical Aneurysm Audit (DSAA) is mandatory for all patients with primary abdominal aortic aneurysms (AAAs) in the Netherlands. The aims are to present the observed outcomes of AAA surgery against the predicted outcomes by means of V-POSSUM (Vascular-Physiological and Operative Severity Score for the enUmeration of Mortality and Morbidity). Adjusted mortality was calculated by the original and re-estimated V(physiology)-POSSUM for hospital comparisons.

METHODS

All patients operated on from January 2013 to December 2014 were included for analysis. Calibration and discrimination of V-POSSUM and V(p)-POSSUM was analysed. Mortality was benchmarked by means of the original V(p)-POSSUM formula and risk-adjusted by the re-estimated V(p)-POSSUM on the DSAA.

RESULTS

In total, 5898 patients were included for analysis: 4579 with elective AAA (EAAA) and 1319 with acute abdominal aortic aneurysm (AAAA), acute symptomatic (SAAA; n = 371) or ruptured (RAAA; n = 948). The percentage of endovascular aneurysm repair (EVAR) varied between hospitals but showed no relation to hospital volume (EAAA: p = .12; AAAA: p = .07). EAAA, SAAA, and RAAA mortality was, respectively, 1.9%, 7.5%, and 28.7%. Elective mortality was 0.9% after EVAR and 5.0% after open surgical repair versus 15.6% and 27.4%, respectively, after AAAA. V-POSSUM overestimated mortality in most EAAA risk groups (p < .01). The discriminative ability of V-POSSUM in EAAA was moderate (C-statistic: .719) and poor for V(p)-POSSUM (C-statistic: .665). V-POSSUM in AAAA repair overestimated in high risk groups, and underestimated in low risk groups (p < .01). The discriminative ability in AAAA of V-POSSUM was moderate (.713) and of V(p)-POSSUM poor (.688). Risk adjustment by the re-estimated V(p)-POSSUM did not have any effect on hospital variation in EAAA but did in AAAA.

CONCLUSION

Mortality in the DSAA was in line with the literature but is not discriminative for hospital comparisons in EAAA. Adjusting for V(p)-POSSUM, revealed no association between hospital volume and treatment or outcome. Risk adjustment for case mix by V(p)-POSSUM in patients with AAAA has been shown to be important.

Associations between post-operative rehabilitation of hip fracture and outcomes: national database analysis (90 characters)

BACKGROUND

Rehabilitation programmes are used to improve hip fracture outcomes. There is little published trial clinical trial or population-based data on the effects of the type or provider of rehabilitation treatments on hip fracture outcomes. We evaluated the associations of rehabilitation interventions with post-operative hip fracture outcomes.

METHODS

Cross-sectional (2013-2015) analysis of data from the English National Hip Fracture Database (NHFD) from all 191 English hospitals treating hip fractures. Of 62,844 NHFD patients, we included 17,708 patients with rehabilitation treatment and 30-day mobility data, and 34,142 patients with rehabilitation treatment and discharge destination data. The intervention was early mobilisation rehabilitation treatments delivered by a physiotherapist (PT, physical therapist in North America) or other clinical staff as identifiable in NHFD. We used ordinal logistic and propensity scoring regression models to adjust for confounding variables including age, sex, pre-fracture mobility, operative delay, and cognitive function and peri-operative risk scores.

RESULTS

In both the adjusted multivariate and propensity-weighted analyses, mobilisation on the day or the day following surgery is associated with better mobility function 30 days after discharge. However patients mobilised by a PT did not have better mobility compared to mobilisation by other professionals. Patients who received a PT assessment were not protected from poorer mobility 30 days after discharge, compared with those who did not receive an assessment. The discharge destination outcome is also better in mobilised than unmobilised patients, whether done by a PT or another health professional, and the difference persists, slightly attenuated, after propensity weighting.

CONCLUSIONS

In addition to the type of health professional initiating mobilisation, data on rehabilitation treatment activity and post-operative gait speed is needed to determine optimum rehabilitation dosage and functional outcome. After adjustment patients mobilised by non-PTs did as well as patients mobilised by PTs, suggesting that PTs' current roles in very early rehabilitation should be reconsidered, with a view to redeploying them to more specialised later rehabilitation activity.

Nationwide study of the treatment of mycotic abdominal aortic aneurysms comparing open and endovascular repair in The Netherlands

OBJECTIVE

Mycotic aneurysms of the abdominal aorta (MAAA) can be treated by open repair (OR) or endovascular aneurysm repair (EVAR). This nationwide study provides an overview of the situation of MAAA treatment in The Netherlands in 2016.

METHODS

A retrospective cohort study was conducted with all centers that registered aortic abdominal aneurysms in the Dutch Surgical Aneurysm Audit in 2016. Questionnaires on 1-year outcomes were sent to all centers that treated patients with MAAA. The primary aim was to determine 30-day and 1-year mortality and morbidity of OR- and EVAR-treated patients. Morbidity was determined by the need for reoperations and the number of readmissions to the hospital.

RESULTS

Twenty-six MAAA were detected in the Dutch Surgical Aneurysm Audit database of 2016, resulting in an incidence of 0.7% of all registered abdominal aortic aneurysms. The 30-day mortality for OR and EVAR treated patients was 1 in 13 and 0 in 13, respectively. Major and minor reinterventions within 30 days were needed for two (one OR and one EVAR) and two (one OR and one EVAR) patients, respectively. Two patients (15.4%) in the OR group and one patient (7.7%) in the EVAR group were readmitted to hospital within 30 days. In total, 1-year outcomes of 23 patients were available. In the OR group, one patient (9.1%) died in the first postoperative year. There was one major reintervention (removal of endoprosthesis and spiralvein reconstruction) in the EVAR group. Two patients (18.2%) treated with OR and two (16.7%) treated with EVAR required a minor reintervention. In both groups, four patients (OR, 36.4%; EVAR, 33.3%) were readmitted to hospital within 1 year postoperatively.

CONCLUSIONS

Both OR- and EVAR-treated patients show acceptable clinical outcomes after 30 days and at the 1-year follow-up. Depending on the clinical course of the patient, EVAR may be considered in the management of this disease.

"Struggling with practices" - a qualitative study of factors influencing the implementation of clinical quality registries for cardiac rehabilitation in England and Denmark

Background

The use of clinical quality registries as means for data driven improvement in healthcare seem promising. However, their use has been shown to be challenged by a number of aspects, and we suggest some may be related to poor implementation. There is a paucity of literature regarding barriers and facilitators for registry implementation, in particular aspects related to data collection and entry. We aimed to illuminate this by exploring how staff perceive the implementation process related to the registries within the field of cardiac rehabilitation in England and Denmark.

Methods

A qualitative, interview-based study with staff involved in collecting and/or entering data into the two case registries (England N = 12, Denmark N = 12). Interviews were analysed using content analysis. The Consolidated Framework for Implementation Research was used to guide interviews and the interpretation of results.

Results

The analysis identified both similarities and differences within and between the studied registries, and resulted in clarification of staffs´ experiences in an overarching theme: ´Struggling with practices´ and five categories; the data entry process, registry quality, resources and management support, quality improvement and the wider healthcare context. Overall, implementation received little focused attention. There was a lack of active support from management, and staff may experience a struggle of fitting use of a registry into a busy and complex everyday practice.

Conclusion

The study highlights factors that may be important to consider when planning and implementing a new clinical quality registry within the field of cardiac rehabilitation, and is possibly transferrable to other fields. The results may thus be useful for policy makers, administrators and managers within the field and beyond. Targeting barriers and utilizing knowledge of facilitating factors is vital in order to improve the process of registry implementation, hence helping to achieve the intended improvement of care processes and outcomes.

Electronic supplementary material

The online version of this article (10.1186/s12913-019-3940-5) contains supplementary material, which is available to authorized users.

Interface design recommendations for computerised clinical audit and feedback: Hybrid usability evidence from a research-led system

BACKGROUND

Audit and Feedback (A&F) is a widely used quality improvement technique that measures clinicians' clinical performance and reports it back to them. Computerised A&F (e-A&F) system interfaces may consist of four key components: (1) Summaries of clinical performance; (2) Patient lists; (3) Patient-level data; (4) Recommended actions. There is a lack of evidence regarding how to best design e-A&F interfaces; establishing such evidence is key to maximising usability, and in turn improving patient safety.

AIM

To evaluate the usability of a novel theoretically-informed and research-led e-A&F system for primary care (the Performance Improvement plaN GeneratoR: PINGR).

OBJECTIVES

(1) Describe PINGR's design, rationale and theoretical basis; (2) Identify usability issues with PINGR; (3) Understand how these issues may interfere with the cognitive goals of end-users; (4) Translate the issues into recommendations for the user-centred design of e-A&F systems.

METHODS

Eight experienced health system evaluators performed a usability inspection using an innovative hybrid approach consisting of five stages: (1) Development of representative user tasks, Goals, and Actions; (2) Combining Heuristic Evaluation and Cognitive Walkthrough methods into a single protocol to identify usability issues; (3) Consolidation of issues; (4) Severity rating of consolidated issues; (5) Analysis of issues according to usability heuristics, interface components, and Goal-Action structure.

RESULTS

A final list of 47 issues were categorised into 8 heuristic themes. The most error-prone heuristics were 'Consistency and standards' (13 usability issues; 28% of the total) and 'Match between system and real world' (n=10, 21%). The recommended actions component of the PINGR interface had the most usability issues (n=21, 45%), followed by patient-level data (n=5, 11%), patient lists (n=4, 9%), and summaries of clinical performance (n=4, 9%). The most error-prone Actions across all user Goals were: (1) Patient selection from a list; (2) Data identification from a figure (both population-level and patient-level); (3) Disagreement with a system recommendation.

CONCLUSIONS

By contextualising our findings within the wider literature on health information system usability, we provide recommendations for the design of e-A&F system interfaces relating to their four key components, in addition to how they may be integrated within a system.

Reducing ventilator associated pneumonia in adult patients through high standards of oral care: a historical control study

OBJECTIVES

Implement and evaluate the impact of oral hygiene measures (teeth brushing, 1% oral chlorhexidine and oropharyngeal suction) on the incidence of ventilator-associated pneumonia (VAP) and the costs of prevention and treatment.

DESIGN

A historical control study of all 1087 patients, mechanically ventilated for at least 48hours in a general adult critical care unit, between July 2009 and December 2011. The incidence of VAP in 528 patients before a practice change was compared with the incidence in 559 patients after a practice change. The clinical audit cycle was used to review compliance with existing standards and implement a regime of enhanced oral hygiene. The costs of changing the oral care regime and the treatment of VAP with antibiotics was calculated.

SETTING

22 bed combined intensive care and high dependency unit in England.

MAIN OUTCOME MEASURES

(1) Compliance with standards for oral care. (2) The incidence of VAP before and after the change.

RESULTS

91% (95% CI 90-93%) compliance with the standards for oral care was achieved throughout the 30 months of the study with very little difference before (90%, 95% CI 88-93%) and after (92%, 95% CI 90-95%) the changes in oral care standards were introduced. Of 528 patients mechanically ventilated for at least 48 hours before the change, 47 developed VAP. The mean incidence of VAP was 0.09 (8.9%) (95% CI 0.07-0.12). The mean VAP per 1000 ventilator days was 13.6 (95% CI 13.1-14.0). After the change 24 of 559 patients developed VAP. The mean incidence of VAP after the change was 0.04 (4.1%) (95% CI 0.03-0.06). The mean VAP per 1000 ventilator days was 6.9 (95% CI 6.5-7.1). There was a £6319 ($10,112, €7518) cost saving on preventing and treating VAP following the practice change. A statistically significant difference (p<0.01) was seen between the incidence of VAP expected and that observed after the change in oral care. This represents a relative risk reduction of 0.53 (95% CI 0.25-0.71) and number needed to treat (NNT) of 21.

CONCLUSION

An enhanced oral care bundle, incorporating 1% Chlorhexidine Gluconate, was associated with a significant reduction in VAP and the costs of treating VAP. Limitations of the study relate to analysis of other variables, in particular severity of illness, between the two groups and the lack of agreement in the literature on VAP criteria, which limits generalisation of these findings.

Effect of audit and feedback with peer review on general practitioners' prescribing and test ordering performance: a cluster-randomized controlled trial

BACKGROUND

Much research worldwide is focussed on cost containment and better adherence to guidelines in healthcare. The research focussing on professional behaviour is often performed in a well-controlled research setting. In this study a large-scale implementation of a peer review strategy was tested on both test ordering and prescribing behaviour in primary care in the normal quality improvement setting.

METHODS

We planned a cluster-RCT in existing local quality improvement collaboratives (LQICs) in primary care. The study ran from January 2008 to January 2011. LQICs were randomly assigned to one of two trial arms, with each arm receiving the same intervention of audit and feedback combined with peer review. Both arms were offered five different clinical topics and acted as blind controls for the other arm. The differences in test ordering rates and prescribing rates between both arms were analysed in an intention-to-treat pre-post analysis and a per-protocol analysis.

RESULTS

Twenty-one LQIC groups, including 197 GPs working in 88 practices, entered the trial. The intention-to-treat analysis did not show a difference in the changes in test ordering or prescribing performance between intervention and control groups. The per-protocol analysis showed positive results for half of the clinical topics. The increase in total tests ordered was 3% in the intervention arm and 15% in the control arm. For prescribing the increase in prescriptions was 20% in the intervention arm and 66% in the control group. It was observed that the groups with the highest baseline test ordering and prescription volumes showed the largest improvements.

CONCLUSIONS

Our study shows that the results from earlier work could not be confirmed by our attempt to implement the strategy in the field. We did not see a decrease in the volumes of tests ordered or of the drugs prescribed but were able to show a lesser increase instead. Implementing the peer review with audit and feedback proved to be not feasible in primary care in the Netherlands.

TRIAL REGISTRATION

This trial was registered at the Dutch trial register under number ISRCTN40008171 on August 7^th 2007.

Analysis of cesarean delivery at Assiut University Hospital using the Ten Group Classification System

OBJECTIVE

To evaluate the feasibility of using the Robson Ten Group Classification System (TGCS) for cesarean delivery (CD) indications at institutional level.

METHODS

Prospective clinical audits of women delivering by CD at Women's Health Hospital, Assiut, Egypt, were conducted in 2008 and 2011. The CD rates overall and in each Robson group were calculated, as was the contribution of each group to the overall CD rate. In addition, the CD indications in each group were analyzed.

RESULTS

The CD rate was 32% (443/1357) in 2008 and 38% (626/1628) in 2011. The most common CD indication at both time intervals was a previous CD. Multiparas without uterine scar, a single cephalic term pregnancy, and spontaneous labor (Robson Group 3) comprised the largest group of women undergoing CD, followed by nulliparas with a single cephalic term pregnancy and spontaneous labor (Group 1), and multiparas with a scarred uterus and a single cephalic term pregnancy (Group 5). Group 5 was the largest contributor (30%) to the overall CD rate, followed by Groups 1 and 4 (10% each).

CONCLUSION

The TGCS can be applied at institutional level. It helps in planning strategies for specific subgroups of women to reduce CD rates and improve outcomes.

The frequency, nature and impact of GP-assessed avoidable delays in a population-based cohort of cancer patients

BACKGROUND

There is a growing emphasis on the speed of diagnosis as an aspect of cancer prognosis. While epidemiological data in the last decade have quantified diagnostic timeliness and its variation, whether and how often prolonged diagnostic intervals can be considered avoidable is unknown.

METHODS

We used data from the English National Cancer Diagnosis Audit (NCDA) on 17,042 patients diagnosed with cancer in 2014. Participating primary care physicians were asked to identify delays in diagnosis that they deemed avoidable, together with the 'setting' of the avoidable delay and key attributable factors. We used descriptive analysis and regression frameworks to assess validity and examine variation in the frequency and nature of avoidable delays.

RESULTS

Among 14,259 patients, 24% were deemed to have had an avoidable delay to their diagnosis. Patients with a reported avoidable delay had a longer median diagnostic interval (92 days) than those without (30 days). Of all avoidable delays, 13% were deemed to have occurred pre-consultation, 49% within primary care, and 38% within secondary care. Avoidable delays were mostly attributed to the test request/performance phase (25%). Multimorbidity was associated with greater odds of avoidable delay (OR for 3+ vs no comorbidity: 1.43 (95% CI 1.25-1.63)), with heterogeneous associations with cancer site.

CONCLUSION

We have shown that GP-identified instances of avoidable delay have construct validity. Whilst the causes of avoidable diagnostic delays are multi-factorial and occur in different settings and phases of the diagnostic process, their analysis can guide improvement initiatives and enable the examination of any prognostic implications.

Assessment of quality in psychiatric nursing documentation - a clinical audit

Background

Quality in nursing documentation facilitates continuity of care and patient safety. Lack of communication between healthcare providers is associated with errors and adverse events. Shortcomings are identified in nursing documentation in several clinical specialties, but very little is known about the quality of how nurses document in the field of psychiatry. Therefore, the aim of this study was to assess the quality of the written nursing documentation in a psychiatric hospital.

Method

A cross-sectional, retrospective patient record review was conducted using the N-Catch audit instrument. In 2011 the nursing documentation from 21 persons admitted to a psychiatric department from September to December 2010 was assessed. The N-Catch instrument was used to audit the record structure, admission notes, nursing care plans, progress and outcome reports, discharge notes and information about the patients’ personal details. The items of N-Catch were scored for quantity and/or quality (0–3 points).

Results

The item ‘quantity of progress and evaluation notes’ had the lowest score: in 86% of the records progress and outcome were evaluated only sporadically. The items ‘the patients’ personal details’ and ‘quantity of record structure’ had the highest scores: respectively 100% and 71% of the records achieved the highest score of these items.

Conclusions

Deficiencies in nursing documentation identified in other clinical specialties also apply to the clinical field of psychiatry. The quality of electronic written nursing documentation in psychiatric nursing needs improvements to ensure continuity and patient safety. This study shows the importance of the existence of a validated tool, readily available to assess local levels of nursing documentation quality.

Cesarean section rates in Lithuania using Robson Ten Group Classification System

BACKGROUND AND OBJECTIVE

The aim of this study was to analyze cesarean section (CS) rates using Robson Ten Group Classification System (TGCS) and to identify the main contributors to the overall CS rate in Lithuania.

MATERIALS AND METHODS

A prospective cross-sectional study was carried out. All women who delivered between January 1 and December 31, 2012, in Lithuania were classified using the TGCS. The CS rates overall and in each Robson group were calculated, as was the contribution of each group to the overall CS rate.

RESULTS

The CS rate was 26.4% (6697 among 25,373 deliveries) in 2012. Nulliparous women with single cephalic full-term pregnancy in spontaneous labor (Group 1) or who underwent induction of labor or prelabor CS (Group 2) and multiparous women with a previous CS (Group 5) were the greatest contributors (67.7%) to the overall CS rate. In addition, significant variation of CS rates between different institutions was observed, especially in women with single cephalic full-term pregnancy without previous CS (Groups 1-4), showing big differences in obstetric care across country.

CONCLUSIONS

Women in Groups 1, 2 and 5 were the largest contributions to the overall CS rate in Lithuania. It seems that efforts to reduce the overall CS rate should be directed on increasing vaginal birth after CS and reducing CS rates in nulliparous women with single cephalic full-term pregnancy (Groups 1 and 2).

Proactive PICC placement: evaluating the patient experience

AIM

to evaluate patient experience following the proactive placement of a peripherally inserted central catheter (PICC).

METHOD

all patients with a PICC in situ who had attended the chemotherapy day unit over a period of 15 weeks were invited to complete a self-administered questionnaire. Questions related to: information giving, the degree of pain on insertion and any complications experienced by the patient while the device was in situ. There was also space to allow for free-text comments after each question.

RESULTS

the majority of patients felt they received enough information and that the procedure was fully explained. Pain on insertion was largely reported as being minimal, with the few patients who did report the procedure as painful also reporting there being difficulty with the insertion. Complication rates were low, the main complication reported was mechanical owing to difficulty with blood withdrawal.

CONCLUSION

irrespective of how uncomfortable the patient found the procedure, the majority of patients would recommend proactive PICC insertion to other patients as 'it made the whole process much easier'.

Community Assessment of COPD Health Care (COACH) study: a clinical audit on primary care performance variability in COPD care

Background

A thorough evaluation of the adequacy of clinical practice in a designated health care setting and temporal context is key for clinical care improvement. This study aimed to perform a clinical audit of primary care to evaluate clinical care delivered to patients with COPD in routine clinical practice.

Methods

The Community Assessment of COPD Health Care (COACH) study was an observational, multicenter, nationwide, non-interventional, retrospective, clinical audit of randomly selected primary care centers in Spain. Two different databases were built: the resources and organization database and the clinical database. From January 1, 2015 to December 31, 2016 consecutive clinical cases of COPD in each participating primary care center (PCC) were audited. For descriptive purposes, we collected data regarding the age at diagnosis of COPD and the age at audit, gender, the setting of the PCC (rural/urban), and comorbidities for each patient. Two guidelines widely and uniformly used in Spain were carefully reviewed to establish a benchmark of adequacy for the audited cases. Clinical performance was analyzed at the patient, center, and regional levels. The degree of adequacy was categorized as excellent (> 80%), good (60–80%), adequate (40–59%), inadequate (20–39%), and highly inadequate (< 20%).

Results

During the study 4307 cases from 63 primary care centers in 6 regions of the country were audited. Most evaluated parameters were judged to fall in the inadequate performance category. A correct diagnosis based on previous exposure plus spirometric obstruction was made in an average of 17.6% of cases, ranging from 9.8 to 23.3% depending on the region. During the audited visit, only 67 (1.6%) patients had current post-bronchodilator obstructive spirometry; 184 (4.3%) patients had current post-bronchodilator obstructive spirometry during either the audited or initial diagnostic visit. Evaluation of dyspnea was performed in 11.1% of cases. Regarding treatment, 33.6% received no maintenance inhaled therapies (ranging from 31.3% in GOLD A to 7.0% in GOLD D). The two most frequently registered items were exacerbations in the previous year (81.4%) and influenza vaccination (87.7%).

Conclusions

The results of this audit revealed a large variability in clinical performance across centers, which was not fully attributable to the severity of the disease.

Introduction of a new ward round approach in a cardiothoracic critical care unit

BACKGROUND

Francis (2013) described inconsistent ward rounds and failures to conduct ward rounds properly as contributing factors to the poor care seen at the Mid Staffordshire Foundation Trust. He suggested that the absence of a nurse at the bedside had clear consequences for communication, ward round efficiency and patient safety. He recommended that nurses should be actively involved in ward rounds and linked this to high quality patient care.

AIM

To share an experience of introducing a ward round checklist, a bedside nurse verbal summary and the development of standard operating procedure for Ward Rounds in cardiothoracic critical care unit to improve patient safety and care.

DESIGN AND METHODS

Semi structured interviews of six registered nurses. A questionnaire to 69 registered nurses. An electronic questionnaire sent to 23 members of the MDT. An observational audit of seven ward rounds reviewing 69 patients.

RESULTS

97% of nurses agreed that verbal summarizing had improved clarity and 90% felt that it had improved patient care. 87% of the MDT respondents stated that they had noticed an improvement in the attendance of the bedside nurse at the ward round review. The ward round checklist reduced omissions. Communication with patients during ward rounds was an area which needed to be improved.

CONCLUSIONS

The introduction of a new ward round approach and audit of its practice has enabled an improvement in the quality of patient care by: Giving more opportunity for the nurse to participate and feel part of the ward round. Reduction of omissions through the use of a ward round checklist. Improved clarity among the MDT by the use of bedside nurse verbal summarizing of the plan of care.

RELEVANCE TO CLINICAL PRACTICE

Nurses' full participation in ward rounds is essential to ensure effective communication and enhance patient safety.

Quality of medication information in discharge summaries from hospitals: an audit of electronic patient records

Background Low quality of medication information in discharge summaries from hospitals may jeopardize optimal therapy and put the patient at risk for medication errors and adverse drug events. Objective To audit the quality of medication information in discharge summaries and explore factors associated with the quality. Setting Helgelandssykehuset Mo i Rana, a rural hospital in central Norway. Method For each month in 2013, we randomly selected 60 discharge summaries from the Department of Medicine and Surgery (totally 720) and evaluated the medication information using eight Norwegian quality criteria. Main outcome measure Mean score per discharge summary ranging from 0 (lowest quality) to 16 (highest quality). Results Mean score per discharge summary was 7.4 (SD 2.8; range 0-14), significantly higher when evaluating medications used regularly compared to mediations used as needed (7.80 vs. 6.52; p < 0.001). Lowest score was achieved for quality criteria concerning generic names, indications for medication use, reasons why changes had been made and information about the source for information. Factors associated with increased quality scores are increasing numbers of medications and male patients. Increasing age seemed to be associated with a reduced score, while type of department was not associated with the quality. Conclusion In discharge summaries from 2013, we identified a low quality of medication information in accordance with the Norwegian quality criteria. Actions for improvement are necessary and follow-up studies to monitor quality are needed.