Why was this transfusion given? Identifying clinical indications for blood transfusion in health care data

Background

To enhance the utility of transfusion data for research, ideally every transfusion should be linked to a primary clinical indication. In electronic patient records, many diagnostic and procedural codes are registered, but unfortunately, it is usually not specified which one is the reason for transfusion. Therefore, a method is needed to determine the most likely indication for transfusion in an automated way.

Study design and methods

An algorithm to identify the most likely transfusion indication was developed and evaluated against a gold standard based on the review of medical records for 234 cases by 2 experts. In a second step, information on misclassification was used to fine-tune the initial algorithm. The adapted algorithm predicts, out of all data available, the most likely indication for transfusion using information on medical specialism, surgical procedures, and diagnosis and procedure dates relative to the transfusion date.

Results

The adapted algorithm was able to predict 74.4% of indications in the sample correctly (extrapolated to the full data set 75.5%). A kappa score, which corrects for the number of options to choose from, was found of 0.63. This indicates that the algorithm performs substantially better than chance level.

Conclusion

It is possible to use an automated algorithm to predict the indication for transfusion in terms of procedures and/or diagnoses. Before implementation of the algorithm in other data sets, the obtained results should be externally validated in an independent hospital data set.

A baseline assessment by healthcare professionals of Dutch pharmacotherapeutic care for the elderly with polypharmacy

Background

Polypharmacy is common in the elderly population and is associated with an increased risk of adverse drug events. To diminish this risk, the guideline 'Polypharmacy in the Elderly' has been developed in 2012. This study examines, to what extent Dutch pharmacotherapeutic practice amongst elderly with polypharmacy mirrors the best practice described in this guideline and which barriers threaten it.

Methods

An observational study was conducted in 2013/14 using a questionnaire distributed amongst Dutch healthcare professionals and elderly patients with polypharmacy. Healthcare professionals were asked about their current practice and the presence of five significant barriers, selected through a literature review and from expert opinion. These barriers are: inadequate transfer of patient records; insufficient documentation of prescribed drugs; a lack of collaboration between professionals; a failure to take a full control of the medication and insufficient involvement of the patient. The patients were asked about their experience with pharmacotherapeutic care.

Results

No more than 26% of the healthcare professionals indicated that they use the guideline. The five barriers threatening the pharmacotherapeutic care were found to be present. Forty-three percent of the patients mentioned that their medication was assessed last year.

Conclusion

The guideline is not used frequently by the healthcare professionals, but there is a will to improve the care by following this guideline. However, the presence of the five barriers hampers its implementation. Good management of those barriers is necessary in order to improve the collaboration between primary and secondary care and to enhance the documentation of prescribed drugs.

Validation of multisource electronic health record data: an application to blood transfusion data

Background

Although data from electronic health records (EHR) are often used for research purposes, systematic validation of these data prior to their use is not standard practice. Existing validation frameworks discuss validity concepts without translating these into practical implementation steps or addressing the potential influence of linking multiple sources. Therefore we developed a practical approach for validating routinely collected data from multiple sources and to apply it to a blood transfusion data warehouse to evaluate the usability in practice.

Methods

The approach consists of identifying existing validation frameworks for EHR data or linked data, selecting validity concepts from these frameworks and establishing quantifiable validity outcomes for each concept. The approach distinguishes external validation concepts (e.g. concordance with external reports, previous literature and expert feedback) and internal consistency concepts which use expected associations within the dataset itself (e.g. completeness, uniformity and plausibility). In an example case, the selected concepts were applied to a transfusion dataset and specified in more detail.

Results

Application of the approach to a transfusion dataset resulted in a structured overview of data validity aspects. This allowed improvement of these aspects through further processing of the data and in some cases adjustment of the data extraction. For example, the proportion of transfused products that could not be linked to the corresponding issued products initially was 2.2% but could be improved by adjusting data extraction criteria to 0.17%.

Conclusions

This stepwise approach for validating linked multisource data provides a basis for evaluating data quality and enhancing interpretation. When the process of data validation is adopted more broadly, this contributes to increased transparency and greater reliability of research based on routinely collected electronic health records.

Electronic supplementary material

The online version of this article (doi:10.1186/s12911-017-0504-7) contains supplementary material, which is available to authorized users.

Crew resource management training in the intensive care unit. A multisite controlled before-after study

INTRODUCTION

There is a growing awareness today that adverse events in the intensive care unit (ICU) are more often caused by problems related to non-technical skills than by a lack of technical, or clinical, expertise. Team training, such as crew resource management (CRM), aims to improve these non-technical skills. The present study evaluated the effectiveness of CRM in the ICU.

METHODS

Six ICUs participated in a paired controlled trial, with one pretest and two post-test measurements (after 3 and 12 months). Three ICUs received CRM training and were compared with a matched control unit. The 2-day classroom-based training was delivered to multidisciplinary groups (ie, ICU physicians, nurses, managers). All levels of Kirkpatrick's evaluation framework were assessed using a mixed method design, including questionnaires, observations and routinely administered patient outcome data.

RESULTS

Level I-reaction: participants were very positive directly after the training. Level II-learning: attitudes towards behaviour aimed at optimising situational awareness were relatively high at baseline and remained stable. Level III-behaviour: self-reported behaviour aimed at optimising situational awareness improved in the intervention group. No changes were found in observed explicit professional oral communication. Level IV-organisation: patient outcomes were unaffected. Error management culture and job satisfaction improved in the intervention group. Patient safety culture improved in both control and intervention units.

CONCLUSIONS

We can conclude that CRM, as delivered in the present study, does not change behaviour or patient outcomes by itself, yet changes how participants think about errors and risks. This indicates that CRM requires a combination with other initiatives in order to improve clinical outcomes.

Development and reliability of the explicit professional oral communication observation tool to quantify the use of non-technical skills in healthcare

BACKGROUND

A lack of non-technical skills is increasingly recognised as an important underlying cause of adverse events in healthcare. The nature and number of things professionals communicate to each other can be perceived as a product of their use of non-technical skills. This paper describes the development and reliability of an instrument to measure and quantify the use of non-technical skills by direct observations of explicit professional oral communication (EPOC) in the clinical situation.

METHODS

In an iterative process we translated, tested and refined an existing checklist from the aviation industry, called self, human interaction, aircraft, procedures and environment, in the context of healthcare, notably emergency departments (ED) and intensive care units (ICU). The EPOC comprises six dimensions: assertiveness, working with others; task-oriented leadership; people-oriented leadership; situational awareness; planning and anticipation. Each dimension is specified into several concrete items reflecting verbal behaviours. The EPOC was evaluated in four ED and six ICU.

RESULTS

In the ED and ICU, respectively, 378 and 1144 individual and 51 and 68 contemporaneous observations of individual staff members were conducted. All EPOC dimensions occur frequently, apart from assertiveness, which was hardly observed. Intraclass correlations for the overall EPOC score ranged between 0.85 and 0.91 and for underlying EPOC dimensions between 0.53 and 0.95.

CONCLUSIONS

The EPOC is a new instrument for evaluating the use of non-technical skills in healthcare, which is reliable in two highly different settings. By quantifying professional behaviour the instrument facilitates measurement of behavioural change over time. The results suggest that EPOC can also be translated to other settings.

Effectiveness of classroom based crew resource management training in the intensive care unit: study design of a controlled trial

BACKGROUND

Crew resource management (CRM) has the potential to enhance patient safety in intensive care units (ICU) by improving the use of non-technical skills. However, CRM evaluation studies in health care are inconclusive with regard to the effect of this training on behaviour and organizational outcomes, due to weak study designs and the scarce use of direct observations. Therefore, the aim of this study is to determine the effectiveness and cost-effectiveness of CRM training on attitude, behaviour and organization after one year, using a multi-method approach and matched control units. The purpose of the present article is to describe the study protocol and the underlying choices of this evaluation study of CRM in the ICU in detail.

METHODS/DESIGN

Six ICUs participated in a paired controlled trial, with one pre-test and two post test measurements (respectively three months and one year after the training). Three ICUs were trained and compared to matched control ICUs. The 2-day classroom-based training was delivered to multidisciplinary groups. Typical CRM topics on the individual, team and organizational level were discussed, such as situational awareness, leadership and communication. All levels of Kirkpatrick's evaluation framework (reaction, learning, behaviour and organisation) were assessed using questionnaires, direct observations, interviews and routine ICU administration data.

DISCUSSION

It is expected that the CRM training acts as a generic intervention that stimulates specific interventions. Besides effectiveness and cost-effectiveness, the assessment of the barriers and facilitators will provide insight in the implementation process of CRM.

TRIAL REGISTRATION

Netherlands Trial Register (NTR): NTR1976.