Competency assessment of residents of Intensive Care Medicine through a simulation-based objective structured clinical evaluation (OSCE). A multicenter observational study

OBJECTIVES

The current official model of training in Intensive Care Medicine (ICM) in Spain is based on exposure to experiences through clinical rotations. The main objective was to determine the level of competency (I novice to V independent practitioner) achieved by the residents at the end of the 3rd year of training (R3) in ICM through a simulation-based OSCE. Secondary objectives were: (1) To identify gaps in performance, and (2) To investigate the reliability and feasibility of conducting simulation-based assessment at multiple sites.

DESIGN

Observational multicenter study.

SETTING

Thirteen Spanish ICU Departments.

PARTICIPANTS

Thirty six R3.

INTERVENTION

The participants performed on five, 15-min, high-fidelity crisis scenarios in four simulation centers. The performances were video recorded for later scoring by trained raters.

MAIN VARIABLES OF INTEREST

Via a Delphi technique, an independent panel of expert intensivists identified critical essential performance elements (CEPE) for each scenario to define the levels of competency.

RESULTS

A total of 176 performances were analyzed. The internal consistency of the check-lists were adequate (KR-20 range 0.64-0.79). Inter-rater reliability was strong [median Intraclass Correlation Coefficient across scenarios: 0.89 (0.65-0.97)]. Competency levels achieved by R3 were: Level I (18.8%), II (35.2%), III (42.6%), IV/V (3.4%). Overall, a great heterogeneity in performance was observed.

CONCLUSION

The expected level of competency after one year in the ICU was achieved only in half of the performances. A more evidence-based educational approach is needed. Multiple center simulation-based assessment showed feasibility and reliability as an evaluation method of competency.

TRIAL REGISTRATION

COBALIDATION. NCT04278976. (https://register.

CLINICALTRIALS

gov).

Acceptance and validity of the methods used to implement a competency based medical education programme in an Intensive Care Department of a teaching referral center

OBJECTIVES

1. To determine the satisfaction of tutors and residents with a specific methodology used to implement CoBaTrICE. 2. To determine the reliability and validity of the global rating scales designed ad hoc to assess the performance of the residents for training purposes.

DESIGN

Prospective cohort study.

PARTICIPANTS

All the residents and tutors of the ICU Department of the Hospital Universitario y Politécnico la Fe de Valencia.

INTERVENTION

CoBaTrICE implementation started in March 2016, it was based on: (1) Training the tutors in feedback techniques; (2) Performing multiple objective and structured work based assessments to achieve the competences of the program; and (3) The use of an electronic portfolio to promote learning reflection and to collect the evidence that learning was taking place.

METHODS

The acceptance of CoBaTrICE was explored through a satisfaction survey conducted after 9 months of implementation of the training program. The 15 residents and 5 tutors of the ICU Department were asked about the methodology of the formative assessments, the quality of the feedback, self-learning regulation and the electronic portfolio usefulness. The validity of the global rating scales was assessed through the tests alfa de Cronbach, reliability and generalizability indexes, and intraclass correlation coefficient.

RESULTS

The implementation of CoBaTrICE was satisfactory in all the dimensions studied. The global rating scales used for formative purposes showed reliability and validity.

CONCLUSIONS

The methodology used to implement CoBaTrICE was highly valued by tutors and residents. The global rating scales used for formative purposes showed reliability and validity.

Initial experience of use of tolvaptan in critically ill patients with fluid overload

WHAT IS KNOWN AND OBJECTIVE

Positive volume balance is related with high mortality in critically ill patients. We describe our experience in the use of tolvaptan in patients with fluid overload.

CASE SUMMARY

Six patients in the recovery phase from septic shock were included. All patients achieved an increase in diuresis after the first day, with a median fluid balance variation of -2362 (-485 to -3447) mL. At the end of treatment, median fluid balance variation was -9080 (-26,784 to -4395) mL.

WHAT IS NEW AND CONCLUSION

Tolvaptan could be an option in critically ill patients with fluid overload and resistant or not treatable with conventional diuretics.

Antibiotic Prescription for Community-Acquired Pneumonia in the Intensive Care Unit: Impact of Adherence to Infectious Diseases Society of America Guidelines on Survival

BACKGROUND

The purpose of our study was to analyze prognostic factors associated with mortality for patients with severe community-acquired pneumonia (CAP).

METHODS

We conducted a prospective multicenter study including all patients with CAP admitted to the intensive care unit during a 15-month period in 33 Spanish hospitals. Admission data and data on the evolution of the disease were recorded. Multivariate analysis was performed using the SPSS statistical package (SPSS).

RESULTS

A total of 529 patients with severe CAP were enrolled; the mean age (+/-SD) was 59.9+/-16.1 years, and the mean Acute Physiology and Chronic Health Evaluation (APACHE) II score (+/-SD) was 18.9+/-7.4. Overall mortality among patients in the intensive case unit was 27.9% (148 patients). The rate of adherence to Infectious Diseases Society of America (IDSA) guidelines was 57.8%. Significantly higher mortality was documented among patients with nonadherence to treatment (33.2% vs. 24.2%). Multivariate analysis identified age (odds ratio [OR], 1.7), APACHE II score (OR, 4.1), nonadherence to IDSA guidelines (OR, 1.6), and immunocompromise (OR, 1.9) as the variables present at admission to the intensive care unit that were independently associated with death in the intensive care unit. In 15 (75%) of 20 cases of Pseudomonas aeruginosa infection, the antimicrobial treatment at admission was inadequate (including 8 of 15 cases involving patients with adherence to IDSA guidelines). Chronic obstructive pulmonary disease (OR, 17.9), malignancy (OR, 11.0), previous antibiotic exposure (OR, 6.2), and radiographic findings demonstrating rapid spread of disease (OR, 3.9) were associated with P. aeruginosa pneumonia.

CONCLUSIONS

Better adherence to IDSA guidelines would help to improve survival among patients with severe CAP. Pseudomonas coverage should be considered for patients with chronic obstructive pulmonary disease, malignancy, or recent antibiotic exposure.