International standards for programmes of training in intensive care medicine in Europe

Trainee-supervisor collaboration, progress-visualisation, and coaching: a survey on challenges in assessment of ICU trainees

BACKGROUND

Assessing trainees is crucial for development of their competence, yet it remains a challenging endeavour. Identifying contributing and influencing factors affecting this process is imperative for improvement.

METHODS

We surveyed residents, fellows, and intensivists working in an intensive care unit (ICU) at a large non-university hospital in Switzerland to investigate the challenges in assessing ICU trainees. Thematic analysis revealed three major themes.

RESULTS

Among 45 physicians, 37(82%) responded. The first theme identified is trainee-intensivist collaboration discontinuity. The limited duration of trainees' ICU rotations, large team size operating in a discordant three-shift system, and busy and unpredictable day-planning hinder sustained collaboration. Potential solutions include a concise pre-collaboration briefing, shared bedside care, and post-collaboration debriefing involving formative assessment and reflection on collaboration. The second theme is the lack of trainees' progress visualisation, which is caused by unsatisfactory familiarisation with the trainees' development. The lack of an overview of a trainee's previous achievements, activities, strengths, weaknesses, and goals may result in inappropriate assessments. Participants suggested implementing digital assessment tools, a competence committee, and dashboards to facilitate progress visualisation. The third theme we identified is insufficient coaching and feedback. Factors like personality traits, hierarchy, and competing interests can impede coaching, while high-quality feedback is essential for correct assessment. Skilled coaches can define short-term goals and may optimise trainee assessment by seeking feedback from multiple supervisors and assisting in both formative and summative assessment. Based on these three themes and the suggested solutions, we developed the acronym "ICU-STAR" representing a potentially powerful framework to enhance short-term trainee-supervisor collaboration in the workplace and to co-scaffold the principles of adequate assessment.

CONCLUSIONS

According to ICU physicians, trainee-supervisor collaboration discontinuity, the lack of visualisation of trainee's development, and insufficient coaching and feedback skills of supervisors are the major factors hampering trainees' assessment in the workplace. Based on suggestions by the survey participants, we propose the acronym "ICU-STAR" as a framework including briefing, shared bedside care, and debriefing of the trainee-supervisor collaboration at the workplace as its core components. With the attending intensivists acting as coaches, progress visualisation can be enhanced by actively collecting more data points.

TRIAL REGISTRATION

N/A.

Twelve tips for developing a systematic acute care curriculum for medical students

There are inadequacies in the practice-readiness of junior doctors for providing acute care in areas of clinical deterioration. In addition, the existing undergraduate curricula are fragmented in how acute care is taught in medical schools. We propose twelve tips for developing a systematic acute care curriculum, including what to teach, how to teach it and, how to assess. Furthermore, we propose and incorporate an acute care learning dashboard as an assessment tool which collates and demonstrates the occurrence of learning, faculty feedback, and students' reflection. We also summarise the existing online resources available for acute care training. We hope to address the existing issues and improve acute care training to prepare the graduates to become practice-ready professionals.

Digital transition in rural emergency medicine: Impact of job satisfaction and workload on communication and technology acceptance

BACKGROUND

Tele-emergency physicians (TEPs) take an increasingly important role in the need-oriented provision of emergency patient care. To improve emergency medicine in rural areas, we set up the project 'Rural|Rescue', which uses TEPs to restructure professional rescue services using information and communication technologies (ICTs) in order to reduce the therapy-free interval. Successful implementation of ICTs relies on user acceptance and knowledge sharing behavior.

METHOD

We conducted a factorial design with active knowledge transfer and technology acceptance as a function of work satisfaction (high vs. low), workload (high vs. low) and point in time (prior to vs. after digitalization). Data were collected via machine readable questionnaires issued to 755 persons (411 pre, 344 post), of which 304 or 40.3% of these persons responded (194 pre, 115 post).

RESULTS

Technology acceptance was higher after the implementation of TEP for nurses but not for other professions, and it was higher when the workload was high. Regarding active communication and knowledge sharing, employees with low work satisfaction are more likely to share their digital knowledge as compared to employees with high work satisfaction. This is an effect of previous knowledge concerning digitalization: After implementing the new technology, work satisfaction increased for the more experienced employees, but not for the less experienced ones.

CONCLUSION

Our research illustrates that employees' workload has an impact on the intention of using digital applications. The higher the workload, the more people are willing to use TEPs. Regarding active knowledge sharing, we see that employees with low work satisfaction are more likely to share their digital knowledge compared to employees with high work satisfaction. This might be attributed to the Dunning-Kruger effect. Highly knowledgeable employees initially feel uncertain about the change, which translates into temporarily lower work satisfaction. They feel the urge to fill even small knowledge gaps, which in return leads to higher work satisfaction. Those responsible need to acknowledge that digital change affects their employees' workflow and work satisfaction. During such times, employees need time and support to gather information and knowledge in order to cope with digitally changed tasks.

Competency assessment of residents of Intensive Care Medicine through a simulation-based objective structured clinical evaluation (OSCE). A multicenter observational study

OBJECTIVES

The current official model of training in Intensive Care Medicine (ICM) in Spain is based on exposure to experiences through clinical rotations. The main objective was to determine the level of competency (I novice to V independent practitioner) achieved by the residents at the end of the 3rd year of training (R3) in ICM through a simulation-based OSCE. Secondary objectives were: (1) To identify gaps in performance, and (2) To investigate the reliability and feasibility of conducting simulation-based assessment at multiple sites.

DESIGN

Observational multicenter study.

SETTING

Thirteen Spanish ICU Departments.

PARTICIPANTS

Thirty six R3.

INTERVENTION

The participants performed on five, 15-min, high-fidelity crisis scenarios in four simulation centers. The performances were video recorded for later scoring by trained raters.

MAIN VARIABLES OF INTEREST

Via a Delphi technique, an independent panel of expert intensivists identified critical essential performance elements (CEPE) for each scenario to define the levels of competency.

RESULTS

A total of 176 performances were analyzed. The internal consistency of the check-lists were adequate (KR-20 range 0.64-0.79). Inter-rater reliability was strong [median Intraclass Correlation Coefficient across scenarios: 0.89 (0.65-0.97)]. Competency levels achieved by R3 were: Level I (18.8%), II (35.2%), III (42.6%), IV/V (3.4%). Overall, a great heterogeneity in performance was observed.

CONCLUSION

The expected level of competency after one year in the ICU was achieved only in half of the performances. A more evidence-based educational approach is needed. Multiple center simulation-based assessment showed feasibility and reliability as an evaluation method of competency.

TRIAL REGISTRATION

COBALIDATION. NCT04278976. (https://register.

CLINICALTRIALS

gov).

Acceptance and validity of the methods used to implement a competency based medical education programme in an Intensive Care Department of a teaching referral center

OBJECTIVES

1. To determine the satisfaction of tutors and residents with a specific methodology used to implement CoBaTrICE. 2. To determine the reliability and validity of the global rating scales designed ad hoc to assess the performance of the residents for training purposes.

DESIGN

Prospective cohort study.

PARTICIPANTS

All the residents and tutors of the ICU Department of the Hospital Universitario y Politécnico la Fe de Valencia.

INTERVENTION

CoBaTrICE implementation started in March 2016, it was based on: (1) Training the tutors in feedback techniques; (2) Performing multiple objective and structured work based assessments to achieve the competences of the program; and (3) The use of an electronic portfolio to promote learning reflection and to collect the evidence that learning was taking place.

METHODS

The acceptance of CoBaTrICE was explored through a satisfaction survey conducted after 9 months of implementation of the training program. The 15 residents and 5 tutors of the ICU Department were asked about the methodology of the formative assessments, the quality of the feedback, self-learning regulation and the electronic portfolio usefulness. The validity of the global rating scales was assessed through the tests alfa de Cronbach, reliability and generalizability indexes, and intraclass correlation coefficient.

RESULTS

The implementation of CoBaTrICE was satisfactory in all the dimensions studied. The global rating scales used for formative purposes showed reliability and validity.

CONCLUSIONS

The methodology used to implement CoBaTrICE was highly valued by tutors and residents. The global rating scales used for formative purposes showed reliability and validity.

Motivations for and Challenges in the Development of Global Medical Curricula: A Scoping Review

PURPOSE

The aim of this scoping review is to understand the motivations for the creation of global medical curricula, summarize methods that have been used to create these curricula, and understand the perceived premises for the creation of these curricula.

METHOD

In 2018, the authors used a comprehensive search strategy to identify papers on existing efforts to create global medical curricula published from 1998 to March 29, 2018, in the following databases: MEDLINE; MEDLINE Epub Ahead of Print, In-Process, and Other Non-Indexed Citations; Embase; Cochrane Central Register of Controlled Trials; Cochrane Database of Systematic Reviews; PsycINFO; CINAHL; ERIC; Scopus; African Index Medicus; and LILACS. There were no language restrictions. Two independent researchers applied the inclusion and exclusion criteria. Demographic data were abstracted from publications and summarized. The stated purposes, methods used for the development, stated motivations, and reported challenges of curricula were coded.

RESULTS

Of the 18,684 publications initially identified, 137 met inclusion criteria. The most common stated purposes for creating curricula were to define speciality-specific standards (50, 30%), to harmonize training standards (38, 23%), and to improve the quality or safety of training (31, 19%). The most common challenges were intercountry variation (including differences in health care systems, the operationalization of medical training, and sociocultural differences; 27, 20%), curricular implementation (20, 15%), and the need for a multistakeholder approach (6, 4%). Most curricula were developed by a social group (e.g., committee; 30, 45%) or Delphi or modified Delphi process (22, 33%).

CONCLUSIONS

The challenges of intercountry variation, the need for a multistakeholder approach, and curricular implementation need to be considered if concerns about curricular relevance are to be addressed. These challenges undoubtedly impact the uptake of global medical curricula and can only be addressed by explicit efforts to make curricula applicable to the realities of diverse health care settings.

Is training in obstetric critical care adequate? An international comparison

Obstetric critical care is an emerging discipline which cuts across speciality boundaries. We have analysed the training curricula in the three major specialities (obstetrics, anaesthesia and intensive care medicine) likely to be involved in the care of the critically-ill obstetric patient, to assess whether it is adequate to ensure effective training on this subject.

Are graduated intensivists prepared for practice? A case study from The Netherlands

PURPOSE

An evaluation of the alignment between intensive care medicine (ICM) training and practice provides valuable information for the development of ICM training. Therefore this study examines how well recently licensed intensivists feel prepared for practice and whether intensivists from different background specialties attain comparable preparedness rates.

METHODS

An inventory was developed to cover the tasks that constitute ICM practice. Two hundred five recently licensed Dutch intensivists received a questionnaire in which they could indicate how well their ICM training programme prepared them for these tasks on a 5-point Likert scale.

RESULTS

Ninety-one respondents returned the questionnaire (response 45%). Respondents felt excellently prepared for 67 tasks, well prepared for 16 tasks, marginally sufficiently prepared for 6 tasks and insufficiently prepared for 15 tasks. Intensivists from anaesthesiology felt better prepared for IC specific activities (mean 4.25, SD 0.38) than those from internal medicine (mean 4.01, SD 0.40, P=.02).Average scores on tasks related to medical expertise were relatively high while tasks relating to management and leadership, science and professional development scored lower.

CONCLUSIONS

Although recently licensed intensivists are well prepared for most tasks in ICM, lower preparedness scores on tasks related to leadership and management, science, and professional development call for re-evaluation of the current curriculum.

Does training improve diagnostic accuracy and inter-rater agreement in applying the Berlin radiographic definition of acute respiratory distress syndrome? A multicenter prospective study

BACKGROUND

Poor inter-rater reliability in chest radiograph interpretation has been reported in the context of acute respiratory distress syndrome (ARDS), although not for the Berlin definition of ARDS. We sought to examine the effect of training material on the accuracy and consistency of intensivists' chest radiograph interpretations for ARDS diagnosis.

METHODS

We conducted a rater agreement study in which 286 intensivists (residents 41.3%, junior attending physicians 35.3%, and senior attending physician 23.4%) independently reviewed the same 12 chest radiographs developed by the ARDS Definition Task Force ("the panel") before and after training. Radiographic diagnoses by the panel were classified into the consistent (n = 4), equivocal (n = 4), and inconsistent (n = 4) categories and were used as a reference. The 1.5-hour training course attended by all 286 intensivists included introduction of the diagnostic rationale, and a subsequent in-depth discussion to reach consensus for all 12 radiographs.

RESULTS

Overall diagnostic accuracy, which was defined as the percentage of chest radiographs that were interpreted correctly, improved but remained poor after training (42.0 ± 14.8% before training vs. 55.3 ± 23.4% after training, p < 0.001). Diagnostic sensitivity and specificity improved after training for all diagnostic categories (p < 0.001), with the exception of specificity for the equivocal category (p = 0.883). Diagnostic accuracy was higher for the consistent category than for the inconsistent and equivocal categories (p < 0.001). Comparisons of pre-training and post-training results revealed that inter-rater agreement was poor and did not improve after training, as assessed by overall agreement (0.450 ± 0.406 vs. 0.461 ± 0.575, p = 0.792), Fleiss's kappa (0.133 ± 0.575 vs. 0.178 ± 0.710, p = 0.405), and intraclass correlation coefficient (ICC; 0.219 vs. 0.276, p = 0.470).

CONCLUSIONS

The radiographic diagnostic accuracy and inter-rater agreement were poor when the Berlin radiographic definition was used, and were not significantly improved by the training set of chest radiographs developed by the ARDS Definition Task Force.

TRIAL REGISTRATION

The study was registered at ClinicalTrials.gov (registration number NCT01704066 ) on 6 October 2012.

Using consensus group methods such as Delphi and Nominal Group in medical education research. MEDICAL TEACHER 2017;39:14-19. [PMID: 27841062 DOI: 10.1080/0142159x.2017.1245856]

Consensus group methods are widely used in research to identify and measure areas where incomplete evidence exists for decision-making. Despite their widespread use, these methods are often inconsistently used and reported. Using examples from the three most commonly used methods, the Delphi, Nominal Group and RAND/UCLA; this paper and associated Guide aim to describe these methods and to highlight common weaknesses in methodology and reporting. The paper outlines a series of recommendations to assist researchers using consensus group methods in providing a comprehensive description and justification of the steps taken in their study.

Consensus development of core competencies in intensive and critical care medicine training in China

Background

The aim of this study is to develop consensus on core competencies required for postgraduate training in intensive care medicine.

Methods

We used a combination of a modified Delphi method and a nominal group technique to create and modify the list of core competencies to ensure maximum consensus. Ideas were generated modified from Competency Based Training in Intensive Care Medicine in Europe collaboration (CoBaTrICE) core competencies. An online survey invited healthcare professionals, educators, and trainees to rate and comment on these competencies. The output from the online survey was edited and then reviewed by a nominal group of 13 intensive care professionals to identify each competence for importance. The resulting list was then recirculated in the nominal group for iterative rating.

Results

The online survey yielded a list of 199 competencies for nominal group reviewing. After five rounds of rating, 129 competencies entered the final set defined as core competencies.

Conclusions

We have generated a set of core competencies using a consensus technique which can serve as an indicator for training program development.

Electronic supplementary material

The online version of this article (doi:10.1186/s13054-016-1514-z) contains supplementary material, which is available to authorized users.

The Intensive care unit specialist: Report from the Task Force of World Federation of Societies of Intensive and Critical Care Medicine

The role of the critical care specialist has been unequivocally established in the management of severely ill patients throughout the world. Data show that the presence of a critical care specialist in the intensive care unit (ICU) environment has reduced morbidity and mortality, improved patient safety, and reduced length of stay and costs. However, many ICUs across the world function as "open ICUs," in which patients may be admitted under a primary physician who has not been trained in critical care medicine. Although the concept of the ICU has gained widespread acceptance amongst medical professionals, hospital administrators and the general public; recognition and the need for doctors specializing in intensive care medicine has lagged behind. The curriculum to ensure appropriate training around the world is diverse but should ideally meet some minimum standards. The World Federation of Societies of Intensive and Critical Care Medicine has set up a task force to address issues concerning the training, functions, roles, and responsibilities of an ICU specialist.

Training in intensive care medicine. A challenge within reach

The medical training model is currently immersed in a process of change. The new paradigm is intended to be more effective, more integrated within the healthcare system, and strongly oriented towards the direct application of knowledge to clinical practice. Compared with the established training system based on certification of the completion of a series or rotations and stays in certain healthcare units, the new model proposes a more structured training process based on the gradual acquisition of specific competences, in which residents must play an active role in designing their own training program. Training based on competences guarantees more transparent, updated and homogeneous learning of objective quality, and which can be homologated internationally. The tutors play a key role as the main directors of the process, and institutional commitment to their work is crucial. In this context, tutors should receive time and specific formation to allow the evaluation of training as the cornerstone of the new model. New forms of objective summative and training evaluation should be introduced to guarantee that the predefined competences and skills are effectively acquired. The free movement of specialists within Europe is very desirable and implies that training quality must be high and amenable to homologation among the different countries. The Competency Based training in Intensive Care Medicine in Europe program is our main reference for achieving this goal. Scientific societies in turn must impulse and facilitate all those initiatives destined to improve healthcare quality and therefore specialist training. They have the mission of designing strategies and processes that favor training, accreditation and advisory activities with the government authorities.

The future of intensive care medicine

Intensive care medical training, whether as a primary specialty or as secondary add-on training, should include key competences to ensure a uniform standard of care, and the number of intensive care physicians needs to increase to keep pace with the growing and anticipated need. The organisation of intensive care in multiple specialty or central units is heterogeneous and evolving, but appropriate early treatment and access to a trained intensivist should be assured at all times, and intensivists should play a pivotal role in ensuring communication and high-quality care across hospital departments. Structures now exist to support clinical research in intensive care medicine, which should become part of routine patient management. However, more translational research is urgently needed to identify areas that show clinical promise and to apply research principles to the real-life clinical setting. Likewise, electronic networks can be used to share expertise and support research. Individuals, physicians and policy makers need to allow for individual choices and priorities in the management of critically ill patients while remaining within the limits of economic reality. Professional scientific societies play a pivotal role in supporting the establishment of a defined minimum level of intensive health care and in ensuring standardised levels of training and patient care by promoting interaction between physicians and policy makers. The perception of intensive care medicine among the general public could be improved by concerted efforts to increase awareness of the services provided and of the successes achieved.