1
|
Haugland H, Gamberini L, Hoareau GL, Haenggi M, Greif R, Brede JR. Resuscitative endovascular balloon occlusion of the aorta in out-of-hospital cardiac arrest - A Delphi consensus study for uniform data collection. Resusc Plus 2023; 16:100485. [PMID: 37859631 PMCID: PMC10583171 DOI: 10.1016/j.resplu.2023.100485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 09/01/2023] [Accepted: 09/25/2023] [Indexed: 10/21/2023] Open
Abstract
Background Evolving research on resuscitative endovascular balloon occlusion of the aorta (REBOA) as an adjunct treatment for out-of-hospital cardiac arrest mandates uniform recording and reporting of data. A consensus on which variables need to be collected may enable comparing and merging data from different studies. We aimed to establish a standard set of variables to be collected and reported in future REBOA studies in out-of-hospital cardiac arrest. Methods A four-round stepwise Delphi consensus process first asked experts to propose without restraint variables for future REBOA research in out-of-hospital cardiac arrest. The experts then reviewed the variables on a 5-point Likert scale and ≥75% agreement was defined as consensus. First authors of published papers on REBOA in out-of-hospital cardiac arrest over the last five years were invited to join the expert panel. Results The data were collected between May 2022 and December 2022. A total of 28 experts out of 34 primarily invited completed the Delphi process, which developed a set of 31 variables that might be considered as a supplement to the Utstein style reporting of research in out-of-hospital cardiac arrest. Conclusions This Delphi consensus process suggested 31 variables that enable future uniform reporting of REBOA in out-of-hospital cardiac arrest.
Collapse
Affiliation(s)
- Helge Haugland
- St. Olav’s University Hospital, Trondheim, Norway
- Norwegian Air Ambulance Foundation, Oslo, Norway
| | - Lorenzo Gamberini
- Department of Anesthesia, Intensive Care and Prehospital Emergency, Ospedale Maggiore Carlo Alberto Pizzardi, Bologna, Italy
| | | | - Matthias Haenggi
- Department of Intensive Care Medicine, Inselspital, Bern University Hospital, Bern, Switzerland
| | - Robert Greif
- University of Bern, Bern Switzerland
- School of Medicine, Sigmund Freud University Vienna, Vienna, Austria
- ERC ResearchNet, Niel, Belgium
| | - Jostein Rødseth Brede
- St. Olav’s University Hospital, Trondheim, Norway
- Norwegian Air Ambulance Foundation, Oslo, Norway
| | | |
Collapse
|
2
|
Jacobsen ME, Nayahangan LJ, Ghidinelli M, Subramaniam C, Hare KB, Konge L, Gustafsson A. Assessment of Technical Competence in Distal Radius Fracture Fixation by a Volar Locking Plate: A Global Delphi Consensus Study. J Hand Surg Am 2023; 48:875-885. [PMID: 37389496 DOI: 10.1016/j.jhsa.2023.05.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/16/2022] [Revised: 04/25/2023] [Accepted: 05/10/2023] [Indexed: 07/01/2023]
Abstract
PURPOSE Volar locking plate fixation of distal radius fractures is a common orthopedic procedure and should be mastered by graduating orthopedic residents. Surgical education is transitioning from a traditional time-based approach to competency-based medical education. Valid and objective assessment is essential for successful transition. The purpose of this study was to develop a comprehensive, procedure-specific assessment tool to evaluate technical competence in volar locking plate osteosynthesis of a distal radius fracture. METHODS International orthopedic/trauma experts involved in resident education participated as panelists in a four-round online Delphi process to reach consensus on the content of the assessment tool. Round 1 was an item-generating round, in which the panelists identified potential assessment parameters. In round 2, the panelists rated the importance of each suggested assessment parameter and reached consensus on which to include in the assessment tool. Round 3 yielded specific assessment score intervals for specific bone and fracture models and is not reported in this study. In round 4, the panelists assigned weights to the assessment parameters on a 1-10 scale to determine how each parameter should have an impact on the overall results. RESULTS Eighty-seven surgeons, representing 42 countries, participated in the study. Round 1 resulted in 45 assessment parameters, grouped into five procedural steps. After round 2, the number of parameters was reduced to 39. After the final round, an additional parameter was removed and weights were assigned to the remaining parameters. CONCLUSIONS Using a systematic methodology, a preliminary assessment tool to evaluate technical competence in distal radius fracture fixation was developed. A consensus of international experts supports the content validity of the assessment tool. CLINICAL RELEVANCE This assessment tool represents the first step in the evidence-based assessment essential for competency-based medical education. Before implementation, further studies exploring validity of variations of the assessment tool in different educational contexts are required.
Collapse
Affiliation(s)
- Mads Emil Jacobsen
- Department of Orthopedic Surgery, Center for Orthopaedic Research and Innovation (CORI), Næstved, Slagelse and Ringsted Hospitals, Slagelse, Region Zealand, Denmark; Copenhagen Academy for Medical Education and Simulation (CAMES), Rigshospitalet, Copenhagen, Capital Region, Denmark; Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark.
| | - Leizl Joy Nayahangan
- Copenhagen Academy for Medical Education and Simulation (CAMES), Rigshospitalet, Copenhagen, Capital Region, Denmark
| | | | | | - Kristoffer Borbjerg Hare
- Department of Orthopedic Surgery, Center for Orthopaedic Research and Innovation (CORI), Næstved, Slagelse and Ringsted Hospitals, Slagelse, Region Zealand, Denmark; Department of Regional Health Research, University of Southern Denmark, Odense, Denmark
| | - Lars Konge
- Copenhagen Academy for Medical Education and Simulation (CAMES), Rigshospitalet, Copenhagen, Capital Region, Denmark; Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Amandus Gustafsson
- Department of Orthopedic Surgery, Center for Orthopaedic Research and Innovation (CORI), Næstved, Slagelse and Ringsted Hospitals, Slagelse, Region Zealand, Denmark; Copenhagen Academy for Medical Education and Simulation (CAMES), Rigshospitalet, Copenhagen, Capital Region, Denmark; Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
3
|
Engberg M, Mikkelsen S, Hörer T, Lindgren H, Søvik E, Frendø M, Svendsen MB, Lönn L, Konge L, Russell L, Taudorf M. Learning insertion of a Resuscitative Endovascular Balloon Occlusion of the Aorta (REBOA) catheter: Is clinical experience necessary? A prospective trial. Injury 2023; 54:1321-1329. [PMID: 36907823 DOI: 10.1016/j.injury.2023.02.048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Revised: 02/08/2023] [Accepted: 02/22/2023] [Indexed: 03/14/2023]
Abstract
BACKGROUND Resuscitative endovascular balloon occlusion of the aorta (REBOA) is an emerging and potentially life-saving procedure, necessitating qualified operators in an increasing number of centres. The procedure shares technical elements with other vascular access procedures using the Seldinger technique, which is mastered by doctors not only in endovascular specialties but also in trauma surgery, emergency medicine, and anaesthesiology. We hypothesised that doctors mastering the Seldinger technique (experienced anaesthesiologist) would learn the technical aspects of REBOA with limited training and remain technically superior to doctors unfamiliar with the Seldinger technique (novice residents) given similar training. METHODS This was a prospective trial of an educational intervention. Three groups of doctors were enroled: novice residents, experienced anaesthesiologists, and endovascular experts. The novices and the anaesthesiologists completed 2.5 h of simulation-based REBOA training. Their skills were tested before and 8-12 weeks after training using a standardised simulated scenario. The endovascular experts, constituting a reference group, were equivalently tested. All performances were video recorded and rated by three blinded experts using a validated assessment tool for REBOA (REBOA-RATE). Performances were compared between groups and with a previously published pass/fail cutoff. RESULTS Sixteen novices, 13 board-certified specialists in anaesthesiology, and 13 endovascular experts participated. Before training, the anaesthesiologists outperformed the novices by 30 percentage points of the maximum REBOA-RATE score (56% (SD 14.0) vs 26% (SD 17%), p<0.01). After training, there was no difference in skills between the two groups (78% (SD 11%) vs 78 (SD 14%), p = 0.93). Neither group reached the endovascular experts' skill level (89% (SD 7%), p<0.05). CONCLUSION For doctors mastering the Seldinger technique, there was an initial inter-procedural transfer of skills advantage when performing REBOA. However, after identical simulation-based training, novices performed equally well to anaesthesiologists, indicating that vascular access experience is not a prerequisite to learning the technical aspects of REBOA. Both groups would need more training to reach technical proficiency.
Collapse
Affiliation(s)
- Morten Engberg
- Copenhagen Academy for Medical Education and Simulation (CAMES), Centre for Human Resources and Education, the Capital Region of Denmark; Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Denmark.
| | - Søren Mikkelsen
- The Mobile Emergency Care Unit, Department of Anaesthesiology and Intensive Care, Odense University Hospital, Odense, Denmark; The Prehospital Research Unit, Region of Southern Denmark, Odense University Hospital, Odense, Denmark; Department of Regional Health Research, University of Southern Denmark, Odense, Denmark
| | - Tal Hörer
- Department of Cardiothoracic and Vascular Surgery and Department of Surgery, Faculty of Life Science, Örebro University Hospital, Örebro, Sweden
| | - Hans Lindgren
- Department of Clinical Sciences, Faculty of Medicine, Lund University, Lund, Sweden; Department of Surgery, Section of Interventional Radiology, Helsingborg Hospital, Helsingborg, Sweden
| | - Edmund Søvik
- Department of Radiology and Nuclear Medicine, St. Olavs University Hospital, Trondheim, Norway
| | - Martin Frendø
- Copenhagen Academy for Medical Education and Simulation (CAMES), Centre for Human Resources and Education, the Capital Region of Denmark; Department of Plastic and Reconstructive Surgery, Copenhagen University Hospital Herlev, Denmark
| | - Morten Bo Svendsen
- Copenhagen Academy for Medical Education and Simulation (CAMES), Centre for Human Resources and Education, the Capital Region of Denmark
| | - Lars Lönn
- Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Denmark; Department of Radiology, Copenhagen University Hospital Rigshospitalet, Denmark
| | - Lars Konge
- Copenhagen Academy for Medical Education and Simulation (CAMES), Centre for Human Resources and Education, the Capital Region of Denmark; Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Denmark
| | - Lene Russell
- Copenhagen Academy for Medical Education and Simulation (CAMES), Centre for Human Resources and Education, the Capital Region of Denmark; Department of Anaesthesiology and Intensive Care, Copenhagen University Hospital Gentofte, Denmark
| | - Mikkel Taudorf
- Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Denmark; Department of Radiology, Copenhagen University Hospital Rigshospitalet, Denmark
| |
Collapse
|
4
|
Ensuring competence in ultrasound-guided procedures-a validity study of a newly developed assessment tool. Eur Radiol 2022; 32:4954-4966. [PMID: 35195745 DOI: 10.1007/s00330-022-08542-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Revised: 11/17/2021] [Accepted: 12/16/2021] [Indexed: 11/04/2022]
Abstract
OBJECTIVES To investigate the validity of the Interventional Ultrasound Skills Evaluation (IUSE) tool for assessment of procedural competence in ultrasound-guided procedures in a clinical environment, including a pass/fail score. METHODS Novices and experienced radiologists were recruited from four hospitals and were observed and assessed while performing ultrasound-guided procedures. Performances were assessed using the IUSE tool by two independent raters. Validity evidence was gathered in accordance with Messick's framework: response process was ensured by standardisation of written rater instructions. Internal structure was explored using Cronbach's alpha for internal consistency reliability; inter-rater reliability was calculated as Pearson's r independently across all ratings, and test-retest reliability was reported using Cronbach's alpha. Relationship to other variables was investigated by comparing performances of the participants in each group. Consequences evidence was explored by calculating a pass/fail standard using the contrasting groups method. RESULTS Six novices and twelve experienced radiologists were enrolled. The IUSE tool had high internal consistency (Cronbach's alpha = 0.96, high inter-rater reliability (Pearson's r = 0.95), and high test-retest reliability (Cronbach's alpha = 0.98), and the mean score was 33.28 for novices and 59.25 for experienced with a highly significant difference (p value < 0.001). The pass/fail score was set at 55 resulting in no false positives or false negatives. CONCLUSIONS Validity evidence from multiple sources supports the use of the IUSE tool for assessment of competence in ultrasound-guided procedures in a clinical environment and its use in high-stakes assessment such as certification. A credible pass/fail criterion was established to inform decision-making. KEY POINTS • A multi-site validity investigation established that the Interventional Ultrasound Skills Evaluation (IUSE) tool can be used to assess procedural competence in ultrasound-guided procedures. • Validity evidence was gathered according to Messick's framework validity from the following sources: response process, internal structure, relationship to other variables, and consequences evidence. • The IUSE tool can be used for both formative and summative assessment, and a credible pass/fail score was established to help inform decision-making such as certification.
Collapse
|