Multimodular Ultrasound Orientation: Residents' Confidence and Skill in Performing Point-of-care Ultrasound

Unravelling the skillset of point-of-care ultrasound: a systematic review

BACKGROUND

The increasing number of physicians that are trained in point-of-care ultrasound (POCUS) warrants critical evaluation and improvement of current training methods. Performing POCUS is a complex task and it is unknown which (neuro)cognitive mechanisms are most important in competence development of this skill. This systematic review was conducted to identify determinants of POCUS competence development that can be used to optimize POCUS training.

METHODS

PubMed, Web of Science, Cochrane Library, Emcare, PsycINFO and ERIC databases were searched for studies measuring ultrasound (US) skills and aptitude. The papers were divided into three categories: "Relevant knowledge", "Psychomotor ability" and 'Visuospatial ability'. The 'Relevant knowledge' category was further subdivided in 'image interpretation', 'technical aspects' and 'general cognitive abilities'. Visuospatial ability was subdivided in visuospatial subcategories based on the Cattell-Horn-Carroll (CHC) Model of Intelligence v2.2, which includes visuospatial manipulation and visuospatial perception. Post-hoc, a meta-analysis was performed to calculate pooled correlations.

RESULTS

26 papers were selected for inclusion in the review. 15 reported on relevant knowledge with a pooled coefficient of determination of 0.26. Four papers reported on psychomotor abilities, one reported a significant relationship with POCUS competence. 13 papers reported on visuospatial abilities, the pooled coefficient of determination was 0.16.

CONCLUSION

There was a lot of heterogeneity in methods to assess possible determinants of POCUS competence and POCUS competence acquisition. This makes it difficult to draw strong conclusions on which determinants should be part of a framework to improve POCUS education. However, we identified two determinants of POCUS competence development: relevant knowledge and visuospatial ability. The content of relevant knowledge could not be retrieved in more depth. For visuospatial ability we used the CHC model as theoretical framework to analyze this skill. We could not point out psychomotor ability as a determinant of POCUS competence.

Self-reported skills and self-confidence in point-of-care ultrasound: a cross-sectional nationwide survey amongst Finnish emergency physicians

BACKGROUND

The use of point-of-care ultrasound (POCUS) is increasing. Numerous investigators have evaluated the learning curves in POCUS, but there are no published studies on how emergency physicians perceive their own competence level with this skill.

METHODS

A nationwide survey amongst Finnish emergency physicians was conducted. The respondents reported their use of POCUS and how it has affected their clinical decision-making. The number of POCUS examinations performed was compared to the self-assessed skill level with different applications. Cut-off values were determined for the number of examinations required to acquire a good self-assessed skill level in each POCUS application. The correlation between self-confidence and the self-estimated skill level was analyzed. Several different statistical methods were used, such as Student's t-test, Pearson's correlation test, Loess method and ROC curve analysis.

RESULTS

A total of 134 out of 253 Finnish emergency medicine specialists and residents (52%) responded to the survey. The most commonly used POCUS applications were POCUS-assisted procedures, pleural effusion and pneumothorax, inferior vena cava and lower extremity deep venous thrombosis. The initial rate of perceived skill acquisition was very steep with the curve flattening with greater skill and more experience. The number of examinations performed to reach a self-assessed good competence varied from seven to 75 with different applications. The lowest cut-off point for self-assessed good competence was obtained for rapid ultrasound for the shock and hypotension-protocol and the highest for focused cardiac examinations. There was an excellent correlation between self-confidence and the self-assessed skill level.

CONCLUSIONS

The Finnish emergency practitioners' self-assessed development of POCUS skills parallels the previously published learning curves of POCUS. The correlation of self-confidence and the self-assessed skill level was found to be excellent. These findings add information on the development of perceived POCUS skills amongst emergency physicians and could complement a formal performance assessment.

Development of an expert consensus checklist for emergency ultrasound

Background

Within today's competency-based medical education, traditional set number proficiency benchmarks have been called into question. Checklists may help guide individualized training and standardized outcomes. However, multicenter expert consensus checklists based on established guidelines with supporting validity evidence have not been published for specific emergency ultrasound (EUS) applications. We describe a robust national EUS expert consensus methodology for developing a checklist for the extended focused assessment with sonography in trauma (eFAST examination).

Methods

Utilizing the ACEP imaging compendium as a primary reference, 10 national EUS experts iteratively refined and agreed upon a final checklist. To obtain initial reliability and validity evidence, two different EUS experts blinded to resident experience then assessed 24 residents performing an eFAST in a simulated environment. Inter-rater reliability of the checklist was assessed using Cohen's kappa coefficient. Validity was assessed by comparing mean performance with the Student's t-test and discriminant ability of individual checklist items using item-total correlation.

Results

The 10 EUS experts agreed on the final checklist items after two rounds of iterations. When evaluating 24 emergency medicine (EM) PGY-1 to -4 residents, the kappa correlation between two blinded EUS faculty raters was moderate at 0.670. Kappa and agreement were near-perfect or perfect in right and left chest image optimization, right upper quadrant (RUQ) probe placement, RUQ anatomy identification, and pelvic first-view anatomy identification. The difference in checklist performance between junior and senior EM residents was significant at -8.1% (p = 0.004). Identification of pelvic structures and placement of the probe for pelvic views were found to have an excellent item-total correlation with values of >0.4.

Conclusions

We have described a robust national EUS expert consensus methodology for developing an eFAST checklist based on the ACEP imaging guidelines. Based on this encouraging initial reliability and validity evidence, further research and checklist development is warranted for additional EUS applications.

Evaluating knowledge, confidence, and self-efficacy of NPs and PAs in the emergency department: extended focused assessment using sonography in trauma

BACKGROUND

Developing and translating knowledge gained in the classroom into skills that are practiced in the clinical setting is an ongoing, iterative, and dynamic process. Health care clinicians require continually evolving knowledge, ongoing education, and hands-on skills practice particular to the specialty.

PURPOSE

This prospective observational study was conceived based on the existing evidence demonstrating that Point of Care Ultrasound (POCUS) is not routinely taught in nurse practitioner (NP) or physician assistant (PA) graduate programs. This study examines outcomes of an educational intervention aimed at improving knowledge, self-confidence, and self-efficacy of the Extended Focused Assessment using Sonography in Trauma (E-FAST examination) for both NPs and PAs working in emergency settings.

METHODOLOGY

Twenty participants attended a short course including both didactic learning and hands-on learning of the E-FAST examination. Participants rated themselves using a self-assessment tool for pre- and postintervention self-evaluation. The Wilcoxon signed-rank test was used to evaluate data. A second tool used to evaluate participants' hands-on use of the E-FAST examination is the Objective Structured Assessment of Ultrasound, in which participants were evaluated by clinical experts. These data were assessed using regression analysis.

RESULTS

Participants showed improvement on the pre/post course self-assessment tool. Participants also showed proficiency using ultrasound and analyzing images as evaluated by experts.

CONCLUSIONS

A short multimodal course can improve clinicians' knowledge, confidence, and self-efficacy in the use of POCUS and the E-FAST examination.

IMPLICATIONS

Hands-on education is a valuable tool for ongoing learning.

Teaching emergency ultrasound to emergency medicine residents: a scoping review of structured training methods

BACKGROUND

Over the past 2 decades, emergency ultrasound has become essential to patient care, and is a mandated competency for emergency medicine residency graduation. However, the best evidence regarding emergency ultrasound education in residency training is not known. We performed a scoping review to determine the (1) characteristics and (2) outcomes of published structured training methods, (3) the quality of publications, and (4) the implications for research and training.

METHODS

We searched broadly on multiple electronic databases and screened studies from the United States and Canada describing structured emergency ultrasound training methods for emergency medicine residents. We evaluated methodological quality with the Medical Education Research Study Quality Instrument (MERSQI), and qualitatively summarized study and intervention characteristics.

RESULTS

A total of 109 studies were selected from 6712 identified publications. Publications mainly reported 1 group pretest-posttest interventions (38%) conducted at a single institution (83%), training in image acquisition (82%) and interpretation (94%) domains with assessment of knowledge (44%) and skill (77%) outcomes, and training in cardiac (18%) or vascular access (15%) applications. Innovative strategies, such as gamification, cadaver models, and hand motion assessment are described. The MERSQI scores of 48 articles ranged from 0 to 15.5 (median, 11.5; interquartile range, 9.6-13.0) out of 18. Low scores reflected the absence of reported valid assessment tools (73%) and higher level outcomes (90%).

CONCLUSIONS

Although innovative strategies are illustrated, the overall quality of research could be improved. The use of standardized planning and assessment tools, intentionally mapped to targeted domains and outcomes, might provide valuable formative and summative information to optimize emergency ultrasound research and training.

Effectiveness of High-Fidelity Simulation in Training Emergency Medicine Physicians in Point of Care Ultrasonography in Pakistan: A Quasi-Experimental Study

Background Point-of-care ultrasound (PoCUS) is frequently utilized in emergency medicine (EM), with an extended-focused assessment with sonography in trauma (e-FAST) being the most widely used PoCUS modality. This modality is not only time- and cost-efficient, but it is highly accurate in the diagnosis and management of surgical patients in the emergency department, as well as being highly predictive of patient outcomes. Targeted training is essential to ensure a learner's confidence in image acquisition, interpretation, and translation of knowledge to making clinical decisions. High-fidelity simulation offers a uniquely safe and "mistake-forgiving" environment to teach and train medical professionals. The present study evaluated the effectiveness of a high-fidelity simulator to train EM physicians in e-FAST at a tertiary care teaching hospital in a lower-middle-income country. Methods This quasi-experimental study was performed at a state-of-the-art simulation center of a multidisciplinary university hospital in Karachi, Pakistan. Subjects were included if they were EM physicians who volunteered to participate and were available for the entire training and testing period. The educational intervention included lectures and hands-on practice on a high-fidelity simulator (SonoSim, Santa Monica, CA). Knowledge and image interpretation on e-FAST were evaluated using a questionnaire, administered before and after the training course. Each participant's ability to acquire and interpret satisfactory images was assessed by experienced EM physicians and recorded. Participants were also administered a needs assessment survey and a course evaluation. Data were analyzed using IBM SPSS Statistics for Windows, Version 20.0 (Armonk, NY: IBM Corp.). All the tests were two-sided, and p-values ≤0.05 were considered significant. Baseline characteristics and outcome variables were recorded and compared by Wilcoxon signed-rank tests. Results A total of 31 EM physicians, 12 (38.7%) men and 19 (61.3%) women, were enrolled in the study, with 24 (77.3%) having one to three years of EM experience. Mean and percentage group performance improved from 6 and 40% before the intervention to 14.5 and 96.6% after the intervention (Z=4.867, p≤0.05). Most improvement in image acquisition on high-fidelity simulation was observed in the upper right quadrant of the suprapubic window (29/31; 93.5%), followed by the upper left quadrant (27/31; 87%) and the subxiphoid window (21/31; 67%). All 31 participants reported improvements in comfort and confidence level with PoCUS after attending the workshop. Conclusions EM physicians who attended a brief workshop incorporating simulation demonstrated improvements in knowledge and image acquisition skills in all domains tested. High-fidelity simulation training is an effective modality for training EM physicians in e-FAST.

Enhancing Splinting Confidence through Inter-Residency Education: An Educational Workshop

INTRODUCTION

The initial treatment for many orthopaedic injuries is splinting. Unfortunately, formal musculoskeletal training is limited in primary care leading to deficiencies in competency and confidence. Suboptimal splints can result in complications such as skin break-down, worsening of deformity, and increased pain. Our orthopaedic surgery clinic often cares for patients who initially present to an emergency department or primary care clinic for their orthopaedic injury. Previous studies have shown that a high number of splints are applied improperly in the primary care setting, which could result in in avoidable skin complications and fracture instability.

METHODS

Orthopaedic surgery residents held a splinting workshop for family medicine residents. The workshop involved didactic and skills portions. Pre- and post-surveys were administered using a 10-point scale to assess confidence in applying three common splints. The data were analyzed using student's t-test and qualitative feed-back.

RESULTS

Confidence in applying and molding each splint type improved significantly (p < 0.05). Knowledge in splint construction improved significantly as well (p < 0.05). Subjective feedback was positive.

CONCLUSION

These results showed inter-residency education can increase residents' confidence in skill-based medical care significantly. The results are encouraging and should facilitate further collaboration between multispecialty residency programs to improve patient care. Further investigation is needed to determine how well skills gained in workshop are retained.

Use of a Refresher Course Increases Confidence in Point-of-Care Ultrasound Skills in Emergency Medicine Faculty

Introduction All practicing emergency medicine (EM) physicians need to maintain a skillset in emergency ultrasound (US) after their initial training. EM physicians in academic practice may be supervising trainees performing ultrasound applications that they aren't comfortable with. This study investigates the effectiveness of a US refresher course. The hypothesis was that a series of short courses would increase confidence in performing and supervising US applications. Methods Nine basic emergency ultrasound applications were taught over the course of one year by ultrasound fellowship-trained EM faculty in a simulation center at a single academic institution. Each session included 30-minutes of didactics/image review and 30-minutes of hands-on practice on normal volunteers and was followed by an anonymous questionnaire evaluating comfort level performing and supervising the ultrasound application before and after the course using a Likert scale from 1 "not at all confident" to 5 "very confident". Results Thirty-six of 60 EM physicians participated in at least 1 of the 9 sessions (median 3, interquartile range 2-4). Faculty who attended had a median of 10 (interquartile range 7-15) years in practice and 61% work at both academic and community sites. For all sessions combined, confidence in performing US increased from a mean score on the Likert scale of 3.3 to 4.4 (difference 1.1, confidence interval (CI) (0.94, 1.29), p < 0.001) and confidence in supervising trainees increased from a mean of 3.4 to 4.5 (difference 1.1, CI (0.88, 1.23), p < 0.001). The largest increases were seen in musculoskeletal (MSK), nerve, and pelvic applications and the least increase was seen with the session focused on intravenous access, but confidence was increased in all sessions. Physicians in practice ≥10 years increased in confidence in performing and supervising the applications by 1.4 (CI (1.11, 1.60), p < 0.001) and 1.3, (CI (1.01, 1.49), p < 0.001), respectively. Physicians in practice <10 years increased 0.8 (CI (0.57, 1.03), p < 0.001) and 0.8 (CI (0.55, 1.05), p < 0.001), respectively. Conclusion An emergency ultrasound refresher course for EM physicians at a single institution improved self-reported confidence in both performing and supervising trainees in all applications reviewed. Those in practice ≥10 years showed the largest increases.