Ultrasound competency assessment in emergency medicine residency programs

Web-based objective and structured assessment of point-of-care lung ultrasound skills in resource-limited settings

BACKGROUND

Objective assessment of skills after training is essential for safe implementation of lung point-of-care ultrasound (POCUS). In low-and middle-income countries (LMIC) there is a need for assessment tools without onsite experts to scale up POCUS access. Our objective is to develop a web-based assessment tool and evaluate trainees across different countries and at different time points after initial lung POCUS training.

METHODS

We adapted the objective and validated lung ultrasound score (LUS-OSAUS) to a web-based tool with quiz and practical skills test. Trainees were evaluated after a short (4-day) standardized lung POCUS training and were classified in distinct groups according to (i) their geographical location (Benin vs. South-Africa) and (ii) time elapsed since training (Benin 0 months vs. Benin 6 months). The Benin 6 months group had minimal continuous education. Skills test images were read by two blinded experts. We report the overall success rates and then compare these rates based on location and timing since training, using the Fischer's exact test.

RESULTS

A total of 35 out of 43 participants completed the online LUS-OSAUS quiz and skills test. The overall success rate was 0.84 (95%CI 0.80-0.88), with lower success rates for "correct depth" 0.54 (0.37-0.71), "correct assessment of pleura" 0.63 (0.45-0.79) and "conclusion" 0.71 (0.54-0.85). There were no differences based on location, with respective rates of 0.86 (0.80-0.92) and 0.83 (0.75-0.91) (p-value = 0.125) for Benin and South Africa at 0 months, respectively. Similarly, there were no differences according to timing with success rates of 0.86 (0.80-0.92) and 0.82 (0.72-0.93) (p-value = 0.563) for Benin at 0 months and 6 months, respectively.

CONCLUSION

Web-based objective and structured assessment of lung POCUS skills in LMIC following a short-standardized training is feasible and has a good overall success rate with consistent results across regions and up to 6 months after training given minimal continuous education. Overall, technical and POCUS-based clinical conclusion skills are the most difficult to acquire.

Pediatric disaster preparedness curriculum across emergency medicine residencies

OBJECTIVE

To assess pediatric disaster medicine (PDM) instruction in emergency medicine (EM) residency programs and to identify barriers to integrating these skills into EM training.

METHODS

National survey study of United States EM Residency Program Directors (PDs) and Assistant PDs during the 2021-2022 academic year.

RESULTS

Of the 186 EM residency programs identified, a total of 24 responses were recorded with a response rate of 12.9 percent. Importance of training was rated 5.79 (standard deviation 2.51) using the Likert scale ranging from 1 to 10. Out of 24 programs, 17 (70.8 percent) do not have any PDM training as part of residency training. Live drill, simulation, and tabletop were identified as most effective methods to deliver PDM training with the Likert scale score of 4.78, 4.6, and 4.47, respectively. Senior trainees' level of -knowledge/skills with family reunification (Likert 2.09/5; chemical-biological-radiological-nuclear explosive 2.95/5) and mass casualty preparation of the emergency department (3.3/5) as assessed by the respondents. The main barrier to education included logistics, eg, space and costs (Likert 3.7/5), lack of didactic time (3.7/5), and limited faculty knowledge, skill, or experience (3.3/5).

CONCLUSION

PDM training is lacking and requires standardization. This study highlights the opportunity for the creation of a model for EM resident education in PDM.

Impact of Different Training Methods on Daily Use of Point-of-Care Ultrasound: Survey on 515 Physicians

ABSTRACT

Point-of-care ultrasound (POCUS) curriculum varies among countries. However, the length of training required for physicians is still under debate. We investigated the impact of different training methods: short hands-on courses (STS), long academic training sessions (LTS), or both (mixed training [MTS]), for POCUS daily use and self-reported confidence overall and specific to specific clinical situations. This was a descriptive study conducted over a 3-month period through a Web-based survey designed to assess the influence of different methods of POCUS training among physicians and residents on their daily practice. The survey was sent to 1212 emergency physicians with prior POCUS training; 515 answers (42%) could be analyzed. Participants in the STS group performed POCUS less frequently than physicians in the LTS or MTS group. Daily use in the STS group was 51% versus 82% in the LTS group and 83% in the MTS group ( P < 0.01). The overall self-reported confidence in POCUS was lower in the STS group ( P < 0.01) in all studied clinical situations. There was no significant difference between LTS and MTS groups ( P > 0.05). Method of POCUS training significantly influenced POCUS daily use. Physicians who underwent long training sessions used POCUS more frequently in their routine practice and were significantly more confident in their ability to perform and interpret a POCUS examination.

Clinical Ultrasound Training in Emergency Medicine Advanced Practice Provider Residencies

INTRODUCTION

Clinical ultrasound training is essential to any emergency medicine (EM) clinician's skill set. We aim to understand the current training patterns of clinical ultrasound training within Advanced Practice Provider (APP) residencies.

METHODS

In a survey sent electronically to 17 active EM APP residencies, data were obtained from 21 responses to questions about structure of ultrasound faculty, quality assessment, feedback, and competency evaluation.

RESULTS

We had a response rate of 88%. Of programs surveyed, 93% were associated with EM physician residencies with 87% led by an ultrasound fellowship-trained EM physician. Ninety-three percent of programs required proctored scanning. Sixty percent of programs do not have any required number of scans to graduate.

CONCLUSION

We found that most EM APP residencies share clinical ultrasound faculty, structures, and processes with associated EM physician residencies. We believe that quality training within clinical ultrasound is attainable; however, proficiency guidelines across EM APP residency programs are lacking.

Evaluation of an emergency medicine point-of-care ultrasound curriculum adapted for a resource-limited setting in Guyana

BACKGROUND

This is a cohort pilot study of senior emergency medicine residents and residency-trained emergency medicine registrars practicing in an urban tertiary academic hospital in Guyana in South America. The primary aim was to assess the effectiveness of the current adapted residency ultrasound training curriculum and guide future ultrasound-specific continuing medical education. Ultrasound image acquisition, interpretation, and integration of ultrasound findings into clinical medical decision-making competency were assessed in a multimodal fashion: a written assessment and a practical assessment.

METHODS

This was a cross-sectional cohort pilot study of senior emergency medicine residents and registrars (residency graduates) practicing in Guyana, a low-middle-income country. Ultrasound image acquisition and interpretation competency were assessed in a multimodal fashion: a written assessment and a practical assessment. The results will be reported as simple percentages. Participants will be deemed competent if the combined score is greater than 80% on the assessment.

RESULTS

All senior residents and graduates of the residency program were competent in the core point-of-care ultrasound applications. The senior residents averaged 89% proficiency, and the residency graduates subdivided based on years since graduation averaged 87-100% proficiency. The more experienced providers performed better on the practical portion of the evaluation. Evaluating the composite analysis of all the participants revealed the Extended Focused Assessment with Sonography in Trauma (EFAST) exam (96%) and cardiac exam (93%) were done with the most proficiency.

CONCLUSION

The assessment results of this pilot study suggest that the current residency ultrasound training curriculum adapted to the resources available is associated with sustained competency after graduation. There was minor attrition of knowledge amongst the senior physicians, but all senior residents and all participating residency graduates were competent in the core ultrasound applications.

Removing Barriers to Emergency Medicine Point-of-Care Ultrasound: Illustrated by a Roadmap for Emergency Medicine Point-of-Care Ultrasound Expansion in India

Point-of-care ultrasound (PoCUS) has a potentially vital role to play in emergency medicine (EM), whether it be in high-, medium-, or low-resourced settings. However, numerous barriers are present which impede EM PoCUS implementation nationally and globally: (i) lack of a national practice guideline or scope of practice for EM PoCUS, (ii) resistance from non-PoCUS users of ultrasound imaging (USI) and lack of awareness from those who undertake parallel or post-EM patient care, and (iii) heterogeneous pattern of resources available in different institutes and settings. When combined with the Indian Preconception and Prenatal Diagnostic Techniques (PCPNDT) Act, this has led to the majority of India's 1.4 billion citizens being unable to access EM PoCUS. In order to address these barriers (globally as well as with specific application to India), this article outlines the three core principles of EM PoCUS: (i) the remit of the EM PoCUS USI must be well defined a priori, (ii) the standard of EM PoCUS USI must be the same as that of non-PoCUS users of USI, and (iii) the imaging performed should align with subsequent clinical decision-making and resource availability. These principles are contextualized using an integrated PoCUS framework approach which is designed to provide a robust foundation for consolidation and expansion across different PoCUS specialisms and health-care settings. Thus, a range of mechanisms (from optimization of clinical practice through to PoCUS educational reform) are presented to address such barriers. For India, these are combined with specific mechanisms to address the PCPNDT Act, to provide the basis for influencing national legislation and instigating an addendum to the Act. By mapping to the recent Lancet Commission publication on transforming access to diagnostics, this provides a global and cross-discipline perspective for the recommendations.

External validation of the ultrasound competency assessment tool

Objective

Point-of-care ultrasound (POCUS) is a core component of emergency medicine (EM) residency training. No standardized competency-based tool has gained widespread acceptance. The ultrasound competency assessment tool (UCAT) was recently derived and validated. We sought to externally validate the UCAT in a 3-year EM residency program.

Methods

This was a convenience sample of PGY-1 to -3 residents. Utilizing the UCAT and an entrustment scale, as described in the original study, six different evaluators split into two groups graded residents in a simulated scenario involving a patient with blunt trauma and hypotension. Residents were asked to perform and interpret a focused assessment with sonography in trauma (FAST) examination and apply the findings to the simulated scenario. Demographics, prior POCUS experience, and self-assessed competency were collected. Each resident was evaluated simultaneously by three different evaluators with advanced ultrasound training utilizing the UCAT and entrustment scales. Intraclass correlation coefficient (ICC) between evaluators was calculated for each assessment domain; analysis of variance was used to compare UCAT performance and PGY level and prior POCUS experience.

Results

Thirty-two residents (14 PGY-1, nine PGY-2, and nine PGY-3) completed the study. Overall, ICC was 0.9 for preparation, 0.57 for image acquisition, 0.3 for image optimization, and 0.46 for clinical integration. There was moderate correlation between number of FAST examinations performed and entrustment and UCAT composite scores. There was poor correlation between self-reported confidence and entrustment and UCAT composite scores.

Conclusions

We had mixed results in our attempt to externally validate the UCAT with poor correlation between faculty and moderate to good correlation with faculty to diagnostic sonographer. More work is needed to validate the UCAT before adoption.

The use of additional imaging studies after biliary point-of-care ultrasound in the emergency department

PURPOSE

We sought to determine the test characteristics of biliary point-of-care ultrasound (POCUS) and to assess the usefulness of obtaining radiology ultrasound (RUS) or cholescintigraphy (HIDA) after biliary POCUS.

METHODS

We conducted a retrospective review of emergency department patients who underwent biliary POCUS between May 4, 2018 and November 28, 2021. To be included, patients had to have at least one of the following confirmatory evaluations (considered in this order): surgery, HIDA, RUS, or abdominal CT scan. When a discrepancy existed between the POCUS and the RUS or HIDA, they were compared to a higher criterion standard (if available).

RESULTS

Using 348 patients who had a confirmatory evaluation after biliary POCUS, we found the sensitivity and specificity of biliary POCUS for gallstones to be 97.0% (95% CI 92.6 to 99.2%) and 99.5% (95% CI 97.3 to 100%), respectively. For cholecystitis, the sensitivity and specificity were 83.8% (95% CI 72.9 to 91.6%) and 98.6% (95% CI 96.4 to 99.6%), respectively. RUS and POCUS were concordant in 72 (81.8%) of 88 cases in which the patient had both studies while HIDA and POCUS were concordant in 24 (70.6%) of 34 cases. POCUS was deemed correct in at least 50% of discrepant cases with RUS and at least 30% of discrepant cases with HIDA.

CONCLUSION

Biliary POCUS has excellent sensitivity and specificity for cholelithiasis; it has lower sensitivity for cholecystitis, but the specificity remains high. Performing a confirmatory RUS or cholescintigraphy after a positive biliary POCUS adds little value, but additional imaging may be useful when POCUS is negative for cholecystitis.

Commentary on Ultrasound Instruction in Undergraduate Medical Education: Perspective from Two Students

BACKGROUND

Ultrasound integration in undergraduate medical education (UME) has been a focused endeavor in recent years. According to the American Institute of Ultrasound in Medicine, more than a third of all US medical schools have adopted a focused ultrasound training program for medical students. Medical student perspectives on best practices in ultrasound education are lacking in the literature.

CURRICULA EXPERIENCES

Two students' reflections are presented regarding two different didactic approaches, flipped classroom and self-study learning models, to teaching ultrasound in the pre-clinical medical education curriculum. Students present reflections on these didactic approaches to facilitate further improvement in ultrasound education curricula.

DISCUSSION

The self-directed learning model enabled students to learn foundational ultrasound exam techniques efficiently in a low-stress environment and subsequently optimized the efficiency of later faculty-led learning events. However, we noted that in both the flipped classroom and self-study learning models of education, the training on basic physical properties of ultrasound, tissue characteristics, and probe manipulation was limited.

CONCLUSION

A self-study learning model ultrasound curricula improves perceived learning efficiency and student confidence, especially when followed by faculty-guided didactics and scanning opportunities. We suggest a framework for ultrasound education curricula that includes components of both formats of ultrasound education alongside faculty-led sessions as an ideal model of ultrasound education. Further, we propose the added benefit of inanimate object scanning to optimize students' knowledge of waveform physics (image acquisition and physical properties of materials) early in the ultrasound education process.

Development and Validation of a Point-of-Care-Ultrasound Image Quality Assessment Tool: The POCUS IQ Scale

OBJECTIVES

We aimed to develop a standardized scoring tool to measure point-of-care ultrasound (POCUS) image quality and to determine validity evidence for its use to assess lung ultrasound image quality.

METHODS

The POCUS Image Quality (POCUS IQ) scale was developed by POCUS-trained physicians to assess sonographers' image acquisition skills by evaluating image quality for any POCUS application. The scale was piloted using lung images of healthy standardized patients acquired by three expert sonographers compared to three novices before and after training. All images (experts, novices pre-training, novices post-training) were scored on the POCUS IQ scale by three blinded POCUS-trained physicians. Reliability was assessed with fully-crossed generalizability and decision studies. Validity was assessed using Messick's framework.

RESULTS

Content validity was supported by the tool's development process of literature review, expert consensus, and pilot testing. Response process was supported by reviewer training and the blinded scoring process. Relation to other variables was supported by scores relating to sonographer experience: median expert score = 10.5/14 (IQR: 4), median novice pre-training score = 6/14 (IQR: 2.25), and novices' improvement after training (median post-training score = 12/14, IQR: 3.25). Internal structure was supported by internal consistency data (coefficient alpha = 0.84, omega coefficient = 0.91) and the generalizability study showing the main contributor to score variability was the sonographer (51%). The G-coefficient was 0.89, suggesting very good internal structure, however, Gwet's AC₂  was 0.5, indicating moderate interrater reliability. The D study projected a minimum of 1 reviewer and 2 patients are needed for good psychometric reliability.

CONCLUSIONS

The POCUS scale has good preliminary validity evidence as an assessment tool for lung POCUS image acquisition skills. Further studies are needed to demonstrate its utility for other POCUS applications and as a feedback tool for POCUS learners.

A consensus list of ultrasound competencies for graduating emergency medicine residents

Objectives

Emergency ultrasound (EUS) is a critical component of emergency medicine (EM) resident education. Currently, there is no consensus list of competencies for EUS training, and graduating residents have varying levels of skill and comfort. The objective of this study was to define a widely accepted comprehensive list of EUS competencies for graduating EM residents through a modified Delphi method.

Methods

We developed a list of EUS applications through a comprehensive literature search, the American College of Emergency Physicians list of core EUS benchmarks, and the Council of Emergency Medicine Residency-Academy of Emergency Ultrasound consensus document. We assembled a multi-institutional expert panel including 15 faculty members from diverse practice environments and geographical regions. The panel voted on the list of competencies through two rounds of a modified Delphi process using a modified Likert scale (1 = not at all important, 5 = very important) to determine levels of agreement for each application-with revisions occurring between the two rounds. High agreement for consensus was set at >80%.

Results

Fifteen of 15 panelists completed the first-round survey (100%) that included 359 topics related to EUS. After the first round, 195 applications achieved high agreement, four applications achieved medium agreement, and 164 applications achieved low agreement. After the discussion, we removed three questions and added 13 questions. Fifteen of 15 panelists completed the second round of the survey (100%) with 209 of the 369 applications achieving consensus.

Conclusion

Our final list represents expert opinion on EUS competencies for graduating EM residents. We hope to use this consensus list to implement a more consistent EUS curriculum for graduating EM residents and to standardize EUS training across EM residency programs.

Evaluation of a Novel Point-of-Care Ultrasound Curriculum for First-Year Pediatric Residents

OBJECTIVE

The aim of the study is to evaluate a novel point-of-care ultrasound (POCUS) educational curriculum for pediatric residents.

METHODS

The cohort study in graduate medical education was completed from January 2017 to March 2019. Postgraduate year 1 (PGY1) pediatric residents attended the educational curriculum that consisted of 3 half-day sessions over a 3-month period. Each session consisted of a lecture (introduction, extended focused assessment with sonography for trauma, soft tissue/musculoskeletal, cardiac, and resuscitative applications) followed by supervised hands-on scanning sessions. Group ratio was 3 learners to 1 machine/expert instructor. Main outcome measures included pre- and post-written test scores, as well as objective structured clinical examination (OSCE) scores.

RESULTS

Forty-nine PGY1 residents (78% women) completed the curriculum. The mean (SD) pretest score was 68% (8.5), and the mean posttest score was 83% (8.3) with a difference of 15 (95% confidence interval, 12.5-17.6; P < 0.001). Mean (SD) focused assessment with sonography for trauma OSCE score after the curriculum was 88.7% (11.9). The number of PGY1 pediatric residents that were comfortable performing POCUS examinations increased from pretraining to posttraining for soft tissue/musculoskeletal (14%-61%, P < 0.001), extended focused assessment with sonography for trauma (24%-90%, P < 0.001), and cardiac (18%-86%, P < 0.001). All participants found the curriculum useful, and 42 of 49 (86%) stated the curriculum increased their ability to acquire and interpret images.

CONCLUSIONS

Postgraduate year 1 pediatric residents learned the basics of POCUS through 3 brief educational sessions. The increase in posttest scores demonstrated improved POCUS knowledge, and the high OSCE score demonstrated their ability to acquire ultrasound images. Point-of-care ultrasound guidelines are needed for pediatric residency programs.

Neonatal POCUS: Embracing our modern day "stethoscope"

The dramatic technologic advancements seen in ultrasound have accelerated the growth of point-of-care ultrasound (POCUS) in medicine. Neonatology has lagged behind other pediatric and adult specialties in incorporating POCUS into clinical practice despite there being numerous applications in cardiac and non-cardiac arenas. Widely available training programs are aiding in improving this situation but significantly more structure and orchestration for neonatal POCUS dissemination will be needed to fully actualize the potential for POCUS to augment its widespread clinical application.

Point-of-care ultrasound training for residents in anaesthesia and critical care: results of a national survey comparing residents and training program directors' perspectives

BACKGROUND

Point-of-care ultrasound (POCUS) has become an essential tool for anaesthesia and critical care physicians and dedicated training is mandatory. This survey describes the current state of Italian residency training programs through the comparison of residents' and directors' perspective.

METHODS

Observational prospective cross-sectional study: 12-question national e-survey sent to Italian directors of anaesthesia and critical care residency programs (N = 40) and residents (N = 3000). Questions focused on POCUS teaching (vascular access, transthoracic echocardiography, focused assessment for trauma, transcranial Doppler, regional anaesthesia, lung and diaphragm ultrasound), organization (dedicated hours, teaching tools, mentors), perceived adequacy/importance of the training and limiting factors.

RESULTS

Five hundred seventy-one residents and 22 directors completed the survey. Bedside teaching (59.4-93.2%) and classroom lessons (29.7-54.4%) were the most frequent teaching tools. Directors reported higher participation in research projects (p < 0.05 for all techniques but focused assessment for trauma) and simulation (p < 0.05 for all techniques but transthoracic echocardiography). Use of online teaching was limited (< 10%); however, 87.4% of residents used additional web-based tools. Consultants were the most frequent mentors, with different perspectives between residents (72.0%) and directors (95.5%; p = 0.013). Residents reported self-training more frequently (48.5 vs. 9.1%; p < 0.001). Evaluation was mainly performed at the bedside; a certification was not available in most cases (< 10%). Most residents perceived POCUS techniques as extremely important. Residents underestimated the relevance given by directors to ultrasound skills in their evaluation and the minimal number of exams required to achieve basic competency. Overall, the training was considered adequate for vascular access only (62.2%). Directors mainly agreed on the need of ultrasound teaching improvement in all fields. Main limitations were the absence of a standardized curriculum for residents and limited mentors' time/expertise for directors.

CONCLUSION

POCUS education is present in Italian anaesthesia and critical care residency programs, although with potential for improvement. Significant discrepancies between residents' and directors' perspectives were identified.

Task model-specific operator skill assessment in routine fetal ultrasound scanning

Purpose

For highly operator-dependent ultrasound scanning, skill assessment approaches evaluate operator competence given available data, such as acquired images and tracked probe movement. Operator skill level can be quantified by the completeness, speed, and precision of performing a clinical task, such as biometry. Such clinical tasks are increasingly becoming assisted or even replaced by automated machine learning models. In addition to measurement, operators need to be competent at the upstream task of acquiring images of sufficient quality. To provide computer assistance for this task requires a new definition of skill.

Methods

This paper focuses on the task of selecting ultrasound frames for biometry, for which operator skill is assessed by quantifying how well the tasks are performed with neural network-based frame classifiers. We first develop a frame classification model for each biometry task, using a novel label-efficient training strategy. Once these task models are trained, we propose a second task model-specific network to predict two skill assessment scores, based on the probability of identifying positive frames and accuracy of model classification.

Results

We present comprehensive results to demonstrate the efficacy of both the frame-classification and skill-assessment networks, using clinically acquired data from two biometry tasks for a total of 139 subjects, and compare the proposed skill assessment with metrics of operator experience.

Conclusion

Task model-specific skill assessment is feasible and can be predicted by the proposed neural networks, which provide objective assessment that is a stronger indicator of task model performance, compared to existing skill assessment methods.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11548-022-02642-y.

Integrating Point of Care Ultrasound Education into Clinical Practice at the Emergency Department

Point of care ultrasound (POCUS) competency is now required learning for emergency medicine trainees. However, there is a wide range of areas that need to be assessed when determining competence. Therefore, this study aims to evaluate competence levels of POCUS skill acquisition including the areas of image acquisition, image interpretation and clinical integration of the emergency medicine residents while on shift in real clinical practice situations. This was a retrospective descriptive study. This study was conducted at Srinagarind Hospital, Thailand from January 2021 through December 2021. The data were collected and reviewed from electronic medical records, ultrasound images and video clips. All POCUS competency skills were assessed by researcher staff. Our results demonstrated that our learners had overall satisfactory competence of image acquisition, satisfactory image interpretation skills, and good clinical integration skills. However, obstetrics and gynecology (OB-GYN) ultrasound scores were poor and cardiac ultrasound had the most varied score of image quality. This study clearly showed the measurable benefits of a POCUS course being integrated into real clinical practice.

The P2Network-Advancing Pediatric Emergency Care With Point-of-Care Ultrasound

ABSTRACT

Over the last 2 decades, the use of point-of-care ultrasound (POCUS) in pediatric emergency medicine (PEM) has grown exponentially. In 2014, a group of PEM POCUS leaders met and formed the P2Network. The P2Network provides a platform to build collaborative relationships and share expertise among members from various countries and practice settings. It works with educators and researchers within and outside of the field to advance POCUS practice in PEM. As an organization, the P2Network promotes the evidence-based application of POCUS to facilitate and improve care in the PEM setting and addresses issues related to integration of the PEM POCUS practitioner in this nascent field. The P2Network is building and augmenting its infrastructure for PEM POCUS research and education and has already made some progress in the areas, with published manuscripts and ongoing clinical research studies under its sponsorship. Future goals include developing a PEM POCUS research agenda, formalizing teaching and assessment of PEM POCUS skills, and implementing multicenter research studies on potentially high impact applications.

Number Needed to Scan: Evidence-Based Point-of-Care Ultrasound (POCUS)

Interest and enthusiasm, regarding the use of point-of-care ultrasound (POCUS), continues to grow among clinicians in multiple medical specialties. Ultrasound machines technology has advanced to allow for smaller, even handheld machines. Integration of automated imaging technology has made these machines more user-friendly. However, one of the concerns with the widespread availability of POCUS is the overuse and misuse of this technology. In order to maximize the clinical impact of POCUS, this manuscript seeks to discuss a novel concept called the “Number needed to scan” (NNS). The NNS is an expression of the number of POCUS examinations needed to be performed to attain a benefit to the patient or to prevent an adverse outcome of a procedure. NNS serves a dual purpose: it can help clinicians understand the magnitude of clinical impact when they apply POCUS, and it can help clinicians explain this magnitude in layman terms to their patients. In this manuscript, we have focused our NNS calculations on landmark articles in three major categories: change in management; safety and accuracy; and catching a missed diagnosis. As clinicians seek to be good stewards of POCUS, NNS should be a concept used to consider which patients will be most likely to benefit from a clinician performed ultrasound.

Longitudinal accuracy analysis of ultrasound performed during a four-year emergency medicine residency

BACKGROUND

The objective of this study was to analyze patterns of point-of-care ultrasound (POCUS) performance over 4 years of emergency medicine (EM) residency. Specifically, we aimed to study how accuracy and adherence to standards of scanning changed by postgraduate year (PGY).

METHODS

This was a retrospective observational study of resident-performed POCUS at an academic emergency department over 6 years. We reviewed records of POCUS scans performed by PGY-1 to -4 residents that had been collected for quality assurance purposes. Data that were collected about EM residents' performance included the total number and type of scans per year, rate of technically limited scans (TLS), and accuracy on interpreting ultrasound images. Resident performances in each year (PGY-1 to -4) were independently evaluated and reported.

RESULTS

During a 6-year period, 137 different EM residents performed 50,815 ultrasound scans. The median number of scans was 177 for PGY-1, 124 for PGY-2, 118 for PGY-3, and 76 for residents in PGY-4. The accuracy of scan interpretations were high across all PGY levels (>97%), but slight degradation was observed as residents progressed through residency. The TLS rate increased from 4.7% among PGY-1s to 13.6% as PGY-4s.

CONCLUSIONS

In this large cohort of POCUS studies by EM residents, POCUS accuracy rates decreased and rates of TLS significantly increased as residents progressed through residency.

Use of Hand-motion Analysis to Assess Competence and Skill Decay for Cardiac and Lung Point-of-care Ultrasound

OBJECTIVES

Assessment of competence in technical skills, including point-of-care ultrasound (POCUS), is required before a novice can safely perform the skill independently. Ongoing assessment of competence is also required because technical skills degrade over time, especially when they are infrequently performed or complex. Hand-motion analysis (HMA) is an objective assessment tool that has been used to evaluate competency in many technical skills. The purpose of this study was to demonstrate the feasibility and validity of HMA as an assessment tool for competence in both simple and complex technical skills as well as skill degradation over time.

METHODS

This prospective cohort study included 36 paramedics with no POCUS experience and six physicians who were fellowship trained in POCUS. The novices completed a 4-hour didactic and hands-on training program for cardiac and lung POCUS. HMA measurements, objective structured clinical examinations (OSCE), and written examinations were collected for novices immediately before and after training as well as 2 and 4 months after training. Expert HMA metrics were also recorded.

RESULTS

Expert HMA metrics for cardiac and lung POCUS were significantly better than those of novices. After completion of the training program, the novices improved significantly in all HMA metrics, knowledge test scores, and OSCE scores. Novices showed skill degradation in cardiac POCUS based on HMA metrics and OSCE scores while lung POCUS image acquisition skills were preserved. Novices deemed competent by OSCE score performed significantly better in HMA metrics than those not deemed competent.

CONCLUSION

We have demonstrated that HMA is a feasible and valid tool for assessment of competence in technical skills and can also evaluate skill degradation over time. Skill degradation appears more apparent in complex skills, such as cardiac POCUS. HMA may provide a more efficient and reliable assessment of technical skills, including POCUS, when compared to traditional assessment tools.

A randomized controlled trial of simulation-based mastery learning to teach the extended focused assessment with sonography in trauma

BACKGROUND

Mastery learning has gained popularity for training residents in procedural skills due to its demonstrated superiority over traditional methods. However, no studies have compared the efficacy of traditional versus mastery learning methods in residency point-of-care ultrasound education. We hypothesized that mastery learning would improve residents' skills in performing the extended focused assessment with sonography in trauma (eFAST).

METHODS

All first-year emergency medicine (EM) resident physicians at a single university hospital underwent a crossover randomized controlled trial to receive mastery-learning eFAST training either at the beginning of the academic year or 6 months into intern year. Participants were taught using a checklist validated by a panel of experts using Mastery Angoff methods and were given feedback on missed tasks until each trainee completed the eFAST with a minimum passing standard (MPS). Our primary outcome was technical proficiency between the two groups for eFAST examinations performed in the emergency department during the academic year.

RESULTS

Sixteen interns were enrolled; eight were randomized to each group. The group that received mastery training at the beginning of the year had mean clinical eFAST proficiency scores above the MPS in the first two quarters of the academic year, while the control group did not. Once the control group underwent eFAST mastery training at the midpoint of the year, both groups had mean proficiency scores above the MPS for the remainder of the year.

CONCLUSION

Simulation-based mastery learning is an effective method of teaching the eFAST examination. This training during intern orientation conferred early proficiency in clinical performance of eFAST among EM residents. This difference in proficiency was no longer present after the control group received mastery learning education halfway through the academic year.

The Ultrasound Competency Assessment Tool (UCAT): Development and Evaluation of a Novel Competency-based Assessment Tool for Point-of-care Ultrasound

OBJECTIVES

Point-of-care ultrasound (POCUS) has become an integral diagnostic and interventional tool. Barriers to POCUS training persist, and it continues to remain heterogeneous across training programs. Structured POCUS assessment tools exist, but remain limited in their feasibility, acceptability, reliability, and validity; none of these tools are entrustment-based. The objective of this study was to derive a simple, entrustment-based POCUS competency assessment tool and pilot it in an assessment setting.

METHODS

This study was composed of two phases. First, a three-step modified Delphi design surveyed 60 members of the Canadian Association of Emergency Physicians Emergency Ultrasound Committee (EUC) to derive the anchors for the tool. Subsequently, the derived ultrasound competency assessment tool (UCAT) was used to assess trainee (N = 37) performance on a simulated FAST examination. The intraclass correlation (ICC) for inter-rater reliability and Cronbach's alpha for internal consistency were calculated. A statistical analysis was performed to compare the UCAT to other competency surrogates.

RESULTS

The three-round Delphi had 22, 26, and 26 responses from the EUC members. Consensus was reached, and anchors for the domains of preparation, image acquisition, image optimization, and clinical integration achieved approval rates between 92 and 96%. The UCAT pilot revealed excellent inter-rater reliability (with ICC values of 0.69-0.89; p < 0.01) and high internal consistency (α = 0.91). While UCAT scores were not impacted by level of training, they were significantly impacted by the number of previous POCUS studies completed.

CONCLUSIONS

We developed and successfully piloted the UCAT, an entrustment-based bedside POCUS competency assessment tool suitable for rapid deployment. The findings from this study indicate early validity evidence for the use of the UCAT as an assessment of trainee POCUS competence on FAST. The UCAT should be trialed in different populations performing several POCUS study types.

Differences in Gaze Fixation Location and Duration Between Resident and Fellowship Sonographers Interpreting a Focused Assessment With Sonography in Trauma

OBJECTIVES

We quantified the gaze fixation duration of resident and fellowship sonographers interpreting a prerecorded focused assessment with sonography in trauma (FAST). We hypothesized that all sonographers would fixate on each relevant anatomic relationship but that the duration of fixation would differ.

METHODS

We conducted a cross-sectional study collecting and analyzing the gaze fixations of a convenience sample of current resident and fellowship sonographers. All sonographers viewed a standardized FAST video, and their gaze fixations were recorded using a Tobii X3-120 eye-tracking bar. Gaze fixations over nine anatomic regions of interest (ROIs) were identified. These were assessed for normality and analyzed using the Wilcoxon rank sum test at an alpha of 0.05 and Bonferroni correction p value of <0.0034. The chi-square test and Pearson's correlation were performed to assess statistical association.

RESULTS

The gaze fixation recordings of 24 resident and eight fellowship sonographers were suitable for analysis. Fourteen of the 24 resident sonographers viewed all ROIs in the FAST, whereas all eight fellowship sonographers viewed each of the nine relevant ROIs. Five ROIs were identified over which at least one resident sonographer did not have a gaze fixation. No statistically significant difference was identified between groups. Resident sonographers gaze fixated over the left upper quadrant (LUQ) splenorenal interface for a median (interquartile range) of 10.64 (9.73-11.60) seconds. The fellowship group viewed the same ROI for 8.43 (6.64-8.95) seconds (p < 0.003). All participants viewed this ROI. No other ROIs had a statistical difference.

CONCLUSION

Five ROIs were identified that were not visually interrogated by all resident sonographers. Only 14 of 24 resident sonographers visually interrogated every area in the FAST, whereas all fellowship sonographers interrogated every ROI. A statistically significant difference was found in gaze fixation duration between resident and fellowship sonographers in one ROI. Further study is required for gaze fixation assessment to become a tool for the interpretation component of point-of-care ultrasound.

Learner-centered Survey of Point-of-care Ultrasound Training, Competence, and Implementation Barriers in Emergency Medicine Training Programs in India

BACKGROUND

Point-of-care ultrasound (POCUS) is important to the practice of emergency medicine (EM), but requires training to achieve competence. The purpose of this study was to describe the current state of POCUS practice and perceived barriers to the implementation in EM training programs in India.

METHODS

A cross-sectional survey consisting of 28 questions was administered to 378 faculty and residents in postgraduate EM training programs across India.

RESULTS

Data were collected from 159 physicians from 16 institutions; 76% of them were EM residents, with a response rate of 42%. Respondents overwhelmingly reported high interest (91%) in learning POCUS topics. Respondents identified highest levels of comfort with the performance and interpretation of trauma ultrasound (US) and echocardiography. Conversely, there was a scarce interest and low levels of competence in performing obstetric US, which may be a result of the practice of triaging these complaints to obstetricians and gynecologists. Lack of US equipment and dedicated training were the highest rated barriers by a significant margin, which 56% of respondents ranked as "very important."

CONCLUSIONS

While significant interest in POCUS exists among the Indian EM physicians, comfort and competence were limited to trauma and echocardiography applications. Expansion of and comfort with POCUS use in these settings may be sought through improvement of access to US equipment and a dedicated US curriculum.

Clinical Integration of Point-of-care Ultrasound by Emergency Medicine Residents: A Single-center Mixed-methods Study

BACKGROUND

Point-of-care ultrasound (POCUS) competence consists of image acquisition, image interpretation, and clinical integration. Limited data exist on POCUS usage patterns and clinical integration by emergency medicine (EM) residents. We sought to determine actual POCUS usage and clinical integration patterns by EM residents and to explore residents' perspectives on POCUS clinical integration.

METHODS

We conducted an explanatory sequential mixed-methods study at a 4-year EM residency program. In phase 1, EM ultrasound (US) attendings observed PGY-4 EM residents' clinical integration of POCUS in real time while on shift in the emergency department (ED). EM US attendings evaluated residents on their intent to perform POCUS, actual POCUS usage, and competence per patient encounter. We used logistic regression to analyze these parameters. In phase 2, we conducted semi-structured interviews with the observed PGY-4 residents regarding POCUS usage and clinical integration in the ED. We analyzed qualitative data for themes.

RESULTS

Emergency medicine US attendings observed 10 PGY-4 EM residents during 254 high-acuity patient encounters from December 2018 to March 2019. EM US attendings considered POCUS indicated for 26% (66/254) of patients, possibly indicated for 12% (30/254) and not indicated for 62% (158/254). Of the 66 patients for whom EM US attendings considered POCUS indicated, PGY-4s intended to perform POCUS for patient management 61% (40/66) of the time. PGY-4s subsequently incorporated POCUS into patient management 73% (48/66) of the time. EM US attendings considered PGY-4s entrustable to perform POCUS independently 81% (206/254) of the time. We did not find a statistically significant association between shift volume, shift type, or POCUS application, and resident intent to perform POCUS nor competence. Interviews identified three factors that influence PGY-4's POCUS clinical integration: motivations to use POCUS, barriers to utilization, and POCUS educational methods.

CONCLUSIONS

This mixed-methods study identified a significant gap in POCUS utilization and clinical integration by PGY-4 EM residents for clinically indicated cases identified by EM US attendings. As clinical integration is a cornerstone of POCUS competence, it is important to ensure that EM resident POCUS curricula emphasize training on clinical utilization and indications for POCUS while on shift in the ED.

Interdisciplinary approach to enhance trauma residents education of Extended-Focused Assessment for Sonography in Trauma in the emergency department

BACKGROUND

Despite the utilization of point-of-care ultrasound (POCUS) by trauma surgeons, formal POCUS requirements do not exist for general surgery residents. We sought to evaluate surgery resident comfort with performing and interpreting of Extended-Focused Assessment for Sonography in Trauma (E-FAST) scans after a brief educational session.

METHODS

A pre-survey, sent to PGY-2 and -3 surgical residents before their trauma rotation, evaluated comfort with eight components of the E-FAST. Residents were then required to watch a 15-min online video and attend a 1-h bedside training session moderated by emergency medicine ultrasound fellows during which residents practised E-FAST image acquisition and interpretation. After the rotation, residents completed a post-survey evaluating their comfort with the E-FAST.

RESULTS

All 27 residents rotating on the trauma service during the 2017-2018 academic year were eligible and, therefore, approached by the study team. Twenty-one (77.78%) residents completed the pre-survey, training and post-survey. Initially, only 52% (13/25) of residents reported feeling confident in performing the E-FAST. After the session, all (100%) reported feeling confident in their training in E-FAST. Self-reported mean comfort with each of the eight components of the E-FAST showed a statistically significant (P < 0.01) increase from pre-post survey for all residents. Isolating only the residents who initially reported feeling confident in E-FAST still showed a statistically significant (P < 0.01) increase in mean comfort.

CONCLUSION

A single POCUS training programme has been shown to improve surgical residents' comfort in performing and interpreting the E-FAST. This interdisciplinary approach can enhance collaboration and bridge gaps between emergency medicine and surgery residency programmes.

Evaluation of Gender Differences in Ultrasound Milestone Evaluations During Emergency Medicine Residency Training: A Multicenter Study

OBJECTIVES

Prior literature has demonstrated incongruities among faculty evaluation of male and female residents' procedural competency during residency training. There are no known studies investigating gender differences in the assessment of procedural skills among emergency medicine (EM) residents, such as those required by ultrasound. The objective of this study was to determine if there are significant gender differences in ultrasound milestone evaluations during EM residency training.

METHODS

We used a stratified, random cluster sample of Accreditation Council for Graduate Medical Education (ACGME) EM residency programs to conduct a longitudinal, retrospective cohort analysis of resident ultrasound milestone evaluation data. Milestone evaluation data were collected from a total of 16 ACGME-accredited EM residency programs representing a 4-year period. We stratified milestone data by resident gender, date of evaluation, resident postgraduate year, and cohort (residents with the same starting date).

RESULTS

A total of 2,554 ultrasound milestone evaluations were collected from 1,187 EM residents (750 men [62.8%] and 444 women [37.1%]) by 104 faculty members during the study period. There was no significant overall difference in mean milestone score between female and male residents [mean difference = 0.01 (95% confidence interval {CI} = -0.04 to 0.05)]. There were no significant differences between female and male residents' mean milestone scores at the first (baseline) PGY1 evaluation (mean difference = -0.04 [95% CI = -0.09 to 0.003)] or at the final evaluation during PGY3 (mean difference = 0.02 [95% CI = -0.03 to 0.06)].

CONCLUSIONS

Despite prior studies suggesting gender bias in the evaluation of procedural competency during residency training, our study indicates that there were no significant gender-related differences in the ultrasound milestone evaluations among EM residents within training programs throughout the United States.

Consensus-Based Expert Development of Critical Items for Direct Observation of Point-of-Care Ultrasound Skills

BACKGROUND

Point-of-care ultrasound (POCUS) is increasingly used in a number of medical specialties. To support competency-based POCUS education, workplace-based assessments are essential.

OBJECTIVE

We developed a consensus-based assessment tool for POCUS skills and determined which items are critical for competence. We then performed standards setting to set cut scores for the tool.

METHODS

Using a modified Delphi technique, 25 experts voted on 32 items over 3 rounds between August and December 2016. Consensus was defined as agreement by at least 80% of the experts. Twelve experts then performed 3 rounds of a standards setting procedure in March 2017 to establish cut scores.

RESULTS

Experts reached consensus for 31 items to include in the tool. Experts reached consensus that 16 of those items were critically important. A final cut score for the tool was established at 65.2% (SD 17.0%). Cut scores for critical items are significantly higher than those for noncritical items (76.5% ± SD 12.4% versus 53.1% ± SD 12.2%, P < .0001).

CONCLUSIONS

We reached consensus on a 31-item workplace-based assessment tool for identifying competence in POCUS. Of those items, 16 were considered critically important. Their importance is further supported by higher cut scores compared with noncritical items.

Tools for Measuring Clinical Ultrasound Competency: Recommendations From the Ultrasound Competency Work Group

Competency in clinical ultrasound is essential to ensuring safe patient care. Competency in clinical ultrasound includes identifying when to perform a clinical ultrasound, performing the technical skills required for ultrasound image acquisition, accurately interpreting ultrasound images, and incorporating sonographic findings into clinical practice. In this concept paper, we discuss the advantages and limitations of existing tools to measure ultrasound competency. We propose strategies and future directions for assessing competency in clinical ultrasound.

Necrotizing Soft Tissue Infections: A Focused Review of Pathophysiology, Diagnosis, Operative Management, Antimicrobial Therapy, and Pediatrics

Background: Necrotizing fasciitis is a major health problem throughout the world. The purpose of this review is to assist providers with the care of these patients through a better understanding of the pathophysiology and management options. Methods: This is a collaborative review of the literature between members of the Surgical Infection Society of North America and World Society of Emergency Surgery. Results: Necrotizing fasciitis continues to be difficult to manage with the mainstay being early diagnosis and surgical intervention. Recognition of at-risk populations assists with the initiation of treatment, thereby impacting outcomes. Conclusions: Although there are some additional treatment strategies available, surgical debridement and antimicrobial therapy are central to the successful eradication of the disease process.

Evaluation of a novel curriculum on point-of-care ultrasound competency and confidence

INTRODUCTION

Point-of-care ultrasound (POCUS) education is a requirement of graduate medical education in EM. Milestones have been established to assess resident US competency. However, the delivery of POCUS education has not been standardized. This study aims to evaluate the impact of implementing a longitudinal, structured POCUS curriculum during EM residency on trainee competency and confidence.

METHODS

A prospective study of PGY-3 trainees before and after implementation of a novel POCUS curriculum was performed over an 18-month period at an EM residency training program. Curriculum design included longitudinal POCUS application-based monthly electronic content, bi-monthly residency conference sessions, and hands-on rotations. PGY-3 resident's POCUS knowledge was assessed with a 38-question multiple-choice and image-based exam. Further, PGY-3 residents were surveyed regarding POCUS confidence. Survey results evaluated provider confidence, satisfaction with the novel curriculum, and overall perception of POCUS utility scored on a 1 (low) to 5 (high) scale. Results were evaluated using an unpaired t test for data analysis.

RESULTS

Mean quiz scores of 8 pre-curriculum PGY-3 residents (84%; 95%CI 78.46-89.54) were not significantly different when compared with 13 post-curriculum PGY-3 residents (82%; 95%CI 77.11-86.89) (p = 0.6126). Survey results for pre-curriculum trainees across each section were 4.13 (95%CI 3.91-4.35), 3.68 (95%CI 3.32-4.04), and 4.33 (95%CI 4.06-4.6). Results for post-curriculum trainees trended higher for each section at 4.22 (95%CI 4.04-4.40) (p = 0.4738), 3.84 (95%CI 3.52-4.16) (p = 0.5279), and 4.49 (95%CI 4.21-4.77) (p = 0.4534).

CONCLUSIONS

Implementation of a structured, longitudinal POCUS curriculum resulted in a trend towards improved trainee confidence, satisfaction, and perception of POCUS. Future studies are needed to identify the optimal structure for POCUS educational content delivery and competency assessment for EM resident providers.

Contrasting Residency Training in Japan and the United States From Perspectives of Japanese Physicians Trained in Both Systems

BACKGROUND

International medical graduates (IMGs) have significant exposure to clinical training in their home country, which provides opportunity for international comparison of training experiences. One relevant IMG population is Japanese physicians who have completed some training before entering residency programs in the United States and desire to improve medical education in Japan.

OBJECTIVE

We examined Japanese IMGs' perceptions of the respective attributes of residency in the United States and Japan.

METHODS

Individual semistructured interviews were conducted with 33 purposively sampled Japanese IMGs who had completed training. We used exploratory thematic analysis, iterative data collection, and thematic analyses with constant comparison.

RESULTS

Comments were organized into 3 categories: (1) attributes of US residency preferable to Japanese residency; (2) attributes of residency training with no clear preference for the US or Japanese systems; and (3) attributes of Japanese residency preferable to US residency. Within each category, we matched themes to residency program requirements or culture of medical training. Main themes include high regard for Accreditation Council for Graduate Medical Education (ACGME) Common Program Requirements, with emphasis on efficient achievement of clinical competency through graded responsibility, contrasted with preference expressed for a Japanese training culture of increased professional commitment facilitated by a lack of work hour limits and development of broad clinician skills, including bedside procedures and radiology interpretation.

CONCLUSIONS

Japanese training culture contrasts with a US model that is increasingly focused on work-life balance and associated compartmentalization of patient care. These findings enhance our understanding of the global medical education landscape and challenges to international standardization of training.

Evaluation of Trainee Competency with Point-of-Care Ultrasonography (POCUS): a Conceptual Framework and Review of Existing Assessments

Point-of-care ultrasonography (POCUS) has the potential to transform healthcare delivery through its diagnostic expediency. Trainee competency with POCUS is now mandated for emergency medicine through the Accreditation Council for Graduate Medical Education (ACGME), and its use is expanding into other medical specialties, including internal medicine. However, a key question remains: how does one define "competency" with this emerging technology? As our trainees become more acquainted with POCUS, it is vital to develop validated methodology for defining and measuring competency amongst inexperienced users. As a framework, the assessment of competency should include evaluations that assess the acquisition and application of POCUS-related knowledge, demonstration of technical skill (e.g., proper probe selection, positioning, and image optimization), and effective integration into routine clinical practice. These assessments can be performed across a variety of settings, including web-based applications, simulators, standardized patients, and real clinical encounters. Several validated assessments regarding POCUS competency have recently been developed, including the Rapid Assessment of Competency in Echocardiography (RACE) or the Assessment of Competency in Thoracic Sonography (ACTS). However, these assessments focus mainly on technical skill and do not expand upon other areas of this framework, which represents a growing need. In this review, we explore the different methodologies for evaluating competency with POCUS as well as discuss current progress in the field of measuring trainee knowledge and technical skill.

Direct Observation Assessment of Ultrasound Competency Using a Mobile Standardized Direct Observation Tool Application With Comparison to Asynchronous Quality Assurance Evaluation

OBJECTIVES

Competency assessment is a key component of point-of-care ultrasound (POCUS) training. The purpose of this study was to design a smartphone-based standardized direct observation tool (SDOT) and to compare a faculty-observed competency assessment at the bedside with a blinded reference standard assessment in the quality assurance (QA) review of ultrasound images.

METHODS

In this prospective, observational study, an SDOT was created using SurveyMonkey containing specific scoring and evaluation items based on the Council of Emergency Medicine Residency-Academy of Emergency Ultrasound: Consensus Document for the Emergency Ultrasound Milestone Project. Ultrasound faculty used the mobile phone-based data collection tool as an SDOT at the bedside when students, residents, and fellows were performing one of eight core POCUS examinations. Data recorded included demographic data, examination-specific data, and overall quality measures (on a scale of 1-5, with 3 and above being defined as adequate for clinical decision making), as well as interpretation and clinical knowledge. The POCUS examination itself was recorded and uploaded to QPath, a HIPAA-compliant ultrasound archive. Each examination was later reviewed by another faculty blinded to the result of the bedside evaluation. The agreement of examinations scored adequate (3 and above) in the two evaluation methods was the primary outcome.

RESULTS

A total of 163 direct observation evaluations were collected from 23 EM residents (93 SDOTs [57%]), 14 students (51 SDOTs [31%]), and four fellows (19 SDOTs [12%]). The trainees were evaluated on completing cardiac (54 [33%]), focused assessment with sonography for trauma (34 [21%]), biliary (25 [15%]), aorta (18 [11%]), renal (12 [7%]), pelvis (eight [5%]), deep vein thrombosis (seven [4%]), and lung scan (5 [3%]). Overall, the number of observed agreements between bedside and QA assessments was 81 (87.1% of the observations) for evaluating the quality of images (scores 1 and 2 vs. scores 3, 4, and 5). The strength of agreement is considered to be "fair" (κ = 0.251 and 95% confidence interval [CI] = 0.02-0.48). Further agreement assessment demonstrated a fair agreement for images taken by residents and students and a "perfect" agreement in images taken by fellows. Overall, a "moderate" inter-rater agreement was found in 79.1% for the accuracy of interpretation of POCUS scan (e.g., true positive, false negative) during QA and bedside evaluation (κ = 0.48, 95% CI = 0.34-0.63). Faculty at the bedside and QA assessment reached a moderate agreement on interpretations noted by residents and students and a "good" agreement on fellows' scans.

CONCLUSION

Using a bedside SDOT through a mobile SurveyMonkey platform facilitates assessment of competency in emergency ultrasound learners and correlates well with traditional competency evaluation by asynchronous weekly image review QA.

Correlation of OSCE performance and point-of-care ultrasound scan numbers among a cohort of emergency medicine residents

Background

Point-of-care ultrasound (POCUS) is an important clinical tool for a growing number of medical specialties. The current American College of Emergency Physicians (ACEP) Ultrasound Guidelines recommend that trainees perform 150–300 ultrasound scans as part of POCUS training. We sought to assess the relationship between ultrasound scan numbers and performance on an ultrasound-focused observed structured clinical examination (OSCE).

Methods

This was a cross-sectional cohort study in which the number of ultrasound scans residents had previously performed were obtained from a prospective database and compared with their total score on an ultrasound OSCE. Ultrasound fellowship trained emergency physicians administered a previously published OSCE that consisted of standardized questions testing image acquisition and interpretation, ultrasound machine mechanics, patient positioning, and troubleshooting. Residents were observed while performing core applications including aorta, biliary, cardiac, deep vein thrombosis, Focused Assessment with Sonography in Trauma (FAST), pelvic, and thoracic ultrasound imaging.

Results

Twenty-nine postgraduate year (PGY)-3 and PGY-4 emergency medicine (EM) residents participated in the OSCE. The median OSCE score was 354 [interquartile range (IQR) 343–361] out of a total possible score of 370. Trainees had previously performed a median of 341 [IQR 289–409] total scans. Residents with more than 300 ultrasound scans had a median OSCE score of 355 [IQR 351–360], which was slightly higher than the median OSCE score of 342 [IQR 326–361] in the group with less than 300 total scans (p = 0.04). Overall, a LOWESS curve demonstrated a positive association between scan numbers and OSCE scores with graphical review of the data suggesting a plateau effect.

Conclusion

The results of this small single residency program study suggest a pattern of improvement in OSCE performance as scan numbers increased, with the appearance of a plateau effect around 300 scans. Further investigation of this correlation in diverse practice environments and within individual ultrasound modalities will be necessary to create generalizable recommendations for scan requirements as part of overall POCUS proficiency assessment.

Pratique de l’échographie clinique au sein d’un réseau territorial d’urgence

Objectif : L’échographie clinique en médecine d’urgence (ECMU) est un outil essentiel de notre pratique. L’objectif principal de notre étude était d’évaluer les caractéristiques des médecins pratiquant l’ECMU au sein de notre territoire. L’objectif secondaire était d’analyser les facteurs influençant une pratique régulière.

Matériel et méthodes : Étude descriptive multicentrique et déclarative, réalisée auprès de médecins urgentistes travaillant au sein d’un réseau territorial de médecine d’urgence à l’aide d’un questionnaire en ligne.

Résultats : Cent onze questionnaires sur 120 envoyés ont été renseignés (92 %). Onze services (92 %) étaient dotés en échographe dont neuf (82 %) en dotation propre. Soixantesix médecins (59 %) déclaraient pratiquer l’échographie régulièrement. La FAST (focused assessment with sonography for traumas) était la plus pratiquée (80 médecins, 72 %), suivie de l’exploration hémodynamique (50 médecins, 45 %) et pleurale (44 médecins, 40 %). Dans le groupe des médecins ne pratiquant pas l’ECMU, 17 médecins sur 22 (77 %) l’expliquaient par un manque de formation. Dans le même temps, l’intérêt porté à l’ECMU par les urgentistes était coté à 7 ± 2 sur une échelle de 0 à 9. Les facteurs associés à la fréquence de la pratique de l’ECMU étaient le sexe (p < 0,001), le type d’activité (p = 0,005), le type de formation à l’échographie (p < 0,001) et l’ancienneté d’équipement de son service en échographe (p < 0,001).

Conclusion : Cette enquête a montré que la pratique régulière était majoritaire avec un intérêt porté par les praticiens à l’ECMU élevé. Cependant, le frein principal à son développement était un niveau de formation jugé insuffisant par certains praticiens.

The use of ultrasound as an adjunct to peripheral venous cannulation by junior doctors in clinical practice

PURPOSE

There is little consensus on the role of training in bedside ultrasound skills for medical students or junior doctors early in their careers.

METHODS

We trained 20 Foundation Year 1 doctors in the use of ultrasound as an adjunct to peripheral venous cannulation and following an assessment of competence gave them access to an ultrasound machine to assist with difficult cannulations in their clinical practice. Self-reported confidence and competence were assessed using pre- and post-training questionnaires, with competence objectively assessed immediately post-training and at one and three months follow up. Clinical use of ultrasound was studied over three months.

RESULTS

Improvements in self-reported confidence and competence were observed post-training and retained at three months. 85% (17/20) of participants were objectively assessed as competent immediately post-training, with retention of competence demonstrated in 80% (16/20) and 75% (15/20) at one and three months, respectively. There were 33 separate uses of ultrasound during the three month study period with a 73% (24/33) success rate and no adverse incidents.

CONCLUSIONS

We suggest that doctors in their first post-graduate year can be trained in the use of ultrasound as an adjunct to peripheral venous cannulation, retain the skill over time and use it safely in their clinical practice.

Entrusting internal medicine residents to use point of care ultrasound: Towards improved assessment and supervision

Background: Internal medicine physicians and trainees are increasingly using, and seeking training in, diagnostic point of care ultrasound (POCUS). Numerous internal medicine training programs have described their curricula, but little has been written about how learners should be assessed, supervised, and allowed to progress toward independent practice, yet these practices are imperative for safe and effective use. Entrustable professional activities (EPAs) offer a practical method to assess observable units of professional work and make supervision decisions. Methods: An EPA for POCUS is used as a framework to assess and determine appropriate levels of supervision in an internal medicine residency program. Results: All learners have been able to advance to level 2 with a mandatory introductory boot camp course. Learners have been able to advance to higher levels of independence, often after taking formal elective programmatic coursework. However, not all learners taking the same coursework have been granted the same level of independence. Conclusions: It is feasible to assess and supervise internal medicine residents' ability to use diagnostic point of care ultrasound using an EPA.

Graduating Surgical Residents Lack Competence in Critical Care Ultrasound

OBJECTIVE

Ultrasound provides accessible imaging for bedside diagnostics and procedural guidance, but may lead to misdiagnosis in untrained users. The main objective of this study was to determine observed and self-perceived competence with critical care ultrasound in graduated general surgery residents.

DESIGN

The design of this study was a retrospective review. Ultrasound training program records were reviewed for number of prior ultrasound examinations performed, self-perceived competence, observed competence on faculty examinations, and intended future use of individual critical care ultrasound examinations.

SETTING

This study was undertaken at the R Adams Cowley Shock Trauma Center, which is a tertiary care center in Baltimore, MD.

PARTICIPANTS

Graduated general surgery residents were identified at the beginning of their surgical critical care fellowship at our institution, and were included if they participated in our critical care ultrasound education program. Fifteen graduated general surgery residents were included.

RESULTS

Prior ultrasound experience ranged from 100% for focused assessment of sonography for trauma (FAST) to 13.3% for advanced cardiac assessment. Self-perceived competence ranged from 46.7% with FAST to 0% for advanced cardiac assessment. Observed competence ranged from 20.0% for FAST examinations to 0% for basic cardiac assessment, advanced cardiac assessment, and inferior vena cava (IVC) assessment. All participants intended to use ultrasound in the future for FAST, pneumothorax detection and basic cardiac assessment, and 86.7% for IVC assessment and advanced cardiac assessment. Of participants with self-perceived competence, 28.6% had observed competence with FAST, 0% with IVC assessment, and 100% with pneumothorax detection.

CONCLUSIONS

Graduated general surgery residents are not competent in multiple critical care ultrasound examinations despite universally planning to use critical care ultrasound in future practice. Current exposure to ultrasound in residency may give a false sense of competency with ultrasound use. A standardized ultrasound curriculum is an urgent need for general surgery training.

Credentialing of Hospitalists in Ultrasound-Guided Bedside Procedures: A Position Statement of the Society of Hospital Medicine

Ultrasound guidance is used increasingly to perform the following 6 bedside procedures that are core competencies of hospitalists: abdominal paracentesis, arterial catheter placement, arthrocentesis, central venous catheter placement, lumbar puncture, and thoracentesis. Yet most hospitalists have not been certified to perform these procedures, whether using ultrasound guidance or not, by specialty boards or other institutions extramural to their own hospitals. Instead, hospital privileging committees often ask hospitalist group leaders to make ad hoc intramural certification assessments as part of credentialing. Given variation in training and experience, such assessments are not straightforward "sign offs." We thus convened a panel of experts to conduct a systematic review to provide recommendations for credentialing hospitalist physicians in ultrasound guidance of these 6 bedside procedures. Pathways for initial and ongoing credentialing are proposed. A guiding principle of both is that certification assessments for basic competence are best made through direct observation of performance on actual patients.

The Case of an Obstructed Stone at the Distal Urethra

This report highlights a presentation of urinary calculus impacted at the urethral meatus and bedside extraction after evaluation with point-of-care ultrasound (POCUS). Visualization of a stone at the urethral meatus prompted a point-of-care ultrasound of the penile shaft and glans. The ultrasound ruled out anatomic variations such as urethral diverticula and as a result bedside removal was expedited. The stone was successfully removed with traction and intraurethral lidocaine gel without urethral lesions or injury to the meatus. Bedside ultrasound is readily available in the emergency department and can be used to characterize urethral foreign bodies, evaluate urethral anatomy, and assess the likelihood of bedside removal.

The Sound Games: Introducing Gamification into Stanford's Orientation on Emergency Ultrasound

Point-of-care ultrasound is a critical component of graduate medical training in emergency medicine. Innovation in ultrasound teaching methods is greatly needed to keep up with a changing medical landscape. A field-wide trend promoting simulation and technology-enhanced learning is underway in an effort to improve patient care, as well as patient safety. In an effort to both motivate students and increase their skill retention, training methods are shifting towards a friendly competition model and are gaining popularity nationwide. In line with this emerging trend, Stanford incorporated the Sound Games – an educational ultrasound event with a distinctly competitive thread – within its existing two-day point-of-care ultrasound orientation course for emergency medicine interns. In this study, we demonstrate successful implementation of the orientation program, significant learning gains in participants, and overall student satisfaction with the course.

Point of Care Ultrasound Diagnosis of a Massive Thoracoabdominal Aortic Aneurysm

This report highlights an atypical presentation of extensive thoracoabdominal aortic aneurysm with intramural hematoma and transient paralysis of the lower extremities. Clinical suspicion for aortic pathology prompted a point of care ultrasound of the heart and aorta, which demonstrated a thoracic and abdominal aortic aneurysm with intraluminal pathology. Consultation and transfer to a tertiary care facility was based solely on the emergency physician’s ultrasound. Subsequent computed tomography (CT) imaging confirmed the ultrasound findings and discovered a left common iliac artery thrombosis consistent with the patient’s presentation. Point of care ultrasound can help clinicians diagnose aortic pathology and direct patient care efficiently and effectively.

Use of Emergency Ultrasound in Arizona Community Emergency Departments

OBJECTIVES

Despite the increased educational exposure to point-of-care ultrasound (US) at all levels of medical training, there are utilization gaps between academic and nonacademic emergency department (ED) settings. The purpose of this study was to assess the current practices and potential barriers to the use of point-of-care US in nonacademic EDs throughout the state of Arizona.

METHODS

We conducted a cross-sectional study. An online questionnaire was electronically sent to all nonacademic EDs in Arizona. The survey consisted of questions regarding demographics, current practice patterns, policies, interdepartmental agreements, and perceptions regarding the use of point-of-care US.

RESULTS

Seventy nonacademic EDs were identified for inclusion in our study, and 58 EDs completed the survey, which represented an 83% response rate. Seventy-eight percent (95% confidence interval [CI], 67%-89%) perform or interpret point-of-care US examinations for patient care. The 3 most common applications of point-of-care US reported by respondents were focused assessment with sonography for trauma, cardiac US examinations, and line placement, and 36% (95% CI, 22%-50%) bill for point-of-care US examinations. At 75% (95% CI, 62%-88%) of EDs, no one is specifically responsible for reviewing point-of-care US examinations for quality assurance, and at 50% (95% CI, 35%-65%), no mechanism exists to archive images. Eighty-three percent (95% CI, 72%-94%) of EDs think that their groups will benefit from the American College of Emergency Physicians Clinical Ultrasound Accreditation Program.

CONCLUSIONS

Ultrasound equipment is available in nearly all nonacademic EDs in Arizona. However, it appears that most providers lack US training, credentialing, quality assurance, and reimbursement mechanisms.

Cadaver-based Necrotizing Fasciitis Model for Medical Training

Necrotizing fasciitis is a devastating infectious disease process that is characterized by extensive soft tissue necrosis along deep fascial planes, systemic toxicity, and high mortality. Ultrasound imaging is a rapid and non-invasive tool that can be used to help make the diagnosis of necrotizing fasciitis by identifying several distinctive sonographic findings. The purpose of this study is to describe the construction of a realistic diagnostic training model for necrotizing fasciitis using fresh frozen cadavers and common, affordable materials.

Presently, fresh non-embalmed cadavers have been used at medical institutions for various educational sessions including cadaver-based ultrasound training sessions. Details for the preparation and construction of a necrotizing fasciitis cadaver model are presented here. This paper shows that the images obtained from the cadaver model closely imitate the ultrasound appearance of fluid and gas seen in actual clinical cases of necrotizing fasciitis.

Therefore, it can be concluded that this cadaver-based model produces high-quality sonographic images that simulate those found in true cases of necrotizing fasciitis and is ideal for demonstrating the sonographic findings of necrotizing fasciitis.