Certification of Point-of-Care Ultrasound Competency

Point-of-Care Ultrasonography in Internal Medicine: Limitations and Pitfalls for Novice Users

Point-of-care ultrasound (POCUS) is increasingly being adopted in the field of internal medicine, leading to the development of POCUS curricula in undergraduate and postgraduate medical education programs. Prominent internal medicine societies and organizations worldwide recognize the expanding utilization of POCUS by internal medicine physicians, emphasizing the need for practitioners to be aware of both its benefits and limitations. Despite the growing enthusiasm for POCUS, clinicians, particularly those with limited clinical experience, must be cautious regarding its inherent limitations and the potential impact on their clinical practice. This review aims to outline the limitations and potential drawbacks of POCUS for medical students, residents, and internists who wish to stay abreast of the escalating use of POCUS in internal medicine and have a desire, or have already commenced, to incorporate POCUS into their practice. Additionally, it provides recommendations for enhancing POCUS proficiency to mitigate these limitations.

A Tool to Assess Competence in Critical Care Ultrasound Based on Entrustable Professional Activities

Background

Existing assessment tools for competence in critical care ultrasound (CCUS) have limited scope and interrupt clinical workflow. The framework of entrustable professional activities (EPAs) is well suited to developing an assessment tool that is comprehensive and readily integrated into the intensive care unit (ICU) training environment.

Objective

This study sought to design an EPA-based tool to assess competence in CCUS for pulmonary and critical care fellows and to assess the validity and reliability of the tool.

Methods

Eight experts in CCUS met to define the core EPAs for CCUS. A nominal group technique was used to reach consensus. An assessment tool was created based on the EPAs with a modified Ottawa entrustability scale. Trained faculty evaluated pulmonary and critical care fellows using this tool in the ICU over a 6-month study period at a single institution. An assessment of validity of the EPA-based tool is made with four sources of validity evidence: content, response process, reliability, and relation to other variables. Reliability and response process data were generated using generalizability theory analysis to estimate sources of variance in entrustment scores. Analysis of response process validity and validity by relation to other variables was performed using regression models.

Results

Fifty-four assessments were recorded during the study period, conducted on 23 trainees by 13 faculty. Content validity of the tool was demonstrated using expert consensus and published guidelines from critical care societies to define the EPAs. Response process validity was demonstrated by the low variance in entrustment scores due to evaluators (0.086 or 6%) and high agreement between score and trainee self-assessment (regression coefficient, 0.82; P < 0.0001). Reliability was demonstrated by the high "true" variance in entrustment score attributable to the trainee: 0.674 or 45%. Validity by relation to other variables was demonstrated using regression analysis to show correlation between entrustment score and the number of times a fellow has performed an EPA (regression coefficient, 0.023; P < 0.0001).

Conclusion

An EPA-based assessment tool for competence in CCUS was created. We obtained sufficient validity evidence on three of the diagnostic EPAs. Procedural EPAs were infrequently assessed, limiting generalizability in this subgroup.

Development of a multisystem point of care ultrasound skills assessment checklist

Background

Many institutions are training clinicians in point-of-care ultrasound (POCUS), but few POCUS skills checklists have been developed and validated. We developed a consensus-based multispecialty POCUS skills checklist with anchoring references for basic cardiac, lung, abdominal, and vascular ultrasound, and peripheral intravenous line (PIV) insertion.

Methods

A POCUS expert panel of 14 physicians specializing in emergency, critical care, and internal/hospital medicine participated in a modified-Delphi approach to develop a basic POCUS skills checklist by group consensus. Three rounds of voting were conducted, and consensus was defined by ≥ 80% agreement. Items achieving < 80% consensus were discussed and considered for up to two additional rounds of voting.

Results

Thirteen POCUS experts (93%) completed all three rounds of voting. Cardiac, lung, abdominal, and vascular ultrasound checklists included probe location and control, basic machine setup, image quality and optimization, and identification of anatomical structures. PIV insertion included additional items for needle tip tracking. During the first round of voting, 136 (82%) items achieved consensus, and after revision and revoting, an additional 21 items achieved consensus. A total of 153 (92%) items were included in the final checklist.

Conclusions

We have developed a consensus-based, multispecialty POCUS checklist to evaluate skills in image acquisition and anatomy identification for basic cardiac, lung, abdominal, and vascular ultrasound, and PIV insertion.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13089-022-00268-4.

Integration of Point-of-Care Ultrasound Education Into the Internal Medicine Core Clerkship Experience

Point-of-care ultrasound (POCUS) is becoming an essential skill for internists. To date, there are no professional guidelines for how POCUS skills should be taught to medical students. A panel of POCUS experts from seven academic medical centers in the United States was convened to describe the components of independently developed IM clerkship POCUS training programs, identify areas of similarity and difference, and propose recommendations for alignment.

Exploring Eye-tracking Technology as an Assessment Tool for Point-of-care Ultrasound Training

OBJECTIVES

Eye-tracking technology has emerged as a potentially useful learner assessment tool in several medical specialties. In the fields of general surgery and anesthesiology, it has been shown to reliably differentiate between different levels of expertise in procedural skills. In the field of radiology, it has been shown to be a valid assessment tool for diagnostic test interpretation. Current methods of competency assessment in point-of-care ultrasound (POCUS) remain a challenge, because they require significant direct observation time by an instructor. The purpose of this study was to determine if eye-tracking technology can accurately distinguish between novice and experts in the interpretation of POCUS clips, specifically of the focused assessment using sonography in trauma (FAST) scan.

METHODS

A convenience sample of medical students, residents, and emergency physicians from a single academic emergency department were invited to participate. Participants included both novices and experts in POCUS. Each participant completed a baseline questionnaire and viewed 16 video clips of a FAST ultrasound examination while their gaze patterns were recorded by a commercially available eye-tracking device. The primary outcome was total gaze time on the area of interest (AOI). Secondary outcomes included total time to fixation, mean number of fixations, and mean duration of first fixation on the AOI.

RESULTS

Fifteen novices and 15 experts completed this study. For total gaze time on the AOI, experts fixated their gaze significantly longer than novices (75.8 ± 16.2 seconds vs. 56.6 ± 12.8 seconds, p = 0.001). Similarly, experts were significantly faster to fixate on the AOI and had a higher fixation count on the AOI (8.5 ± 4.0 seconds vs. 15.1 ± 6.8 seconds, p = 0.003; and 170 ± 30 vs. 143 ± 28 seconds, p = 0.016). There were no differences on the mean duration of first fixation on the AOI (0.42 ± 0.12 seconds vs. 0.39 ± 0.09 seconds, p = 0.467).

CONCLUSION

Eye-tracking technology shows the potential to differentiate between experts and novices by their gaze patterns on video clips of FAST examinations. The total gaze time on the AOI may be a useful metric to help in the assessment of competency in POCUS image interpretation. In addition, the evaluation of gaze patterns may help educators identify causes of interpretation errors. Future studies are needed to further validate these metrics in a larger cohort.

Handheld Ultrasound Device Usage and Image Acquisition Ability Among Internal Medicine Trainees: A Randomized Trial

BACKGROUND

There is insufficient knowledge about how personal access to handheld ultrasound devices (HUDs) improves trainee learning with point-of-care ultrasound (POCUS).

OBJECTIVE

To assess whether HUDs, alongside a yearlong lecture series, improved trainee POCUS usage and ability to acquire images.

METHODS

Internal medicine intern physicians (n = 47) at a single institution from 2017 to 2018 were randomized 1:1 to receive personal HUDs (n = 24) for patient care/self-directed learning vs no-HUDs (n = 23). All interns received a repeated lecture series on cardiac, thoracic, and abdominal POCUS. Main outcome measures included self-reported HUD usage rates and post-intervention assessment scores using the Rapid Assessment of Competency in Echocardiography (RACE) scale between HUD and no-HUD groups.

RESULTS

HUD interns reported performing POCUS assessments on patients a mean 6.8 (SD 2.2) times per week vs 6.4 (SD 2.9) times per week in non-HUD arm (P = .66). There was no relationship between the number of self-reported examinations per week and a trainee's post-intervention RACE score (rho = 0.022, P = .95). HUD interns did not have significantly higher post-intervention RACE scores (median HUD score 17.0 vs no-HUD score 17.8; P = .72). Trainee confidence with cardiac POCUS did not correlate with RACE scores.

CONCLUSIONS

Personal HUDs without direct supervision did not increase the amount of POCUS usage or improve interns' acquisition abilities. Interns who reported performing more examinations per week did not have higher RACE scores. Improved HUD access and lectures without additional feedback may not improve POCUS mastery.

Point of care ultrasound for all by all: A multidisciplinary survey across a large quaternary care medical system

PURPOSE

We sought to understand current POCUS practices and comfort as well as assess opinions about POCUS across our medical system via a survey to guide program development.

METHODS

This study was conducted as a 19 question RedCap survey with multiple parts. Respondents were queried for demographics as well as experience with, attitudes toward, and clinical use of POCUS in common critical care scenarios.

RESULTS

The survey was completed by 343 individuals, a response rate of 30%. Most respondents "agreed" that POCUS is a needed skill and helped them provide safer care (78% and 86% agreement). Most faculty and trainees reported some POCUS training (62% and 88%) and at least weekly use. Trainees rated themselves more comfortable than faculty for most exam types. The majority of faculty rated their POCUS education as inadequate while trainees had mixed responses.

CONCLUSIONS

POCUS is a frequently used tool, yet users are less confident in their skills than expected. POCUS applications are viewed as needed for future practice but there is a substantial need for improved education among faculty and trainees. Pooling resources and sharing educational initiatives across multiple specialties may help improve POCUS implementation.

Clinical Integration of Point-of-care Ultrasound by Emergency Medicine Residents: A Single-center Mixed-methods Study

BACKGROUND

Point-of-care ultrasound (POCUS) competence consists of image acquisition, image interpretation, and clinical integration. Limited data exist on POCUS usage patterns and clinical integration by emergency medicine (EM) residents. We sought to determine actual POCUS usage and clinical integration patterns by EM residents and to explore residents' perspectives on POCUS clinical integration.

METHODS

We conducted an explanatory sequential mixed-methods study at a 4-year EM residency program. In phase 1, EM ultrasound (US) attendings observed PGY-4 EM residents' clinical integration of POCUS in real time while on shift in the emergency department (ED). EM US attendings evaluated residents on their intent to perform POCUS, actual POCUS usage, and competence per patient encounter. We used logistic regression to analyze these parameters. In phase 2, we conducted semi-structured interviews with the observed PGY-4 residents regarding POCUS usage and clinical integration in the ED. We analyzed qualitative data for themes.

RESULTS

Emergency medicine US attendings observed 10 PGY-4 EM residents during 254 high-acuity patient encounters from December 2018 to March 2019. EM US attendings considered POCUS indicated for 26% (66/254) of patients, possibly indicated for 12% (30/254) and not indicated for 62% (158/254). Of the 66 patients for whom EM US attendings considered POCUS indicated, PGY-4s intended to perform POCUS for patient management 61% (40/66) of the time. PGY-4s subsequently incorporated POCUS into patient management 73% (48/66) of the time. EM US attendings considered PGY-4s entrustable to perform POCUS independently 81% (206/254) of the time. We did not find a statistically significant association between shift volume, shift type, or POCUS application, and resident intent to perform POCUS nor competence. Interviews identified three factors that influence PGY-4's POCUS clinical integration: motivations to use POCUS, barriers to utilization, and POCUS educational methods.

CONCLUSIONS

This mixed-methods study identified a significant gap in POCUS utilization and clinical integration by PGY-4 EM residents for clinically indicated cases identified by EM US attendings. As clinical integration is a cornerstone of POCUS competence, it is important to ensure that EM resident POCUS curricula emphasize training on clinical utilization and indications for POCUS while on shift in the ED.

Standardized adult-gerontology acute care nurse practitioner point-of-care ultrasound training: A new perspective in the age of a pandemic

Our health care landscape is rapidly changing. With the aging population and seemingly increasing outbreak of communicable diseases, it is expected that there will be a continued demand for inpatient/critical care providers. The current COVID-19 pandemic provides a glimpse of a health care system in severe provider shortage. Adult-gerontology acute nurse practitioners (GACNPs) can play a vital part in relieving that shortage. But with the increased role, there is an increased responsibility and need for expansion of AGACNP skill set. This includes the training and utilization of point-of-care ultrasound (POCUS). The case reports and data available from countries that have already combated COVID-19 outbreak show POCUS can play a key part in managing critically ill patients on isolation precautions. This article provides my perspective on POCUS training and competency achievement for AGACNPPs.

Developing and Evaluating a Remote Quality Assurance System for Point-of-Care Ultrasound for an Internal Medicine Residency Global Health Track

Background: A quality assurance system is vital when using point-of-care ultrasound (POCUS) to ensure safe and effective ultrasound use. There are many barriers to implementing a quality assurance system including need for costly software, faculty time, and extra work to log images. Methods: With minimal funding or protected faculty time, we successfully developed an effective remote quality assurance system between residents rotating internationally and faculty in the US. Results: 270 total exams were logged using this system (41 per resident over a 7 week period). Over the course of the implementation period, a significant increase was seen in average image quality (p = 0.030) and percent agreement with reviewer (p = 0.021). No significant increase was seen for percent images with quality rating 5/5 (p = 0.068) or for studies per resident per week (p = 0.30). Discussion/Conclusions: A quality assurance system for remote review and feedback of POCUS exams was successfully developed with limited available funding, using consumer-level software and an educational collaboration. Residents used the system regularly and demonstrated improvement in reviewer-rated image acquisition and interpretation skills. A similar system can be applied for physicians in any geographic area looking to learn POCUS, in partnership with local or international POCUS mentors. We detail a step-by-step approach, challenges encountered, and lessons learned, to help guide others seeking to implement similar programs.

A Longitudinal Curriculum In Point-Of-Care Ultrasonography Improves Medical Knowledge And Psychomotor Skills Among Internal Medicine Residents

PURPOSE

Despite its growing popularity and clinical utility among hospital-based physicians, there are no formal competency requirements nor training standards for United States based Internal Medicine Residencies for learning point-of-care ultrasonography (POCUS). The purpose of this investigation was to study the impact and effectiveness of a novel POCUS curriculum for an Internal Medicine (IM) residency program.

PATIENTS AND METHODS

This was a Single-Group Educational Quasi-Experiment involving Categorical and Preliminary Internal Medicine Residents in Post-Graduate Years 1 through 3 at a single United States academic tertiary center. The study period was from January 1, 2017, through June 30, 2017, during which time the residents participated in monthly modules including didactics and hands-on ultrasound scanning skills with live models. Participants completed a comprehensive knowledge examination at the beginning and end of the six-month period. Participants were also tested regarding hands-on image acquisition and interpretation immediately before and after the hands-on skills labs. The primary outcome measure was performance improvement in a comprehensive medical knowledge assessment.

RESULTS

In total, 42 residents consented for participation. The residents' monthly rotations were adjusted in order to accommodate the new educational process. Among 29 participants with complete data sets for analysis, the mean (SD) comprehensive knowledge examination score improved from 60.9% before curriculum to 70.2% after curriculum completion (P<0.001). Subgroup analysis determined that improvement in medical knowledge required attending at least 2 out of the 6 (33%) educational sessions. Attendance at hands-on skills labs correlated significantly with improvement; didactics alone did not.

CONCLUSION

A longitudinal POCUS curriculum consisting of both didactic sessions and hands-on skills labs improves knowledge, image acquisition, and interpretation skills of residents. Having this curriculum span at least 6 months provides learners the opportunity to attend multiple classes which strengthens learning through repetition while also providing learners flexibility in schedule.

Morning report innovation: Case Oriented Report and Exam Skills

Morning report is a valuable educational conference but is often a stand-alone classroom-based discussion which misses the opportunity for bedside education. In this report, we describe an innovative morning report structure - the Case Oriented Report and Exam Skills (CORES) - that addresses this pitfall of the traditional case conference format and brings learners to the bedside. The key components of CORES include highlighting concepts of clinical reasoning, emphasizing evidence-based and hypothesis-driven physical exam (HDPE), and integrating emerging bedside technologies such as point-of-care ultrasound (POCUS).

Evaluation of Trainee Competency with Point-of-Care Ultrasonography (POCUS): a Conceptual Framework and Review of Existing Assessments

Point-of-care ultrasonography (POCUS) has the potential to transform healthcare delivery through its diagnostic expediency. Trainee competency with POCUS is now mandated for emergency medicine through the Accreditation Council for Graduate Medical Education (ACGME), and its use is expanding into other medical specialties, including internal medicine. However, a key question remains: how does one define "competency" with this emerging technology? As our trainees become more acquainted with POCUS, it is vital to develop validated methodology for defining and measuring competency amongst inexperienced users. As a framework, the assessment of competency should include evaluations that assess the acquisition and application of POCUS-related knowledge, demonstration of technical skill (e.g., proper probe selection, positioning, and image optimization), and effective integration into routine clinical practice. These assessments can be performed across a variety of settings, including web-based applications, simulators, standardized patients, and real clinical encounters. Several validated assessments regarding POCUS competency have recently been developed, including the Rapid Assessment of Competency in Echocardiography (RACE) or the Assessment of Competency in Thoracic Sonography (ACTS). However, these assessments focus mainly on technical skill and do not expand upon other areas of this framework, which represents a growing need. In this review, we explore the different methodologies for evaluating competency with POCUS as well as discuss current progress in the field of measuring trainee knowledge and technical skill.

Ultrasound-guided Bedside Core Needle Biopsy: A Hospitalist Procedure Team's Experience

Tissue pathology is integral for the diagnosis of various conditions, especially malignancy. Traditionally, biopsy procedures, including core needle biopsy (CNB), are performed by surgeons or radiologists. With the increasing utilization of point of care ultrasound (POCUS) skills and competence in bedside procedures by general internists, CNB can be safely moved to the patient's bedside with maintained accuracy and increased cost savings compared to traditional procedural methods. We aim to review the experience of our hospitalist-run medical procedure service in performing these ultrasound-guided procedures at the bedside.

Point-of-Care Ultrasound for Hospitalists: A Position Statement of the Society of Hospital Medicine

Many hospitalists incorporate point-of-care ultrasound (POCUS) into their daily practice to answer specific diagnostic questions or to guide performance of invasive bedside procedures. However, standards for hospitalists in POCUS training and assessment are not yet established. Most internal medicine residency training programs, the major pipeline for incoming hospitalists, have only recently begun to incorporate POCUS in their curricula. The purpose of this document is to inform a broad audience on what POCUS is and how hospitalists are using it. This document is intended to provide guidance for the hospitalists who use POCUS and administrators who oversee its use. We discuss POCUS 1) applications, 2) training, 3) assessments, and 4) program management. Practicing hospitalists must continue to collaborate with their local credentialing bodies to outline requirements for POCUS use. Hospitalists should be integrally involved in decision-making processes surrounding POCUS program management.