Portable Ultrasound Device Usage and Learning Outcomes Among Internal Medicine Trainees: A Parallel-Group Randomized Trial

Effectiveness of a Brief Point of Care Ultrasound Course at a National Nephrology Conference

The rising demand for point of care ultrasound (POCUS) instruction during nephrology fellowship has been limited due to a shortage of trained faculty and courses designed specifically for nephrologists. A hands-on POCUS pre-course was organized during the April 2023 National Kidney Foundation (NKF) Spring Clinical Meeting to address this challenge. The course consisted of pre-recorded lectures and a 4-hour hands-on workshop guided by multidisciplinary POCUS experts. The anonymous post-course survey received responses from 25 out of 39 participants, yielding a 64.1% response rate. On a scale of 0-10, confidence levels for acquiring kidney images rose from 2.6 + 2.3 (mean + SD) pre-workshop to 7.8 + 1.5 post-workshop (p<0.001). Similarly, a remarkable improvement in confidence for acquiring lung and cardiac images was seen as scores increased from 1.8 + 2.4 to 7.7 + 1.5 (p<0.001) and from 1.5 + 2.2 to 7.2 + 1.3 (p<0.001), respectively. Additionally, respondents reported a substantial improvement in their confidence to interpret kidney, lung, and cardiac POCUS images, with scores increasing from 4.5 + 2.2 to 7.7 + 1.1 (p<0.001), 2.3 + 2.4 to 7.6 + 1.5 (p<0.001), and 2 + 2 to 7.3 + 1.5 (p<0.001), respectively. Barriers to implementing POCUS use at institutions included a perceived lack of trained faculty, limited protected time for faculty, and insufficient support from division leadership. The NKF POCUS pre-course successfully improved participants' confidence in acquiring and interpreting basic POCUS images.

Handheld Ultrasound Device Usage and Image Acquisition Ability Among Internal Medicine Trainees: A Randomized Trial

BACKGROUND

There is insufficient knowledge about how personal access to handheld ultrasound devices (HUDs) improves trainee learning with point-of-care ultrasound (POCUS).

OBJECTIVE

To assess whether HUDs, alongside a yearlong lecture series, improved trainee POCUS usage and ability to acquire images.

METHODS

Internal medicine intern physicians (n = 47) at a single institution from 2017 to 2018 were randomized 1:1 to receive personal HUDs (n = 24) for patient care/self-directed learning vs no-HUDs (n = 23). All interns received a repeated lecture series on cardiac, thoracic, and abdominal POCUS. Main outcome measures included self-reported HUD usage rates and post-intervention assessment scores using the Rapid Assessment of Competency in Echocardiography (RACE) scale between HUD and no-HUD groups.

RESULTS

HUD interns reported performing POCUS assessments on patients a mean 6.8 (SD 2.2) times per week vs 6.4 (SD 2.9) times per week in non-HUD arm (P = .66). There was no relationship between the number of self-reported examinations per week and a trainee's post-intervention RACE score (rho = 0.022, P = .95). HUD interns did not have significantly higher post-intervention RACE scores (median HUD score 17.0 vs no-HUD score 17.8; P = .72). Trainee confidence with cardiac POCUS did not correlate with RACE scores.

CONCLUSIONS

Personal HUDs without direct supervision did not increase the amount of POCUS usage or improve interns' acquisition abilities. Interns who reported performing more examinations per week did not have higher RACE scores. Improved HUD access and lectures without additional feedback may not improve POCUS mastery.

Skill retention with ultrasound curricula

Background

Implementation of a point of care ultrasound curricula is valuable, but optimal integration for internal medicine residency is unclear. The purpose of this study was to evaluate if a structured ultrasound curriculum vs. structured ultrasound curriculum plus supervised thoracic ultrasounds would improve internal medicine residents’ skill and retention 6 and 12 months from baseline.

Methods

We conducted a randomized controlled study evaluating internal medical residents’ skill retention of thoracic ultrasound using a structured curriculum (control, n = 14) vs. structured curriculum plus 20 supervised bedside thoracic ultrasounds (intervention, n = 14). We used a stratified randomization based on program year. All subjects attended a half-day course that included 5 lectures and hands-on sessions at baseline. Assessments included written and practical exams at baseline, immediately post-course and at 6 and 12 months. Scores are reported as a percentage for the number of correct responses/number of questions (range 0–100%). The Mann Whitney U and the Friedman tests were used for analyses.

Results

Twenty-eight residents were enrolled. Two subjects withdrew prior to the 6-month exams. Written exam scores for all subjects improved, baseline median (IQR) 60 (46.47 to 66.67) post-course 80 (65 to 86.67), 6-month 80 (66.67 to 86.67) and 12-month 86.67 (80 to 88.34), p = <0.001. All subjects practical exam scores median (IQR) significantly improved, baseline 18.18 (7.95 to 32.95), post-course 59.09 (45.45 to 70.45), 6 month 71.74 (60.87 to 82.61) and 12-month 76.09 (65.22 to 88.05), p = <0.001. Comparing the control group to the intervention group, there were statistically significant higher scores, median (IQR), in the intervention group on the practical exam at 6 months 63.05 (48.92 to 69.57) vs. 82.61(72.83 to89.13), p = <0.001.

Conclusion

In this cohort, internal medicine residents participating in a structured thoracic ultrasound course plus 20-supervised ultrasounds achieved higher practical exam scores long-term compared to controls.