Test of simulator-based assessment of psychomotor skill in transthoracic echo

Instructing Ultrasound-guided Examination Techniques Using a Social Media Smartphone App

Social media applications on smartphones allow for new avenues of instruction in sports medicine and exercise sciences. This study tested the feasibility of instructing health care personnel through videos of ultrasound vascular measurements distributed by a social media messenger application. After two training sessions with an ultrasound device, voluntary physicians (n=10) and nurses (n=10) received a video for the performance of an ultrasound-guided determination of intima-media-thickness and diameter of the femoral arteries via a social media messenger application. All participants examined the same healthy human subject. There was no significant difference between the groups regarding overall time of performance, measurements of the femoral arteries, or a specifically designed "assessment of mobile imparted arterial ultrasound determination" score. The physicians group achieved significantly higher scores in the established "objective structured assessment of ultrasound skills" score (p=0.019). Approval of the setting was high in both groups. Transmission of videos via social media applications can be used for instructions on the performance of ultrasound-guided vascular examinations in sports medicine, even if investigators' performances differ depending on their grade of ultrasound experience. In the future, the chosen approach should be tested in practical scientific examination settings.

Formative Assessment of Performance in Diagnostic Ultrasound Using Simulation and Quantitative and Objective Metrics

BACKGROUND

We developed simulator-based tools for assessing provider competence in transthoracic echocardiography (TTE) and vascular duplex scanning.

METHODS

Psychomotor (technical) skill in TTE image acquisition was calculated from the deviation angle of an acquired image from the anatomically correct view. We applied this metric for formative assessment to give feedback to learners and evaluate curricula.Psychomotor skill in vascular ultrasound was measured in terms of dexterity and image plane location; cognitive skill was assessed from measurements of blood flow velocity, parameter settings, and diagnosis. The validity of the vascular simulator was assessed from the accuracy with which experts can measure peak systolic blood flow velocity (PSV).

RESULTS

In the TTE simulator, the skill metric enabled immediate feedback, formative assessment of curriculum efficacy, and comparison of curriculum outcomes. The vascular duplex ultrasound simulator also provided feedback, and experts' measurements of PSV deviated from actual PSV in the model by <10%.

CONCLUSIONS

Skill in acquiring diagnostic ultrasound images of organs and vessels can be measured using simulation in an objective, quantitative, and standardized manner. Current applications are provision of feedback to learners to enable training without direct faculty oversight and formative assessment of curricula. Simulator-based metrics could also be applied for summative assessment.