Teaching Concepts of Transesophageal Echocardiography via Web-Based Modules

Tool to improve qualitative assessment of left ventricular systolic function

Interactive online learning tools have revolutionized graduate medical education and can impart echocardiographic image interpretive skills. We created self-paced, interactive online training modules using a repository of echocardiography videos of normal and various degrees of abnormal left ventricles. In this study, we tested the feasibility of this learning tool. Thirteen anesthesia interns took a pre-test and then had 3 weeks to complete the training modules on their own time before taking a post-test. The average score on the post-test (74.6% ± 11.08%) was higher than the average score on the pre-test (57.7% ± 9.27%) (P < 0.001). Scores did not differ between extreme function (severe dysfunction or hyperdynamic function) and non-extreme function (normal function or mild or moderate dysfunction) questions on both the pre-test (P = 0.278) and post-test (P = 0.093). The interns scored higher on the post-test than the pre-test on both extreme (P = 0.0062) and non-extreme (P = 0.0083) questions. After using an online educational tool that allowed learning on their own time and pace, trainees improved their ability to correctly categorize left ventricular systolic function. Left ventricular systolic function is often a key echocardiographic question that can be difficult to master. The promising performance of this educational resource may lead to more time- and cost-effective methods for improving diagnostic accuracy among learners.

Resident Education in Laryngeal Stroboscopy: Part II-Evaluation of a Multimedia Training Module

OBJECTIVE

To evaluate the efficacy of a web-based training module for teaching interpretation of laryngeal stroboscopy in a cohort of otolaryngology residents.

STUDY DESIGN

Randomized controlled trial.

SETTING

Academic tertiary center.

SUBJECTS AND METHODS

Residents from three training programs were invited to complete an assessment consisting of a survey and five stroboscopic exams. Subsequently, participants were randomized to receive teaching materials in the form of (1) a handout (HO) or (2) a multimedia module (MM) and asked to complete a post-training assessment. Responses were compared to responses provided by three fellowship-trained laryngologists.

RESULTS

Thirty-five of 47 invited residents (74.4%) completed both assessments. Overall mean postassessment scores were 64.3% ± 7.0, with the MM group (67.0% ± 7.6, n = 17) scoring higher (P = 0.03) than the HO (61.6% ± 5.4, n = 18) cohort. Postassessment scores did not differ by postgraduate year (P = 0.75) or institution (P = 0.17). Paired analysis demonstrated an overall mean improvement of 7.4% in the handout (HO) cohort (P = 0.03) and 10.3% in the MM cohort (P = 0.0006). Subset analysis demonstrated higher scores for the MM cohort for perceptual voice evaluation (HO = 68.8% ± 11.0; MM = 77.3% ± 10.6, P = 0.03) and stroboscopy-specific items (HO = 55.5% ± 8.2; MM = 61.9% ± 10.8, P = 0.06). On a five-point Likert scale, residents reported improved confidence in stroboscopy interpretation (P < 0.0001), irrespective of cohort (P = 0.62). Residents rated the MM (median = 5) more favorably as a teaching tool compared to the HO (median = 4, P = 0.001).

CONCLUSION

Use of both the written HO and MM module improved scores and confidence in interpreting laryngeal stroboscopy. The MM was more effective in perceptual voice evaluation and stroboscopy-specific items. The MM was also rated more favorably by residents and may be an ideal adjunct modality for teaching stroboscopy.

Training Surgical Residents for Ultrasound-Guided Assessment and Management of Unstable Patients

OBJECTIVE

Proficiency in the use of ultrasound is presently not an ACGME required core competency for accredited surgical training. There should be a basic unified ultrasound curriculum for surgical trainees. We developed a multimodal ultrasound-training program to ensure baseline proficiency and readiness for clinical performance without impacting trainee duty hours.

DESIGN

We developed and implemented a multimodal curriculum for ultrasound education and its use as a supplement to clinical evaluation of unstable patients.

SETTING

A single-center study was completed in a hospital setting.

PARTICIPANTS

Post-graduate year-1 surgical residents at our institution were invited to participate in a multimodal perioperative course.

RESULTS

51 residents attended the course over the three sessions. The vignette exam as a whole demonstrated a Cronbach's alpha of 0.819 indicating good internal reliability of the entire test. There was significant improvement in their knowledge in clinical vignettes (55% ± 12.4 on pre-test vs. 83% ± 13.2% on post-test, p<0.001).

CONCLUSION

It is feasible to incorporate a focused ultrasound curriculum to assess clinically unstable patients. The multimodal nature of the course aid in the development of preclinical proficiency and decreased the orientation phase of ultrasound use.

Intervention Descriptions in Medical Education: What Can Be Improved? A Systematic Review and Checklist

PURPOSE

Many medical education studies focus on the effectiveness of educational interventions. However, these studies often lack clear, thorough descriptions of interventions that would make the interventions replicable. This systematic review aimed to identify gaps and limitations in the descriptions of educational interventions, using a comprehensive checklist.

METHOD

Based on the literature, the authors developed a checklist of 17 criteria for thorough descriptions of educational interventions in medical education. They searched the Ovid MEDLINE, Embase, and ERIC databases for eligible English-language studies published January 2014-March 2016 that evaluated the effects of educational interventions during classroom teaching in postgraduate medical education. Subsequently, they used this checklist to systematically review the included studies. Descriptions were scored 0 (no information), 1 (unclear/partial information), or 2 (detailed description) for each of the 16 scorable criteria (possible range 0-32).

RESULTS

Among the 105 included studies, the criteria most frequently reported in detail were learning needs (78.1%), content/subject (77.1%), and educational strategies (79.0%). The criteria least frequently reported in detail were incentives (9.5%), environment (5.7%), and planned and unplanned changes (12.4%). No article described all criteria. The mean score was 15.9 (SD 4.1), with a range from 8 (5 studies) to 25 (1 study). The majority (76.2%) of articles scored 11-20.

CONCLUSIONS

Descriptions were frequently missing key information and lacked uniformity. The results suggest a need for a common standard. The authors encourage others to validate, complement, and use their checklist, which could lead to more complete, comparable, and replicable descriptions of educational interventions.

Evaluation of the quality of transesophageal echocardiography images and verification of proficiency

Various metrics have been used in curriculum-based transesophageal echocardiography (TEE) training programs to evaluate acquisition of proficiency. However, the quality of task completion, that is the final image quality, was subjectively evaluated in these studies. Ideally, the endpoint metric should be an objective comparison of the trainee-acquired image with a reference ideal image. Therefore, we developed a simulator-based methodology of preclinical verification of proficiency (VOP) in trainees by tracking objective evaluation of the final acquired images. We utilized geometric data from the simulator probes to compare image acquisition of anesthesia residents who participated in our structured longitudinal simulator-based TEE educational program vs ideal image planes determined from a panel of experts. Thirty-three participants completed the study (15 experts, 7 postgraduate year (PGY)-1 and 11 PGY-4). The results of our study demonstrated a significant difference in image capture success rates between learners and experts (χ² = 14.716, df = 2, P < 0.001) with the difference between learners (PGY-1 and PGY-4) not being statistically significant (χ² = 0, df = 1, P = 1.000). Therefore, our results suggest that novices (i.e. PGY-1 residents) are capable of attaining a level of proficiency comparable to those with modest training (i.e. PGY-4 residents) after completion of a simulation-based training curriculum. However, professionals with years of clinical training (i.e. attending physicians) exhibit a superior mastery of such skills. It is hence feasible to develop a simulator-based VOP program in performance of TEE for junior anesthesia residents.