Is There a Replication Crisis in Medical Education Research?

Longitudinal Improvement in Public Speaking Skills Through Participation in a Resident Public Speaking Curriculum

OBJECTIVE

To promote public speaking skills, a pediatrics residency program developed a longitudinal public speaking curriculum grounded in deliberate practice and reflective practice.

METHODS

Residents delivered annual presentations and received formal feedback. Audience evaluation forms from 2005-2017 were included for analysis. The form used 5-point scales (5= best) for specific presentation elements (clarity, eye contact/body language, pace, succinct text, minimally distracting delivery, clear conclusion, appropriate learning objectives, achieving learning objectives, and answering questions) and for overall quality. Longitudinal changes in scores were analyzed with paired t tests.

RESULTS

Overall, 5,771 evaluations of 276 presentations given by 97 residents were analyzed. Between post-graduate year (PGY)-1 and PGY-3 presentations, mean overall rating increased from 4.38 to 4.59 (P<.001, d=0.51). The median percentage of 5-point scores increased from 50.0% (IQR, 24.3%-65.4%) to 72.5% (IQR, 53.3%-81.2%). Eight of 9 specific elements showed significant increases (median effect size 0.55). Residents whose initial presentations ranked in the bottom quartile had larger improvements than residents initially ranked in the top quartile.

CONCLUSIONS

After pediatric residents participated in a public speaking curriculum with targeted objectives, formal feedback, and repeated practice, their public speaking skills improved. Public speaking curricula can and should be adopted more broadly in graduate medical education.

Use of eye tracking in medical education

Eye tracking has become increasingly applied in medical education research for studying the cognitive processes that occur during the performance of a task, such as image interpretation and surgical skills development. However, analysis and interpretation of the large amount of data obtained by eye tracking can be confusing. In this article, our intention is to clarify the analysis and interpretation of the data obtained from eye tracking. Understanding the relationship between eye tracking metrics (such as gaze, pupil and blink rate) and cognitive processes (such as visual attention, perception, memory and cognitive workload) is essential. The importance of calibration and how the limitations of eye tracking can be overcome is also highlighted.

Advancing Research Training in Medical Education: Global Perspectives and Paradigms for Future Development

BACKGROUND

This study delves into the dynamic field of medical education research, emphasizing the integration of research training within medical curricula. It seeks to understand the impact of such integration on the competencies of future medical professionals.

OBJECTIVE

The primary aim is to systematically categorize and analyze the current trends and future directions in research training in medical education. This involves assessing the influence of research training on medical students' skills and the methodologies used in such research.

METHODS

The research employs an extensive bibliographic literature review across multiple databases. It classifies studies like experiential or case studies, editorials, and original research articles. This classification is based on criteria such as geographical location, research objectives, theoretical frameworks, and methodologies.

RESULTS

Findings reveal a diverse landscape in medical education research, with a significant emphasis on research training. The research showcases varying methodologies and approaches used globally, highlighting the thematic focus and geographical distribution of these studies.

CONCLUSION

Research training in medical education is a globally expansive and evolving field. It underscores the importance of continuous investigation, particularly focusing on integrating research elements at curricular levels and exploring innovative educational strategies. The study also points out potential research gaps, especially in underrepresented regions, indicating directions for future research efforts.