Multi-level longitudinal learning curve regression models integrated with item difficulty metrics for deliberate practice of visual diagnosis: groundwork for adaptive learning

Twelve Tips for using Learning Curves in Health Professions Education Research

Learning curves can be used to design, implement, and evaluate educational interventions. Attention to key aspects of the method can improve the fidelity of this representation of learning as well as its suitability for education and research purposes. This paper addresses when to use a learning curve, which graphical properties to consider, how to use learning curves quantitatively, and how to use observed thresholds to communicate meaning. We also address the associated ethics and policy considerations. We conclude with a best practices checklist for both educators and researchers seeking to use learning curves in their work.

Self-regulated learning and the future of diagnostic reasoning education

Diagnostic reasoning is a foundational ability of health professionals. The goal of enhancing clinical reasoning education is improved diagnostic accuracy and reduced diagnostic error. In order to do so, health professions educators need not only help learners improve their clinical reasoning, but teach them how to develop expert performance. An evidence-based learning strategy that is strongly associated with expert performance is self-regulated learning (SRL). SRL is the modulation of "self-generated thoughts, feelings, and actions that are planned and cyclically adapted to the attainment of personal goals". At this time, there is little data on the use of SRL to improve diagnostic reasoning. However, there appear to be numerous opportunities to utilize SRL in novel ways to improve diagnostic reasoning given what is already known about this competency. Examples that are discussed include the role SRL can play in simulation, clinical experiences, assessment, and novel technologies such as virtual reality, artificial intelligence, and machine learning. SRL is central to the philosophy that health professionals are life-long learners, as it teaches learners "how to learn". SRL has the potential to help achieve the goal of improved diagnostic accuracy and reduced diagnostic error.

Developing the Expected Entrustment Score: Accounting for Variation in Resident Assessment

BACKGROUND

Clinical competency committees (CCCs) and residency program leaders may find it difficult to interpret workplace-based assessment (WBA) ratings knowing that contextual factors and bias play a large role.

OBJECTIVE

We describe the development of an expected entrustment score for resident performance within the context of our well-developed Observable Practice Activity (OPA) WBA system.

DESIGN

Observational study PARTICIPANTS: Internal medicine residents MAIN MEASURE: Entrustment KEY RESULTS: Each individual resident had observed entrustment scores with a unique relationship to the expected entrustment scores. Many residents' observed scores oscillated closely around the expected scores. However, distinct performance patterns did emerge.

CONCLUSIONS

We used regression modeling and leveraged large numbers of historical WBA data points to produce an expected entrustment score that served as a guidepost for performance interpretation.

What role does basic research have in an applied field?

Research in health professions education has often been portrayed as an applied field, one that draws on more basic forms of research in pursuing what are primarily practical ends. While there is an undeniable practical side to much of the work published in our field, and in this Journal in particular, this can be problematic when the necessary basic research is not extant. In this editorial, two of this Journal's editors consider some of the challenges in bridging these basic research gaps in an erstwhile applied field, and the implications for the kinds of research we undertake and for the identity of the field as a whole.