A reflective analysis of medical education research on self-regulation in learning and practice

The show must go on: fostering residents' sustainable employability in medical education - a qualitative exploration of the Resident Leadership Program

BACKGROUND

Residents' sustainable employability (SE) is threatened by high burn-out rates, sleep deficits, and career dissatisfaction. Medical education may contribute to residents' SE by providing them with opportunities to influence their employment contexts and to develop conscious self-regulation. This paper explores how residents, participating in the Resident Leadership Program (RLP), are enabled to work on, and learn about, their SE.

METHODS

The RLP took place between February and July 2021 and consisted of lectures on, and practice in, quality improvement (QI) work. SE was the theme that governed residents' QI projects. In this study, residents were interviewed individually before the program (n = 8), were observed while participating in the program (45 h) and were interviewed in three groups after the program (n = 8). The data were analysed in accordance with the 'flexible-coding' method.

RESULTS

The findings are presented in four 'acts' mirroring an unfolding play as a metaphor to show how residents' understanding of context, self-regulations, and quality improvement work-relevant to their SE-changed in the RLP. The acts include 'setting the stage', describing how residents experienced the context of medicine; 'acting the part', depicting how residents managed their employment contexts using self-regulation; 'changing the décor', elaborating on residents' QI projects; and 'growing one's role', presenting residents' take-aways from participating in the RLP that may benefit their SE. These take-aways encompassed awareness of the importance of SE, a reconsideration and/or adjustment of self-regulation, feeling better equipped to navigate employment contexts, and increased joy in work because of contributing to peers' SE through QI work.

CONCLUSIONS

Our results indicate that medical education is a fruitful environment for providing important lessons and tools for residents to work on and learn about their SE, likely benefiting their SE throughout their careers.

Learning cardiac embryology on YouTube-What videos are there to view?

In modern medical curricula, embryology is typically taught through lectures, with a few institutions providing tutorials. The use of 3-D videos or animations enables students to study these embryological structures and how they change with time. The aim of this study was to assess the quality of cardiac embryology videos available on YouTube. A systematic literature review regarding the use of YouTube in teaching or learning cardiac embryology identified no papers that examined this specific question, and next, a systematic search of YouTube was performed. A total of 1200 cardiac embryology videos were retrieved using 12 specific search terms, with 370 videos retrieved under two or more search terms and excluded. A further 511 videos were excluded under additional, specific criteria. The remaining 319 videos were evaluated with the YouTube Video Assessment Criteria (UTvAC), with 121 rated as "useful." Videos on YouTube are uploaded with a wide audience in mind, from children to cardiologists, and content control is imperfect. Multiple videos were identified as duplicates of videos from original channels, typically without attribution. While 49 videos showed operations or human material, none contained an ethical statement regarding consent, and only 10 of these included an age restriction or graphical advisory. While there are useful videos for medical students studying cardiac embryology on YouTube, intuitive search strategies will also identify many with irrelevant content and of variable quality. Digital competence and search strategies are not innate skills, so educators should teach students to assess information so as to avoid overload or "filter failure."

Development and Evaluation of an Experiential Career Planning Assignment to Train Students to Assess Organizational Fit

Determining if an employment opportunity will be a good match can feel daunting, especially for veterinary graduates entering the workforce. To ease this transition, veterinary educators traditionally have attempted to provide career support through interspersed didactic lectures on career options and the preparation of employment documents. While well intended, this approach fails to address the multiple dimensions of effective career planning or the reality that career planning is a lifelong endeavor. For a career-planning teaching modality to be effective, it must address all stages of career planning and provide a framework that can be adapted throughout a career. Here we describe how a four-stage career-planning model, utilized throughout higher education, was employed to create a career planning assignment for guiding students in assessing organizational fit. We describe how student feedback was used to inform revisions, resulting in an improved educational experience as measured by students' perceptions of the utility of the assignment. Additional recommendations based on instructor reflection are provided to guide creation and implementation of future assignments. Given the growing support for professional skills training in veterinary medical education, we view incorporation of such learning activities as essential to preparing students to enter the modern veterinary workplace.

The Relationship Between Self-Regulated Learning Competency and Clinical Reasoning Tendency in Medical Students

Self-regulated learning (SRL) is essential to professional learning and practice across disciplines. However, the literature provides limited insights into how medical educators could leverage the SRL framework to support trainees' strategic processes in clinical reasoning activities. In this study, we investigated the relationship between SRL competency and clinical reasoning tendency as 64 medical students diagnosed a virtual patient in a computer-simulated environment. We further examined whether students with different profiles of SRL competency and clinical reasoning tendency differed in their behavioral patterns and performance. The results suggested that SRL competency positively predicted clinical reasoning tendency. Enhancing medical students' SRL competency, especially their self-reflection skills, could increase the tendency toward relying on an analytic approach to clinical reasoning. Moreover, we identified two groups of students (i.e., analytic SRL learners, and non-analytic, low SRL learners) using K-means clustering analysis. The two groups of students differed in their behavioral patterns in clinical reasoning, as revealed by lag sequential analysis. Furthermore, analytic SRL learners ordered more relevant lab tests than non-analytic low SRL learners in clinical reasoning. This study has methodological and practical implications.

Basic psychological needs satisfaction as a mediator between clinical learning climate, self-regulated learning and perceived learning in the nursing education context

PURPOSE

Self-regulated learning (SRL) can enhance students' learning process. Students need support to effectively regulate their learning. However, the effect of learning climate on SRL behavior, its ultimate effect on learning and the underlying mechanisms have not yet been established. We explored these relationships using self-determination theory.

MATERIALS AND METHODS

Nursing students (N = 244) filled in questionnaires about SRL behavior, perceived learning, perceived pedagogical atmosphere and Basic Psychological Needs (BPN) satisfaction after their clinical placement. Structural equation modelling was used to test a model in which perceived pedagogical atmosphere affects SRL behavior and subsequent perceived learning through BPN satisfaction.

RESULTS

The tested model had an adequate fit (RMSEA = 0.080, SRMR = 0.051; CFI = 0.972; TLI = 0.950). A positively perceived pedagogical atmosphere contributed to SRL behavior, which was fully explained by BPN satisfaction. SRL partially mediated the contribution of pedagogical atmosphere/BPN to perceived learning.

CONCLUSIONS

A learning climate that satisfies students' BPN contributes to their SRL behavior. SRL behavior plays a positive but modest role in the relationship between climate and perceived learning. Without a culture that is supportive of learning, implementation of tools to apply SRL behavior may not be effective. Study limitations include reliance on self-report scales and the inclusion of a single discipline.

An exploratory study of goal orientations of traditional block and longitudinal integrated clerkship students

BACKGROUND

Achievement goal theory links goal setting, motivation, and learning and describes three orientations: 'mastery' (seeking learning), 'performance' (seeking positive judgments), and 'performance-avoidance' (avoiding negative judgments). Mastery orientation is considered most adaptive. The authors investigated goal orientations of traditional block clerkship (TBC) and longitudinal integrated clerkship (LIC) students.

METHODS

This was an exploratory study conducted at one US medical school. Three hundred and twenty students completed an anonymous survey consisting of three tools with validation evidence: Patterns of Adaptive Learning Survey, Task-choice Goal Measures, and Questionnaire Goal Choice Items. The authors analyzed the data using regression analyses, Chi-square, and Wilcoxon's rank-sum tests.

RESULTS

While all students rated mastery items most highly on the five-point Likert scale (mean 4.58/5.00), LIC students rated performance-orientation lower (β = -0.36, p = .04), chose personal mastery-orientation items more frequently (92% vs. 64.4%, p = .005), and perceived their learning environment as promoting less performance (β = -0.60, p = .002) and performance-avoidance (β = -0.78, p < .001) compared to TBC students.

CONCLUSIONS

LIC and TBC students differed in their report of personal and clerkship goal orientations. These differences may inform educational design and future research to promote students' mastery orientation.

A Philosophical Discussion of the Support of Self-Regulated Learning in Medical Education: The Treasure Hunt Approach Versus the (Dutch) "Dropping" Approach

Issue: Many current educational approaches are intended to cultivate learners' full (learning) potential by fostering self-regulated learning (SRL), as it is expected that those learners with a high degree of SRL learn more effectively than those with a low degree of SRL. However, these attempts to foster SRL are not always successful. Evidence: We considered complexities related to fostering self-regulated learning by use of an analogy. This analogy was based on two (Dutch) children's games: the treasure hunt (children can find a "treasure" by following directions, completing assignments and/or answering questions) and the dropping (pre-teens are dropped in the woods at nighttime with the assignment to find their way back home). We formulated four interrelated philosophical questions. These questions were not formulated with the intention to provide clear-cut answers, but were instead meant to evoke contemplation about the SRL concept. During this contemplation, the implications of definitional issues regarding SRL were discussed by use of the first question: What are the consequences of the difficulties to explicate what is (not) SRL? The second question (How does SRL relate to autonomy?) touched upon the intricate relationship between SRL and autonomy, by discussing the role of social interaction and varying degrees of instruction when fostering SRL. Next, a related topic was addressed by the third question: How much risk are we willing and able to take when fostering SRL? And finally, the importance of and possibilities to assess SRL were discussed by the fourth question (Should SRL be assessed?). Implications: From our contemplations it has become clear that approaches to foster SRL are often insufficiently aligned with the experience and needs of learners. Instead these approaches are commonly defined by contextual factors, such as misconceptions about SRL and lack of leeway for learners. Consequently, we have used principles that apply to both treasure hunts and droppings, to provide guidelines on how to align one's approach to foster SRL with the educational context and experience and needs of learners.

Fostering Adaptive Expertise Through Simulation

Technology-enhanced simulation has been used to tackle myriad challenges within health professions education. Recently, work has typically adopted a mastery learning orientation that emphasizes trainees' sequential mastery of increasingly complex material. Doing so has privileged a focus on performance and task completion, as captured by trainees' observable behaviors and actions. Designing simulation in these ways has provided important advances to education, clinical care, and patient safety, yet also placed constraints around how simulation-based activities were enacted and learning outcomes were measured. In tracing the contemporary manifestations of simulation in health professions education, this article highlights several unintended consequences of this performance orientation and draws from principles of adaptive expertise to suggest new directions. Instructional approaches grounded in adaptive expertise in other contexts suggest that uncertainty, struggle, invention, and even failure help learners to develop deeper conceptual understanding and learn innovative approaches to novel problems. Adaptive expertise provides a new lens for simulation designers to think intentionally around how idiosyncrasy, individuality, and inventiveness could be enacted as central design principles, providing learners with opportunities to practice and receive feedback around the kinds of complex problems they are likely to encounter in practice. Fostering the growth of adaptive expertise through simulation will require a fundamental reimagining of the design of simulation scenarios, embracing the power of uncertainty and ill-defined problem spaces, and focusing on the structure and pedagogical stance of debriefing. Such an approach may reveal untapped potential within health care simulation.

Structured interviews on self-regulated learning strategies of medical students in the final year of medical school

BACKGROUND

In the final year of medical school, the educational focus is on experiences in the clinical environment. This is where students acquire most of their practical knowledge for their future career and need to optimise their Self-Regulated Learning (SRL) strategies. Hence, the current study aims to explore which SRL strategies medical students use during their clerkships in different learning settings.

METHODS

Structured interviews were conducted between May 2019 and December 2020 with 43 medical students during their final year in Munich, Germany. The students were surveyed about their SRL strategies. The transcribed data were thematically analysed using the measurements Strategy Use (SU) and Strategy Frequency (SF).

RESULTS

Interview data were organized into 11 SRL strategy categories. The most used SRL strategy in general was "seeking information in the internet in form of a text" (SU: 1; SF: 2.605), with an e-learning tool; followed by "seeking social assistance from doctors" (SU: 0.977; SF: 1.884), and "seeking information in books" (SU: 0.884; SF: 1.419). There were differences in the usage of SRL in different learning contexts between female and male students. For example, 95.3% of students are "seeking social assistance from doctors" when having difficulties on the ward, but only 55.8% when they need help with written tasks (e.g. medical letter). The results show a difference in SRL usage when preparing for oral-practical (79.1% books) and written (97.7% e-learning tool) exam. However, it also appears that some students do not have SRL strategies for certain situations, mostly due to a lack of time.

CONCLUSION

Medical students in the clinical phase are adapting their SRL strategy to the learning situation. To better support students´ SRL, it is necessary to ensure availability for their preferred resources: e-learning tool and experienced physicians as supervisors. Future research should focus on strategies to handle the limited time during clerkships.

"It Changed How I Think"-Impact of Programmatic Assessment Upon Practicing Physicians: A Qualitative Study

Programmatic assessment is a systematic approach used to document and assess learner performance. It offers learners frequent formative feedback from a variety of contexts and uses both high- and low-stakes assessments to determine student progress. Existing research has explored learner and faculty perceptions of programmatic assessment, reporting favorable impact on faculty understanding of the importance of assessment stakes and feedback to learners while students report the ability to establish and navigate towards goals and reflect on their performance. The Cleveland Clinic Lerner College of Medicine (CCLCM) of Case Western Reserve University adopted programmatic assessment methods at its inception. With more than 18 years' experience with programmatic assessment and a portfolio-based assessment system, CCLCM is well-positioned to explore its graduates' perceptions of their programmatic assessment experiences during and after medical school. In 2020, the investigators interviewed 26 of the 339 physician graduates. Participants were purposefully sampled to represent multiple class cohorts (2009-2019), clinical specialties, and practice locations. The investigators analyzed interview transcripts using thematic analysis informed by the frameworks of self-determination theory and professional identity formation. The authors identified themes and support each with participant quotes from the interviews. Based on findings, the investigators compiled a series of recommendations for other institutions who have already or plan to incorporate elements of programmatic assessment into their curricula. The authors concluded by discussing future directions for research and additional avenues of inquiry.

Association between impulsivity and cognitive capacity decrease is mediated by smartphone addiction, academic procrastination, bedtime procrastination, sleep insufficiency and daytime fatigue among medical students: a path analysis

BACKGROUND

Medical students are at high risk for sleep disturbance. One possible cause of their sleeping problem is impulsivity. We aim to investigate the possible mediators between medical students' impulsivity and sleep outcomes. Thus, we developed and investigated a model where the predictors were attentional, non-planning, and motor impulsivity subtraits. In the final model, subjective cognitive capacity decrease was the outcome variable. In light of previous findings, academic procrastination, smartphone addiction, and bedtime procrastination were considered important mediators as well as two variables of poor sleep, sleeping insufficiency, and daytime fatigue.

METHODS

Medical students (N = 211; age_M = 22.15 years; age_SD = 3.47 years; 71.6% women) were recruited to complete an online survey comprised of demographics (age, gender), self-administered scales (Abbreviated Impulsiveness Scale, Bedtime Procrastination Scale, Abbreviated Impulsiveness Scale, Academic Procrastination Scale-Short Form) and questions on tiredness, daily fatigue and subjective cognitive capacity decrease. Correlation and path analyses were implemented to examine hypothesized relationships between the variables.

RESULTS

Both attentional impulsivity (β = 0.33, p < .001) and non-planning impulsivity (β = -0.19, p < .01) had a direct relationship with cognitive capacity decrease. Attentional impulsivity was also associated with decreased cognitive capacity with a serial mediation effect via smartphone addiction, academic procrastination, bedtime procrastination, sleep insufficiency and fatigue (estimate = 0.017, p < .01). The indirect link between non-planning impulsivity and cognitive capacity decrease was mediated by academic procrastination, bedtime procrastination, sleep insufficiency and fatigue (estimate = 0.011, p < .01).

CONCLUSIONS

Inability to stay focused and plan tasks effectively (directly and indirectly) predicts poor sleep outcomes. This relationship is mediated by excessive smartphone use, academic procrastination, and bedtime procrastination. Our findings are relevant in light of self-regulatory learning, which is crucial in medical education. This is a recursive cycle of planning, emotion regulation, proper strategy selection and self-monitoring. Future interventions addressing attentional and non-planning impulsivity, problematic smartphone use, academic procrastination, and in turn, bedtime procrastination might make this routine more effective. In the conclusion section, practical implications of the results are discussed.

Self-regulated learning and the future of diagnostic reasoning education

Diagnostic reasoning is a foundational ability of health professionals. The goal of enhancing clinical reasoning education is improved diagnostic accuracy and reduced diagnostic error. In order to do so, health professions educators need not only help learners improve their clinical reasoning, but teach them how to develop expert performance. An evidence-based learning strategy that is strongly associated with expert performance is self-regulated learning (SRL). SRL is the modulation of "self-generated thoughts, feelings, and actions that are planned and cyclically adapted to the attainment of personal goals". At this time, there is little data on the use of SRL to improve diagnostic reasoning. However, there appear to be numerous opportunities to utilize SRL in novel ways to improve diagnostic reasoning given what is already known about this competency. Examples that are discussed include the role SRL can play in simulation, clinical experiences, assessment, and novel technologies such as virtual reality, artificial intelligence, and machine learning. SRL is central to the philosophy that health professionals are life-long learners, as it teaches learners "how to learn". SRL has the potential to help achieve the goal of improved diagnostic accuracy and reduced diagnostic error.

Mentoring is in the 'I' of the beholder: supporting mentors in reflecting on their actual and preferred way of mentoring

BACKGROUND

An important strategy to support the professional development of mentors in health professions education is to encourage critical reflection on what they do, why they do it, and how they do it. Not only the 'how' of mentoring should be covered, but also the implicit knowledge and beliefs fundamental to the mentoring practice (a mentor's personal interpretative framework). This study analyzed the extent to which mentors perceive a difference between how they actually mentor and how they prefer to mentor.

METHODS

The MERIT (MEntor Reflection InstrumenT) survey (distributed in 2020, N = 228), was used to ask mentors about the how, what, and why of their mentoring in two response modes: (1) regarding their actual mentoring practice and (2) regarding their preferred mentoring practice. With an analysis of covariance, it was explored whether potential discrepancies between these responses were influenced by experience, profession of the mentor, and curriculum-bound assessment requirements.

RESULTS

The averaged total MERIT score and averaged scores for the subscales 'Supporting Personal Development' and 'Monitoring Performance' were significantly higher for preferred than for actual mentoring. In addition, mentors' experience interacted significantly with these scores, such that the difference between actual and preferred scores became smaller with more years of experience.

CONCLUSIONS

Mentors can reflect on their actual and preferred approach to mentoring. This analysis and the potential discrepancy between actual and preferred mentoring can serve as input for individual professional development trajectories.

A Mixed-Methods Program Evaluation of a Self-directed Learning Panel Management Curriculum in an Internal Medicine Residency Clinic

BACKGROUND

Panel management (PM) curricula in internal medicine (IM) residency programs often assign performance measures which may not address the varied interests or needs of resident-learners.

AIM

To evaluate a self-directed learning (SDL)-based PM curriculum.

SETTING

University-based primary care practice in Burlington, Vermont.

PARTICIPANTS

Thirty-five internal medicine residents participated.

PROGRAM DESCRIPTION

Residents completed a PM curriculum that integrated SDL, electronic health record (EHR)-driven performance feedback, mentorship, and autonomy to set learning and patient care goals.

PROGRAM EVALUATION

Pre/post-curricular surveys assessed EHR tool acceptability, weekly curricular surveys and post-curricular focus groups assessed resident perceptions and goals, and an interrupted time series analysis of care gap closure rates was used to compare the pre-intervention and intervention periods. Majority of residents (28-32 or 80-91%) completed the surveys and focus groups. Residents found the EHR tools acceptable and valued protected time, mentorship, and autonomy to set goals. A total of 13,313 patient visits were analyzed. There were no significant differences between rates between the pre-intervention period and the first intervention period (p=0.44).

DISCUSSION

A longitudinal PM curriculum that incorporated SDL and goal setting with EHR-driven performance feedback was well-received by residents, however did not significantly impact the rate of care gap closure.

Effective competency-based medical education requires learning environments that promote a mastery goal orientation: A narrative review

PURPOSE

Competency-based medical education (CBME) emphasizes the need for learners to be central to their own learning and to take an active role in learning. This approach has a dual aim: to encourage learners to actively engage in their own learning, and to push learners to develop learning strategies that will prepare them for lifelong learning. This review paper proposes a theoretical bridge between CBME and lifelong learning and puts forth the argument that in order for CBME programs to produce the physicians truly needed in our society now and in the future, learning environments must be intentionally designed to foster mastery goal orientations and to support the development of adaptive self-regulated learning skills and behaviours.

MATERIALS AND METHODS

This narrative literature review incorporated results of searches conducted by a subject librarian in PsycInfo and MedLine. Articles were also identified through reference lists of identified papers to capture older key citations. Analysis of the literature used a constructivist epistemological approach to develop an integrative description of the interaction of achievement goal orientation, self-regulated learning, learning environment, and lifelong learning.

RESULTS

Findings from achievement goal theory research support the assumption that adoption of a mastery goal orientation facilitates the use of adaptive learning behaviours, such as those described in self-regulated learning theory. Adaptive self-regulated learning strategies, in turn, facilitate effective lifelong learning. The authors offer evidence for how learning environments influence goal orientations and self-regulated learning, and propose that CBME programs intentionally plan for such learning environments. Finally, the authors offer specific suggestions and examples for how learning environments can be designed or adjusted to support adoption of a mastery goal orientation and use of self-regulated learning behaviours and strategies to help support development of adaptive lifelong learners.

Factors associated with medical students' self-regulated learning and its relationship with clinical performance: a cross-sectional study

BACKGROUND

The importance of self-regulated learning (SRL) has been broadly recognised by medical education institutions and medical professionals. Self-regulated learning, which is a context-specific process, is affected by personal, contextual and social factors. Although many studies on exploring the factors that influenced SRL and the relationship of between SRL and clinical achievement levels have been carried out in western countries, little is known about the factors associated with self-regulated learning and its relationship with clinical performance among medical students in China.

METHODS

A cross-sectional online survey was distributed to 3rd year clinical medicine students who were in the clinical clerkship stage in a medical college in Wuhan. We used Self-regulated Learning Scale for Undergraduates (SLSU) to measure the self-regulated learning of students and Objective Structured Clinical Examination (OSCE) in the national proficiency test to assess the clinical performance of students. The participation rate was 73.95% (193 students). An independent t-test and analysis of variance were used to analyse the factors associated with self-regulated learning. The relationship between self-regulated learning and clinical performance was analysed with multilinear regression analysis.

RESULTS

Univariate analysis showed that having a clear career planning and a professional idol, providing full-time teaching clinical teachers in the clerkship department and seeking the help of the surrounding classmates and the guidance of teachers or senior students were significant predictors of self-regulated learning. Multilinear regression analysis has revealed a positive relationship among extrinsic goals (partial r = 0.171), clinical clerkship evaluation (partial r = 0.197) and clinical performance (F = 4.070, p = 0.004).

CONCLUSIONS

Motivation-related personal and social factors related to clinical context could promote the SRL level of medical students in China. Extrinsic goals and clinical clerkship evaluation could facilitate students' clinical achievements on clinical skills. External support, such as clinical clerkship management, might improve clinical performance on clinical skills in clinical clerkship context.

Readiness to enter the workforce: perceptions of health professions students at a regional Australian university

BACKGROUND

Perceived readiness for practice can help mitigate the stress and uncertainty associated with transitioning from university into the workforce. This study aimed to identify factors influencing the readiness for clinical practice among final-year medical, dental, and pharmacy students at an Australian regional university.

METHODS

The study utilised a sequential explanatory mixed-methods approach with surveys administered for the quantitative phase and interviews/focus groups for the qualitative phase. Descriptive statistics and inductive thematic analysis were utilised for the quantitative and qualitative data, respectively. Triangulation of findings from both phases facilitated in-depth understanding of the factors that influenced participants' self-perceived readiness for clinical practice.

RESULTS

From the three disciplines, 132 students completed the survey and 14 participated in the focus groups and interviews. Students felt most prepared in their patient-centred capabilities, core skills, and advanced consultation skills, and least prepared in their system-related capabilities and clinical care skills. Themes identified as essential enablers and confidence builders in relation to workforce readiness in all three disciplines were: gained knowledge and skills, value of clinical placement experiences, support from peers, family and staff. However, students felt their work-readiness was impaired by heavy academic workloads and poor knowledge of health care systems, which affected skills development. Participants suggested additional support in health care system and clinical governance, mental healthcare, and induction to placement sites to further improve their work readiness.

CONCLUSIONS

The findings of this study suggest that improving work-readiness of healthcare students requires alignment of learning needs to real-world practice opportunities, ensuring support systems are appropriate, and early familiarisation with the healthcare system.

Medical Students' Technology Use for Self-Directed Learning: Contributing and Constraining Factors

BACKGROUND

With medical education shifting towards competency-based models, medical students are expected to be self-directed lifelong learners. There is an urgent need to understand what technology students adopt for self-directed learning and what factors contributed to students' self-initiated technology use.

METHOD

This study took place in a midwestern university medical school, which implements a flipped classroom model where students are required to learn all the course materials independently before class. Twenty-six first- and second-year medical students participated in a semi-structured interview about their self-directed learning with technology, and contributing factors towards technology use. A qualitative description methodology using thematic analysis was used to identify key themes from the interview data.

RESULTS

Medical students reported using four types of technologies for learning video resources, self-assessment tools, management tools, and social media. Three key determinants of students' self-directed technology use were identified, including perceived usefulness, subjective norms, and educational compatibility.

CONCLUSIONS

By probing medical students' self-initiated technology use and its determinants, this study suggested that in a self-directed learning environment, medical students used a variety of third-party resources to facilitate learning and develop self-directed learning skills. This study also provided important practical implications to better support students' productive use of technologies for self-directed learning.

Relationships between medical students' co-regulatory network characteristics and self-regulated learning: a social network study

INTRODUCTION

Recent conceptualizations of self-regulated learning acknowledge the importance of co-regulation, i.e., students' interactions with others in their networks to support self-regulation. Using a social network approach, the aim of this study is to explore relationships between characteristics of medical students' co-regulatory networks, perceived learning opportunities, and self-regulated learning.

METHODS

The authors surveyed 403 undergraduate medical students during their clinical clerkships (response rate 65.5%). Using multiple regression analysis, structural equation modelling techniques, and analysis of variance, the authors explored relationships between co-regulatory network characteristics (network size, network diversity, and interaction frequency), students' perceptions of learning opportunities in the workplace setting, and self-reported self-regulated learning.

RESULTS

Across all clerkships, data showed positive relationships between tie strength and self-regulated learning (β = 0.095, p < 0.05) and between network size and tie strength (β = 0.530, p < 0.001), and a negative relationship between network diversity and tie strength (β = -0.474, p < 0.001). Students' perceptions of learning opportunities showed positive relationships with both self-regulated learning (β = 0.295, p < 0.001) and co-regulatory network size (β = 0.134, p < 0.01). Characteristics of clerkship contexts influenced both co-regulatory network characteristics (size and tie strength) and relationships between network characteristics, self-regulated learning, and students' perceptions of learning opportunities.

DISCUSSION

The present study reinforces the importance of co-regulatory networks for medical students' self-regulated learning during clinical clerkships. Findings imply that supporting development of strong networks aimed at frequent co-regulatory interactions may enhance medical students' self-regulated learning in challenging clinical learning environments. Social network approaches offer promising ways of further understanding and conceptualising self- and co-regulated learning in clinical workplaces.

Putting self-regulated learning in context: Integrating self-, co-, and socially shared regulation of learning

Processes involved in the regulation of learning have been researched for decades, because of its impact on academic and workplace performance. In fact, self-regulated learning is the focus of countless studies in health professions education and higher education in general. While we will always need competent individuals who are able to regulate their own learning, developments in healthcare require a shift from a focus on the individual to the collective: collaboration within and between healthcare teams is at the heart of high-quality patient care. Concepts of collaborative learning and collective competence challenge commonly held conceptualisations of regulatory learning and call for a focus on the social embeddedness of regulatory learning and processes regulating the learning of the collective. Therefore, this article questions the alignment of current conceptualisations of regulation of learning with demands for collaboration in current healthcare. We explore different conceptualisations of regulation of learning (self-, co-, and socially shared regulation of learning), and elaborate on how the integration of these conceptualisations adds to our understanding of regulatory learning in healthcare settings. Building on these insights, we furthermore suggest ways forward for research and educational practice.

What Were You Thinking? Medical Students' Metacognition and Perceptions of Self-Regulated Learning

PHENOMENON

As a component of self-regulated learning, metacognition is gaining attention in the medical education research community. Metacognition, simply put, is thinking about one's thinking. Having a metacognitive habit of mind is essential for healthcare professionals. This study identified the metacognitive competencies of medical students as they completed a conceptual learning task, and provided insight into students' perceptions of self-regulated learning in their curriculum. Approach: Eleven third-year medical students from a Dutch University were purposively sampled to participate in this qualitative study. The study design included a think-aloud assignment followed by a semi-structured interview. During the assignment, participants were instructed to think aloud while solving questions about medical physiological concepts such as blood flow, pressure, and resistance. Think-aloud data were collected through audiotaping and used to identify participants' metacognitive competencies. The assignment also served as a prompt for an interview in which participants were questioned about metacognitive knowledge, monitoring, experiences, and perceptions of self-regulated learning in their curriculum. All data were transcribed verbatim and analyzed iteratively using a template analysis. Findings: Students differed in their use of metacognitive skills, with an overall focus on monitoring and, to a lesser extent, on planning and evaluation. Additionally, differences were found in students' metacognitive knowledge and metacognitive experiences. There was apparent use of inefficient, superficial predictive cues. Regarding perceptions of self-regulated learning skills, some students felt no need to develop such skills as they perceived medical education as an exercise in memorizing facts. Others emphasized the need for more insight into their actual level of knowledge and competence. Insights: Pre-clinical medical students require explicit teaching of metacognitive skills to facilitate self-regulated learning. Educators should aim to integrate metacognition in the everyday discourse of the classroom to foster an environment in which students discuss their own learning.

Supplemental data for this article is available online at https://doi.org/10.1080/10401334.2021.1889559.

Examining the accuracy of residents' self-assessments and faculty assessment behaviours in anesthesiology

BACKGROUND

Residents' accurate self-assessment and clinical judgment are essential for optimizing their clinical skills development. Evidence from the medical literature suggests that residents generally do poorly at self-assessing their performance, often due to factors relating to learners' personal backgrounds, cultures, the specific contexts of the learning environment and rater bias or inaccuracies. We evaluated the accuracy of anesthesiology residents' self-assessed Global Entrustment scores and determined whether differences between faculty and resident scores varied by resident seniority, faculty leniency, and/or year of assessment.

METHODS

We employed variance components modeling techniques and analyzed 329 pairs of faculty and self-assessed entrustment scores among 43 faculty assessors and 15 residents. Using faculty scores as the gold standard, we compared faculty scores with residents' scores (x_i(faculty)-x_i(resident)), and determined residents' accuracy, including over- and under-confidence.

RESULTS

The results indicate that residents were respectively over- and under-confident in 10.9% and 54.4% of the assessments but more consistent in their individual self-assessments (rho = 0.70) than faculty assessors. Faculty scores were significantly higher (α = 0.396; z = 4.39; p < 0.001) than residents' self-assessed scores. Being a lenient/dovish (β = 0.121, z = 3.16, p < 0.01) and a neutral (β = 0.137, z = 3.57, p < 0.001) faculty assessor predicted a higher likelihood of resident under-confidence. Senior residents were significantly less likely to be under-confident compared to junior residents (β = -0.182, z =-2.45, p < 0.05). The accuracy of self-assessments did not significantly vary during the two years of the study period.

CONCLUSIONS

The majority of residents' self-assessments were inaccurate. Our findings may help identify the sources of such inaccuracies.

Digital Learning in Speech-Language Pathology, Phoniatrics, and Otolaryngology: Interdisciplinary and Exploratory Analysis of Content, Organizing Structures, and Formats

BACKGROUND

The digital revolution is rapidly transforming health care and clinical teaching and learning. Relative to other medical fields, the interdisciplinary fields of speech-language pathology (SLP), phoniatrics, and otolaryngology have been slower to take up digital tools for therapeutic, teaching, and learning purposes-a process that was recently expedited by the COVID-19 pandemic. Although many current teaching and learning tools have restricted or institution-only access, there are many openly accessible tools that have gone largely unexplored. To find, use, and evaluate such resources, it is important to be familiar with the structures, concepts, and formats of existing digital tools.

OBJECTIVE

This descriptive study aims to investigate digital learning tools and resources in SLP, phoniatrics, and otolaryngology. Differences in content, learning goals, and digital formats between academic-level learners and clinical-professional learners are explored.

METHODS

A systematic search of generic and academic search engines (eg, Google and PubMed); the App Store; Google Play Store; and websites of established SLP, phoniatrics, and otolaryngology organizations was conducted. By using specific search terms and detailed inclusion and exclusion criteria, relevant digital resources were identified. These were organized and analyzed according to learner groups, content matter, learning goals and architectures, and digital formats.

RESULTS

Within- and between-learner group differences among 125 identified tools were investigated. In terms of content, the largest proportion of tools for academic-level learners pertained to anatomy and physiology (60/214, 28%), and that for clinical-professional learners pertained to diagnostic evaluation (47/185, 25.4%). Between groups, the largest differences were observed for anatomy and physiology (academic-level learners: 60/86, 70%; clinical-professional learners: 26/86, 30%) and professional issues (8/28, 29% vs 20/28, 71%). With regard to learning goals, most tools for academic-level learners targeted the performance of procedural skills (50/98, 51%), and those for clinical-professional learners targeted receptive information acquisition (44/62, 71%). Academic-level learners had more tools for supporting higher-level learning goals than clinical-professional learners, specifically tools for performing procedural skills (50/66, 76% vs 16/66, 24%) and strategic skills (8/10, 80% vs 2/10, 20%). Visual formats (eg, pictures or diagrams) were dominant across both learner groups. The greatest between-group differences were observed for interactive formats (45/66, 68% vs 21/66, 32%).

CONCLUSIONS

This investigation provides initial insights into openly accessible tools across SLP, phoniatrics, and otolaryngology and their organizing structures. Digital tools in these fields addressed diverse content, although the tools for academic-level learners were greater in number, targeted higher-level learning goals, and had more interactive formats than those for clinical-professional learners. The crucial next steps include investigating the actual use of such tools in practice and students' and professionals' attitudes to better improve upon such tools and incorporate them into current and future learning milieus.

Education in the placement of ultrasound-guided peripheral venous catheters: a systematic review

BACKGROUND

Placing a peripheral vein catheter can be challenging due to several factors, but using ultrasound as guidance increases the success rate. The purpose of this review is to investigate the knowledge already existing within the field of education in ultrasound-guided peripheral vein catheter placement and explore the efficacy and clinical impact of different types of education.

METHODS

In accordance with PRISMA-guidelines, a systematic search was performed using three databases (PubMed, EMBASE, CINAHL). Two reviewers screened titles and abstracts, subsequently full-text of the relevant articles. The risk of bias was assessed using the Cochrane Collaboration risk of bias assessment tool and the New Ottawa scale.

RESULTS

Of 3409 identified publications, 64 were included. The studies were different in target learners, study design, assessment tools, and outcome measures, which made direct comparison difficult. The studies addressed a possible effect of mastery learning and found e-learning and didactic classroom teaching to be equally effective.

CONCLUSION

Current studies suggest a potential benefit of ultrasound guided USG-PVC training on success rate, procedure time, cannulation attempts, and reducing the need for subsequent CVC or PICC in adult patients. An assessment tool with proven validity of evidence to ensure competence exists and education strategies like mastery learning, e-learning, and the usage of color Doppler show promising results, but an evidence-based USG-PVC-placement training program using these strategies combined is still warranted.

[Education for resuscitation]

Diese Leitlinien des European Resuscitation Council basieren auf dem internationalen wissenschaftlichen Konsens 2020 zur kardiopulmonalen Reanimation mit Behandlungsempfehlungen (International Liaison Committee on Resuscitation 2020 International Consensus on Cardiopulmonary Resuscitation Science with Treatment Recommendations [ILCOR] 2020 CoSTR). Dieser Abschnitt bietet Bürgern und Angehörigen der Gesundheitsberufe Anleitungen zum Lehren und Lernen der Kenntnisse, der Fertigkeiten und der Einstellungen zur Reanimation mit dem Ziel, das Überleben von Patienten nach Kreislaufstillstand zu verbessern.

Skeptical self-regulation: Resident experiences of uncertainty about uncertainty

OBJECTIVES

Managing uncertainty is central to expert practice, yet how novice trainees navigate these moments is likely different than what has been described by experienced clinicians. Exploring trainees' experiences with uncertainty could therefore help explicate the unique cues that they attend to, how they appraise their comfort in these moments and how they enact responses within the affordances of their training environment.

METHODS

Informed by constructivist grounded theory, we explored how novice emergency medicine trainees experienced and managed clinical uncertainty in practice. We used a critical incident technique to prompt participants to reflect on experiences with uncertainty immediately following a clinical shift, exploring the cues they attended to and the approaches they used to navigate these moments. Two investigators coded line-by-line using constant comparison, organising the data into focused codes. The research team discussed the relationships between these codes and developed a set of themes that supported our efforts to theorise about the phenomenon.

RESULTS

We enrolled 13 trainees in their first two years of postgraduate training across two institutions. They expressed uncertainty about the root causes of the patient problems they were facing and the potential management steps to take, but also expressed a pervasive sense of uncertainty about their own abilities and their appraisals of the situation. This, in turn, led to challenges with selecting, interpreting and using the cues in their environment effectively. Participants invoked several approaches to combat this sense of uncertainty about themselves, rehearsing steps before a clinical encounter, checking their interpretations with others and implicitly calibrating their appraisals to those of more experienced team members.

CONCLUSIONS

Trainees' struggles with the legitimacy of their interpretations impact their experiences with uncertainty. Recognising these ongoing struggles may enable supervisors and other team members to provide more effective scaffolding, validation and calibration of clinical judgments and patient management.

Workplace-based assessments of entrustable professional activities in a psychiatry core clerkship: an observational study

BACKGROUND

Entrustable professional activities (EPAs) in competency-based, undergraduate medical education (UME) have led to new formative workplace-based assessments (WBA) using entrustment-supervision scales in clerkships. We conducted an observational, prospective cohort study to explore the usefulness of a WBA designed to assess core EPAs in a psychiatry clerkship.

METHODS

We analyzed changes in self-entrustment ratings of students and the supervisors' ratings per EPA. Timing and frequencies of learner-initiated WBAs based on a prospective entrustment-supervision scale and resultant narrative feedback were analyzed quantitatively and qualitatively. Predictors for indirect supervision levels were explored via regression analysis, and narrative feedback was coded using thematic content analysis. Students evaluated the WBA after each clerkship rotation.

RESULTS

EPA 1 ("Take a patient's history"), EPA 2 ("Assess physical & mental status") and EPA 8 ("Document & present a clinical encounter") were most frequently used for learner-initiated WBAs throughout the clerkship rotations in a sample of 83 students. Clinical residents signed off on the majority of the WBAs (71%). EPAs 1, 2, and 8 showed the largest increases in self-entrustment and received most of the indirect supervision level ratings. We found a moderate, positive correlation between self-entrusted supervision levels at the end of the clerkship and the number of documented entrustment-supervision ratings per EPA (p < 0.0001). The number of entrustment ratings explained 6.5% of the variance in the supervisors' ratings for EPA 1. Narrative feedback was documented for 79% (n = 214) of the WBAs. Most narratives addressed the Medical Expert role (77%, n = 208) and used reinforcement (59%, n = 161) as a feedback strategy. Students perceived the feedback as beneficial.

CONCLUSIONS

Using formative WBAs with an entrustment-supervision scale and prompts for written feedback facilitated targeted, high-quality feedback and effectively supported students' development toward self-entrusted, indirect supervision levels.

European Resuscitation Council Guidelines 2021: Education for resuscitation

These European Resuscitation Council education guidelines, are based on the 2020 International Consensus on Cardiopulmonary Resuscitation Science with Treatment Recommendations. This section provides guidance to citizens and healthcare professionals with regard to teaching and learning the knowledge, skills and attitudes of resuscitation with the ultimate aim of improving patient survival after cardiac arrest.

Health management students' self-regulation and digital concept mapping in online learning environments

BACKGROUND

Self-regulation of learning is considered one of the key capabilities deemed essential for the healthcare system and its workers to cope successfully with the current challenges they are facing. Therefore, healthcare curricula are increasingly called upon to support self-regulation as a central learning outcome. With scant relevant publications describing how students of medicine and other healthcare professions regulate their learning, this study set out to design and assess a problem-based learning using digital concept mapping in an online course and to evaluate the set of connections between this intervention and Health Management students' self-regulation of learning.

METHOD

Students of a Management of Health Service Organizations program (100) were presented with an ill-structured problem, relevant to their course content (accreditation process within hospitals) and were asked to argue for or against the implementation of the accreditation process. The participants were asked to detail five arguments to establish their decision by using Mindomo, a popular digital platform for designing concept maps. The students were given predefined criteria that allowed them to self-assess their maps. Data for the analysis were gathered by two measurements: Concept mapping for problem-based learning scale and the Online self-regulated learning scale and were analyzed by using Partial Least Squares - Structural Equation Modeling.

RESULTS

The analyses showed that at the beginning of the process, students' online self-regulation was found lower than at the end of the intervention, and only two self-regulation sub-factors: Goal setting and Task strategies, were positively linked to students' perceptions of the intervention. After the intervention, the analyses showed that it increased the levels of four Online self-regulation sub-factors: Goal setting, Task strategies, Environment structuring, and Time management.

CONCLUSIONS

Teachers need to recognize and account for different types of learners and encourage and scaffold students' effective use of self-regulation strategies. Low self-regulated learners might fail to see the advantages of concept mapping in problem-solving activities. Combining these teaching and learning tools together with the use of advanced technology in an online course that encourages active learning enables the development and acquisition of abilities of self-directed learning among students in the medical and health management professions.

How supervision and educational supports impact medical students' preparation for future learning of endotracheal intubation skills: a non-inferiority experimental trial

BACKGROUND

Professional education cannot keep pace with the rapid advancements of knowledge in today's society. But it can develop professionals who can. 'Preparation for future learning' (PFL) has been conceptualized as a form of transfer whereby learners use their previous knowledge to learn about and adaptively solve new problems. Improved PFL outcomes have been linked to instructional approaches targeting learning mechanisms similar to those associated with successful self-regulated learning (SRL). We expected training that includes evidence-based SRL-supports would be non-inferior to training with direct supervision using the outcomes of a 'near transfer' test, and a PFL assessment of simulated endotracheal intubation skills.

METHOD

This study took place at the University of Toronto from October 2014 to August 2015. We randomized medical students and residents (n = 54) into three groups: Unsupervised, Supported; Supervised, Supported; and Unsupervised, Unsupported. Two raters scored participants' test performances using a Global Rating Scale with strong validity evidence. We analyzed participants' near transfer and PFL outcomes using two separate mixed effects ANCOVAs.

RESULTS

For the Unsupervised, Supported group versus the Supervised, Supported group, we found that the difference in mean scores was 0.20, with a 95% Confidence Interval (CI) of - 0.17 to 0.57, on the near transfer test, and was 0.09, with a 95% CI of - 0.28 to 0.46, on the PFL assessment. Neither mean score nor their 95% CIs exceeded the non-inferiority margin of 0.60 units. Compared to the two Supported groups, the Unsupervised, Unsupported group was non-inferior on the near transfer test (differences in mean scores were 0.02 and - 0.22). On the PFL assessment, however, the differences in mean scores were 0.38 and 0.29, and both 95% CIs crossed the non-inferiority margin.

CONCLUSIONS

Training with SRL-supports was non-inferior to training with a supervisor. Both interventions appeared to impact PFL assessment outcomes positively, yet inconclusively when compared to the Unsupervised and Unsupported group, By contrast, the Unsupervised, Supported group did not score well on the near transfer test. Based on the observed sensitivity of the PFL assessment, we recommend researchers continue to study how such assessments may measure learners' SRL outcomes  during structured learning experiences.

Self-Efficacy, Academic Motivation, and Self-Regulation: How Do They Predict Academic Achievement for Medical Students?

PURPOSE

Self-efficacy, academic motivation, and self-regulation have been identified as important factors contributing to students' learning success in general education. In the field of medical education, however, few studies have examined these variables or their interrelationships as predictors of undergraduate medical students' learning outcomes, especially in the context of flipped learning.

METHODS

Using structural equation modeling (SEM), this study explored the impact of self-efficacy on 146 first- and second-year medical students' academic achievement in a flipped-learning environment, and whether such impact (if any) was mediated by academic motivation and self-regulated learning (SRL) strategies.

RESULTS

On average, students scored highest on self-efficacy (mean = 5 out of a possible 7), followed by intrinsic motivation (mean = 4.59), resource-management strategies (mean = 4.48), metacognitive strategies (mean = 4.46), extrinsic motivation (mean = 4.24), and cognitive strategies (mean = 4.17). Our SEM results suggest that, while there was a direct effect of self-efficacy on learning outcomes, academic motivation and SRL strategies did not mediate it.

CONCLUSIONS

By unpacking the structural relationships among self-efficacy, academic motivation, SRL strategies, and learning outcomes, this study provides evidence-based support for the importance of promoting students' self-efficacy in undergraduate medical flipped-learning environments. Strategies for increasing students' self-efficacy are also discussed.

Limited effects from professional identity formation-oriented intervention on self-regulated learning in a preclinical setting: a randomized-controlled study in Japan

BACKGROUND

Developing self-regulated learning in preclinical settings is important for future lifelong learning. Previous studies indicate professional identity formation, i.e., formation of self-identity with internalized values and norms of professionalism, might promote self-regulated learning. We designed a professional identity formation-oriented reflection and learning plan format, then tested effectiveness on raising self-regulated learning in a preclinical year curriculum.

METHODS

A randomized controlled crossover trial was conducted using 112 students at Jichi Medical University. In six one-day problem-based learning sessions in a 7-month pre-clinical year curriculum, Groups A (n = 56, female 18, mean age 21.5y ± 0.7) and B (n = 56, female 11, mean age 21.7y ± 1.0) experienced professional identity formation-oriented format: Group A had three sessions with the intervention format in the first half, B in the second half. Between-group identity stages and self-regulated learning levels were compared using professional identity essays and the Motivated Strategies for Learning Questionnaire.

RESULTS

Two-level regression analyses showed no improvement in questionnaire categories but moderate improvement of professional identity stages over time (R2 = 0.069), regardless of timing of intervention.

CONCLUSIONS

Professional identity moderately forms during the pre-clinical year curriculum. However, neither identity nor self-regulated learning is raised significantly by limited intervention.

Characteristics and quality of rotation-specific resident learning goals: a prospective study

Background: Residents are expected to develop the skills to set learning goals. Setting learning goals is part of self-regulated learning, setting the foundation for creating a learning plan, deploying learning strategies, and assessing their progress to those goals. While effective goal setting is essential to resident self-regulated learning, residents struggle with setting learning goals and desire faculty assistance with goal setting.Objective: We aimed to characterize the topics and quality of residents' rotation-specific learning goals.Design: We conducted a prospective study of 153 internal medicine residents, assessing 455 learning goals for general medicine inpatient rotations. We coded learning goal themes, competencies, and learning domains, and assessed quality using the validated Learning Goal Scoring Rubric. We compared topic categories, competencies, learning domains, and quality between the first and second months of postgraduate (PGY)-1 residents and between PGY-1 and PGY-3 residents. We assessed factors associated with learning goal completion.Results: The overall response rate was 80%. The top three learning goal categories were patient management, specific diseases related to general medicine, and teaching skills. There were no changes in learning goal characteristics between PGY-1 months (p ≥ 0.04). There were differences between PGY-1 and PGY-3 residents' learning goals in patient management (28% vs 6%; p < .001), specific disease conditions (19% vs 3%; p < .001), and teaching skills (2% vs 56%; p < .001). There was no difference in learning goal quality between PGY-1 months (1.63 vs. 1.67; p = 0.82). The PGY-3 learning goals were of higher quality than PGY-1 learning goals for the 'specific goal' item (1.38 vs. 0.98, p = 0.005), but not for other items or overall (all p ≥ 0.02). Residents reported 85% (297/347) learning goal completion.Conclusions: Resident rotation-specific learning goals reflect a broad array of topics. Residents' learning goal quality was low and residents may benefit from guidance to support residents' learning goals.

Resident learning trajectories in the workplace: A self-regulated learning analysis

CONTEXT

Research in workplace learning has emphasised trainees' active role in their education. By focusing on how trainees fine-tune their strategic learning, theories of self-regulated learning (SRL) offer a unique lens to study workplace learning. To date, studies of SRL in the workplace tend to focus on listing the factors affecting learning, rather than on the specific mechanisms trainees use to regulate their goal-directed activities. To inform the design of workplace learning interventions that better support SRL, we asked: How do residents navigate their exposure to and experience performing invasive procedures in intensive care units?

METHODS

In two academic hospitals, we conducted post-call debriefs with residents coming off shift and later sought their elaborated perspectives via semi-structured interviews. We used a constant comparative methodology to analyse the data, to iteratively refine data collection, and to inform abductive coding of the data, using SRL principles as sensitising concepts.

RESULTS

We completed 29 debriefs and nine interviews with 24 trainees. Participants described specific mechanisms: identifying, creating, avoiding, missing and competing for opportunities to perform invasive procedures. While using these mechanisms to engage with procedures (or not), participants reported: distinguishing trajectories (i.e. becoming attuned to task-relevant factors), navigating trajectories (i.e. creating and interacting with opportunities to perform procedures), and co-constructing trajectories with their peers, supervisors and interprofessional team members.

CONCLUSIONS

We identified specific SRL mechanisms trainees used to distinguish and navigate possible learning trajectories. We also confirmed previous findings, including that trainees become attuned to interactions between personal, behavioural and environmental factors (SRL theory), and that their resulting learning behaviours are constrained and guided by interactions with peers, supervisors and colleagues (workplace learning theory). Making learning trajectories explicit for clinician teachers may help them support trainees in prioritising certain trajectories, in progressing along each trajectory, and in co-constructing their plans for navigating them.

Modification of the self-regulated strategy inventory-self report for blended and team-based learning

INTRODUCTION

One of the primary missions of pharmacy education is to produce graduates with the foundations to develop into expert practitioners through continuous learning and reflection upon traditional and clinical experiences. This reflection process and the use of effective strategies to meet specific learning goals can be considered a form of self-regulated learning (SRL). The following study validates an inventory to assess SRL strategies in blended and team-based learning (TBL) environments.

METHODS

A SRL strategy inventory was developed based upon the Self-Regulated Strategies Inventory-Self-Report (SRSI-SR) and new items designed for blended and TBL environments. Sixteen new items focused on leveraging the team to learn content, the use and misuse of video lectures and slides, and interaction with social media and the learning management system. Two hundred and thirty doctor of pharmacy students in the third professional year participated in the study. Twenty-eight items from the SRSI-SR and 16 new items were examined through a principal components analysis (PCA).

RESULTS

The PCA indicated three distinct components; managing learning environment, maladaptive learning strategies, and seeking and learning information. The total inventory accounted for 46.36% of the score. Maladaptive learning strategies scores were moderately predictive of poor academic achievement in didactic coursework.

CONCLUSIONS

The following study demonstrates the importance of reexamination and adaptation of educational inventories such as the SRSI-SR. This study provides specific insight into what maladaptive strategies may be limiting underperforming students from achieving greater success and mastery in the didactic curriculum.

A case for feedback and monitoring assessment in competency-based medical education

PURPOSE

Within competency-based medical education, self-regulated learning (SRL) requires residents to leverage self-assessment and faculty feedback. We sought to investigate the potential for competency-based assessments to foster SRL by quantifying the relationship between faculty feedback and entrustment ratings as well as the congruence between faculty assessment and resident self-assessment.

MATERIALS AND METHODS

We collected comments in (a) an emergency medicine objective structured clinical examination group (objective structured clinical examinations [OSCE] and emergency medicine OSCE group [EMOG]) and (b) a first-year resident multidisciplinary resuscitation "Nightmares" course assessment group (NCAG) and OSCE group (NOG). We assessed comments across five domains including Initial Assessment (IA), Diagnostic Action (DA), Therapeutic Action (TA), Communication (COM), and entrustment. Analyses included structured qualitative coding and (non)parametric and descriptive analyses.

RESULTS

In the EMOG, faculty's positive comments in the entrustment domain corresponded to lower entrustment score Mean Ranks (MRs) for IA (<11.1), DA (<11.2), and entrustment (<11.6). In NOG, faculty's negative comments resulted in lower entrustment score MRs for TA (<11.8 and <10) and DA (<12.4), and positive comments resulted in higher entrustment score MRs for IA (>15.4) and COM (>17.6). In the NCAG, faculty's positive IA comments were negatively correlated with entrustment scores (ρ = -.27, P = .04). Across programs, faculty and residents made similar domain-specific comments 13% of the time.

CONCLUSIONS

Minimal and inconsistent associations were found between narrative and numerical feedback. Performance monitoring accuracy and feedback should be included in assessment validation.

Using a self-regulated learning-enhanced video feedback educational intervention to improve junior doctor prescribing

Introduction: Medical school graduates in the UK consistently report feeling underprepared for the task of prescribing when embarking on practice. The effective application of self-regulated learning (SRL) approaches and feedback on complex tasks are associated with improved outcomes in practice-based clinical skills.Aims: This study aimed to investigate the effectiveness of an educational intervention using SRL-enhanced video feedback for improving the prescribing competency of junior doctors.Methods: A prospective cohort study was designed to compare intervention and control cohorts of junior doctors undertaking simulated clinical encounters at the beginning and end of their 4-month rotation through renal medicine.Results: The improvement in prescribing competency for the intervention cohort was significant (p < 0.001) with large effect size (d = 1.42). Self-efficacy improved in both cohorts with large (control cohort p = 0.026, r= 0.64) and medium (intervention cohort p = 0.083, d = 0.55) effect sizes. Goal setting and self-monitoring skills improved in the intervention cohort only with medium effect size (p = 0.096, d = 0.53).Conclusions: SRL-enhanced video feedback is effective for improving prescribing competency and developing SRL processes such as goal setting and self-monitoring skills in simulated clinical encounters. Further research is required to evaluate transferability to other clinical sub-speciality contexts and investigate the effectiveness of the intervention for improving prescribing in non-simulated settings.

The nature of learning from simulation: Now I know it, now I'll do it, I'll work on that

CONTEXT

Ongoing learning in complex clinical environments requires health professionals to assess their own performance, manage their learning, and modify their practices based on self-monitored progress. Self-regulated learning (SRL) theory suggests that although learners may be capable of such learning, they often need guidance to enact it effectively. Debriefings following simulation may be an ideal time to support learners' use of SRL in targeted areas, but the extent to which they are optimally fostering these practices has not been examined.

METHODS

A qualitative study informed by grounded theory methodology was conducted in the context of three interprofessional in situ trauma simulations at our level 1 trauma centre. A total of 18 participants were interviewed both immediately and 5-6 weeks after the simulation experience. Transcripts were analysed using an iterative constant comparative approach to explore concepts and themes regarding the nature of learning from and after simulation.

RESULTS

During initial interviews, there were many examples of acquired content knowledge and straightforward practice changes that might not require ongoing SRL to enact well in practice. However, even for skills identified as needing to be 'worked on,' SRL strategies were lacking. At follow-up interviews, some participants had evolved more specific learning goals and rudimentary plans for implementation and improvement, but suggested this was prompted by the study interview questions rather than the simulation debriefing itself.

CONCLUSIONS

Overall, participants did not engage in fulsome development of SRL plans based on the simulation and debriefing; however, there were elements of SRL present, particularly after participants were given time to reflect on the interview questions and their own goals. This suggests that simulation training can support the use of SRL. However, debriefing approaches might be better optimised to take full advantage of the opportunity to encourage and foster SRL in practice after the simulation is over.

A Comparison of Guided Video Reflection versus Self-Regulated Learning to Teach Knot Tying to Medical Students: A Pilot Randomized Controlled Trial

OBJECTIVES

Self-regulated learning has been proposed as a resource saving alternative for learning knot tying. However, this may be hindered by the Dunning-Kruger effect. A potential alternative is guided video reflection. The objectives of this study are to compare the performance and self-assessment abilities amongst medical students learning knot tying using either a traditional self-regulated approach versus guided video reflection.

DESIGN

This randomized, single-blinded, controlled trial used a pre-post-retention test design. All knot tying performances were video recorded and assessed nonsequentially by blinded evaluators using a modified Objective Structured Assessment of Technical Skills tool.

PARTICIPANTS

This study recruited 31 first- and second-year medical students and 6 senior urology residents from Western University in Canada.

RESULTS

At baseline, the performances of the experts were significantly higher than the experimental groups (F_3,85 = 9.080, p < 0.001). After the intervention, there was a significant increase in the performance for both experimental groups compared to the pretest period (p < 0.001). The scores between the experimental groups were not significantly different (p = 0.338). The improved performances of both groups were sustained on retention testing (p < 0.001). The self-assessment abilities were accurate for both experimental groups at baseline. However, at the post-test period the accuracy was poor (interclass correlation 0.361) for the self-regulated group, while remaining moderately (interclass correlation 0.685) accurate for the reflection group.

CONCLUSIONS

Students using guided video reflection were able to achieve competency and maintained their knot tying skills to the same degree as those who used the self-regulated approach. These results may be due to the positive effects of reflection on self-assessment abilities and subsequent improvement in goal setting for further practice.

Clerkship students' use of a video library for training the mental status examination

Aim: Fewer patient encounters and diminished bedside teaching pose a challenge to medical students' opportunity to learn during clinical clerkships in psychiatry. Videos can be used for close examination of signs and symptoms and to increase engagement and recall. A video library holding recordings of psychiatric patients with mental status examinations were prepared. We explored the students' use of this library during their clerkships.Methods and materials: The video library was introduced to three rotations of medical students and made accessible on hospital computers. Four students volunteered as key informants and were followed daily throughout the clerkship by the first author, using the ethnographic method of participant observation. At the end of the clerkship, group interviews were conducted with each rotation of students, including the key informants. Twelve students participated in the study. Field notes taken during participant observation and the transcribed interviews were merged in a thematic analysis.Results: The analysis reveals the students' autonomous and arbitrary use of the video library. Creatively extending the use of the videos, they scheduled their video sessions according to their individual needs. The students furthermore blended experiences gained from the library and in the ward, thus coping in various ways with the shortcomings of the video library.Conclusions: The medical students felt they benefited from the simplified learning situation offered by the video library. Their frequent shortcuts through the videos during sessions highlighted weaknesses in the feedback and reflection processes occasioned by the library.

Beyond the self: The role of co-regulation in medical students' self-regulated learning

CONTEXT

Medical students are expected to self-regulate their learning within complex and unpredictable clinical learning environments. Research increasingly focuses on the effects of social interactions on the development of self-regulation in workplace settings, a notion embodied within the concept of co-regulated learning (CRL). Creating workplace learning environments that effectively foster lifelong self-regulated learning (SRL) requires a deeper understanding of the relationship between CRL and SRL. The aim of this study was therefore to explore medical students' perceptions of CRL in clinical clerkships and its perceived impact on the development of their SRL.

METHODS

We conducted semi-structured interviews with 11 purposively sampled medical students enrolled in clinical clerkships at one undergraduate competency-based medical school. Data collection and analysis were conducted iteratively, informed by principles of constructivist grounded theory. Data analysis followed stages of open, axial and selective coding, which enabled us to conceptualise how co-regulation influences the development of students' self-regulation.

RESULTS

Data revealed three interrelated shifts in CRL and SRL as students progressed through clerkships. First, students' CRL shifted from a focus on peers to co-regulation with clinician role models. Second, self-regulated behaviour shifted from being externally driven to being internally driven. Last, self-regulation shifted from a task-oriented approach towards a more comprehensive approach focusing on professional competence and identity formation. Students indicated that if they felt able to confidently and proactively self-regulate their learning, the threshold for engaging others in meaningful CRL seemed to be lowered, enhancing further development of SRL skills.

CONCLUSIONS

Findings from the current study emphasise the notion that SRL and its development are grounded in CRL in clinical settings. To optimally support the development of students' SRL, we need to focus on facilitating and organising learners' engagement in CRL from the start of the medical curriculum.

Exploring the Cultivation of Self-Regulated Learning (SRL) Strategies Among Pre-Clinical Medical Students in Two Medical Schools

PURPOSE

Research has shown that many undergraduate students struggle with self-regulated learning (SRL) in clinical year as they are insufficiently supported by the staff in the early year to prepare them for the transition. Hence, this study aims to find out the SRL strategies and the approaches that could promote SRL among pre-clinical students in two medical schools.

METHOD

This is a mixed-method study. The Motivated Strategies for Learning Questionnaire (MSLQ) was used to collect student SRL strategies while semi-structured interviews with faculty members and focus group discussions with students were used to gather data on the approaches that promote SRL. Student MSLQ was analysed using descriptive statistics while interviews were transcribed verbatim and thematically analysed.

RESULTS

A pilot using MSLQ with 413 students recorded a Cronbach's alpha of 0.928 for the questionnaire. The actual study involved 457 Years 1 & 2 students. Students from both institutions are motivated by the Task Value, and they use Elaboration and Organisation strategies the most in their pre-clinical year. Three themes emerged from the qualitative analysis of this study: characteristics of strategies that promote SRL, hindrance in promoting SRL, and opportunities in promoting SRL.

CONCLUSIONS

Our findings indicate that students' intrinsic motivation is generally high in pre-clinical year. However, metacognition and critical thinking strategies will need to be enhanced among students. Despite knowing teaching and learning approaches could promote these strategies, many teachers are still not confident in doing so and hence training dang sharing best practices might be helpful in promoting SRL.

Nomograms Predicting Self-Regulated Learning Levels in Chinese Undergraduate Medical Students

Purpose

The purpose of this study was to construct a multi-center cross-sectional study to predict self-regulated learning (SRL) levels of Chinese medical undergraduates.

Methods

We selected medical undergraduates by random sampling from five universities in mainland China. The classical regression methods (logistic regression and Lasso regression) and machine learning model were combined to identify the most significant predictors of SRL levels. Nomograms were built based on multivariable models. The accuracy, discrimination, and generalization of our nomograms were evaluated by the receiver operating characteristic curves (ROC) and the calibration curves and a high quality external validation.

Results

There were 2052 medical undergraduates from five universities in mainland China initially. The nomograms constructed based on the non-overfitting multivariable models were verified by internal validation (C-index: learning motivation: 0.736; learning strategy: 0.744) and external validation (C-index: learning motivation: 0.986; learning strategy: 1.000), showing decent prediction accuracy, discrimination, and generalization.

Conclusion

Comprehensive nomograms constructed in this study were useful and convenient tools to evaluate the SRL levels of undergraduate medical students in China.

Beyond 'driving': The relationship between assessment, performance and learning

OBJECTIVE

Is the statement 'assessment drives learning' a myth?

BACKGROUND

Instructors create assessments and students respond to these assessments. Although such responses are often labelled indications of learning, the responses educators observe can also be considered a performance. When responses are aligned with generating stable changes, then assessment drives learning. When responses are not aligned with stable changes, we must consider them to be something else: a performance put on partially or fully for the sake of implying capability rather than actual learning. The alignment between the assessments educators create and the way students respond to these assessments is determined by the actions students take in our curriculum, in preparation for our assessments and after engaging with our assessments.

CONCLUSIONS

Not all assessments need to or should support learning, but when we assume all assessments 'drive learning', we endorse the myth that assessment is necessarily a formative aspect of our curricula. When we create assessments that encourage performance activities such as cramming, competing for tutorial airtime and impression management in the clinical setting we drive students to a performance. By thinking about how our students, institutions, curricula and assessments support learning and how well they support performance, we can modify and more fully align our curricular and assessment efforts to support learners in achieving their (and our) desired outcome. So, is the phrase 'assessment drives learning' a myth? This paper will conclude that it often is but we as educators must, through our leadership, move this myth towards a reality.

Prompting medical students to self-assess their learning needs during the ageing and health module: a mixed methods study

Understanding our learning needs is fundamental for safe, effective and knowledge-based medical practice and facilitates life-long learning. A mixed methods study investigated fourth-year medical students' self-perceived understanding of their learning needs using 1] a visual scale, before and after a four-week module in Ageing and Health (A&H) and 2] through focus group discussions. During 2013-14 academic year, all students (252) were invited to use a Visual Analogue Scale (VAS) tool to self-assess their learning needs that were linked to Ageing and Health curriculum learning outcomes. Assenting students (197 at pre-self-assessment, 201 at post-assessment) returned anonymous Visual Analogue Scales, self-assessing history-taking skills, examination skills, knowledge of medication use, co-morbidity, nutritional and swallowing assessment responses, before and after the A&H module. Three student focus groups explored whether completion of the VAS self-assessment had prompted improved self-awareness of their learning needs. The VAS responses increased for each curriculum domain with significant differences between the pre-and post responses - for the student-year-group. Nutritional and swallowing knowledge showed the greatest improvement from a self-assessed low baseline at entry. Focus-group students generally viewed the VAS tool positively, and as an aid for prompting consideration of current and future clinical practice. Some students recognised that 'a need to be ready-for-work' focused engaged learning; others demonstrated self-regulated learning through self-motivation and an action plan. The Visual Analogue Scale quantitative responses showed increased student-self-perceived learning for each curriculum domain at fourth-year completion of the A&H module, suggesting that prompting self-assessment had increased students' knowledge and skills. Focus group students saw the VAS tool as useful for prompting awareness of their current and future learning needs. Additional educational strategies should be explored to enable all students to self-reflect and engage effectively on their learning needs, to gain the skills for the maintenance of professional medical competence. Abbreviations: A&H: Ageing and Health Module; e-portfolio: an electronic version of an evidence portfolio, which allows medical students and graduates to reflect and document learning and competencies; F1: year1 of post-graduate medical clinical training; GMC: General Medical Council-the regulation organisation for maintaining standards for doctors in UK; Logbook: usually a written document which can be used to record procedures and attendance at clinics or case-based discussions and can be used to set learning outcomes and to structure teaching in clinical settings for medical students and doctors; PDP: personal development plan is used to plan future learning and skills needs for work and education with an plan for action/s outcome; SPSS: Statistical Package for the Social Sciences; VAS: Visual Analogue Scale is a visual method of describing an experience.

Learning Cardiac Embryology-Which Resources Do Students Use, and Why?

With increasing class sizes, small group activities for learning embryology are present in few institutions. How then do students supplement their lectures in order to ask and answer questions, or delve into concepts in detail? Arguably, animations and videos are ideal for visualizing four-dimensional anatomy, but how do students find and filter these? First-year medical students were surveyed with respect to the cardiac embryology component of their course and asked their opinions regarding the clinical relevance of this content and the resources they used to enhance learning. Students indicated that they considered cardiac embryology to be of relevance to clinical practice and that videos are a useful resource in helping them to learn this material. However, when seeking videos or resources, it emerged that students tended to Google information in preference to accessing online resources (or textbooks) specifically recommended by their instructor, despite students' recognition that "accuracy of information" was paramount when choosing what resource to use. While all students seemed reluctant to contact a staff member with questions, those with less proficiency in English were less likely to approach faculty for assistance. While acknowledging students as adult learners, self-regulated learning skills do not develop automatically and the development of these skills should be viewed as a "shared responsibility" between students and staff. Likewise, students also need to be taught critical appraisal of learning resources, especially in the complex online environment, with design of their bespoke institutional virtual learning environment facilitating easy identification and access of recommended resources.

Evaluating learning and change in orthopaedics: What is the evidence-base?

Learning and change are key elements of clinical governance and are responsible for the progression of our specialty. Although orthopaedics has been slow to embrace quality improvement, recent years have seen global developments in surgical education, quality improvement, and patient outcome research. This review covers recent advances in the evaluation of learning and change and identifies the most important research questions that remain unanswered. Research into proxies of learning is improving but more work is required to identify the best proxy for a given procedure. Learning curves are becoming commonplace but are poorly integrated into postgraduate training curricula and there is little agreement over the most appropriate method to analyse learning curve data. With various organisations promoting centralisation of care, learning curve analysis is more important than ever before. The use of simulation in orthopaedics is developing but is yet to be formally mapped to resident training worldwide. Patient outcome research is rapidly changing, with an increased focus on quality of life measures. These are key to patients and their care. Cost-utility analysis is increasingly seen in orthopaedic manuscripts and this needs to continue to improve evidence-based care. Large-scale international, multi-centre randomised trials are gaining popularity and updated guidance on sample size estimation needs to become widespread. A global lack of surgeon equipoise will need to be addressed. Quality improvement projects frequently employ interrupted time-series analysis to evaluate change. This technique's limitations must be acknowledged, and more work is required to improve the evaluation of change in a dynamic healthcare environment where multiple interventions frequently occur. Advances in the evaluation of learning and change are needed to drive improved international surgical education and increase the reliability, validity, and importance of the conclusions drawn from orthopaedic research.

First-year medical students' calibration bias and accuracy across clinical reasoning activities

To be safe and effective practitioners and learners, medical professionals must be able to accurately assess their own performance to know when they need additional help. This study explored the metacognitive judgments of 157 first-year medical students; in particular, the study examined students' self-assessments or calibration as they engaged in a virtual-patient simulation targeting clinical reasoning practices. Examining two key subtasks of a patient encounter, history (Hx) and physical exam (PE), the authors assessed the level of variation in students' behavioral performance (i.e., effectiveness and efficiency) and judgments of performance (i.e., calibration bias and accuracy) across the two subtasks. Paired t tests revealed that the Hx subtask was deemed to be more challenging than the PE subtask when viewed in terms of both actual and perceived performance. In addition to students performing worse on the Hx subtask than PE, they also perceived that they performed less well for Hx. Interestingly, across both subtasks, the majority of participants overestimated their performance (98% of participants for Hx and 95% for PE). Correlation analyses revealed that the participants' overall level of accuracy in metacognitive judgments was moderately stable across the Hx and PE subtasks. Taken together, findings underscore the importance of assessing medical students' metacognitive judgments at different points during a clinical encounter.