Developing the master learner: applying learning theory to the learner, the teacher, and the learning environment

Student teacher training: participant motivation

BACKGROUND

Teaching, assessment and feedback skills are documented globally as required graduate attributes for medical students. By integrating teacher training into curricula, the importance of teaching and educational scholarship is highlighted. In this study, we used self-determination theory (SDT) to consider medical students' motivation to voluntarily participate in a short teacher training programme.

METHODS

Thirty-eight senior medical students were invited to attend a teacher training programme at a major tertiary teaching hospital. Participating students were asked to respond to one question: 'Why did you volunteer to take part in the teacher training course?' Self-determination theory was used as a conceptual framework to identify and code recurrent themes in the data.

RESULTS

In total, 23/38 (61%) of invited students chose to participate in the programme, and 21/23 (91%) of the students responded to the survey. Students' motivation to participate in the teacher training programme were related to: (1) autonomy - their enjoyment of their current voluntary involvement in teaching; (2) competence - a recognition of the need for formal training and certification in teaching, and as an essential part of their future career in medicine; (3) relatedness - the joint recognition of the importance of quality in teaching, as emphasised by their own learning experiences in the medical programme.

CONCLUSION

Students reported being motivated to take part in teacher training because of their enjoyment of teaching, their desire to increase the quality of teaching within medical education, their desire for formal recognition of teaching as a learned skill, plus their recognition of teaching as a requirement within the medical profession. By integrating teacher training into curricula, the importance of teaching and educational scholarship is highlighted.

Accuracy of self-monitoring during learning of radiograph interpretation

CONTEXT

Despite calls for the improvement of self-assessment as a basis for self-directed learning, instructional designs that include reflection in practice are uncommon. Using data from a screen-based simulation for learning radiograph interpretation, we present validity evidence for a simple self-monitoring measure and examine how it can complement skill assessment.

METHODS

Medical students learning ankle radiograph interpretation were given an online learning set of 50 cases which they were asked to classify as 'abnormal' (fractured) or 'normal' and to indicate the degree to which they felt certain about their response (Definitely or Probably). They received immediate feedback on each case. All students subsequently completed two 20-case post-tests: an immediate post-test (IPT), and a delayed post-test (DPT) administered 2 weeks later. We determined the degree to which certainty (Definitely versus Probably) correlated with accuracy of interpretation and how this relationship changed between the tests.

RESULTS

Of 988 students approached, 115 completed both tests. Mean ± SD accuracy scores decreased from 59 ± 17% at the IPT to 53 ± 16% at the DPT (95% confidence interval [CI] for the difference: -2% to -10%). Mean self-assessed certainty did not decrease (rates of Definitely: IPT, 17.6%; DPT, 19.5%; 95% CI for difference: +7.2% to -3.4%). Regression modelling showed that accuracy was positively associated with choosing Definitely over Probably (odds ratio [OR] 1.63, 95% CI 1.27-2.09) and indicated a statistically significant interaction between test timing and certainty (OR 0.72, 95% CI 0.52-0.99); thus, the accuracy of self-monitoring decayed over the retention interval, leaving students relatively overconfident in their abilities.

CONCLUSIONS

This study shows that, in medical students learning radiograph interpretation, the development of self-monitoring skills can be measured and should not be assumed to necessarily vary in the same way as the underlying clinical skill.

Combining bimodal presentation schemes and buzz groups improves clinical reasoning and learning at morning report

Morning reports offer opportunities for intensive work-based learning. In this controlled study, we measured learning processes and outcomes with the report of paediatric emergency room patients. Twelve specialists and 12 residents were randomised into four groups and discussed the same two paediatric cases. The groups differed in their presentation modality (verbal only vs. verbal + text) and the use of buzz groups (with vs. without). The verbal interactions were analysed for clinical reasoning processes. Perceptions of learning and judgment of learning were reported in a questionnaire. Diagnostic accuracy was assessed by a 20-item multiple-choice test. Combined bimodal presentation and buzz groups increased the odds ratio of clinical reasoning to occur in the discussion of cases by a factor of 1.90 (p = 0.013), indicating superior reasoning for buzz groups working with bimodal materials. For specialists, a positive effect of bimodal presentation was found on perceptions of learning (p < 0.05), and for residents, a positive effect of buzz groups was found on judgment of learning (p < 0.005). A positive effect of bimodal presentation on diagnostic accuracy was noted in the specialists (p < 0.05). Combined bimodal presentation and buzz group discussion of emergency cases improves clinicians' clinical reasoning and learning.

GP supervisors' experience in supporting self-regulated learning: a balancing act

Self-regulated learning is essential for professional development and lifelong learning. As self-regulated learning has many inaccuracies, the need to support self-regulated learning has been recommended. Supervisors can provide such support. In a prior study trainees reported on the variation in received supervisor support. This study aims at exploring supervisors' perspectives. The aim is to explore how supervisors experience self-regulated learning of postgraduate general practitioners (GP) trainees and their role in this, and what helps and hinders them in supervising. In a qualitative study using a phenomenological approach, we interviewed 20 supervisors of first- and third-year postgraduate GP trainees. Supervisors recognised trainee activity in self-regulated learning and adapted their coaching style to trainee needs, occasionally causing conflicting emotions. Supervisors' beliefs regarding their role, trainees' role and the usefulness of educational interventions influenced their support. Supervisors experienced a relation between patient safety, self-regulated learning and trainee capability to learn. Supervisor training was helpful to exchange experience and obtain advice. Supervisors found colleagues helpful in sharing supervision tasks or in calibrating judgments of trainees. Busy practice occasionally hindered the supervisory process. In conclusion, supervisors adapt their coaching to trainees' self-regulated learning, sometimes causing conflicting emotions. Patient safety and entrustment are key aspects of the supervisory process. Supervisors' beliefs about their role and trainees' role influence their support. Supervisor training is important to increase awareness of these beliefs and the influence on their behaviour, and to improve the use of educational instruments. The results align with findings from other (medical) education, thereby illustrating its relevance.

Reviewing residents' competence: a qualitative study of the role of clinical competency committees in performance assessment

PURPOSE

Clinical competency committees (CCCs) are now required in graduate medical education. This study examined how residency programs understand and operationalize this mandate for resident performance review.

METHOD

In 2013, the investigators conducted semistructured interviews with 34 residency program directors at five public institutions in California, asking about each institution's CCCs and resident performance review processes. They used conventional content analysis to identify major themes from the verbatim interview transcripts.

RESULTS

The purpose of resident performance review at all institutions was oriented toward one of two paradigms: a problem identification model, which predominated; or a developmental model. The problem identification model, which focused on identifying and addressing performance concerns, used performance data such as red-flag alerts and informal information shared with program directors to identify struggling residents.In the developmental model, the timely acquisition and synthesis of data to inform each resident's developmental trajectory was challenging. Participants highly valued CCC members' expertise as educators to corroborate the identification of struggling residents and to enhance credibility of the committee's outcomes. Training in applying the milestones to the CCC's work was minimal.Participants were highly committed to performance review and perceived the current process as adequate for struggling residents but potentially not for others.

CONCLUSIONS

Institutions orient resident performance review toward problem identification; a developmental approach is uncommon. Clarifying the purpose of resident performance review and employing efficient information systems that synthesize performance data and engage residents and faculty in purposeful feedback discussions could enable the meaningful implementation of milestones-based assessment.

Found in transition: applying milestones to three unique discharge curricula

Introduction. A safe and effective transition from hospital to post-acute care is a complex and important physician competency. Milestones and Entrustable Professional Activities (EPA) form the new educational rubric in Graduate Medical Education Training. “A safe and effective discharge from the hospital” is an EPA ripe for educational innovation.

Methods. The authors collaborated in a qualitative process called mapping to define 22 of 142 Internal Medicine (IM) curricular milestones related to the transition of care. Fifty-five participant units at an Association for Program Directors in Internal Medicine (APDIM) workshop prioritized the milestones, using a validated ranking process called Q-sort. We analyzed the Q-sort results, which rank the milestones in order of priority. We then applied this ranking to three innovative models of training IM residents in the transitions of care: Simulation (S), Discharge Clinic Feedback (DCF) and TRACER (T).

Results. We collected 55 Q-sort rankings from particpants at the APDIM workshop. We then identified which milestones are a focus of the three innovative models of training in the transition of care: Simulation = 5 of 22 milestones, Discharge Clinic Feedback = 9 of 22 milestones, and TRACER = 7 of 22 milestones. Milestones identified in each innovation related to one of the top 8 prioritized milestones 75% of the time; thus, more frequently than the milestones with lower priority. Two milestones are shared by all three curricula: Utilize patient-centered education and Ensure succinct written communication. Two other milestones are shared by two curricula: Manage and coordinate care transitions across multiple delivery systems and Customize care in the context of the patient’s preferences. If you combine the three innovations, all of the top 8 milestones are included.

Discussion. The milestones give us a context to share individual innovations and to compare and contrast using a standardized frame. We demonstrate that the three unique discharge curricula in aggregate capture all of the highest prioritized milestones for this discharge EPA.

Role modelling of clinical tutors: a focus group study among medical students

BACKGROUND

Role modelling by clinicians assists in development of medical students' professional competencies, values and attitudes. Three core characteristics of a positive role model include 1) clinical attributes, 2) teaching skills, and 3) personal qualities. This study was designed to explore medical students' perceptions of their bedside clinical tutors as role models during the first year of a medical program.

METHODS

The study was conducted with one cohort (n = 301) of students who had completed Year 1 of the Sydney Medical Program in 2013. A total of nine focus groups (n = 59) were conducted with medical students following completion of Year 1. Data were transcribed verbatim. Thematic analysis was used to code and categorise data into themes.

RESULTS

Students identified both positive and negative characteristics and behaviour displayed by their clinical tutors. Characteristics and behaviour that students would like to emulate as medical practitioners in the future included: 1) Clinical attributes: a good knowledge base; articulate history taking skills; the ability to explain and demonstrate skills at the appropriate level for students; and empathy, respect and genuine compassion for patients. 2) Teaching skills: development of a rapport with students; provision of time towards the growth of students academically and professionally; provision of a positive learning environment; an understanding of the student curriculum and assessment requirements; immediate and useful feedback; and provision of patient interaction. 3) Personal qualities: respectful interprofessional staff interactions; preparedness for tutorials; demonstration of a passion for teaching; and demonstration of a passion for their career choice.

CONCLUSION

Excellence in role modelling entails demonstration of excellent clinical care, teaching skills and personal characteristics. Our findings reinforce the important function of clinical bedside tutors as role models, which has implications for faculty development and recruitment.

Innovative strategies in critical care education

The cadre of information pertinent to critical care medicine continues to expand at a tremendous pace, and we must adapt our strategies of medical education to keep up with the expansion. Differences in learners' characteristics can contribute to a mismatch with historical teaching strategies. Simulation is increasingly popular, but still far from universal. Emerging technology has the potential to improve our knowledge translation, but there is currently sparse literature describing these resources or their benefits and limitations. Directed strategies of assessment and feedback are often suboptimal. Even strategies of accreditation are evolving. This review attempts to summarize salient concepts, suggest resources, and highlight novel strategies to enhance practice and education in the challenging critical care environment.

The impact of eLearning on health professional educators' attitudes to information and communication technology

Background

The use of information and communication technology (ICT) in health professional education is increasing rapidly. Health professional educators need to be responsive to health professionals’ information and communication technological needs; however, there is a paucity of information about educators’ attitudes to, and capabilities with, ICT.

Methods

Fifty-two health professional educators, enrolled in health professional education postgraduate studies, participated in an online subject with specific eLearning components requiring the use of ICT. They completed a pre- and postquestionnaire pertaining to ICT attitudes, confidence, and usage.

Results

Participants reported significant increases in overall ICT confidence during the subject despite it being high at baseline (mean: 7.0 out of 10; P=0.02). Even with increased ICT confidence, there were decreases in the participants’ sense of ICT control when related to health professional education (P=0.002); whereas, the amount of time participants engaged with ICT devices was negatively correlated with the sense of ICT control (P=0.002). The effect of age and health discipline on ICT attitudes and confidence was not significant (P>0.05).

Conclusion

This study reports that health professional educators have perceptual deficits toward ICT. The impact of eLearning increased confidence in ICT but caused a reduction in participants’ sense of control of ICT. Health professional educators require more ICT training and support to facilitate better ICT integration in health professional education settings.

The Student Curriculum Review Team: How we catalyze curricular changes through a student-centered approach

Student feedback is a valuable asset in curriculum evaluation and improvement, but many institutions have faced challenges implementing it in a meaningful way. In this article, we report the rationale, process and impact of the Student Curriculum Review Team (SCRT), a student-led and faculty-supported organization at the Johns Hopkins University School of Medicine. SCRT's evaluation of each pre-clinical course is composed of a comprehensive three-step process: a review of course evaluation data, a Town Hall Meeting and online survey to generate and assess potential solutions, and a thoughtful discussion with course directors. Over the past two years, SCRT has demonstrated the strength of its approach by playing a substantial role in improving medical education, as reported by students and faculty. Furthermore, SCRT's uniquely student-centered, collaborative model has strengthened relationships between students and faculty and is one that could be readily adapted to other medical schools or academic institutions.

The Flipped Classroom in Medical Education: Engaging Students to Build Competency

The flipped classroom represents an essential component in curricular reform. Technological advances enabling asynchronous and distributed learning are facilitating the movement to a competency-based paradigm in healthcare education. At its most basic level, flipping the classroom is the practice of assigning students didactic material, traditionally covered in lectures, to be learned before class while using face-to-face time for more engaging and active learning strategies. The development of more complex learning systems is creating new opportunities for learning across the continuum of medical education as well as interprofessional education. As medical educators engage in the process of successfully flipping a lecture, they gain new teaching perspectives, which are foundational to effectively engage in curricular reform. The purpose of this article is to build a pedagogical and technological understanding of the flipped classroom framework and to articulate strategies for implementing it in medical education to build competency.

Elective anatomy by whole body dissection course: what motivates students?

BACKGROUND

Students' motivation provides a powerful tool to maximise learning. The reasons for motivation can be articulated in view of self-determination theory (SDT). This theory proposes that for students to be motivated and hence benefit educationally and professionally from courses, three key elements are needed: autonomy, competence, and relatedness. In this paper we apply SDT theory to consider medical students' motivation to participate throughout a 2014 optional summer intensive eight week elective anatomy by whole body dissection course. The course was designed and facilitated by surgeons, and required small group, active learning.

METHODS

At the end of the course, data were collected from all (24/24) students by means of an open ended survey questionnaire. Framework analysis was used to code and categorise data into themes.

RESULTS

Utilising self-determination theory as a theoretical framework, students' motivation and experiences of participation in the course were explored. Elements that facilitated students' motivation included the enthusiasm and expertise of the surgeons, the sense of collegiality and community within the course, the challenges of group activities, and sense of achievement through frequent assessments.

CONCLUSION

The team learning course design, and facilitation by surgeons, provided an enriched learning environment, motivating students to build on their knowledge and apply a surgical context to their learning.

The perceived effects of faculty presence vs. absence on small-group learning and group dynamics: a quasi-experimental study

BACKGROUND

Medical education increasingly relies on small-group learning. Small group learning provides more active learning, better retention, higher satisfaction, and facilitates development of problem-solving and team-working abilities. However, less is known about student experience and preference for different small groups teaching models. We evaluated group educational dynamics and group learning process in medical school clerkship small group case-based settings, with a faculty member present versus absent.

METHODS

Students completed surveys after cases when the faculty was present ("in") or absent ("out") for the bulk of the discussion. 228 paired surveys (114 pairs) were available for paired analysis, assessing group dynamics, group learning process, student preference, and participation through self-report and self-rating of group behaviors tied to learning and discussion quality.

RESULTS

Ratings of group dynamics and group learning process were significantly higher with the faculty absent vs. present (p range <0.001 to 0.015). Students also reported higher levels of participation when the faculty member was absent (p = 0.03). Students were more likely to express a preference for having the faculty member present after "in" case vs. "out" case discussions. (p < 0.001). There was no difference in reported success of the case discussion after "in" vs. "out" cases (p = 0.67).

CONCLUSIONS

Student groups without faculty present reported better group dynamics, group learning processes, and participation with faculty absent. Students reported that they feel somewhat dependent on faculty, especially when the faculty is present, though there was no significant difference in students reporting that they obtained the most they could from the discussion of the case after both "in" and "out" cases.

Putting the pediatrics milestones into practice: a consensus roadmap and resource analysis

The Accreditation Council for Graduate Medical Education has partnered with member boards of the American Board of Medical Specialties to initiate the next steps in advancing competency-based assessment in residency programs. This initiative, known as the Milestone Project, is a paradigm shift from traditional assessment efforts and requires all pediatrics residency programs to report individual resident progression along a series of 4 to 5 developmental levels of performance, or milestones, for individual competencies every 6 months beginning in June 2014. The effort required to successfully make this shift is tremendous given the number of training programs, training institutions, and trainees. However, it holds great promise for achieving training outcomes that align with patient needs; developing a valid, reliable, and meaningful way to track residents' development; and providing trainees with a roadmap for learning. Recognizing the resources needed to implement this new system, the authors, all residency program leaders, provide their consensus view of the components necessary for implementing and sustaining this effort, including resource estimates for completing this work. The authors have identified 4 domains: (1) Program Review and Development of Stakeholders and Participants, (2) Assessment Methods and Validation, (3) Data and Assessment System Development, and (4) Summative Assessment and Feedback. This work can serve as a starting point and framework for collaboration with program, department, and institutional leaders to identify and garner necessary resources and plan for local and national efforts that will ensure successful transition to milestones-based assessment.

The practicality of theory

The study of medical education has broadened significantly over the past decade to include a wide variety of theoretical frameworks from multiple research domains. There remains a significant misconception, however, that learning theories (largely drawn from cognitive psychology and education) are practical and useful to educators, whereas other types of theory are not. The authors of this commentary reflect on a learning-theory-based model for developing master learners presented by Schumacher and colleagues in this issue of Academic Medicine. They suggest that bioscientific and sociocultural theories can enhance different aspects of that model and provide specific examples from neuropsychophysiology, Foucauldian discourse analysis, and critical theory. Bioscientific and sociocultural theories such as these present medical educators with an exciting array of new methodological and interpretive possibilities. The authors illustrate ways in which these theories can have important practical applications for, and impacts on, the practice of medical education.