Individualized learning plans: basics and beyond

Beyond the Procedure Log: Using Individualized Learning Plans to Set Learner-Specific Milestones for Procedural Skills Acquisition

ABSTRACT

Procedural training for nonsurgical fields, such as internal medicine, is an important component of medical education. However, recent changes to accreditation guidelines have resulted in less formal guidance on procedural competency, not only leading to opportunities for individualizing training but also creating potential problems for trainees and training programs. In this article, the authors use internal medicine as an exemplar to review current strategies for procedural education in nonsurgical fields, including procedural simulation, dedicated procedural rotations, and advanced subspecialty training, and highlight an emerging need for learner-specific terminal milestones in procedural training. Individualized learning plans (ILPs), collections of trainee-specific objectives for learning, are arguably a useful strategy for organizing procedural training. The role of ILPs as a framework to support setting learner-specific terminal milestones, guide skill acquisition, and allocate procedural learning opportunities based on trainees' anticipated career plans is subsequently explored, and how an ILP-based approach might be implemented within the complex educational milieu of a clinical training program is examined. The limitations and pitfalls of an ILP-based approach, including the need for development of coaching programs, are considered. The authors conclude that, despite the limitations of ILPs, when combined with other current strategies for building trainees' procedural competence, these plans may help trainees maximize the educational benefits of their training period and can encourage effective, safer, and equitable allocation of procedural practice opportunities.

Using learning analytics in clinical competency committees: Increasing the impact of competency-based medical education

Graduate medical education (GME) and Clinical Competency Committees (CCC) have been evolving to monitor trainee progression using competency-based medical education principles and outcomes, though evidence suggests CCCs fall short of this goal. Challenges include that evaluation data are often incomplete, insufficient, poorly aligned with performance, conflicting or of unknown quality, and CCCs struggle to organize, analyze, visualize, and integrate data elements across sources, collection methods, contexts, and time-periods, which makes advancement decisions difficult. Learning analytics have significant potential to improve competence committee decision making, yet their use is not yet commonplace. Learning analytics (LA) is the interpretation of multiple data sources gathered on trainees to assess academic progress, predict future performance, and identify potential issues to be addressed with feedback and individualized learning plans. What distinguishes LA from other educational approaches is systematic data collection and advanced digital interpretation and visualization to inform educational systems. These data are necessary to: 1) fully understand educational contexts and guide improvements; 2) advance proficiency among stakeholders to make ethical and accurate summative decisions; and 3) clearly communicate methods, findings, and actionable recommendations for a range of educational stakeholders. The ACGME released the third edition CCC Guidebook for Programs in 2020 and the 2021 Milestones 2.0 supplement of the Journal of Graduate Medical Education (JGME Supplement) presented important papers that describe evaluation and implementation features of effective CCCs. Principles of LA underpin national GME outcomes data and training across specialties; however, little guidance currently exists on how GME programs can use LA to improve the CCC process. Here we outline recommendations for implementing learning analytics for supporting decision making on trainee progress in two areas: 1) Data Quality and Decision Making, and 2) Educator Development.

The Value of the Pediatric Urgent Care in Pediatric Resident Education

OBJECTIVE

Pediatric urgent care (UC) is a growing field and may provide unique learning opportunities for pediatric residents. We aimed to assess whether a UC rotation could be feasible and meaningful and help fill educational gaps.

METHODS

Within our current X + Y rotational model, we used Kern's 6-step approach for curriculum development to create a longitudinal UC educational experience for postgraduate year 2 (PGY2) pediatric residents. We assessed progress toward achieving our aim by using a mixed-methods approach matched to Kirkpatrick's levels of learning, including program annual evaluations, self-assessed UC competencies, and 360 milestone evaluations.

RESULTS

A total of 14 PGY2s participated in our yearlong longitudinal rotation without duty hour violations or deviations from well child care. Thematic analysis revealed concepts of autonomy, procedural access, and intentionality of education. Residents showed statistical improvement in 4/10 milestones and 26/27 self-assessed performance items. Of 14 residents, 6 scored ≥4 on all milestones by the end of the year.

CONCLUSIONS

Our curriculum demonstrates a valuable role for the pediatric UC in the procedural and clinical education of pediatric residents. Practical implications and assessment tools of such a curriculum may be valuable for others interested in integrating this learning experience into their current educational model.

A Qualitative Analysis of Assessment and Evaluation Practices Within the Individualized Curriculum

OBJECTIVE

The Accreditation Council of Graduate Medical Education requires an "individualized curriculum" (IC) in pediatric residency. A shared understanding across programs of methods to evaluate the IC is lacking. We explored pediatric program leaders' perceptions of assessment and evaluation within the IC to further understand and inform most useful practices.

METHODS

We conducted a phenomenology study using semi-structured interviews to 1) determine what IC assessment and evaluation strategies are utilized in pediatric residency programs, and 2) explore program leaders' perceptions of the feasibility and value of assessment and evaluation in the IC. We recruited a purposive sample of leaders from 15 pediatric residency programs of various sizes and regions. Interviews were recorded and transcribed. Data were analyzed to produce themes.

RESULTS

Three themes arose from our analysis: 1) Systematic assessment of the IC, though desired, is not robust in pediatric residency training; 2) Program differences present unique barriers and facilitators that impact the feasibility of assessment within the IC; and 3) Meaningfulness of assessment in the IC varies by stakeholder. Themes reflected perspectives on individual learner assessment and program evaluation.

CONCLUSIONS

While systematic assessment and evaluation of the IC in pediatric residency training is lacking, program leaders desire feasible strategies that are meaningful to the resident, the program, and its leadership team. Leveraging current assessment and evaluation tools and aligning new assessment strategies could promote the integration of IC assessment with other assessments, minimizing burden. More structured IC assessment and evaluation could inform how to best achieve curricular goals of the IC.

A mixed methods exploration of the emergence of goal orientation in medical students' individualized learning plans

PURPOSE

Goal orientation (GO) describes an individual's approach to different achievement situations. Understanding the motivations and approach to achieving goals of medical students is vital with the increasing emphasis on self-directed learning. The purpose of this study was to identify themes in self-improvement reflections that relate to each GO dimension (learning, performance-prove, and performance-avoid).

METHODS

A sequential explanatory mixed methods design was used. GO data was used to categorize students into groups aligning with the GO dimension identified in the previous stage of quantitative analysis. Individualized learning plans (ILPs) for each GO dimension group were coded inductively to identify emergent themes related to goal setting and achievement.

RESULTS

The learning GO group was the largest of the three GOs. Five themes were identified from inductive analysis: importance of practice, identifying elements that helped, identifying structural barriers, opportunities for improvement, and acknowledging experience. While these themes occur across GO, patterns exist within their ILPs based on GO.

CONCLUSIONS

We identified common themes for motivations of medical students, and these motivations might differ depending on their GO. Further exploration into the themes over the course of their training will provide additional insights on what factors may be involved in student motivations towards learning and achievement. Educators can use this information to individualize feedback and students can better understand their motivations towards achieving goals.

Best Practices for Remediation in Pulmonary and Critical Care Medicine Fellowship Training

Background

Remediation of struggling learners in pulmonary and critical care fellowship programs is a challenge, even for experienced medical educators.

Objective

This evidence-based narrative review provides a framework program leaders may use to address fellows having difficulty achieving competency during fellowship training.

Methods

The relevant evidence for approaches on the basis of each learner’s needs is reviewed and interpreted in the context of fellowship training in pulmonary medicine and critical care. Issues addressed include bias in fellow assessments and remediation, the impacts of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic, the specific challenges of pulmonary and critical care fellowship programs, a brief review of relevant legal issues, guidance on building and leveraging program resources, and a discussion of learner outcomes.

Results

This results in a concise, evidence-based toolkit for program leaders based around four pillars: early identification, fellow assessment, collaborative intervention, and reassessment. Important concepts also include the need for documentation, clear and written communication, and fellow-directed approaches to the creation of achievable goals.

Conclusion

Evidence-based remediation helps struggling learners in pulmonary and critical care fellowship to improve their ability to meet Accreditation Council for Graduate Medical Education (ACGME) milestones.

Reimagining the Clinical Competency Committee to Enhance Education and Prepare for Competency-Based Time-Variable Advancement

Assessing residents and clinical fellows is a high-stakes activity. Effective assessment is important throughout training so that identified areas of strength and weakness can guide educational planning to optimize outcomes. Assessment has historically been underemphasized although medical education oversight organizations have strengthened requirements in recent years. Growing acceptance of competency-based medical education and its logical extension to competency-based time-variable (CB-TV) graduate medical education (GME) further highlights the importance of implementing effective evidence-based approaches to assessment. The Clinical Competency Committee (CCC) has emerged as a key programmatic structure in graduate medical education. In the context of launching a multi-specialty pilot of CB-TV GME in our health system, we have examined several program's CCC processes and reviewed the relevant literature to propose enhancements to CCCs. We recommend that all CCCs fulfill three core goals, regularly applied to every GME trainee: (1) discern and describe the resident's developmental status to individualize education, (2) determine readiness for unsupervised practice, and (3) foster self-assessment ability. We integrate the literature and observations from GME program CCCs in our institutions to evaluate how current CCC processes support or undermine these goals. Obstacles and key enablers are identified. Finally, we recommend ways to achieve the stated goals, including the following: (1) assess and promote the development of competency in all trainees, not just outliers, through a shared model of assessment and competency-based advancement; (2) strengthen CCC assessment processes to determine trainee readiness for independent practice; and (3) promote trainee reflection and informed self-assessment. The importance of coaching for competency, robust workplace-based assessments, feedback, and co-production of individualized learning plans are emphasized. Individual programs and their CCCs must strengthen assessment tools and frameworks to realize the potential of competency-oriented education.

Clinical Competency Committees in Plastic Surgery Residency

Background:

Clinical competency committees (CCCs) are now an Accreditation Council on Graduate Medical Education (ACGME) requirement for plastic surgery training programs. They serve to monitor resident progress and make formal recommendations to program directors on promotion, remediation, and dismissal, based on resident progress toward the curricular milestones.

Methods:

Here, we present an overview on building, conducting, and improving a CCC, reviewing the literature available regarding best practices regarding this novel assessment system, with attention to the particular requirements for plastic surgery training.

Results:

We present the results of the Duke University CAQCC as a case study in the efficacy of a well-executed group in terms of improved resident outcomes, particularly regarding In-service Examination scores as an objective measure.

Conclusions:

Rather than simply serving as a necessary ACGME dictum, the CCC has the opportunity to demonstrably improve resident education. This article is valuable for department leaders, program directors, faculty, and residents toward understanding the purpose and design of their CCC.

Implementation of a monthly individualized learning plan with emergency medicine residents

OBJECTIVES

Self-assessment and self-directed learning (SDL) are integral to developing competent physicians who are lifelong learners. Individualized learning plans (ILPs) are tools to formalize this process and allow for mentors to guide residents in developing these skills. Pediatric residencies have adopted the ILP process and have demonstrated improvement in resident SDL behavior, but to date there have been no EM residencies to adopt the ILP process into resident education.

METHODS

The ILP program was designed around three key elements: (1) resident performance of self-assessment; (2) a collaborative conversation about learning needs and goals; and (3) a shared development of implementation strategies. The program was implemented with 12 PGY1 EM residents in the 2019-2020 academic year. Following an introduction to ILPs during orientation, residents met monthly with program leadership to create and reflect on ILPs. At the conclusion of the academic year, residents were surveyed about their attitude toward the ILP process and SDL.

RESULTS

A total of nine residents completed the postimplementation survey. Prior to implementing the ILP program, residents universally reported that they had little to no experience with generating an ILP. Following implementation, 55% of residents described themselves as strong independent learners and 89% wanted to continue the program into their second year.

CONCLUSIONS

Overall, residents felt that the ILP program helped to focus their goals, monitor their progress, and allowed them to develop a relationship with program leadership.

Describing Overarching Curricular Goals for Individualized Education

Phenomenon: The phenomenon of individualized education, an essential component of competency-based medical education, addresses individual learner needs while working toward standardized learning outcomes. One challenge with broadly implementing individualized education is the lack of a pragmatic operational definition. To formalize expectations for individualized education, the Accreditation Council of Graduate Medical Education in 2013 began requiring six months of individualized curriculum (IC) during pediatric residency; however, there is not a national standard of formal curricular goals for the IC as an educational entity. Examining and describing the overarching curricular goals of IC could provide a framework for discourse about and further study of individualized education in medicine across disciplines and the continuum of medical education. Thus, we aimed to describe the phenomenon of individualized education through the lens of the goals of the IC in pediatric residency in the United States. Approach: In 2017, a purposeful sample of Pediatric Residency leaders were recruited to represent a diverse sample of program sizes, regions of the country, and importance of the IC to the program leadership. They completed an online survey with open-ended questions describing formal and implicit goals of their program's IC. The authors analyzed responses initially using conventional content analysis, then investigated whether the themes for program goals aligned with any existing educational theory. The concepts and language aligned with the principles of self-determination theory (SDT); therefore, the IC goals were subsequently grouped using the SDT domains of relatedness, autonomy, and competence. A focus group with a subset of survey respondents was conducted for member checking and elaboration of concepts. Findings: Program leaders from a diverse sample of 36 programs participated in the survey and a subset of 11 programs participated in the focus group. The common goals across all programs are listed in parentheses and organized by domains of SDT: 1)Relatedness goals (engage in mentorship, select a career) cultivate resident's professional identity based on their desired future career path; 2)autonomy goals (create a learning plan, practice accountability) help residents plan their path; and fulfillment of their plans lead to 3)competence goals (develop targeted clinical skills and knowledge, ensure comprehensive exposure, address learning gaps), ensuring they have a comprehensive skill set for their chosen identity. Insights: This study provides a framework to describe the phenomenon of individualized education through the lens of IC curricular goals in pediatric residency. The goals for IC that emerged from this study serve as a pragmatic framework for implementation of individualized education. They provide a common language and structure to promote more rigorous and collaborative study of individualized education across programs, disciplines, and settings in medicine. They may function as a roadmap for learners to navigate educational activities and for programs to help shape the experiences of their learners and examine outcomes of individualized education in their programs. The framework can also help individual pediatric residency programs structure improvements to their IC. Disciplines beyond pediatrics may also use this framework to better structure elective experiences to capitalize on the benefits of individual education.

Use of Individualized Learning Plans to Facilitate Feedback Among Medical Students

Self-regulated learning theory suggests that individualized learning plans can benefit medical trainees by providing a structured means of goal setting, self-monitoring, and self-evaluation. External feedback also plays an important role in affecting learner motivations, perceptions, and self-evaluations. Accordingly, having learners share individualized learning plans with preceptors might promote self-regulated learning by helping align the feedback they receive with their learning goals. Hypothesis: We hypothesized having medical students share individualized learning plans with attendings and residents would improve the quality of the feedback they received, increase the likelihood that feedback correlated to their learning goals, and improve their perceptions of feedback received. Method: In this multisite study, third-year medical students on their pediatric clerkship created individualized learning plans and shared them with residents and attendings by writing a learning goal on at least one of their required faculty feedback forms. The quality of feedback on forms with versus without a learning goal written on top was scored using a validated scoring tool and compared using a Wilcoxon signed-ranks test, and the frequency with which feedback directly correlated to a student learning goal on forms with versus without a learning goal written on top was compared using a chi-square test. Students completed a post-clerkship survey rating the quality of feedback and teaching they received, perceptions of the individualized learning plans, progress toward achieving learning goals, and whether or not they received teaching and/or feedback related to learning goals. Results: Thirty-six students completed a total of 108 learning goals and 181 feedback forms, of which 42 forms (23.2%) had a learning goal written on top. The mean (SD) feedback score between forms with [3.9 (0.9)] versus without [3.6 (0.6)] a learning goal written on top was not different (p = .113). Feedback on forms with a learning goal written on top was more likely to correlate to a student learning goal than feedback on forms without a learning goal (92.9% vs 23.0% respectively, p < .001). Student perceptions of the usefulness of learning goals did not differ between students who reported receiving teaching or feedback related to a learning goal and those who did not. Conclusions: Sharing individualized learning plans with preceptors helped align feedback with learning goals but did not affect the quality of feedback. Further research should examine the bidirectional relationship between individualized learning plans and feedback in light of other contextual and interpersonal factors.

How is self-regulated learning documented in e-portfolios of trainees? A content analysis

BACKGROUND

It is assumed that portfolios contribute to self-regulated learning (SRL). Presence of these SRL processes within the documentation kept in portfolios is presupposed in common educational practices, such as the assessment of reflective entries. However, questions can be asked considering the presence of SRL within portfolios. The aim of this study was to gain insight into the documentation of SRL processes within the electronic (e)-portfolio content of medical trainees. SRL consists of numerous processes, for this study the focus was on self-assessment via reflection and feedback, goal-setting and planning, and monitoring, as these are the processes that health professions education research mentions to be supported by portfolios.

METHODS

A database containing 1022 anonymous e-portfolios from General Practitioner trainees was used to provide descriptive statistics of the various available e-portfolio forms. This was followed by a quantitative content analysis of 90 e-portfolios, for which, a codebook was constructed to rate the documentation of the included SRL processes.

RESULTS

The numbers of forms in the e-portfolios varied to a great extent. Content analysis showed a limited documentation of reflective entries, and available entries mainly described events and experiences without explanations and context. Feedback was generally limited to comments on what went well and lacked specificity, context and suggestions for future action. Learning goals and plans were short of specificity, but did contain challenging topics and different goals were compatible with each other. 75% of the e-portfolios showed (limited) signs of monitoring.

CONCLUSIONS

The e-portfolio content showed limited documentation of SRL processes. As documentation of SRL requires time and asks for a high level of introspection and writing skills, one cannot expect documentation of SRL processes to appear in e-portfolio content without efforts.

Neonatal postgraduate training program for physician assistants: meeting a need in neonatal care

There is a growing need for advanced practice providers in the NICU. Physician assistants (PAs) with postgraduate training in neonatology can help meet these demands. The premise of training PAs to work in the NICU is being adopted by multiple centers nationwide. Unfortunately, there are no standardized curricula for neonatal PA training that can be utilized to initiate residencies. Since our program is the longest running neonatal PA residency in the nation, we are in a unique position to share the accumulated experiences of our curriculum development. In this article, we describe our neonatal PA residency as it exists today with selected lessons learned. In addition, we present mixed qualitative and quantitative assessments of graduates. We believe that neonatal PA residency graduates become ideal candidates to fill the growing national need. We propose that our model program can be a stepping stone to enhance the role of PAs in neonatal care.

Pediatric Program Director Minimum Milestone Expectations Before Allowing Supervision of Others and Unsupervised Practice

BACKGROUND

The Accreditation Council for Graduate Medical Education requires semiannual Milestone reporting on all residents. Milestone expectations of performance are unknown.

OBJECTIVE

To determine pediatric program director (PD) minimum Milestone expectations for residents before being ready to supervise and before being ready to graduate.

METHODS

Mixed methods survey of pediatric PDs on their programs' Milestone expectations before residents are ready to supervise and before they are ready to graduate, and in what ways PDs use Milestones to make supervision and graduation decisions. If programs had no established Milestone expectations, PDs indicated expectations they considered for use in their program. Mean minimum Milestone level expectations were adjusted for program size, region, and clustering of Milestone expectations by program were calculated for before supervise and before graduate. Free-text questions were analyzed using thematic analysis.

RESULTS

The response rate was 56.8% (113 of 199). Most programs had no required minimum Milestone level before residents are ready to supervise (80%; 76 of 95) or ready to graduate (84%; 80 of 95). For readiness to supervise, minimum Milestone expectations PDs considered establishing for their program were highest for humanism (2.46; 95% confidence interval [CI], 2.21-2.71) and professionalization (2.37; 95% CI, 2.15-2.60). Minimum Milestone expectations for graduates were highest for help-seeking (3.14; 95% CI, 2.83-3.46). Main themes included the use of Milestones in combination with other information to assess learner performance and Milestones are not equally weighted when making advancement decisions.

CONCLUSIONS

Most PDs have not established program minimum Milestones, but would vary such expectations according to competency.

Individualized Learning Plan (ILP) Is an Effective Tool in Assessing Achievement of Otology-related Subcompetency Milestones

OBJECTIVE

To investigate the individualized learning plan (ILP) as a tool in assessment of residents' milestone achievements as they pertain to Otology subcompetencies: Chronic Ear Disease, Pediatric Otitis Media, and Hearing Loss.

STUDY DESIGN

Prospective study.

METHODS

Twenty otolaryngology residents were instructed to use an ILP and identify six milestones from three otology-related subcompetencies to focus on during the course of a 3-month rotation. They were also asked to plan out specific activities which would help them achieve these milestones, to specify whether or not they successfully achieved them, by what instructional or learning methods and to identify any barriers. The completed ILPs were reviewed by a faculty member.

MAIN OUTCOME MEASURES

The effectiveness of the ILP was assessed by response compliance rate, corroboration of self-reported milestone achievement with faculty evaluations and the ability to set attainable milestones.

RESULTS

There was 95% compliance in using an ILP to achieve milestones. Self-reported milestone scores corresponded to the faculty evaluations in a large majority (89.6%) of patients, and tended to be underestimated by the residents. Out of 114 total milestones identified, 44 (38.6%) were not achieved, with particular overestimation in the use of independent study as a learning method.

CONCLUSION

The ILP is an effective tool in measuring residents' achievement of otology-related milestones, and could possibly be used to supplement or replace faculty assessment. The ILP provides valuable information on barriers to achieving milestones and informs trainees on how to set attainable goals as they pertain to patient care and medical knowledge in otology.

A Randomized Trial of SMART Goal Enhanced Debriefing after Simulation to Promote Educational Actions

Introduction

Goal setting is used in education to promote learning and performance. Debriefing after clinical scenario-based simulation is a well-established practice that provides learners a defined structure to review and improve performance. Our objective was to integrate formal learning goal generation, using the SMART framework (Specific, Measurable, Attainable, Realistic, and Time-bound), into standard debriefing processes (i.e., “SMART Goal Enhanced Debriefing”) and subsequently measure the impact on the development of learning goals and execution of educational actions.

Methods

This was a prospective multicenter randomized controlled study of 80 emergency medicine residents at three academic hospitals comparing the effectiveness of SMART Goal Enhanced Debriefing to a standard debriefing. Residents were block randomized on a rolling basis following a simulation case. SMART Goal Enhanced Debriefing included five minutes of formal instruction on the development of SMART learning goals during the summary/application phase of the debrief. Outcome measures included the number of recalled learning goals, self-reported executed educational actions, and quality of each learning goal and educational action after a two-week follow-up period.

Results

The mean number of reported learning goals was similar in the standard debriefing group (mean 2.05 goals, SD 1.13, n=37 residents), and in the SMART Goal Enhanced Debriefing group (mean 1.93, SD 0.96, n=43), with no difference in learning goal quality. Residents receiving SMART Goal Enhanced Debriefing completed more educational actions on average (Control group actions completed 0.97 (SD 0.87), SMART debrief group 1.44 (SD 1.03) p=0.03).

Conclusion

The number and quality of learning goals reported by residents was not improved as a result of SMART Goal Enhanced Debriefing. Residents did, however, execute more educational actions, which is consistent with the overarching intent of any educational intervention.

Focusing on the Formative: Building an Assessment System Aimed at Student Growth and Development

This Perspective addresses the need for an integrated system of formative and summative assessment in undergraduate medical education with a focus on the formative. While acknowledging the importance of summative assessment, which asks whether trainees have met criteria for progression, the authors propose that a formatively focused assessment system can best accomplish a central task of competency-based medical education: transmitting feedback to learners in a format and a manner that will help them to improve, develop, and grow. Formative assessment should not be seen as a set of singular events but, rather, as a process that is organized and integrated over time, much like the cycle of quality improvement in medicine. To justify this position, the authors discuss its conceptual underpinnings and rationale, including the need to prepare learners for the formatively focused assessment system of graduate medical education. Next, the authors identify assessment strategies that could be employed, as well as the characteristics of an institutional culture and the learner-teacher relationship necessary for a learner-centered, improvement-focused assessment system to succeed. Finally, an infrastructure for such a system is proposed. This consists of a foundation of well-articulated and disseminated milestones for achievement and four pillars: faculty development, learner development, longitudinal academic advising and coaching, and documentation of developing competence. The authors conclude by suggesting that the guidelines proposed are analogous to the principles of continuity and coordination of care, so much valued in the world of medicine yet often overlooked in the world of education.

Can Individualized Learning Plans in an advanced clinical experience course for fourth year medical students foster Self-Directed Learning?

BACKGROUND

Residency programs have utilized Individualized Learning Plans (ILPs) to customize resident education while undergraduate medical education has not done so in a meaningful way. We discuss the use of ILPs within a fourth year medical school course to facilitate self-directed learning (SDL).

METHODS

At Stony Brook University School of Medicine, an ILP component was added to the Advanced Clinical Experience (ACE) course for fourth year students. Each completed an ILP outlining personal learning goals and strategies to achieve them. An adaptation of the Motivated Strategies for Learning Questionnaire (MSLQ) (Duncan T and McKeachie W, Educ Psych 40(2):117-128, 2005 and Cook DA et al., Med Ed 45:1230-1240, 2011) was used to measure success of ILPs in improving SDL. Qualitative data analysis was conducted on the ILPs and self-reflections.

RESULTS

Forty-eight students participated. Two of the four SDL sub-domains identified on the MSLQ showed improvement; self-efficacy (p = .001) and self-regulation (p = .002). 'Medical Knowledge' was the competency most frequently identified as an area of concentration (90 %) and professionalism was selected least frequently (4 %). A higher percentage (83 %) of students who reported complete achievement of their ILP goals also reported feeling better prepared for entering residency.

CONCLUSIONS

ILPs improve SDL strategies among medical students and may serve as useful tools to help shape future learning goals as they transition to residency training.

In Pursuit of Meaningful Use of Learning Goals in Residency: A Qualitative Study of Pediatric Residents

PURPOSE

Medical education aims to equip physicians for lifelong learning, an objective supported by the conceptual framework of self-regulated learning (SRL). Learning goals have been used to develop SRL skills in learners across the medical education continuum. This study's purpose was to elicit residents' perspectives on learning goal use and to develop explanations suggesting how aspects of the learning environment may facilitate or hinder the meaningful use of learning goals in residency.

METHOD

Resident focus groups and program director interviews were conducted in 2012-2013, audio-recorded, and transcribed. Programs were selected to maximize diversity of size, geographic location, type of program, and current use of learning goals. Data were analyzed using the constant comparative method associated with grounded theory. Further analysis compared themes frequently occurring together to strengthen the understanding of relationships between the themes. Through iterative discussions, investigators built a grounded theory.

RESULTS

Ninety-five third-year residents and 12 program directors at 12 pediatric residency programs participated. The analysis identified 21 subthemes grouped into 5 themes: program support, faculty roles, goal characteristics and purposes, resident attributes, and accountability and goal follow-through. Review of relationships between the themes revealed a pyramid of support with program support as the foundation that facilitates the layers above it, leading to goal follow-through.

CONCLUSIONS

Program support facilitates each step of the SRL process that leads to meaningful use of learning goals in residency. A strong foundation of program support should include attention to aspects of the implicit curriculum as well as the explicit curriculum.

Using Individualized Learning Plans to Facilitate Learner-Centered Teaching

Individualized learning plans (ILPs) are helpful tools that can facilitate learner-centered education and can be used with all levels of learners. We introduce the concept of ILPs, the rationale for their use in pediatric and adolescent gynecology education, and review the challenges that learners might face in creating ILPs, and describes how educators can support learners during this process.

Impact of individualized learning plans on United States senior medical students advanced clinical rotations

The individualized learning plan (ILP) is a tool that promotes self-directed learning. The aim of this pilot study was to look at the perception of the ILPs in United States senior medical school students as a way to improve their learning experience during their advanced practice clerkship. We conducted a survey of graduating medical students that contained both quantitative and open-ended questions regarding the students' experiences with the ILP during their advanced practice clerkship from July 2014 to March 2016. We systematically identified and compiled themes among the qualitative responses. Responses from 294 out of 460 subjects were included for analysis (63.9%). Ninety students (30.6%) reported that the ILP was definitely reviewed at the midpoint and 88 (29.9%) at the final evaluation. One hundred sixty one students (54.8%) felt the ILP provided a framework for learning. One hundred sixty one students (61.6%) felt it was a useful tool in helping open a discussion between the student and faculty. The qualitative data was grouped by areas most mentioned and these areas of concern centered on lack of faculty knowledge about ILP, time to complete ILP, and uncertainty of appropriate goal setting. The majority of students perceive the ILP to be helpful. Our results suggest that active intervention is needed by dedicated and trained faculty to improve ILP utilization. It is recommended that faculty gives students examples of learning goals to create their own learning framework and encourages them to discuss and review the ILP.

Effective feedback strategies for teaching in pediatric and adolescent gynecology

The clinical setting of pediatric and adolescent gynecology poses complex tasks for the physician with its numerous procedures and the communication demands of interacting with an adolescent and/or guardian. Needless to say, teaching within this setting is highly demanding. Regardless of the level of learner or the professional role (e.g., nurse, medical student, resident, physician assistant) represented, clinical teaching requires that the instructor provide feedback in ways that benefit the student. Recent research on feedback suggests a more complex understanding of feedback than in the past. This article highlights key research and its implication for effective feedback by presenting a three part framework; know your learner, understand what is to be learned, and plan for improvement.

Assessing residents' written learning goals and goal writing skill: validity evidence for the learning goal scoring rubric

PURPOSE

To provide validity evidence for use of the Learning Goal Scoring Rubric to assess the quality of written learning goals and residents' goal writing skills.

METHOD

This two-part study used the rubric to assess University of Colorado third-year pediatric residents' written learning goals to obtain validity evidence. In study 1, five raters independently scored 48 goals written in 2010-2011 and 2011-2012 by 48 residents, who also responded to the Jefferson Scale of Physician Lifelong Learning (JeffSPLL). In study 2, two raters independently scored 48 goals written in 2011-2012 by 12 residents. Intraclass correlation coefficients (ICCs) assessed rater agreement to provide evidence for response process. Generalizability theory assessed internal structure. Independent-samples Mann-Whitney U tests and correlations assessed relationship to other variables. Content was matched to published literature and instructional methods.

RESULTS

The ICC was 0.71 for the overall rubric. In study 1, where the generalizability study's (G study's) object of measurement was learning goals, the phi coefficient was 0.867. In study 2, where the G study's object of measurement was the resident (goal writing skill), the phi coefficient was 0.751. The total mean score of residents with goal writing training was significantly higher than that of those without (7.54 versus 4.98, P < .001). Correlation between goal quality and JeffSPLL score was not significant. Investigators agreed that the content matched the published literature and instructional methods.

CONCLUSIONS

Preliminary validity evidence indicates that this scoring rubric can assess learning goal quality and goal writing skill.

Use of individualized learning plans among fourth-year sub-interns in pediatrics and internal medicine

BACKGROUND

Individualized Learning Plans (ILPs) are an effective tool for promoting self-directed learning among residents. However, no literature details ILP use among medical students.

METHODS

Fifty fourth-year sub-interns in pediatrics and internal medicine created ILPs, including a self-assessment of strengths and weaknesses based on ACGME core competencies and the setting of learning objectives. During weekly follow-up meetings with faculty mentors and peers, students discussed challenges and revised goals. Upon completion of the rotation, students completed a survey of Likert-scale questions addressing satisfaction with and perceived utility of ILP components.

RESULTS

Students most often self-identified strengths in the areas of Professionalism and Interpersonal and Communication Skills and weaknesses in Patient Care and Systems-Based Practice. Eighty-two percent set at least one learning objective in an identified area of weakness. Students expressed high confidence in their abilities to create achievable learning objectives and to generate strategies to meet those objectives. Students agreed that discussions during group meetings were meaningful, and they identified the setting learning objectives and weekly meetings as the most important elements of the exercise.

CONCLUSIONS

Fourth-year sub-interns reported that ILPs helped them to accomplish rotation goals, with the setting of learning objectives and weekly discussions being the most useful elements.

Is residents' progress on individualized learning plans related to the type of learning goal set?

PURPOSE

To determine the types of learning goals residents select for their individualized learning plans (ILPs) and the relationship between goal type and progress toward achieving that goal.

METHOD

Pediatric and combined pediatric residents at 46 U.S. training programs completed a Web-based survey on ILPs in 2008-2009, describing their most important learning goal and the goals on which they made the most and least progress. Using iterative inductive review, responses were categorized into seven types (six corresponding with the Accreditation Council for Graduate Medical Education general competencies). Descriptive statistics and regression models were used to assess the relationship between goal type and progress made.

RESULTS

Of 1,739 eligible residents, 992 (57%) completed the survey; 668 (38%) had previously completed an ILP and described their learning goals. Residents were more likely to report medical knowledge (MK) (53.7%) and patient care (PC) (25.9%) goals as most important and less likely to report professionalism (1.5%) and systems-based practice (SBP) (1.0%) goals as most important. Compared with progress on MK goals, residents reported significantly greater progress on PC (odds ratio [OR]: 2.20; 95% confidence interval [CI]: 1.57-3.09) and practice-based learning and improvement teaching (OR: 2.99; 95% CI: 1.59-5.63) goals and less progress on SBP goals (OR: 0.16; 95% CI: 0.05-0.56).

CONCLUSIONS

Residents most commonly identified MK and PC learning goals as the most important. Residents made more progress on goals related to everyday tasks, such as PC and teaching, compared with goals less integrated in everyday training, such as SBP.