Time-Variable Training in Medicine: Theoretical Considerations

Procedural sedation competencies: a review and multidisciplinary international consensus statement on knowledge, skills, training, and credentialing

Procedural sedation is practised by a heterogeneous group of practitioners working in a wide array of settings. However, there are currently no accepted standards for the competencies a sedation practitioner should have, the content of sedation training programmes, and guidelines for credentialing. The multidisciplinary International Committee for the Advancement of Procedural Sedation sought to develop a consensus statement on the following: which competencies should medical or dental practitioners have for procedural sedation and how are they obtained, assessed, maintained, and privileged. Using the framework of Competency-Based Medical Education, the practice of procedural sedation was defined as a complex professional task requiring demonstrable integration of different competencies. For each question, the results of a literature review were synthetised into preliminary statements. Following an iterative Delphi review method, final consensus was reached. Using multispeciality consensus, we defined procedural sedation competence by identifying a set of core competencies in the domains of knowledge, skills, and attitudes across physical safety, effectiveness, psychological safety, and deliberate practice. In addition, we present a standardised framework for competency-based training and credentialing of procedural sedation practitioners.

Artificial Intelligence in Health Professions Education assessment: AMEE Guide No. 178

Health Professions Education (HPE) assessment is being increasingly impacted by Artificial Intelligence (AI), and institutions, educators, and learners are grappling with AI's ever-evolving complexities, dangers, and potential. This AMEE Guide aims to assist all HPE stakeholders by helping them navigate the assessment uncertainty before them. Although the impetus is AI, the Guide grounds its path in pedagogical theory, considers the range of human responses, and then deals with assessment types, challenges, AI roles as tutor and learner, and required competencies. It then discusses the difficult and ethical issues, before ending with considerations for faculty development and the technicalities of AI acknowledgment in assessment. Through this Guide, we aim to allay fears in the face of change and demonstrate possibilities that will allow educators and learners to harness the full potential of AI in HPE assessment.

Competency-based education - the reform of postgraduate medical training in Switzerland

Objective

Medical training in Switzerland is currently undergoing change. The postgraduate education curricula of all medical specialties are being converted to competency-based medical education (CBME). Entrustable Professional Activities (EPA) are used to assess competencies. EPAs describe specific professional tasks that are assigned to postgraduate trainees once they have achieved sufficient competencies.

Methodology and results

The article describes how the didactic building blocks are joined to create competency-based teaching and how the implementation takes place.The project is described using the Kern cycle. The first two steps, problem identification and targeted needs assessment, are presented in the project description section, the other four steps in the results. Concrete details are given using examples from the cardiology curriculum.

Conclusion

The conversion of medical training in Switzerland to competency-based teaching is an important step that is urgently needed but complex. The long-term plan of the Swiss Institute for Postgraduate and Continuing Medical Education (SIWF) consists not only of structural steps but also cultural change. The first two years of the conversion were successful. In collaboration with the specialist societies, postgraduate curricula are being converted to EPA-based learning objectives, the didactic training for postgraduate teaching staff adapted accordingly and feedback from learners is continuously gathered. The implementation process has begun. Additional data will be collected as the project proceeds. Using experience already gained internationally and by specialist societies which have already taken this step as benchmarks is critical for other specialties and training centres that are still to follow.

Croix R, van Melle E. Competence By Design: a transformational national model of time-variable competency-based postgraduate medical education

Postgraduate medical education is an essential societal enterprise that prepares highly skilled physicians for the health workforce. In recent years, PGME systems have been criticized worldwide for problems with variable graduate abilities, concerns about patient safety, and issues with teaching and assessment methods. In response, competency based medical education approaches, with an emphasis on graduate outcomes, have been proposed as the direction for 21st century health profession education. However, there are few published models of large-scale implementation of these approaches. We describe the rationale and design for a national, time-variable competency-based multi-specialty system for postgraduate medical education called Competence by Design. Fourteen innovations were bundled to create this new system, using the Van Melle Core Components of competency based medical education as the basis for the transformation. The successful execution of this transformational training system shows competency based medical education can be implemented at scale. The lessons learned in the early implementation of Competence by Design can inform competency based medical education innovation efforts across professions worldwide.

Lessons From Organic Chemistry: The Case for Considering Both High Standards and Equity in Assessment

ABSTRACT

In this commentary, the authors explore the tension of balancing high performance standards in medical education with the acceptability of those standards to stakeholders (e.g., learners and patients). The authors then offer a lens through which this tension might be considered and ways forward that focus on both patient outcomes and learner needs.In examining this phenomenon, the authors argue that high performance standards are often necessary. Societal accountability is key to medical education, with the public demanding that training programs prepare physicians to provide high-quality care. Medical schools and residency programs, therefore, require rigorous standards to ensure graduates are ready to care for patients. At the same time, learners' experience is important to consider. Making sure that performance standards are acceptable to stakeholders supports the validity of assessment decisions.Equity should also be central to program evaluation and validity arguments when considering performance standards. Currently, learners across the continuum are variably prepared for the next phase in training and often face inequities in resource availability to meet high passing standards, which may lead to learner attrition. Many students who face these inequities come from underrepresented or disadvantaged backgrounds and are essential to ensuring a diverse medical workforce to meet the needs of patients and society. When these students struggle, it contributes to the leaky pipeline of more socioeconomically and racially diverse applicants.The authors posit that 4 key factors can balance the tension between high performance standards and stakeholder acceptability: standards that are acceptable and defensible, progression that is time variable, requisite support structures that are uniquely tailored for each learner, and assessment systems that are equitably designed.

Lessons learned spanning 17 years of experience with three consecutive nationwide competency based medical education training plans

Introduction

Curricula for postgraduate medical education have transformed since the introduction of competency based medical education (CBME). Postgraduate training plans offer broader training with different competencies and an outcome-based approach, in addition to the medical technical aspects of training. However, CBME also has its challenges. Over the past years, critical views have been shared on the potential drawbacks of CBME, such as assessment burden and conflicts with practicality in the workplace. Recent studies identified a need for a better understanding of how the evolving concept of CBME has been translated to curriculum design and implemented in the practice of postgraduate training. The aim of this study was to describe the development of CBME translations to curriculum design, based on three consecutive postgraduate training programs spanning 17 years.

Method

We performed a document analysis of three consecutive Dutch gynecology and obstetrics training plans that were implemented in 2005, 2013, and 2021. We used template analysis to identify changes over time.

Results

Over time, CBME-based curriculum design changed in several domains. Assessment changed from a model with a focus on summative decision to one with an emphasis on formative, low-stakes assessments aimed at supporting learning. The training plans evolved in parallel to evolving educational insights, e.g., by placing increasing emphasis on personal development. The curricula focused on a competency-based concept by introducing training modules and personalized authorization based on feedback rather than on a set duration of internships. There was increasing freedom in personalized training trajectories in the training plans, together with increasing trust towards the resident.

Conclusion

The way CBME was translated into training plans has evolved in the course of 17 years of experience with CMBE-based education. The main areas of change were the structure of the training plans, which became increasingly open, the degree to which learning outcomes were mandatory or not, and the way these outcomes were assessed.

Competency-Based Education: The Need to Debunk Misconceptions and Develop a Common Language

Competency-based education (CBE) dates back to the early 1900s. A renewed interest in CBE in health professions education has been sparked by the recommendations that emerged from the 2017 Josiah Macy Jr Foundation conference on CBE. These recommendations urge changes in structure and pedagogy to address gaps between societal needs, health care practice, and health professions education. Despite widespread interest, there is significant variability in what constitutes CBE. This variability has challenged the development of an evidence base in the literature and has led to widespread misconceptions regarding CBE. Implementation science principles outline the need to develop a common language to inform effective and sustained implementation of an innovation. By misusing or overusing similar words and using different concepts interchangeably without first developing a common, widely understood language around CBE, we cannot expect that CBE will be among the tools successful in closing gaps between health care practice and education.

An Ideal System of Assessment to Support Competency-Based Graduate Medical Education: Key Attributes and Proposed Next Steps

Competency-based medical education (CBME) is the future of medical education and relies heavily on high quality assessment. However, the current assessment practices employed by many general surgery graduate medical education training programs are subpar. Assessments often lack reliability and validity evidence, have low faculty engagement, and differ from program to program. Given the importance of assessment in CBME, it is critical that we build a better assessment system for measuring trainee competency. We propose that an ideal system of assessment is standardized, evidence-based, comprehensive, integrated, and continuously improving. In this article, we explore these characteristics and propose next steps to achieve such a system of assessment in general surgery.

Competency-based pharmacy education definition: What components need to be defined to implement it?

OBJECTIVES

This study aimed to define the essential elements in the proposed competency-based pharmacy education (CBPE) definition, provide the key defining components of each essential element on the basis of educational theory and evidence, and define how the essential elements meet the identified needs for CBPE.

METHODS

best-practice integrative review was conducted as part of the work of the American Association of Colleges of Pharmacy CBPE Task Force to define the essential elements in the CBPE definition and how these elements fit with the need for CBPE. The definition was compared with other published competency-based education definitions across K-12, higher education, medical education, and veterinary education. Task Force members then met to develop a consensus on the core components of the 5 essential elements in the definition. Next, the Task Force evaluated the fit of CBPE by matching the identified needs, discussed in detail elsewhere, across each of the stakeholder perspectives with the core components of the 5 essential elements in the derived definition of CBPE.

FINDINGS

Upon review of the proposed CBPE definition, the Task Force identified 5 essential elements. These elements include the following: meeting health care and societal needs, outcomes-based curricular model, de-emphasized time, learner-centered culture, and authentic teaching and learning strategies aligned to assessments.

SUMMARY

This article helps to establish a common language for CBPE by defining the essential elements of the core components of the definition, and provides a starting point for further exploration of CBPE.

Neurology Education in 2035: The Neurology Future Forecasting Series

In the past decade, there have been dramatic changes in all aspects of neurologic care, and along with this, neurology education has transformed. These changes have affected all aspects of education across the educational continuum, including learners, teachers, educators, content, delivery methods, assessments, and outcomes. Health systems science, health humanities, diversity, equity, and inclusion and health disparities are becoming core components of neurology curricula, and, in the future, will be integrated into every aspect of our educational mission. The ways in which material is taught and learned have been influenced by technologic innovations and a growing understanding of the science of learning. We forecast that this trend will continue, with learners choosing from an array of electronic resources to engage with fundamental topics, allowing front-line clinical teachers to spend more time supporting critical reasoning and teaching students how to learn. There has been a growing differentiation of educational roles (i.e., teachers, educators, and scholars). We forecast that these roles will become more distinct, each with an individualized pattern of support and expectations. Assessment has become more aligned with the work of the learners, and there are growing calls to focus more on the impact of educational programs on patient care. We forecast that there will be an increased emphasis on educational outcomes and public accountability for training programs. In this article, we reflect on the history of medical education in neurology and explore the current state to forecast the future of neurology education and discuss ways in which we can prepare.

A Mixed-Methods Exploration of the Developmental Trajectory of Autonomous Motivation in Graduate Medical Learners

INTRODUCTION

Self-determination theory (SDT), when applied to curricular construction, emphasizes curiosity, self-awareness, and resilience. Physicians need these qualities to face the challenges of clinical practice. SDT offers a lens for medical educators to track learner development toward sustainable, rewarding careers. This study describes the changes observed in learner communications about feelings of competence, relatedness, and autonomy across a 3-year family medicine training program designed to develop activated, lifelong learners.

METHODS

This retrospective, mixed-methods case study uses a phenomenological approach to explore how 51 learners described their experiences at various intervals in residency training. Data collected from 2009 to 2015 from resident focus groups, competency assessment meetings, and faculty assessment reports inform a 3-stage analysis process to determine learner motivation levels along the SDT continuum.

RESULTS

Aggregated qualitative and quantitative data show residents' progression from introjection (controlled motivation) in PGY1, to identification (autonomous motivation) in PGY2, and integration (autonomous) by the end of PGY3. The examination of a single learner's data set reveals an advanced motivation level in PGY1 (identification), followed by a period of retrograde in PGY2 (introjection), then rebounding in PGY3 (identification), which illustrates how motivation level can be affected by external competency requirements and challenges related to career transitions.

DISCUSSION

The examination of self-motivation in medical learners has implications for curriculum development, assessment, teaching and self-directed learning, and resilience training. Learner awareness of intrinsic motivation, and the curriculum designed around it, can better prepare residents for challenges during residency and help them flourish in twenty-first-century medicine.

Competency-Based Education: Developing an Advanced Competency Framework for Indonesian Pharmacists

Introduction: Pharmacists need to be adaptable, flexible, and capable of advancing their practice to adapt to rapidly changing population health needs. We describe an educational approach to pharmacy workforce transformation in Indonesia through an advanced practice competency framework development using an "adopt and adapt" methodology. Methods: The competency framework development process comprised a translation phase, an adopt and adapt phase, validation through a nationwide mapping survey, and a completion phase through leadership consensus panels. We conducted a forward-backwards translation of a previously validated Advanced to Consultancy Level Framework (ACLF) to yield the Indonesian Advanced Development Framework (IADF) draft. The subsequent adoption and adaptation process was conducted through a series of consensus panels. We validated the IADF through a nationwide workforce survey. The final phase included leadership consensus panels with the professional leadership body in Indonesia. We analyzed the qualitative data thematically and the quantitative data using a Multiple Correspondence Analysis (MCA) technique. Results: We identified conceptual challenges in adopting and adapting the existing ACLF, which were addressed by providing a national glossary and concrete examples. A total of 6,212 pharmacists participated in the national workforce survey, of which 43% had <2 years of post-license (post-registration) experience. The MCA results showed that practitioner self-assessment to the IADF could discriminate their career development stages. The results also indicated a four-stage career model (including early years career training). Embedding this model in a structured national training program will enhance the professional workforce development through a more structured career journey. Conclusions: We describe the first validation of an advanced competency development framework for the pharmacy workforce in a non-Anglophone country, showing the possibility of transnational applicability of this framework. We argue that this methodology can be used in Low and Middle-income countries (LMICs) for the more rapid advancement of pharmaceutical care practice.

A Scoping Review of Professional Identity Formation in Undergraduate Medical Education

BACKGROUND

Professional identity formation (PIF) in medical students is a multifactorial phenomenon, shaped by ways that clinical and non-clinical experiences, expectations and environmental factors merge with individual values, beliefs and obligations. The relationship between students' evolving professional identity and self-identity or personhood remains ill-defined, making it challenging for medical schools to support PIF systematically and strategically. Primarily, to capture prevailing literature on PIF in medical school education, and secondarily, to ascertain how PIF influences on medical students may be viewed through the lens of the ring theory of personhood (RToP) and to identify ways that medical schools support PIF.

METHODS

A systematic scoping review was conducted using the systematic evidence-based approach. Articles published between 1 January 2000 and 1 July 2020 related to PIF in medical students were searched using PubMed, Embase, PsycINFO, ERIC and Scopus. Articles of all study designs (quantitative and qualitative), published or translated into English, were included. Concurrent thematic and directed content analyses were used to evaluate the data.

RESULTS

A total of 10443 abstracts were identified, 272 full-text articles evaluated, and 76 articles included. Thematic and directed content analyses revealed similar themes and categories as follows: characteristics of PIF in relation to professionalism, role of socialization in PIF, PIF enablers and barriers, and medical school approaches to supporting PIF.

DISCUSSION

PIF involves iterative construction, deconstruction and inculcation of professional beliefs, values and behaviours into a pre-existent identity. Through the lens of RToP, factors were elucidated that promote or hinder students' identity development on individual, relational or societal levels. If inadequately or inappropriately supported, enabling factors become barriers to PIF. Medical schools employ an all-encompassing approach to support PIF, illuminating the need for distinct and deliberate longitudinal monitoring and mentoring to foster students' balanced integration of personal and professional identities over time.

Competency-based time-variable training internationally: Ensuring practical next steps in the wake of the COVID-19 pandemic

Competency-based medical education has been advocated as the future of medical education for nearly a half-century. Inherent to this is the promise that advancement and transitions in training would be defined by readiness to practice rather than by time. Of the logistical problems facing competency-based, time-variable (CBTV) training, enacting time variability may be the largest hurdle to clear. Although it is true that an 'all or nothing' approach to CBTV training would require massive overhauls of both medical education and health care systems, the authors propose that training institutions should gradually evolve within their current environments to incrementally move toward the best version of CBTV training for learners, supervisors, and patients. In support of this evolution, the authors seek to demonstrate the feasibility of advancing toward the goal of realistic CBTV training by detailing examples of successful CBTV training and describing key features of initial steps toward CBTV training implementation.

Preliminary Evaluation of a Core Knowledge Test for Certification of Health Care Chaplains

This article describes the rationale, evolution, implementation, and evaluation of a process for testing core knowledge in health care chaplaincy certification. The process developed by the Spiritual Care Association uses online testing of evidence-based core knowledge developed with several expert advisory committees. The process seems to have acceptable validity, reliability, feasibility and usability and should be considered as a component to current certification processes for health care chaplains.

Ten caveats of learning analytics in health professions education: A consumer's perspective

A group of 22 medical educators from different European countries, gathered in a meeting in Utrecht in July 2019, discussed the topic of learning analytics (LA) in an open conversation and addressed its definition, its purposes and potential risks for learners and teachers. LA was seen as a significant advance with important potential to improve education, but the group felt that potential drawbacks of using LA may yet be under-exposed in the literature. After transcription and interpretation of the discussion's conclusions, a document was drafted and fed back to the group in two rounds to arrive at a series of 10 caveats educators should be aware of when developing and using LA, including too much standardized learning, with undue consequences of over-efficiency and pressure on learners and teachers, and a decrease of the variety of 'valid' learning resources. Learning analytics may misalign with eventual clinical performance and can run the risk of privacy breaches and inescapability of documented failures. These consequences may not happen, but the authors, on behalf of the full group of educators, felt it worth to signal these caveats from a consumers' perspective.

Introducing Summative Progress Testing in Radiology Residency: Little Change in Residents' Test Results After Transitioning from Formative Progress Testing

INTRODUCTION

Educational effects of transitioning from formative to summative progress testing are unclear. Our purpose was to investigate whether such transitioning in radiology residency is associated with a change in progress test results.

METHODS

We investigated a national cohort of radiology residents (N > 300) who were semi-annually assessed through a mandatory progress test. Until 2014, this test was purely formative for all residents, but in 2014/2015, it was transitioned (as part of a national radiology residency program revision) to include a summative pass requirement for new residents. In 7 posttransitioning tests in 2015-2019, including summatively and formatively tested residents who followed the revised and pre-transitioning residency program, respectively, we assessed residents' relative test scores and percentage of residents that reached pass standards.

RESULTS

Due to our educational setting, most posttransitioning tests had no residents in the summative condition in postgraduate year 4-5, nor residents in the formative condition in year 0.5-2. Across the 7 tests, relative test scores in postgraduate year 1-3 of the summative resident group and year 3.5-4.5 of the formative group differed significantly (p < 0.01 and p < 0.05, respectively, Kruskal-Wallis test). However, scores fluctuated without consistent time trends and without consistent differences between both resident groups. Percentage of residents reaching the pass standard did not differ significantly across tests or between groups.

DISCUSSION

Transitioning from formative to summative progress testing was associated with overall steady test results of the whole resident group in 4 post-transitioning years. We do not exclude that transitioning may have positive educational effects for resident subgroups.

Longitudinal Assessment of Resident Performance Using Entrustable Professional Activities

IMPORTANCE

Entrustable professional activities (EPAs) are an emerging workplace-based, patient-oriented assessment approach with limited empirical evidence.

OBJECTIVE

To measure the development of pediatric trainees' clinical skills over time using EPA-based assessment data.

DESIGN, SETTING, AND PARTICIPANTS

Prospective cohort study of categorical pediatric residents over 3 academic years (2015-2016, 2016-2017, and 2017-2018) assessed on 17 American Board of Pediatrics EPAs. Residents in training at 23 pediatric residency programs in the Association of Pediatric Program Directors Longitudinal Educational Assessment Research Network were included. Assessment was conducted by clinical competency committee members, who made summative assessment decisions regarding levels of supervision required for each resident and each EPA. Data were collected from May 2016 to November 2018 and analyzed from November to December 2018.

INTERVENTIONS

Longitudinal, prospective assessment using EPAs.

MAIN OUTCOMES AND MEASURES

Trajectories of supervision levels by EPA during residency training and how often graduating residents were deemed ready for unsupervised practice in each EPA.

RESULTS

Across the 5 data collection cycles, 1987 residents from all 3 postgraduate years in 23 residency programs were assigned 25 503 supervision level reports for the 17 general pediatrics EPAs. The 4 EPAs that required the most supervision across training were EPA 14 (quality improvement) on the 5-level scale (estimated mean level at graduation, 3.7; 95% CI, 3.6-3.7) and EPAs 8 (transition to adult care; mean, 7.0; 95% CI, 7.0-7.1), 9 (behavioral and mental health; mean, 6.6; 95% CI, 6.5-6.6), and 10 (resuscitate and stabilize; mean, 6.9; 95% CI, 6.8-7.0) on the expanded 5-level scale. At the time of graduation (36 months), the percentage of trainees who were rated at a supervision level corresponding to "unsupervised practice" varied by EPA from 53% to 98%. If performance standards were set to align with 90% of trainees achieving the level of unsupervised practice, this standard would be met for only 8 of the 17 EPAs (although 89% met this standard for EPA 17, performing the common procedures of the general pediatrician).

CONCLUSIONS AND RELEVANCE

This study presents initial evidence for empirically derived practice readiness and sets the stage for identifying curricular gaps that contribute to discrepancy between observed practice readiness and standards needed to produce physicians able to meet the health needs of the patient populations they serve. Future work should compare these findings with postgraduation outcomes data as a means of seeking validity evidence.

Professionals' perspectives on factors affecting GP trainees' patient mix: results from an interview and focus group study among professionals working in Dutch general practice

INTRODUCTION

Seeing and treating patients in daily practice forms the basis of general practitioner (GP) training. However, the types of patients seen by GP trainees do not always match trainees' educational needs. Knowledge about factors that shape the mix of patient types is limited, especially with regard to the role of the professionals who work in the GP practice.

AIM

We investigated factors affecting the mix of patients seen by GP trainees from the perspective of professionals.

DESIGN AND SETTING

This qualitative study involved GP trainees, GP supervisors, medical receptionists and nurse practitioners affiliated with a GP Specialty Training Institute in the Netherlands.

METHODS

Twelve focus groups and seven interviews with 73 participants were held. Data collection and analysis were iterative, using thematic analysis with a constant comparison methodology.

RESULTS

The characteristics of patients' health problems and the bond between the doctor and patient are important determinants of GP trainees' patient mix. Because trainees have not yet developed bonds with patients, they are less likely to see patients with complex health problems. However, trainees can deliberately influence their patient mix by paying purposeful attention to bonding with patients and by gaining professional trust through focused engagement with their colleagues.

CONCLUSION

Trainees' patient mix is affected by various factors. Trainees and team members can take steps to ensure that this mix matches trainees' educational needs, but their success depends on the interaction between trainees' behaviour, the attitudes of team members and the context. The findings show how the mix of patients seen by trainees can be influenced to become more trainee centred and learning oriented.

Moving Toward Summative Competency Assessment to Individualize the Postclerkship Phase

In the move toward competency-based medical education, leaders have called for standardization of learning outcomes and individualization of the learning process. Significant progress has been made in establishing defined expectations for the knowledge, skills, attitudes, and behaviors required for successful transition to residency training, but individualization of educational processes to assist learners in reaching these competencies has been predominantly conceptual to date. The traditional time-based structure of medical education has posed a challenge to individualization within the curriculum and has led to more attention on innovations that facilitate transition from medical school to residency. However, a shift of focus to the clerkship-to-postclerkship transition point in the undergraduate curriculum provides an opportunity to determine how longitudinal competency-based assessments can be used to facilitate intentional and individualized structuring of the long-debated fourth year.This Perspective demonstrates how 2 institutions-the University of Virginia School of Medicine and the University of Michigan Medical School-are using competency assessments and applying standardized outcomes in decisions about individualization of the postclerkship learning process. One institution assesses Core Entrustable Professional Activities for Entering Residency, whereas the other has incorporated Accreditation Council for Graduate Medical Education core competencies and student career interests to determine degrees of flexibility in the postclerkship phase. Individualization in addition to continued assessment of performance presents an opportunity for intentional use of curriculum time to develop each student to be competently prepared for the transition to residency.

Development of competence in volumetric image interpretation in radiology residents

BACKGROUND

During residency, radiology residents learn to interpret volumetric radiological images. The development of their competence for volumetric image interpretation, as opposed to 2D image reading, is not completely understood. The purpose of the present study was to investigate how competence for volumetric image interpretation develops in radiology residents and how this compares with competence development for 2D image interpretation, by studying resident scores on image-based items in digital radiology tests.

METHODS

We reviewed resident scores on volumetric and 2D image-based test items in 9 consecutive semi-annual digital radiology tests that were carried out from November 2013 to April 2018. We assessed percentage-correct sum scores for all test items about volumetric images and for all test items about 2D images in each test as well as for all residents across the 9 tests (i.e. 4.5 years of test materials). We used a paired t-test to analyze whether scores differed between volumetric and 2D image-based test items in individual residents in postgraduate year (PGY) 0-5, subdivided in 10 half-year phases (PGY 0-0.5, 0.5-1.0, 1.0-1.5 et cetera).

RESULTS

The percentage-correct scores on volumetric and 2D image-based items showed a comparable trend of development, increasing in the first half of residency and flattening off in the second half. Chance-corrected scores were generally lower in volumetric than in 2D items (on average 1-5% points). In PGY 1.5-4.5, this score difference was statistically significant (p-values ranging from 0.02 to < 0.001), with the largest difference found in PGY 2.5 (mean: 5% points; 95% CI: -7.3 - -3.4). At the end of training in PGY 5, there was no statistically significant score difference between both item types.

CONCLUSIONS

The development of competence in volumetric image interpretation fits a similar curvilinear growth curve during radiology residency as 2D image interpretation competence in digital radiology tests. Although residents performed significantly lower on volumetric than 2D items in PGY 1.5-4.5, we consider the magnitude of this difference as relatively small for our educational setting and we suggest that throughout radiology training there are no relevant differences in the development of both types of competences, as investigated by digital radiology tests.

Key considerations prior to nasal high flow deployment in a Peruvian PICU from providers' perspectives

AIM

Implementation of healthcare interventions in resource-limited settings remains challenging. This exploratory qualitative study describes social and institutional factors to consider prior to nasal high flow deployment in a middle-income country.

METHODS

Researchers conducted eight nursing focus groups and four semi-structured physician interviews at Instituto Nacional de Salud del Niño in Lima, Peru. Participants were identified via purposive sampling. Data were transcribed, translated and coded using a rigorous and iterative process. Pertinent themes were identified using thematic analysis with Dedoose software.

RESULTS

Thirty-nine nurses and four physicians participated in focus groups and interviews, respectively. Participants identified five major factors: (i) Adequate training, (ii) Clinician buy-in, (iii) Resource-limited setting, (iv) Local social context and (v) Organizational change management. To create buy-in, physicians and nurses emphasised the need to recognise benefit of the intervention and agree with clinical practice standardization. Physicians and nurses described barriers specific to resource-limited settings, including unreliable supply chain, whereas nurses shared concerns about increasing workload and physician-nurse social hierarchy. Participants recognised the importance of team commitment and ongoing interdisciplinary communication for sustainability.

CONCLUSION

While some factors to consider prior to deployment of healthcare technology are universal, resource-limited settings have unique implementation barriers.

Examining the clinical learning environment through the architectural avenue

Medical education has traditionally focused on the learners, the educators, and the curriculum, while tending to overlook the role of the designed environment. Experience indicates, however, that processes and outcomes of medical education are sensitive to the qualities and disposition of the spaces in which it occurs. This includes the clinical education within the patient care environment, termed the clinical learning environment (CLE). Recognition of this has informed the design of some new clinical learning spaces for the past decade. Competency-based clinical education can drive design requirements that differ materially from those associated with general purpose educational or clinical spaces. In this article, we outline two conceptual frameworks: (i) materialist spatiality and (ii) actor-network theory and consider how they can guide the design of spaces to support competency-based medical education and to guide the evaluation and discussion of the educational impacts of the spaces once built. We illustrate the use of these frameworks through discussion of the educational ambitions that underpinned the design of some recent clinical educational spaces. We close with practical points for consideration by educators and designers.

Resident and Faculty Attitudes Toward the Dutch Radiology Progress Test as It Transitions from a Formative to a Summative Measure of Licensure Eligibility

BACKGROUND

Progress testing, a regularly administered comprehensive test of a complete knowledge domain, usually serves to provide learners feedback and has a formative nature.

OBJECTIVE

Our study aimed to investigate the acceptability of introducing a summative component in the postgraduate Dutch Radiology Progress Test (DRPT) among residents and program directors in a competency-based training program.

METHODS

A 15-item questionnaire with 3 items on acceptability of summative postgraduate knowledge testing, 7 on acceptability of the summative DRPT regulations, 4 on self-reported educational effects, and 1 open comment item was distributed nationally among 349 residents and 81 radiology program directors.

RESULTS

The questionnaire was filled out by 330 residents (95%) and 48 (59%) program directors. Summative postgraduate knowledge testing was regarded as acceptable by both groups, but more so by program directors than residents. The transition toward summative assessment in the DRPT was received neutrally to slightly positively by residents, while program directors regarded it as an improvement and estimated the summative criteria to be lighter and less stressful than did residents. The residents' self-reported educational effects of summative assessment in the DRPT were limited, whereas program directors expected a greater end-of-training knowledge improvement than residents.

CONCLUSIONS

Both residents and program directors support summative postgraduate knowledge testing, although it is more accepted by program directors. Residents receive summative radiological progress testing neutrally to slightly positively, while program directors generally value it more positively than residents. Directors should be aware of these different perspectives when introducing or developing summative progress testing in residency programs.

Assessing learning in the adaptive curriculum

BACKGROUND

Medical education is a dynamic process that will continuously evolve to respond to changes in the foundations of medicine, the clinical practice of medicine and in health systems science.

PURPOSE

In this paper, we review how assessing learning in such a dynamic environment requires comprehensive flexible and adaptable methodological approaches designed to assess knowledge attainment and transfer, clinical skills/competency development, and ethical/professional behavior. Adaptive assessments should measure the learner's ability to observe where changes in health care delivery are needed and how to implement them. Balancing formative and summative assessments will promote reflective learning so that each student will reach her/his highest potential. From the programmatic perspective, measuring the design and delivery of instruction in relation to students? efforts to achieve competency will improve learning and foster continuous professional development of faculty and advance the science of learning.

APPROACH

We describe how two medical schools are approaching adaptive assessment, including using portfolio systems that encompass teaching and learning experiences while offering real-time longitudinal tracking of digital data toward improving learning and provide curricula continuous improvement cycles. Using latest technologies, portfolios produce actionable data displays with precise guidance for learning and program development.

Preparing educators for adaptive education (AE) programs

CONTEXT

There has long been awareness that educational experiences should be individualized. In the health professions, this tenet remains inconsistently implemented. Adapting to the widely diverse characteristics of different learners requires educators who are prepared for planning and implementing adaptive education (AE).

RATIONALE

Learning experiences, for both educators and health professions students, can be substantially enhanced by mirroring clinical care, where we respect the uniqueness of each person and increasingly approach care as a collaboration. We are continuously "diagnostic," striving to understand our patients' clinical and life circumstances, adjusting to new findings. Learners are also unique in multiple, relevant ways. They deserve educators who work with them collaboratively and "diagnostically," adapting to changing information.

IMPLEMENTATION

Until recently, having educational programs that adapt to learner uniqueness was logistically and economically unrealistic. Now, thanks to deeper understandings of the learning process and new technologies, individualization is feasible. Here, we focus on the foundation step of preparing educators. Educator development: Suitably prepared educators are indispensable to success in becoming appropriately adaptive to learners' needs. For some educators, becoming more adaptive can be contrary to long-held assumptions and habits. We offer recommendations for effective educator development, without which authentic AE is unlikely.

Competency-Based, Time-Variable Education in the Health Professions: Crossroads

Health care systems around the world are transforming to align with the needs of 21st-century patients and populations. Transformation must also occur in the educational systems that prepare the health professionals who deliver care, advance discovery, and educate the next generation of physicians in these evolving systems. Competency-based, time-variable education, a comprehensive educational strategy guided by the roles and responsibilities that health professionals must assume to meet the needs of contemporary patients and communities, has the potential to catalyze optimization of educational and health care delivery systems. By designing educational and assessment programs that require learners to meet specific competencies before transitioning between the stages of formal education and into practice, this framework assures the public that every physician is capable of providing high-quality care. By engaging learners as partners in assessment, competency-based, time-variable education prepares graduates for careers as lifelong learners. While the medical education community has embraced the notion of competencies as a guiding framework for educational institutions, the structure and conduct of formal educational programs remain more aligned with a time-based, competency-variable paradigm.The authors outline the rationale behind this recommended shift to a competency-based, time-variable education system. They then introduce the other articles included in this supplement to Academic Medicine, which summarize the history of, theories behind, examples demonstrating, and challenges associated with competency-based, time-variable education in the health professions.