Questioning medical competence: Should the Covid-19 crisis affect the goals of medical education?

Introducing the Next Era in Assessment

In this introduction, the guest editors of the "Next Era in Assessment" special collection frame the invited papers by envisioning a next era in assessment of medical education, based on ideas developed during a summit that convened professional and educational leaders and scholars. The authors posit that the next era of assessment will focus unambiguously on serving patients and the health of society, reflect its sociocultural context, and support learners' longitudinal growth and development. As such, assessment will be characterized as transformational, development-oriented and socially accountable. The authors introduce the papers in this special collection, which represent elements of a roadmap towards the next era in assessment by exploring several foundational considerations that will make the next era successful. These include the equally important issues of (1) focusing on accountability, trust and power in assessment, (2) addressing implementation and contextualization of assessment systems, (3) optimizing the use of technology in assessment, (4) establishing infrastructure for data sharing and data storage, (5) developing a vocabulary around emerging sources of assessment data, and (6) reconceptualizing validity around patient care and learner equity. Attending to these priority areas will help leaders create authentic assessment systems that are responsive to learners' and society's needs, while reaping the full promise of competency-based medical education (CBME) as well as emerging data science and artificial intelligence technologies.

The Next Era of Assessment Within Medical Education: Exploring Intersections of Context and Implementation

In competency-based medical education (CBME), which is being embraced globally, the patient-learner-educator encounter occurs in a highly complex context which contributes to a wide range of assessment outcomes. Current and historical barriers to considering context in assessment include the existing post-positivist epistemological stance that values objectivity and validity evidence over the variability introduced by context. This is most evident in standardized testing. While always critical to medical education the impact of context on assessment is becoming more pronounced as many aspects of training diversify. This diversity includes an expanding interest beyond individual trainee competence to include the interdependency and collective nature of clinical competence and the growing awareness that medical education needs to be co-produced among a wider group of stakeholders. In this Eye Opener, we wish to consider: 1) How might we best account for the influence of context in the clinical competence assessment of individuals in medical education? and by doing so, 2) How could we usher in the next era of assessment that improves our ability to meet the dynamic needs of society and all its stakeholders? The purpose of this Eye Opener is thus two-fold. First, we conceptualize - from a variety of viewpoints, how we might address context in assessment of competence at the level of the individual learner. Second, we present recommendations that address how to approach implementation of a more contextualized competence assessment.

Power/knowledge: A sociomaterial perspective on a new accreditation process during COVID-19

INTRODUCTION

The COVID-19 pandemic had significant impacts on many aspects of health care and education, including the accreditation of medical education programmes. As a community of international educators, it is important that we study changes that resulted from the pandemic to help us understand educational processes more broadly. As COVID-19 unfolded in Canada, a revised format of undergraduate medical accreditation was implemented, including a shift to virtual site visits, a two-stage visit schedule, a focused approach to reviewing standards and the addition of a field secretary to the visit team. Our case study research aimed to evaluate the sociomaterial implications of these changes in format on the process of accreditation at two schools.

METHODS

We interviewed key informants to understand the impacts, strengths and limitations of changes made to the accreditation format. We used an abductive approach to analyse transcripts and applied a sociomaterial lens in looking for interconnections between the material and social changes that were experienced within the accreditation system.

RESULTS

Stakeholders within the accreditation system did not anticipate that changes to the accreditation format would have significant impacts on how accreditation functioned or on its overall outcomes. However, key informants described how the revised format of accreditation reconstructed how power was distributed and how knowledge was produced. The revised format contributed to changes in who held power within each of the programmes, within each of the visiting teams and between site members and visiting team members. As power shifted across stakeholders in response to material changes to the accreditation format, key informants described changes in how knowledge was produced.

CONCLUSIONS

Our findings suggest that the most powerful knowledge about any given programme might best be obtained through individualised tools, technologies and voices that are most meaningful to the unique context of each programme. Deliberate attention to how knowledge and power are influenced by the interactions between material and social processes within accreditation may help educators and leaders see the effects of change.

Physician-Patient Communication Course: When the Inauguration of a New Israeli Medical School Coincided with COVID-19 Pandemic

Purpose

The curriculum of the Adelson School of Medicine at Ariel University, the newly established sixth medical school in Israel, includes a simulation center-based extended course on physician-patient communication, aiming to help students master the core competency of interpersonal and communication skills. For more than a year following the emergence of the COVID-19 pandemic, the school suspended most face-to-face (F2F) encounters, transforming most teaching activities to remote platforms. The paper outlines the ways we adapted teaching of this course to these circumstances, the reactions of students and mentors to the changes and results of 1st year students' survey.

Methods

During the lockdown in the first year 48 of 70 first-year students participated in a voluntary anonymous online evaluation of the course assessing motivation to become a physician; perceptions, feelings and attitudes towards the communication course, and advantages and disadvantages of online and F2F medical interviews.

Results

46.1% of the responding students reported that the pandemic strengthened their desire to become physicians. 56.3% claimed that they were able to a relatively large extent to empathize with COVID-19 patients who were exposed to the virus; 79.1% viewed their mentors as positive role models of communication skills. The students were able to receive and offer social support to their peers. They evaluated very highly the short instructional videos produced by the faculty.

Conclusion

During the lockdown, the respondents generally indicated positive attitudes towards the communication course, the mentors and the inclusion of physician-patient communication as a topic in medical education. The students and mentors reported many disadvantages and few advantages of remote learning. Yet inevitably remote learning including online-based simulations is a step towards preparations for future practice within virtual medical care and telemedicine. The limitations of this study include the cross-sectional design, small sample size and self-reporting.

Transdisciplinary entrustable professional activities

Healthcare has become highly specialized. Specialists, in medicine as well as in nursing, determine much of the high quality of current health care. But healthcare has also become increasingly fragmented, with professionals trained in separate postgraduate silos, with boundaries often difficult to cross. While a century ago, generalists dominated patient care provision, now specialists prevail and risk becoming alienated from each other, losing the ability to adapt to neighboring professional domains. Current health care requires a flexible workforce, ready to serve in multiple contexts, as the COVID-19 crisis has shown.The new concept of transdisciplinary entrustable professional activities, EPAs applicable in more than one specialty, was recently conceived to enhance collaboration and transfer between educational programs in postgraduate nursing in the Netherlands.In this paper, we reflect on our experiences so far, and on practical and conceptual issues concerning transdisciplinary EPAs, such as: who should define, train, assess, and register transdisciplinary EPAs? How can different prior education prepare for similar EPAs? And how do transdisciplinary EPAs affect professional identity?We believe that transdisciplinary EPAs can contribute to creating more flexible curricula and hence to a more coherent, collaborative healthcare workforce, less determined by the boundaries of traditional specialties.

Let's Talk About it: The Utility of Formalized Support for Medical Residents

Medical residents are significantly impacted by burnout and depression. Recent events have only further increased the pressure and demands on the healthcare sector, intensifying the burden facing residents and posing a threat to residents' well-being. As a result, significant efforts are being made to provide formalized support and well-being programs. Yet, emergent evidence indicates that residents do not sufficiently utilize this form of support. Considering the organizational investment and focus on formalized support programs, we conducted a mixed-method study to investigate residents' utilization of formalized well-being support, and potential reasons for non-use. Our study was conducted during a period of increased work burden and stress for medical residents, where formalized support was specifically offered and targeted to medical staff. Our findings confirm earlier results of low support utilization and point to the importance of informal support mechanisms, in particular peer support. We conclude by discussing the role of managers and educational programs in facilitating a positive cultural shift to promote and support residents in seeking support.

Cultivating patient-centered care competence through a telemedicine-based course: An explorative study of undergraduate medical students' self-reflective writing

Background

The COVID-19 pandemic has encouraged adaptations of learning methods in clinical clerkship. There have been limited reports on the merits of involving medical students in telemedicine. This study, therefore, aims to investigate students' reflection on what they learned and identify the challenges and benefits of doctor-patient interaction through their experience in a telemedicine-based course.

Methods

A 4 week telemedicine-based course for medical students to participate in telemonitoring of COVID-19 patients undergoing self-isolation was conducted. This is a qualitative study using an interpretive phenomenology design to investigate students' self-reflection on their experiences in monitoring COVID-19 patients. Students were asked to reflect on their experience upon completion of the course through 750-1,000 words essays. A thematic analysis which considers units of meaning based on students' experiences was completed.

Results

Our study identified four main themes gathered from students' experiences related to the telemedicine-based course: communication and education, professionalism and professional identity formation, system-based practice, and patient-centered care.

Conclusion

The course was part of an integrative effort involving multiple parties to tackle the burden on the nation's healthcare system during the pandemic. Telemedicine is part of future medical practice which supports the medical curriculum adaptability along with attempts to develop future-proof medical doctors through various clinical learning experiences.

Analysis of Obligatory Involvement of Medical Students in Pandemic Response in the Czech Republic: Competencies, Experiences, and Legal Implications

Objectives: Medical students in the Czech Republic were mandated by the law to take part in the COVID-19 pandemic response in order to expand healthcare capacity. Our study aimed to analyze student's competencies defined in the legislation and compare them with competencies assigned to them in clinical settings during their deployment. Methods: Online survey with statistical analysis of collected data. Results: The survey was completed by 997 respondents. A major convergence between the system of credentials defined in the legal framework and the competencies that students performed were identified. Conclusion: Medical students represented a valuable resource for addressing shortages of qualified healthcare staff in critical situation. However, the system of competencies and credentials must be aligned with the educational framework to clearly define acquisition of competencies during the course of medical studies and the legal framework regulating students' deployment must ensure consistency of actual and formal competencies in order to guarantee high standards of care and safety of the patients.

Beyond the Digital Competencies of Medical Students: Concerns over Integrating Data Science Basics into the Medical Curriculum

Introduction. Data science is becoming increasingly prominent in the medical profession, in the face of the COVID-19 pandemic, presenting additional challenges and opportunities for medical education. We retrospectively appraised the existing biomedical informatics (BMI) and biostatistics courses taught to students enrolled in a six-year medical program. Methods. An anonymous cross-sectional survey was conducted among 121 students in their fourth year, with regard to the courses they previously attended, in contrast with the ongoing emergency medicine (EM) course during the first semester of the academic year 2020−2021, when all activities went online. The questionnaire included opinion items about courses and self-assessed knowledge, and questions probing into the respondents’ familiarity with the basics of data science. Results. Appreciation of the EM course was high, with a median (IQR) score of 9 (7−10) on a scale from 1 to 10. The overall scores for the BMI and biostatistics were 7 (5−9) and 8 (5−9), respectively. These latter scores were strongly correlated (Spearman correlation coefficient R = 0.869, p < 0.001). We found no correlation between measured and self-assessed knowledge of data science (R = 0.107, p = 0.246), but the latter was fairly and significantly correlated with the perceived usefulness of the courses. Conclusions. The keystone of this different perception of EM versus data science was the courses’ apparent value to the medical profession. The following conclusions could be drawn: (a) objective assessments of residual knowledge of the basics of data science do not necessarily correlate with the students’ subjective appraisal and opinion of the field or courses; (b) medical students need to see the explicit connection between interdisciplinary or complementary courses and the medical profession; and (c) courses on information technology and data science would better suit a distributed approach across the medical curriculum.

The Early Effects of the COVID-19 Pandemic on Pediatric Resident Education: A National Assessment

PURPOSE

Residency programs must ensure resident competence for independent practice. The COVID-19 pandemic disrupted healthcare delivery, impacting pediatric residencies. This study examines the impact on pediatric resident education.

METHODS

The authors conducted a mixed methods national survey of pediatric residency program directors (PDs) from May- July 2020. Data analysis included descriptive statistics, χ², Wilcox rank sum tests. Multivariable modeling identified factors associated with resident preparation for more senior roles. Thematic analysis was performed on open-ended questions about PD COVID-19 pandemic recommendations to peers, Accreditation Council for Graduate Medical Education and American Board of Pediatrics.

RESULTS

Response rate was 55% (110/199). PDs reported the COVID-19 pandemic negatively affected inpatient (n= 86, 78.2%), and outpatient education (n=104, 94.5%), procedural competence (n=64; 58.2%), and resident preparation for more senior roles (n= 50, 45.5%). In bivariate analyses, increasingly negative impacts on inpatient and outpatient education were associated with an increasingly negative impact on resident preparation for more senior roles (p=0.03, p=0.008), these relationships held true in multivariable analysis. Qualitative analysis identified 4 themes from PD recommendations: 1) Clear communication from governing bodies and other leaders; 2) Flexibility within programs and from governing bodies; 3) Clinical exposure is key for competency development; 4) Online platforms are important for education, communication, and support.

CONCLUSIONS

The COVID-19 pandemic negatively impacted inpatient and outpatient education. When these were more negatively impacted, resident preparation for more senior roles was worse. Highlighting the importance of competency based medical education to tailor experiences ensuring each resident is competent for independent practice.

WHAT'S NEW

The COVID-19 pandemic negatively impacted inpatient and outpatient clinical education which negatively impacted resident preparation for more senior roles. This highlights the importance of competency based medical education to ensure each graduating resident is competent for independent practice.

The void: COVID-19 restrictions and junior doctor education opportunities

BACKGROUND

In the setting of the COVID-19 pandemic, the modes of hospital service delivery, education, training, and the context surrounding them has undergone enormous change and disruptions.

OBJECTIVE

This study aimed to understand the 'lived-experience' of junior doctors in relation to their education, training, and professional development during the pandemic.

METHODS

A qualitative study based on thematic and cohort narrative analysis. 20 junior doctors who trained at an Australian tertiary paediatric hospital during the time of COVID-19 restrictions were interviewed. Based on a phenomenological approach, the interviews examined junior doctors' experiences in relation to medical education, adaptive education styles and the value attributed by participants to different forms of education provided to them.

RESULTS

Four overarching themes were identified regarding trainee perceptions of the impact of COVID-19 restrictions on learning opportunities, both positive and negative. These were: 'The void' - learning expectations junior doctors felt were missed, education affordances, peers and networks, and professional identity.

CONCLUSION

The pace with which educators have adapted to new teaching modes should be harnessed to incite equally novel curriculum evolution, smart investment in clinical moments, reconnect learning communities and create robust virtual learning environments.

Reimagining the Clinical Competency Committee to Enhance Education and Prepare for Competency-Based Time-Variable Advancement

Assessing residents and clinical fellows is a high-stakes activity. Effective assessment is important throughout training so that identified areas of strength and weakness can guide educational planning to optimize outcomes. Assessment has historically been underemphasized although medical education oversight organizations have strengthened requirements in recent years. Growing acceptance of competency-based medical education and its logical extension to competency-based time-variable (CB-TV) graduate medical education (GME) further highlights the importance of implementing effective evidence-based approaches to assessment. The Clinical Competency Committee (CCC) has emerged as a key programmatic structure in graduate medical education. In the context of launching a multi-specialty pilot of CB-TV GME in our health system, we have examined several program's CCC processes and reviewed the relevant literature to propose enhancements to CCCs. We recommend that all CCCs fulfill three core goals, regularly applied to every GME trainee: (1) discern and describe the resident's developmental status to individualize education, (2) determine readiness for unsupervised practice, and (3) foster self-assessment ability. We integrate the literature and observations from GME program CCCs in our institutions to evaluate how current CCC processes support or undermine these goals. Obstacles and key enablers are identified. Finally, we recommend ways to achieve the stated goals, including the following: (1) assess and promote the development of competency in all trainees, not just outliers, through a shared model of assessment and competency-based advancement; (2) strengthen CCC assessment processes to determine trainee readiness for independent practice; and (3) promote trainee reflection and informed self-assessment. The importance of coaching for competency, robust workplace-based assessments, feedback, and co-production of individualized learning plans are emphasized. Individual programs and their CCCs must strengthen assessment tools and frameworks to realize the potential of competency-oriented education.

Approaching Training-Practice Gaps After the Transition: A Practice Proposal for Supervision After Training

Transitions within medical, veterinarian, and other health professional training, from classroom to workplace, between undergraduate, postgraduate, fellowship phases, and to unsupervised clinical practice, are often stressful. Endeavors to alleviate inadequate connections between phases have typically focused on preparation of learners for a next phase. Yet, while some of these efforts show results, they cannot obliviate transitional gaps. If reformulated as ‘not completely ready to assume the expected responsibilities in the next phase’, transitions may reflect intrinsic problems in a training trajectory. Indeed, the nature of classroom teaching and even skills training for example, will never fully reflect the true context of clinical training. In various stages of clinical training, the supervision provided to trainees, particularly medical residents, has increased over the past decades. This addresses calls for enhanced patient safety, but may inadequately prepare trainees for unsupervised practice. Transitions often evolve around the question how much support or supervision incoming trainees or junior professionals require. We propose to consider receiving incoming trainees and new employees in clinical workplaces with a conversation about required supervision for discrete tasks, or entrustable professional activities (EPAs). EPAs lend themselves for the question: “At what level of supervision will you be able to carry out this task?”. This question can be answered by both the trainee or junior employee and the supervisor or employer and can lead to agreement about specified supervision for a defined period of time. We expect that this “supported autonomy tool” could alleviate stress and enhance continued development after transitions.

Adaptive leadership of doctors during COVID-19

PURPOSE

This study aims to examine the adaptive leadership of doctors during COVID-19 to understand the leadership competencies required for adaptive events.

DESIGN/METHODOLOGY/APPROACH

Phenomenology-based qualitative design was used. Data were collected from six doctors from the state of Kerala, India using semi-structured interviews.

FINDINGS

Five themes were identified. The first theme, core leadership shows that doctors perceive leaders as educators, learners and social beings. The second theme, adaptive challenges, describes the ambiguous pandemic-related challenges that doctors are facing including, unusual occupational demands, information overload, sociocultural issues and personal intricacies. The third theme reflects that for doctors, adaptive work during the pandemic included - new learning to address unique issues, changing perspectives and establishing and maintaining a safe and engaging workplace environment. The fourth theme describes the adaptive leadership competencies such as regulating distress, providing direction, maintaining disciplined action, fostering collaboration, empowering, understanding organizational linkages, strategic vision and communication skills. The fifth theme elucidates the lacunae in leadership training as perceived by the doctors.

RESEARCH LIMITATIONS/IMPLICATIONS

The findings can help in developing and enhancing competency frameworks for doctors' adaptive leadership.

ORIGINALITY/VALUE

This is one of the earliest studies to systematically examine components of adaptive leadership for doctors during COVID-19 and identify associated competencies.

Supervision, Interprofessional Collaboration, and Patient Safety in Intensive Care Units during the COVID-19 Pandemic

Background: To meet coronavirus disease (COVID-19) demands in the spring of 2020, many intensive care (IC) units (ICUs) required help of redeployed personnel working outside their regular scope of practice, causing an expansion and change of staffing ratios. Objective: How did this composite alternative ICU workforce experience supervision, interprofessional collaboration, and quality and safety of care under the unprecedented clinical circumstances at the height of the first pandemic wave as lived experiences uniquely captured during the first peak of the pandemic? Methods: An international, cross-sectional survey was conducted among physicians, nurses, and allied personnel deployed or redeployed to ICUs in Utrecht, New York, and Dublin from April to May of 2020. Data were analyzed separately for the three sites. Quantitative data were treated for descriptive statistics; qualitative data were analyzed thematically and combined for general interpretations. Results: On the basis of 234, 83, and 34 responses (response rates of 68%, 48%, and 41% in Utrecht, New York, and Dublin, respectively), we found that the amount of supervision and the quality and safety of care were perceived as being lower than usual but still acceptable. The working atmosphere was overwhelmingly felt to be collaborative and supportive. Where IC-certified nurse-to-patient ratios had decreased most (Utrecht), nurses voiced criticism about supervision and quality of care. Continuity within the work environment, team composition, and informal ("curbside") consultations were critical mediators of success. Conclusion: In the exceptional circumstances encountered during the COVID-19 pandemic, many ICUs were managed by a composite workforce of IC-certified and redeployed personnel. Although supervision is critical for safe care, supervisory roles were not clearly related to the amount of prior ICU experience. Vital for satisfaction with the quality of care was the span of control for those who assumed supervisory roles (i.e., the ratio of certified to noncertified personnel). Stable teams that matched less experienced personnel with more experienced personnel; a strong, interprofessional, collaborative atmosphere; a robust culture of informal consultation; and judicious, more flexible use of rules and regulations proved to be essential.

Health professions education scholarship: The emergence, current status, and future of a discipline in its own right

Medical education, as a domain of scholarly pursuit, has enjoyed a remarkably rapid development in the past 70 years and is now more commonly known as health professions education (HPE) scholarship. Evidenced by a solid increase of publications, numbers of specialized journals, professional associations, national and international conferences, academies for medical educators, masters and doctoral courses, and the establishment of many units of HPE scholarship, the domain of HPE education scholarship has matured into a scholarly discipline in its own right. In this contribution, the author reviews the developments of the field from Boyer's four criteria that determine scholarship: discovery, integration, application, and teaching. Born mid-20th century, and in the first decades developed in the predominant area of physician education, HPE scholarship has matured, with increasing breadth, depth, and volume of scholars, publications, conferences, and dedicated centers for research and development. The author concludes that, given the infrastructure that has emerged, HPE can arguably be considered a discipline in its own right. This academic question may not matter hugely for practices of scholarly work in this domain, and any stance in this academic debate inevitably reflects a personal view, but the author would support the view of health professions scholarship as being a unique niche, with inherent dependence on both medical and other health professional sciences, on the one hand, and social sciences, including educational sciences, on the other hand.