The problem with solutions

Unintended consequences of technology in competency-based education: a qualitative study of lessons learned in an OtoHNS program

BACKGROUND

Formative feedback and entrustment ratings on assessments of entrustable professional activities (EPAs) are intended to support learner self-regulation and inform entrustment decisions in competency-based medical education. Technology platforms have been developed to facilitate these goals, but little is known about their effects on these new assessment practices. This study investigates how users interacted with an e-portfolio in an OtoHNS surgery program transitioning to a Canadian approach to competency-based assessment, Competence by Design.

METHODS

We employed a sociomaterial perspective on technology and grounded theory methods of iterative data collection and analysis to study this OtoHNS program's use of an e-portfolio for assessment purposes. All residents (n = 14) and competency committee members (n = 7) participated in the study; data included feedback in resident portfolios, observation of use of the e-portfolio in a competency committee meeting, and a focus group with residents to explore how they used the e-portfolio and visualize interfaces that would better meet their needs.

RESULTS

Use of the e-portfolio to document, access, and interpret assessment data was problematic for both residents and faculty, but the residents faced more challenges. While faculty were slowed in making entrustment decisions, formative assessments were not actionable for residents. Workarounds to these barriers resulted in a "numbers game" residents played to acquire EPAs. Themes prioritized needs for searchable, contextual, visual, and mobile aspects of technology design to support use of assessment data for resident learning.

CONCLUSION

Best practices of technology design begin by understanding user needs. Insights from this study support recommendations for improved technology design centred on learner needs to provide OtoHNS residents a more formative experience of competency-based training.

"It's making me think outside the box at times": a qualitative study of dynamic capabilities in surgical training

Craft specialties such as surgery endured widespread disruption to postgraduate education and training during the pandemic. Despite the expansive literature on rapid adaptations and innovations, generalisability of these descriptions is limited by scarce use of theory-driven methods. In this research, we explored UK surgical trainees' (n = 46) and consultant surgeons' (trainers, n = 25) perceptions of how learning in clinical environments changed during a time of extreme uncertainty (2020/2021). Our ultimate goal was to identify new ideas that could shape post-pandemic surgical training. We conducted semi-structured virtual interviews with participants from a range of working/training environments across thirteen Health Boards in Scotland. Initial analysis of interview transcripts was inductive. Dynamic capabilities theory (how effectively an organisation uses its resources to respond to environmental changes) and its micro-foundations (sensing, seizing, reconfiguring) were used for subsequent theory-driven analysis. Findings demonstrate that surgical training responded dynamically and adapted to external and internal environmental uncertainty. Sensing threats and opportunities in the clinical environment prompted trainers' institutions to seize new ways of working. Learners gained from reconfigured training opportunities (e.g., splitting operative cases between trainees), pan-surgical working (e.g., broader surgical exposure), redeployment (e.g., to medical specialties), collaborative working (working with new colleagues and in new ways) and supervision (shifting to online supervision). Our data foreground the human resource and structural reconfigurations, and technological innovations that effectively maintained surgical training during the pandemic, albeit in different ways. These adaptations and innovations could provide the foundations for enhancing surgical education and training in the post-pandemic era.

Technical Difficulties: Teaching Critical Philosophical Orientations toward Technology

Issue: Technological innovation is accelerating, creating less time to reflect on the impact new technologies will have on the medical profession. Modern technologies are becoming increasingly embedded in routine medical practice with far-reaching impacts on the patient-physician relationship and the very essence of the health professions. These impacts are often difficult to predict and can create unintended consequences for medical education. This article is driven by a main question: How do we prepare trainees to critically assess technologies that we cannot foresee and effectively use technology to support equitable and compassionate care? Evidence: We translate insights from the philosophy of technology into a proposal for integrating critical technical consciousness in medical curricula. We identify three areas required to develop critical consciousness with regard to emerging technologies. The first area is technical literacy, which involves not just knowing how to use technology, but also understanding its limitations and appropriate contexts for use. The second area is the ability to assess the social impact of technology. This practice requires understanding that while technification creates new possibilities it can also have adverse, unintended consequences. The third area is critical reflection on the relationship between 'the human' and 'the technical' as it relates to the values of the medical profession and professional identity formation. Human and technology are two sides of the same coin; therefore, thinking critically about technology also forces us to think about what we consider 'the human side of medicine'. Implications: Critical technical consciousness can be fostered through an educational program underpinned by the recognition that, although technological innovation can create new possibilities for healing, technology is never neutral. Rather, it is imperative to emphasize that technology is interwoven with the social fabric that is essential to healing. Like medication, technology can be both potion and poison.

Blind spots in medical education: how can we envision new possibilities?

As human beings, we all have blind spots. Most obvious are our visual blind spots, such as where the optic nerve meets the retina and our inability to see behind us. It can be more difficult to acknowledge our other types of blind spots, like unexamined beliefs, assumptions, or biases. While each individual has blind spots, groups can share blind spots that limit change and innovation or even systematically disadvantage certain other groups. In this article, we provide a definition of blind spots in medical education, and offer examples, including unfamiliarity with the evidence and theory informing medical education, lack of evidence supporting well-accepted and influential practices, significant absences in our scholarly literature, and the failure to engage patients in curriculum development and reform. We argue that actively helping each other see blind spots may allow us to avoid pitfalls and take advantage of new opportunities for advancing medical education scholarship and practice. When we expand our collective field of vision, we can also envision more "adjacent possibilities," future states near enough to be considered but not so distant as to be unimaginable. For medical education to attend to its blind spots, there needs to be increased participation among all stakeholders and a commitment to acknowledging blind spots even when that may cause discomfort. Ultimately, the better we can see blind spots and imagine new possibilities, the more we will be able to adapt, innovate, and reform medical education to prepare and sustain a physician workforce that serves society's needs.

The Norms and Corporatization of Medicine Influence Physician Moral Distress in the United States

PhenomenonMoral distress, which occurs when someone's moral integrity is seriously compromised because they feel unable to act in accordance with their core values and obligations, is an increasingly important concern for physicians. Due in part to limited understanding of the root causes of moral distress, little is known about which approaches are most beneficial for mitigating physicians' distress. Our objective was to describe system-level factors in United States (U.S.) healthcare that contribute to moral distress among pediatric hospitalist attendings and pediatric residents.ApproachIn this qualitative study, we conducted one-on-one semi-structured interviews with pediatric hospitalist attendings and pediatric residents from 4 university-affiliated, freestanding children's hospitals in the U.S. between August 2019 and February 2020. Data were coded with an iteratively developed codebook, categorized into themes, and then synthesized.FindingsWe interviewed 22 hospitalists and 18 residents. Participants described in detail how the culture of medicine created a context that cultivated moral distress. Norms of medical education and the practice of medicine created conflicts between residents' strong sense of professional responsibility to serve the best interests of their patients and the expectations of a hierarchical system of decision-making. The corporatization of the U.S. healthcare system created administrative and financial pressures that conflicted with the moral responsibility felt by both residents and hospitalists to provide the care that their patients and families needed.InsightsThese findings highlight the critical role of systemic sources of moral distress. These findings suggest that system-level interventions must supplement existing interventions that target individual health care providers. Preventing and managing moral distress will require a broad approach that addresses systemic drivers, such as the corporatization of medicine, which are entrenched in the culture of medicine.

Changing Medical Education, Overnight: The Curricular Response to COVID-19 of Nine Medical Schools

Issue: Calls to change medical education have been frequent, persistent, and generally limited to alterations in content or structural re-organization. Self-imposed barriers have prevented adoption of more radical pedagogical approaches, so recent predictions of the 'inevitability' of medical education transitioning to online delivery seemed unlikely. Then in March 2020 the COVID-19 pandemic forced medical schools to overcome established barriers overnight and make the most rapid curricular shift in medical education's history. We share the collated reports of nine medical schools and postulate how recent responses may influence future medical education. Evidence: While extraneous pandemic-related factors make it impossible to scientifically distinguish the impact of the curricular changes, some themes emerged. The rapid transition to online delivery was made possible by all schools having learning management systems and key electronic resources already blended into their curricula; we were closer to online delivery than anticipated. Student engagement with online delivery varied with different pedagogies used and the importance of social learning and interaction along with autonomy in learning were apparent. These are factors known to enhance online learning, and the student-centered modalities (e.g. problem-based learning) that included them appeared to be more engaging. Assumptions that the new online environment would be easily adopted and embraced by 'technophilic' students did not always hold true. Achieving true distance medical education will take longer than this 'overnight' response, but adhering to best practices for online education may open a new realm of possibilities. Implications: While this experience did not confirm that online medical education is really 'inevitable,' it revealed that it is possible. Thoughtfully blending more online components into a medical curriculum will allow us to take advantage of this environment's strengths such as efficiency and the ability to support asynchronous and autonomous learning that engage and foster intrinsic learning in our students. While maintaining aspects of social interaction, online learning could enhance pre-clinical medical education by allowing integration and collaboration among classes of medical students, other health professionals, and even between medical schools. What remains to be seen is whether COVID-19 provided the experience, vision and courage for medical education to change, or whether the old barriers will rise again when the pandemic is over.