Assessing the Learning Environment for Medical Students: An Evaluation of a Novel Survey Instrument in Four Medical Schools

Exploring Unprofessional Behaviors and Biased Perceptions in the Clinical Environment: Students' Perspectives

Professionalism stands as a fundamental cornerstone within the realm of physician training, representing a core competency that holds significant importance. It entails creating workplaces that are physically and psychologically safe within the health care system. Positive role modeling from health professionals is important in creating a learning environment that fosters diversity, equity, and inclusion for all. Using the mixed-methods sequential design, this study investigated unprofessional behaviors and biased perceptions demonstrated by health professionals as perceived and experienced by medical students during their clinical rotations at one medical school. Seventy-three M3 students and 37 M4 students responded to the survey, followed by three focus groups (n = 11) to further examine unprofessionalism and biases as well as impacts on performance, learning opportunities, and well-being. The results from both the quantitative and qualitative data demonstrate the presence of unprofessionalism and biases within the current medical education environment. These issues include a lack of respect and compassion, a lack of commitment to professional duties, malfunctioning teamwork, and a lack of sensitivity towards individuals regardless of their group affiliations. The unprofessional behaviors and biased perceptions have detrimental impacts on students' performance, learning, and well-being. The reasons behind unprofessionalism and bias are multifaceted, influenced by societal and local environmental factors that extend beyond individual beliefs and values. By collecting empirical data on students' experiences and perceptions, the study sheds light on the areas that need improvement and offers insights into adopting strategies to decrease unprofessional conducts and foster a respectful and inclusive learning environment.

A scoping review of the questionnaires used for the assessment of the perception of undergraduate students of the learning environment in healthcare professions education programs

The learning environment (LE) includes social interactions, organizational culture, structures, and physical and virtual spaces that influence the learning experiences of students. Despite numerous studies exploring the perception of healthcare professional students (HCPS) of their LE, the validity evidence of the utilized questionnaires remains unclear. This scoping review aimed to identify questionnaires used to examine the perception of undergraduate HCPS of their LE and to assess their validity evidence. Five key concepts were used: (1) higher education; (2) questionnaire; (3) LE; (4) perception; and (5) health professions (HP). PubMed, ERIC, ProQuest, and Cochrane databases were searched for studies developing or adapting questionnaires to examine LE. This review employed the APERA standards of validity evidence and Beckman et al. (J Gen Intern Med 20:1159-1164, 2005) interpretation of these standards according to 5 categories: content, internal structure, response process, relation to other variables, and consequences. Out of 41 questionnaires included in this review, the analysis revealed a predominant emphasis on content and internal structure categories. However, less than 10% of the included questionnaires provided information in relation to other variables, consequences, and response process categories. Most of the identified questionnaires received extensive coverage in the fields of medicine and nursing, followed by dentistry. This review identified diverse questionnaires utilized for examining the perception of students of their LE across different HPs. Given the limited validity evidence for existing questionnaires, future research should prioritize the development and validation of psychometric measures. This will ultimately ensure sound and evidence-based quality improvement measures of the LE in HP education programs.

Barriers and Facilitators to Pediatric Resident Education in the Emergency Department: A Qualitative Study

Objective Local resident evaluations of the pediatric emergency department (ED) declined over the last five years. Sparse literature exists on resident perspectives of educational experiences. This study explored the barriers and facilitators to resident education in the Pediatric ED. Methods This qualitative study utilized focus groups at a large pediatric training hospital. Trained facilitators performed semi-structured interviews prompting discussion of resident experiences in the pediatric ED. One pilot and six focus groups (38 pediatric residents) achieved data saturation. Sessions were audio recorded, de-identified and transcribed by a professional service. Three authors (CJ, JM, SS) analyzed the transcripts independently using line-by-line coding. Following code agreement, authors identified central themes drawing on grounded theory. Results Six categories emerged: (1) ED environment, (2) consistent goals, expectations, and resources, (3) ED workflow, (4) preceptor accessibility, (5) resident growth and development, (6) ED preconceived notions. Residents value a respectful work environment despite the chaotic nature of the ED. They need clear goals and expectations with a strong orientation. Autonomy, open communication and shared decision-making allow residents to feel like team members. Residents gravitate toward welcoming, available preceptors that enthusiastically teach. More ED environment exposure increases comfort and efficiency and helps develop medical decision-making skills. Residents admit ED preconceptions and personality traits affect performance. Conclusion Residents self-identified barriers and facilitators to ED education. Educators must provide a safe and open learning environment, clear rotation expectations and goals, consistent positivity supporting shared decision making, and allow residents autonomy to build their practice styles.

Selecting Instruments for Measuring the Clinical Learning Environment of Medical Education: A 4-Domain Framework

Learning environments shape the experiences of learners and practitioners, making them an important component of program evaluation. However, educators find it challenging to decide whether to measure clinical learning environments with existing instruments or to design their own new instrument and, if using an existing instrument, which to choose. To assist educators with these decisions, the authors compared clinical learning environment instruments based on their characteristics, underlying constructs, and degree to which items reflect 4 domains (personal, social, organizational, material) from a recently developed model for conceptualizing learning environments in the health professions. Building on 3 prior literature reviews as well as a literature search, the authors identified 6 clinically oriented learning environment instruments designed for medical education. They collected key information about each instrument (e.g., number of items and subscales, conceptual frameworks, operational definitions of the learning environment) and coded items from each instrument according to the 4 domains. The 6 instruments varied in number of items, underlying constructs, subscales, definitions of clinical learning environment, and domain coverage. Most instruments focused heavily on the organizational and social domains and less on the personal and material domains (half omitted the material domain entirely). The variations in these instruments suggest that educators might consider several guiding questions. How will they define the learning environment and which theoretical lens is most applicable (e.g., personal vitality, sociocultural learning theory)? What aspects or domains of the learning environment do they most wish to capture (e.g., personal support, social interactions, organizational culture, access to resources)? How comprehensive do they want the instrument to be (and correspondingly how much time do they expect people to devote to completing the instrument and how frequently)? Whose perspective do they wish to evaluate (e.g., student, resident, fellow, attending, team, patient)? Each of these considerations is addressed.

Resident Vitality in 34 Programs at 14 Academic Health Systems: Insights for Educating Physicians and Surgeons for the Future

OBJECTIVE

To clarify our understanding of how the culture of residency training influences the well-being of residents, this study reports on the vitality of residents at 34 programs across the United States and identifies characteristics of the programs, institutions and residents that are associated with high resident vitality.

DESIGN

In 2014 to 2015, residents nationally were surveyed using the validated C - Change Resident Survey. The survey assessed residents' vitality and 12 other dimensions that characterize residents' perspectives of the culture of the residency training programs: Self-efficacy, Institutional/program support, Relationships/inclusion/trust, Values alignment, Ethical/moral distress, Respect, Leadership aspirations, Mentoring, Work-life integration, Gender equity, Racial/ethnic minority equity, and self-assessed Competencies. Multilevel models were used to assess vitality within and across programs, and examine predictors including resident, program, and institution characteristics.

PARTICIPANTS

Two thousand four hundred and fifty-two residents from 11 General Surgery, 12 Internal Medicine, and 11 Pediatrics programs at 14 U.S. academic health systems.

RESULTS

One thousand seven hundred and eight residents responded (70% response rate). The mean Vitality score was 3.6 (range 1-5, where values of 4-5 represent high Vitality). There was wide variation among the 34 programs in the percent of residents who had high Vitality scores, ranging from 17% to 71%. However, the average Vitality scores within specialty (Surgery, Medicine, and Pediatrics) were not significantly different. The strongest predictors of Vitality were Work-life integration, Relationships/inclusion/trust, Institutional/program support, Res?>pect, Values alignment, and Ethical/moral distress, which together accounted for 50% of vitality variance. Individual demographics accounted for just 3% of variance.

CONCLUSIONS

Vitality is an essential component of resident well-being, and within each specialty there are programs that have excelled in promoting a culture of high vitality. Our findings suggest that we should test interventions to enhance resident vitality by focusing greater attention on providing institutional support, aligning individual and institutional values, integrating work and personal life, and facilitating relationships, inclusiveness and trust.

'I feel like I sleep here': how space and place influence medical student experiences

CONTEXT

Buildings and learning spaces contribute in crucial ways to people's experiences of these spaces. However, this aspect of context has been under-researched in medical education. We addressed this gap in knowledge by using the conceptual notions of space and place as heuristic lenses through which to explore the impact of a new medical school building on student experiences.

METHODS

We carried out an exploratory case study to explore the impact of a new medical school building on student experiences. Data were collected from archived documents (n = 50), interviews with key stakeholders (n = 17) and focus group discussions with students (n = 17 participants) to provide context and aid triangulation. Data coding and analysis were initially inductive and conducted using thematic analysis. After themes had emerged, we applied the concepts of boundary objects, liminal space and Foucault's panopticon to provide a framework for the data.

RESULTS

There were specific visions and intentions for the place (the location) and space (the facilities) of the new medical school building (e.g. it was positioned to facilitate flow between educational and clinical settings). However, the unintentional consequences of the planning were that students felt disconnected from the wider university, trapped on the health care campus, and under pressure to behave not like students but in a manner they believed to be expected by clinical staff and patients.

CONCLUSIONS

Despite much effort and a focus on creating an idyllic space and place, the new medical school had both positive and (unintentionally) negative impacts on student experiences. These findings highlight the importance of reflecting on, and exploring, how space and place may influence and shape students' learning experiences during the formative years of their development of a professional identity, a necessary consideration when planning new medical school learning spaces or changing these spaces.

Tracking Student Mistreatment Data to Improve the Emergency Medicine Clerkship Learning Environment

Introduction

Medical student mistreatment is a prevalent and significant challenge for medical schools across the country, associated with negative emotional and professional consequences for students. The Association of American Medical Colleges and Liaison Committee on Medical Education have increasingly emphasized the issue of mistreatment in recent years, and medical schools are tasked with creating a positive learning climate.

Methods

The authors describe the efforts of an emergency department (ED) to improve its clerkship learning environment, using a multifaceted approach for collecting mistreatment data and relaying them to educators and clerkship leadership. Data are gathered through end-of-rotation evaluations, teaching evaluations, and an online reporting system available to medical students. Mistreatment data are then relayed to the ED during semi-annual meetings between clerkship leadership and medical school assistant deans, and through annual mistreatment reports provided to department chairs.

Results

Over a two-year period, students submitted a total of 56 narrative comments related to mistreatment or unprofessional behavior during their emergency medicine (EM) clerkship. Of these comments, 12 were submitted in 2015-16 and 44 were submitted in 2016-17. The most frequently observed themes were students feeling ignored or marginalized by faculty (14 comments); students being prevented from speaking or working with patients and/or attending faculty (11 comments); and students being treated in an unprofessional manner by staff (other than faculty, 8 comments).

Conclusion

This article details an ED's efforts to improve its EM clerkship learning environment by tracking mistreatment data and intentionally communicating the results to educators and clerkship leadership. Continued mistreatment data collection and faculty development will be necessary for these efforts to have a measurable effect on the learning environment.

Assessing the Culture of Residency Using the C - Change Resident Survey: Validity Evidence in 34 U.S. Residency Programs

BACKGROUND

A practical instrument is needed to reliably measure the clinical learning environment and professionalism for residents.

OBJECTIVE

To develop and present evidence of validity of an instrument to assess the culture of residency programs and the clinical learning environment.

DESIGN

During 2014-2015, we surveyed residents using the C - Change Resident Survey to assess residents' perceptions of the culture in their programs.

PARTICIPANTS

Residents in all years of training in 34 programs in internal medicine, pediatrics, and general surgery in 14 geographically diverse public and private academic health systems.

MAIN MEASURES

The C - Change Resident Survey assessed residents' perceptions of 13 dimensions of the culture: Vitality, Self-Efficacy, Institutional Support, Relationships/Inclusion, Values Alignment, Ethical/Moral Distress, Respect, Mentoring, Work-Life Integration, Gender Equity, Racial/Ethnic Minority Equity, and self-assessed Competencies. We measured the internal reliability of each of the 13 dimensions and evaluated response process, content validity, and construct-related evidence validity by assessing relationships predicted by our conceptual model and prior research. We also assessed whether the measurements were sensitive to differences in specialty and across institutions.

KEY RESULTS

A total of 1708 residents completed the survey [internal medicine: n = 956, pediatrics: n = 411, general surgery: n = 311 (51% women; 16% underrepresented in medicine minority)], with a response rate of 70% (range across programs, 51-87%). Internal consistency of each dimension was high (Cronbach α: 0.73-0.90). The instrument was able to detect significant differences in the learning environment across programs and sites. Evidence of validity was supported by a good response process and the demonstration of several relationships predicted by our conceptual model.

CONCLUSIONS

The C - Change Resident Survey assesses the clinical learning environment for residents, and we encourage further study of validity in different contexts. Results could be used to facilitate and monitor improvements in the clinical learning environment and resident well-being.