Validation of the Postgraduate Hospital Educational Environment Measure (PHEEM) in a sample of 731 Greek residents

Postgraduate medical trainees at a Ugandan university perceive their clinical learning environment positively but differentially despite challenging circumstances: a cross-sectional study

PURPOSE

The clinical learning environment is an essential component in health professions' education. Data are scant on how postgraduate trainees in sub-Saharan Africa perceive their medical school learning environments, and how those perceptions contribute to their engagement during training, their emotional wellbeing, and career aspirations. This study examined perceptions of postgraduate medical trainees (residents) in a resource-limited setting, regarding their learning environment and explored perceptual contributions to their career engagement during training. The data reported contribute to understanding how clinical learning environments can be improved in low-resource settings in Uganda and elsewhere.

METHODS

This study was done at the Faculty of Medicine of Mbarara University of Science and Technology in Uganda. We used a descriptive cross-sectional design involving sequential mixed methods. Quantitative data were collected using the Postgraduate Hospital Educational Environment Measure (PHEEM). Qualitative data were collected using focus group discussions.

RESULTS

Ninety of the 113 eligible residents responded (79.6%). Of these, 62 (68.9%) were males, 51 (56.7%) were third-year trainees, and the majority (40%) of the residents were aged between 30 and 34 years. Overall PHEEM scored 98.22 ± 38.09; Role Autonomy scored 34.25 ± 13.69, Teaching scored 39.7 ± 13.81, and Social Support scored 24.27 ± 10.59. Gender differences occurred in the perceptions of teaching and social support. Cronbach's alpha coefficient was 0.94 for the overall PHEEM. Five major themes were identified from the qualitative data (trainee support, supervision environment, engagement with overall learning environment, preparation for future practice, and challenges that impede training).

CONCLUSIONS

Overall, this study suggests that postgraduate trainees at the institution perceived the clinical learning environment positively amidst challenges of limited resources. Trainees' insights provided data that propose improvements on a number of domains in the learning environment.

Educational environment and mental wellbeing of medical and surgical postgraduate residents in Medellin, Colombia

INTRODUCTION

One of the most important moments in a doctor's life occurs when they do a medical residency. This period imposes stress and academic demands, which, together with the educational environment, allows for greater or lesser mental wellbeing. The objective of this study was to determine how the educational environment and mental wellbeing of medical residents are related.

METHODS

Analytical cross-sectional study, in residents of clinical-surgical specialties. The educational environment was assessed using the Postgraduate Hospital Educational Environment Measure (PHEEM), and mental wellbeing was assessed with the Warwick-Edinburgh Mental Wellbeing Scale (WEMWBS). Pearson's linear correlation was determined. Informed consent and approval by the university ethics committee were obtained.

RESULTS

The study population comprised 131 students, 43.8% male, with a median age of 28 years (interquartile range 4). In total, 87.9% of residents answered the survey. Of these, 65.9% were doing medical residencies and 34.1% surgical residencies. The mean PHEEM score was 107.96 ± 18.88, the positive emotions subscale was 29.32 ± 5.18 and positive functioning 23.61 ± 3.57, with a mean total mental wellbeing of 52.96 ± 8.44. A positive and moderate correlation was found between the total PHEEM score and each of the two mental wellbeing subscales (p < 0.001).

CONCLUSIONS

A positive correlation was found between a better perception of the educational environment and mental wellbeing by residents of clinical and surgical specialties with greater mental wellbeing.

Instrument for the evaluation of higher surgical training experience in the operating theatre

OBJECTIVE

The operating theatre, as the primary learning environment for surgeons, needs to be conducive to achieve successful training. A validated 27-item questionnaire aimed at evaluating the training experience of higher surgical trainees in the operating theatre was developed.

METHODS

The initial questionnaire was developed using a literature review and a focus group. Items were validated with content validity index (CVI) and Cronbach's alpha.

RESULTS

The initial version of 33 questions was modified in the focus group into a 29-item 4-point Likert scale questionnaire covering 3 areas. Of these 29 items, 27 reached the threshold CVI of 0.87, and they achieved a Cronbach's alpha of 0.89 from 17 responses.

CONCLUSION

The quantitative validations in the instrument are comparable to other existing medical education evaluation tools. Aspects of non-technical skills and human factors were featured heavily and perceived to be important for learning in the operating theatre.

Internal Medicine Residents' Perceptions of the Learning Environment of a Residency Training Program in Ethiopia: a Mixed Methods Study

INTRODUCTION

The learning environment is an important determinant of the quality of medical education. Having a good learning climate leads to improved learning process, satisfaction with education, and helps achieve the goals of the curriculum. Assessment of the quality of learning environment helps with the identification of areas that need improvement. The aim of this study was to assess the learning environment of internal medicine training program in Ethiopia.

METHODS

A mixed methods study using a cross-sectional survey using Postgraduate Hospital Educational Environment Measure and a qualitative study using a focus group discussion was done on internal medicine residents from December 2020 to May 2021. Comparison of quantitative data was done using Mann-Whitney U-Test and Kruskal-Wallis H-test. P-value <0.05 was considered statistically significant.

RESULTS

A total of 100 residents participated in the study. The overall total mean score of the responses of the participants was 70.87 (±19.8) with mean perceptions of role autonomy, perceptions of teaching and perceptions of social support of 25.9 (±7.1), 27.1 (10.2) and 17.9 (±5.1), respectively. These values suggest the presence of plenty of problems in the program. Higher mean scores were reported by males and by earlier years of residency. Ten residents participated in the focus group discussion. Four recurring themes that negatively affect learning environment were identified and included excessive workload, inadequate teaching activity, non-conducive hospital physical environment and lack of diagnostic and therapeutic modalities.

CONCLUSION

The internal medicine residency learning environment has many challenges that need immediate attention and follow-up.

Perceived wellness among pharmacy residents during COVID-19

Background

Well-being, burnout, and resiliency have been topics of discussion among health care providers over the last few years. Wellness can relate to many areas or domains in our lives such as financial, social, spiritual, physical, and occupational, whereas well-being is career focused. Wellness is multidimensional and encompasses different domains, and well-being usually focuses on a singular domain. Literature supports the study of well-being in health care workers; however, research is limited for assessing wellness in different domains of health care workers.

Objective

This study sought to describe perceived pharmacy resident wellness during the coronavirus disease 2019 (COVID-19) pandemic.

Methods

A 67-item survey was sent by e-mail to eligible study participants, including any postgraduate year (PGY) 1, 2, or 24-month pharmacy resident completing/completed their training in June 2019-July 2020. The primary outcome was perceived resident wellness based on the 7 domains from Princeton UMatter Wellness Self-Assessment, developed to measure self-perceptions of wellness across dimensions. Descriptive statistics and participant scores were aggregated and presented as a total domain score. Statistics and scores were determined from completed surveys.

Results

A total of 418 participants accessed the survey, 384 met inclusion criteria, and 326 completed the survey. Of the participants, 77% were female with 85% completing a traditional PGY-1 residency program. The wellness domain with the lowest total was physical wellness, with a domain median of 23 of 28. The highest-scoring domain was social wellness, with a median of 27.

Conclusion

Perceived resident wellness during COVID-19 was highest in the social domain and lowest in the physical wellness domain. Residency programming administrators could use this information to make improvements to orientation practices and wellness domain programming throughout the duration of residency training during a pandemic.

Educational Environment and Mental Wellbeing of Medical and Surgical Postgraduate Residents in Medellin, Colombia

INTRODUCTION

One of the most important moments in a doctor's life occurs when they do a medical residency. This period imposes stress and academic demands, which, together with the educational environment, allows for greater or lesser mental wellbeing. The objective of this study was to determine how the educational environment and mental wellbeing of medical residents are related.

METHODS

Analytical cross-sectional study, in residents of clinical-surgical specialties. The educational environment was assessed using the Postgraduate Hospital Educational Environment Measure (PHEEM), and mental wellbeing was assessed with the Warwick-Edinburgh Mental Wellbeing Scale (WEMWBS). Pearson's linear correlation was determined. Informed consent and approval by the university ethics committee were obtained.

RESULTS

The study population comprised 131 students, 43.8% male, with a median age of 28 years (interquartile range 4). In total, 87.9% of residents answered the survey. Of these, 65.9% were doing medical residencies and 34.1% surgical residencies. The mean PHEEM score was 107.96±18.88, the positive emotions subscale was 29.32±5.18 and positive functioning 23.61±3.57, with a mean total mental wellbeing of 52.96±8.44. A positive and moderate correlation was found between the total PHEEM score and each of the two mental wellbeing subscales (p <0.001).

CONCLUSIONS

A positive correlation was found between a better perception of the educational environment and mental wellbeing by residents of clinical and surgical specialties with greater mental wellbeing.

Moroccan residents' perception of hospital learning environment measured with French version of the postgraduate hospital educational environment measure

PURPOSE

This study aimed to assess the educational environment of resident in Morocco and to compare the residents' perception depending on their specialties.

METHODS

We applied the French version of the postgraduate hospital educational environment measure (PHEEM) to measure the educational environment in 6 hospitals in Rabat from January to June 2017. Internal reliability of the questionnaire was assessed using Cronbach's alpha coefficient. Principal component analysis was conducted to assess the construct validity of the three subscales of the PHEEM questionnaire. Variance analysis (ANOVA test) was performed to compare means of PHEEM overall, subscale, and each item score among 6 specialties.

RESULTS

The response of 255 resident was included. The 40 items PHEEM questionnaire showed reliability with a Cronbach's alpha of 0.91. Principal component analysis on all 40 items suggested three factors explaining 48% of the variance with better results for the teaching subscale. Moroccan resident perceived their educational environment as more positive than negative. There was a significant difference in the overall and subscales score among the 6 specialties.

CONCLUSION

French version of the PHEEM score is a valid and reliable instrument in Morocco. Moroccan resident perceived their educational environment as more positive than negative but room for improvement of many challenges particularly the poor infrastructure, the suboptimal quality of supervision, and teaching and inadequate work regulation remained.

Understanding the Mentoring Environment Through Thematic Analysis of the Learning Environment in Medical Education: a Systematic Review

BACKGROUND

Mentoring's success has been attributed to individualised matching, holistic mentoring relationships (MRs) and personalised mentoring environments (MEs). Whilst there is growing data on matching and MRs, a dearth of ME data has hindered development of mentoring programme. Inspired by studies likening MEs to learning environments (LEs) and data highlighting common characteristics between the two, this systematic review scrutinises reports on LEs to extrapolate the findings to the ME context to provide a better understanding of ME and their role in the mentoring process.

METHODS

Using identical search strategies, 6 reviewers carried out independent literature reviews of LEs in clinical medicine published between 1 January 2000 and 31 December 2015 using PubMed, ERIC, Cochrane Database of Systematic Reviews, Google Scholar and Scopus databases. Braun and Clarke's (2006) approach to thematic analysis was adopted to circumnavigate LE's evolving, context-specific, goal-sensitive, learner-tutor relationally dependent nature.

RESULTS

A total of 4574 abstracts were identified, 90 articles were reviewed, and 58 full-text articles were thematically analysed. The two themes identified were LE structure and LE culture. LE structure regards the framework that guides interactions within the LE. LE culture concerns the values and practices influencing learner-tutor-host organisation interactions.

DISCUSSION

LE is the product of culture and structure that influence and are influenced by the tutor-learner-host organisation relationship. LE structure guides the evolving tutor-learner-host organisation relationship whilst the LE culture nurtures it and oversees the LE structure. Similarities between LEs and MEs allow LE data to inform programme designers of ME's role in mentoring's success.

Validity of the scan of postgraduate educational environment domains (SPEED) questionnaire in a rural general practice training setting

BACKGROUND

The educational environment is critical to learning and is determined by social interactions. Trainee satisfaction translates to career commitment, retention and a positive professional attitude as well as being an important factor in assessing the impact of the training program. This study aimed to validate the Scan of Postgraduate Educational Environment Domain (SPEED) tool and assess its appropriateness in evaluating the quality of General Practice (GP) rural postgraduate educational environment.

METHODS

A questionnaire containing the 15-item SPEED tool was administered to GP registrars to examine their perceptions of the educational environment. Principal component analysis (PCA) and exploratory factor analysis (EFA) were used to gather evidences of the validity of the instrument based on its internal structure. Additional validity evidence and reliability estimates were obtained using many-facet Rasch model analysis (MFRM).

RESULTS

The survey was completed by 351 registrars with a response rate of 60%. Parallel analysis performed using principal component analysis and exploratory factor analysis suggests that the SPEED tool is unidimensional. The MFRM analysis demonstrated an excellent degree of infit and outfit for items and training sites, but not for persons. The MFRM analysis also estimated high reliability levels for items (0.98), training sites (0.95) and persons within training sites (ranging from 0.87 to 0.93 in each training sites). Overall, the registrars agreed that the educational environment had high quality, with most (13 out of 15) of the items rated above 4 out of 5.

CONCLUSIONS

This study demonstrated a high degree of validity and reliability of the SPEED tool for the measurement of the quality of the educational environment in a rural postgraduate GP training context. However, when applied in a new setting, the tool may not function as a multidimensional tool consistent with its theoretical grounding.

Perceptions of emergency medicine residents on the quality of residency training in the United States and Saudi Arabia

BACKGROUND

We compare educational environments (i.e. physical, emotional and intellectual experiences) of emergency medicine (EM) residents training in the United States of America (USA) and Saudi Arabia (SA).

METHODS

A cross-sectional survey study was conducted using an adapted version of the validated Postgraduate Hospital Educational Environment Measure (PHEEM) survey instrument from April 2015 through June 2016 to compare educational environments in all emergency medicine residency programs in SA and three selected programs in the USA with a history of training Saudi physicians. Overall scores were compared across programs, and for subscales (autonomy, teaching, and social Support), using chi-squared, t-tests, and analysis of variance.

RESULTS

A total of 219 surveys were returned for 260 residents across six programs (3 SA, 3 USA), with a response rate of 84%. Program-specific response rates varied from 79%-100%. All six residencies were qualitatively rated as "more positive than negative but room for improvement". Quantitative PHEEM scores for the USA programs were significantly higher: 118.7 compared to 109.9 for SA, P=0.001. In subscales, perceptions of social support were not different between the two countries (P=0.243); however, role autonomy (P<0.001) and teaching (P=0.005) were better in USA programs. There were no significant differences by post-graduate training year.

CONCLUSION

EM residents in all three emergency medicine residency programs in SA and the three USA programs studied perceive their training as high quality in general, but with room for improvements. USA residency programs scored higher in overall quality. This was driven by more favorable perceptions of role autonomy and teaching. Understanding how residents perceive their programs may help drive targeted quality improvement efforts.

The learning environment of paediatric interns in South Africa

BACKGROUND

South African (SA) paediatric interns (recently qualified medical graduates) work in a high disease burdened and resource deficient environment for two years, prior to independent practice. Perceptions of this learning environment (LE) influences their approaches to training as well as the outcomes of this period of development. Obstacles to creating a supportive LE and supervisor interaction affects the quality of this training. Measuring perceptions of the LE with validated instruments can help inform improvements in learning during this crucial period of medical education.

METHODS

The aims of this study was to determine the psychometric qualities of the Postgraduate Hospital Educational Environment Measure (PHEEM) amongst paediatric interns across four hospital complexes in South Africa and to measure the LE as perceived by both interns and their supervisors. Construct validity was tested using factor analysis and internal consistency was measured with Cronbach's alpha.

RESULTS

A total of 209 interns and 60 supervisors (69% intern response rate) responded to the questionnaire. The PHEEM was found to be very reliable with an overall Cronbach's alpha of 0.943 and 0.874 for intern and supervisors respectively. Factor analysis using a 3-factor solution accounted for 42% of the variance with the teaching subscale having the best fit compared with the other sub-scales of the original tool. Most interns perceived the learning environment as being more positive than negative however, their perceptions differed significantly from that of their supervisors. Poor infrastructural support from institutions, excessive workloads and inadequate supervision were factors preventing optimal training of paediatric interns.

CONCLUSIONS

The SA version of the PHEEM tool used was found to be a reliable and valid instrument for use in interns amongst high disease burdened contexts. Various obstacles to creating an ideal learning environment for paediatric interns were identified to be in need of urgent review. Key differences in perceptions of an ideal learning environment between interns and their supervisors need to be fully explored as these may result in sub-optimal supervision and mentoring.