A Systematic Review of the Quality and Utility of Observer-Based Instruments for Assessing Medical Professionalism

Exploring Unprofessional Behaviors and Biased Perceptions in the Clinical Environment: Students' Perspectives

Professionalism stands as a fundamental cornerstone within the realm of physician training, representing a core competency that holds significant importance. It entails creating workplaces that are physically and psychologically safe within the health care system. Positive role modeling from health professionals is important in creating a learning environment that fosters diversity, equity, and inclusion for all. Using the mixed-methods sequential design, this study investigated unprofessional behaviors and biased perceptions demonstrated by health professionals as perceived and experienced by medical students during their clinical rotations at one medical school. Seventy-three M3 students and 37 M4 students responded to the survey, followed by three focus groups (n = 11) to further examine unprofessionalism and biases as well as impacts on performance, learning opportunities, and well-being. The results from both the quantitative and qualitative data demonstrate the presence of unprofessionalism and biases within the current medical education environment. These issues include a lack of respect and compassion, a lack of commitment to professional duties, malfunctioning teamwork, and a lack of sensitivity towards individuals regardless of their group affiliations. The unprofessional behaviors and biased perceptions have detrimental impacts on students' performance, learning, and well-being. The reasons behind unprofessionalism and bias are multifaceted, influenced by societal and local environmental factors that extend beyond individual beliefs and values. By collecting empirical data on students' experiences and perceptions, the study sheds light on the areas that need improvement and offers insights into adopting strategies to decrease unprofessional conducts and foster a respectful and inclusive learning environment.

Performance, interpersonal relationships and professional satisfaction: determinants to support pharmaceutical reengineering

Professionalism represents the ethical contract that binds professionals and society. Its technical aspects, such as the professional practice model, form the foundation for attitudinal and behavioral characteristics, including the fiduciary relationship between pharmacists and patients. Despite significant interest in the topic, contextualizing professionalism proves to be a challenging endeavor, relying on collaboration among formal leaders, academics, and practitioners in the field. Consequently, defining, understanding, teaching, and evaluating pharmaceutical professionalism contribute to shape societal perceptions and the understanding of pharmacists and students, who may occasionally struggle to grasp the underlying rationale behind professional practices. Moreover, contextualizing professionalism entails addressing various challenges, such as fostering support for professionalism and its adaptation, which encompasses pharmacists' performance across diverse clinical services, their interpersonal interactions with patients, families, communities, and fellow healthcare professionals, as well as personal job satisfaction amidst obstacles as job insecurity, ethical dilemmas, and compromised autonomy.

Assessment of Professionalism in Pharmacists and Pharmacy Students: Scoping Review of Instruments and Validity Evidence

OBJECTIVE

To characterize which instruments have been developed to assess professionalism in the field of pharmacy.

FINDINGS

A scoping review was conducted to answer which instruments have been developed to assess professionalism in the field of Pharmacy. The databases consulted were EMBASE, ERIC, PUBMED/Medline, Scopus, and Web of Science. No restrictions on language or year of publication were made. Only studies about development or translation of instruments for professionalism assessment were included. The methodological quality of studies was verified by the Questionnaire Cross-Cultural Adaptation Guideline and the COnsensus-based Standards for the selection of health Measurement INstruments. Seven studies met the eligibility criteria and were included in this scoping review. In general, the instruments were developed from ideological elements assigned to professionalism by pharmaceutical and medical entities, in addition to theoretical references that came from social sciences. Regarding the evaluation of validation and psychometric property evidence, the studies generally adopted distinct procedures which highlights some destandardization, although the methodological quality was accepted.

SUMMARY

More studies on the professionalism field should be conducted to characterize professionalism and develop pharmaceutical practices in line with societal demands and expectations.

"Opportunities and responsibilities": how do pharmacists assess their professionalism?

INTRODUCTION

Professionalism is fundamental to the existence of professions. In pharmacy, interest in this theme improved with events that examined the resocialization of pharmacists in care. With this, evaluating professionalism can help the operationalization of the theme and, consequently, the development of strategies for pharmacy consolidation before its challenges. Therefore, this study aimed to evaluate the professionalism of Brazilian pharmacists.

METHODS

To meet the objective, a cross-sectional study was conducted between March 2022 and August 2023. Data were collected using the Brazilian version of the "Modification of Hall's Professionalism Scale for Use with Pharmacists". The scale has 39 items grouped into the domains: autonomy, vocation, professional council, self-regulation, continuing education, and altruism. Data were analyzed using descriptive statistics and an ANOVA analysis of variance with post-hoc Hochberg or Games-Howell tests with Bootstrapping was conducted to verify differences between groups.

RESULTS

600 pharmacists participated in this study. The majority (69%) was female and carried out their professional activities in community pharmacies (50%). Professionalism scores ranged between 14 and 29 points, with an average of 22.8 points. Pharmacists working in outpatient clinics had higher scores in most factors, namely, altruism, continuing education, professional council, vocation, and autonomy. This indicates that the inclination of pharmacists to occupy areas focused on care can be significant to assess professionalism.

CONCLUSIONS

The data obtained indicate that pharmacists working in outpatient clinics had higher professionalism scores compared to others. This corroborates the worldwide trend experienced by pharmacy in recent decades, which is the execution of increasingly patient-centered practice models.

The Effect of Teaching Professionalism by Using Real Lifetime Scenarios in Undergraduate Medical Students: An Educational Trial

Introduction

The objective of this research is to evaluate the effect of teaching professionalism by real lifetime scenario to undergraduate MBBS medical students.

Methods

This comparative quasi-experimental trial was conducted in OBS/GYN department from May 2019 to Jan 2020. The final year MBBS students of Shalamar Medical and Dental College, Lahore, who attended the clinical rotation of Gynae OBS were enrolled in the study using consecutive sampling. Each batch consists of 15 students. The first two batches were taken as active control, whereas the third batch was taken as an interventional group. The certified faculty in medical education assessed professionalism by using P-MEX at the start and end of the rotation in the gynae ward. P-MEX data are presented as mean and standard deviation. The comparison between the two groups was done using independent sample t-test, and pre- and post-comparison within group was done by paired sample t-test. P-value less than 0.05 was considered as significant.

Results

Among the 45 students, 28(62.22%) were male and 17(37.78%) were female. Age and gender were statistically similar in both groups. The average total score, at the start of the rotation of the intervention group was 1.95±0.294, whereas the active control group was 2.23±0.31. At the end of the rotation, the average total score of the intervention group was 3.22±0.48 and active control was 2.56±0.53. Pre- and post P-MEX score was statistically significant with P<0.001.

Conclusion

This research showed that the teaching of professionalism using real lifetime scenarios led to statistically significant improvement of professionalism in the form of P-MEX mean score among final MBBS students.

Perception of dental students and faculty regarding the practice of professionalism in dentistry using the Professionalism Mini Evaluation Exercise (P-MEX)

BACKGROUND

Professionalism is one of the fundamental traits which includes behaviors, commitments, standards, and goals that helps define a profession.

OBJECTIVE

This study aimed to assess the attitude of dental students and graduates regarding the practice of professionalism in dentistry using the Professionalism Mini Evaluation Exercise (P-MEX) questionnaire.

METHOD

This cross-sectional study was conducted amongst the dental undergraduates, lecturers and postgraduate faculty. Views regarding professionalism were assessed using the P-MEX. The 24-questions based survey form is comprised of questions related to doctor and patient relationship skills, reflective abilities, time management, and lastly, interprofessional relationship expertise. Data was analyzed using SPSS version 23. Descriptive statistics were done using mean and SD, whilst associations between responses were assessed using Mann-Whitney U and Kruskal-Wallis tests. P value less than 0.05 was considered significant.

RESULTS

From a total of 201 participants, 95 (47.3%) were males and 106 (52.7%) were females. Statistically significant association was seen between time management, reflective skills, and interpersonal skills with gender, as well as the domains of P-MEX and years of education.

CONCLUSION

The use of P-MEX provides a valid confirmation for the assessment and awareness of professionalism amongst the dental faculty and students. Females demonstrated higher traits of professionalism as compared to males. The findings from the current study identify that students and faculty members had sufficient awareness regarding professionalism and the practice of professionalism was routinely followed.

Cross-cultural adaptation and psychometric evaluation of the "Modification of Hall's professionalism scale for use with pharmacists"

BACKGROUND

Professionalism is the demonstration of behaviors that guide the actions of health professionals. In Pharmacy, its implementation is possible through assessment instruments for pharmacists, such as the "Modification of Hall's Professionalism Scale for Use with Pharmacists".

OBJECTIVE

To translate the "Modification of Hall's Professionalism Scale for Use with Pharmacists" into a Brazilian Portuguese version and evaluate its psychometric properties for pharmacists.

METHOD

The methodological process of this study took place in three stages: translation and cross-cultural adaptation of the instrument original version into a Brazilian Portuguese version; validation of the scale content through consensus among geographically distinct experts and, finally; examination of the scale psychometric measurement properties through a convenience sample of 600 Brazilian pharmacists. At this stage, construct validity was verified using Exploratory Factor Analysis (EFA) and reliability was examined by calculating the composite reliability.

RESULTS

The adapted instrument to a Brazilian Portuguese version demonstrated content validity with coefficients considered acceptable, above 0.8. The EFA demonstrated a structure supported by six factors and 39 items. The H index suggested high stability for all factors as well as composite reliability.

CONCLUSION

The Brazilian Portuguese version of the instrument presented appropriate content validity coefficients and psychometric properties. This measure may be useful for future studies on professionalism regarding teaching strategies and assessment of this construct among pharmacists.

Quality indicators of hospitalized children influenced by clinical pharmacist services: A systematic review

BACKGROUND

Care for children who are hospitalized can be optimized if the pharmacist, in conjunction with the multidisciplinary team, promotes the rational use of medicines. In this sense, the evaluation of the quality of these clinical services through indicators is important in the planning, decision making of pharmacists and managers of these services.

OBJECTIVE

To characterize which health indicators were influenced by the pharmaceutical clinical services for the care of children in hospitals.

METHODS

A systematic review was performed. The search for data was made on the bases: Cochrane, Embase, Lilacs, Pubmed and Web of Science. Then, the search included studies in which evaluated the impact of pharmaceutical clinical services on clinical, economic and humanistic outcomes.

RESULTS

The search resulted in 11 included studies. In this review, four pharmaceutical clinical services were found: pharmacotherapy review, multiprofessional team interventions, antimicrobial stewardship program and pharmaceutical services at discharge hospital. The most influenced outcome indicators were length of hospital stay, with average time in the group that received the pharmacotherapy review service, and interventions multiprofessional team with a 6.45-day vs. 10.83 days in the control group; hospital readmissions with a significant reduction of non-scheduled readmission of 30 days in the ntimicrobial stewardship program; reduction of hospital costs and caregiver satisfaction.

CONCLUSION

In this study, we can highlight that pharmacotherapy review, multiprofessional team interventions and Antimicrobial Stewardship Program that significantly reduced the clinical results of length of hospital stay and hospital readmission, as well as a significant reduction of hospital costs.

Assessment of Medical Professionalism: Development and psychometric analysis of Professionalism Assessment Tool (PAT) in Pakistani context using Delphi Techniques

Objective

This study aims to develop and assess the content validity along with the reliability of a Professionalism Assessment Tool (PAT) with an intention to measure professionalism among undergraduate medical students.

Methods

This psychometric analytical study validation study was carried out at Rawalpindi Medical University from 1st February to 1st June, 2021 after establishing feasibility and obtaining ethical approval. The non-probability convince sampling was employed to collect data. Using Nunnally's, the ratio of e subjects per item was selected, as our preliminary tool has 48 items so 384 sample size was estimated for scale validation. The preliminary 48-item tool with five subscales(cSS) developed through mutual consensus by the Delphi technique namely Communication skill(cSS1),-7 item, Accountability(cSS2)-8 item, Altruism(cSS3)-13 item, Self-Directed Learning (cSS4)-10 item and Ethics(cSS5),-10 item was labelled as Professionalism Assessment Tool (PAT). The tool was administered to 4th year MBBS students, the data obtained was analyzed by calculating Cronbach's alpha to estimate the reliability. The SPSS version 26 was used for data analysis.

Results

The 48-item PAT had an overall reliability (Cronbach's alpha) of 0.783. The Reliability of the new Subscales were communication skills (0.405), self-directed learning (0.527), Accountability (0.378), Altruism (0.486) and Ethics (0.715).

Conclusion

The final tool developed for assessment of professionalism had 48 items on a seven point Likert like scale, across five Subscales. Results showed that it was determined as a useful tool in assessing professionalism in undergraduate medical students to generate reliable results for valid decision-making.

Developing an Instrument to Evaluate Undergraduate Healthcare Students' Professionalism

Professionalism is a multidimensional quality acquired over time. Undergraduate years lay a foundation for the development of professionalism. Tools monitoring the students' professional development are needed. Our tool development followed three phases: 1) identifying meaningful criteria for professionalism adapted to the education level, 2) developing an evaluation instrument in a process maximising construct validity, 3) testing the evaluation instrument in an interprofessional study. The evaluation instrument proved to be applicable in the field and it meets validity standards. Some differences between professions were found and discussed. Professionality starts to develop during the education, and early monitoring is important to support students' optimal development. The evaluation instrument supports both self- and expert evaluation of healthcare students' professional development.

Assessment of Professionalism During the Emergency Medicine Clerkship Using the National Clinical Assessment Tool for Medical Students in Emergency Medicine

OBJECTIVES

In 2016, a national consensus conference created the National Clinical Assessment Tool for Medical Students in Emergency Medicine (NCAT-EM), a standardized end-of-shift assessment tool. We report the first large-scale analysis of professionalism concerns collected from May 2017 through December 2018 by a multisite consortium using the NCAT-EM. Our primary objective was to characterize the nature and frequency of professionalism concerns. Our secondary objective was to identify characteristics associated with giving or receiving a professionalism flag.

METHODS

The consortium database includes assessments for all students on EM clerkships at participating sites. This report presents descriptive statistics about the frequency of different flags, the distribution of flags among different student categories, assessor and student characteristics, and distribution of global assessment scores on assessments citing concerns. We used Fisher's exact test to look for associations between the frequency of professionalism flags and the sex of the students and assessors and across student categories. We used logistic regression to look for relationships between professionalism concerns and global assessment scores as well as intent to apply in EM.

RESULTS

We screened 6,768 assessments of 784 students by 719 assessors from 13 sites. After excluding assessments without flags and assessments with apparent data entry errors, we analyzed 57 (0.8%) assessments containing 79 flags. The most frequent flags were punctuality (25/79, 31.6%) and initiative (20/79, 25.3%). Few students received flags (42/784, 5.4%). Few assessors flagged concerns (41/719, 5.7%). We detected no correlation between the frequency of flags and whether a student was applying in EM or between the sex of students and assessors. Global scores of lower one-third appeared more often in assessments with a flag (30/57, 52.6% vs. 233/6,711, 3.5%).

CONCLUSIONS

Only 5.4% of students received flags. Punctuality and initiative accounted for a majority of citations. Professionalism flags correlated strongly with lower global assessment scores.

Professionalism in traditional Chinese medicine (TCM) practitioners: a qualitative study

BACKGROUND

Medical professionalism is important for establishing public trust in doctors. Its definition is culture-sensitive. However, no research has explored medical professionalism in Traditional Chinese Medicine (TCM) practitioners. This study aims to (a) establish the domains of professionalism in TCM practitioners in Singapore, and to (b) compare the domains of professionalism of practitioners trained in TCM and practitioners trained in conventional medicine.

METHODS

Data for this qualitative study was collected through in-depth interviews (IDIs) with TCM practitioners. IDIs were audio-recorded and transcribed verbatim. Thematic analysis was conducted by two independent coders using the Professionalism Mini-Evaluation Exercise (P-MEX) as a framework. The domains of professionalism in TCM and conventional medicine were then compared, using data from a similar study on professionalism in practitioners trained in conventional medicine.

RESULTS

A total of 27 TCM practitioners (40.7% male) participated in this study. The four domains of professionalism in the P-MEX, namely doctor-patient relationship skills, reflective skills, time management and inter-professional relationship skills, and two new sub-domains, "communicated effectively with patient" and "demonstrated understanding and integrated with conventional medicine", were relevant to TCM practitioners. This is largely similar to that of practitioners trained in conventional medicine, with a few differences, including "ensured continuity of care" and "used health resources appropriately".

CONCLUSION

The domains of professionalism in TCM practitioners were established and they are similar to that of practitioners trained in conventional medicine. This study is the first to define medical professionalism in TCM practitioners. Findings will provide guidance on the education of professionalism in TCM practitioners.

Assessment of medical professionalism using the Professionalism Mini Evaluation Exercise (P-MEX) in a multi-ethnic society: a Delphi study

BACKGROUND

The importance of medical professionalism and its assessment has been well documented in the literature. However, there is currently no culturally-adapted tool to assess medical professionalism in Singapore. This study sets out to find consensus on relevance of the items from the Professionalism Mini Evaluation Exercise (P-MEX) for assessing medical professionalism in Singapore.

METHODS

A two-round Delphi survey was completed by an expert panel consisting of program directors, associate designated institutional officials, and designated institutional official (n = 15) from residency programs in Singapore. Round 1 comprised of 23 items from the P-MEX rated on a 5-point scale (1 = Definitely include, 2 = Possibly include, 3 = Neutral, 4 = Possibly exclude, 5 = Definitely exclude). In round 2, the experts received feedback from the previous round, and were asked to re-rate the items which did not achieve consensus in the previous round. The threshold for consensus in the study was defined as 70% or greater agreement among experts.

RESULTS

Completed questionnaires for both rounds were received from all 15 experts. In round 1, 18 items (78%) achieved consensus to be included. In round 2, 1 (4%) item achieved consensus to be included. However, none of the remaining items achieved consensus to be removed, and they exhibited stability in responses. A list of 19 items covering four domains of medical professionalism (Doctor-patient relationship skills, Reflective skills, Time management and Inter-professional relationship skills) was obtained during the two-rounds of Delphi survey.

CONCLUSIONS

Nineteen items in the P-MEX had garnered consensus and is suitable for assessing medical professionalism in Singapore. The findings of this study can provide guidance for faculty and institutions who want to assess medical professionalism of their medical trainees.

Assessment of medical professionalism: preliminary results of a qualitative study

BACKGROUND

The importance of medical professionalism has been well documented in the literature. Cultural background affects the constituents of professionalism. However, few studies have explored the domains of medical professionalism in an Asian context. We aim to describe the views and experiences of both patients and faculty on medical professionalism in an urban Asian city state.

METHODS

Data for this qualitative study were collected through focus group discussions (FGDs) with patients and in-depth interviews (IDIs) with faculty members. The IDIs and FGDs were audio-recorded and transcribed verbatim. Thematic analysis was conducted by two independent coders using a priori framework derived from Professionalism Mini Evaluation Exercise (P-MEX). Sociodemographic data of faculty members and patients were obtained through brief questionnaires.

RESULTS

A total of 31 patients (58.1% male, all had visited healthcare facilities within the past year) and 26 faculty members (42.3% male, 38.5% from medical disciplines, median years as faculty is 11) participated in this study. The results supported the four domains of medical professionalism - Doctor-patient relationship skills, Reflective skills, Time management and Inter-professional relationship skills. Two new sub-domains which emerged from data were (1) communicated effectively with patient and (2) demonstrated collegiality.

CONCLUSIONS

The domains of professionalism in Singapore were similar to previous studies. This study allows a better understanding of medical professionalism to enhance the assessment and ultimately, the teaching of medical professionalism in an urban multi-ethnic Asian city.

Assessing Professionalism in Medicine - A Scoping Review of Assessment Tools from 1990 to 2018

BACKGROUND

Medical professionalism enhances doctor-patient relationships and advances patient-centric care. However, despite its pivotal role, the concept of medical professionalism remains diversely understood, taught and thus poorly assessed with Singapore lacking a linguistically sensitive, context specific and culturally appropriate assessment tool. A scoping review of assessments of professionalism in medicine was thus carried out to better guide its understanding.

METHODS

Arksey and O'Malley's (2005) approach to scoping reviews was used to identify appropriate publications featured in four databases published between 1 January 1990 and 31 December 2018. Seven members of the research team employed thematic analysis to evaluate the selected articles.

RESULTS

3799 abstracts were identified, 138 full-text articles reviewed and 74 studies included. The two themes identified were the context-specific nature of assessments and competency-based stages in medical professionalism.

CONCLUSIONS

Prevailing assessments of professionalism in medicine must contend with differences in setting, context and levels of professional development as these explicate variances found in existing assessment criteria and approaches. However, acknowledging the significance of context-specific competency-based stages in medical professionalism will allow the forwarding of guiding principles to aid the design of a culturally-sensitive and practical approach to assessing professionalism.

Professionalism Milestones Assessments Used by Emergency Medicine Residency Programs: A Cross-sectional Survey

Introduction

Professionalism is a vital component of quality patient care. While competency in professionalism is Accreditation Council for Graduate Medical Education (ACGME)-mandated, the methods used to evaluate professionalism are not standardized, calling into question the validity of reported measurements. We aimed to determine the type and frequency of methods used by United States (US) -based emergency medicine (EM) residencies to assess accountability (Acc) and professional values (PV), as well as how often graduating residents achieve competency in these areas.

Methods

We created a cross-sectional survey exploring assessment and perceived competency in Acc and PV, and then modified the survey for content and clarity through feedback from emergency physicians not involved in the study. The final survey was sent to the clinical competency committee (CCC) chair or program director (PD) of the 185 US-based ACGME-accredited EM residencies. We summarized results using descriptive statistics and Fisher’s exact testing.

Results

A total of 121 programs (65.4%) completed the survey. The most frequently used methods of assessment were faculty shift evaluation (89.7%), CCC opinion (86.8%), and faculty summative evaluation (76.4%). Overall, 37% and 42% of residency programs stated that nearly all (greater than 95%) of their graduating residents achieve mastery of Acc and PV non-technical skills, respectively. Only 11.2% of respondents felt their programs were very effective at determining mastery of non-technical skills.

Conclusion

EM residency programs relied heavily on faculty shift evaluations and summative opinions to determine resident competency in professionalism, with feedback from peers, administrators, and other staff less frequently incorporated. Few residency programs felt their current methods of evaluating professionalism were very effective.