1
|
Williams KN, Lazzara EH, Sadighi M, Chandran N, Joshi K, Raj S, Shields I, Nichols B, Testa D, Hernandez J, Michael M, Rege R, Greilich P. Integrating behavioral assessment in instructional design for competency-based medical education. Front Med (Lausanne) 2024; 11:1432319. [PMID: 39219797 PMCID: PMC11361929 DOI: 10.3389/fmed.2024.1432319] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2024] [Accepted: 07/29/2024] [Indexed: 09/04/2024] Open
Abstract
As institutions continuously strive to align with the standards set forth within competency-based medical education, there is an increased need to produce evidence of learner achievement in the form of observable behaviors. However, the complexity of healthcare education and clinical environments make it challenging to generate valid and reliable behavioral assessments. In this article, we utilize our interdisciplinary knowledge from the perspectives of experts in medical education, assessment, and academic administration to provide tips to successfully incorporate behavioral assessments into instructional designs. These include tips for identifying the best assessment methods fit for purpose, guiding instructors in establishing boundaries of assessment, managing instructors, selecting raters, generating behavioral assessment guides, training raters, ensuring logistics support assessment strategies, and fostering capacity for iteration. These can be used by institutions to improve planning and implementation for longitudinal behavioral assessments.
Collapse
Affiliation(s)
- K. N. Williams
- Department of Human Factors and Behavioral Neurobiology, Embry-Riddle Aeronautical University, Daytona Beach, FL, United States
| | - Elizabeth H. Lazzara
- Department of Human Factors and Behavioral Neurobiology, Embry-Riddle Aeronautical University, Daytona Beach, FL, United States
| | - M. Sadighi
- Office of Undergraduate Medical Education, UT Southwestern Medical Center, Dallas, TX, United States
| | - N. Chandran
- Department of Anesthesiology and Pain Management, UT Southwestern Medical Center, Dallas, TX, United States
| | - K. Joshi
- Department of Emergency Medicine, UT Southwestern Medical Center, Dallas, TX, United States
| | - S. Raj
- Department of Emergency Medicine, UT Southwestern Medical Center, Dallas, TX, United States
| | - I. Shields
- Department of Anesthesiology and Critical Care, Penn Medicine, Philadelphia, PA, United States
| | - B. Nichols
- Department of Pediatrics, UT Southwestern Medical Center, Dallas, TX, United States
| | - D. Testa
- Department of Emergency Medicine, UT Southwestern Medical Center, Dallas, TX, United States
| | - J. Hernandez
- Department of Emergency Medicine, UT Southwestern Medical Center, Dallas, TX, United States
| | - M. Michael
- Department of Anesthesiology and Pain Management, UT Southwestern Medical Center, Dallas, TX, United States
| | - R. Rege
- Department of Surgery, Office of Undergraduate Medical Education, UT Southwestern Medical Center, Dallas, TX, United States
| | - P. Greilich
- Department of Anesthesiology and Pain Management, Office of Undergraduate Medical Education, Health System Chief Quality Office, UT Southwestern Medical Center, Dallas, TX, United States
| |
Collapse
|
2
|
Teo YH, Peh TY, Abdurrahman ABHM, Lee ASI, Chiam M, Fong W, Wijaya L, Krishna LKR. A modified Delphi approach to nurturing professionalism in postgraduate medical education in Singapore. Singapore Med J 2024; 65:313-325. [PMID: 34823327 PMCID: PMC11232710 DOI: 10.11622/smedj.2021224] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2021] [Accepted: 11/23/2021] [Indexed: 11/18/2022]
Abstract
INTRODUCTION Nurturing professional identities instils behavioural standards of physicians, and this in turn facilitates consistent professional attitudes, practice and patient care. Identities are socioculturally constructed efforts; therefore, we must account for the social, cultural and local healthcare factors that shape physicians' roles, responsibilities and expectations. This study aimed to forward a programme to nurture professionalism among physicians in Singapore. METHODS A three-phase, evidenced-based approach was used. First, a systematic scoping review (SSR) was conducted to identify professionalism elements. Second, a questionnaire was created based on the findings of the SSR. Third, a modified Delphi approach, which involved local experts to identify socioculturally appropriate elements to nurture professionalism, was used. RESULTS A total of 124 articles were identified from the SSR; these articles revealed definitions, knowledge, skills and approaches to nurturing professionalism. Through the modified Delphi approach, we identified professional traits, virtues, communication, ethical, self-care, teaching and assessment methods, and support mechanisms. CONCLUSION The results of this study formed the basis for a holistic and longitudinal programme focused on instilling professional traits and competencies over time through personalised and holistic support of physicians. The findings will be of interest to medical communities in the region and beyond.
Collapse
Affiliation(s)
- Yao Hao Teo
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | - Tan Ying Peh
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
- Assisi Hospice, Singapore
- The Palliative Care Centre for Excellence in Research and Education, Singapore
| | - Ahmad Bin Hanifah Marican Abdurrahman
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | - Alexia Sze Inn Lee
- Division of Cancer Education, National Cancer Centre Singapore, Singapore
| | - Min Chiam
- Division of Cancer Education, National Cancer Centre Singapore, Singapore
| | - Warren Fong
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
- Department of Rheumatology and Immunology, Singapore General Hospital, Singapore
- Duke-NUS Medical School, Singapore
| | - Limin Wijaya
- Duke-NUS Medical School, Singapore
- Department of Infectious Diseases, Singapore General Hospital, Singapore
| | - Lalit Kumar Radha Krishna
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
- The Palliative Care Centre for Excellence in Research and Education, Singapore
- Division of Cancer Education, National Cancer Centre Singapore, Singapore
- Duke-NUS Medical School, Singapore
- Palliative Care Institute Liverpool, Academic Palliative and End of Life Care Centre, University of Liverpool, United Kingdom
- Centre of Biomedical Ethics, National University of Singapore, Singapore
| |
Collapse
|
3
|
Montgomery MW, Petersen EM, Weinstein AR, Curren C, Hufmeyer K, Kisielewski M, Krupat E, Osman NY. Moving Beyond the Dichotomous Assessment of Professionalism in the Internal Medicine Clerkship: Results of a National Survey of Clerkship Directors. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2024; 99:208-214. [PMID: 37369066 DOI: 10.1097/acm.0000000000005308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/29/2023]
Abstract
PURPOSE This study examines how internal medicine clerkship faculty and leadership conceptualize professionalism and professional behaviors and attitudes, identifies whether and how faculty use metrics to assess professionalism and factor it into clerkship grades, and describes barriers that prevent faculty from feeling prepared to support the development of professional behaviors in students. METHOD The Clerkship Directors in Internal Medicine opened a call for thematic survey section proposals to its physician-faculty members, blind-reviewed all submissions, and selected 4 based on internal medicine clinical clerkship training experience relevance. The survey launched on October 5 and closed on December 7, 2021. Data were analyzed using descriptive statistics. RESULTS Of 137 core clerkship directors (CDs) at Liaison Committee on Medical Education-accredited medical schools, 103 (75.2%) responded to the survey. Of 102 respondents (1 nonrespondent), 84 (82.4%) identified professional behavior lapses in involvement and 60 (58.8%) identified introspection lapses. Of 103 respondents, 97 (94.2%) reported that their clerkships ask clinical faculty and residents to formally evaluate professionalism, and 64 (62.1%) reported that they factor professionalism assessments into final clerkship grades. CDs reported multiple barriers to addressing professionalism directly with students, including logistical barriers, professionalism assessment subjectivity concerns, and the possible adverse effect of an unprofessional label for students. CONCLUSIONS Professionalism assessment and remediation in medical education currently center on a deficit model that seeks to identify and remediate professionalism lapses, rather than a developmental model that seeks to nurture growth. This dichotomous characterization of behaviors as professional or unprofessional limits assessment and can adversely affect the learning environment. The authors propose a shift to a developmental model that considers professionalism as a continuous process parallel to the acquisition of clinical skills and medical knowledge.
Collapse
|
4
|
Tabatabaei ZS, Mirzazadeh A, Amini H, Mafinejad MK. What we think about professional and unprofessional behaviors: differences between the perception of clinical faculty members and medical students. BMC MEDICAL EDUCATION 2022; 22:866. [PMID: 36517813 PMCID: PMC9749347 DOI: 10.1186/s12909-022-03874-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/01/2022] [Accepted: 11/08/2022] [Indexed: 06/17/2023]
Abstract
INTRODUCTION Differences in the viewpoints of clinical faculty members and medical students about prioritizing professional norms accepted by the professional community and lack of alignment of these views can lead to distortion of understanding, problems in learning and assessment of professionalism, and failure in students' professional identity formation. This study aimed to identify the differences in viewpoints of clinical faculty members and medical students about prioritizing the importance and prevalence of professional and unprofessional behaviors among undergraduate medical students. METHODS A multi-stage qualitative study was conducted at Tehran University of Medical Sciences during 2020-2021. At first, a systematic search was conducted to identify professional and unprofessional behaviors using the directional content analysis method. A panel of experts was formed to check the codes obtained from reviewing the literature and to evaluate its compliance with the context. Then, the modified nominal group technique sessions were held with clinical faculty members and medical students to strengthen the codes extracted from the studies and systematically integrate their views to achieve a comprehensive list of professional and unprofessional behaviors in accordance with the context. Finally, a consensus was made among them about prioritizing the importance and prevalence of these behaviors in undergraduate medical students. RESULTS A total of 490 codes of professional behaviors and 595 unprofessional behavior codes were identified in the literature review. In the following sessions of the modified nominal group, 13 clinical faculty members listed 105 codes of professional and unprofessional behaviors, and 51 medical students also listed 313 codes. The results of the modified nominal group technique showed that the faculty members reported the importance of unprofessional behaviors higher than professional ones. At the same time, students rated the importance of professional behaviors higher than unprofessional ones. Both faculty members and students rate the prevalence of professional behaviors as high and the prevalence of unprofessional behaviors as low. CONCLUSION The results showed a difference of views between clinical faculty members and medical students about prioritizing professional and unprofessional behaviors. It is essential to align their viewpoints to understand, learn and value professionalism to develop a professional identity.
Collapse
Affiliation(s)
- Zahra Sadat Tabatabaei
- Department of Medical Education, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
- Education Development Office, School of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Azim Mirzazadeh
- Department of Internal Medicine, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Homayoun Amini
- Department of Psychiatry, Roozbeh Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Mahboobeh Khabaz Mafinejad
- Health Professions Education Research Center, Education Development Center, Department of Medical Education, Tehran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
5
|
Teo KJH, Teo MYK, Pisupati A, Ong RSR, Goh CK, Seah CHX, Toh YR, Burla N, Koh NSY, Tay KT, Ong YT, Chiam M, Fong W, Wijaya L, Goh SPL, Krishna LKR. Assessing professional identity formation (PIF) amongst medical students in Oncology and Palliative Medicine postings: a SEBA guided scoping review. Palliat Care 2022; 21:200. [PMID: 36397067 PMCID: PMC9673314 DOI: 10.1186/s12904-022-01090-4] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Accepted: 10/26/2022] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Introduction to a multi-professional team who are working and caring for the dying, and facing complex moral and ethical dilemmas during Oncology and Palliative Medicine postings influence a medical student's professional identity formation (PIF). However, limited appreciation of PIF, inadequate assessments and insufficient support jeopardise this opportunity to shape how medical students think, feel and act as future physicians. To address this gap, a systematic scoping review (SSR) of PIF assessment methods is proposed. METHODS A Systematic Evidence-based Approach (SEBA) guided SSR of assessments of PIF in medical schools published between 1st January 2000 and 31st December 2021 in PubMed, Embase, ERIC and Scopus databases was carried out. Included articles were concurrently content and thematically analysed using SEBA's Split Approach and the themes and categories identified were combined using SEBA's Jigsaw Perspective. The review hinged on the following questions: "what is known about the assessment of professional identity formation amongst medical students?", "what are the theories and principles guiding the assessment of professional identity formation amongst medical students?", "what factors influence PIF in medical students?", "what are the tools used to assess PIF in medical students?", and "what considerations impact the implementation of PIF assessment tools amongst medical students?". RESULTS Two thousand four hundred thirty six abstracts were reviewed, 602 full-text articles were evaluated, and 88 articles were included. The 3 domains identified were 1) theories, 2) assessment, and 3) implementation in assessing PIF. Differing attention to the different aspects of the PIF process impairs evaluations, jeopardise timely and appropriate support of medical students and hinder effective implementation of PIF assessments. CONCLUSION The Krishna-Pisupati model combines current theories and concepts of PIF to provide a more holistic perspective of the PIF process. Under the aegis of this model, Palliative Care and Oncology postings are envisaged as Communities of Practice influencing self-concepts of personhood and identity and shaping how medical students see their roles and responsibilities as future physicians. These insights allow the forwarding of nine recommendations to improve assessments of PIF and shape the design of a PIF-specific tool that can direct timely and personalized support of medical students.
Collapse
Affiliation(s)
- Kelly Jia Hui Teo
- grid.4280.e0000 0001 2180 6431Yong Loo Lin School of Medicine, National University of Singapore, 1E Kent Ridge Road, NUHS Tower Block, Level 11, Singapore, 119228 Singapore ,grid.410724.40000 0004 0620 9745Division of Supportive and Palliative Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore ,grid.410724.40000 0004 0620 9745Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
| | - Mac Yu Kai Teo
- grid.4280.e0000 0001 2180 6431Yong Loo Lin School of Medicine, National University of Singapore, 1E Kent Ridge Road, NUHS Tower Block, Level 11, Singapore, 119228 Singapore ,grid.410724.40000 0004 0620 9745Division of Supportive and Palliative Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore ,grid.410724.40000 0004 0620 9745Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
| | - Anushka Pisupati
- grid.4280.e0000 0001 2180 6431Yong Loo Lin School of Medicine, National University of Singapore, 1E Kent Ridge Road, NUHS Tower Block, Level 11, Singapore, 119228 Singapore ,grid.410724.40000 0004 0620 9745Division of Supportive and Palliative Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore ,grid.410724.40000 0004 0620 9745Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
| | - Rui Song Ryan Ong
- grid.4280.e0000 0001 2180 6431Yong Loo Lin School of Medicine, National University of Singapore, 1E Kent Ridge Road, NUHS Tower Block, Level 11, Singapore, 119228 Singapore ,grid.410724.40000 0004 0620 9745Division of Supportive and Palliative Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore ,grid.410724.40000 0004 0620 9745Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
| | - Chloe Keyi Goh
- grid.4280.e0000 0001 2180 6431Yong Loo Lin School of Medicine, National University of Singapore, 1E Kent Ridge Road, NUHS Tower Block, Level 11, Singapore, 119228 Singapore ,grid.410724.40000 0004 0620 9745Division of Supportive and Palliative Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore ,grid.410724.40000 0004 0620 9745Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
| | - Claire Hui Xian Seah
- grid.4280.e0000 0001 2180 6431Yong Loo Lin School of Medicine, National University of Singapore, 1E Kent Ridge Road, NUHS Tower Block, Level 11, Singapore, 119228 Singapore ,grid.410724.40000 0004 0620 9745Division of Supportive and Palliative Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore ,grid.410724.40000 0004 0620 9745Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
| | - You Ru Toh
- grid.4280.e0000 0001 2180 6431Yong Loo Lin School of Medicine, National University of Singapore, 1E Kent Ridge Road, NUHS Tower Block, Level 11, Singapore, 119228 Singapore ,grid.410724.40000 0004 0620 9745Division of Supportive and Palliative Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore ,grid.410724.40000 0004 0620 9745Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
| | - Neha Burla
- grid.4280.e0000 0001 2180 6431Yong Loo Lin School of Medicine, National University of Singapore, 1E Kent Ridge Road, NUHS Tower Block, Level 11, Singapore, 119228 Singapore ,grid.410724.40000 0004 0620 9745Division of Supportive and Palliative Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore ,grid.410724.40000 0004 0620 9745Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
| | - Natalie Song Yi Koh
- grid.4280.e0000 0001 2180 6431Yong Loo Lin School of Medicine, National University of Singapore, 1E Kent Ridge Road, NUHS Tower Block, Level 11, Singapore, 119228 Singapore ,grid.410724.40000 0004 0620 9745Division of Supportive and Palliative Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore ,grid.410724.40000 0004 0620 9745Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
| | - Kuang Teck Tay
- grid.4280.e0000 0001 2180 6431Yong Loo Lin School of Medicine, National University of Singapore, 1E Kent Ridge Road, NUHS Tower Block, Level 11, Singapore, 119228 Singapore ,grid.410724.40000 0004 0620 9745Division of Supportive and Palliative Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore ,grid.410724.40000 0004 0620 9745Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
| | - Yun Ting Ong
- grid.4280.e0000 0001 2180 6431Yong Loo Lin School of Medicine, National University of Singapore, 1E Kent Ridge Road, NUHS Tower Block, Level 11, Singapore, 119228 Singapore ,grid.410724.40000 0004 0620 9745Division of Supportive and Palliative Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore ,grid.410724.40000 0004 0620 9745Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
| | - Min Chiam
- grid.410724.40000 0004 0620 9745Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
| | - Warren Fong
- grid.4280.e0000 0001 2180 6431Yong Loo Lin School of Medicine, National University of Singapore, 1E Kent Ridge Road, NUHS Tower Block, Level 11, Singapore, 119228 Singapore ,grid.428397.30000 0004 0385 0924Duke-NUS Medical School, 8 College Road, Singapore, 169857 Singapore ,grid.163555.10000 0000 9486 5048Department of Rheumatology and Immunology, Singapore General Hospital, 16 College Road, Block 6 Level 9, Singapore General Hospital, Singapore, 169854 Singapore
| | - Limin Wijaya
- grid.428397.30000 0004 0385 0924Duke-NUS Medical School, 8 College Road, Singapore, 169857 Singapore ,grid.163555.10000 0000 9486 5048Division of Infectious Disease, Singapore General Hospital, 16 College Road, Block 6 Level 7, Singapore General Hospital, Singapore, 169854 Singapore
| | - Suzanne Pei Lin Goh
- grid.428397.30000 0004 0385 0924Duke-NUS Medical School, 8 College Road, Singapore, 169857 Singapore ,KK Women’s and Children Hospital, 100 Bukit Timah Rd, Singapore, 229899 Singapore
| | - Lalit Kumar Radha Krishna
- grid.4280.e0000 0001 2180 6431Yong Loo Lin School of Medicine, National University of Singapore, 1E Kent Ridge Road, NUHS Tower Block, Level 11, Singapore, 119228 Singapore ,grid.410724.40000 0004 0620 9745Division of Supportive and Palliative Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore ,grid.410724.40000 0004 0620 9745Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore ,grid.428397.30000 0004 0385 0924Duke-NUS Medical School, 8 College Road, Singapore, 169857 Singapore ,grid.10025.360000 0004 1936 8470Palliative Care Institute Liverpool, Academic Palliative & End of Life Care Centre, Cancer Research Centre, University of Liverpool, 200 London Road, Liverpool, L3 9TA UK ,grid.4280.e0000 0001 2180 6431Centre for Biomedical Ethics, National University of Singapore, Blk MD11, 10 Medical Drive, #02-03, Singapore, 117597 Singapore ,The Palliative Care Centre for Excellence in Research and Education, PalC C/O Dover Park Hospice, 10 Jalan Tan Tock Seng, PalC, 308436 Singapore ,grid.10025.360000 0004 1936 8470Health Data Science, University of Liverpool, Whelan Building, The Quadrangle, Brownlow Hill, Liverpool, L69 3GB UK
| |
Collapse
|
6
|
Bowman A, Reid D, Bobby Harreveld R, Lawson C. Evaluation of post-simulation sonographer students' professional behaviour in the workplace. Radiography (Lond) 2022; 28:889-896. [PMID: 35780628 DOI: 10.1016/j.radi.2022.06.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Revised: 06/15/2022] [Accepted: 06/17/2022] [Indexed: 11/24/2022]
Abstract
INTRODUCTION In Australia, sonographer's professional identity is traditionally 'caught' from clinical role models. A four-year undergraduate-postgraduate course introduced professional identity education, with simulated practice, to prepare novice sonographer students prior to clinical practice. Preclinical students learnt sonographer professional behaviour, and humanistic attributes, during simulation designed with volunteer peers as standardised patients, educator role-models, immediate feedback, self-reflection, and longitudinal multi-observer assessment. This paper reports on the transfer of learnt professional behaviour and humanistic attributes to clinical practice. METHODS Professional behaviour evaluations completed by 94 clinical assessors described 174 students' professional behaviour and attributes one month into their initial clinical practice (2015-6). Student performance of each behaviour, and behavioural category, was quantitatively analysed by modelling binomial proportions with logistic regression. RESULTS Students demonstrated substantial learning transfer to clinical practice, achieving an overall mean score of 'consistent' sonographer professional behaviour and humanistic attributes (mean score of equal to or >3/4), one month into clinical practice. Professional behaviours varied in transferability, with 'response to patient's questions' showing least efficacy (P < 0.05). Increased deliberate practice with educator role-models improved transfer efficacy significantly (P < 0.001). CONCLUSION Preclinical application of theory to simulated practice, using standardised patients, educator role-models, immediate feedback, and multi-observer assessment, facilitated substantial transfer of sonographer professional behaviour and attributes to clinical practice. The efficacy of transfer varied but improved with increased deliberate practice and feedback. IMPLICATIONS FOR PRACTICE The incorporation of preclinical professional behaviour education with simulated practice into the core curriculum of sonographer courses is recommended for the formation of sonographer professional identity, improved clinical outcomes and increased patient safety during the early stages of ultrasound education.
Collapse
Affiliation(s)
- A Bowman
- School of Graduate Research, Central Queensland University, Cairns, Australia.
| | - D Reid
- Department of Agriculture and Fisheries, Queensland Government, Rockhampton, Australia.
| | - R Bobby Harreveld
- School of Education and the Arts, Central Queensland University, Rockhampton, Australia.
| | - C Lawson
- School of Education and the Arts, Central Queensland University, Rockhampton, Australia.
| |
Collapse
|
7
|
Khan N, van Mook W, Dave S, Ha S, Sagisi J, Davi N, Aftab C, Tiwari S, Hickman M, Gilliar W. Learner perspectives of professionalism: a mixed method systematic review protocol (Preprint). JMIR Res Protoc 2022; 11:e37473. [PMID: 36006688 PMCID: PMC9459844 DOI: 10.2196/37473] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 06/04/2022] [Accepted: 06/28/2022] [Indexed: 11/13/2022] Open
Abstract
Background Professionalism has come to be associated with competence in medical education, with the habitual and judicious use of communication, knowledge, technical skills, clinical reasoning, emotions, values, and reflection in daily practice for the benefit of the individual and community being served. Recent studies indicate students should have the opportunity to observe the application of knowledge and skills by their mentors to improve patient health and safety. A noticeable detail that needs implementation into the curriculum is the inclusion of student perspectives. This review will explore students’ understanding and experience of professionalism in undergraduate medical education (UME). Objective This paper presents the protocol for a review that aims to develop an integrated synthesis of qualitative and quantitative studies resulting in recommendations for medical school curricula to incorporate the learners’ perspectives in teaching professionalism in UME. Methods We will take an integrated approach to synthesis. Data will be extracted from the included studies, and quantitative data will be “qualitized.” PubMed (Medline), Embase, PsycInfo, and ERIC (Education Resources Information Center) will be searched for studies published in English from 2010 to 2021. Studies will be screened and critically appraised for methodological quality using the Mixed Methods Appraisal Tool by 2 researchers, with disagreements resolved by a third researcher. Qualitative, quantitative, and mixed methods studies will be considered. Our population of interest is undergraduate medical students; hence, studies on medical residents and graduate medical students will be excluded. We will consider studies that explore how concepts of professionalism are understood, experienced, and taught in undergraduate medicine and on how medical students understand and develop the identified constructs of professionalism. Results This study is in the screening phase; therefore, no results are available at this time. However, we had initiated the searches, screening, and are currently in the critical appraisal stage. We will commence preparation to clean and convert the data for coding in July 2022, and analysis will be ongoing from the end of July 2022 until submission for publication in November 2022. Conclusions This research will contribute to the student perspectives on professionalism in medical education literature. The findings will aid in the creation of a checklist to guide the development of a curriculum on professionalism in UME. International Registered Report Identifier (IRRID) PRR1-10.2196/37473
Collapse
Affiliation(s)
- Nagina Khan
- Department of Osteopathic Medicine, Touro University Nevada, Henderson, NV, United States
- Association of University Teachers of Psychiatry, London, United Kingdom
| | - Walther van Mook
- Department of Intensive Care Medicine, Maastricht University Medical Centre, Maastricht, Netherlands
- School of Health Professions Education, Faculty of Health, Medicine, and Life Sciences, Maastricht University, Maastricht, Netherlands
- Maastricht UMC+ Academy, Maastricht, Netherlands
| | - Subodh Dave
- Department of Osteopathic Medicine, Derbyshire Healthcare NHS Foundation Trust, Derbyshire, United Kingdom
- Department of Osteopathic Medicine, University of Bolton, Bolton, United Kingdom
- Royal College of Psychiatrists, London, United Kingdom
| | - Sohyun Ha
- Department of Osteopathic Medicine, Touro University Nevada, Henderson, NV, United States
| | - Joshua Sagisi
- Department of Osteopathic Medicine, Touro University Nevada, Henderson, NV, United States
| | - Nicole Davi
- Department of Osteopathic Medicine, Touro University Nevada, Henderson, NV, United States
| | - Chantel Aftab
- Department of Osteopathic Medicine, Touro University Nevada, Henderson, NV, United States
| | - Sucheta Tiwari
- East London NHS Foundation Trust, London, United Kingdom
| | - Marie Hickman
- Department of Osteopathic Medicine, Derbyshire Healthcare NHS Foundation Trust, Derbyshire, United Kingdom
| | - Wolfgang Gilliar
- Department of Osteopathic Medicine, Touro University Nevada, Henderson, NV, United States
| |
Collapse
|
8
|
Ong YT, Kow CS, Teo YH, Tan LHE, Abdurrahman ABHM, Quek NWS, Prakash K, Cheong CWS, Tan XH, Lim WQ, Wu J, Tan LHS, Tay KT, Chin A, Toh YP, Mason S, Radha Krishna LK. Nurturing professionalism in medical schools. A systematic scoping review of training curricula between 1990-2019. MEDICAL TEACHER 2020; 42:636-649. [PMID: 32065016 DOI: 10.1080/0142159x.2020.1724921] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Introduction: Professionalism is an evolving, socioculturally informed multidimensional construct that influences doctor-patient relationships, patient satisfaction and care outcomes. However, despite its clinical significance there is little consistency in how professionalism is nurtured amongst medical students. To address this gap a systemic scoping review of nurturing professionalism in medical schools, is proposed.Methods: Levac's framework and the PRISMA-P 2015 checklist underpinned a 6-stage systematic review protocol. Concurrent use of Braun and Clarke's approach to thematic analysis and directed content analysis was used to identify the key elements in nurturing professionalism.Results: 13921 abstracts were identified from six databases, 854 full-text articles reviewed, and 162 full-text included articles were included. The 4 themes identified through thematic analysis are consistent with findings of the directed content analysis. These were the definition of professionalism, the approaches, content, barriers and enablers to teaching professionalism.Conclusion: Informed by a viable definition of professionalism and clear milestones nurturing professionalism nurturing professionalism begins with culturally appropriate training in clinical competence, humanistic qualities and reflective capacity. This process requires effective evaluations of professional identity formation, and the impact of the learning environment underlining the need for longitudinal assessments of the training process.
Collapse
Affiliation(s)
- Yun Ting Ong
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Cheryl Shumin Kow
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Yao Hao Teo
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Lorraine Hui En Tan
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Ahmad Bin Hanifah Marican Abdurrahman
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Nicholas Wei Sheng Quek
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Kishore Prakash
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Clarissa Wei Shuen Cheong
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Xiu Hui Tan
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Wei Qiang Lim
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Jiaxuan Wu
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Laura Hui Shuen Tan
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Kuang Teck Tay
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Annelissa Chin
- Medical Library, National University of Singapore Libraries, National University of Singapore, Singapore, Singapore
| | - Ying Pin Toh
- Family Medicine Residency, National University Health System, Singapore, Singapore
| | - Stephen Mason
- Palliative Care Institute Liverpool, Academic Palliative and End of Life Care Centre, University of Liverpool, Liverpool, England
| | - Lalit Kumar Radha Krishna
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
- Palliative Care Institute Liverpool, Academic Palliative and End of Life Care Centre, University of Liverpool, Liverpool, England
- Education Department, Duke-NUS Graduate Medical School, Singapore, Singapore
- Centre for Biomedical Ethics, National University of Singapore, Singapore, Singapore
| |
Collapse
|
9
|
Mak-van der Vossen M, Teherani A, van Mook W, Croiset G, Kusurkar RA. How to identify, address and report students' unprofessional behaviour in medical school. MEDICAL TEACHER 2020; 42:372-379. [PMID: 31880194 DOI: 10.1080/0142159x.2019.1692130] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/26/2023]
Abstract
This AMEE guide provides a research overview of the identification of, and responding to unprofessional behaviour in medical students. It is directed towards medical educators in preclinical and clinical undergraduate medical education. It aims to describe, clarify and categorize different types of unprofessional behaviours, highlighting students' unprofessional behaviour profiles and what they mean for further guidance. This facilitates identification, addressing, reporting and remediation of different types of unprofessional behaviour in different types of students in undergraduate medical education. Professionalism, professional behaviour and professional identity formation are three different viewpoints in medical education and research. Teaching and assessing professionalism, promoting professional identity formation, is the positive approach. An inevitable consequence is that teachers sometimes are confronted with unprofessional behaviour. When this happens, a complementary approach is needed. How to effectively respond to unprofessional behaviour deserves our attention, owing to the amount of time, effort and resources spent by teachers in managing unprofessional behaviour of medical students. Clinical and medical educators find it hard to address unprofessional behaviour and turn toward refraining from handling it, thus leading to the 'failure to fail' phenomenon. Finding the ways to describe and categorize observed unprofessional behaviour of students encourages teachers to take the appropriate actions.
Collapse
Affiliation(s)
- Marianne Mak-van der Vossen
- Department of Research in Education, Faculty of Medicine VU University Amsterdam, Amsterdam UMC, Amsterdam, The Netherlands
| | - Arianne Teherani
- Department of Medicine and Center for Faculty Educators, University of California, School of Medicine, San Francisco, CA, USA
| | - Walther van Mook
- Department of Intensive Care Medicine, Maastricht University Medical Center, Maastricht, The Netherlands
- School of Health Professions Education, Maastricht University, Maastricht, The Netherlands
| | - Gerda Croiset
- Department of Research in Education, Faculty of Medicine VU University Amsterdam, Amsterdam UMC, Amsterdam, The Netherlands
| | - Rashmi A Kusurkar
- Department of Research in Education, Faculty of Medicine VU University Amsterdam, Amsterdam UMC, Amsterdam, The Netherlands
| |
Collapse
|
10
|
MacKenzie DE, Merritt BK, Holstead R, Sarty GE. Professional practice behaviour: Identification and validation of key indicators. Br J Occup Ther 2019. [DOI: 10.1177/0308022619879361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
IntroductionProfessional behaviour is regarded as an important competency for occupational therapy practice, yet little guidance exists for indicators underpinning development or remediation in the educational or practice settings. This study sought to confirm the content validity of observable professional behaviour indicators from an existing evaluation framework for representativeness and relevance for occupational therapy practice.MethodsA modified Delphi approach was conducted with expert panellists ( n = 30) consisting of regulators, administrators, faculty members, practitioners, and students for professional behaviour indicator consensus, together with a cross-sectional survey of practitioners ( n = 119). Fleiss’ κ and χ2 contingency tables were completed for agreement across panellists, and between panellist and survey groups. Cross-case qualitative analyses identified facilitators and barriers for professional behaviour practice.ResultsContent validity of 17 professional behaviour indicators was achieved, with >85% agreement from the expert panellists and the cross-sectional survey group. Main professional behaviour reporting issues in practice included fear of reprisal, lack of formal policies, and an unsupportive culture. Support from others, documented workplace policies, and self-regulation/duty to monitor were the critical facilitators for supporting professional behaviour in practice.ConclusionThe professional behaviour indicators in this study offer observable behaviours from which assessment rubrics or tools may be developed. Further study is warranted.
Collapse
|
11
|
Guraya SY, van Mook WN, Khoshhal KI. Failure of faculty to fail failing medical students: Fiction or an actual erosion of professional standards? J Taibah Univ Med Sci 2019; 14:103-109. [PMID: 31435399 PMCID: PMC6694968 DOI: 10.1016/j.jtumed.2019.01.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2018] [Revised: 01/06/2019] [Accepted: 01/07/2019] [Indexed: 11/20/2022] Open
Abstract
OBJECTIVES Literature has shown that some assessors assign passing grades to medical students who, in fact, should not have passed. This inability of the faculty to fail underperforming students can jeopardise the reputation of professional programs, be it in the medical field or beyond. Simultaneously, weak students become incompetent physicians and, thus, endanger the community they serve. The impetus for conducting this systematic review was to identify barriers to faculty in failing struggling medical students. METHODS The databases of MEDLINE, Scopus, Wiley online library, Cochrane library, OVID, Taylor and Francis, CINAHL, Springer link, ProQuest, and ISI Web of knowledge were searched using Medical Subject Headings (MeSH) terms 'Faculty failure' AND 'Failing students' AND 'Failure to fail' OR 'Assessment'. The data were synthesised, and the results were analysed. RESULTS This search showed a wealth of barriers to faculty contributing to a 'failure to fail' such as their concerns about legal action and an appeals process; the stress of failing students; a lack of knowledge about proper documentation; unavailability of support, resources, and offices for faculty; absence of administrative guidelines; and complex dismissal procedures discouraging the faculty from failing students. CONCLUSION Institutional faculty development programs and training workshops should facilitate the education of supervisors and assessors for timely evaluation and regular documentation of trainee assessment. The provision of legal advice in cases of appeal and professional support by the resource and support office is emphasised.
Collapse
Affiliation(s)
- Salman Y. Guraya
- Clinical Sciences Department, College of Medicine University of Sharjah, Sharjah, United Arab Emirates
| | - Walther N.K.A. van Mook
- Department of Intensive Care, Faculty of Health, Medicine and Life Sciences (FHML), Maastricht University Medical Centre, the Netherlands
| | - Khalid I. Khoshhal
- Department of Orthopedics, College of Medicine Taibah University, Almadinah Almunawwarah, KSA
| |
Collapse
|
12
|
Barnhoorn PC, Houtlosser M, Ottenhoff-de Jonge MW, Essers GTJM, Numans ME, Kramer AWM. A practical framework for remediating unprofessional behavior and for developing professionalism competencies and a professional identity. MEDICAL TEACHER 2019; 41:303-308. [PMID: 29703096 DOI: 10.1080/0142159x.2018.1464133] [Citation(s) in RCA: 36] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
The relatively new term "Professional Identity Formation" (PIF) complements behavior-based and attitude-based perspectives on professionalism. Unprofessional behavior and its remediation should also be addressed from this perspective. However, a framework is needed to guide discussion and remediation of unprofessional behavior, which can encompass behavior-based, attitude-based, and identity-based perspectives on professionalism. To this end, the authors propose a multi-level professionalism framework which describes, apart from professional behavior, more levels which influence professional performance: environment, competencies, beliefs, values, identity, and mission. The different levels can provide tools for educators to address and discuss unprofessional behavior with their students in a comprehensive way. By reflecting on all the different levels of the framework, educators guard themselves against narrowing the discussion to either professional behavior or professional identity. The multi-level professionalism framework can help educators and students to gain a better understanding of the root of unprofessional behavior, and of remediation strategies that would be appropriate. For despite the recent emphasis on PIF, unprofessional behavior and its remediation will remain important issues in medical education.
Collapse
Affiliation(s)
- Pieter C Barnhoorn
- a Department of Public Health and Primary Care , Leiden University Medical Center , Leiden , The Netherlands
| | - Mirjam Houtlosser
- b Department of Medical Ethics and Health Law , Leiden University Medical Center , Leiden , The Netherlands
| | | | - Geurt T J M Essers
- c The Netherlands' Network of the GP Specialty Training Institutes , Utrecht , The Netherlands
| | - Mattijs E Numans
- a Department of Public Health and Primary Care , Leiden University Medical Center , Leiden , The Netherlands
| | - Anneke W M Kramer
- a Department of Public Health and Primary Care , Leiden University Medical Center , Leiden , The Netherlands
| |
Collapse
|
13
|
Hoonpongsimanont W, Sahota PK, Chen Y, Patel M, Tarapan T, Bengiamin D, Sutham K, Imsuwan I, Dadeh AA, Nakornchai T, Narajeenron K. Physician professionalism: definition from a generation perspective. INTERNATIONAL JOURNAL OF MEDICAL EDUCATION 2018; 9:246-252. [PMID: 30269110 PMCID: PMC6387766 DOI: 10.5116/ijme.5ba0.a584] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/08/2018] [Accepted: 09/18/2018] [Indexed: 05/23/2023]
Abstract
OBJECTIVES The primary objective of this study was to determine whether consensuses on the definition of emergency physician professionalism exist within and among four different generations. Our secondary objective was to describe the most important characteristic related to emergency physician professionalism that each generation values. METHODS We performed a cross-sectional survey study, using a card-sorting technique, at the emergency departments of two university-based medical centers in the United States. The study was conducted with 288 participants from February to November 2017. Participants included adult emergency department patients, emergency medicine supervising physicians, emergency medicine residents, emergency department nurses, and fourth- and second-year medical students who independently ranked 39 cards that represent qualities related to emergency physician professionalism. We used descriptive statistics, quantitative cultural consensuses and Spearman's correlation coefficients to analyze the data. RESULTS We found cultural consensuses on emergency physician professionalism in Millennials and Generation X overall, with respect for patients named the most important quality (eigenratio 5.94, negative competency 0%; eigenratio 3.87, negative competency 1.64%, respectively). There were consensuses on emergency physician professionalism in healthcare providers throughout all generations, but no consensuses were found across generations in the patient groups. CONCLUSIONS While younger generations and healthcare providers had consensuses on emergency physician professionalism, we found that patients had no consensuses on this matter. Medical professionalism curricula should be designed with an understanding of each generation's values concerning professionalism. Future studies using qualitative methods across specialties, to assess definitions of medical professionalism in each generation, should be pursued.
Collapse
Affiliation(s)
| | - Preet K Sahota
- Department of Emergency Medicine, University of California, Irvine, Orange, CA, USA
| | - Yanjun Chen
- Institute for Clinical and Translational Sciences, University of California, Irvine, Irvine, CA, USA
| | - Mayuri Patel
- Department of Emergency Medicine, University of California, Irvine, Orange, CA, USA
| | - Tanawat Tarapan
- Department of Emergency Medicine, University and King Chulalongkorn Memorial Hospital, the Thai Red Cross Society, Bangkok, Thailand
| | - Deena Bengiamin
- Department of Emergency Medicine, University of California, San Francisco-Fresno, Fresno, CA, USA
| | - Krongkarn Sutham
- Department of Emergency Medicine, Chiang Mai University, Chiang Mai, Thailand
| | - Intanon Imsuwan
- Department of Emergency Medicine, Thammasat University, Pathumthani, Thailand
| | - Ar-Aishah Dadeh
- Department of Emergency Medicine, Prince of Songkla University, Songkla, Thailand
| | - Tanyaporn Nakornchai
- Department of Emergency Medicine, Siriraj Hospital, Mahidol University, Bangkok, Thailand
| | - Khuansiri Narajeenron
- Department of Emergency Medicine, University and King Chulalongkorn Memorial Hospital, the Thai Red Cross Society, Bangkok, Thailand
| |
Collapse
|
14
|
Kulasegaram K, Rangachari PK. Beyond "formative": assessments to enrich student learning. ADVANCES IN PHYSIOLOGY EDUCATION 2018; 42:5-14. [PMID: 29341810 DOI: 10.1152/advan.00122.2017] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Formative assessments can enhance and enrich student learning. Typically, these have been used to provide feedback against end-of-course standards and prepare students for summative assessments of performance or measurement of competence. Here, we present the case for using assessments for learning to encompass a wider range of important outcomes. We discuss 1) the rationale for using assessment for learning; 2) guiding theories of expertise that inform assessment for learning; 3) theoretical and empirical evidence; 4) approaches to rigor and validation; and 5) approaches to implementation at multiple levels of the curriculum. The literature strongly supports the use of assessments as an opportunity to reinforce and enhance learning. Physiology teachers have a wide range of theories, models, and interventions from which to prepare students for retention, application, transfer, and future learning by using assessments.
Collapse
Affiliation(s)
- Kulamakan Kulasegaram
- The Wilson Centre and Department of Family & Community Medicine, Faculty of Medicine, University of Toronto , Toronto, Ontario , Canada
| | - Patangi K Rangachari
- Bachelor of Health Sciences (Honors) Program, Department of Medicine, Faculty of Health Sciences, McMaster University , Hamilton, Ontario , Canada
| |
Collapse
|
15
|
Mak-van der Vossen MC, van Mook WNKA, Kors JM, van Wieringen WN, Peerdeman SM, Croiset G, Kusurkar RA. Distinguishing Three Unprofessional Behavior Profiles of Medical Students Using Latent Class Analysis. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2016; 91:1276-83. [PMID: 27119326 DOI: 10.1097/acm.0000000000001206] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
PURPOSE Because unprofessional behavior of physicians is associated with unprofessional behavior in medical school, identifying unprofessional behavior in medical school is critical. Research has noted the difficulty in assessing professional behavior. Instead of identifying isolated behaviors, it could be more helpful to recognize behavioral patterns to evaluate students' professional behavior. The authors aimed to identify patterns in the unprofessional behaviors of medical students and to construct descriptions based on these patterns. METHOD Content analysis of research articles yielded a template of unprofessional behaviors for coding student evaluation forms indicating unsatisfactory professional behavior, collected from 2012 to 2014 at the VUmc School of Medical Sciences, Amsterdam, the Netherlands. Latent class analysis was used to identify classes of students with a high chance of displaying comparable unprofessional behaviors. Teachers' feedback of prototype students was summarized to generate profile descriptions. RESULTS A template of 109 behaviors was used to code 232 evaluation forms of 194 students (3.9% students/year). Latent class analysis identified three hypothetical classes of students: Class 1 (43%) was labeled as "Poor reliability," class 2 (20%) was labeled as "Poor reliability and poor insight," and class 3 (37%) was labeled as "Poor reliability, poor insight, and poor adaptability." CONCLUSIONS These profiles of unprofessional behavior might help to improve the evaluation of unprofessional behavior in medical school. Further research should provide evidence for confidently accepting or rejecting the profiles as an instrument to identify which students are expected to benefit from remediation trajectories.
Collapse
Affiliation(s)
- Marianne C Mak-van der Vossen
- M.C. Mak-van der Vossen is a general practitioner, PhD student, Department of Research in Education, and coordinator of the educational theme "Professional behavior," VUmc School of Medical Sciences, Amsterdam, the Netherlands. W.N.K.A. van Mook is internist/intensivist, Department of Intensive Care Medicine, Maastricht University Medical Center, and associate professor, Medical Education, Maastricht University, Maastricht, the Netherlands. J.M. Kors is a midwife and medical educator, AVAG Midwifery Academy, Amsterdam Groningen, the Netherlands. W.N. van Wieringen is biostatistician, Department of Epidemiology and Biostatistics, VU University Medical Centre, Amsterdam, the Netherlands. S.M. Peerdeman is neurosurgeon, VU University Medical Centre, and professor of professional development, VUmc School of Medical Sciences, Amsterdam, the Netherlands. G. Croiset is professor of medical education and director, VUmc School of Medical Sciences, Amsterdam, the Netherlands. R.A. Kusurkar is head, Department of Research in Education, VUmc School of Medical Sciences, Amsterdam, the Netherlands
| | | | | | | | | | | | | |
Collapse
|
16
|
Lee KL, Tsai SL, Chiu YT, Ho MJ. Can student self-ratings be compared with peer ratings? A study of measurement invariance of multisource feedback. ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2016; 21:401-413. [PMID: 26387118 DOI: 10.1007/s10459-015-9638-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/03/2014] [Accepted: 09/10/2015] [Indexed: 06/05/2023]
Abstract
Measurement invariance is a prerequisite for comparing measurement scores from different groups. In medical education, multi-source feedback (MSF) is utilized to assess core competencies, including the professionalism. However, little attention has been paid to the measurement invariance of assessment instruments; that is, whether an instrument holds the same meaning across different rater groups. To examine the measurement invariance of the National Taiwan University professionalism MSF (NTU P-MSF) in order to determine whether medical students' self-rating can be compared to their peers' rating. An eight-factor model was specified for confirmatory factor analysis to examine the construct validity of the NTU P-MSF. Cronbach's alpha was computed for the items of each domain to evaluate internal consistent reliability. The same eight-factor model was used for multi-group confirmatory factor analyses. Four hierarchical models were specified to test configural (i.e., identical factor-item relationship), metric (i.e., identical factor loadings), scalar (i.e., identical intercepts), and error variance across self-rating and peer rating groups. One hundred and twenty second-year medical students from weekly discussion groups conducted as part of a medical professionalism course agreed to use the NTU P-MSF to assess themselves or their discussion group peers. NTU P-MSF assessment scores were a good fit for the eight-factor model among self group and peer group. The Cronbach's alpha coefficients of students' NTU P-MSF scores and peers' scores ranged from 0.76 to 0.89 and 0.84 to 0.91, respectively indicating that the NTU P-MSF scores also have good internal consistent reliability between both groups. In addition, same factor structure and similar factor loadings and intercepts of NTU P-MSF scores between both groups indicate that NTU P-MSF scores had configural, metric, and scalar invariance. Thus, students' self-assessments and peer assessments can be compared in terms of the constructs of NTU P-MSF scores, change in NTU P-MSF scores, and its factor scores. This study demonstrates how to investigate the measurement invariance of a professionalism MSF and contributes to the discussion on self- and peer assessment in medical education.
Collapse
Affiliation(s)
- Keng-Lin Lee
- Department of Medical Education and Bioethics, National Taiwan University College of Medicine, No. 1, Ren-Ai Road, Section 1, Taipei, Taiwan
| | - Shih-Li Tsai
- Department of Medical Education and Bioethics, National Taiwan University College of Medicine, No. 1, Ren-Ai Road, Section 1, Taipei, Taiwan
| | - Yu-Ting Chiu
- Department of Medical Education and Bioethics, National Taiwan University College of Medicine, No. 1, Ren-Ai Road, Section 1, Taipei, Taiwan
| | - Ming-Jung Ho
- Department of Medical Education and Bioethics, National Taiwan University College of Medicine, No. 1, Ren-Ai Road, Section 1, Taipei, Taiwan.
| |
Collapse
|
17
|
Santen SA, Petrusa E, Gruppen LD. The relationship between promotions committees' identification of problem medical students and subsequent state medical board actions. ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2015; 20:421-430. [PMID: 25134665 DOI: 10.1007/s10459-014-9536-2] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/14/2014] [Accepted: 07/22/2014] [Indexed: 06/03/2023]
Abstract
Studies have found unprofessional behavior in medical school was associated with disciplinary action by state medical boards. For medical schools, promotions committees are responsible for identifying which students do not demonstrate academic performance and professional behavior acceptable for promotion and graduation. The objective of this study was to determine if student identification by promotions committees during medical school was associated with disciplinary actions by state medical boards later in practice. We reviewed 20 years of promotions committees' records from a single institution and noted students identified by promotions committees for performance or behavioral issues. These were compared with disciplinary action reports from the Federation of State Medical Boards (FSMB) for graduates. Over the two decades, 2,131 students matriculated and 2,078 of these graduated. The promotions committees identified 140 students for poor academic performance or behavioral problems (140/2,078, 6.7 %). Of these, 108 students graduated. FSMB records showed 29 of the 2,078 graduates had sanctions by state boards (29/2,078, 1.4 %). Only four students that had actions by state medical boards were among the 108 graduated students identified by medical school promotions committees (4/108, 3.7 %). Of the students not identified by promotions committees, 25 eventually had disciplinary actions (25/1,970, 1.3 %). The odds of having state medical board action if identified by promotions committees was 3.0 (CI 1.02-8.8, p < 0.05). In conclusion, identification of students by medical school promotions committees was later associated with state medical board actions. However, most graduates with state medical board actions were not identified by medical school promotions committees.
Collapse
Affiliation(s)
- Sally A Santen
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI, USA,
| | | | | |
Collapse
|
18
|
van Mook WNKA, van Luijk SJ, Zwietering PJ, Southgate L, Schuwirth LWT, Scherpbier AJJA, van der Vleuten CPM. The threat of the dyscompetent resident: A plea to make the implicit more explicit! ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2015; 20:559-74. [PMID: 24927810 DOI: 10.1007/s10459-014-9526-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/22/2014] [Accepted: 05/28/2014] [Indexed: 05/26/2023]
Abstract
Although several examples of frameworks dealing with students' unprofessional behaviour are available, guidance on how to deal locally or regionally with dysfunctional residents is limited (Hickson et al. in Acad Med 82(11):1040-1048, 2007b; Leape and Fromson in Ann Intern Med 144(2):107-115, 2006). Any 'rules' are mostly unwritten, and often emerge by trial and error within the specialty training programme (Stern and Papadakis in N Engl J Med 355(17):1794-1799, 2006). It is nevertheless of utmost importance that objectives, rules and guidelines comparable to those existing in undergraduate training (Project Team Consilium Abeundi van Luijk in Professional behaviour: teaching, assessing and coaching students. Final report and appendices. Mosae Libris, 2005; van Mook et al. in Neth J Crit Care 16(4):162-173, 2010a) are developed for postgraduate training. And that implicit rules are made explicit. This article outlines a framework based on the lessons learned from contemporary postgraduate medical training programmes.
Collapse
Affiliation(s)
- Walther N K A van Mook
- Department of Intensive Care Medicine, Maastricht University Medical Centre+, P. Debyelaan 25, 6202 AZ, Maastricht, The Netherlands,
| | | | | | | | | | | | | |
Collapse
|
19
|
Mak-van der Vossen M, Peerdeman S, Kleinveld J, Kusurkar R. How we designed and implemented teaching, training, and assessment of professional behaviour at VUmc School of Medical Sciences Amsterdam. MEDICAL TEACHER 2013; 35:709-14. [PMID: 23782044 DOI: 10.3109/0142159x.2013.799637] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
BACKGROUND Training of doctors in The Netherlands seeks to develop clinical competences including professional behaviour. Behaving as a professional is not just a desirable trait but a clearly stated requirement for doctors and medical students. RESULTS We designed an educational theme, Professional Behaviour (PB), as a longitudinal thread throughout our six-year curriculum after defining PB as "The observable aspects of practising professionalism". This definition was translated into a set of practical skills that can be observed: "The ability to deal with tasks, to deal with others and to deal with oneself". We assess PB 29 times in the course of the medical curriculum. Students with an unsatisfactory PB do not get their degree irrespective of their medical knowledge. We train teachers to identify and report unprofessional student behaviour, and we offer these students interventions and support. CONCLUSIONS With the educational theme "Professional Behaviour" we have defined PB for our institute and firmly embedded it in the medical curriculum. We use workplace learning and role models for teaching PB. Different teachers carry out multiple formative and summative assessments, using standardized assessment scales. With these measures we intend to promote a culture of excellence in PB in our institute.
Collapse
|
20
|
Byszewski A, Hendelman W, McGuinty C, Moineau G. Wanted: role models--medical students' perceptions of professionalism. BMC MEDICAL EDUCATION 2012; 12:115. [PMID: 23153359 PMCID: PMC3537482 DOI: 10.1186/1472-6920-12-115] [Citation(s) in RCA: 53] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/01/2012] [Accepted: 11/01/2012] [Indexed: 05/22/2023]
Abstract
BACKGROUND Transformation of medical students to become medical professionals is a core competency required for physicians in the 21st century. Role modeling was traditionally the key method of transmitting this skill. Medical schools are developing medical curricula which are explicit in ensuring students develop the professional competency and understand the values and attributes of this role. The purpose of this study was to determine student perception of professionalism at the University of Ottawa and gain insights for improvement in promotion of professionalism in undergraduate medical education. METHODS Survey on student perception of professionalism in general, the curriculum and learning environment at the University of Ottawa, and the perception of student behaviors, was developed by faculty and students and sent electronically to all University of Ottawa medical students. The survey included both quantitative items including an adapted Pritzker list and qualitative responses to eight open ended questions on professionalism at the Faculty of Medicine, University of Ottawa. All analyses were performed using SAS version 9.1 (SAS Institute Inc. Cary, NC, USA). Chi-square and Fischer's exact test (for cell count less than 5) were used to derive p-values for categorical variables by level of student learning. RESULTS The response rate was 45.6% (255 of 559 students) for all four years of the curriculum. 63% of the responses were from students in years 1 and 2 (preclerkship). Students identified role modeling as the single most important aspect of professionalism. The strongest curricular recommendations included faculty-led case scenario sessions, enhancing interprofessional interactions and the creation of special awards to staff and students to "celebrate" professionalism. Current evaluation systems were considered least effective. The importance of role modeling and information on how to report lapses and breaches was highlighted in the answers to the open ended questions. CONCLUSIONS Students identify the need for strong positive role models in their learning environment, and for effective evaluation of the professionalism of students and teachers. Medical school leaders must facilitate development of these components within the MD education and faculty development programs as well as in clinical milieus where student learning occurs.
Collapse
Affiliation(s)
- Anna Byszewski
- Professor of Medicine, Division of Geriatric Medicine, University of Ottawa, Ottawa, Canada
- The Ottawa Hospital, Civic Campus, 1053 Carling Avenue, Box 678, Ottawa, ON, Canada
| | | | - Caroline McGuinty
- Postgraduate Training, Internal Medicine, University of Toronto, Toronto, Canada
| | - Geneviève Moineau
- Vice President, Education, Association of Faculties of Medicine of Canada, Toronto, Canada
| |
Collapse
|