1
|
Matava CT, Alam F, Kealey A, Bahrey LA, McCreath GA, Walsh CM. The influence of resident and faculty gender on assessments in anesthesia competency-based medical education. Can J Anaesth 2023; 70:978-987. [PMID: 37165126 PMCID: PMC10171726 DOI: 10.1007/s12630-023-02454-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2022] [Revised: 11/15/2022] [Accepted: 11/17/2022] [Indexed: 05/12/2023] Open
Abstract
PURPOSE Competency-based medical education (CBME) relies on frequent workplace-based assessments of trainees, providing opportunities for conscious and implicit biases to reflect in these assessments. We aimed to examine the influence of resident and faculty gender on performance ratings of residents within a CBME system. METHODS This retrospective cohort study took place from August 2017 to January 2021 using resident assessment data from two workplace-based assessments: the Anesthesia Clinical Encounter Assessment (ACEA) and Entrustable Professional Activities (EPAs). Self-reported gender data were also extracted. The primary outcome-gender-based differences in entrustment ratings of residents on the ACEA and EPAs-was evaluated using mixed-effects logistic regression, with differences reported through odds ratios and confidence intervals (α = 0.01). Gender-based differences in the receipt of free-text comments on the ACEA and EPAs were also explored. RESULTS In total, 14,376 ACEA and 4,467 EPA assessments were analyzed. There were no significant differences in entrustment ratings on either assessment tool between men and women residents. Regardless of whether assessments were completed by men or women faculty, entrustment rates between men and women residents were not significantly different for any postgraduate year level. Additionally, men and women residents received strengths-related and actions-related comments on both assessments at comparable frequencies, irrespective of faculty gender. CONCLUSION We found no gender-based differences in entrustment ratings for both the ACEA and EPAs, which suggests an absence of resident gender bias within this CBME system. Given considerable heterogeneity in rater leniency, future work would be strengthened by using rater leniency-adjusted scores rather than raw scores.
Collapse
Affiliation(s)
- Clyde T Matava
- Department of Anesthesia and Pain Medicine, The Hospital for Sick Children, 555 University Ave., Toronto, ON, M5G 1X8, Canada.
- Department of Anesthesiology and Pain Medicine, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada.
- SickKids Research Institute, The Hospital for Sick Children, Toronto, ON, Canada.
| | - Fahad Alam
- Department of Anesthesiology and Pain Medicine, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- Department of Anesthesia, Sunnybrook Health Sciences Centre, Toronto, ON, Canada
| | - Alayne Kealey
- Department of Anesthesia and Pain Medicine, The Hospital for Sick Children, 555 University Ave., Toronto, ON, M5G 1X8, Canada
- Department of Anesthesiology and Pain Medicine, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Lisa A Bahrey
- Department of Anesthesiology and Pain Medicine, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- Department of Anesthesia, University Health Network-Toronto General Hospital, Toronto, ON, Canada
| | - Graham A McCreath
- SickKids Research Institute, The Hospital for Sick Children, Toronto, ON, Canada
| | - Catharine M Walsh
- SickKids Research Institute, The Hospital for Sick Children, Toronto, ON, Canada
- Division of Gastroenterology, Hepatology and Nutrition, The Hospital for Sick Children, Toronto, ON, Canada
- Department of Paediatrics, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- The Wilson Centre, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
2
|
Affiliation(s)
- Fahad Alam
- From the Department of Anesthesia, Sunnybrook Health Sciences Centre.,Sunnybrook Simulation Centre, Toronto, Ontario, Canada.,Wilson Centre for Research in Medical Education, Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada.,Canadian Anesthesiologists' Society-Simulation and Education Section, Toronto, Ontario, Canada.,Collaborative Human ImmerSive Interaction Laboratory, Toronto, Ontario, Canada.,Department of Anesthesiology and Pain Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Clyde Matava
- Collaborative Human ImmerSive Interaction Laboratory, Toronto, Ontario, Canada.,Department of Anesthesiology and Pain Medicine, University of Toronto, Toronto, Ontario, Canada.,Department of Anesthesia and Pain Medicine, Hospital for Sick Children, Toronto, Ontario, Canada
| |
Collapse
|
3
|
Kealey A, Naik VN. Competency-Based Medical Training in Anesthesiology: Has It Delivered on the Promise of Better Education? Anesth Analg 2022; 135:223-229. [PMID: 35839492 DOI: 10.1213/ane.0000000000006091] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Affiliation(s)
- Alayne Kealey
- From the Department of Anesthesia, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada.,Department of Anesthesiology and Pain Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Viren N Naik
- Department of Anesthesiology and Pain Medicine, University of Ottawa, Ottawa, Ontario, Canada
| |
Collapse
|
4
|
Bailey K, West NC, Matava C. Competency-Based Medical Education: Are Canadian Pediatric Anesthesiologists Ready? Cureus 2022; 14:e22344. [PMID: 35223329 PMCID: PMC8862616 DOI: 10.7759/cureus.22344] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/17/2022] [Indexed: 11/05/2022] Open
Abstract
Background With the introduction of Competency-Based Medical Education (CBME), the Canadian Pediatric Anesthesia Society (CPAS) surveyed its members to assess their awareness of and prior experience with CBME concepts and evaluation tools, and identify methods for faculty development of CBME teaching strategies for pediatric anesthesia residents and fellows. Methods An online survey was sent to CPAS members. Outcomes included respondents’ previous exposure to CBME and the educational support they had received in anticipation of the curriculum. Questions used multi-item Likert scales and a general feedback question. Results The response rate was 39% (60/155). Eighty-eight percent of respondents spent ≥50% of their time practicing pediatric anesthesia; 78% and 45% spent at least a quarter of their time teaching residents and fellows respectively. Eighty-three percent were familiar with CBME concepts, and 58% were familiar with Milestones, Competencies, and Entrustable Professional Activities (EPAs). However, 64% had not received any formal training and 52% had not used any CBME evaluation tools. Learning preferences included small group discussions (72%), lectures with questions and answers (Q&A) (62%), seminars (50%), and workshops (50%). Conclusions Despite widespread awareness of CBME concepts, there is a need to educate Canadian pediatric anesthesiologists regarding CBME evaluation tools. Faculty development support will increase the utilization of these tools in teaching practice.
Collapse
|