1
|
Woodworth GE, Goldstein ZT, Ambardekar AP, Arthur ME, Bailey CF, Booth GJ, Carney PA, Chen F, Duncan MJ, Fromer IR, Hallman MR, Hoang T, Isaak R, Klesius LL, Ladlie BL, Mitchell SA, Miller Juve AK, Mitchell JD, McGrath BJ, Shepler JA, Sims CR, Spofford CM, Tanaka PP, Maniker RB. Development and Pilot Testing of a Programmatic System for Competency Assessment in US Anesthesiology Residency Training. Anesth Analg 2024; 138:1081-1093. [PMID: 37801598 DOI: 10.1213/ane.0000000000006667] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/08/2023]
Abstract
BACKGROUND In 2018, a set of entrustable professional activities (EPAs) and procedural skills assessments were developed for anesthesiology training, but they did not assess all the Accreditation Council for Graduate Medical Education (ACGME) milestones. The aims of this study were to (1) remap the 2018 EPA and procedural skills assessments to the revised ACGME Anesthesiology Milestones 2.0, (2) develop new assessments that combined with the original assessments to create a system of assessment that addresses all level 1 to 4 milestones, and (3) provide evidence for the validity of the assessments. METHODS Using a modified Delphi process, a panel of anesthesiology education experts remapped the original assessments developed in 2018 to the Anesthesiology Milestones 2.0 and developed new assessments to create a system that assessed all level 1 through 4 milestones. Following a 24-month pilot at 7 institutions, the number of EPA and procedural skill assessments and mean scores were computed at the end of the academic year. Milestone achievement and subcompetency data for assessments from a single institution were compared to scores assigned by the institution's clinical competency committee (CCC). RESULTS New assessment development, 2 months of testing and feedback, and revisions resulted in 5 new EPAs, 11 nontechnical skills assessments (NTSAs), and 6 objective structured clinical examinations (OSCEs). Combined with the original 20 EPAs and procedural skills assessments, the new system of assessment addresses 99% of level 1 to 4 Anesthesiology Milestones 2.0. During the 24-month pilot, aggregate mean EPA and procedural skill scores significantly increased with year in training. System subcompetency scores correlated significantly with 15 of 23 (65.2%) corresponding CCC scores at a single institution, but 8 correlations (36.4%) were <30.0, illustrating poor correlation. CONCLUSIONS A panel of experts developed a set of EPAs, procedural skill assessment, NTSAs, and OSCEs to form a programmatic system of assessment for anesthesiology residency training in the United States. The method used to develop and pilot test the assessments, the progression of assessment scores with time in training, and the correlation of assessment scores with CCC scoring of milestone achievement provide evidence for the validity of the assessments.
Collapse
Affiliation(s)
- Glenn E Woodworth
- From the Department of Anesthesiology and Perioperative Medicine, Oregon Health & Science University, Portland, Oregon
| | - Zachary T Goldstein
- Department of Anesthesiology, Cedars Sinai Medical Center, Los Angeles, California
| | - Aditee P Ambardekar
- Department of Anesthesiology and Pain Management, University of Texas, Southwestern Medical Center, Dallas, Texas
| | - Mary E Arthur
- Department of Anesthesiology and Perioperative Medicine, Medical College of Georgia at Augusta University, Augusta, Georgia
| | - Caryl F Bailey
- Department of Anesthesiology and Perioperative Medicine, Medical College of Georgia at Augusta University, Augusta, Georgia
| | - Gregory J Booth
- Uniformed Services University of the Health Sciences, Department of Anesthesiology and Pain Medicine, Naval Medical Center Portsmouth, Portsmouth, Virginia
| | - Patricia A Carney
- Division of Hospital Medicine, Department of Family Medicine and Internal Medicine, Oregon Health & Science University, Portland, Oregon
| | - Fei Chen
- Department of Anesthesiology, University of North Carolina at Chapel Hill School of Medicine, Chapel Hill, North Carolina
| | - Michael J Duncan
- Department of Anesthesiology, University of Missouri-Kansas City, Kansas City, Missouri
| | - Ilana R Fromer
- Department of Anesthesiology, University of Minnesota, Minneapolis, Minnesota
| | - Matthew R Hallman
- Department of Anesthesiology and Pain Medicine, University of Washington, Seattle, Washington
| | - Thomas Hoang
- From the Department of Anesthesiology and Perioperative Medicine, Oregon Health & Science University, Portland, Oregon
| | - Robert Isaak
- Department of Anesthesiology, University of North Carolina, Chapel Hill, North Carolina
| | - Lisa L Klesius
- Department of Anesthesiology, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin
| | - Beth L Ladlie
- Department of Anesthesiology, Mayo Clinic, Rochester, Minnesota
| | | | - Amy K Miller Juve
- From the Department of Anesthesiology and Perioperative Medicine, Oregon Health & Science University, Portland, Oregon
| | - John D Mitchell
- Department of Anesthesiology, Critical Care, and Perioperative Medicine, Henry Ford Health, Detroit, Michigan
| | - Brian J McGrath
- Department of Anesthesiology, University of Florida College of Medicine-Jacksonville, Jacksonville, Florida
| | - John A Shepler
- Department of Anesthesiology, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin
| | - Charles R Sims
- Department of Anesthesiology & Perioperative Medicine, Mayo Clinic, Rochester, Minnesota
| | - Christina M Spofford
- Department of Anesthesiology, Medical College of Wisconsin, Milwaukee, Wisconsin
| | - Pedro P Tanaka
- Department of Anesthesiology, Stanford University, Stanford, California
| | - Robert B Maniker
- Department of Anesthesiology, Columbia University, New York, New York
| |
Collapse
|
2
|
Goldhamer MEJ, Pusic MV, Nadel ES, Co JPT, Weinstein DF. Promotion in Place: A Model for Competency-Based, Time-Variable Graduate Medical Education. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2024; 99:518-523. [PMID: 38285547 DOI: 10.1097/acm.0000000000005652] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/31/2024]
Abstract
PROBLEM Competency-based medical education is increasingly regarded as a preferred framework for physician training, but implementation is limited. U.S. residency programs remain largely time based, with variable assessments and limited opportunities for individualization. Gaps in graduates' readiness for unsupervised care have been noted across specialties. Logistical barriers and regulatory requirements constrain movement toward competency-based, time-variable (CBTV) graduate medical education (GME), despite its theoretical benefits. APPROACH The authors describe a vision for CBTV-GME and an implementation model that can be applied across specialties. Termed "Promotion in Place" (PIP), the model relies on enhanced assessment, clear criteria for advancement, and flexibility to adjust individuals' responsibilities and time in training based on demonstrated competence. PIP allows a resident's graduation to be advanced or delayed accordingly. Residents deemed competent for early graduation can transition to attending physician status within their training institution and benefit from a period of "sheltered independence" until the standard graduation date. Residents who need extended time to achieve competency have graduation delayed to incorporate additional targeted education. OUTCOMES A proposal to pilot the PIP model of CBTV-GME received funding through the American Medical Association's "Reimagining Residency" initiative in 2019. Ten of 46 residency programs in a multihospital system expressed interest and pursued initial planning. Seven programs withdrew for reasons including program director transitions, uncertainty about resident reactions, and the COVID-19 pandemic. Three programs petitioned their specialty boards for exemptions from time-based training. One program was granted the needed exemption and launched a PIP pilot, now in year 4, demonstrating the feasibility of implementing this model. Implementation tools and templates are described. NEXT STEPS Larger-scale implementation with longer-term assessment is needed to evaluate the impact and generalizability of this CBTV-GME model.
Collapse
|
3
|
Fuller SL, Ambardekar AP, Diachun CAB, Kearney MD, Long TR, Miller Juve AK, Mitchell JD, Woodworth GE. Competency-Based Time-Variable Anesthesiology Residency Training: Identification of Problems and Solutions. Anesth Analg 2024; 138:848-855. [PMID: 37450642 DOI: 10.1213/ane.0000000000006625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/18/2023]
Abstract
BACKGROUND Global medical education is gradually moving toward more comprehensive implementations of a competency-based education (CBE) model. Elimination of standard time-based training and adoption of time-variable training (competency-based time-variable training [CB-TVT]) is one of the final stages of implementation of CBE. While CB-TVT has been implemented in some programs outside the United States, residency programs in the United States are still exploring this approach to training. The Accreditation Council for Graduate Medical Education (ACGME) and the American Board of Medical Specialties (ABMS) are encouraging member boards and residency review committees to consider innovative ways programs could implement CB-TVT. The goals of this study were to (1) identify potential problems with the implementation of CB-TVT in anesthesiology residency training, (2) rank the importance of the problems and the perceived difficulty of solving them, and (3) develop proposed solutions to the identified problems. METHODS Study participants were recruited from key stakeholder groups in anesthesiology education, including current or former program directors, department chairs, residents, fellows, American Board of Anesthesiology (ABA) board members, ACGME residency review committee members or ACGME leaders, designated institutional officials, residency program coordinators, clinical operations directors, and leaders of large anesthesiology community practice groups. This study was conducted in 2 phases. In phase 1, survey questionnaires were iteratively distributed to participants to identify problems with the implementation of CB-TVT. Participants were also asked to rank the perceived importance and difficulty of each problem and to identify relevant stakeholder groups that would be responsible for solving each problem. In phase 2, surveys focused on identifying potential solutions for problems identified in phase 1. RESULTS A total of 36 stakeholders identified 39 potential problems, grouped into 7 major categories, with the implementation of CB-TVT in anesthesiology residency training. Of the 39 problems, 19 (48.7%) were marked as important or very important on a 5-point scale and 12 of 19 (63.2%) of the important problems were marked as difficult or very difficult to solve on a 5-point scale. Stakeholders proposed 165 total solutions to the identified problems. CONCLUSIONS CB-TVT is a promising educational model for anesthesiology residency, which potentially results in learner flexibility, individualization of curricula, and utilization of competencies to determine learner advancement. Because of the potential problems with the implementation of CB-TVT, it is important for future pilot implementations of CB-TVT to document realized problems, efficacy of solutions, and effects on educational outcomes to justify the burden of implementing CB-TVT.
Collapse
Affiliation(s)
- Skylar L Fuller
- From the Department of Anesthesiology and Perioperative Medicine, Oregon Health & Science University, Portland, Oregon
| | - Aditee P Ambardekar
- Department of Anesthesiology and Pain Management, University of Texas, Southwestern Medical Center, Dallas, Texas
| | - Carol Ann B Diachun
- Department of Anesthesiology, University of Florida-Jacksonville, Jacksonville, Florida
| | - Matthew D Kearney
- Department of Family Medicine and Community Health, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania
| | - Timothy R Long
- Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, Minnesota
| | - Amy K Miller Juve
- From the Department of Anesthesiology and Perioperative Medicine, Oregon Health & Science University, Portland, Oregon
| | - John D Mitchell
- Department of Anesthesiology, Critical Care, and Perioperative Medicine, Henry Ford Health, Detroit, Michigan
| | - Glenn E Woodworth
- From the Department of Anesthesiology and Perioperative Medicine, Oregon Health & Science University, Portland, Oregon
| |
Collapse
|
4
|
Frank JR, Karpinski J, Sherbino J, Snell LS, Atkinson A, Oswald A, Hall AK, Cooke L, Dojeiji S, Richardson D, Cheung WJ, Cavalcanti RB, Dalseg TR, Thoma B, Flynn L, Gofton W, Dudek N, Bhanji F, Wong BMF, Razack S, Anderson R, Dubois D, Boucher A, Gomes MM, Taber S, Gorman LJ, Fulford J, Naik V, Harris KA, St. Croix R, van Melle E. Competence By Design: a transformational national model of time-variable competency-based postgraduate medical education. PERSPECTIVES ON MEDICAL EDUCATION 2024; 13:201-223. [PMID: 38525203 PMCID: PMC10959143 DOI: 10.5334/pme.1096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 02/16/2024] [Indexed: 03/26/2024]
Abstract
Postgraduate medical education is an essential societal enterprise that prepares highly skilled physicians for the health workforce. In recent years, PGME systems have been criticized worldwide for problems with variable graduate abilities, concerns about patient safety, and issues with teaching and assessment methods. In response, competency based medical education approaches, with an emphasis on graduate outcomes, have been proposed as the direction for 21st century health profession education. However, there are few published models of large-scale implementation of these approaches. We describe the rationale and design for a national, time-variable competency-based multi-specialty system for postgraduate medical education called Competence by Design. Fourteen innovations were bundled to create this new system, using the Van Melle Core Components of competency based medical education as the basis for the transformation. The successful execution of this transformational training system shows competency based medical education can be implemented at scale. The lessons learned in the early implementation of Competence by Design can inform competency based medical education innovation efforts across professions worldwide.
Collapse
Affiliation(s)
- Jason R. Frank
- Centre for Innovation in Medical Education and Professor, Department of Emergency Medicine, Faculty of Medicine, University of Ottawa, ON, Canada
| | - Jolanta Karpinski
- Department of Medicine, University of Ottawa, Ottawa, ON, Canada
- Competency Based Medical Education, University of Ottawa, Ottawa, ON, Canada
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
| | | | - Linda S. Snell
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
- Medicine and Health Sciences Education, McGill University, Montreal, QC, Canada
| | - Adelle Atkinson
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
- Department of Paediatrics, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Anna Oswald
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
- Department of Medicine, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada
- Competency Based Medical Education, University of Alberta, Edmonton, AB, Canada
| | - Andrew K. Hall
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
- Department of Emergency Medicine, University of Ottawa, Ottawa, ON, Canada
| | - Lara Cooke
- Division of Neurology, Department of Clinical Neurosciences, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
| | - Susan Dojeiji
- Physical Medicine and Rehabilitation, University of Ottawa, Ottawa, ON, Canada
| | - Denyse Richardson
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
- Department of Physical Medicine and Rehabilitation, Queen’s University, Kingston, ON, Canada
| | - Warren J. Cheung
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
- Department of Medicine, University of Toronto, Toronto, ON, Canada
| | - Rodrigo B. Cavalcanti
- Department of Medicine, University of Toronto, Toronto, ON, Canada
- HoPingKong Centre, University Health Network, Toronto, ON, Canada
| | - Timothy R. Dalseg
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
- Division of Emergency Medicine, University of Toronto, Toronto, ON, Canada
| | - Brent Thoma
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
- Emergency Medicine, University of Saskatchewan, Saskatoon, SK, Canada
| | - Leslie Flynn
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
- Departments of Psychiatry and Family Medicine, and Co-Director Master of Health Sciences Education, Queen’s University, Kingston, ON, Canada
| | - Wade Gofton
- Department of Surgery (Division of Orthopedic Surgery), The Ottawa Hospital and University of Ottawa, Ottawa, ON, Canada
| | - Nancy Dudek
- Department of Medicine (Division of Physical Medicine & Rehabilitation) and The Ottawa Hospital, University of Ottawa, Ottawa, Ontario, Canada
| | - Farhan Bhanji
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
- Faculty of Medicine and Health Sciences, McGill University, Montreal, QC, Canada
| | - Brian M.-F. Wong
- Centre for Quality Improvement and Patient Safety, University of Toronto, Toronto, Canada
| | - Saleem Razack
- Centre for Health Education Scholarship, University of British Columbia and BC Children’s Hospital, Vancouver, BC, Canada
| | - Robert Anderson
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
- Northern Ontario School of Medicine University, Sudbury, ON, Canada
| | - Daniel Dubois
- Department of Anesthesiology and Pain Medicine, University of Ottawa, Ottawa, ON, Canada
| | - Andrée Boucher
- Department of Medicine (Division of Endocrinology), Universitéde Montréal, Montréal, QC, Canada
| | - Marcio M. Gomes
- Department of Pathology and Laboratory Medicine, University of Ottawa, Ottawa, ON, Canada
| | - Sarah Taber
- Office of Standards and Assessment, Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
| | - Lisa J. Gorman
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
| | - Jane Fulford
- Canadian Internet Registration Authority, Canada
| | - Viren Naik
- Department of Anesthesiology and Pain Medicine, University of Ottawa, Ottawa, ON, Canada
- Medical Council of Canada, Ottawa, ON, Canada
| | - Kenneth A. Harris
- Royal College of Physicians and Surgeons of Canada, Canada
- Emeritus, Western University, Canada
| | - Rhonda St. Croix
- Learning and Connecting at the Royal College of Physicians and Surgeons of Canada, Canada
| | - Elaine van Melle
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
- Department of Family Medicine, Queen’s University, Kingston, ON, Canada
| |
Collapse
|
5
|
Haidar DA, Hopson LR, Tucker RV, Huang RD, Koehler J, Theyyunni N, Klekowski N, Fung CM. Staffing Patterns of Non-ACGME Fellowships with 4-Year Residency Programs: A National Survey. West J Emerg Med 2024; 25:175-180. [PMID: 38596914 PMCID: PMC11000558 DOI: 10.5811/westjem.18454] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Revised: 11/10/2023] [Accepted: 12/07/2023] [Indexed: 04/11/2024] Open
Abstract
Introduction Emergency medicine (EM) is one of few specialties with variable training lengths. Hiring a three-year graduate to continue fellowship training in a department that supports a four-year residency program can lead to conflicts around resident supervision. We sought to understand hiring and clinical supervision, or staffing, patterns of non-Accreditation Council for Graduate Medical Education (ACGME) fellowships hosted at institutions supporting four-year residency programs. Methods We performed a web-based, cross-sectional survey of non-ACGME fellowship directors (FD) hosted at institutions supporting four-year EM residency programs. We calculated descriptive statistics. Our primary outcome was the proportion of programs with four-year EM residencies that hire non-ACGME fellows graduating from three-year EM residencies. Results Of 119 eligible FDs, 88 (74%) completed the survey. Seventy FDs (80%) indicated that they hire graduates of three-year residencies. Fifty-six (80%) indicated that three-year graduates supervise residents. Most FDs (74%) indicated no additional requirements exist to supervise residents outside of being hired as faculty. The FDs cited department policy, concerns about quality and length of training, and resident complaints as reasons for not hiring three-year graduates. A majority (10/18, 56%) noted that not hiring fellows from three-year programs negatively impacts recruitment and gives them access to a smaller applicant pool. Conclusion Most non-ACGME fellowships at institutions with four-year EM programs recruit three-year graduates and allow them to supervise residents. This survey provides programs information on how comparable fellowships recruit and staff their departments, which may inform policies that fit the needs of their learners, the fellowship, and the department.
Collapse
Affiliation(s)
- David A. Haidar
- University of Michigan, Department of Emergency Medicine, Ann Arbor, Michigan
| | - Laura R. Hopson
- University of Michigan, Department of Emergency Medicine, Ann Arbor, Michigan
| | - Ryan V. Tucker
- University of Colorado, Department of Emergency Medicine, Aurora, Colorado
| | - Rob D. Huang
- University of Michigan, Department of Emergency Medicine, Ann Arbor, Michigan
| | - Jessica Koehler
- University of Michigan, Department of Emergency Medicine, Ann Arbor, Michigan
| | - Nik Theyyunni
- University of Michigan, Department of Emergency Medicine, Ann Arbor, Michigan
| | - Nicole Klekowski
- University of Michigan, Department of Emergency Medicine, Ann Arbor, Michigan
| | - Christopher M. Fung
- University of Michigan, Department of Emergency Medicine, Ann Arbor, Michigan
| |
Collapse
|
6
|
Gates RS, Marcotte K, Moreci R, Krumm AE, Lynch KA, Bailey C, George BC. An Ideal System of Assessment to Support Competency-Based Graduate Medical Education: Key Attributes and Proposed Next Steps. JOURNAL OF SURGICAL EDUCATION 2024; 81:172-177. [PMID: 38158276 DOI: 10.1016/j.jsurg.2023.10.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 09/09/2023] [Accepted: 10/11/2023] [Indexed: 01/03/2024]
Abstract
Competency-based medical education (CBME) is the future of medical education and relies heavily on high quality assessment. However, the current assessment practices employed by many general surgery graduate medical education training programs are subpar. Assessments often lack reliability and validity evidence, have low faculty engagement, and differ from program to program. Given the importance of assessment in CBME, it is critical that we build a better assessment system for measuring trainee competency. We propose that an ideal system of assessment is standardized, evidence-based, comprehensive, integrated, and continuously improving. In this article, we explore these characteristics and propose next steps to achieve such a system of assessment in general surgery.
Collapse
Affiliation(s)
- Rebecca S Gates
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, Michigan.
| | - Kayla Marcotte
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, Michigan; Department of Learning and Health Sciences, University of Michigan, Ann Arbor, Michigan
| | - Rebecca Moreci
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, Michigan
| | - Andrew E Krumm
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, Michigan; Department of Learning and Health Sciences, University of Michigan, Ann Arbor, Michigan
| | - Kenneth A Lynch
- Department of Surgery, Brown University, Providence, Rhode Island
| | - Christina Bailey
- Department of Surgery, Vanderbilt University, Nashville, Tennessee
| | - Brian C George
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, Michigan
| |
Collapse
|
7
|
Lee HJ, Akulian JA, Argento AC, Batra H, Lamb C, Mullon J, Murgu S. Interventional Pulmonary Fellowship Training: End of the Beginning. ATS Sch 2023; 4:405-412. [PMID: 38196682 PMCID: PMC10773264 DOI: 10.34197/ats-scholar.2022-0107ps] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 06/23/2023] [Indexed: 01/11/2024] Open
Abstract
Interventional pulmonology (IP) fellowship training has undergone increased popularity and growth. The Accreditation Council of Graduate Medical Education recently recognized IP medicine as a new subspecialty, which leads to new challenges and opportunities for a young subspecialty. Although the specialty-specific requirements are in progress, IP fellowship programs must plan ahead for the known common program requirements and anticipated accreditation process. The educational leadership in IP must identify and execute solutions to sustain continued excellence. This includes transitioning to a new regulatory environment with issues of funding new fellowships, keeping up to date with training/assessment of new procedures, and shaping the future through recruitment of talent to lead the young subspecialty.
Collapse
Affiliation(s)
- Hans J. Lee
- Section of Interventional Pulmonology, Division of Pulmonary and Critical Care Medicine, The Johns Hopkins University School of Medicine, Baltimore, Maryland
| | - Jason A. Akulian
- Division of Pulmonary and Critical Care Medicine, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - A. Christine Argento
- Section of Interventional Pulmonology, Division of Pulmonary and Critical Care Medicine, The Johns Hopkins University School of Medicine, Baltimore, Maryland
| | - Hitesh Batra
- University of Alabama at Birmingham, Birmingham, Alabama
| | - Carla Lamb
- Lahey Hospital and Medical Center, Burlington, Massachusetts
| | - John Mullon
- Division of Pulmonary, Critical Care, and Sleep Medicine, Mayo Clinic, Rochester, Minnesota; and
| | | |
Collapse
|
8
|
Carney PA, Sebok-Syer SS, Pusic MV, Gillespie CC, Westervelt M, Goldhamer MEJ. Using learning analytics in clinical competency committees: Increasing the impact of competency-based medical education. MEDICAL EDUCATION ONLINE 2023; 28:2178913. [PMID: 36821373 PMCID: PMC9970252 DOI: 10.1080/10872981.2023.2178913] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Revised: 02/02/2023] [Accepted: 02/07/2023] [Indexed: 06/18/2023]
Abstract
Graduate medical education (GME) and Clinical Competency Committees (CCC) have been evolving to monitor trainee progression using competency-based medical education principles and outcomes, though evidence suggests CCCs fall short of this goal. Challenges include that evaluation data are often incomplete, insufficient, poorly aligned with performance, conflicting or of unknown quality, and CCCs struggle to organize, analyze, visualize, and integrate data elements across sources, collection methods, contexts, and time-periods, which makes advancement decisions difficult. Learning analytics have significant potential to improve competence committee decision making, yet their use is not yet commonplace. Learning analytics (LA) is the interpretation of multiple data sources gathered on trainees to assess academic progress, predict future performance, and identify potential issues to be addressed with feedback and individualized learning plans. What distinguishes LA from other educational approaches is systematic data collection and advanced digital interpretation and visualization to inform educational systems. These data are necessary to: 1) fully understand educational contexts and guide improvements; 2) advance proficiency among stakeholders to make ethical and accurate summative decisions; and 3) clearly communicate methods, findings, and actionable recommendations for a range of educational stakeholders. The ACGME released the third edition CCC Guidebook for Programs in 2020 and the 2021 Milestones 2.0 supplement of the Journal of Graduate Medical Education (JGME Supplement) presented important papers that describe evaluation and implementation features of effective CCCs. Principles of LA underpin national GME outcomes data and training across specialties; however, little guidance currently exists on how GME programs can use LA to improve the CCC process. Here we outline recommendations for implementing learning analytics for supporting decision making on trainee progress in two areas: 1) Data Quality and Decision Making, and 2) Educator Development.
Collapse
Affiliation(s)
- Patricia A. Carney
- Professor of Family Medicine, Oregon Health & Science University, Portland, OR, USA
| | | | | | | | - Marjorie Westervelt
- Director of Assessment, Evaluation and Scholarship, University of California, Davis, CA, USA
| | - Mary Ellen J. Goldhamer
- Medicine, Harvard Medical School, Massachusetts General Hospital, and Mass General Brigham, Boston, MA, USA
| |
Collapse
|
9
|
Peacock J, Austin A, Shapiro M, Battista A, Samuel A. Accelerating medical education with ChatGPT: an implementation guide. MEDEDPUBLISH 2023; 13:64. [PMID: 38440148 PMCID: PMC10910173 DOI: 10.12688/mep.19732.2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/17/2023] [Indexed: 03/06/2024] Open
Abstract
Chatbots powered by artificial intelligence have revolutionized many industries and fields of study, including medical education. Medical educators are increasingly asked to perform more administrative, written, and assessment functions with less time and resources. Safe use of chatbots, like ChatGPT, can help medical educators efficiently perform these functions. In this article, we provide medical educators with tips for the implementation of ChatGPT in medical education. Through creativity and careful construction of prompts, medical educators can use these and other implementations of chatbots, like ChatGPT, in their practice.
Collapse
Affiliation(s)
- Justin Peacock
- Department of Radiology and Radiological Sciences, Uniformed Services University, Bethesda, MD, USA
| | - Andrea Austin
- Department of Military and Emergency Medicine, Uniformed Services University, Bethesda, MD, USA
- UHS Southern California Education Consortium, Temecula, CA, USA
| | - Marina Shapiro
- Center for Health Professions Education, Uniformed Services University, Bethesda, MD, USA
| | - Alexis Battista
- Center for Health Professions Education, Uniformed Services University, Bethesda, MD, USA
| | - Anita Samuel
- Center for Health Professions Education, Uniformed Services University, Bethesda, MD, USA
| |
Collapse
|
10
|
Bhavsar-Burke I, Shah BJ, Carethers JM, Whitson MJ, Kaul V, David Y, Dilly CK. Reimagining Gastroenterology Fellowship Training: The Third Year of the Future. Gastroenterology 2023; 164:872-875.e2. [PMID: 36868527 PMCID: PMC11264334 DOI: 10.1053/j.gastro.2023.02.029] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/05/2023]
Affiliation(s)
- Indira Bhavsar-Burke
- Division of Gastroenterology, Hepatology, and Nutrition, Cleveland Clinic, Cleveland, Ohio
| | - Brijen J Shah
- Department of Medicine, Geriatrics and Medical Education, Icahn School of Medicine at Mount Sinai, New York, New York
| | - John M Carethers
- Department of Medicine, Division of Gastroenterology, University of California San Diego, La Jolla, California
| | - Matthew J Whitson
- Division of Gastroenterology and Hepatology, The Donald and Barbara Zucker School of Medicine at Hofstra-Northwell, Long Island, New York
| | - Vivek Kaul
- Division of Gastroenterology and Hepatology, University of Rochester, Rochester, New York
| | | | - Christen K Dilly
- Division of Gastroenterology, Hepatology, and Nutrition, Indiana University School of Medicine, Indianapolis, Indiana; Roudebush VA Medical Center, Indianapolis, Indiana.
| |
Collapse
|
11
|
Cardiovascular Critical Care Training: A Collaboration between Intensivists and Cardiologists. ATS Sch 2022; 3:522-534. [PMID: 36726709 PMCID: PMC9885994 DOI: 10.34197/ats-scholar.2022-0087ps] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Accepted: 10/21/2022] [Indexed: 11/13/2022] Open
Abstract
With growing patient complexity, the cardiovascular intensive care unit (CICU) of today has evolved substantially from the coronary care unit (CCU) of decades ago. The growing burden of noncardiac critical illness and highly specialized acute cardiovascular disease requires a degree of expertise beyond that afforded through a general cardiology training program. Therefore, the American Heart Association (AHA) has proposed a CICU staffing model to include dedicated cardiac intensivists; in the present day, "dual-trained" physicians are extremely sparse. Guidance on designing critical care fellowships for cardiologists is limited but will require collaboration between cardiologists and medical intensivists. Here, we review the evolution of the CICU, describe training pathways, and offer guidance on creating a cardiology critical care training program.
Collapse
|
12
|
Menchetti I, Eagles D, Ghanem D, Leppard J, Fournier K, Cheung WJ. Gender differences in emergency medicine resident assessment: A scoping review. AEM EDUCATION AND TRAINING 2022; 6:e10808. [PMID: 36189450 PMCID: PMC9513437 DOI: 10.1002/aet2.10808] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Revised: 09/05/2022] [Accepted: 09/06/2022] [Indexed: 05/26/2023]
Abstract
Background Growing literature within postgraduate medical education demonstrates that female resident physicians experience gender bias throughout their training and future careers. This scoping review aims to describe the current body of literature on gender differences in emergency medicine (EM) resident assessment. Methods We conducted a scoping review which adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines. We included research involving resident physicians or fellows in EM (population and context), which focused on the impact of gender on assessments (concept). We searched seven databases from the databases' inception to April 4, 2022. Two reviewers independently screened citations, completed full-text review, and abstracted data. A third reviewer resolved any discrepancies. Results A total of 667 unique citations were identified; 10 studies were included, and all were conducted within the United States. Four studies reported differences in EM resident assessments attributable to gender within workplace-based assessments (qualitative comments and quantitative scores) by both attending physicians and nonphysicians. Six studies investigating clinical competency committee scores, procedural scores, and simulation-based assessments did not report any significant differences attributable to gender. Conclusions This scoping review found that gender bias exists within EM resident assessment most notably at the level of narrative comments typically received via workplace-based assessments. As female EM residents receive higher rates of negative or critical comments and discordant feedback documented on assessment, these findings raise concern about added barriers female EM residents may face while progressing through residency and the impact on their clinical and professional development.
Collapse
Affiliation(s)
| | - Debra Eagles
- Department of Emergency MedicineUniversity of OttawaOttawaOntarioCanada
- School of Epidemiology and Public HealthUniversity of OttawaOttawaOntarioCanada
| | - Dana Ghanem
- Faculty of MedicineUniversity of OttawaOttawaOntarioCanada
| | - Jennifer Leppard
- Department of Emergency MedicineUniversity of OttawaOttawaOntarioCanada
| | - Karine Fournier
- Health Sciences LibraryUniversity of OttawaOttawaOntarioCanada
| | - Warren J. Cheung
- Department of Emergency MedicineUniversity of OttawaOttawaOntarioCanada
- Royal College of Physicians and Surgeons of CanadaOttawaOntarioCanada
| |
Collapse
|