1
|
Green ML, Aagaard EM, Caverzagie KJ, Chick DA, Holmboe E, Kane G, Smith CD, Iobst W. Charting the road to competence: developmental milestones for internal medicine residency training. J Grad Med Educ 2009; 1:5-20. [PMID: 21975701 PMCID: PMC2931179 DOI: 10.4300/01.01.0003] [Citation(s) in RCA: 214] [Impact Index Per Article: 13.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/06/2022] Open
Abstract
BACKGROUND The Accreditation Council for Graduate Medical Education (ACGME) Outcome Project requires that residency program directors objectively document that their residents achieve competence in 6 general dimensions of practice. INTERVENTION In November 2007, the American Board of Internal Medicine (ABIM) and the ACGME initiated the development of milestones for internal medicine residency training. ABIM and ACGME convened a 33-member milestones task force made up of program directors, experts in evaluation and quality, and representatives of internal medicine stakeholder organizations. This article reports on the development process and the resulting list of proposed milestones for each ACGME competency. OUTCOMES The task force adopted the Dreyfus model of skill acquisition as a framework the internal medicine milestones, and calibrated the milestones with the expectation that residents achieve, at a minimum, the "competency" level in the 5-step progression by the completion of residency. The task force also developed general recommendations for strategies to evaluate the milestones. DISCUSSION The milestones resulting from this effort will promote competency-based resident education in internal medicine, and will allow program directors to track the progress of residents and inform decisions regarding promotion and readiness for independent practice. In addition, the milestones may guide curriculum development, suggest specific assessment strategies, provide benchmarks for resident self-directed assessment-seeking, and assist remediation by facilitating identification of specific deficits. Finally, by making explicit the profession's expectations for graduates and providing a degree of national standardization in evaluation, the milestones may improve public accountability for residency training.
Collapse
|
research-article |
16 |
214 |
2
|
Lyss-Lerman P, Teherani A, Aagaard E, Loeser H, Cooke M, Harper GM. What training is needed in the fourth year of medical school? Views of residency program directors. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2009; 84:823-9. [PMID: 19550170 DOI: 10.1097/acm.0b013e3181a82426] [Citation(s) in RCA: 184] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
PURPOSE To identify common struggles of interns, determine residency program directors' (PDs') views of the competencies to be gained in the fourth year of medical school, and apply this information to formulate goals of curricular reform and student advising. METHOD In 2007, semistructured interviews were conducted with 30 PDs in the 10 most common specialty choices of students at the University of California, San Francisco, School of Medicine to assess the PDs' priorities for knowledge, skills, and attitudes to be acquired in the fourth year. Interviews were coded to identify major themes. RESULTS Common struggles of interns were lack of self-reflection and improvement, poor organizational skills, underdeveloped professionalism, and lack of medical knowledge. The Accreditation Council for Graduate Medical Education competencies of patient care, practice-based learning and improvement, interpersonal and communication skills, and professionalism were deemed fundamental to fourth-year students' development. Rotations recommended across specialties were a subinternship in a student's future field and in internal medicine (IM), rotations in an IM subspecialty, critical care, and emergency and ambulatory medicine. PDs encouraged minimizing additional time spent in the student's future field. Suggested coursework included an intensively coached transitional subinternship and courses to improve students' medical knowledge. CONCLUSIONS PDs deemed the fourth year to have a critical role in the curriculum. There was consensus about expected fourth-year competencies and the common clinical experiences that best prepare students for residency training. These findings support using the fourth year to transition students to graduate medical training and highlight areas for curricular innovation.
Collapse
|
|
16 |
184 |
3
|
Guerrasio J, Garrity MJ, Aagaard EM. Learner deficits and academic outcomes of medical students, residents, fellows, and attending physicians referred to a remediation program, 2006-2012. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2014; 89:352-8. [PMID: 24362382 DOI: 10.1097/acm.0000000000000122] [Citation(s) in RCA: 110] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
Abstract
PURPOSE To identify deficit types and predictors of poor academic outcomes among students, residents, fellows, and physicians referred to the University of Colorado School of Medicine's remediation program. METHOD During 2006-2012, 151 learners were referred. After a standardized assessment process, program faculty developed individualized learning plans that incorporated deliberate practice, feedback, and reflection, followed by independent reassessment. The authors collected data on training levels, identified deficits, remediation plan details, outcomes, and faculty time invested. They examined relationships between gender, training level, and specific deficits. They analyzed faculty time by deficit and explored predictors of negative outcomes. RESULTS Most learners had more than one deficit; medical knowledge, clinical reasoning, and professionalism were most common. Medical students were more likely than others to have mental well-being issues (P = .03), whereas the prevalence of professionalism deficits increased steadily as training level increased. Men struggled more than women with communication (P = .01) and mental well-being. Poor professionalism was the only predictor of probationary status (P < .001), and probation was a predictor of other negative outcomes (P < .0001). Remediation of clinical reasoning and mental well-being deficits required significantly more faculty time (P < .001 and P = .03, respectively). Per hour, faculty face time reduced the odds of probation by 3.1% (95% CI, 0.09-0.63) and all negative outcomes by 2.6% (95% CI, 0.96-0.99). CONCLUSIONS Remediation required substantial resources but was successful for 90% of learners. Future studies should compare remediation strategies and assess how to optimize faculty time.
Collapse
|
|
11 |
110 |
4
|
Stickrath C, Noble M, Prochazka A, Anderson M, Griffiths M, Manheim J, Sillau S, Aagaard E. Attending rounds in the current era: what is and is not happening. JAMA Intern Med 2013; 173:1084-9. [PMID: 23649040 DOI: 10.1001/jamainternmed.2013.6041] [Citation(s) in RCA: 89] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
IMPORTANCE General medicine rounds by attending physicians provide the foundation for patient care and education in teaching hospitals. However, the detailed activities of these rounds in the current era are not well characterized. OBJECTIVE To describe the characteristics of attending rounds for internal medicine inpatients in a large teaching hospital system. DESIGN A cross-sectional observational study of attending rounds in internal medicine. Rounds were observed directly by research assistants. SETTING Four teaching hospitals associated with a large public medical school. PARTICIPANTS Fifty-six attending physicians and 279 trainees treating 807 general medicine inpatients. MAIN OUTCOMES AND MEASURES Duration and location of rounds, composition of teams, and frequency of 19 potential activities during rounds. RESULTS We observed 90 days of rounds. A typical rounding day consisted of 1 attending with 3 trainees visiting a median of 9 (range, 2-18 [SD, 2.9]) patients for a median of 2.0 hours (range, 25-241 [SD, 2.7] minutes). On rounds, teams most frequently discussed the patient care plan (96.7% of patients), reviewed diagnostic studies (90.7%), communicated with patients (73.4%), and discussed the medication list (68.8%). Teams infrequently discussed invasive lines or tubes (9.3%) or nursing notes (6.2%) and rarely communicated with nurses (12.0%) or taught physical examination skills (14.6%), evidence-based medicine topics (7.2%), or learner-identified topics (3.2%). Many commonly performed activities occurred infrequently at the bedside. CONCLUSIONS AND RELEVANCE Most activities on attending rounds do not take place at the bedside. The teams discuss patient care plans and test results most of the time but fail to include many items that may be of significant value, including specific aspects of patient care, interprofessional communication, and learner-centered education. Future studies are needed to further assess the implications of these observations.
Collapse
|
Multicenter Study |
12 |
89 |
5
|
Abstract
To describe medical students' mentoring relationships and determine characteristics associated with having mentors, 232/302 (77%) of third- and fourth-year medical students at the University of California at San Francisco (UCSF) were surveyed. Twenty-six percent of third-year and 45% of fourth-year students had mentors. Most met their mentors during inpatient clerkships (28%), research (19%), or sought them on the basis of similar interests (23%). On multivariate analysis, students who performed research prior to (odds ratio [OR], 4.8; 95% confidence interval [95% CI], 1.4 to 16.7; P =.01) or during medical school (OR, 2.4; 95% CI, 1.1 to 5.6; P =.03) and students satisfied with advising from all sources at UCSF (OR, 1.8; 95% CI, 1.4 to 2.4; P <.001) were more likely to have mentors.
Collapse
|
brief-report |
22 |
88 |
6
|
Aagaard E, Teherani A, Irby DM. Effectiveness of the one-minute preceptor model for diagnosing the patient and the learner: proof of concept. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2004; 79:42-49. [PMID: 14690996 DOI: 10.1097/00001888-200401000-00010] [Citation(s) in RCA: 82] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
PURPOSE To compare the One-Minute Preceptor (OMP) and traditional models of ambulatory teaching in terms of the preceptors' (1) ability to correctly diagnose patients' medical problems, (2) ability to rate students' skills and confidence in doing so, and (3) satisfaction with both models. METHOD A within-groups experimental design study was conducted with 116 preceptors at seven universities in 2000. Participants viewed scripted, videotaped precepting encounters of both models using two cases and were asked to rate students' abilities, their confidence in rating the students' abilities, and the effectiveness and efficiency of the teaching encounters. RESULTS Preceptors who viewed the videotapes of the OMP model were equally or better able to correctly diagnose the patients' medical conditions than those viewing the traditional model. Preceptors viewing the OMP rated students' abilities higher on history taking/physical examination, presentations, clinical reasoning, and fund of knowledge than did those viewing the traditional model. Preceptors viewing the OMP rated themselves as more confident in rating students' abilities in presentation, clinical reasoning, and fund of knowledge. Preceptors rated the OMP as more effective and more efficient than the traditional model. CONCLUSIONS Preceptors viewing scripted, videotaped teaching encounters using the OMP model were equal to or better able to correctly diagnose patients' medical problems, had greater self-confidence in rating students, and rated the encounter as more effective and efficient than when viewing the traditional model.
Collapse
|
|
21 |
82 |
7
|
Wani S, Han S, Simon V, Hall M, Early D, Aagaard E, Abidi WM, Banerjee S, Baron TH, Bartel M, Bowman E, Brauer BC, Buscaglia JM, Carlin L, Chak A, Chatrath H, Choudhary A, Confer B, Coté GA, Das KK, DiMaio CJ, Dries AM, Edmundowicz SA, Chafic AHE, Hajj IE, Ellert S, Ferreira J, Gamboa A, Gan IS, Gangarosa L, Gannavarapu B, Gordon SR, Guda NM, Hammad HT, Harris C, Jalaj S, Jowell P, Kenshil S, Klapman J, Kochman ML, Komanduri S, Lang G, Lee LS, Loren DE, Lukens F, Mullady D, Muthusamy RV, Nett AS, Olyaee MS, Pakseresht K, Perera P, Pfau P, Piraka C, Poneros JM, Rastogi A, Razzak A, Riff B, Saligram S, Scheiman JM, Schuster I, Shah RJ, Sharma R, Spaete JP, Singh A, Sohail M, Sreenarasimhaiah J, Stevens T, Tabibian JH, Tzimas D, Uppal DS, Urayama S, Vitterbo D, Wang AY, Wassef W, Yachimski P, Zepeda-Gomez S, Zuchelli T, Keswani RN. Setting minimum standards for training in EUS and ERCP: results from a prospective multicenter study evaluating learning curves and competence among advanced endoscopy trainees. Gastrointest Endosc 2019; 89:1160-1168.e9. [PMID: 30738985 PMCID: PMC6527477 DOI: 10.1016/j.gie.2019.01.030] [Citation(s) in RCA: 81] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/30/2018] [Accepted: 01/25/2019] [Indexed: 02/08/2023]
Abstract
BACKGROUND AND AIMS Minimum EUS and ERCP volumes that should be offered per trainee in "high quality" advanced endoscopy training programs (AETPs) are not established. We aimed to define the number of procedures required by an "average" advanced endoscopy trainee (AET) to achieve competence in technical and cognitive EUS and ERCP tasks to help structure AETPs. METHODS American Society for Gastrointestinal Endoscopy (ASGE)-recognized AETPs were invited to participate; AETs were graded on every fifth EUS and ERCP examination using a validated tool. Grading for each skill was done using a 4-point scoring system, and learning curves using cumulative sum analysis for overall, technical, and cognitive components of EUS and ERCP were shared with AETs and trainers quarterly. Generalized linear mixed-effects models with a random intercept for each AET were used to generate aggregate learning curves, allowing us to use data from all AETs to estimate the average learning experience for trainees. RESULTS Among 62 invited AETPs, 37 AETs from 32 AETPs participated. Most AETs reported hands-on EUS (52%, median 20 cases) and ERCP (68%, median 50 cases) experience before starting an AETP. The median number of EUS and ERCPs performed per AET was 400 (range, 200-750) and 361 (range, 250-650), respectively. Overall, 2616 examinations were graded (EUS, 1277; ERCP-biliary, 1143; pancreatic, 196). Most graded EUS examinations were performed for pancreatobiliary indications (69.9%) and ERCP examinations for ASGE biliary grade of difficulty 1 (72.1%). The average AET achieved competence in core EUS and ERCP skills at approximately 225 and 250 cases, respectively. However, overall technical competence was achieved for grade 2 ERCP at about 300 cases. CONCLUSION The thresholds provided for an average AET to achieve competence in EUS and ERCP may be used by the ASGE and AETPs in establishing the minimal standards for case volume exposure for AETs during their training. (Clinical trial registration number: NCT02509416.).
Collapse
|
Research Support, N.I.H., Extramural |
6 |
81 |
8
|
Wani S, Keswani RN, Han S, Aagaard EM, Hall M, Simon V, Abidi WM, Banerjee S, Baron TH, Bartel M, Bowman E, Brauer BC, Buscaglia JM, Carlin L, Chak A, Chatrath H, Choudhary A, Confer B, Coté GA, Das KK, DiMaio CJ, Dries AM, Edmundowicz SA, El Chafic AH, El Hajj I, Ellert S, Ferreira J, Gamboa A, Gan IS, Gangarosa LM, Gannavarapu B, Gordon SR, Guda NM, Hammad HT, Harris C, Jalaj S, Jowell PS, Kenshil S, Klapman J, Kochman ML, Komanduri S, Lang G, Lee LS, Loren DE, Lukens FJ, Mullady D, Muthusamy VR, Nett AS, Olyaee MS, Pakseresht K, Perera P, Pfau P, Piraka C, Poneros JM, Rastogi A, Razzak A, Riff B, Saligram S, Scheiman JM, Schuster I, Shah RJ, Sharma R, Spaete JP, Singh A, Sohail M, Sreenarasimhaiah J, Stevens T, Tabibian JH, Tzimas D, Uppal DS, Urayama S, Vitterbo D, Wang AY, Wassef W, Yachimski P, Zepeda-Gomez S, Zuchelli T, Early D. Competence in Endoscopic Ultrasound and Endoscopic Retrograde Cholangiopancreatography, From Training Through Independent Practice. Gastroenterology 2018; 155:1483-1494.e7. [PMID: 30056094 PMCID: PMC6504935 DOI: 10.1053/j.gastro.2018.07.024] [Citation(s) in RCA: 60] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/21/2018] [Revised: 07/18/2018] [Accepted: 07/21/2018] [Indexed: 12/21/2022]
Abstract
BACKGROUND & AIMS It is unclear whether participation in competency-based fellowship programs for endoscopic ultrasound (EUS) and endoscopic retrograde cholangiopancreatography (ERCP) results in high-quality care in independent practice. We measured quality indicator (QI) adherence during the first year of independent practice among physicians who completed endoscopic training with a systematic assessment of competence. METHODS We performed a prospective multicenter cohort study of invited participants from 62 training programs. In phase 1, 24 advanced endoscopy trainees (AETs), from 20 programs, were assessed using a validated competence assessment tool. We used a comprehensive data collection and reporting system to create learning curves using cumulative sum analysis that were shared with AETs and trainers quarterly. In phase 2, participating AETs entered data into a database pertaining to every EUS and ERCP examination during their first year of independent practice, anchored by key QIs. RESULTS By the end of training, most AETs had achieved overall technical competence (EUS 91.7%, ERCP 73.9%) and cognitive competence (EUS 91.7%, ERCP 94.1%). In phase 2 of the study, 22 AETs (91.6%) participated and completed a median of 136 EUS examinations per AET and 116 ERCP examinations per AET. Most AETs met the performance thresholds for QIs in EUS (including 94.4% diagnostic rate of adequate samples and 83.8% diagnostic yield of malignancy in pancreatic masses) and ERCP (94.9% overall cannulation rate). CONCLUSIONS In this prospective multicenter study, we found that although competence cannot be confirmed for all AETs at the end of training, most meet QI thresholds for EUS and ERCP at the end of their first year of independent practice. This finding affirms the effectiveness of training programs. Clinicaltrials.gov ID NCT02509416.
Collapse
|
Multicenter Study |
7 |
60 |
9
|
Caverzagie KJ, Iobst WF, Aagaard EM, Hood S, Chick DA, Kane GC, Brigham TP, Swing SR, Meade LB, Bazari H, Bush RW, Kirk LM, Green ML, Hinchey KT, Smith CD. The internal medicine reporting milestones and the next accreditation system. Ann Intern Med 2013; 158:557-9. [PMID: 23358671 DOI: 10.7326/0003-4819-158-7-201304020-00593] [Citation(s) in RCA: 52] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
|
|
12 |
52 |
10
|
Abstract
INTRODUCTION There is no widely accepted structured, evidence based strategy for the remediation of clinical reasoning skills. AIM To assess the effectiveness of a standardized clinical reasoning remediation plan for medical learners at various stages of training. SETTING Learners enrolled in the University of Colorado School of Medicine Remediation Program. PROGRAM DESCRIPTION From 2006 to 2012, the learner remediation program received 151 referrals. Referrals were made by medical student clerkship directors, residency and fellowship program directors, and through self-referrals. Each learner's deficiencies were identified using a standardized assessment process; 53 were noted to have clinical reasoning deficits. The authors developed and implemented a ten-step clinical reasoning remediation plan for each of these individuals, whose subsequent performance was independently assessed by unbiased faculty and senior trainees. Participant demographics, faculty time invested, and learner outcomes were tracked. PROGRAM EVALUATION Prevalence of clinical reasoning deficits did not differ by level of training of the remediating individual (p = 0.49). Overall, the mean amount of faculty time required for remediation was 29.6 h (SD = 29.3), with a median of 18 h (IQR 5-39) and a range of 2-100 h. Fifty-one of the 53 (96%) passed the post remediation reassessment. Thirty-eight (72%) learners either graduated from their original program or continue to practice in good standing. Four (8%) additional residents who were placed on probation and five (9%) who transferred to another program have since graduated. DISCUSSION The ten-step remediation plan proved to be successful for the majority of learners struggling with clinical reasoning based on reassessment and limited subsequent educational outcomes. Next steps include implementing the program at other institutions to assess generalizability and tracking long-term outcomes on clinical care.
Collapse
|
research-article |
11 |
50 |
11
|
Loeb DF, Lee RS, Binswanger IA, Ellison MC, Aagaard EM. Patient, resident physician, and visit factors associated with documentation of sexual history in the outpatient setting. J Gen Intern Med 2011; 26:887-93. [PMID: 21523496 PMCID: PMC3138976 DOI: 10.1007/s11606-011-1711-z] [Citation(s) in RCA: 46] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/23/2010] [Revised: 01/21/2011] [Accepted: 03/14/2011] [Indexed: 11/25/2022]
Abstract
BACKGROUND Providers need an accurate sexual history for appropriate screening and counseling, but data on the patient, visit, and physician factors associated with sexual history-taking are limited. OBJECTIVES To assess patient, resident physician, and visit factors associated with documentation of a sexual history at health care maintenance (HCM) visits. DESIGN Retrospective cross-sectional chart review. PARTICIPANTS Review of all HCM clinic notes (n = 360) by 26 internal medicine residents from February to August of 2007 at two university-based outpatient clinics. MEASUREMENTS Documentation of sexual history and patient, resident, and visit factors were abstracted using structured tools. We employed a generalized estimating equations method to control for correlation between patients within residents. We performed multivariate analysis of the factors significantly associated with the outcome of documentation of at least one component of a sexual history. KEY RESULTS Among 360 charts reviewed, 25% documented at least one component of a sexual history with a mean percent by resident of 23% (SD = 18%). Factors positively associated with documentation were: concern about sexually transmitted infection (referent: no concern; OR = 4.2 [95% CI = 1.3-13.2]); genitourinary or abdominal complaint (referent: no complaint; OR = 4.3 [2.2-8.5]); performance of other HCM (referent: no HCM performed; OR = 3.2 [1.5-7.0]), and birth control use (referent: no birth control; OR = 3.0 [1.1, 7.8]). Factors negatively associated with documentation were: age groups 46-55, 56-65, and >65 (referent: 18-25; ORs = 0.1, 0.1, and 0.2 [0.0-0.6, 0.0-0.4, and 0.1-0.6]), and no specified marital status (referent: married; OR = 0.5 [0.3-0.8]). CONCLUSIONS Our findings highlight the need for an emphasis on documentation of a sexual history by internal medicine residents during routine HCM visits, especially in older and asymptomatic patients, to ensure adequate screening and counseling.
Collapse
|
Comparative Study |
14 |
46 |
12
|
Bray-Hall S, Schmidt K, Aagaard E. Toward safe hospital discharge: a transitions in care curriculum for medical students. J Gen Intern Med 2010; 25:878-81. [PMID: 20443072 PMCID: PMC2896603 DOI: 10.1007/s11606-010-1364-3] [Citation(s) in RCA: 41] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/27/2009] [Revised: 12/19/2009] [Accepted: 04/05/2010] [Indexed: 10/19/2022]
Abstract
BACKGROUND Medical errors often occur when patients move between care settings. Physicians generally receive little formal education on improving patient care transitions. OBJECTIVE To develop a sustainable and effective Transition in Care Curriculum (TICC). Specific goals were to increase student confidence in and knowledge of skills necessary during care transitions at the time of hospital discharge, and to quantify the frequency of student-identified medication discrepancies during a post-discharge home visit. DESIGN TICC was delivered to 136 3rd-year medical students during their required inpatient medicine clerkship at six urban Denver hospitals. TICC consists of small and large group interactive sessions and self-directed learning exercises to provide foundational knowledge of care transitions. Experiential learning occurs through direct patient care at the time of discharge and during a follow-up home, hospice, or skilled nursing visit. Students completed a pre-post confidence measure, short answer and multiple choice questions, a post-clerkship satisfaction survey, and a standardized medication discrepancy tool. MAIN RESULTS Overall combined confidence in transitional care skills improved following the TICC from an average score of 2.7 (SD 0.9) to 4.0 (SD 0.8) (p < 0.01) on a 5-point confidence scale. They scored an average of 77% on the written discharge plan portion of the final exam. Students rated the usefulness of TICC at a mean of 3.1 (SD 0.7), above the combined mean of 2.7 for project work in all required clerkships. Students identified medication discrepancies during 43% of post-discharge visits (58 of 136). The most common reasons for discrepancies were patient lack of understanding of instructions and intentional non-adherence to medication plan. CONCLUSION TICC represents a feasible and effective program to teach evidence-based transitional care.
Collapse
|
research-article |
15 |
41 |
13
|
Aagaard E, Kane GC, Conforti L, Hood S, Caverzagie KJ, Smith C, Chick DA, Holmboe ES, Iobst WF. Early feedback on the use of the internal medicine reporting milestones in assessment of resident performance. J Grad Med Educ 2013; 5:433-8. [PMID: 24404307 PMCID: PMC3771173 DOI: 10.4300/jgme-d-13-00001.1] [Citation(s) in RCA: 41] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/30/2012] [Revised: 03/22/2013] [Accepted: 04/01/2013] [Indexed: 11/06/2022] Open
Abstract
BACKGROUND The educational milestones were designed as a criterion-based framework for assessing resident progression on the 6 Accreditation Council for Graduate Medical Education competencies. OBJECTIVE We obtained feedback on, and assessed the construct validity and perceived feasibility and utility of, draft Internal Medicine Milestones for Patient Care and Systems-Based Practice. METHODS All participants in our mixed-methods study were members of competency committees in internal medicine residency programs. An initial survey assessed participant and program demographics; focus groups obtained feedback on the draft milestones and explored their perceived utility in resident assessment, and an exit survey elicited input on the value of the draft milestones in resident assessment. Surveys were tabulated using descriptive statistics. Conventional content analysis method was used to assess the focus group data. RESULTS Thirty-four participants from 17 programs completed surveys and participated in 1 of 6 focus groups. Overall, the milestones were perceived as useful in formative and summative assessment of residents. Participants raised concerns about the length and complexity of some draft milestones and suggested specific changes. The focus groups also identified a need for faculty development. In the exit survey, most participants agreed that the Patient Care and Systems-Based Practice Milestones would help competency committees assess trainee progress toward independent practice. CONCLUSIONS Draft reporting milestones for 2 competencies demonstrated significant construct validity in both the content and response process and the perceived utility for the assessment of resident performance. To ensure success, additional feedback from the internal medicine community and faculty development will be necessary.
Collapse
|
research-article |
12 |
41 |
14
|
Teherani A, O'Sullivan P, Aagaard EM, Morrison EH, Irby DM. Student perceptions of the one minute preceptor and traditional preceptor models. MEDICAL TEACHER 2007; 29:323-7. [PMID: 17786745 DOI: 10.1080/01421590701287988] [Citation(s) in RCA: 41] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
Abstract
BACKGROUND The one-minute preceptor (OMP) model was developed to effectively and efficiently teach learners while simultaneously addressing patient needs. This study was conducted to determine if third- and fourth-year medical students prefer the OMP model over the traditional precepting model and what teaching points they needed from the clinical encounters. METHODS Third- and fourth-year students (N = 164) at two medical schools completed a questionnaire and prompts on teaching points in response to viewing two videotaped precepting encounters. Differences between OMP and traditional precepting scores were computed using a factorial repeated measures analysis of co-variance (ANCOVA). Teaching points were coded and counted. RESULTS Students preferred the OMP precepting model to the traditional teaching model (p = 0.001). While the desired teaching points changed as the case presentation/discussion progressed, students were most interested in learning about the clinical presentation or natural progression of the disease regardless of teaching model used. CONCLUSIONS Students rate the OMP as a more effective model of teaching than the traditional model. The teaching points desired by students change as the case presentation/discussion unfolds. Work carried out at: University of California, San Francisco, Office of Medical Education and University of California, Irvine, Department of Family Medicine.
Collapse
|
Multicenter Study |
18 |
41 |
15
|
Westermark A, Leiggener C, Aagaard E, Lindskog S. Histological findings in soft tissues around temporomandibular joint prostheses after up to eight years of function. Int J Oral Maxillofac Surg 2011; 40:18-25. [PMID: 21044827 DOI: 10.1016/j.ijom.2010.09.009] [Citation(s) in RCA: 38] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2010] [Accepted: 09/13/2010] [Indexed: 11/30/2022]
|
|
14 |
38 |
16
|
|
|
9 |
36 |
17
|
Guerrasio J, Furfari KA, Rosenthal LD, Nogar CL, Wray KW, Aagaard EM. Failure to fail: the institutional perspective. MEDICAL TEACHER 2014; 36:799-803. [PMID: 24845780 DOI: 10.3109/0142159x.2014.910295] [Citation(s) in RCA: 34] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
Abstract
PURPOSE To determine institutional barriers to placing failing students on probation, dismissing students. METHODS An online survey study was distributed to Student Affairs Deans or the equivalent at allopathic (MD) and osteopathic (DO) medical schools, and physician assistant (PA) and nurse practitioner (NP) schools across the United States. Nineteen (40%) of the 48 schools responded: six MD, four DO, five PA and four NP. The survey contained demographic questions and questions regarding probation and dismissal. Themes were independently coded and combined via consensus based on grounded theory. The survey was distributed until saturation of qualitative responses were achieved. RESULTS Respondents identified variations in the use of probation and dismissal and a wide range of barriers, with the greatest emphasis on legal concerns. Respondents felt that students were graduating who should not be allowed to graduate, and that the likelihood of a student being placed on probation or being terminated was highly variable. DISCUSSION Our results suggest that institution culture at heath professions schools across the United States may represent an obstacle in placing failing learners on probation and dismissing learners who should not graduate. Additional studies are needed to prove if these concerns are founded or merely fears.
Collapse
|
|
11 |
34 |
18
|
Castiglioni A, Aagaard E, Spencer A, Nicholson L, Karani R, Bates CK, Willett LL, Chheda SG. Succeeding as a Clinician Educator: useful tips and resources. J Gen Intern Med 2013; 28:136-40. [PMID: 22836953 PMCID: PMC3539043 DOI: 10.1007/s11606-012-2156-8] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/26/2011] [Revised: 06/11/2012] [Accepted: 06/19/2012] [Indexed: 10/28/2022]
Abstract
Clinician Educators (CEs) play an essential role in the education and patient care missions of academic medical centers. Despite their crucial role, academic advancement is slower for CEs than for other faculty. Increased clinical productivity demands and financial stressors at academic medical centers add to the existing challenges faced by CEs. This perspective seeks to provide a framework for junior CEs to consider with the goal of maximizing their chance of academic success. We discuss six action areas that we consider central to flourishing at academic medical centers: 1. Clarify what success means and define goals; 2. Seek mentorship and be a responsible mentee; 3. Develop a niche and engage in relevant professional development; 4. Network; 5. Transform educational activities into scholarship; and 6. Seek funding and other resources.
Collapse
|
research-article |
12 |
33 |
19
|
Colson ER, Pérez M, Blaylock L, Jeffe DB, Lawrence SJ, Wilson SA, Aagaard EM. Washington University School of Medicine in St. Louis Case Study: A Process for Understanding and Addressing Bias in Clerkship Grading. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2020; 95:S131-S135. [PMID: 32889929 DOI: 10.1097/acm.0000000000003702] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
In 2018, in response to a news story featuring the Icahn School of Medicine's decision to eliminate its chapter of Alpha Omega Alpha (AOA) due to perceived racial inequities, students at Washington University School of Medicine in St. Louis (WUSM) brought similar concerns to leadership. WUSM leadership evaluated whether students' race, ethnicity, and gender were associated with their receipt of honors in the 6 core clerkships, key determinants of AOA selection. In preliminary analysis of the school's data, statistically significant racial and ethnic disparities were associated with receipt of honors in each clerkship. Leaders shared these findings with the WUSM community along with a clear message that such discrepancies are unacceptable to the school. An effort to further analyze what lay behind the findings as well as to identify steps to resolve the problem was launched. Using a quality improvement framework, data from focus groups and student surveys were analyzed and 2 overarching themes emerged. Students perceived that both assessment and the learning environment impacted racial/ethnic disparities in clerkship grades. In multivariable logistic regression models, shelf exam scores (a part of student assessment) were found to be associated with receipt of honors in each clerkship; in some (but not all) clerkships, shelf exam scores attenuated the effect of race/ethnicity on receipt of honors, so that when the shelf scores were added to the model, the race/ethnicity effect was no longer significant. This case study describes WUSM's process to understand and address bias in clerkship grading and AOA nomination so that other medical schools might benefit from what has been learned.
Collapse
|
|
5 |
31 |
20
|
Irby DM, Aagaard E, Teherani A. Teaching points identified by preceptors observing one-minute preceptor and traditional preceptor encounters. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2004; 79:50-55. [PMID: 14690997 DOI: 10.1097/00001888-200401000-00012] [Citation(s) in RCA: 30] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
PURPOSE This study examined the teaching points made by preceptors in response to two videotaped teaching encounters to determine if (1) different preceptors use similar teaching points in response to the same case, (2) preceptors' teaching points vary by case, and (3) preceptors' teaching points vary by teaching model (One-Minute Preceptor and traditional preceptor models). METHOD Preceptors (n = 116) at seven universities participated in a within-groups experimental design study in 2000. The preceptors viewed videotaped encounters depicting two cases and two precepting models. They were asked to list two teaching points after viewing the initial case presentations and after the teaching encounters were completed. Frequency of teaching points listed by preceptors was examined for each case and teaching model. Teaching points were coded using qualitative methods and then analyzed using repeated-measures analysis of variance. RESULTS Of the 843 total teaching points identified by preceptors, 63 were discrete teaching points that were aggregated into 15 categories. Most preceptors (82%) listed three to five separate teaching points, which varied significantly by case and model. Those observing the traditional precepting model were more likely to teach generic skills such as history-taking skills, presentation skills, and risk factors, and those observing the One-Minute Preceptor were more likely to teach about the illness focusing on a broader differential diagnosis, further diagnostic tests, and the natural presentation of disease. CONCLUSIONS Preceptors use three to five common teaching points that vary by case and teaching model. The One-Minute Preceptor model shifted teaching points away from generic clinical skills toward disease-specific teaching.
Collapse
|
Comparative Study |
21 |
30 |
21
|
Nørholt SE, Aagaard E, Svensson P, Sindet-Pedersen S. Evaluation of trismus, bite force, and pressure algometry after third molar surgery: a placebo-controlled study of ibuprofen. J Oral Maxillofac Surg 1998; 56:420-7; discussion 427-9. [PMID: 9541340 DOI: 10.1016/s0278-2391(98)90705-4] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
PURPOSE This study evaluated trismus, bite force, and pressure algometry as measures of analgesic efficacy after third molar removal. PATIENTS AND METHODS Fifty-seven patients (36 females and 21 males) developed at least moderate pain after surgical removal of a mandibular third molar and were given either ibuprofen, 400 mg (n = 26), or placebo (n = 31) in a double-blind study. Pain intensity and pain relief were rated on a five-point verbal rating scale during the 4-hour study period. Recordings of trismus, bilateral pressure pain detection and tolerance thresholds, and bite force were performed before surgery, at medication, and hourly for 4 hours. Changes in the functional variables were calculated as percent change from baseline (before surgery). RESULTS The pain intensity and pain relief ratings showed significant differences between the ibuprofen- and placebo-treated patients in the 4-hour study period. The changes in trismus, bite force, and pressure pain thresholds were in accordance with these pain ratings. Pressure pain detection threshold on the operated side was significantly lower in the placebo-treated patients compared with the ibuprofen-treated patients 2 and 3 hours after medication, whereas pressure tolerance threshold showed a significant difference after 2 hours. Bite force on the operated side was significantly less reduced 3 hours after treatment with ibuprofen when compared with placebo. CONCLUSIONS The functional measures used support the results obtained by rating of pain intensity and pain relief, and could be of value as measures of the efficacy of an analgesic to reduce functional impairment caused by postoperative pain.
Collapse
|
Clinical Trial |
27 |
27 |
22
|
Hauer KE, Teherani A, Dechet A, Aagaard EM. Medical students' perceptions of mentoring: a focus-group analysis. MEDICAL TEACHER 2005; 27:732-4. [PMID: 16451896 DOI: 10.1080/01421590500271316] [Citation(s) in RCA: 26] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/06/2023]
Abstract
Characteristics of medical students' mentoring relationships and factors that affect mentoring during medical school are poorly understood. The authors conducted four focus groups with fourth-year medical students to explore what students sought from mentors, perceived barriers to mentoring and suggestions for improvement. Data were analyzed using grounded theory. Students with and without mentors described a mentoring relationship as a personal connection with a faculty member invested in helping the student achieve a personal and professional vision. The short duration of courses, abrupt change from classroom learning to clerkships and limited exposure to clinicians were perceived as barriers to mentoring. Students recommended that the school explicitly promote mentoring with early education about finding mentors, placing the responsibility on students while also expanding the pool of potential mentors. It is concluded that medical students characterize mentoring in terms of the interpersonal dynamics of the relationship, emphasizing personal connection and advocacy. Educating and empowering students along with faculty education regarding students' needs may improve mentoring.
Collapse
|
|
20 |
26 |
23
|
Guerrasio J, Cumbler E, Trosterman A, Wald H, Brandenburg S, Aagaard E. Determining need for remediation through postrotation evaluations. J Grad Med Educ 2012; 4:47-51. [PMID: 23451306 PMCID: PMC3312533 DOI: 10.4300/jgme-d-11-00145.1] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/28/2011] [Revised: 10/13/2011] [Accepted: 10/18/2011] [Indexed: 11/06/2022] Open
Abstract
INTRODUCTION Postrotation evaluations are frequently used by residency program directors for early detection of residents with academic difficulties; however, the accuracy of these evaluations in assessing resident performance has been questioned. METHODS This retrospective case-control study examines the ability of postrotation evaluation characteristics to predict the need for remediation. We compared the evaluations of 17 residents who were placed on academic warning or probation, from 2000 to 2007, with those for a group of peers matched on sex, postgraduate year (PGY), and entering class. RESULTS The presence of an outlier evaluation, the number of words written in the comments section, and the percentage of evaluations with negative or ambiguous comments were all associated with the need for remediation (P = .01, P = .001, P = .002, P = < .001, respectively). In contrast, United States Medical Licensing Examination step 1 and step 2 scores, total number of evaluations received, and percentage of positive comments on the evaluations were not associated with the need for remediation (P = .06, P = .87, P = .55, respectively). DISCUSSION Despite ambiguous evaluation comments, the length and percentage of ambiguous or negative comments did indicate future need for remediation. CONCLUSIONS Our study demonstrates that postrotation evaluation characteristics can be used to identify residents as risk. However, larger prospective studies, encompassing multiple institutions, are needed to validate various evaluation methods in measuring resident performance and to accurately predict the need for remediation.
Collapse
|
research-article |
13 |
25 |
24
|
Nolt BR, Gonzales R, Maselli J, Aagaard E, Camargo CA, Metlay JP. Vital-sign abnormalities as predictors of pneumonia in adults with acute cough illness. Am J Emerg Med 2007; 25:631-6. [PMID: 17606087 DOI: 10.1016/j.ajem.2006.11.031] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2006] [Revised: 10/30/2006] [Accepted: 11/12/2006] [Indexed: 11/27/2022] Open
Abstract
PURPOSE This study examines the strength of the association between vital-sign abnormalities, advanced age, and the diagnosis of community-acquired pneumonia (CAP) in the evaluation of adults with acute cough illness. METHODS A random sample of adult visits for acute cough to 15 EDs during the winter period of 2 consecutive years (2003-2005) was selected for medical record abstraction. Visits were initially sampled based on discharge diagnoses for a broad range of acute respiratory tract infection diagnoses. Participating sites were a national sample of EDs in Veterans Administration and non-Veterans Administration hospitals stratified across the US region. RESULTS Of 4464 charts reviewed, 421 had a diagnosis of CAP based on physician discharge diagnosis and radiographic findings. Age greater than 50 years and vital-sign abnormality (including fever, hypoxemia, tachycardia, or tachypnea) were the only significant predictors of CAP. Hypoxemia had the strongest association with CAP diagnosis (odds ratio, 3.5; 95% confidence interval, 2.4-5.0). A greater number of abnormalities were associated with a higher prevalence of CAP, from 12% with 1 abnormality to 69% with 4 vital-sign abnormalities (P < .001). Most vital-sign abnormalities were predictive of CAP regardless of age. CONCLUSIONS Increases in vital-sign abnormalities are associated with a greater probability of CAP, and the strength of the association does not vary substantially by age.
Collapse
|
Research Support, U.S. Gov't, P.H.S. |
18 |
25 |
25
|
Aagaard EM, Lin P, Modin GW, Lane NE. Prevention of glucocorticoid-induced osteoporosis: provider practice at an urban county hospital. Am J Med 1999; 107:456-60. [PMID: 10569300 DOI: 10.1016/s0002-9343(99)00265-x] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/16/2022]
Abstract
PURPOSE We sought to determine the frequency and types of prophylaxis for osteoporosis that were prescribed to outpatients who were receiving chronic glucocorticoid treatment and to identify the patient and provider characteristics that were associated with the use of prophylaxis. SUBJECTS AND METHODS We identified 215 adult outpatients at San Francisco General Hospital who had received a prescription for prednisone (or its equivalent) at a daily dose of at least 5 mg for at least 1 month. Patient demographic characteristics, the diagnosis for which glucocorticoids were prescribed, comorbid illnesses, and medications were determined by chart review. Characteristics of the patients who were prescribed prophylaxis were compared with those of patients who were not prescribed prophylaxis. RESULTS Prophylaxis for glucocorticoid-induced osteoporosis was prescribed to 58% of patients. Patients prescribed prophylaxis were older (mean [+/-SD] age of 50.0 +/- 13.9 versus 44.5 +/- 13.6 years, P = 0.004), more likely to be female (69% versus 40%, P <0.0001), postmenopausal if female (84% versus 56%, P = 0.002), have more comorbid illnesses (63% versus 29%, P = 0.001), and take multiple medications (66% versus 45%, P = 0.002). Patients attending the rheumatology clinic were 1.6 times more likely to receive prophylaxis than those attending other clinics (P <0.0001). The strongest predictor of prophylaxis was postmenopausal state. In premenopausal women, the independent predictors of prophylaxis were being treated in the rheumatology clinic and the presence of comorbid illnesses, whereas comorbid illnesses was the only independent predictor of prophylaxis in men. CONCLUSIONS Educational efforts should be directed toward increasing awareness of the importance of glucocorticoid-induced osteoporosis and its prevention.
Collapse
|
|
26 |
25 |