1
|
Davila JA, Harada ND, Rugen KW, Gilman SC, Sansgiry S. Interprofessional Curriculum Delivery: Experience of a Primary Care Education Program. Healthcare (Basel) 2024; 12:950. [PMID: 38727507 PMCID: PMC11083181 DOI: 10.3390/healthcare12090950] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Revised: 04/17/2024] [Accepted: 04/29/2024] [Indexed: 05/13/2024] Open
Abstract
Few post-graduate training programs offer a comprehensive curriculum that includes structured clinical experiences to teach interprofessional care. To address this need, the United States Department of Veterans Affairs, Office of Academic Affiliations funded the Centers of Excellence in Primary Care Education (CoEPCE) from 2011-2019 to provide interprofessional curricula for health profession trainees (HPTs), including physician residents, nurse practitioner residents, pharmacy residents, and psychology residents. We examined changes over time in curricular domains, system impacts, and program practices based on HPT survey data and the qualitative evaluation of narrative feedback. An annual survey was administered to participants. Indirect standardized ratios were calculated for interprofessional professional education (IPE) program domains, system impacts, and program practices. Qualitative responses were coded based on curricular domains and key program components. The study cohort included 369 HPTs. Site and profession standardized indirect ratios across all professions indicated improvements in curricular domains, system impacts, and program practices, with significant differences observed for associated health HPTs as compared to other HPTs for performance improvement. Qualitative data indicated that profession was associated with differences in perceptions of the curriculum. Although improvements occurred over time, our findings support the need for the thoughtful consideration of profession-specific identity characteristics when designing interprofessional curricula.
Collapse
|
2
|
Harada ND, Traylor L, Rugen KW, Bowen JL, Smith CS, Felker B, Ludke D, Tonnu-Mihara I, Ruberg JL, Adler J, Uhl K, Gardner AL, Gilman SC. Interprofessional transformation of clinical education: The first six years of the Veterans Affairs Centers of Excellence in Primary Care Education. J Interprof Care 2023; 37:S86-S94. [PMID: 29461131 DOI: 10.1080/13561820.2018.1433642] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2017] [Revised: 10/24/2017] [Accepted: 01/24/2018] [Indexed: 10/18/2022]
Abstract
This paper describes the Centers of Excellence in Primary Care Education (CoEPCE), a seven-site collaborative project funded by the Office of Academic Affiliations (OAA) within the Veterans Health Administration of the United States Department of Veterans Affairs (VA). The CoEPCE was established to fulfill OAA's vision of large-scale transformation of the clinical learning environment within VA primary care settings. This was accomplished by funding new Centers within VA facilities to develop models of interprofessional education (IPE) to teach health professions trainees to deliver high quality interprofessional team-based primary care to Veterans. Using reports and data collected and maintained by the National Coordinating Center over the first six years of the project, we describe program inputs, the multicomponent intervention, activities undertaken to develop the intervention, and short-term outcomes. The findings have implications for lessons learned that can be considered by others seeking large-scale transformation of education within the clinical workplace and the development of interprofessional clinical learning environments. Within the VA, the CoEPCE has laid the foundation for IPE and collaborative practice, but much work remains to disseminate this work throughout the national VA system.
Collapse
|
3
|
Keitz SA, Aron DC, Brannen JL, Byrne JM, Cannon GW, Clarke CT, Gilman SC, Hettler DL, Kaminetzky CP, Zeiss RA, Bernett DS, Wicker AB, Kashner TM. Impact of clinical training on recruiting graduating health professionals. THE AMERICAN JOURNAL OF MANAGED CARE 2019; 25:e111-e118. [PMID: 30986020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
OBJECTIVES Recruiting professional staff is an important business reason for hospitals allowing health trainees to engage in supervised patient care. Whereas prior studies have focused on educational institutions, this study focuses on teaching hospitals and whether trainees' clinical experiences affect their willingness to work (ie, recruitability) for the type of healthcare center where they trained. STUDY DESIGN A pre-post, observational study based on Learners' Perceptions Survey data in which respondents served as their own controls. METHODS Convenience sample of 15,207 physician, 11,844 nursing, and 13,012 associated health trainees who rotated through 1 of 169 US Department of Veterans Affairs (VA) medical centers between July 1, 2014, and June 30, 2017. Generalized estimating equations computed how clinical, learning, working, and cultural experiences influenced pre-post differences in willingness to consider VA for future employment. RESULTS VA recruitability increased dramatically from 55% pretraining to 75% post training (adjusted odds ratio [OR], 2.1; 95% CI, 2.0-2.1; P <.001) in all 3 cohorts: physician (from 39% to 59%; OR, 1.6; 95% CI, 1.5-1.6; P <.001), nursing (from 61% to 84%; OR, 2.5; 95% CI, 2.4-2.6; P <.001), and associated health trainees (from 68% to 87%; OR, 2.7; 95% CI, 2.6-2.9; P <.001). For all trainees, changes in recruitability (P <.001) were associated with how trainees rated their clinical learning environment, personal experiences, and culture of psychological safety. Satisfaction ratings with faculty and preceptors (P <.001) were associated with positive changes in recruitability among nursing and associated health students but not physician residents, whereas nursing students who gave higher ratings for interprofessional team culture became less recruitable. CONCLUSIONS Academic medical centers can attract their health trainees for future employment if they provide positive clinical, working, learning, and cultural experiences.
Collapse
|
4
|
Harada ND, Rajashekara S, Sansgiry S, Wirtz Rugen K, King S, Gilman SC, Davila JA. Developing Interprofessional Primary Care Teams: Alumni Evaluation of the Department of Veterans Affairs Centers of Excellence in Primary Care Education Program. JOURNAL OF MEDICAL EDUCATION AND CURRICULAR DEVELOPMENT 2019; 6:2382120519875455. [PMID: 35187259 PMCID: PMC8855379 DOI: 10.1177/2382120519875455] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/09/2019] [Accepted: 08/15/2019] [Indexed: 06/14/2023]
Abstract
PURPOSE The Centers of Excellence in Primary Care Education (CoEPCE) is an interprofessional graduate training program within the Department of Veterans Affairs (VA). In this project, we describe career paths of CoEPCE graduates, their perceptions of CoEPCE program value, their overall satisfaction with the training, and suggestions for program improvement to enhance interprofessional education and workforce development. METHODS The Graduate Participant Survey was developed and administered in 2018 to CoEPCE graduates from 2012 to 2017. Quantitative data from closed-ended questions were analyzed through descriptive and non-parametric statistics to test for significant differences by profession. Qualitative data from the single open-ended question were analyzed using content analysis with inductive and deductive approaches. RESULTS The survey was completed by 180 graduates. Greater proportions of pharmacists and psychologists than nurse practitioners and physicians were employed in VA, and greater proportions of nurse practitioners and pharmacists than physicians and psychologists were employed in primary care. Although smaller proportions of physicians were currently employed in primary care (P < .0001), a greater proportion completed advanced training programs (P < .0001). Overall, graduates perceived that their CoEPCE training was highly valued by advanced training programs and employers and improved their chances of finding a job. They reported high levels of satisfaction (mean = 4.3 ± 0.9 out of 5 total) with the training program, continued to use skills they learned during training, and believe their CoEPCE experiences made them better health care providers. CONCLUSIONS Ninety-four percent of the CoEPCE graduates were employed at the VA and/or primary care at the completion of their training, although there were significant differences by profession. Graduates continued to practice interprofessional skills learned during their training and were highly satisfied with the program. Taken together, the findings indicate that continued enhancements to the interprofessional clinical learning environment are warranted.
Collapse
|
5
|
Kashner TM, Hettler DL, Zeiss RA, Aron DC, Bernett DS, Brannen JL, Byrne JM, Cannon GW, Chang BK, Dougherty MB, Gilman SC, Holland GJ, Kaminetzky CP, Wicker AB, Keitz SA. Has Interprofessional Education Changed Learning Preferences? A National Perspective. Health Serv Res 2016; 52:268-290. [PMID: 26990439 DOI: 10.1111/1475-6773.12485] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
OBJECTIVE To assess how changes in curriculum, accreditation standards, and certification and licensure competencies impacted how medical students and physician residents value interprofessional team and patient-centered care. PRIMARY DATA SOURCE The Department of Veterans Affairs Learners' Perceptions Survey (2003-2013). The nationally administered survey asked a representative sample of 56,569 U.S. medical students and physician residents, with a comparison group of 78,038 nonphysician trainees, to rate satisfaction with 28 elements, in two overall domains, describing their clinical learning experiences at VA medical centers. STUDY DESIGN Value preferences were scored as independent adjusted associations between an element (interprofessional team, patient-centered preceptor) and the respective overall domain (clinical learning environment, faculty, and preceptors) relative to a referent element (quality of clinical care, quality of preceptor). PRINCIPAL FINDINGS Physician trainees valued interprofessional (14 percent vs. 37 percent, p < .001) and patient-centered learning (21 percent vs. 36 percent, p < .001) less than their nonphysician counterparts. Physician preferences for interprofessional learning showed modest increases over time (2.5 percent/year, p < .001), driven mostly by internal medicine and surgery residents. Preferences did not increase with trainees' academic progress. CONCLUSIONS Despite changes in medical education, physician trainees continue to lag behind their nonphysician counterparts in valuing experience with interprofessional team and patient-centered care.
Collapse
|
6
|
Watts BV, McKinney K, Williams LC, Cully JA, Gilman SC, Brannen JL. Current Training in Quality and Safety: The Current Landscape in the Department of Veterans Affairs. Am J Med Qual 2016; 31:382. [PMID: 26933081 DOI: 10.1177/1062860615626276] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
7
|
Gilman SC, Chokshi DA, Bowen JL, Rugen KW, Cox M. Connecting the dots: interprofessional health education and delivery system redesign at the Veterans Health Administration. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2014; 89:1113-1116. [PMID: 24853198 DOI: 10.1097/acm.0000000000000312] [Citation(s) in RCA: 43] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
Health systems around the United States are embracing new models of primary care using interprofessional team-based approaches in pursuit of better patient outcomes, higher levels of satisfaction among patients and providers, and improved overall value. Less often discussed are the implications of new models of care for health professions education, including education for physicians, nurse practitioners, physician assistants, and other professions engaged in primary care. Described here is the interaction between care transformation and redesign of health professions education at the largest integrated delivery system in the United States: the Veterans Health Administration (VA). Challenges and lessons learned are discussed in the context of a demonstration initiative, the VA Centers of Excellence in Primary Care Education. Five sites, involving VA medical centers and their academic affiliates in Boise, Cleveland, San Francisco, Seattle, and West Haven, introduced interprofessional primary care curricula for resident physicians and nurse practitioner students beginning in 2011. Implementation struggles largely revolved around the operational logistics and cultural disruption of integrating educational redesign for medicine and nursing and facilitating the interface between educational and clinical activities. To realize new models for interprofessional teaching, faculty, staff, and trainees must understand the histories, traditions, and program requirements across professions and experiment with new approaches to achieving a common goal. Key recommendations for redesign of health professions education revolve around strengthening the union between interprofessional learning, team-based practice, and high-value care.
Collapse
|
8
|
Watts BV, Shiner B, Cully JA, Gilman SC, Benneyan JC, Eisenhauer W. Health systems engineering fellowship: curriculum and program development. Am J Med Qual 2014; 30:161-6. [PMID: 24586025 DOI: 10.1177/1062860614523033] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Industrial engineering and related disciplines have been used widely in improvement efforts in many industries. These approaches have been less commonly attempted in health care. One factor limiting application is the limited workforce resulting from a lack of specific education and professional development in health systems engineering (HSE). The authors describe the development of an HSE fellowship within the United States Department of Veterans Affairs, Veterans Health Administration (VA). This fellowship includes a novel curriculum based on specifically established competencies for HSE. A 1-year HSE curriculum was developed and delivered to fellows at several VA engineering resource centers over several years. On graduation, a majority of the fellows accepted positions in the health care field. Challenges faced in developing the fellowship are discussed. Advanced educational opportunities in applied HSE have the potential to develop the workforce capacity needed to improve the quality of health care.
Collapse
|
9
|
Byrne JM, Chang BK, Gilman SC, Keitz SA, Kaminetzky CP, Aron DC, Baz S, Cannon GW, Zeiss RA, Holland GJ, Kashner TM. The learners' perceptions survey-primary care: assessing resident perceptions of internal medicine continuity clinics and patient-centered care. J Grad Med Educ 2013; 5:587-93. [PMID: 24455006 PMCID: PMC3886456 DOI: 10.4300/jgme-d-12-00233.1] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/10/2012] [Revised: 01/23/2013] [Accepted: 04/01/2013] [Indexed: 11/06/2022] Open
Abstract
BACKGROUND In 2010, the Department of Veterans Affairs (VA) implemented a national patient-centered care initiative that organized primary care into interdisciplinary teams of health care professionals to provide patient-centered, continuous, and coordinated care. OBJECTIVE We assessed the discriminate validity of the Learners' Perceptions Survey-Primary Care (LPS-PC), a tool designed to measure residents' perceptions about their primary and patient-centered care experiences. METHODS Between October 2010 and June 2011, the LPS-PC was administered to Loma Linda University Medical Center internal medicine residents assigned to continuity clinics at the VA Loma Linda Healthcare System (VALLHCS), a university setting, or the county hospital. Adjusted differences in satisfaction ratings across settings and over domains (patient- and family-centered care, faculty and preceptors, learning, clinical, work and physical environments, and personal experience) were computed using a generalized linear model. RESULTS Our response rate was 86% (77 of 90). Residents were more satisfied with patient- and family-centered care at the VALLHCS than at either the university or county (P < .001). However, faculty and preceptors (odds ratio [OR] = 1.53), physical (OR = 1.29), and learning (OR = 1.28) environments had more impact on overall resident satisfaction than patient- and family-centered care (OR = 1.08). CONCLUSIONS The LPS-PC demonstrated discriminate validity to assess residents' perceptions of their patient-centered clinical training experience across outpatient primary care settings at an internal medicine residency program. The largest difference in scores was the patient- and family-centered care domain, in which residents rated the VALLHCS much higher than the university or county sites.
Collapse
|
10
|
Rugen KW, Watts SA, Janson SL, Angelo LA, Nash M, Zapatka SA, Brienza R, Gilman SC, Bowen JL, Saxe JM. Veteran Affairs Centers of Excellence in Primary Care Education: transforming nurse practitioner education. Nurs Outlook 2013; 62:78-88. [PMID: 24630678 DOI: 10.1016/j.outlook.2013.11.004] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2013] [Revised: 11/04/2013] [Accepted: 11/10/2013] [Indexed: 11/29/2022]
Abstract
To integrate health care professional learners into patient-centered primary care delivery models, the Department of Veterans Affairs has funded five Centers of Excellence in Primary Care Education (CoEPCEs). The main goal of the CoEPCEs is to develop and test innovative structural and curricular models that foster transformation of health care training from profession-specific "silos" to interprofessional, team-based educational and care delivery models in patient-centered primary care settings. CoEPCE implementation emphasizes four core curricular domains: shared decision making, sustained relationships, interprofessional collaboration, and performance improvement. The structural models allow interprofessional learners to have longitudinal learning experiences and sustained and continuous relationships with patients, faculty mentors, and peer learners. This article presents an overview of the innovative curricular models developed at each site, focusing on nurse practitioner (NP) education. Insights on transforming NP education in the practice setting and its impact on traditional NP educational models are offered. Preliminary outcomes and sustainment examples are also provided.
Collapse
|
11
|
Scheuner MT, Hamilton AB, Peredo J, Sale TJ, Austin C, Gilman SC, Bowen MS, Goldzweig CL, Lee M, Mittman BS, Yano EM. A cancer genetics toolkit improves access to genetic services through documentation and use of the family history by primary-care clinicians. Genet Med 2013; 16:60-9. [DOI: 10.1038/gim.2013.75] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2012] [Accepted: 04/16/2013] [Indexed: 02/04/2023] Open
|
12
|
Kaminetzky CP, Keitz SA, Kashner TM, Aron DC, Byrne JM, Chang BK, Clarke C, Gilman SC, Holland GJ, Wicker A, Cannon GW. Training satisfaction for subspecialty fellows in internal medicine: findings from the Veterans Affairs (VA) Learners' Perceptions Survey. BMC MEDICAL EDUCATION 2011; 11:21. [PMID: 21575269 PMCID: PMC3121724 DOI: 10.1186/1472-6920-11-21] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/21/2010] [Accepted: 05/17/2011] [Indexed: 05/30/2023]
Abstract
BACKGROUND Learner satisfaction assessment is critical in the design and improvement of training programs. However, little is known about what influences satisfaction and whether trainee specialty is correlated. A national comparison of satisfaction among internal medicine subspecialty fellows in the Department of Veterans Affairs (VA) provides a unique opportunity to examine educational factors associated with learner satisfaction. We compared satisfaction across internal medicine fellows by subspecialty and compared factors associated with satisfaction between procedural versus non-procedural subspecialty fellows, using data from the Learners' Perceptions Survey (LPS), a validated survey tool. METHODS We surveyed 2,221 internal medicine subspecialty fellows rotating through VA between 2001 and 2008. Learners rated their overall training satisfaction on a 100-point scale, and on a five-point Likert scale ranked satisfaction with items within six educational domains: learning, clinical, working and physical environments; personal experience; and clinical faculty/preceptor. RESULTS Procedural and non-procedural fellows reported similar overall satisfaction scores (81.2 and 81.6). Non-procedural fellows reported higher satisfaction with 79 of 81 items within the 6 domains and with the domain of physical environment (4.06 vs. 3.85, p <0.001). Satisfaction with clinical faculty/preceptor and personal experience had the strongest impact on overall satisfaction for both. Procedural fellows reported lower satisfaction with physical environment. CONCLUSIONS Internal medicine fellows are highly satisfied with their VA training. Nonprocedural fellows reported higher satisfaction with most items. For both procedural and non-procedural fellows, clinical faculty/preceptor and personal experience have the strongest impact on overall satisfaction.
Collapse
|
13
|
Bragg EJ, Meganathan K, Shay K, Gilman SC, Zeiss RA, Hettler DL. The Impact of VA's geriatric research, education and clinical centers on academic affiliates. GERONTOLOGY & GERIATRICS EDUCATION 2011; 32:5-21. [PMID: 21347928 DOI: 10.1080/02701960.2011.550211] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
The education mission of the Department of Veterans Affairs (VA) is to train health professionals to benefit VA and the United States. One approach for achieving that mission, along with VA's research and clinical missions, was the establishment of Geriatric Research, Education and Clinical Centers (GRECCs) in 1975. These were developed at VA hospital sites that had existing strong partnerships with schools of medicine already engaged in research on aging. GRECCs were funded to enhance those research enterprises, to expand health professions education in geriatrics, to expand interest in geriatrics among medical faculty and to support them to become more expert in geriatrics, to develop new approaches to care of the aging, and to disseminate the lessons learned within VA and beyond. Using 2001 and 2008 data from two surveys of U.S. medical schools' geriatrics programs, this article explores the impact of GRECCs on geriatric programs at their affiliated schools of medicine. It demonstrates how VA's academic mission through GRECCs has benefited VA and its affiliates and how it has benefited the nation through the growth of geriatric medicine as an academic enterprise and a legitimate clinical specialty.
Collapse
|
14
|
Kashner TM, Byrne JM, Henley SS, Golden RM, Aron DC, Cannon GW, Chang BK, Gilman SC, Holland GJ, Kaminetzky CP, Keitz SA, Muchmore EA, Kashner TK, Wicker AB. Measuring progressive independence with the resident supervision index: theoretical approach. J Grad Med Educ 2010; 2:8-16. [PMID: 21975879 PMCID: PMC2931231 DOI: 10.4300/jgme-d-09-00083.1] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/10/2009] [Revised: 01/04/2010] [Accepted: 01/21/2010] [Indexed: 11/06/2022] Open
Abstract
BACKGROUND Graduate medical education is based on an on-the-job training model in which residents provide clinical care under supervision. The traditional method is to offer residents graduated levels of responsibility that will prepare them for independent practice. However, if progressive independence from supervision exceeds residents' progressive professional development, patient outcomes may be at risk. Leaders in graduate medical education have called for "optimal" supervision, yet few studies have conceptually defined what optimal supervision means and whether optimal care is theoretically compatible with progressive independence, nor have they developed a test for progressive independence. OBJECTIVE This research develops theory and analytic models as part of the Resident Supervision Index to quantify the intensity of supervision. METHODS We introduce an explicit set of assumptions for an ideal patient-centered theory of optimal supervision of resident-provided care. A critical assumption is that informed attending staff will use available resources to optimize patient outcomes first and foremost, with residents gaining clinical competencies by contributing to optimal care. Next, we derive mathematically the consequences of these assumptions as theoretical results. RESULTS Under optimal supervision, (1) patient outcome is expected to be no worse than if residents were not involved, (2) supervisors will avoid undersupervising residents (when patients are at increased risk for poor outcomes) or oversupervising residents (when residents miss clinical opportunities to practice care), (3) optimal patient outcomes will be compatible with progressive independence, (4) progressive development can be inferred from progressive independence whenever residents contribute to patient care, and (5) analytic models that test for progressive independence will emphasize adjusting the association between length of graduate medical education training and supervision for case complexity and clinic workload, but not patient health outcomes. CONCLUSION An explicit theoretical framework is critical to measure scientifically progressive independence from supervision using graduate medical education data.
Collapse
|
15
|
Kashner TM, Byrne JM, Chang BK, Henley SS, Golden RM, Aron DC, Cannon GW, Gilman SC, Holland GJ, Kaminetzky CP, Keitz SA, Muchmore EA, Kashner TK, Wicker AB. Measuring progressive independence with the resident supervision index: empirical approach. J Grad Med Educ 2010; 2:17-30. [PMID: 21975880 PMCID: PMC2931230 DOI: 10.4300/1949-8357-2.1.17] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/10/2009] [Revised: 01/01/2010] [Accepted: 01/21/2010] [Indexed: 11/06/2022] Open
Abstract
BACKGROUND A Resident Supervision Index (RSI) developed by our research team quantifies the intensity of resident supervision in graduate medical education, with the goal of testing for progressive independence. The 4-part RSI method includes a survey instrument for staff and residents (RSI Inventory), a strategy to score survey responses, a theoretical framework (patient centered optimal supervision), and a statistical model that accounts for the presence or absence of supervision and the intensity of patient care. METHODS The RSI Inventory data came from 140 outpatient encounters involving 57 residents and 37 attending physicians during a 3-month period at a Department of Veterans Affairs outpatient clinic. Responses are scored to quantitatively measure the intensity of resident supervision across 10 levels of patient services (staff is absent, is present, participated, or provided care with or without a resident), case discussion (resident-staff interaction), and oversight (staff reviewed case, reviewed medical chart, consulted with staff, or assessed patient). Scores are analyzed by level and for patient care using a 2-part model (supervision initiated [yes or no] versus intensity once supervision was initiated). RESULTS All resident encounters had patient care supervision, resident oversight, or both. Consistent with the progressive independence hypothesis, residents were 1.72 (P = .019) times more likely to be fully responsible for patient care with each additional postgraduate year. Decreasing case complexity, increasing clinic workload, and advanced nonmedical degrees among attending staff were negatively associated with supervision intensity, although associations varied by supervision level. CONCLUSIONS These data are consistent with the progressive independence hypothesis in graduate medical education and offer empirical support for the 4-part RSI method to quantify the intensity of resident supervision for research, program evaluation, and resident assessment purposes. Before informing policy, however, more scientific research in actual teaching settings is needed to better understand the relationships among patient outcomes, clinic workload, case complexity, and graduate medical education experience in resident supervision and professional development.
Collapse
|
16
|
Splaine ME, Ogrinc G, Gilman SC, Aron DC, Estrada CA, Rosenthal GE, Lee S, Dittus RS, Batalden PB. The Department of Veterans Affairs National Quality Scholars Fellowship Program: experience from 10 years of training quality scholars. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2009; 84:1741-8. [PMID: 19940583 PMCID: PMC3800745 DOI: 10.1097/acm.0b013e3181bfdcef] [Citation(s) in RCA: 42] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2023]
Abstract
The Department of Veterans Affairs (VA) National Quality Scholars Fellowship Program (VAQS) was established in 1998 as a postgraduate medical education fellowship to train physicians in new methods of improving the quality and safety of health care for veterans and the nation. The VAQS curriculum is based on adult learning theory, with a national core curriculum of face-to-face components, technologically mediated distance learning components, and a unique local curriculum that draws from the strengths of regional resources. VAQS has established strong ties with other VA programs. Fellows' research and quality improvement projects are integrated with local and regional VA leaders' priorities, enhancing the relevance and visibility of the fellows' efforts and promoting recruitment of fellows to VA positions. VAQS has enrolled 98 fellows since 1999; 75 have completed the program and 24 are currently enrolled. Fellowship graduates have pursued a variety of career paths: 17% are continuing training (most in VA), 31% hold a VA faculty/staff position, 66% are academic faculty, and 80% conduct clinical or research work related to health care improvement. Graduates have held leadership positions in VA, Department of Defense, academic medicine, and public health agencies. Combining knowledge about the improvement of health care with adult learning strategies, distance learning technologies, face-to-face meetings, local mentorship, and experiential projects has been successful in improving care in VA and preparing physicians to participate in, study, and lead the improvement of health care quality and safety.
Collapse
|
17
|
Sherman SE, Fotiades J, Rubenstein LV, Gilman SC, Vivell S, Chaney E, Yano EM, Felker B. Teaching systems-based practice to primary care physicians to foster routine implementation of evidence-based depression care. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2007; 82:168-75. [PMID: 17264696 DOI: 10.1097/acm.0b013e31802d9165] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Although health care organizations seeking to improve quality often must change the system for delivering care, there is little available evidence on how to educate staff and providers about this change. As part of a 2002-2003 Veterans Health Administration multisite project using collaborative care to improve the management of depression, the authors implemented the Translating Initiatives for Depression into Effective Solutions (TIDES) program. Five steps were followed for teaching systems-based practice: (1) determine providers' educational needs (through administrative data, expert opinion, and provider discussion), (2) develop educational materials (based on needs assessed), (3) help each of seven sites develop an educational intervention, (4) implement the intervention, and (5) monitor the intervention's effectiveness. Sites relied primarily on passive educational strategies. There was variable implementation of the different components (e.g., lecture, educational outreach). No site chose to write up its education plan, as was suggested. The authors thus suggest that the educational model was successful at identifying providers' needs and creating appropriate materials, because the program was not advertised in other ways and because almost all providers referred patients to the program. However, the educational model was only partially successful at getting sites to develop and implement an educational plan, although provider behavior did change. Overall, the program was somewhat effective at teaching systems-based practice. The authors believe the best way to enhance effectiveness is to build education into the system rather than rely on a separate system for education.
Collapse
|
18
|
Jackson MJ, Gallis HA, Gilman SC, Grossman M, Holzman GB, Marquis D, Trusky SK. The need for specialty curricula based on core competencies: a white paper of the Conjoint Committee on Continuing Medical Education. THE JOURNAL OF CONTINUING EDUCATION IN THE HEALTH PROFESSIONS 2007; 27:124-8. [PMID: 17576626 DOI: 10.1002/chp.111] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
At present there is no curriculum to guide physician lifelong learning in a prescribed, deliberate manner. The Conjoint Committee on Continuing Medical Education, a group representing 16 major stakeholder organizations in continuing medical education, recommends that each specialty society and corresponding board reach consensus on the competencies expected of physicians in that specialty. Experts in a specialty will define content-based core competencies in the areas of patient care, medical knowledge, practice-based learning and improvement, interpersonal and communication skills, professionalism, and systems-based practice. These competencies, when cross-referenced with expertise, comprise a framework for specialty curricula and board maintenance of certification programs. The American Academy of Ophthalmology and the American Board of Ophthalmology already have implemented this recommendation. Their work is reported as a model for further development. A competency-based curriculum framework offers a foundation for continuing medical education in diverse practice settings and provider organizations.
Collapse
|
19
|
Leist JC, Gilman SC, Cullen RJ, Sklar J. Using Baldrige criteria to meet or exceed Accreditation Council for Continuing Medical Education Standards. THE JOURNAL OF CONTINUING EDUCATION IN THE HEALTH PROFESSIONS 2004; 24:57-63. [PMID: 15069913 DOI: 10.1002/chp.1340240109] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Continuing medical education providers accredited by the Accreditation Council for Continuing Medical Education (ACCME) may apply organizational assessment strategies beyond the ACCME Essential Areas, Elements, and Criteria. The Malcolm Baldrige National Quality Program offers an organizational assessment strategy commonly used in business, health care, and education settings. An analysis of both standards pointed out useful associations between the ACCME Essential Areas and the Baldrige National Quality Program Education Criteria (2003). Including leadership, governance, and social responsibility, the Baldrige Education Criteria provide a more comprehensive organizational assessment and stronger emphasis on a wider variety of results. The present analysis suggests that a continuing medical education provider could meet, and possibly exceed, the ACCME standards by applying the Baldrige Education Criteria in a "self-study" process to define, measure, monitor, and document fundamental organizational responsibilities and performance.
Collapse
|
20
|
Gilman SC, Cullen RJ, Leist JC, Craft CA. Domains-based outcomes assessment of continuing medical education: the VA's model. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2002; 77:810-817. [PMID: 12176694 DOI: 10.1097/00001888-200208000-00010] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
Demonstrating outcomes of continuing medical education (CME) efforts has become increasingly important to CME providers, accrediting organizations, and licensing bodies. Many CME providers have difficulty defining the nature of the outcomes, much less documenting the outcomes for which they are responsible. The vague nature of the terms "outcome," "impact," or "result" in the complexity of health care and medical education environments is a particular obstacle to many education providers. To overcome these barriers, the VA's Employee Education System (EES), a large CME provider, created a model identifying five major domains of possible outcomes for CME interventions; these are the domains of individual participants, employee teams, the larger organization, patients, and the community. These domains are useful in either assessing a single CME activity's outcomes or comprehensively assessing a CME provider's outcomes-assessment strategy. The use of such a domains-based outcomes-management strategy links organizational mission, needs assessment, specific activity assessment, and assessment of the overall education program. This approach may be useful to CME providers, accrediting and licensing bodies, or others interested in the relationship of CME outcomes to the activities of CME providers.
Collapse
|
21
|
Gilman SC. Degeneracy and race in the nineteenth century: the impact of clinical medicine. THE JOURNAL OF ETHNIC STUDIES 2001; 10:27-50. [PMID: 11620378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 02/21/2023]
|
22
|
Gilman SC, Turner JW. Media richness and social information processing: rationale for multifocal continuing medical education activities. THE JOURNAL OF CONTINUING EDUCATION IN THE HEALTH PROFESSIONS 2001; 21:134-139. [PMID: 11563218 DOI: 10.1002/chp.1340210303] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
Academic business communication has studied the results of media selection in organizations. Little of this work has been discussed in the context of continuing medical education (CME); however, it may apply to improving the design of educational activities. This article reviews literature on media richness and social information processing theories. The concept of media richness suggests that media choice results from a match between the objective characteristics of the medium and the content requirements of a message. In this context, media include face-to-face conversation and print and electronic media. Social information processing theory suggests that media selection is also based on participants' social norms for how information is communicated in their environment and the participants' familiarity with specific media types. Appraisal of CME with respect to these theories suggests that the complex relationship of CME content and CME participant environments invites the most effective strategies of multiple media experienced over time in what might be called multifocal continuing medical education.
Collapse
|
23
|
Lee SC, Brummet ME, Shahabuddin S, Woodworth TG, Georas SN, Leiferman KM, Gilman SC, Stellato C, Gladue RP, Schleimer RP, Beck LA. Cutaneous injection of human subjects with macrophage inflammatory protein-1 alpha induces significant recruitment of neutrophils and monocytes. JOURNAL OF IMMUNOLOGY (BALTIMORE, MD. : 1950) 2000; 164:3392-401. [PMID: 10706735 DOI: 10.4049/jimmunol.164.6.3392] [Citation(s) in RCA: 82] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
Macrophage inflammatory protein (MIP-1 alpha), a member of the CC chemokine subfamily, has been shown to attract T cells and monocytes in vitro and to be expressed at sites of inflammation. Although the in vitro activities of MIP-1 alpha have been well documented, the in vivo biological activities of MIP-1 alpha in humans have not been studied. To address this, we challenged human subjects by intradermal injection with up to 1000 pmol of MIP-1 alpha and performed biopsies 2, 10, and 24 h later. Although no acute cutaneous or systemic reactions were noted, endothelial cell activation, as indicated by the expression of E-selectin, was observed. In agreement with its in vitro activity, monocyte, lymphocyte, and, to a lesser degree, eosinophil infiltration was observed, peaking at 10-24 h. Surprisingly, in contrast to its reported lack of in vitro neutrophil-stimulating activity, a rapid infiltration of neutrophils was observed in vivo. This neutrophil infiltration occurred as early as 2 h, preceding the appearance of other cells, and peaked at 10 h. Interestingly, we found that neutrophils in whole blood, but not after isolation, expressed CCR1 on their cell surface. This CCR1 was thought to be functional as assessed by neutrophil CD11b up-regulation following whole-blood MIP-1 alpha stimulation. These studies substantiate the biological effects of MIP-1 alpha on monocytes and lymphocytes and uncover the previously unrecognized activity of MIP-1 alpha to induce neutrophil infiltration and endothelial cell activation, underscoring the need to evaluate chemokines in vivo in humans.
Collapse
|
24
|
Weringer EJ, Perry BD, Sawyer PS, Gilman SC, Showell HJ. Antagonizing leukotriene B4 receptors delays cardiac allograft rejection in mice. Transplantation 1999; 67:808-15. [PMID: 10199727 DOI: 10.1097/00007890-199903270-00005] [Citation(s) in RCA: 20] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
BACKGROUND Allograft rejection is a cellular immunological/inflammatory response that is, in part, directed by potent proinflammatory mediators. This study was designed to test the hypothesis that leukotriene B4 (LTB4) may have a role in graft rejection and that LTB4 receptor antagonists may be clinically useful in the treatment of allograft rejection. METHODS We evaluated the potent and selective LTB4 receptor antagonist CP-105696 in a murine heterotopic cardiac allograft model with oral dosing daily for 28 days or in an induction protocol (day -1 to day 3). RESULTS At a dose of 50 mg/kg/day (28 days), B10.BR (H2k) allografts transplanted into C57Bl/6 (H2b) recipients were significantly protected, as reflected by the mean survival time versus control grafts (27+/-20 days [n=10] vs. 12+/-6 days [n=14]; P=0.0146). Using an induction protocol (day -1 to day 3), CP-105696 at 100 mg/kg/day significantly prolonged allograft survival (33+/-23 days [n=9]; P=0.0026), but CP-105696 at 10 mg/kg/day did not (18+/-16 days [n=8]; P=0.1433). Syngeneic grafts survived indefinitely (n=11). Immunohistological evaluation of allografts at rejection revealed a mononuclear cell infiltrate composed primarily of CD3+ and CD11b+ (Mac-1+) cells, which were infrequent in syngeneic grafts. Allografts from mice treated with CP-105696 at 50 or 100 mg/kg/day demonstrated a selective reduction in beta2-integrin (Mac-1) expression on monocytes/macrophages, as demonstrated by CD11b staining density compared with allograft controls. CONCLUSIONS The results suggest that LTB4 or other potential ligands for LTB4 receptors may be important mediators of allograft rejection and support the clinical evaluation of LTB4 receptor antagonists in human organ transplantation.
Collapse
|
25
|
Ferreira MR, Bennett RL, Gilman SC, Mathewson S, Bennett CL. Diffusion of laparoscopic cholecystectomy in the Veterans Affairs health care system, 1991-1995. EFFECTIVE CLINICAL PRACTICE : ECP 1999; 2:49-55. [PMID: 10538476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Subscribe] [Scholar Register] [Indexed: 02/14/2023]
Abstract
CONTEXT Laparoscopic cholecystectomy has become the most widely used treatment for gallbladder disease. In HMO, Medicare, and fee-for-service settings, cholecystectomy rates increased 28% to 59% after introduction of laparoscopic cholecystectomy. OBJECTIVE To investigate the impact of the introduction of laparoscopic cholecystectomy on cholecystectomy rates and the operative mortality rate in Veterans Affairs (VA) hospitals. DESIGN Sequential cross-sectional study. PATIENTS All patients who underwent cholecystectomy from 1991 (before introduction of laparoscopic cholecystectomy) to 1995. SETTING 133 VA hospitals. OUTCOME MEASURES Cholecystectomy rates, use of laparoscopic or open cholecystectomy, and operative mortality rate. RESULTS The annual number of cholecystectomies in the VA system increased by 10% from 1991 to 1995; the laparoscopic procedure accounted for 25% of the caseload in 1992 and 52% in 1995. Compared with patients having laparoscopic cholecystectomy, those having open cholecystectomy were more likely to be older, be male, and have acute cholecystitis or comorbid illnesses (P < 0.001). The operative mortality rate of open cholecystectomy increased by 46% during this 4-year period (from 2.4% to 3.4%) and was constant for laparoscopic cholecystectomy (about 0.5%). Given the increasing use of the laparoscopic procedure, however, the overall mortality rate of cholecystectomy during surgery decreased by 22% (from 2.4% to 1.8%). Despite increased use of the surgery, the absolute number of deaths decreased by 9%. CONCLUSIONS The introduction of laparoscopic cholecystectomy in the VA system was not accompanied by a large increase in cholecystectomy rates, as it was in fee-for-service, Medicare, and HMO systems. Because the rate of operations has changed only slightly, the total number of cholecystectomy-related deaths has decreased.
Collapse
|