101
|
Law EH, Pickard AS, Xie F, Walton SM, Lee TA, Schwartz A. Parallel Valuation: A Direct Comparison of EQ-5D-3L and EQ-5D-5L Societal Value Sets. Med Decis Making 2019; 38:968-982. [PMID: 30403577 DOI: 10.1177/0272989x18802797] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
OBJECTIVE To compare and contrast EQ-5D-5L (5L) and EQ-5D-3L (3L) health state values derived from a common sample. METHODS Data from the 2017 US EQ-5D valuation study were analyzed. Value sets were estimated with random-effects linear regression based on composite time trade-off (cTTO) valuations for 3L and 5L health states with 2 approaches to model specification: main effects only and additional N3/N45 terms. Properties of the descriptive system and value set characteristics were compared by examining distributions of predicted index scores, ceiling effects, and single-level transition values from adjacent corner health states. Mean transition values were calculated for all predicted 3L and 5L health states and plotted against baseline index scores. RESULTS A total of 1062 respondents were included in the analysis. The observed mean cTTO values for the worst possible 3L and 5L health states were -0.423 and -0.343, respectively. The range of scale was larger with the 3L, compared to the 5L, for both main effects and N term models. Values for the mildest 5L health states (range, 0.857-0.924) were similar to 11111 for the 3L. Parameter estimates for matched dimension levels differed by <|0.07| except for the most severe level of Mobility. For the main effects model, 3L mean transition values were greater for more severe baseline 3L index scores, whereas 5L mean transition values remained constant irrespective of the baseline index score. CONCLUSIONS Compared to the 3L, the 5L exhibited a lower ceiling effect and improved measurement properties. There was a larger range of scale for the 3L compared to 5L; however, this difference was driven by differences in preference for the most severe level of problems in Mobility.
Collapse
|
102
|
Antoon JW, Reilly PJ, Munns EH, Schwartz A, Lohr JA. Efficacy of Empiric Treatment of Urinary Tract Infections in Neonates and Young Infants. Glob Pediatr Health 2019; 6:2333794X19857999. [PMID: 31259211 PMCID: PMC6587387 DOI: 10.1177/2333794x19857999] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2019] [Revised: 05/21/2019] [Accepted: 05/26/2019] [Indexed: 11/21/2022] Open
Abstract
Background. The antibiotic resistance patterns of young infants with urinary tract infections (UTIs) have evolved over the past 2 decades. Whether current empiric antibiotic regimens are sufficient in this age group is unknown. Methods. A retrospective review of patients aged 0 to 60 days admitted with a UTI discharge diagnosis. Results. Overall susceptibility to empiric antibiotics was 87%. Antibiotic resistance and length of stay were highest among those who were afebrile, those admitted to the intensive care unit, and those with culture diagnosis of enterococcal infection. The sensitivity and specificity of ultrasound as a screening tool for genitourinary anomaly was 70% and 40%, respectively, with a positive predictive value of 31.8%. Conclusions. Empiric antibiotic regimens cover a high percentage of UTIs in infants. However, high rates of resistance and prolonged length of stay in patients with enterococcal infection highlight the need for continued surveillance of such patients in this age group.
Collapse
|
103
|
Weaver FM, Binns-Calvey A, Gonzalez B, Kostovich C, LaVela S, Stroupe KT, Kelly B, Ashley N, Miskevics S, Gerber B, Burkhart L, Schwartz A, Weiner SJ. Alerting Doctors About Patient Life Challenges: A Randomized Control Trial of a Previsit Inventory of Contextual Factors. MDM Policy Pract 2019; 4:2381468319852334. [PMID: 31192310 PMCID: PMC6540506 DOI: 10.1177/2381468319852334] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2018] [Accepted: 04/13/2019] [Indexed: 11/15/2022] Open
Abstract
Objective. Effective care attends to relevant patient life context. We tested whether a patient-completed inventory helps providers contextualize care and increases patients’ perception of patient-centered care (PCC). Method. The inventory listed six red flags (e.g., emergency room visits) and if the patient checked any, prompted for related contextual factors (e.g., transportation difficulties). Patients were randomized to complete the inventory or watch health videos prior to their visit. Patients presented their inventory results to providers during audio-recorded encounters. Audios were coded for physician probing and incorporating context in care plans. Patients completed the Consultation and Relational Empathy (CARE) instrument after the encounter. Results. A total of 272 Veterans were randomized. Adjusting for covariates and clustering within providers, inventory patients rated visits as more patient-centered (44.5; standard error = 1.1) than controls (42.7, standard error = 1.1, P = 0.04, CARE range = 10–50). Providers were more likely to probe red flags (odds ratio = 1.54; confidence interval = 1.07–2.22; P = 0.02) when receiving the inventory, but not incorporating context into care planning. Conclusion. A previsit inventory of life context increased perceptions of PCC and providers’ likelihood of exploring context but not contextualizing care. Information about patients’ life challenges is not sufficient to assure that context informs provider decision making even when provided at the point of care by patients themselves.
Collapse
|
104
|
Kemper KJ, McClafferty H, Wilson PM, Serwint JR, Batra M, Mahan JD, Schubert CJ, Staples BB, Schwartz A. Do Mindfulness and Self-Compassion Predict Burnout in Pediatric Residents? ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2019; 94:876-884. [PMID: 30520809 DOI: 10.1097/acm.0000000000002546] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
PURPOSE Burnout symptoms are common among health professionals. Gaps remain in understanding both the stability of burnout and compassion over time and relationships among burnout, self-compassion, stress, and mindfulness in pediatric residents. METHOD The authors conducted a prospective cohort study of residents at 31 U.S. residency programs affiliated with the Pediatric Resident Burnout-Resilience Study Consortium. Residents completed online cross-sectional surveys in spring 2016 and 2017. The authors assessed demographic characteristics and standardized measures of mindfulness, self-compassion, stress, burnout, and confidence in providing compassionate care. RESULTS Of 1,108 eligible residents, 872 (79%) completed both surveys. Of these, 72% were women. The prevalence of burnout was 58% and the level of mindfulness was 2.8 in both years; levels of stress (16.4 and 16.2) and self-compassion (37.2 and 37.6) were also nearly identical in both years. After controlling for baseline burnout levels in linear mixed-model regression analyses, mindfulness in 2016 was protective for levels of stress and confidence in providing compassionate care in 2017. Self-compassion in 2016 was protective for burnout, stress, and confidence in providing compassionate care in 2017; a one-standard-deviation increase in self-compassion score was associated with a decrease in the probability of burnout from 58% to 48%. CONCLUSIONS Burnout and stress were prevalent and stable over at least 12 months among pediatric residents. Mindfulness and self-compassion were longitudinally associated with lower stress and greater confidence in providing compassionate care. Future studies are needed to evaluate the effectiveness of training that promotes mindfulness and self-compassion in pediatric residents.
Collapse
|
105
|
Javaheri S, Graff J, Khayat R, Schwartz A, Germany R, Costanzo MR. 0568 Phrenic Nerve Stimulation to Treat Idiopathic Central Sleep Apnea. Sleep 2019. [DOI: 10.1093/sleep/zsz067.566] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
|
106
|
Kemper KJ, Wilson PM, Schwartz A, Mahan JD, Batra M, Staples BB, McClafferty H, Schubert CJ, Serwint JR. Burnout in Pediatric Residents: Comparing Brief Screening Questions to the Maslach Burnout Inventory. Acad Pediatr 2019; 19:251-255. [PMID: 30395934 DOI: 10.1016/j.acap.2018.11.003] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/29/2018] [Revised: 10/24/2018] [Accepted: 11/02/2018] [Indexed: 10/27/2022]
Abstract
BACKGROUND Measuring burnout symptoms is important, but the Maslach Burnout Inventory (MBI) has 22 items. This project compared 3 single-item measures with the MBI and other factors related to burnout. METHODS Data were analyzed from the 2016 and 2017 Pediatric Resident Burnout-Resilience Study Consortium surveys, which included standard measures of perceived stress, mindfulness, resilience, and self-compassion; the MBI; and the 1- and 2-item screening questions. RESULTS In 2016 and 2017, data were collected from 1785/2723 (65%) and 2148/3273 (66%) eligible pediatric residents, respectively. Burnout rates on the MBI were 56% in 2016 and 54% in 2017. The Physician Work Life Study item generated estimates of burnout prevalence of 43% to 49% and, compared with the MBI for 2016 and 2017, had sensitivities of 69% to 72%, specificities of 79% to 82%, positive likelihood ratios of 3.4 to 3.8, and negative likelihood ratios of 0.35 to 0.38. The combination of an emotional exhaustion item and a depersonalization item generated burnout estimates of 53% in both years and, compared with the full MBI, had sensitivities of 85% to 87%, specificities of 84% to 85%, positive likelihood ratios of 5.7 to 6.4, and negative likelihood ratios of 0.18 for both years. Both items were significantly correlated with their parent subscales. The single items were significantly correlated with stress, mindfulness, resilience, and self-compassion. CONCLUSIONS The 1- and 2-item screens generated prevalence estimates similar to the MBI and were correlated with variables associated with burnout. The 1- and 2-item screens may be useful for pediatric residency training programs tracking burnout symptoms and response to interventions.
Collapse
|
107
|
Reed S, Kemper KJ, Schwartz A, Batra M, Staples BB, Serwint JR, McClafferty H, Schubert CJ, Wilson PM, Rakowsky A, Chase M, Mahan JD. Variability of Burnout and Stress Measures in Pediatric Residents: An Exploratory Single-Center Study From the Pediatric Resident Burnout-Resilience Study Consortium. J Evid Based Integr Med 2019; 23:2515690X18804779. [PMID: 30378438 PMCID: PMC6238198 DOI: 10.1177/2515690x18804779] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
Residency is a high-risk period for physician burnout. We aimed to determine the short-term stability of factors associated with burnout, application of these data to previous conceptual models, and the relationship of these factors over 3 months. Physician wellness questionnaire results were analyzed at 2 time points 3 months apart. Associations among variables within and across time points were analyzed. Logistic regression was used to predict burnout and compassionate care. A total of 74% of residents completed surveys. Over 3 months, burnout ( P = .005) and empathy ( P = .04) worsened. The most significant cross-sectional relationship was between stress and emotional exhaustion (time 1 r = 0.61, time 2 r = 0.68). Resilience was predictive of increased compassionate care and decreased burnout ( P < .05). Mindfulness was predictive of decreased burnout ( P < .05). Mitigating stress and fostering mindfulness and resilience longitudinally may be key areas of focus for improved wellness in pediatric residents. Larger studies are needed to better develop targeted wellness interventions.
Collapse
|
108
|
Murray KE, Lane JL, Carraccio C, Glasgow T, Long M, West DC, O'Connor M, Hobday P, Schwartz A, Englander R. Crossing the Gap: Using Competency-Based Assessment to Determine Whether Learners Are Ready for the Undergraduate-to-Graduate Transition. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2019; 94:338-345. [PMID: 30475269 DOI: 10.1097/acm.0000000000002535] [Citation(s) in RCA: 45] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
In 2011, the Education in Pediatrics Across the Continuum (EPAC) Study Group recruited four medical schools (University of California, San Francisco; University of Colorado; University of Minnesota; and University of Utah) and their associated pediatrics clerkship and residency program directors to be part of a consortium to pilot a model designed to advance learners from undergraduate medical education (UME) to graduate medical education (GME) and then to fellowship or practice based on competence rather than time spent in training. The central design features of this pilot included predetermined expectations of performance and transition criteria to ensure readiness to progress from UME to GME, using the Core Entrustable Professional Activities for Entering Residency (Core EPAs) as a common assessment framework. Using this framework, each site team (which included, but was not limited to, the EPAC course, pediatric clerkship, and pediatric residency program directors) monitored learners' progress, with the site's clinical competency committee marking the point of readiness to transition from UME to GME (i.e., the attainment of supervision level 3a). Two of the sites implemented time-variable transition from UME to GME, based on when a learner met the performance expectations and transition criteria. In this Article, the authors describe each of the four sites' implementation of Core EPA assessment and their approach to gathering the data necessary to determine readiness for transition. They conclude by offering recommendations and lessons learned from the pilot's first seven years of development, adaptation, and implementation of assessment strategies across the sites, and discussing next steps.
Collapse
|
109
|
Etingen B, Hill JN, Miller LJ, Schwartz A, LaVela SL, Jordan N. An Exploratory Pilot Study to Describe Shared Decision-Making for PTSD Treatment Planning: The Provider Perspective. Mil Med 2019; 184:467-475. [PMID: 30901448 DOI: 10.1093/milmed/usy407] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2018] [Revised: 09/25/2018] [Indexed: 11/13/2022] Open
Abstract
OBJECTIVE To describe current practices used by Veterans Administration (VA) mental health (MH) providers involved in post-traumatic stress disorder (PTSD) treatment planning to support engagement of veterans with PTSD in shared decision-making (SDM). METHODS Semi-structured interviews with MH providers (n = 9) were conducted at 1 large VA, audio-recorded, and transcribed verbatim. Transcripts were analyzed deductively, guided by a published account of the integral SDM components for MH care. RESULTS While discussing forming a cohesive team with patients, providers noted the importance of establishing rapport and assessing treatment readiness. Providers' clinical knowledge/expertise, knowledge of the facility's treatment options, knowledge of how to navigate the VA MH care system, and patient factors (goals/preferences, factors influencing treatment engagement) were noted as important to consider when patients and providers exchange information. When negotiating the treatment plan, providers indicated that conversations should include treatment recommendations and concurrent opportunities for personalization. They also emphasized the importance of discussions to finalize a mutually agreeable patient- and provider-informed treatment plan and measure treatment impact. CONCLUSION These results offer a preliminary understanding of VA MH providers' facilitation of SDM for PTSD care. Findings may provide insights for MH providers who wish to engage patients with PTSD in SDM.
Collapse
|
110
|
Schumacher DJ, Bartlett KW, Elliott SP, Michelson C, Sharma T, Garfunkel LC, King B, Schwartz A. Milestone Ratings and Supervisory Role Categorizations Swim Together, but Is the Water Muddy? Acad Pediatr 2019; 19:144-151. [PMID: 29925038 DOI: 10.1016/j.acap.2018.06.002] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/30/2017] [Revised: 06/01/2018] [Accepted: 06/09/2018] [Indexed: 10/28/2022]
Abstract
OBJECTIVE This single-specialty, multi-institutional study aimed to determine 1) the association between milestone ratings for individual competencies and average milestone ratings (AMRs) and 2) the association between AMRs and recommended supervisory role categorizations made by individual clinical competency committee (CCC) members. METHODS During the 2015-16 academic year, CCC members at 14 pediatric residencies reported milestone ratings for 21 competencies and recommended supervisory role categories (may not supervise, may supervise in some settings, may supervise in all settings) for residents they reviewed. An exploratory factor analysis of competencies was conducted. The associations among individual competencies, the AMR, and supervisory role categorizations were determined by computing bivariate correlations. The relationship between AMRs and recommended supervisory role categorizations was examined using an ordinal mixed logistic regression model. RESULTS Of the 155 CCC members, 68 completed both milestone assignments and supervision categorizations for 451 residents. Factor analysis of individual competencies controlling for clustering of residents in raters and sites resulted in a single-factor solution (cumulative variance: 0.75). All individual competencies had large positive correlations with the AMR (correlation coefficient: 0.84-0.93), except for two professionalism competencies (Prof1: 0.63 and Prof4: 0.65). When combined across training year and time points, the AMR and supervisory role categorization had a moderately positive correlation (0.56). CONCLUSIONS This exploratory study identified a modest correlation between average milestone ratings and supervisory role categorization. Convergence of competencies on a single factor deserves further exploration, with possible rater effects warranting attention.
Collapse
|
111
|
Schumacher DJ, Martini A, Bartlett KW, King B, Calaman S, Garfunkel LC, Elliott SP, Frohna JG, Schwartz A, Michelson CD. Key Factors in Clinical Competency Committee Members' Decisions Regarding Residents' Readiness to Serve as Supervisors: A National Study. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2019; 94:251-258. [PMID: 30256253 DOI: 10.1097/acm.0000000000002469] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
PURPOSE Entrustment has become a popular assessment framework in recent years. Most research in this area has focused on how frontline assessors determine when a learner can be entrusted. However, less work has focused on how these entrustment decisions are made. The authors sought to understand the key factors that pediatric residency program clinical competency committee (CCC) members consider when recommending residents to a supervisory role. METHOD CCC members at 14 pediatric residency programs recommended residents to one of five progressive supervisory roles (from not serving as a supervisory resident to serving as a supervisory resident in all settings). They then responded to a free-text prompt, describing the key factors that led them to that decision. The authors analyzed these responses, by role recommendation, using a thematic analysis. RESULTS Of the 155 CCC members at the participating programs, 84 completed 769 supervisory role recommendations during the 2015-2016 academic year. Four themes emerged from the thematic analysis: (1) Determining supervisory ability follows from demonstrated trustworthiness; (2) demonstrated performance matters, but so does experience; (3) ability to lead a team is considered; and (4) contextual considerations external to the resident are at play. CONCLUSIONS CCC members considered resident and environmental factors in their summative entrustment decision making. The interplay between these factors should be considered as CCC processes are optimized and studied further.
Collapse
|
112
|
Selvaraj K, Ruiz MJ, Aschkenasy J, Chang JD, Heard A, Minier M, Osta AD, Pavelack M, Samelson M, Schwartz A, Scotellaro MA, Seo-Lee A, Sonu S, Stillerman A, Bayldon BW. Screening for Toxic Stress Risk Factors at Well-Child Visits: The Addressing Social Key Questions for Health Study. J Pediatr 2019; 205:244-249.e4. [PMID: 30297291 DOI: 10.1016/j.jpeds.2018.09.004] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/23/2018] [Revised: 07/20/2018] [Accepted: 09/04/2018] [Indexed: 01/02/2023]
Abstract
OBJECTIVES To determine the prevalence of and demographic characteristics associated with toxic stress risk factors by universal screening, the impact of screening on referral rates to community resources, and the feasibility and acceptability of screening in a medical home setting. STUDY DESIGN We developed the Addressing Social Key Questions for Health Questionnaire, a 13-question screen of adverse childhood experiences (ACEs) and unmet social needs. Parents/guardians of children 0-17 years of age received this questionnaire at well-child visits at 4 academic clinics from August 1, 2016 to February 28, 2017. Providers reviewed the tool and referred to community resources as needed. A subset of families completed demographic and satisfaction surveys. Prevalence of ACEs and unmet social needs, community referral rates at 1 site with available data, and family acceptability data were collected. Analyses included frequency distributions, χ2 tests, and Poisson regression. RESULTS Of 2569 families completing an Addressing Social Key Questions for Health Questionnaire, 49% reported ≥1 stressor; 6% had ≥1 ACE; 47% had ≥1 unmet social need. At 1 site, community referral rates increased from 2.0% to 13.3% (P < .0001) after screening implementation. Risk factors for having a stressor include male sex and African American or Hispanic race. 86% of 446 families want clinics to continue screening. CONCLUSIONS Universal screening for toxic stress risk factors in pediatric primary care improved identification and management of family needs. Screening was feasible and acceptable to families. Prevalence of unmet social needs but not ACEs was comparable with prior studies. Further evaluation and modification of the screening protocol is needed to increase screening and identification.
Collapse
|
113
|
Hicks PJ, Margolis MJ, Carraccio CL, Clauser BE, Donnelly K, Fromme HB, Gifford KA, Poynter SE, Schumacher DJ, Schwartz A. A novel workplace-based assessment for competency-based decisions and learner feedback. MEDICAL TEACHER 2018; 40:1143-1150. [PMID: 29688108 DOI: 10.1080/0142159x.2018.1461204] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
BACKGROUND Increased recognition of the importance of competency-based education and assessment has led to the need for practical and reliable methods to assess relevant skills in the workplace. METHODS A novel milestone-based workplace assessment system was implemented in 15 pediatrics residency programs. The system provided: (1) web-based multisource feedback (MSF) and structured clinical observation (SCO) instruments that could be completed on any computer or mobile device; and (2) monthly feedback reports that included competency-level scores and recommendations for improvement. RESULTS For the final instruments, an average of five MSF and 3.7 SCO assessment instruments were completed for each of 292 interns; instruments required an average of 4-8 min to complete. Generalizability coefficients >0.80 were attainable with six MSF observations. Users indicated that the new system added value to their existing assessment program; the need to complete the local assessments in addition to the new assessments was identified as a burden of the overall process. CONCLUSIONS Outcomes - including high participation rates and high reliability compared to what has traditionally been found with workplace-based assessment - provide evidence for the validity of scores resulting from this novel competency-based assessment system. The development of this assessment model is generalizable to other specialties.
Collapse
|
114
|
Park YS, Hicks PJ, Carraccio C, Margolis M, Schwartz A. Does Incorporating a Measure of Clinical Workload Improve Workplace-Based Assessment Scores? Insights for Measurement Precision and Longitudinal Score Growth From Ten Pediatrics Residency Programs. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2018; 93:S21-S29. [PMID: 30365426 DOI: 10.1097/acm.0000000000002381] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
PURPOSE This study investigates the impact of incorporating observer-reported workload into workplace-based assessment (WBA) scores on (1) psychometric characteristics of WBA scores and (2) measuring changes in performance over time using workload-unadjusted versus workload-adjusted scores. METHOD Structured clinical observations and multisource feedback instruments were used to collect WBA data from first-year pediatrics residents at 10 residency programs between July 2016 and June 2017. Observers completed items in 8 subcompetencies associated with Pediatrics Milestones. Faculty and resident observers assessed workload using a sliding scale ranging from low to high; all item scores were rescaled to a 1-5 scale to facilitate analysis and interpretation. Workload-adjusted WBA scores were calculated at the item level using three different approaches, and aggregated for analysis at the competency level. Mixed-effects regression models were used to estimate variance components. Longitudinal growth curve analyses examined patterns of developmental score change over time. RESULTS On average, participating residents (n = 252) were assessed 5.32 times (standard deviation = 3.79) by different raters during the data collection period. Adjusting for workload yielded better discrimination of learner performance, and higher reliability, reducing measurement error by 28%. Projections in reliability indicated needing up to twice the number of raters when workload-unadjusted scores were used. Longitudinal analysis showed an increase in scores over time, with significant interaction between workload and time; workload also increased significantly over time. CONCLUSIONS Incorporating a measure of observer-reported workload could improve the measurement properties and the ability to interpret WBA scores.
Collapse
|
115
|
|
116
|
Li STT, Tancredi DJ, Schwartz A, Guillot A, Burke AE, Trimm RF, Guralnick S, Mahan JD, Gifford K. Pediatric Program Director Minimum Milestone Expectations Before Allowing Supervision of Others and Unsupervised Practice. Acad Pediatr 2018; 18:828-836. [PMID: 29704651 DOI: 10.1016/j.acap.2018.04.010] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/24/2017] [Revised: 04/19/2018] [Accepted: 04/21/2018] [Indexed: 11/28/2022]
Abstract
BACKGROUND The Accreditation Council for Graduate Medical Education requires semiannual Milestone reporting on all residents. Milestone expectations of performance are unknown. OBJECTIVE To determine pediatric program director (PD) minimum Milestone expectations for residents before being ready to supervise and before being ready to graduate. METHODS Mixed methods survey of pediatric PDs on their programs' Milestone expectations before residents are ready to supervise and before they are ready to graduate, and in what ways PDs use Milestones to make supervision and graduation decisions. If programs had no established Milestone expectations, PDs indicated expectations they considered for use in their program. Mean minimum Milestone level expectations were adjusted for program size, region, and clustering of Milestone expectations by program were calculated for before supervise and before graduate. Free-text questions were analyzed using thematic analysis. RESULTS The response rate was 56.8% (113 of 199). Most programs had no required minimum Milestone level before residents are ready to supervise (80%; 76 of 95) or ready to graduate (84%; 80 of 95). For readiness to supervise, minimum Milestone expectations PDs considered establishing for their program were highest for humanism (2.46; 95% confidence interval [CI], 2.21-2.71) and professionalization (2.37; 95% CI, 2.15-2.60). Minimum Milestone expectations for graduates were highest for help-seeking (3.14; 95% CI, 2.83-3.46). Main themes included the use of Milestones in combination with other information to assess learner performance and Milestones are not equally weighted when making advancement decisions. CONCLUSIONS Most PDs have not established program minimum Milestones, but would vary such expectations according to competency.
Collapse
|
117
|
Ott M, Schwartz A, Goldszmidt M, Bordage G, Lingard L. Resident hesitation in the operating room: does uncertainty equal incompetence? MEDICAL EDUCATION 2018; 52:851-860. [PMID: 29574896 DOI: 10.1111/medu.13530] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/23/2017] [Revised: 09/15/2017] [Accepted: 12/22/2017] [Indexed: 05/28/2023]
Abstract
CONTEXT In postgraduate medical programmes, the progressive development of autonomy places residents in situations in which they must cope with uncertainty. We explored the phenomenon of hesitation, triggered by uncertainty, in the context of the operating room in order to understand the social behaviours surrounding supervision and progressive autonomy. METHODS Nine surgical residents and their supervising surgeons at a Canadian medical school were selected. Each resident-supervisor pair was observed during a surgical procedure and subsequently participated in separate post-observation, semi-structured interviews. Constructivist grounded theory was used to guide the collection and analysis of data. RESULTS Three hesitation-related themes were identified: the principle of progress; the meaning of hesitation, and the judgement of competence. Supervisors and residents understood hesitation in the context of a core surgical principle we termed the 'principle of progress'. This principle reflects the supervisors' and residents' shared norm that maintaining progress throughout a surgical procedure is of utmost importance. Resident hesitation was perceived as the first indication of a disruption to this principle and was therefore interpreted by supervisors and residents alike as a sign of incompetence. This interpretation influenced the teaching-learning process during these moments when residents were working at the edge of their abilities. CONCLUSIONS The principle of progress influences the meaning of hesitation which, in turn, shapes judgements of competence. This has important implications for teaching and learning in direct supervision settings such as surgery. Without efforts to change the perception that hesitation represents incompetence, these potential teaching-learning moments will not fully support progressive autonomy.
Collapse
|
118
|
Johnson J, Schwartz A, Lineberry M, Rehman F, Park YS. Development, administration, and validity evidence of a subspecialty preparatory test toward licensure: a pilot study. BMC MEDICAL EDUCATION 2018; 18:176. [PMID: 30068394 PMCID: PMC6090864 DOI: 10.1186/s12909-018-1294-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/17/2018] [Accepted: 07/25/2018] [Indexed: 06/08/2023]
Abstract
BACKGROUND Trainees in medical subspecialties lack validated assessment scores that can be used to prepare for their licensing examination. This paper presents the development, administration, and validity evidence of a constructed-response preparatory test (CRPT) administered to meet the needs of nephrology trainees. METHODS Learning objectives from the licensing examination were used to develop a test blueprint for the preparatory test. Messick's unified validity framework was used to gather validity evidence for content, response process, internal structure, relations to other variables, and consequences. Questionnaires were used to gather data on the trainees' perception of examination preparedness, item clarity, and curriculum adequacy. RESULTS There were 10 trainees and 5 faculty volunteers who took the test. The majority of trainees passed the constructed-response preparatory test. However, many scored poorly on items assessing renal pathology and physiology knowledge. We gathered the following five sources of validity evidence: (1) Content: CRPT mapped to the licensing examination blueprint, with items demonstrating clarity and range of difficulty; (2) Response process: moderate rater agreement (intraclass correlation = .58); (3) Internal structure: sufficient reliability based on generalizability theory (G-coefficient = .76 and Φ-coefficient = .53); (4) Relations to other variables: CRPT scores reflected years of exposure in nephrology and clinical practice; (5) Consequences: post-assessment survey revealed that none of the test takers felt "poorly prepared" for the upcoming summative examination and that their studying would increase in duration and be adapted in terms of content focus. CONCLUSIONS Preparatory tests using constructed response items mapped to licensure examination blueprint can be developed and used at local program settings to help prepare learners for subspecialty licensure examinations. The CRPT and questionnaire data identified shortcomings of the nephrology training program curriculum. Following the preparatory test, trainees expressed an improved sense of preparedness for their licensing examination.
Collapse
|
119
|
de la Salle C, Charmantier JL, Baas MJ, Schwartz A, Wiesel ML, Grunebaum L, Cazenave JP. A Deletion Located in the 3′ Non Translated Part of the Factor IX Gene Responsible for Mild Haemophilia B. Thromb Haemost 2018. [DOI: 10.1055/s-0038-1649582] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
|
120
|
Schwartz A. What should we mean by "allowed to supervise others" in entrustment scales? MEDICAL TEACHER 2018; 40:642. [PMID: 29334285 DOI: 10.1080/0142159x.2017.1421752] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
|
121
|
Biselli P, Fricke K, Grote L, Braun AT, Kirkness J, Smith P, Schwartz A, Schneider H. Reductions in dead space ventilation with nasal high flow depend on physiological dead space volume: metabolic hood measurements during sleep in patients with COPD and controls. Eur Respir J 2018; 51:13993003.02251-2017. [PMID: 29724917 DOI: 10.1183/13993003.02251-2017] [Citation(s) in RCA: 37] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2017] [Accepted: 04/10/2018] [Indexed: 11/05/2022]
Abstract
Nasal high flow (NHF) reduces minute ventilation and ventilatory loads during sleep but the mechanisms are not clear. We hypothesised NHF reduces ventilation in proportion to physiological but not anatomical dead space.11 subjects (five controls and six chronic obstructive pulmonary disease (COPD) patients) underwent polysomnography with transcutaneous carbon dioxide (CO2) monitoring under a metabolic hood. During stable non-rapid eye movement stage 2 sleep, subjects received NHF (20 L·min-1) intermittently for periods of 5-10 min. We measured CO2 production and calculated dead space ventilation.Controls and COPD patients responded similarly to NHF. NHF reduced minute ventilation (from 5.6±0.4 to 4.8±0.4 L·min-1; p<0.05) and tidal volume (from 0.34±0.03 to 0.3±0.03 L; p<0.05) without a change in energy expenditure, transcutaneous CO2 or alveolar ventilation. There was a significant decrease in dead space ventilation (from 2.5±0.4 to 1.6±0.4 L·min-1; p<0.05), but not in respiratory rate. The reduction in dead space ventilation correlated with baseline physiological dead space fraction (r2=0.36; p<0.05), but not with respiratory rate or anatomical dead space volume.During sleep, NHF decreases minute ventilation due to an overall reduction in dead space ventilation in proportion to the extent of baseline physiological dead space fraction.
Collapse
|
122
|
Chan TM, Mercuri M, Van Dewark K, Sherbino J, Schwartz A, Norman G, Lineberry M. Managing Multiplicity: Conceptualizing Physician Cognition in Multipatient Environments. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2018; 93:786-793. [PMID: 29210754 DOI: 10.1097/acm.0000000000002081] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
PURPOSE Emergency physicians (EPs) regularly manage multiple patients simultaneously, often making time-sensitive decisions around priorities for multiple patients. Few studies have explored physician cognition in multipatient scenarios. The authors sought to develop a conceptual framework to describe how EPs think in busy, multipatient environments. METHOD From July 2014 to May 2015, a qualitative study was conducted at McMaster University, using a think-aloud protocol to examine how 10 attending EPs and 10 junior residents made decisions in multipatient environments. Participants engaged in the think-aloud exercise for five different simulated multipatient scenarios. Transcripts from recorded interviews were analyzed inductively, with an iterative process involving two independent coders, and compared between attendings and residents. RESULTS The attending EPs and junior residents used similar processes to prioritize patients in these multipatient scenarios. The think-aloud processes demonstrated a similar process used by almost all participants. The cognitive task of patient prioritization consisted of three components: a brief overview of the entire cohort of patients to determine a general strategy; an individual chart review, whereby the participant created a functional patient story from information available in a file (i.e., vitals, brief clinical history); and creation of a relative priority list. Compared with residents, the attendings were better able to construct deeper and more complex patient stories. CONCLUSIONS The authors propose a conceptual framework for how EPs prioritize care for multiple patients in complex environments. This study may be useful to teachers who train physicians to function more efficiently in busy clinical environments.
Collapse
|
123
|
Berger S, Pho H, Fleury Curado T, Schwartz A, Polotsky V. 0077 Intranasal Leptin Approach To Treat Sleep-disordered Breathing. Sleep 2018. [DOI: 10.1093/sleep/zsy061.076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
|
124
|
Caballero Eraso C, Shin M, Pho H, Schwartz A, Tang W, Sham J, Polotsky V. 0080 Leptin Induces Upregulation Of The Hypoxic Ventilatory Response Acting In The Carotid Bodies. Sleep 2018. [DOI: 10.1093/sleep/zsy061.079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
|
125
|
Antoon JW, Goldman JL, Lee B, Schwartz A. Incidence, outcomes, and resource use in children with Stevens-Johnson syndrome and toxic epidermal necrolysis. Pediatr Dermatol 2018; 35:182-187. [PMID: 29315761 DOI: 10.1111/pde.13383] [Citation(s) in RCA: 33] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
BACKGROUND/OBJECTIVES Stevens-Johnson syndrome (SJS) and toxic epidermal necrolysis (TEN) are life-threatening cutaneous reactions, typically to drugs or infection. The incidence and outcomes of these conditions in children are unknown. The objective of this study was to report the overall burden of Stevens-Johnson syndrome and toxic epidermal necrolysis in children in the United States. METHODS We performed a retrospective cohort analysis of children and adolescents younger than 18 years of age using the 2009 and 2012 Kids' Inpatient Database. RESULTS We identified 1486 children and adolescents hospitalized with a diagnosis of Stevens-Johnson syndrome or toxic epidermal necrolysis. The national incidence per 100 000 was 6.3 for Stevens-Johnson syndrome, 0.7 for Stevens-Johnson syndrome/toxic epidermal necrolysis overlap syndrome, and 0.5 for toxic epidermal necrolysis. The highest incidence in children was in those aged 11-15 years (38.4 per 100 000). Toxic epidermal necrolysis and Stevens-Johnson syndrome/toxic epidermal necrolysis overlap syndrome were associated with longer stay, greater mortality, and higher hospital charges than those with Stevens-Johnson syndrome. Hospital mortality was highest in children with toxic epidermal necrolysis and in children aged 0-5 years. CONCLUSIONS The incidence of Stevens-Johnson syndrome and toxic epidermal necrolysis in children is higher than reported in adults, and there are significant age-based variations in incidence and outcomes across the pediatric population. Further study is needed to determine the most effective treatment strategies to reduce costs and improve outcomes in children hospitalized with severe cutaneous reactions.
Collapse
|