Perceptions of Justice in Clinical Learning Environments: Development and Validation of an Organizational Justice Measure for Medical Trainees

PURPOSE

This study aimed to develop an instrument to measure medical trainees' perceptions of justice in clinical learning environments.

METHOD

Between 2019 and 2023, the authors conducted a multiyear, multi-institutional, multiphase study to develop a 16-item justice measure with 4 dimensions: interpersonal, informational, procedural, and distributive. The authors gathered validity evidence based on test content, internal structure, and relationships with other variables across 3 phases. Phase 1 involved drafting items and gathering evidence that items measured intended dimensions. Phase 2 involved analyzing relevance of items for target groups, examining interitem correlations and factor loadings in a preliminary analysis, and obtaining reliability estimates. Phase 3 involved a confirmatory factor analysis and collecting convergent and discriminant validity evidence.

RESULTS

In phase 1, 63 of 91 draft items were retained following a content validation exercise gauging how well items measured targeted dimensions (mean [SD] item ratings within dimensions, 4.16 [0.36] to 4.39 [0.34]) on a 5-point Likert scale (with 1 indicating not at all well and 5 indicating extremely well). In phase 2, 30 items were removed due to low factor loadings (i.e., < 0.40), and 4 items per dimension were selected (factor loadings, 0.42-0.89). In phase 3, a confirmatory factor analysis supported the 4-dimension model (χ2 = 610.14, P < .001; comparative fit index = 0.90, Tucker-Lewis Index = 0.87, root mean squared error of approximation = 0.11, standardized root mean squared residual = 0.06), with convergent and discriminant validity evidence showing hypothesized positive correlations with a justice measure (r = 0.93, P < .001), trait positive affect (r = 0.46, P < .001), and emotional stability (r = 0.33, P < .001) and negative correlations with trait negative affect (r = -0.39, P < .001).

CONCLUSIONS

Results indicate the measure's potential utility in understanding justice perceptions and designing targeted interventions.

Can a Situational Judgment Test Identify Trainees at Risk of Professionalism Issues? A Multi-Institutional, Prospective Cohort Study

PURPOSE

To determine whether overall situational judgment test (SJT) scores are associated with programs' clinical competency committee (CCC) ratings of trainee professionalism, any concerning behavior, and concerning behavior requiring active remediation at 2 time periods.

METHOD

In fall 2019, trainees from 17 U.S. programs (16 residency, 1 fellowship) took an online 15-scenario SJT developed to measure 7 dimensions of professionalism. CCC midyear and year-end (6 months and 1 year following SJT completion, respectively) professionalism scores and concern ratings were gathered for academic year 2019-2020. Analyses were conducted to determine whether overall SJT scores related to overall professionalism ratings, trainees displaying any concerns, and trainees requiring active remediation at both time periods.

RESULTS

Overall SJT scores correlated positively with midyear and year-end overall professionalism ratings ( r = .21 and .14, P &lt; .001 and = .03, respectively). Holding gender and race/ethnicity constant, a 1 standard deviation (SD) increase in overall SJT score was associated with a .20 SD increase in overall professionalism ratings at midyear ( P = .005) and a .22 SD increase at year-end ( P = .001). Holding gender and race/ethnicity constant, a 1 SD increase in overall SJT score decreased the odds of a trainee displaying any concerns by 37% (odds ratio [OR] 95% confidence interval [CI]: [.44, .87], P = .006) at midyear and 34% (OR 95% CI: [.46, .95], P = .025) at year-end and decreased the odds of a trainee requiring active remediation by 51% (OR 95% CI: [.25, .90], P = .02) at midyear.

CONCLUSIONS

Overall SJT scores correlated positively with midyear and year-end overall professionalism ratings and were associated with whether trainees exhibited any concerning behavior at midyear and year-end and whether trainees needed active remediation at midyear. Future research should investigate whether other potential professionalism measures are associated with concerning trainee behavior.

Supervision and Care Quality as Perceived by Redeployed Attendings, Fellows, and Residents During a COVID-19 Surge: Lessons for the Future

PURPOSE

To better prepare for potential future large-scale redeployments, this study examines quality of supervision and care as perceived by redeployed residents, fellows, and attendings during a COVID-19 surge.

METHOD

During April and May 2020, attendings, fellows, and residents redeployed at 2 teaching hospitals were invited to participate in a survey, which included questions on respondents' prior experience; redeployed role; amount of supervision needed and received; and perceptions of quality of supervision, patient care, and interprofessional collaboration. Frequencies, means, and P values were calculated to compare perceptions by experience and trainee status. Narrative responses to 2 open-ended questions were independently coded; themes were constructed.

RESULTS

Overall, 152 of 297 (51.2%) individuals responded, including 64 of 142 attendings (45.1%), 40 of 79 fellows (50.6%), and 48 of 76 residents (63.2%). Fellows and attendings, regardless of prior experience, perceived supervision as adequate. In contrast, experienced residents reported receiving more supervision than needed, while inexperienced residents reported receiving less supervision than needed and rated overall supervision as poor. Attendings, fellows, and experienced residents rated the overall quality of care as acceptable to good, whereas inexperienced residents perceived overall quality of care as worse to much worse, particularly when compared with baseline.

CONCLUSIONS

Narrative themes indicated that the quality of supervision and care was buffered by strong camaraderie, a culture of informal consultation, team composition (mixing experienced with inexperienced), and clinical decision aids. The markedly negative view of inexperienced residents suggests a higher risk for disillusionment, perhaps even moral injury, during future redeployments. Implications for planning are explored.

Exploring the relationship between emotion and cognitive load types during patient handovers

Cognitive Load Theory has emerged as an important approach to improving instruction in the health professions workplace, including patient handovers. At the same time, there is growing recognition that emotion influences learning through numerous cognitive processes including motivation, attention, working memory, and long-term memory. This study explores how emotion influences the cognitive load experienced by trainees performing patient handovers. From January to March 2019, 693 (38.7%) of 1807 residents and fellows from a 24-hospital health system in New York city completed a survey after performing a handover. Participants rated their emotional state and cognitive load. The survey included questions about features of the learner, task, and instructional environment. The authors used factor analysis to identify the core dimensions of emotion. Regression analyses explored the relationship between the emotion factors and cognitive load types. Two emotion dimensions were identified representing invigoration and tranquility. In regression analyses, higher levels of invigoration, tranquility, and their interaction were independently associated with lower intrinsic load and extraneous load. The interaction of invigoration and tranquility predicted lower germane load. The addition of the emotion variables to multivariate models including other predictors of cognitive load types significantly increased the amount of variance explained. The study provides a model for measuring emotions in workplace learning. Because emotion appears to have a significant influence on cognitive load types, instructional designers should consider strategies that help trainees regulate emotion in order to reduce cognitive load and improve learning and performance.

Evidence for validity for the Cognitive Load Inventory for Handoffs

CONTEXT

Patient handovers remain a significant patient safety challenge. Cognitive load theory (CLT) can be used to identify the cognitive mechanisms for handover errors. The ability to measure cognitive load types during handovers could drive the development of more effective curricula and protocols. No such measure currently exists.

METHODS

The authors developed the Cognitive Load Inventory for Handoffs (CLIH) using a multi-step process, including expert interviews to enhance content validity and talk-alouds to optimise response process validity. The final version contained 28 items. From January to March 2019, we administered a cross-sectional survey to 1807 residents and fellows from a large health care system in the USA. Participants completed the CLIH following a handover. Exploratory factor analysis of data from one-third of respondents identified high-performing items; confirmatory factor analysis of data from the remaining sample assessed model fit. Model fit was evaluated using the comparative fit index (CFI) (>0.90), Tucker-Lewis index (TFI) (>0.80), standardised root mean square residual (SRMR) (<0.08) and root mean square of error of approximation (RMSEA) (<0.08).

RESULTS

Participants included 693 trainees (38.4%) (231 in the exploratory study and 462 in the confirmatory study). Eleven items were removed during exploratory factor analysis. Confirmatory factor analysis of the 16 remaining items (five for intrinsic load, seven for extraneous load and four for germane load) supported a three-factor model and met criteria for good model fit: the CFI was 0.95, TFI was 0.93, RMSEA was 0.074 and SRMR was 0.07. The factor structure was comparable for gender and role. Intrinsic, extraneous and germane load scales had high internal consistency. With one exception, scale scores were associated, as hypothesised, with postgraduate level and clinical setting.

CONCLUSIONS

The CLIH measures three types of cognitive load during patient handovers. Evidencefor validity is provided for the CLIH's content, response process, internal structure and association with other variables. This instrument can be used to determine the relative drivers of cognitive load during handovers in order to optimize handover instruction and protocols.

Exploring Residents' Experience of Career Development Scholarship Tracks: A Qualitative Case Study Using Social Cognitive Career Theory

Problem: Trainees enter graduate medical education with professional aspirations that often extend beyond the role of clinician to roles such as educator, innovator, leader, advocate, or researcher. Many residency programs have implemented academic tracks to support career development in these areas. With the exception of research tracks, these tracks generally do not include significant longitudinal protected time and often rely upon 'extra-curricular' effort and possess insufficient structure, mentorship, and accountability. Most prior studies of non-research scholarship tracks have not been theory driven and do not explore in depth the experience of residents who participate. Approach: To address this gap in the literature, we conducted a qualitative case study informed by Social Cognitive Career Theory to explore the professional identity development of residents who participated in a non-research scholarship track that incorporates recommended best practices. The track, Pathways to Expertise Program, incorporates features of successful research tracks: protected time, longitudinal experience, mentorship, platforms for recognition, and accountability. Participants from the first three cohorts were interviewed at the time of their graduation (2017-2019). Semi-structured interviews were conducted, transcribed, and independently coded. Social Cognitive Career Theory informed the organization of codes into themes. Context: The Pathways to Expertise Program was implemented in a psychiatry residency training program in a large urban academic teaching hospital. Impact: Fifteen residents entered Pathways to Expertise Program during the study period and all 15 participated in the study. Fourteen completed the program and presented their projects at the department grand rounds. For dissemination, 12 presented their project findings at one or more national meetings in the form of a poster (20 distributed across 11 residents), workshop (six distributed across four residents), or presentation (two across two residents). Six residents accounted for a total of seven first author publications in peer reviewed journals. All participants described how their self-efficacy increased as a result of new skills (e.g., content, methodology, and scientific communication), mentorship (e.g., content and process guidance), peer and broader support (e.g., small group supervision), persuasive communications (e.g., recognition both locally and nationally), and positive emotional reactions (e.g., triumph). The residents also described expecting compelling benefits (e.g., stronger application for fellowship and expanded career opportunities). Participants indicated that the experience influenced their career goals and how they perceived their professional identities. Lessons Learned: These findings suggest that a longitudinal academic track that incorporates features of successful research tracks (protected time, mentorship, peer support, and accountability for deliverables) can be instrumental in forming and maturing professional identities for non-clinical roles. These tracks can accomplish several important goals, including enhancing resilience via identity formation around passion and purpose and meeting society's need for physicians who are engaged in inquiry and innovation. Implications for the design of academic tracks in general are explored.

Attenuation of bleomycin-induced pulmonary fibrosis by a catalytic antioxidant metalloporphyrin

Oxidative stress plays an important role in the development of fibrotic responses in the lung. However, it is not clear whether inhibiting oxidative stress with antioxidants can attenuate fibrotic processes in the lung. The objective of these studies was to test whether the catalytic antioxidant porphyrin manganese (III) tetrakis (4-benzoic acid) porphyrin (MnTBAP) could protect mice against bleomycin-induced lung fibrosis. A 10 mg/kg intraperitoneal dose of MnTBAP was established as safe and had a serum and lung half-life of 9.5 h in mice. Based on this data, four groups of mice were given one dose of bleomycin (3.2 U/kg, intratracheal) or saline and MnTBAP (5 mg/kg, intraperitoneal) or saline twice daily for 14 d. Lung fibrosis was assessed by measuring (1) lung hydroxyproline content as an index of collagen accumulation, (2) airway dysfunction by whole body plethysmography, and (3) histopathology. Bleomycin produced a 20% loss in body weight that was only 10% in the bleomycin/MnTBAP group. Bleomycin produced a twofold increase in hydroxyproline content that was decreased 23% by MnTBAP. Bleomycin produced a twofold increase in airway dysfunction that was also attenuated 30% by MnTBAP. Histopathologic analysis of the lungs of mice treated with bleomycin demonstrated a severe fibrotic response that was attenuated 28% by MnTBAP. Future studies on the oxidant mechanisms that MnTBAP is affecting in this bleomycin model of lung fibrosis may shed light on potential new therapeutic approaches for treating interstitial lung diseases.

Pharmacokinetics of diclofenac sodium in chronic active hepatitis and alcoholic cirrhosis

The objective of this study was to assess the pharmacokinetics of diclofenac sodium and its five metabolites following administration of a 150 mg oral dose to healthy subjects and patients with either chronic active hepatitis of varying morphology or alcoholic cirrhosis. Six healthy subjects, 6 chronic active hepatitis patients, and 6 alcoholic cirrhosis patients were enrolled in this prospective, open-label, parallel study. Blood samples were drawn at 0, 0.25, 0.5, 0.75, 1, 2, 4, 6, 8, 12, 24, 48, 72, 144, 312, and 480 hours, and urine samples were collected for 144 hours after administration of a single oral dose of diclofenac sodium. The mean area under the serum concentration-time curve extrapolated to infinity, oral clearance, half-life, maximal concentration, and time to peak concentration for diclofenac and its metabolites were determined and compared using analysis of variance. Cirrhotics had a mean +/- SD diclofenac AUC value (19,114 +/- 6806 ng.h/ml) significantly different (p < 0.02) from hepatitis patients (6071 +/- 1867 ng.h/ml) and healthy subjects (7008 +/- 2006 ng.h/ml), whereas healthy subjects and hepatitis patients had similar values. Comparable results were found for 4'-hydroxydiclofenac. The AUC values for 3'-hydroxydiclofenac and 3'-hydroxy-4'methoxydiclofeanc were significantly different when healthy subjects were compared to cirrhotics. However, hepatitis subjects were not significantly different from either group. The results indicate that hepatitis does not alter the pharmacokinetics of diclofenac. Alcoholic cirrhosis increased the mean diclofenac AUC approximately three times compared to normal subjects, indicating that one-third of the usual dose in cirrhotics would produce equivalent AUC values in normal subjects and subjects with alcoholic cirrhosis. However, since pharmacodynamic measurements were not made and no increase in untoward or side effects was noted in the alcoholic cirrhosis patients after a single dose, maintenance doses should be titrated to patients response.

Pharmacokinetic study of azithromycin with fluconazole and cotrimoxazole (trimethoprim-sulfamethoxazole) in healthy volunteers

BACKGROUND

Azithromycin, fluconazole and cotrimoxazole (trimethoprim-sulfamethoxazole; TMP/SMX) are all agents that are utilised for the treatment and/or prophylaxis of opportunistic infections in patients with AIDS.

OBJECTIVE

To characterise the potential for an interaction when azithromycin is coadministered with cotrimoxazole or with fluconazole.

DESIGN

Two separate nonblind randomised studies were conducted in healthy volunteers. During the fluconazole study the potential for fluconazole to adversely affect the pharmacokinetics of azithromycin was also studied.

PARTICIPANTS

24 (cotrimoxazole) and 18 (fluconazole) healthy male and female volunteers.

RESULTS

The results of both studies indicated that neither the peak concentrations of nor the exposures (area under the concentration-time curve) to the test drugs were changed when azithromycin was coadministered. In addition, fluconazole did not significantly alter the pharmacokinetic parameters of azithromycin.

CONCLUSIONS

Azithromycin does not alter the bioavailability of either cotrimoxazole or fluconazole.

Stereo-specific analysis of a novel protein kinase C inhibitor

SPC-100270 drug substance ((2S,3S)-2-aminooctadecane-1,3-diol) is a synthetic sphingosine analogue possessing limited ultraviolet absorbance (UV) and two chiral centres. Analytical methodology employing derivatization of SPC-100270 with o-phthaldialdehyde (OPA) and a chiral thiol, N-acetyl-D-penicillamine, was developed to assess the isomeric purity of SPC-100270 in the presence of two of its three stereoisomers. Separation of the isoindole derivatives was achieved with isocratic reversed-phase column chromatography with detection at 330 nm. Under the conditions studied, the derivatization was complete within 3 h at 50 degrees C. The standard and derivatized solutions were stable for 7 days under refrigerated conditions. The limit of detection was 0.036 micrograms SPC-100270 per ml and the limit of quantitation was 0.237 micrograms SPC-100270 per ml. The assay response was linear over a concentration range of 4.7-376 micrograms SPC-100270 per ml with a coefficient of determination of greater than 0.9999. The precision, ruggedness and specificity of the assay were acceptable for determination of SPC-100270 in the presence of its stereoisomers and under forced degradation conditions. The method has been applied successfully in two independent laboratories for quality control release and stability assessment of SPC-100270 drug substance for early clinical studies.

The electrocardiographic effects of cetirizine in normal subjects

OBJECTIVE

To establish whether the antihistamine cetirizine has the potential to prolong the QTc interval in normal volunteers at up to six times the usual recommended dose.

METHODS

Twenty-five healthy volunteers were studied in a prospective, double-blind crossover design conducted on inpatients in a Clinical Research Center. The primary end point of the study was QTc prolongation on the surface electrocardiogram (ECG). Plasma concentrations of cetirizine were also measured for pharmacokinetic analysis. The end point for the pharmacokinetic analysis was the dose/area under the concentration-time curve (apparent clearance of an oral dose). The subjects received the following three treatments in random sequence: placebo, 20 mg/day cetirizine, and 60 mg/day cetirizine for 7 consecutive days. A series of baseline ECGs was recorded over 2 days before each treatment, while the subject receiving placebo. ECG effects of the treatments were then compared with the baseline ECGs.

RESULTS

Analysis of variance showed no difference between the treatment groups (placebo, 20 mg cetirizine, and 60 mg cetirizine every day) in effect on QTc compared with baseline. A paired Student t test showed no difference in dose/area under the concentration-time curve between the 20 mg/day and 60 mg/day dosing groups at steady state.

CONCLUSION

In healthy volunteers, cetirizine does not prolong the QTc interval at doses of up to six times the usual recommended dose.