Acceptance and validity of the methods used to implement a competency based medical education programme in an Intensive Care Department of a teaching referral center

OBJECTIVES

1. To determine the satisfaction of tutors and residents with a specific methodology used to implement CoBaTrICE. 2. To determine the reliability and validity of the global rating scales designed ad hoc to assess the performance of the residents for training purposes.

DESIGN

Prospective cohort study.

PARTICIPANTS

All the residents and tutors of the ICU Department of the Hospital Universitario y Politécnico la Fe de Valencia.

INTERVENTION

CoBaTrICE implementation started in March 2016, it was based on: (1) Training the tutors in feedback techniques; (2) Performing multiple objective and structured work based assessments to achieve the competences of the program; and (3) The use of an electronic portfolio to promote learning reflection and to collect the evidence that learning was taking place.

METHODS

The acceptance of CoBaTrICE was explored through a satisfaction survey conducted after 9 months of implementation of the training program. The 15 residents and 5 tutors of the ICU Department were asked about the methodology of the formative assessments, the quality of the feedback, self-learning regulation and the electronic portfolio usefulness. The validity of the global rating scales was assessed through the tests alfa de Cronbach, reliability and generalizability indexes, and intraclass correlation coefficient.

RESULTS

The implementation of CoBaTrICE was satisfactory in all the dimensions studied. The global rating scales used for formative purposes showed reliability and validity.

CONCLUSIONS

The methodology used to implement CoBaTrICE was highly valued by tutors and residents. The global rating scales used for formative purposes showed reliability and validity.

The value of patient global assessment in lumbar spine surgery: an evaluation based on more than 90,000 patients

PURPOSE

There are two, principally different ways to obtain patient opinions regarding the outcome of spine surgery: using prospective multi-item questionnaires preoperatively and at follow-up, and using a retrospective single-item question at follow-up-both methods have distinct advantages and limitations. The purpose of the study was to explore the utility of using the simple transition question global assessment, GA, ("How is your back/leg pain today as compared to before the surgery?") as an overall patient-reported outcome measure (PROM) based on the large real-life database in the Swedish spine registry (Swespine).

METHODS

The correlation between GA and the score-changes and the final scores at 1 year of follow-up for the PROMs VAS, ODI, and EQ-5D was examined. The correlations between GA and item-specific domains within the ODI, EQ-5D and SF-36 as well as the discriminative ability of PROMs with GA as reference criterion were also analysed. The cohort consisted of 94,132 patients registered in Swespine who were surgically treated for disc herniation, spinal stenosis or degenerative disc disease.

RESULTS

The correlation coefficients for GA vs. the score-changes were lower than for GA vs final scores. For VAS they ranged for the different diagnosis groups from 0.33 to 0.61 and from 0.50 to 0.79, respectively. For ODI, the corresponding values ranged from 0.43 to 0.65 and 0.63 to 0.76; for the EQ-5D from 0.32 to 0.45 and 0.54 to 0.71. Further, GA showed a somewhat stronger correlation to pain-specific PROMs than to quality-of-life PROMs.

CONCLUSIONS

The single-item outcome measure global assessment (GA) appears to be a feasible overall patient-reported outcome measure (PROM) and a useful reference for interpreting the scores of patient-reported outcome measures.

Function and clinical meaningfulness of treatments for mild Alzheimer's disease

Introduction

Effectiveness of Alzheimer's disease (AD) treatments is commonly evaluated with coprimary outcomes; cognition with function to ensure clinical meaningfulness of a cognitive effect.

Methods

We reviewed the literature for functional outcomes in mild AD or mild cognitive impairment (MCI) patients (distinct from combined mild-moderate/severe AD) treated with approved AD drugs. Cognitive and functional treatment differences in mild AD patients in solanezumab EXPEDITION/EXPEDITION2 studies were compared across time.

Results

Seven publications provided MCI/mild AD functional outcomes, one of which reported a significant functional treatment effect. Secondary analyses of EXPEDITION studies suggested a smaller functional effect of solanezumab relative to cognition. An increasing effect of solanezumab over 18 months was shown for cognition and function.

Discussion

Function as the sole measure to demonstrate clinical meaningfulness of cognitive effects in mild AD may have limitations. For disease-modifying treatments, point differences on cognitive and functional scales should be qualified with duration of treatment.