Introduction, development, and evaluation of the miniclinical evaluation exercise in postgraduate education of chiropractors

The positive and negative impacts of the COVID-19 pandemic on the European Council on Chiropractic Education accredited programs: A mixed methods audit and thematic analysis

OBJECTIVE

The objectives of this study were to: (1) determine the impact of COVID-19 on the operations within the 9 sections of the European Council on Chiropractic Education (ECCE) 'Standards'; (2) identify specific rapid changes to the programs; and (3) identify positive changes that will continue post-pandemic.

METHODS

This was a mixed methods audit and thematic analysis of data from interviews conducted via a cloud-based video conferencing tool with program leaders of the ECCE accredited institutions. A validated questionnaire designed around ECCE's "Standards" was used, consisting of 3 sections: (1) Severity of the COVID-19 impact on each ECCE Standard section; (2) Description of program changes made for each section; (3) Identification of positive changes continuing post-pandemic. Descriptive statistics were calculated for Part 1 and compared for significant differences via the Kruskal-Wallis test. Verbal responses to Parts 2 and 3 were evaluated independently by 3 researchers using a modified "thematic analysis" approach. Final thematic categories and themes were agreed upon by the researchers.

RESULTS

There was a 100% response rate. Outpatient teaching clinics were most severely affected, followed by teaching chiropractic technique courses. Curricular structure and duration and program management were least affected (p =.033). Four thematic categories were identified: Extreme Stress, Courses Most Severely Affected, Integrity of Examinations and Assessments, and Positive Changes That Will Continue.

CONCLUSION

Final-year students were most negatively impacted due to restricted opportunities in outpatient clinics. Integrity of examinations was also a problem. Positive, innovative teaching materials and methods were quickly developed and should continue.

Avaliação do desempenho dos residentes em ortopedia na prática clínica

Objetivo Avaliar o desempenho de residentes de ortopedia na realização de exames clínicos.

Métodos O Mini-CEX foi aplicado por três docentes em quatro momentos distintos. O instrumento foi adaptado pelos autores para uso em ortopedia, com desenvolvimento de descritores para cada habilidade avaliada. Os supervisores foram treinados pelo pesquisador principal para utilização do Mini-CEX por meio de materiais didáticos e discussões e os descritores do instrumento foram padronizados.

Resultados As pontuações médias obtidas nas quatro avaliações de cada um dos 21 residentes revelaram melhora no desempenho de todas as habilidades entre o primeiro e o quarto encontro.

Conclusões O desempenho dos residentes em ortopedia apresentou evolução satisfatória, com melhora progressiva de todas as habilidades.

Impact of Simulated Patients on Physiotherapy Students' Skill Performance in Cardiorespiratory Practice Classes: A Pilot Study

Purpose: To date, no evidence exists that high-fidelity simulation improves skill development among physiotherapy students in the university setting. With pressures to reduce costs and maintain or improve the quality of the learning experience, and with pressures on clinical placement, it is essential to investigate methods that might improve students' skill performance before they undertake clinical practice. Our study set out to investigate (1) the impact of using simulated patients (SPs) in a practical class on physiotherapy students' skill acquisition and (2) the students' reflections on the intervention. Method: We devised a pilot study using a single-centre randomized controlled trial. A total of 28 undergraduate physiotherapy students, matched using previous practical examination grades, undertook a 2-hour practical class in which they practised their core cardiorespiratory skills. Pre-session resources were identical. The control group practised on peers; the intervention group practised on SPs. The students' skill performance was assessed 2 weeks later using the Mini-Clinical Evaluation Exercise (MiniCEX), including gathering qualitative data from the students' reflections. Twenty-eight students undertook the practical class and subsequent MiniCEX assessment. Results: A statistically significant difference was found for all aspects of the MiniCEX except medical interview (p = 0.07) and physical interview (p = 0.69), and a large effect size was found for all areas except physical interview (0.154) and medical interview (0.378). The students' reflections focused on three key themes: behaviours and attitudes, teaching the active cycle of breathing technique, and feedback. Conclusions: Our findings suggest that interacting with SPs improves student skill performance, but further research using a larger sample size and an outcome measure validated for this population is required to confirm this.

The utility of mini-Clinical Evaluation Exercise in undergraduate and postgraduate medical education: A BEME review: BEME Guide No. 59

Background: This BEME review aims at exploring, analyzing, and synthesizing the evidence considering the utility of the mini-CEX for assessing undergraduate and postgraduate medical trainees, specifically as it relates to reliability, validity, educational impact, acceptability, and cost.Methods: This registered BEME review applied a systematic search strategy in seven databases to identify studies on validity, reliability, educational impact, acceptability, or cost of the mini-CEX. Data extraction and quality assessment were carried out by two authors. Discrepancies were resolved by a third reviewer. Descriptive synthesis was mainly used to address the review questions. A meta-analysis was performed for Cronbach's alpha.Results: Fifty-eight papers were included. Only two studies evaluated all five utility criteria. Forty-seven (81%) of the included studies met seven or more of the quality criteria. Cronbach's alpha ranged from 0.58 to 0.97 (weighted mean = 0.90). Reported G coefficients, Standard error of measurement, and confidence interval were diverse and varied based on the number of encounters and the nested or crossed design of the study. The calculated number of encounters needed for a desirable G coefficient also varied greatly. Content coverage was reported satisfactory in several studies. Mini-CEX discriminated between various levels of competency. Factor analyses revealed a single dimension. The six competencies showed high levels of correlation with statistical significance with the overall competence. Moderate to high correlations between mini-CEX scores and other clinical exams were reported. The mini-CEX improved students' performance in other examinations. By providing a framework for structured observation and feedback, the mini-CEX exerts a favorable educational impact. Included studies revealed that feedback was provided in most encounters but its quality was questionable. The completion rates were generally above 50%. Feasibility and high satisfaction were reported.Conclusion: The mini-CEX has reasonable validity, reliability, and educational impact. Acceptability and feasibility should be interpreted given the required number of encounters.