Remote, asynchronous training and feedback enables development of neurodynamic skills in physiotherapy students

BACKGROUND

During the COVID-19 pandemic, face-to-face teaching and learning of physiotherapy practical skills was limited. Asynchronous, remote training has been effective in development of clinical skills in some health professions. This study aimed to determine the effect of remote, asynchronous training and feedback on development of neurodynamic skills in physiotherapy students.

METHODS

Longitudinal repeated measurements study, across four training sessions. Participants engaged in a remote training program for development of upper limb neurodynamic techniques. In this sequential training, participants viewed the online tutorial, practiced independently, and uploaded a video of their performance for formative assessment and feedback from a trained instructor via a checklist and rubric.

RESULTS

Intra-subject analyses of 60 third-year physiotherapy students showed that the target standard of performance, with no further significant change in scores, was attained following session 2 for the checklist and session 3 for the rubric. This shows that two sessions are required to learn the procedures, and three sessions yield further improvements in performance quality.

CONCLUSION

The remote, asynchronous training and feedback model proved to be an effective strategy for students' development of neurodynamic testing skills and forms a viable alternative to in-person training. This study contributes to the future of acquiring physiotherapy clinical competencies when distance or hybrid practice is required.

Assessing the inter-rater and intra-rater reliability of the Physical Therapy Competence Assessment for Airway Suctioning (PT-CAAS)

BACKGROUND AND PURPOSE

The Physical Therapy Competence Assessment for Airway Suctioning (PT-CAAS) is a recently developed measure to assess the clinical competence of physiotherapists who perform airway suctioning with adults. The purpose of this study was to assess the inter-rater and intra-rater reliability of the PT-CAAS.

METHODS

Scoring rules were developed through expert consultation. Reliability was then assessed using nine videos of suctioning performed in a simulated learning environment. A repeated measures design was used, with two replicate sets of measurements made by each participant for all videos. Data were analyzed using a repeated measures model for the concurrent assessment of inter-rater and intra-rater reliability. Participants were physiotherapists with suctioning experience.

RESULTS

Twenty physiotherapists completed initial scoring and re-scoring for all nine videos; their data were included in the analysis. Intraclass correlation coefficients (ICCs) for inter-rater reliability ranged from 0.569 [lower one-sided 95% confidence interval (CI): 0.395; standard error of measurement (SEM): 0.963] for infection control to 0.759 (lower one-sided 95% CI: 0.612; SEM: 0.722) for post-suctioning assessment and care. The inter-rater ICC for overall performance was 0.752 (lower one-sided 95% CI: 0.602; SEM: 0.660). ICCs for intra-rater reliability ranged from 0.759 (lower one-sided 95% CI: 0.197; SEM 0.721) for infection control to 0.860 (lower one-sided 95% CI: 0.544; SEM: 0.550) for post-suctioning assessment and care. The intra-rater ICC for overall performance was 0.867 (lower one-sided 95% CI: 0.559; SEM: 0.483).

DISCUSSION

Evidence of moderate to good inter-rater and good intra-rater reliability was found; however, the results should be interpreted with caution given the wide CIs and relatively large SEMs. Improved assessor training and assessments of reliability using a larger sample size are recommended.

Development of a tool to assess core cardiorespiratory physiotherapy skills: a Delphi study

PURPOSE

This study reports on the development of an outcome measure designed to evaluate pre-registration physiotherapy students' ability in performing core cardiorespiratory skills.

METHOD

A four round, e- Delphi study using an international panel of expert cardiorespiratory physiotherapists involved in pre-registration student education was undertaken. In round one participants identified what they look for in students competently performing core cardio-respiratory physiotherapy assessment and treatment skills. These items were refined in rounds two and three. Item content validity score (iCVI) of ≥ 0.8 at round four identified consensus. Scale content validity index (SCVI) was calculated.

RESULTS

Response rate for round one was 46% (6/13). Additional experts were invited to participate and response rates increased to 71% (round 2), 88% (round 3) and 100% (round 4). Of the 207 items across the seven skills identified in round one, 140 were presented in round four. Of these, consensus was achieved for 128 items, with 12 being excluded. The SCVI was 0.907.

CONCLUSION

This e-Delphi study enabled the development of a draft outcome measure, which aims to assess performance of seven cardiorespiratory physiotherapy skills. This tool will enable rigorous evaluation of different education methods to establish their effectiveness. However, it is first necessary to establish construct validity and assess inter and intra-rater reliability.

The effectiveness of the Peyton's 4-step teaching approach on skill acquisition of procedures in health professions education: A systematic review and meta-analysis with integrated meta-regression

Background

Acquisition of procedures is an important element in health professions education. Traditionally procedures are taught using a "see one - do one" approach. That is a teacher demonstrates and describes a procedure and afterwards the students practice the procedure. A more recent teaching approach for the acquisition of procedural skills was presented by Walker and Peyton. Peyton's teaching approach is a stepwise teaching approach and consists of the following four steps: demonstration, deconstruction, comprehension and performance. The aims of this study were (i) to systematically evaluate the effectiveness of Peyton's 4-step teaching approach on the acquisition of procedural skills in health professions education and (ii) to evaluate whether studies with fewer students per teacher showed a larger between group difference than studies with more students per teacher.

Methods

We searched in Medline, PsycInfo, Embase and ERIC for eligible studies. Records were screened by two independent reviewers. A random effects meta-analysis was performed to evaluate skill acquisition and time needed to perform the procedures at post-acquisition and retention tests. A meta-regression was used to explore the effect of the number of students per teacher on the estimated effect of the educational interventions.

Results

An effect size of 0.45 SMD (95% CI [0.15; 0.75]) at post-acquisition and 0.7 SMD (95% CI [-0.09; 1.49]) at retention testing were in favour of Peyton's teaching approach for skill acquisition. The groups using Peyton's teaching approach needed considerably less time to perform the procedure at post-acquisition (SMD: -0.8; 95% [CI -2.13 to 1.62]) and retention (SMD: -2.65; 95% CI [-7.77 to 2.47]) testing. The effectiveness of Peyton's teaching approach was less clear in subgroup analyses using peer teachers. Meta-regression showed that the number of students per teacher was an important moderator variable.

Conclusion

Peyton's teaching approach is an effective teaching approach for skill acquisition of procedural skills in health professions education. When peer students or student tutors are used as teachers the effectiveness of Peyton's teaching approach is less clear. Peyton's teaching approach is more effective when small groups with few students per teacher are used.

The assessment of procedural skills in physiotherapy education: a measurement study using the Rasch model

Background

Procedural skills are a key element in the training of future physiotherapists. Procedural skills relate to the acquisition of appropriate motor skills, which allow the safe application of clinical procedures to patients. In order to evaluate procedural skills in physiotherapy education validated assessment instruments are required. Recently the assessment of procedural skills in physiotherapy education (APSPT) tool was developed. The overall aim of this study was to establish the structural validity of the APSPT. In order to do this the following objectives were examined: i) the fit of the items of APSPT to the Rasch-model, ii) the fit of the overall score to the Rasch model, iii) the difficulty of each test item and iv) whether the difficulty levels of the individual test items cover the whole capacity spectrum of students in pre-registration physiotherapy education.

Methods

For this observational cross-sectional measurement properties study a convenience sample of 69 undergraduate pre-registration physiotherapy students of the HES-SO Valais-Wallis was recruited. Participants were instructed to perform a task procedure on a simulated patient. The performance was evaluated with the APSPT. A conditional maximum likelihood approach was used to estimate the parameters of a partial credit model for polytomous item responses. Item fit, ordering of thresholds, targeting and goodness of fit to the Rasch model was assessed.

Results

Item fit statistics showed that 25 items of the APSPT showed adequate fit to the Rasch model. Disordering of item thresholds did not occur and the targeting of the APSPT was adequate to measure the abilities of the included participants. Undimensionality and subgroup homogeneity were confirmed.

Conclusion

This study presented evidence for the structural validity of the APSPT. Undimensionality of the APSPT was confirmed and therefore presents evidence that the latent dimension of procedural skills in physiotherapy education consists of several subcategories. However, the results should be interpreted with caution given the small sample size.

Postgraduate clinical physiotherapy education in acute hospitals: a cohort study

Background: Junior physiotherapists require satisfactory clinical skills to work effectively within the acute hospital setting for service quality and consistency. Objective: To investigate the effects of stream-specific clinical training on junior physiotherapist self-efficacy, self-rated confidence, and self-rated ability to work independently during weekend shifts. Design: Prospective cohort study. Participants: Eighteen junior physiotherapists. Methods: Physiotherapists undertook 8 h of stream-specific education in: pediatrics, women's health, neuro-medical, musculoskeletal, cardiorespiratory, and critical care over 8 weeks. Learning objectives were evaluated using a self-efficacy (0-100) scale and self-rated confidence was measured with a 4-point Likert scale (not confident to independent). Self-rated ability to independently work weekend shifts was measured dichotomously (yes/no). Results: Participants completed an average of three stream-specific programs in the study period. Post-training, mean improvement in self-efficacy across objectives ranged from 2.9 (95% CI -8.7 to 14.5) to 43.3 (95% CI 4.8-81.8) points, p < 0.05 for 80% of objectives. Self-rated confidence scores improved for 45.6% of stream-specific learning objectives; 52.8% were unchanged and 1.7% reported a decrease in confidence. Self-rated ability to work stream-specific weekend shifts increased from 56-70%, but no stream achieved a significant increase in staff able to independently work weekend shifts (p range 0.10 to 1.0). Conclusions: A stream-specific education program increased junior physiotherapists' self-efficacy and self-rated confidence but not perceived ability to work independently on weekends. Results were non-randomized and actual practice change was not assessed. Future studies could investigate different educational structures in a blinded, randomized manner on clinical practice change.