Test–retest reliability measures for curve data: an overview with recommendations and supplementary code

Psychometric evaluation of the study interest questionnaire-short form among Chinese nursing students based on classical test theory and item response theory

BACKGROUND

There is currently no dedicated measurement for assessing nursing students' study interest in China. Considering the good reliability, validity, and widespread applicability of the Study Interest Questionnaire-Short Form (SIQ-SF), the objective of this study was to validate its usage among Chinese nursing students.

METHODS

The translation and cross-cultural adaptation rigorously followed the modified Brislin model. A cross-sectional survey was conducted using the Chinese version of the SIQ-SF and convenience sampling was employed to select nursing students. The Psychometric evaluation of the Chinese version of the SIQ-SF was conducted based on Classical Test Theory and Item Response Theory.

RESULTS

A total of 1158 participants were included in the analysis. The item-level content validity index (CVI) ranged from 0.9 to 1.0, and the scale-level CVI was 0.98. In the Exploratory factor analysis, three factors with eigenvalues above 1 were identified, accounting for 62.554% of the cumulative variance. In the confirmatory factor analysis, the CMIN\DF was 5.639, the GFI was 0.953, the CFI was 0.902, and the IFI was 0.904. The Cronbach's α coefficient of the Chinese version of the SIQ-SF was 0.70. Thirty-one participants were invited to sign the scale after two weeks. The intraclass correlation coefficient was 0.784, and that of items ranged from 0.70 to 0.819. The infit MnSQ values ranged between 0.76 and 1.51, and the outfit MnSQ values ranged between 0.72 and 1.76. The point-measure correlation value ranged between 0.30 and 0.68. The item difficulty measures ranged from - 0.66 to 1.44 logit and the individual learning interest estimations ranged from - 4.22 to 4.97 logit. DIF contrast ranged from 0.00 to 0.33 logits, with all p values greater than 0.05.

CONCLUSIONS

The Chinese version of the SIQ-SF demonstrated acceptable reliability and validity among Chinese nursing students and could be used to assess nursing students' study interest in China. With the aid of this scale, teachers can gain a better understanding of nursing students' study interests, thereby maximizing their learning effects through appropriate content and methods.

Markerless three-dimensional gait analysis in healthy older adults: test-retest reliability and measurement error

In older adults, gait analysis may detect changes that signal early disease states, yet challenges in biomechanical screening limit widespread use in clinical or community settings. Recently, a markerless method from multi-camera video data has become accessible, making screenings less challenging. This study evaluated the test-retest reliability and measurement error of markerless gait kinematics and kinetics in healthy older adults. Twenty-nine healthy older adults performed gait analysis on two occasions, at preferred walking speed, using their everyday clothes. Lower limb angles and moments were averaged from 8 gait cycles. Integrated pointwise indices [Intraclass Correlation Coefficient (ICCA,K) and Standard Error of Measurement (SEM)] were calculated for curve data, as well as ICCA,K, and SEM [95 % confidence intervals] for selected peaks. Generally, kinematic ICCs were good (>0.75) and reasonably stable throughout the gait cycle, except for the hip kinematics during the swing phase in the sagittal plane and pelvis tilt and rotation. The integrated and peaks SEM were <2.4°. The reliability of kinetics was similar (ICC>0.75), except for the transverse hip moment and abduction peak, fluctuating more during the swing than through the stance phase. SEM were < 0.07Nm/Kg. In conclusion, these results showed good overall test-retest reliability for markerless gait kinematics and kinetics for the hip, knee, and ankle joints, moderate for the pelvis angles, and error levels of ≤5°, and SEM%≤5% for the sagittal plane. This supports this method's use in assessing gait in healthy older adults, including kinetics, for which reliability data from markerless systems is difficult to find reported.

How reliable are lower limb biomechanical evaluations during volleyball-specific jump-landing tasks?

BACKGROUND

Biomechanical evaluations of sport-specific jump-landing tasks may provide a more ecologically valid interpretation compared to generic jump-landing tasks. For accurate interpretation of longitudinal research, it is essential to understand the reliability of biomechanical parameters of sport-specific jump-landing tasks.

RESEARCH QUESTION

How reliable are hip, knee and ankle joint angles and moment curves during two volleyball-specific jump-landing tasks and is this comparable with the reliability of a generic jump-landing task?

METHODS

Three-dimensional (3D) biomechanical analyses of 27 male volleyball players were performed in two sessions separated by one week. Test-retest reliability was analyzed by calculating integrated as well as 1D intraclass correlation coefficient (ICC) and integrated standard error of measurement (SEM) for hip, knee and ankle angles and moments during a spike and block jump (volleyball-specific tasks), and during a drop vertical jump (generic task).

RESULTS

Reliability of joint angles of volleyball-specific and generic jump-landing tasks are similar with excellent-to-good integrated ICC for hip, knee and ankle flexion/extension (ICC= 0.61-0.89) and hip and knee abduction/adduction (ICC=0.61-0.78) but fair-to-poor ICC for ankle abduction/adduction (ICC=0.28-0.52) and hip, knee and ankle internal/external rotation (ICC=0.29-0.53). Reliability of hip, knee and ankle joint moments was good-to excellent (ICC= 0.62-0.86) except for hip flexion moment during spike jump and drop vertical jump (ICC=0.43-0.47) and knee flexion moment during both volleyball-specific tasks (ICC=0.56-0.57). For all tasks, curve analysis revealed poorer reliability at start and end of the landing phase than during the midpart.

SIGNIFICANCE

Our data suggests that kinematic evaluations of volleyball-specific jump-landing tasks are reliable to use in screening programs, especially in the sagittal plane. Notably, reliability is poorer at the beginning and end of the landing phase, requiring careful interpretation. In conclusion, the results of this study indicate the potential for integration of sport-specific jump-landing tasks in screening programs, which will be more ecologically valid.

Confidence sets for intraclass correlation coefficients in test-retest curve measurements

Evaluating test-retest reliability is crucial in biomechanical research, as it validates experimental results. While methods for reliability of scalar outcome variables are well-established, methods to assess reliability of continuous curve data (such as joint angle trajectories during gait) remain less explored. This study investigates methods for constructing confidence sets for curve-level intraclass correlation coefficients (ICC), which can be expressed as either an ICC curve or an integrated ICC. Currently, no standardised guidelines exist in biomechanics for reporting curve-level ICC uncertainty. Nonparametric bootstrapping techniques are proposed for both the ICC curve's confidence bands and the integrated ICC's confidence intervals, and these methods are validated through Monte Carlo simulations, covering various effect sizes and curve characteristics. Additionally, these methods are applied to assess the test-retest reliability of knee kinematics in three different planes during landing of one-leg hops, where less uncertainty is observed for the ICC curve and integrated ICC in the frontal plane compared to other planes. When the entire time domain is of primary empirical interest, we recommend using a rank-based bootstrap confidence band to express ICC uncertainty, as it yields increasingly precise and valid results as the number of individuals increases, with the coverage rate approaching the correct level of 95%. When a single summary metric is of primary interest, we recommend using the integrated ICC along with a typical bootstrap confidence interval based on the normal distribution, as the coverage rate remains adequately accurate and stable at around the correct level of 95% across varying number of individuals.

Quantifying lumbar mobility using a single tri-axial accelerometer

Background

Lumbar mobility is regarded as important for assessing and managing low back pain (LBP). Inertial Measurement Units (IMUs) are currently the most feasible technology for quantifying lumbar mobility in clinical and research settings. However, their gyroscopes are susceptible to drift errors, limiting their use for long-term remote monitoring.

Research question

Can a single tri-axial accelerometer provide an accurate and feasible alternative to a multi-sensor IMU for quantifying lumbar flexion mobility and velocity?

Methods

In this cross-sectional study, 18 healthy adults performed nine repetitions of full spinal flexion movements. Lumbar flexion mobility and velocity were quantified using a multi-sensor IMU and just the tri-axial accelerometer within the IMU. Correlations between the two methods were assessed for each percentile of the lumbar flexion movement cycle, and differences in measurements were modelled using a Generalised Additive Model (GAM).

Results

Very high correlations (r > 0.90) in flexion angles and velocities were found between the two methods for most of the movement cycle. However, the accelerometer overestimated lumbar flexion angle at the start (-4.7° [95 % CI -7.6° to -1.8°]) and end (-4.8° [95 % CI -7.7° to -1.9°]) of movement cycles, but underestimated angles (maximal difference of 4.3° [95 % CI 1.4° to 7.2°]) between 7 % and 92 % of the movement cycle. For flexion velocity, the accelerometer underestimated at the start (16.6°/s [95%CI 16.0 to 17.2°/s]) and overestimated (-12.3°/s [95%CI -12.9 to -11.7°/s]) at the end of the movement, compared to the IMU.

Significance

Despite the observed differences, the study suggests that a single tri-axial accelerometer could be a feasible tool for continuous remote monitoring of lumbar mobility and velocity. This finding has potential implications for the management of LBP, enabling more accessible and cost-effective monitoring of lumbar mobility in both clinical and research settings.

Playing With Fire Compounds: The Tonal Accents of Compounds in (North) Norwegian Preschoolers' Role-Play Register

Prosodic features are some of the most salient features of dialect variation in Norway. It is therefore no wonder that the switch in prosodic systems is what is first recognized by caretakers and scholars when Norwegian children code-switch to something resembling the dialect of the capital (henceforth Urban East Norwegian, UEN) in role-play. With a focus on the system of lexical tonal accents, this paper investigates the spontaneous speech of North Norwegian children engaging in peer social role-play. By investigating F0 contours extracted from a corpus of spontaneous peer play, and comparing them with elicited baseline reference contours, this paper makes the case that children fail to apply the target tonal accent consistent with UEN in compounds in role-play, although the production of tonal accents otherwise seems to be phonetically target like UEN. Put in other words, they perform in accordance with UEN phonetics, but not UEN morpho-phonology.

Variability of time series barbell kinematics in elite male weightlifters

Introduction

Barbell kinematics are an essential aspect of assessing weightlifting performance. This study aimed at analyzing the total variability of time series barbell kinematics during repeated lifts in the snatch and the clean and jerk at submaximal and maximal barbell loads.

Methods

In a test-retest design, seven male weightlifters lifted submaximal [85% planned one-repetition maximum (1RMp)] and maximal (97% 1RMp) loads in the snatch and the clean and jerk during training. Barbell trajectory, vertical velocity, and vertical acceleration were determined using video analysis. Standard error of measurement (SEM), intraclass correlation coefficient (ICC), and smallest real difference (SRD) were used to determine the total variability during the lifts. Hedge's g effect size was used to assess differences in SEM between submaximal and maximal loads.

Results

The main findings indicated that variability-in particular for the barbell velocity-was lower at maximal compared to submaximal barbell loads (g = 0.52-2.93). SEM of time series data showed that variability increased in the snatch and the clean and jerk from the 1st pull/dip to the catch position irrespectively of the barbell load.

Discussion

This study presents values of total variability of time series barbell kinematics during the snatch, the clean, and the jerk. Further, the SRD can be used to evaluate changes in barbell kinematics in response to training. In addition, when interpreting barbell kinematics, coaches should take into account that the variability of barbell kinematics can vary depending on the exercise and the barbell load.

Atypical Lower Limb Mechanics During Weight Acceptance of Stair Descent at Different Time Frames After Anterior Cruciate Ligament Reconstruction

BACKGROUND

An anterior cruciate ligament (ACL) rupture may result in poor sensorimotor knee control and, consequentially, adapted movement strategies to help maintain knee stability. Whether patients display atypical lower limb mechanics during weight acceptance of stair descent at different time frames after ACL reconstruction (ACLR) is unknown.

PURPOSE

To compare the presence of atypical lower limb mechanics during the weight acceptance phase of stair descent among athletes at early, middle, and late time frames after unilateral ACLR.

STUDY DESIGN

Controlled laboratory study.

METHODS

A total of 49 athletes with ACLR were classified into 3 groups according to time after ACLR-early (<6 months; n = 17), middle (6-18 months; n = 16), and late (>18 months; n = 16)-and compared with asymptomatic athletes (control; n = 18). Sagittal plane hip, knee, and ankle angles; angular velocities; moments; and powers were compared between the ACLR groups' injured and noninjured legs and the control group as well as between legs within groups using functional data analysis methods.

RESULTS

All 3 ACLR groups showed greater knee flexion angles and moments than the control group for injured and noninjured legs. For the other outcomes, the early group had, compared with the control group, less hip power absorption, more knee power absorption, lower ankle plantarflexion angle, lower ankle dorsiflexion moment, and less ankle power absorption for the injured leg and more knee power absorption and higher vertical ground reaction force for the noninjured leg. In addition, the late group showed differences from the control group for the injured leg revealing more knee power absorption and lower ankle plantarflexion angle. Only the early group took a longer time than the control group to complete weight acceptance and demonstrated asymmetry for multiple outcomes.

CONCLUSION

Athletes with different time frames after ACLR revealed atypically large knee angles and moments during weight acceptance of stair descent for both the injured and the noninjured legs. These findings may express a chronically adapted strategy to increase knee control. In contrast, atypical hip and ankle mechanics seem restricted to an early time frame after ACLR.

CLINICAL RELEVANCE

Rehabilitation after ACLR should include early training in controlling weight acceptance. Including a control group is essential when evaluating movement patterns after ACLR because both legs may be affected.

Modified conventional gait model vs. Six degrees of freedom model: A comparison of lower limb kinematics and associated error

BACKGROUND

The conventional gait model (CGM) is commonly utilised within clinical motion analysis but has a number of inherent limitations. To overcome some of these limitations modifications have been made to the CGM and six-degrees of freedom models (6DoF) have been developed.

RESEARCH QUESTION

How comparable are lower limb kinematics calculated using modified CGM and 6DoF models and what is the error associated with the output of each model during walking?

METHODS

Ten healthy males attended two gait analysis sessions, in which they walked at a self-selected pace, while a 10-camera motion capture system recorded lower limb kinematics. Hip, knee and ankle joint kinematics in all three anatomical planes were calculated using a modified CGM, with medial anatomical markers and a three-dimensional foot added, and 6DoF. Mean absolute differences were calculated on a point-by-point basis over the walking gait cycle and interpreted relative to a 5° threshold to explore the comparability of model outputs. The standard error of the measurement (SEM) was also calculated on a point-by-point basis over the walking gait cycle for each model.

RESULTS

Mean absolute differences above 5° were reported between the two model outputs in 58-86% of the walking gait cycle at the knee in the frontal plane, and over the entire walking gait cycle at the hip and knee in the transverse plane. SEM was typically larger for the modified CGM compared to the 6DoF, with the highest SEM values reported at the knee in the frontal plane, and the hip and the knee in the transverse plane.

SIGNIFICANCE

Caution should be taken when looking to compare findings between studies utilising modified CGM and 6DoF outside of the sagittal plane, especially at the hip and knee. The reduced SEM associated with the 6DoF suggests this modelling approach may be preferable.

Test-retest reliability of entire time-series data from hip, knee and ankle kinematics and kinetics during one-leg hops for distance: Analyses using integrated pointwise indices

Motion capture systems enable in-depth interpretations of human movements based on data from three-dimensional joint angles and moments. Such analyses carry important bearings for evaluation of movement control during for instance hop landings among sports-active individuals from a performance perspective but also in rehabilitation. Recent statistical development allows analysis of entire time-series of angle and moment during hops using functional data analysis, but the reliability of such multifaceted data is not established. We used integrated pointwise indices (intra-class correlation, ICC; standard error of measurement, SEM) to establish the test-retest reliability of three-dimensional hip, knee and ankle angle and moment curves during landings of one-leg hop for distance (OLHD) in 23 asymptomatic individuals aged 18-28. We contrasted these findings to reliability of discrete variables extracted at specific events (initial contact, peak value). We extended the calculations of ICC and SEM to handle unbalanced situations (varying number of repetitions) to include all available data. Hip and knee angle curves proved reliable with stable ICC curves throughout the landing, with integrated ICCs ≥ 0.71 for all planes except for knee internal/external rotation (ICC = 0.57). Hip and knee moment curves and ankle angle and moments were less reliable and less stable, particularly in the first ~ 10-25% of the landing (integrated ICCs 0.44-0.57). Curve data were generally not in agreement with the results for discrete event data, thus advocating analysis of curve data which contains more information. To conclude, hip and knee angle curve data during OLHD landings can reliably be evaluated, while moment curves necessitate careful consideration.

The timed up & go test sit-to-stand transition: Which signals measured by inertial sensors are a viable route for continuous analysis?

BACKGROUND

The Timed Up and Go test is a well-known clinical test for assessing of mobility and fall risk. It has been shown that the IMU which use an accelerometer and gyroscope are capable of analysing the quantitative parameters of the sit-to-stand transition.

RESEARCH QUESTION

Which signals obtained by the inertial sensors are suitable for continuous Timed Up & Go test sit-to-stand transition analysis?

METHODS

In the study we included 29 older adult volunteers and 31 de-novo Parkinson disease (PD) patients. All subjects performed an instrumented extended TUG wearing a gyro-accelerometer. The sit-to-stand transition was detected from an angular velocity signal. The sit-to-stand signal pattern within the subject group was analyzed via an intra-class correlation between curves. Inter-subjects' variability was visualized using prediction bands.

RESULTS

The angular velocity about the pitch axis exhibited the best signal match across subjects in both groups (0.50 < ICC < 0.75). When analysing acceleration, the acceleration along the antero-posterior axis showed moderate inter-subjects signal pattern match (0.50 < ICC < 0.75) in the reference group. The analysis of other signals revealed a poor signal pattern in both subject groups.

SIGNIFICANCE

For optimal interpretation of the analysis of continuous curves, the signal pattern must be considered. Also, the inter-subject variability along this pattern can be informative and useful.

Development and Validation of a Wearable Inertial Sensors-Based Automated System for Assessing Work-Related Musculoskeletal Disorders in the Workspace

The industrial societies face difficulty applying traditional work-related musculoskeletal disorder (WMSD) risk assessment methods in practical applications due to in-situ task dynamics, complex data processing, and the need of ergonomics professionals. This study aims to develop and validate a wearable inertial sensors-based automated system for assessing WMSD risks in the workspace conveniently, in order to enhance workspace safety and improve workers’ health. Both postural ergonomic analysis (RULA/REBA) and two-dimensional static biomechanical analysis were automatized as two toolboxes in the proposed system to provide comprehensive WMSD risk assessment based on the kinematic data acquired from wearable inertial sensors. The effectiveness of the developed system was validated through a follow-up experiment among 20 young subjects when performing representative tasks in the heavy industry. The RULA/REBA scores derived from our system achieved high consistency with experts’ ratings (intraclass correlation coefficient ≥0.83, classification accuracy >88%), and good agreement was also found between low-back compression force from the developed system and the reference system (mean intersystem coefficient of multiple correlation >0.89 and relative error <9.5%). These findings suggested that the wearable inertial sensors-based automated system could be effectively used for WMSD risk assessment of workers when performing tasks in the workspace.

Biomechanical measures of short-term maximal cycling on an ergometer: a test-retest study

An understanding of test-retest reliability is important for biomechanists, such as when assessing the longitudinal effect of training or equipment interventions. Our aim was to quantify the test-retest reliability of biomechanical variables measured during short-term maximal cycling. Fourteen track sprint cyclists performed 3 × 4 s seated sprints at 135 rpm on an isokinetic ergometer, repeating the session 7.6 ± 2.5 days later. Joint moments were calculated via inverse dynamics, using pedal forces and limb kinematics. EMG activity was measured for 9 lower limb muscles. Reliability was explored by quantifying systematic and random differences within- and between-session. Within-session reliability was better than between-sessions reliability. The test-retest reliability level was typically moderate to excellent for the biomechanical variables that describe maximal cycling. However, some variables, such as peak knee flexion moment and maximum hip joint power, demonstrated lower reliability, indicating that care needs to be taken when using these variables to evaluate biomechanical changes. Although measurement error (instrumentation error, anatomical marker misplacement, soft tissue artefacts) can explain some of our reliability observations, we speculate that biological variability may also be a contributor to the lower repeatability observed in several variables including ineffective crank force, ankle kinematics and hamstring muscles' activation patterns.

Ultrasound imaging to assess skeletal muscle architecture during movements: a systematic review of methods, reliability, and challenges

B-mode ultrasound is often used to quantify muscle architecture during movements. Our objectives were to 1) systematically review the reliability of fascicle length (FL) and pennation angles (PA) measured using ultrasound during movements involving voluntary contractions; 2) systematically review the methods used in studies reporting reliability, discuss associated challenges, and provide recommendations to improve the reliability and validity of dynamic ultrasound measurements; and 3) provide an overview of computational approaches for quantifying fascicle architecture, their validity, agreement with manual quantification of fascicle architecture, and advantages and drawbacks. Three databases were searched until June 2019. Studies among healthy human individuals aged 17-85 yr that investigated the reliability of FL or PA in lower-extremity muscles during isoinertial movements and that were written in English were included. Thirty studies (n = 340 participants) were included for reliability analyses. Between-session reliability as measured by coefficient of multiple correlations (CMC), and coefficient of variation (CV) was FL CMC: 0.89-0.96; CV: 8.3% and PA CMC: 0.87-0.90; CV: 4.5-9.6%. Within-session reliability was FL CMC: 0.82-0.99; CV: 0.0-6.7% and PA CMC: 0.91; CV: 0.0-15.0%. Manual analysis reliability was FL CMC: 0.89-0.96; CV: 0.0-15.9%; PA CMC: 0.84-0.90; and CV: 2.0-9.8%. Computational analysis FL CMC was 0.82-0.99, and PA CV was 14.0-15.0%. Eighteen computational approaches were identified, and these generally showed high agreement with manual analysis and high validity compared with phantoms or synthetic images. B-mode ultrasound is a reliable method to quantify fascicle architecture during movement. Additionally, computational approaches can provide a reliable and valid estimation of fascicle architecture.

Agreement between An Inertia and Optical Based Motion Capture during the VU-Return-to-Play- Field-Test

The validity of an inertial sensor-based motion capture system (IMC) has not been examined within the demands of a sports-specific field movement test. This study examined the validity of an IMC during a field test (VU®) by comparing it to an optical marker-based motion capture system (MMC). Expected accuracy and precision benchmarks were computed by comparing the outcomes of a linear and functional joint fitting model within the MMC. The kinematics from the IMC in sagittal plane demonstrated correlations (r²) between 0.76 and 0.98 with root mean square differences (RMSD) < 5°, only the knee bias was within the benchmark. In the frontal plane, r² ranged between 0.13 and 0.80 with RMSD < 10°, while the knee and hip bias was within the benchmark. For the transversal plane, r² ranged 0.11 to 0.93 with RMSD < 7°, while the ankle, knee and hip bias remained within the benchmark. The findings indicate that ankle kinematics are not interchangeable with MMC, that hip flexion and pelvis tilt higher in IMC than MMC, while other measures are comparable to MMC. Higher pelvis tilt/hip flexion in the IMC can be explained by a one sensor tilt estimation, while ankle kinematics demonstrated a considerable level of disagreement, which is likely due to four reasons: A one sensor estimation, sensor/marker attachment, movement artefacts of shoe sole and the ankle model used.