Sample size requirements for estimating intraclass correlations with desired precision

Reliability of the ICD-11 personality disorder severity ratings and diagnosis

The present study aimed to investigate the interrater reliability of the dichotomous and dimensional personality disorder (PD) diagnoses based on the overall severity assessment on a rating form consisting of 18 anchored items encompassing diagnostic requirements of the International Classification of Diseases 11th Revision (ICD-11). We also aimed to examine the extent of consistency within the diagnostic requirements grouped under the domains of self- and interpersonal functioning, specific manifestations of personality dysfunction, and distress and impairment in psychosocial functioning. Our data involved a total of 184 inter-ratings of 46 consenting patients by the same set of four clinicians. The chance-corrected agreement levels were estimated at intraclass correlation coefficient (ICC) = 0.89 for the overall severity composite, ICC = 0.83 for the dimensional PD diagnosis and Fleiss' kappa = 0.77 for the dichotomous PD diagnosis. Internal consistency analysis of the overall severity composite and the domain composites revealed Cronbach's alpha coefficients approaching or exceeding 0.90 level. Our findings suggest that the diagnostic requirements listed in the ICD-11 and related documents for the severity determination in PD compose an internally consistent set. With the guidance of a rating form comprised of anchored items covering this set, competency-level clinicians are likely to perform reliable evaluations of the severity of personality disturbance, and dimensional and dichotomous PD diagnoses. The development of semi-structured interviews that would further facilitate the task of inspecting and rating each diagnostic requirement reliably will possibly enhance the implementation of the ICD-11 classification for PD around the world.

Validation of a new method for the radiological measurement of rod curvature in patients with spine deformity

PURPOSE

The relationship between rod curvature and postoperative radiographic results is a debated topic. One of the reasons of the heterogeneity of the observed results might reside in the lack of a validated and widely employed method to measure the curvature of the rods. Aim of this study was to present and validate a novel method for rod measurement, which is based on routine X-rays and utilizes a regression algorithm that limits manual measurements and the related errors.

METHODS

Data from 20 adolescent idiopathic scoliosis/Scheuermann kyphosis (AIS/SK) patients and 35 adult spine deformity (ASD) patients for analysis, with 112 rods in total. An orthogonal reference grid was overlaid on the lateral X-ray; seven points were then marked along each rod and their coordinates recorded in a table. Using these coordinates, a third-order polynomial regression was applied to obtain the rod curvature equation (correlation coefficients > 0.97). Three observers (one surgeon, one experienced and one inexperienced observer) independently applied the developed method to measure the rod angulation of the included patients and performed the measurements twice. The reliability of the method was evaluated in terms of intraclass correlation coefficient (ICC), Bland-Altmann plot and 2SR.

RESULTS

The intra-observer ICCs for all measurements exceed 0.85, indicating an excellent correlation. For the AIS/SK group, the surgeon showed a slightly lower reliability compared to the other two evaluators (0.93 vs 0.98 and 0.98). However, the surgeon showed a higher reliability in measurements of the rods at the lumbar level, both for L1-S1 and L4-S1 (0.98 vs 0.96 and 0.89; 0.97 vs. 0.85 and 0.91, respectively). The variability also showed excellent results, with a mean variability ranging from 1.09° to 3.76°. The inter-observer ICCs for the three measurement groups showed an excellent reliability for the AIS/SK group (0.98). The reliability was slightly lower but still excellent for the lumbar measurements in ASD patients at L1-S1 (0.89) and L4-S1 (0.83). The results of the 2SR for each measured segment were 4.4° for T5-T11, 5.4° for L1-S1 and 5.5° for L4-S1.

CONCLUSION

The described method represents a reliable and reproducible way to measure rod curvature. This method is based on routine X-rays and utilizes a regression algorithm that limits manual measurements and the related errors.

Evaluating the validity and reliability of the Tswana adaptation of the MOS-HIV tool for health-related quality of life among HIV Sub-populations in Botswana: A study protocol

The lack of culturally and contextually appropriate adaptations of health-related quality of life (HRQoL) tools hinders HIV patient outcomes. This study aims to assess the validity and reliability of a Tswana version of the Medical Outcome Survey-HIV (MOS-HIV) tool among diverse HIV sub-populations in Botswana. In terms of the methodology the study will comprise of several steps. Firstly, forward and back-translation of the original U.S. English MOS-HIV tool into Setswana, followed by the review of the translated tool. Phase 1 will evaluate content, construct validity, and reliability of the newly developed tool among HIV outpatients at Gaborone Infectious Diseases Clinics (IDCC). A Cronbach's alpha coefficient >0.7 across the 35 items and 11 dimensions of the MOS-HIV tool will indicate internal consistency reliability. Phase 2 will employ the use of logistic regression models to identify predictors of poor HRQoL among randomly selected IDCC sites, both in urban and rural centers. Phase 3 will investigate predictors of poor HRQoL among inpatients receiving treatment for HIV-associated cryptococcal meningitis (CM) using longitudinal data analysis methods. Ethical approval has been obtained from the University of Botswana, Walter Sisulu University, Human Research and Development Unit, Ministry of Health, and Princess Marina Hospital. Prospective participants will provide written informed consent, with proxy consent explored when feasible. Voluntary participation and confidentiality will be ensured during data collection and analysis. Data will be securely stored under lock-and-key. Dissemination of study findings will adhere to strict privacy protocols, avoiding the sharing of personal identifiers.

Accuracy of pelvic bone segmentation for 3d printing: a study of segmentation accuracy based on anatomic landmarks to evaluate the influence of the observer

BACKGROUND

3D printing has a wide range of applications and has brought significant change to many medical fields. However, ensuring quality assurance (QA) is essential for patient safety and requires a QA program that encompasses the entire production process. This process begins with imaging and continues on with segmentation, which is the conversion of Digital Imaging and Communications in Medicine (DICOM) data into virtual 3D-models. Since segmentation is highly influenced by manual intervention the influence of the users background on segmentation accuracy should be thoroughly investigated.

METHODS

Seventeen computed tomography (CT) scans of the pelvis with physiological bony structures were identified, anonymized, exported as DICOM data sets, and pelvic bones were segmented by four observers with different backgrounds. Landmarks were measured on DICOM images and in the segmentations. Intraclass correlation coefficients (ICCs) were calculated to assess inter-observer agreement, and the trueness of the segmentation results was analyzed by comparing the DICOM landmark measurements with the measurements of the segmentation results. The correlation between segmentation trueness and segmentation time was analyzed.

RESULTS

The lower limits of the 95% confidence intervals of the ICCs for the seven landmarks analyzed ranged from 0.511 to 0.986. The distance between the iliac crests showed the highest agreement between observers, while the distance between the ischial tuberosities showed the lowest. The distance between the upper edge of the symphysis and the promontory showed the lowest deviation between DICOM measurements and segmentation measurements (mean deviations < 1 mm), while the intertuberous distance showed the highest deviation (mean deviations 14.5-18.2 mm).

CONCLUSIONS

Investigators with diverse backgrounds in segmentation and varying experience with slice images achieved pelvic bone segmentations with landmark measurements of mostly high agreement in a setup with high realism. In contrast, high variability was observed in the segmentation of the coccyx. In general, interobserver agreement was high, but due to measurement inaccuracies, landmark-based approaches cannot conclusively show that segmentation accuracy is within a clinically tolerable range of 2 mm for the pelvis. If the segmentation is performed by a very inexperienced user, the result should be reviewed critically by the clinician in charge.

The dichoptic contrast ordering test: A method for measuring the depth of binocular imbalance

In binocular vision, the relative strength of the input from the two eyes can have significant functional impact. These inputs are typically balanced; however, in some conditions (e.g., amblyopia), one eye will dominate over the other. To quantify imbalances in binocular vision, we have developed the Dichoptic Contrast Ordering Test (DiCOT). Implemented on a tablet device, the program uses rankings of perceived contrast (of dichoptically presented stimuli) to find a scaling factor that balances the two eyes. We measured how physical interventions (applied to one eye) affect the DiCOT measurements, including neutral density (ND) filters, Bangerter filters, and optical blur introduced by a +3-diopter (D) lens. The DiCOT results were compared to those from the Dichoptic Letter Test (DLT). Both the DiCOT and the DLT showed excellent test-retest reliability; however, the magnitude of the imbalances introduced by the interventions was greater in the DLT. To find consistency between the methods, rescaling the DiCOT results from individual conditions gave good results. However, the adjustments required for the +3-D lens condition were quite different from those for the ND and Bangerter filters. Our results indicate that the DiCOT and DLT measures partially separate aspects of binocular imbalance. This supports the simultaneous use of both measures in future studies.

Intersystem and Interoperator Agreement of US Attenuation Coefficient for Quantifying Liver Steatosis

Background The extent of liver steatosis can be assessed using US attenuation coefficient (AC) algorithms currently implemented in several US systems. However, little is known about intersystem and interoperator variability in measurements. Purpose To assess intersystem and interoperator agreement in US AC measurements for fat quantification in individuals with varying degrees of liver steatosis and to assess the correlation of each manufacturer's AC algorithm results with MRI proton density fat fraction (PDFF). Materials and Methods This prospective study was conducted at Southwoods Imaging, Youngstown, Ohio, September 30-October 1, 2023. Two operators independently obtained AC measurements using eight US systems equipped with an AC algorithm from different manufacturers. On the same day, MRI PDFF measurement was performed by a different operator. Correlation between US AC and MRI PDFF was assessed using a mixed-effects model. Agreement between systems and operators was evaluated using the intraclass correlation coefficient (ICC). Results Twenty-six individuals (mean age, 55.4 years ± 10.7 [SD]; 16 female participants) were evaluated. The correlation of US AC with MRI PDFF was high for five AC algorithms (r range, 0.70-0.86), moderate for two (r = 0.62 for both), and poor for one (r = 0.47). In pairwise comparisons, none of the pairs of systems achieved excellent agreement (overall ICC = 0.33 [95% CI: 0.15, 0.52]). One pair showed good agreement (ICC = 0.79 [95% CI: 0.66, 0.87]), eight pairs showed moderate agreement (ICC range, 0.50 [95% CI: 0.22, 0.69] to 0.73 [95% CI: 0.49, 0.85]), and 19 pairs showed poor agreement (ICC range, 0.11 [95% CI: -0.06, 0.37] to 0.48 [95% CI: 0.20, 0.67]). Interoperator agreement on AC value was excellent for the Samsung Medison algorithm (ICC = 0.90 [95% CI: 0.80, 0.96]), good for the Siemens Healthineers (ICC = 0.76 [95% CI: 0.54, 0.89]) and Canon Medical Systems (ICC = 0.76 [95% CI: 0.16, 0.92]) algorithms, and moderate for the remaining algorithms (ICC range, 0.50 [95% CI: 0.16, 0.73] to 0.74 [95% CI: 0.51, 0.88]). The mean AC value obtained by the two operators did not differ for any system except the system from Canon Medical Systems. Conclusion There was substantial variability in AC values obtained with different US systems, precluding interchangeability between systems for liver steatosis diagnosis and follow-up imaging. Interoperator agreement ranged from moderate to excellent. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Han in this issue.

Cross-cultural adaptation and psychometric validation of the French version of the Defense and Veterans Pain Rating Scale for acute and chronic pain: a prospective clinical study

BACKGROUND

Pain assessment and proper evaluation of pain are prerequisites for treatment of acute and chronic pain. Until now, most evaluations have used only resting pain intensity and a unidimensional scale, although multidimensional pain assessment and especially assessment of functional pain impact on activities are recommended. The Defense and Veterans Pain Rating Scale (DVPRS) permits this multidimensional assessment, but no validated French translation exists.

OBJECTIVES

To validate the French translation of the multidimensional DVPRS, called the Functional Pain Scale (FPS), in multiple settings of acute and chronic pain.

STUDY DESIGN

Prospective observational study.

SETTING

Two large hospitals in the French-speaking region of Switzerland.

METHODS

We recruited 232 patients from February 2022 to January 2023. Patients with acute or chronic pain in different settings received a paper questionnaire with both a numerical rating scale (NRS) and the FPS and a customized evaluation questionnaire. Correlation between the FPS and NRS, psychometric properties, and patient preferences were analyzed.

RESULTS

Correlation between the FPS and NRS was high for the whole group of 232 patients, as well for all subgroups. The multi-item FPS scale showed excellent internal consistency. A large majority of patients, even those >75 years of age, preferred the FPS over the NRS and stated that the FPS was easy to use.

CONCLUSIONS

The study confirms that the French translation of the DVPRS (the FPS) is a valid measurement instrument for acute and chronic pain evaluation in a wide range of patient groups and is easy for patients to use.

TRIAL REGISTRATION

ClinicalTrials.gov ID: NCT05307380.

Characteristics and Outcomes of Surgical Treatment for Anterolateral Ankle Impingement Due to the Distal Fascicle of the Anterior Inferior Tibiofibular Ligament

Background

The pathomechanism of anterolateral ankle impingement (ALAI) due to the distal fascicle of the anterior inferior tibiofibular ligament (DF-AITFL) has not been fully elucidated. In addition, because of its rarity, no definitive diagnostic criteria have been established for ALAI due to DF-AITFL.

Purpose

To document the symptom characteristics and magnetic resonance imaging (MRI) and and arthroscopic findings as well as postoperative clinical outcomes of ALAI due to DF-AITFL.

Study Design

Case series; Level of evidence, 4.

Methods

Included were 12 patients (5 male and 7 female; mean age, 34.4 years [range, 21-76 years]) who were diagnosed with ALAI due to DF-AITFL and underwent excision of the DF-AITFL from November 2017 to August 2021. Symptom characteristics and symptom-related medical histories were evaluated, as were MRI and arthroscopic findings. Clinical outcomes were assessed using the visual analog scale for pain, American Orthopaedic Foot & Ankle Society ankle-hindfoot functional scale, and Foot Function Index.

Results

All 12 patients had a history of ankle sprain before symptom onset. DF-AITFL was confirmed by MRI in all patients. Bone edema of the talus was observed in 2 patients (16.7%), and cartilage abnormalities in 3 patients (25%). Arthroscopy showed that the DF-AITFL contacted the anterolateral aspect of the talar dome during range of motion in all patients and that the AITFL was bent where it contacted the anterolateral dome of the talus in 3 patients (25%). Partial tear or adhesion of the DF-AITFL was noted in 7 patients (58.3%), and cartilage deformation at the anterolateral talar dome in 4 patients (33.3%). Mean visual analog scale pain, American Orthopaedic Foot & Ankle Society, and Foot Function Index scores improved significantly from preoperatively to postoperatively.

Conclusion

ALAI due to DF-AITFL should be considered a possible cause of anterolateral ankle pain after an ankle sprain. The diagnosis can be reliably made with a thorough clinical examination and imaging studies. Half of the patients in this series also had lateral ankle instability. Surgical resection of the DF-AITFL and ligament reconstruction, if necessary, resulted in significant symptom improvement.

Evaluation of the Psychometric Properties of the Translated Physical Self-Perception Profile Among Chinese Breast Cancer Survivor

PURPOSE

The purpose of this study was to translate the original English version of the Physical Self-Perception Profile into Cantonese Chinese, while considering linguistic and socio-cultural characteristics, and to evaluate its psychometric properties among Chinese breast cancer survivors in Hong Kong, China, thus providing a valid, culturally relevant tool for assessing physical self-esteem among this population.

METHODS

The 30-item, 5 subscale Physical Self-Perception Profile was translated into Chinese by the combined translation technique. The psychometric properties of the Cantonese version of the Physical Self-Perception Profile were examined in 292 Hong Kong Chinese breast cancer survivors for internal consistency and test-retest reliability. A confirmatory factor analysis was conducted to evaluate the structural validity. A panel of five experts examined its content validity. The concurrent validity was examined by correlating the Physical Self-Perception Profile and a validated global self-esteem measure.

RESULTS

The Cantonese version of the Physical Self-Perception Profile demonstrated satisfactory content validity, also satisfactory internal consistency with Cronbach's α ranging from .64 to .80, as well as good test-retest reliability, with an intraclass correlation coefficient ranging from .77 to .81. The confirmatory factor analysis showed a fairly good fit of the four-factor subdomain structure, namely, physical condition, physical strength, body attractiveness, and sports competence. The concurrent validity of the Chinese version Physical Self-Perception Profile was demonstrated by a significant positive correlation between the physical self-worth domain and four subdomains with global self-esteem. In addition, the four subdomains had statistically significant positive correlations, with the physical self-worth domain indicating the instrument's hierarchical structure.

CONCLUSION

The study translated the Physical Self-Perception Profile from English to Cantonese and demonstrated its desirable psychometric properties among Chinese Hong Kong breast cancer survivors. The linguistical and cultural adaptation of this instrument can serve as a valid and reliable tool for assessing physical self-esteem among breast cancer survivors in Hong Kong, China.

Quantitative reliability assessment of brain MRI volumetric measurements in type II GM1 gangliosidosis patients

Purpose

GM1-gangliosidosis (GM1) leads to extensive neurodegenerative changes and atrophy that precludes the use of automated MRI segmentation techniques for generating brain volumetrics. We developed a standardized segmentation protocol for brain MRIs of patients with type II GM1 and then assessed the inter- and intra-rater reliability of this methodology. The volumetric data may be used as a biomarker of disease burden and progression, and standardized methodology may support research into the natural history of the disease which is currently lacking in the literature.

Approach

Twenty-five brain MRIs were included in this study from 22 type II GM1 patients of which 8 were late-infantile subtype and 14 were juvenile subtype. The following structures were segmented by two rating teams on a slice-by-slice basis: whole brain, ventricles, cerebellum, lentiform nucleus, thalamus, corpus callosum, and caudate nucleus. The inter- and intra-rater reliability of the segmentation method was assessed with an intraclass correlation coefficient as well as Sorensen-Dice and Jaccard coefficients.

Results

Based on the Sorensen-Dice and Jaccard coefficients, the inter- and intra-rater reliability of the segmentation method was significantly better for the juvenile patients compared to late-infantile (p < 0.01). In addition, the agreement between the two rater teams and within themselves can be considered good with all p-values < 0.05.

Conclusions

The standardized segmentation approach described here has good inter- and intra-rater reliability and may provide greater accuracy and reproducibility for neuromorphological studies in this group of patients and help to further expand our understanding of the natural history of this disease.

Development and Preliminary Validation of a Central Venous Access Device-Associated Skin Impairment Classification Tool Using Modified Delphi and Clinimetric Methods

BACKGROUND

An evidence and consensus-based instrument is needed to classify central venous access device-associated skin impairments.

AIM

The aim of this study was to design and evaluate the central venous access device-associated skin impairment classification tool.

DESIGN

A two-phase modified Delphi study.

METHODS

This two-phase study consisted of a literature review, followed by the development and validation of a classification instrument, by experts in the fields of central venous access devices and wound management (Phase 1). The instrument was tested (Phase 2) using 38 clinical photographs of a range of relevant skin impairments by the same expert panel. The expert panel consisted of registered nurses who were clinical researchers (n = 4) and clinical experts (n = 3) with an average of 24 years of nursing and research experience and 11 years of experience in wound management. Measures to assess preliminary content validity and inter-rater reliability were used.

RESULTS

The instrument consists of five overarching aetiological classifications, including contact dermatitis, mechanical injury, infection, pressure injury and complex clinical presentation, with 14 associated subcategory diagnoses (e.g., allergic dermatitis, skin tear and local infection), with definitions and signs and symptoms. High agreement was achieved for preliminary scale content validity and item content validity (I-CVI = 1). Inter-rater reliability of aetiologies was high. The overall inter-rater reliability of individual definitions and signs and symptoms had excellent agreement.

CONCLUSION

The development and preliminary validation of this classification tool provide a common language to guide the classification and assessment of central venous access device-associated skin impairment.

IMPACT

The comprehensive and validated classification tool will promote accurate identification of central venous access device-associated skin impairment by establishing a common language for healthcare providers. The availability of this tool can reduce clinical uncertainty, instances of misdiagnosis and the potential for mismanagement. Consequently, it will play a pivotal role in guiding clinical decision-making, ultimately enhancing the quality of treatment and improving patient outcomes.

REPORTING METHOD

The Guidance on Conducting and Reporting Delphi Studies (CREDES) was adhered to.

PATIENT OR PUBLIC CONTRIBUTION

No patient or public contribution.

Evaluation of Smartphone Technology on Spatiotemporal Gait in Older and Diseased Adult Populations

Objective: Advancements in smartphone technology provide availability to evaluate movement in a more practical and feasible manner, improving clinicians' ability to diagnose and treat adults at risk for mobility loss. The purpose of this study was to evaluate the validity and reliability of a smartphone application to measure spatiotemporal outcomes during level (primary) and uphill/downhill (secondary) walking with and without an assistive device for older adults (OAs), Parkinson's Disease (PD) and cerebrovascular accident (CVA) populations. Methods: A total of 50 adults (OA = 20; PD = 15; CVA = 15) underwent gait analysis at self-selected gait speeds under 0-degree, 5-degree uphill and 5-degree downhill environments. The validity and reliability of the smartphone outcomes were compared to a motion-capture laboratory. Bland-Altman analysis was used to evaluate limits of agreement between the two systems. Intraclass correlation coefficients (ICCs) were used to determine absolute agreement, and Pearson correlation coefficients (r) were used to assess the strength of the association between the two systems. Results: For level walking, Bland-Altman analysis revealed relatively equal estimations of spatiotemporal outcomes between systems for OAs without an assistive device and slight to mild under- and overestimations of outcomes between systems for PD and CVA with and without an assistive device. Moderate to very high correlations between systems (without an assistive device: OA r-range, 0.72-0.99; PD r-range, 0.87-0.97; CVA r-range, 0.56-0.99; with an assistive device: PD r-range, 0.35-0.98; CVA r-range, 0.50-0.99) were also observed. Poor to excellent ICCs for reliability between systems (without an assistive device: OA ICC range, 0.71-0.99; PD ICC range, 0.73-0.97; CVA ICC range, 0.56-0.99; with an assistive device: PD ICC range, 0.22-0.98; CVA ICC range, 0.44-0.99) were observed across all outcomes. Conclusions: This smartphone application can be clinically useful in detecting most spatiotemporal outcomes in various walking environments for older and diseased adults at risk for mobility loss.

Evaluation of a Novel Virtual Reality Simulated Alternate Cover Test to Assess Strabismus: A Prospective, Masked Study

PURPOSE

A sensorimotor examination is the gold standard for strabismus diagnosis and quantification but requires a highly skilled examiner and may be limited by a child's cooperation. Virtual reality (VR) employs eye-tracking technology to monitor eye position and may be able to measure strabismus. The aim of this study was to assess a prototype VR-simulated alternate cover test to detect and measure strabismus.

DESIGN

Prospective, masked diagnostic test study.

METHODS

Patients aged 5-18 years with visual acuity of 20/80 or better were prospectively enrolled to undergo strabismus measurements using a VR simulated alternate cover test (Olleyes, Inc., Summit, NJ) followed by an alternate cover test performed by a masked pediatric ophthalmologist or orthoptist. The main outcome measure was correlation between gold standard and VR-obtained strabismus measurements (in prism diopters [PD]) in primary gaze at near using Pearson correlation coefficients and Bland-Altman analysis with limits of agreement (LOA). A secondary measure was the diagnostic accuracy for the VR headset to detect strabismus.

RESULTS

A total of 85 participants were enrolled, mean ± standard deviation age was 10.8 ± 3.8 years, 45.9% (39/85) male. 40.0% (34/85) had strabismus: 17.7% (15/85) esotropia, 22.4% (19/85) exotropia, and 5.9% (5/85) vertical strabismus. 52.9% (18/34) of strabismus was intermittent. The overall correlation between VR and gold standard strabismus measurements was moderate but significant (r = 0.42, 95% CI 0.22, 0.58, P < .001), and correlation was strong for esotropia and constant deviations (r = 0.74, 95% CI 0.38, 0.91, P = .001 and r = 0.74, 95% CI 0.39, 0.91, P < .001, respectively). In participants with horizontal strabismus, Bland-Altman analysis showed a mean difference between standard and VR measurements of 3.55 ± 8.33 PD for esotropia (upper and lower LOA 19.89, -12.78 PD) and 17.15 ± 11.20 PD for exotropia (LOA 39.09 and -4.79 PD). Sensitivity for detecting strabismus was low: 27.6% (95% CI 12.7, 47.2), but specificity was high: 87.5% (95% CI 75.9, 94.8).

CONCLUSIONS

A prototype VR simulated alternate cover test showed a moderate but significant correlation with the gold standard sensorimotor examination and correlation was strong in those with esotropia and constant deviations. While the level of agreement demonstrated by this novel VR technology is promising, further improvements are needed before clinical deployment. However, this study demonstrates that VR has the potential to expand our ability to detect, measure, and monitor strabismus.

Test-Retest Reliability and Usefulness of a Foot-Ankle Rebound-Jump Test for Measuring Foot-Ankle Reactive Strength in Athletes

PURPOSE

This study investigated the test-retest reliability and usefulness of the foot-ankle rebound-jump test (FARJT) for measuring foot-ankle reactive strength metrics in athletes.

METHODS

Thirty-six highly trained, healthy athletes (5 female; 21.5 [3.9] y; 1.80 [0.10] m; 72.7 [10.4] kg) performed 8 repeated bilateral vertical foot-ankle rebound jumps on 2 testing days. Testing days were 1 week apart, and these sessions were preceded by a familiarization session. Reactive strength metrics were calculated by dividing jump height (in meters) by contact time (in seconds) for the reactive strength index (RSI) and flight time (in seconds) by contact time (in seconds) for the reactive strength ratio (RSR). The mean of 4 jumps (excluding the first and last 2 jumps) on each testing session were considered for RSI and RSR reliability and usefulness analysis.

RESULTS

We found a high reliability of the FARJT for RSI (intraclass correlation coefficient [ICC] > .90 and coefficient of variation [CV] = 12%) and RSR (ICC ≥ .90 and CV = 8%). Regarding their usefulness, both RSI and RSR were rated as "marginal" in detecting the smallest worthwhile change (typical error > smallest worthwhile change) and "good" in detecting a moderate change in performance.

CONCLUSIONS

The results showed that a FARJT is a highly reliable test for measuring foot-ankle reactive strength in athletes and useful for quantifying changes, for example, following a training block. However, its usefulness as an accurate daily or weekly monitoring tool in practice is questionable.

Concordance between two models of stratification for patients living with HIV infection to providing pharmaceutical care

OBJECTIVE

To determine the degree of agreement of 2 differents stratification models for pharmaceutical care to people living with HIV.

METHODS

This was a single-center observational prospective cohort study of patients with regular follow-up in pharmaceutical care consultations according to the Capacity-Motivation-Opportunity methodology, conducted between January 1 and March 31, 2023. Patients received the pharmacotherapeutic interventions applied routinely to ambulatory care patients according to this model. As part of the usual clinical practice, the presence or absence of the variables that apply to both stratification models were collected. The scores obtained and the corresponding stratification level were collected for each patient according to both stratification models published (ST-2017 and ST-2022). To analyze the reliability between the measurements of 2 numerical score models of the stratification level with both tools, their degree of concordance was calculated using the intraclass correlation coefficient. Likewise, reliability was also evaluated from a qualitative perspective by means of Cohen's Kappa coefficient. Additionally, the existence of correlation between the scores of the 2 models was assessed by calculating Pearson's correlation coefficient.

RESULTS

Of the total of 758 patients being followed in the cohort, finally, 233 patients were enrolled. The distribution of patients for each stratification model was: ST-2017: 59.7% level-3, 25.3% level-2, and 15.0% level-1, while for ST-2022: 60.9% level-3, 26.6% level-2, and 12.4% level-1. It was observed that the reclassification was symmetrical (P=.317). The qualitative analysis of the agreement between the models showed a good Cohen's kappa value, (K=0.66). A value of 0.563 was found as the intraclass correlation coefficient. Finally, the correlation analysis between the quantitative scores of the 2 models yielded a Pearson correlation coefficient of 0.86.

CONCLUSIONS

The concordance between the 2 models was good, which confirms that the multidimensional adaptation and simplification of the model were correct and that its use can be extended in routine clinical practice.

Concordance between two models of stratification for patients living with HIV infection to providing pharmaceutical care

OBJECTIVE

To determine the degree of agreement of two differents stratification models for pharmaceutical care to people living with HIV.

METHODS

This was a single-centre observational prospective cohort study of patients with regular follow-up in pharmaceutical care consultations according to the Capacity-Motivation-Opportunity methodology, conducted between January 1st and March 31th, 2023. Patients received the pharmacotherapeutic interventions applied routinely to ambulatory care patients according to this model. As part of the usual clinical practice, the presence or absence of the variables that apply to both stratification models were collected. The scores obtained and the corresponding stratification level were collected for each patient according to both stratification models published (ST-2017 and ST-2022). To analyze the reliability between the measurements of two numerical score models of the stratification level with both tools, their degree of concordance was calculated using the intraclass correlation coefficient. Likewise, reliability was also evaluated from a qualitative perspective by means of Cohen's Kappa coefficient. Additionally, the existence of correlation between the scores of the two models was assessed by calculating Pearson's correlation coefficient.

RESULTS

Of the total of 758 patients being followed in the cohort, finally, 233 patients were enrolled. The distribution of patients for each stratification model was: ST-2017: 59.7% level-3, 25.3% level-2 and 15.0% level-1, while for ST-2022: 60.9% level-3, 26.6% level-2 and 12.4% level-1. It was observed that the reclassification was symmetrical (p=0.317). The qualitative analysis of the agreement between the models showed a good Cohen's kappa value, (K=0.66). A value of 0.563 was found as the intraclass correlation coefficient. Finally, the correlation analysis between the quantitative scores of the two models yielded a Pearson correlation coefficient of 0.86.

CONCLUSIONS

The concordance between the two models was good, which confirms that the multidimensional adaptation and simplification of the model were correct and that its use can be extended in routine clinical practice.

Clinician-administered performance-based tests via telehealth in people with chronic lower limb musculoskeletal disorders: Test-retest reliability and agreement with in-person assessment

INTRODUCTION

Uptake of telehealth has surged, yet no previous studies have evaluated the clinimetric properties of clinician-administered performance-based tests of function, strength, and balance via telehealth in people with chronic lower limb musculoskeletal pain. This study investigated the: (i) test-retest reliability of performance-based tests via telehealth, and (ii) agreement between scores obtained via telehealth and in-person.

METHODS

Fifty-seven adults aged ≥45 years with chronic lower limb musculoskeletal pain underwent three testing sessions: one in-person and two via videoconferencing. Tests included 30-s chair stand, 5-m fast-paced walk, stair climb, timed up and go, step test, timed single-leg stance, and calf raises. Test-retest reliability and agreement were assessed via intraclass correlation coefficients (ICC; lower limit of 95% confidence interval (CI) ≥0.70 considered acceptable). ICCs were interpreted as poor (<0.5), moderate (0.5-0.75), good (0.75-0.9), or excellent (>0.9).

RESULTS

Test-retest reliability was good-excellent with acceptable lower CI for stair climb test, timed up and go, right leg timed single-leg stance, and calf raises (ICC = 0.84-0.91, 95% CI lower limit = 0.71-0.79). Agreement between telehealth and in-person was good-excellent with acceptable lower CI for 30-s chair stand, left leg single-leg stance, and calf raises (ICC = 0.82-0.91, 95% CI lower limit = 0.71-0.85).

DISCUSSION

Stair climb, timed up and go, right leg timed single-leg stance, and calf raise tests have acceptable reliability for use via telehealth in research and clinical practice. If re-testing via a different mode (telehealth/in-person), clinicians and researchers should consider using the 30-s chair stand test, left leg timed single-leg stance, and calf raise tests.

Translation, cultural adaptation, and validation of the NOSE-Perf scale to Brazilian Portuguese

OBJECTIVE

To perform the translation, cultural adaptation, and validation of the NOSE-Perf Scale to Brazilian Portuguese.

METHODS

This study was divided into two stages. In the first stage, the questionnaire was submitted for translation and cultural adaptation, following the guidelines recommended by the ISPOR Task Force (International Society for Pharmacoeconomics and Outcomes Research). Then, the Brazilian Portuguese version of the NOSE-Perf scale was applied to a group with septal perforation and a control group. The group with perforation answered the questionnaire again after one month. Internal consistency, test-retest reliability, and discriminant validity were assessed.

RESULTS

The Brazilian Portuguese version of the NOSE-Perf scale was applied to 32 participants, 16 from the group with septal perforations and 16 controls. The instrument obtained high internal consistency, with Cronbach's alpha scores of 0.986. High reliability was also obtained, with Spearman's correlation coefficient of 0.996 (p < 0.001) and the intraclass correlation coefficient of 0.965 with a 95% Confidence Interval (95% CI) of 0.886‒0.988. The NSP group obtained a mean total score of 13.8 ± 12.6 and the control group a score of 2.3 ± 1.8, with a statistical difference between the groups (p < 0.001), demonstrating good discriminant validity.

CONCLUSION

The Brazilian Portuguese version of the NOSE-Perf scale is a reliable and valid instrument for measuring symptoms in patients with nasal septum perforations.

LEVEL OF EVIDENCE

Level 2-Oxford Centre for Evidence-Based Medicine 2011 Levels of Evidence.

Validity and reliability of a finger training tool for assessing metacarpal phalangeal joint ranges of motion in asymptomatic participants

This pilot study aims to evaluate concurrent validity using the goniometer as a reference tool and test-retest reliability of flexion of metacarpal phalangeal joint (MCP) measurements taken from a finger training device (air-guitar system) in healthy participants. There were ten self -reported asymptomatic participants recruited to test the devices. The measurements of all metacarpophangeal joints of the dominant hands were conducted using a finger goniometer and the air-guitar system. Two measuring sessions were conducted on the same day. The concurrent validity of the air-guitar indicated by strong concordance correlation coefficient (0.62-0.90) with the goniometer and mean difference (approximately 1°) between the two instruments are well below the limit of 5°. The test-retest reliability of MCP measurements from the air-guitar glove (0.82-0.99) was acceptable as a clinically meaningful measurement tool as the intraclass correlation coefficients were higher than 0.7. The standard error of measurement and minimal detectable change of the air-guitar are similar to those of the goniometer. The air-guitar tracking features, when used as a home-based therapy tool, may assist in monitoring change of MCP flexion over a time course with good reliability and strongly associated with the measurements from the goniometer.

How well can the fetal heart rate baseline be assessed by intrapartum intermittent auscultation? An interrater reliability and agreement study

BACKGROUND

We aimed to examine the inter-reliability and agreement among midwives when assessing the fetal heart rate (FHR) using the handheld Doppler. The primary aim was to measure the reliability and agreement of FHR baseline (baseline) as beats per minute (bpm). The secondary aims were to measure fluctuations from the baseline, defined as increases and decreases, and classifications (normal or abnormal) of FHR soundtracks. This is the first interrater reliability and agreement study on intermittent auscultation (IA) to our knowledge.

METHODS

The participant population consisted of 154 women in labor, from a mixed-risk population and admitted to hospital for intrapartum care. The rater population were 16 midwives from various maternity care settings in Norway. A total of 154 soundtracks were recorded with a handheld Doppler device, and the 16 raters assessed 1-min soundtracks once, through an online survey (Nettskjema). They assessed the baseline, FHR increase or decrease, and the FHR classification. The primary outcome, baseline, was measured with intraclass correlation coefficient (ICC). The secondary outcomes were measured with kappa and proportion of agreement.

RESULTS

The interrater reliability for the baseline (bpm) was ICC(A,1) 0.74 (95% CI 0.69-0.78). On average, an absolute difference of 7.9 bpm (95% CI 7.3-8.5 bpm) was observed between pairs of raters.

CONCLUSION

Our results demonstrate an acceptable level of reliability and agreement in assessing the baseline using a handheld Doppler.

Performance of a prediction method for activities of daily living scores using influence coefficients in patients with stroke

Introduction

Recently, a method was developed to predict the motor Functional Independence Measure (FIM) score at discharge in patients with stroke by stratifying the effects of factors such as age and cognitive function and multiplying those by the influence coefficients of these factors. However, an evaluation of the predictive performance of the method is required for clinical application. The present study aimed to evaluate the predictive performance of this prediction method.

Methods

Patients with stroke discharged from a rehabilitation ward between April 2021 and September 2022 were included. Predicted values of the motor FIM score at discharge were calculated after data collection from the hospital's patient database. The concordance between predicted and actual values was evaluated using the interclass correlation coefficient; moreover, the residual values were calculated.

Results

In total, 207 patients were included in the analysis. The median age was 79 (69-85) years, and 112 (54.1%) patients were male. The interclass correlation coefficient between predicted and actual values was 0.84 (95% confidence interval 0.75-0.89) for the motor FIM score at discharge. Meanwhile, the median residual value was 5.3 (-2.0-10.3) for the motor FIM score at discharge.

Discussion

The prediction method was validated with good performance. However, the residual values indicated that some cases deviated from the prediction. In future studies, it will be necessary to improve the predictive performance of the method by clarifying the characteristics of cases that deviate from the prediction.

Goniometry and fleximetry measurements to assess cervical range of motion in individuals with chronic neck pain: a validity and reliability study

PURPOSE

To assess the test-retest and inter-rater reliability of goniometry and fleximetry in measuring cervical range of motion in individuals with chronic neck pain.

METHODS

A reliability study. Thirty individuals with chronic neck pain were selected. Cervical range of motion was measured by goniometry and fleximetry at two time points 7 days apart. To characterize the sample, we used the numerical pain rating scale, Pain-Related Catastrophizing Thoughts Scale, and Neck Disability Index. Intraclass correlation coefficient (ICC), standard error of measurement (SEM) and minimum detectable change (MDC) were calculated. Correlations between goniometry and fleximetry measurements were performed using Spearman's correlation coefficient (rho).

RESULTS

For goniometry, we found excellent test-retest reliability (ICC ≥ 0.986, SEM ≤ 1.89%, MDC ≤ 5.23%) and inter-rater reliability (ICC ≥ 0.947, SEM ≤ 3.91%, MDC ≤ 10.84%). Similarly, we found excellent test-retest reliability (ICC ≥ 0.969, SEM ≤ 2.71%, MDC ≤ 7.52%) and inter-rater reliability (ICC ≥ 0.981, SEM ≤ 1.88%, MDC ≤ 5.20%) for fleximetry. Finally, we observed a strong correlation between the goniometry and the fleximetry for all cervical movements (rho ≥ 0.993).

CONCLUSION

Goniometry and fleximetry measurements are reliable for assessing cervical range of motion in individuals with chronic neck pain.

The optimal measurement method considering reliability and validity in the anterior knee laxity of anterior cruciate ligament tears

INTRODUCTION

To seek an optimal measurement method with high reliability and high validity for evaluation of the anterior knee laxity on stress radiographs and comparing the translation values to those of KT-2000 arthrometer.

METHODS

Anterior knee laxity in 77 patients was measured preoperatively using the TelosTM and the KT-2000 arthrometer. Side-to-side difference measurements were taken using three conventional measuring methods and one proposed method (Modified Lateral). The knee position on the stress radiograph was evaluated and scored based on the stress radiograph qualifying criteria depending on stress film correctiveness. Intraclass correlation coefficients were analyzed to evaluate the reliability of the measurement methods and were compared between high (Group H) and low (Group L) radiograph quality score groups for each method. Validity was assessed by comparing the KT-2000 and the TelosTM using Pearson correlation (r value).

RESULTS

The Modified Lateral method showed the best Intraclass Correlation Coefficients (ICCs), followed by Center to Center, and Medial to Medial and Lateral to Lateral methods without considering the quality of Telos. In the comparison between groups based on Telos quality for intra-rater reliability, the Medial to Medial (MM) method demonstrated the best reliability in both groups (MM: ICCs, Group H = 0.942, Group L = 0.917, P = 0.693). As for inter-rater reliability, the Modified Lateral (ML) method exhibited the best reliability in both groups (ML: ICCs, Group H = 0.923, Group L = 0.882, P = 0.547). The value measured using the ML method in Telos showed the highest correlation coefficient with the KT-2000 measured value in both groups H and L. There were no statistically significant differences among the correlation coefficient values.

CONCLUSION

The Modified Lateral method is recommended for its high reliability, taking into account the differences in bilateral knee positions and anatomical discriminability on stress radiographs when evaluating anterior knee translation with Telos. It also best reflected the KT-2000 arthrometer.

LEVEL OF EVIDENCE

Case Series, Level IV.

Centralized and Federated Models for the Analysis of Clinical Data

The progress of precision medicine research hinges on the gathering and analysis of extensive and diverse clinical datasets. With the continued expansion of modalities, scales, and sources of clinical datasets, it becomes imperative to devise methods for aggregating information from these varied sources to achieve a comprehensive understanding of diseases. In this review, we describe two important approaches for the analysis of diverse clinical datasets, namely the centralized model and federated model. We compare and contrast the strengths and weaknesses inherent in each model and present recent progress in methodologies and their associated challenges. Finally, we present an outlook on the opportunities that both models hold for the future analysis of clinical data.

Proximal humeral fractures in children - controversies in decision making

BACKGROUND

Proximal humeral fractures in children are rare and usually treated non-operatively, especially in children younger than ten. The decision between operative and non-operative treatment is mostly based on age and fracture angulation. In the current literature, diverging recommendations regarding fracture angulation that is still tolerable for non-operative treatment can be found. Besides, there is no consensus on how fracture angulation should be determined. This study aimed to determine whether leading experts in pediatric trauma surgery in Germany showed agreement concerning the measurement of fracture angulation, deciding between operative and non-operative treatment, and choosing a treatment modality.

METHODS

Twenty radiographs showing a proximal humeral fracture and the patient's age were assessed twice by twenty-two senior members of the "Section of Pediatric Traumatology of the German Association for Trauma Surgery". Experts determined the fracture angulation and chose between several operative and non-operative treatment modalities. The mean of individual standard deviations was calculated to estimate the accuracy of single measurements for fracture angulation. Besides Intra-Class Correlation and Fleiss' Kappa coefficients were determined.

RESULTS

For fracture angulation, experts showed moderate (ICC = 0.60) interobserver and excellent (ICC = 0.90) intraobserver agreement. For the treatment decision, there was fair (Kappa = 0.38) interobserver and substantial (Kappa = 0.77) intraobserver agreement. Finally, experts preferred ESIN over K-wires for operative and a Gilchrist over a Cuff/Collar for non-operative treatment.

CONCLUSIONS

Firstly, there is a need for consensus among experts on how fracture angulation in PHFs in children should be reliably determined. Our data indicate that choosing one method everybody agrees to use could be more helpful than using the most sophisticated. However, the overall importance of fracture angulation should also be critically discussed. Finally, experts should agree on treatment algorithms that could translate into guidelines to standardize the care and perform reliable outcome studies.

LEVEL OF EVIDENCE

III.

Use of near-infrared fluorescence angiography with indocyanine green to evaluate direct cutaneous arteries used for canine axial pattern flaps

OBJECTIVE

To describe the use of near-infrared angiography (NIRFA) to identify the vascularization of three canine axial pattern flaps (APFs) omocervical (OMO), thoracodorsal (THO), and caudal superficial epigastric (CSE); to establish a vascular fluorescence pattern (VFP) grading system; and to evaluate the effect of NIRFA on surgeon flap dimension planning compared to traditional landmark palpation (LP) and visualization assessments.

STUDY DESIGN

Experimental study.

ANIMALS

A total of 15 healthy, client-owned dogs.

METHODS

Dogs were sedated and flap sites were clipped. LP-based margins were drawn and preinjection images were recorded. Indocyanine green (ICG) was administered and VFP images were recorded. VFP scores were determined by five surgeons. Margin alterations were performed based on NIRFA-ICG images. Altered measurements were compared between LP and NIRFA-ICG images.

RESULTS

Vascularization of the CSE flap was most visible with NIRFA with VFP scores 4/4 for 13/15 dogs. Intersurgeon agreement for VFP grades was poorest for THO (ICC = 0.35) and intermediate for OMO (ICC = 0.49) flaps. Surgeons were more likely to adjust dimensions for CSE flaps relative to OMO (OR 17.3, 95% CI: 6.2, 47.8) or THO (25.5; 8.6, 75.7).

CONCLUSION

Using a grading system, we demonstrated that the CSE flap was most visible. Surgeons were more likely to adjust the LP-CSE flap margins based on fluorescence patterns and were more likely to rely on LP when visualization scores were low.

CLINICAL SIGNIFICANCE

NIRFA has possible applications identifying some direct cutaneous arteries of APFs and their associated angiosomes in real-time. Further investigation is indicated to study NIRFA's potential to improve patient specific APF planning.

Cadaveric Biomechanical Laboratory Research Can Be Quantitatively Scored for Quality With the Biomechanics Objective Basic Science Quality Assessment Tool: The BOBQAT Score

PURPOSE

To develop a quality appraisal tool for the assessment of cadaveric biomechanical laboratory and other basic science biomechanical studies.

METHODS

For item identification and development, a systematic review of the literature was performed. The content validity index (CVI) was used either to include or exclude items. The content validity ratio (CVR) was used to determine content validity. Weighting was performed by each panel member; the final weight was either up- or downgraded to the closest of 5% or 10%. Face validity was scored on a Likert scale ranked from 1 to 7. Test-retest reliability was determined using the Fleiss kappa coefficient. Internal consistency was assessed with Cronbach's alpha. Concurrent criterion validity was assessed against the Quality Appraisal for Cadaveric Studies scale.

RESULTS

The final Biomechanics Objective Basic science Quality Assessment Tool (BOBQAT) score included 15 items and was shown to be valid, reliable, and consistent. Five items had a CVI of 1.0; 10 items had a CVI of 0.875. For weighting, 5 items received a weight of 10%, and 10 items a weight of 5%. CVR was 1.0 for 6 items and 0.75 for 9 items. For face validity, all items achieved a score above 5. For test-retest reliability, almost-perfect test-retest reliability was observed for 10 items, substantial agreement for 4 items, and moderate agreement for 1 item. For internal consistency, Cronbach's alpha was calculated to be 0.71. For concurrent criterion validity, Pearson's product-moment correlation was 0.56 (95% confidence interval [CI] = 0.38-0.70, P = .0001).

CONCLUSIONS

Cadaveric biomechanical and laboratory research can be quantitatively scored for quality based on the inclusion of a clear and answerable purpose, demographics, specimen condition, appropriate bone density, reproducible technique, appropriate outcome measures, appropriate loading conditions, appropriate load magnitude, cyclic loading, sample size calculation, proper statistical analysis, results consistent with methods, limitations considered, conclusions based on results, and disclosure of funding and potential conflicts.

CLINICAL RELEVANCE

Study quality assessments are important to evaluate internal and external validity and reliability and to identify methodological flaws and misleading conclusions. The BOBQAT score will help not only in the critical appraisal of cadaveric biomechanical studies but also in guiding the designs of such research endeavors.

Knowledge in Inflammatory Bowel Disease: Translation to Portuguese, Validation, and Clinical Application of the IBD-KNOW Questionnaire

Background/Aims

Inflammatory bowel disease (IBD)-related knowledge empowers patients, providing the development of adaptative coping strategies. Recently, a more comprehensive questionnaire for evaluating IBD-related knowledge was developed, the IBD-KNOW. The main aim of our study was to translate to Portuguese and validate the IBD-KNOW questionnaire. We also explored the predictors of high scores of disease-related knowledge and the effect of knowledge on health-related quality of life (HRQoL) and therapeutic adherence.

Methods

This is an observational, unicentric, and cross-sectional study. We translated and adapted the original English version of the IBD-KNOW questionnaire into Portuguese. Afterwards, IBD patients in the outpatient clinics were invited to fill out a multimodal form including the Portuguese version of IBD-KNOW, a visual analogue scale (VAS) of self-perceived knowledge, the Portuguese version of Short IBD Questionnaire (SIBDQ) and the Portuguese version of Morisky Adherence Scale 8-item (MMAS-8). Demographic and disease characteristics were collected. We assessed validity (through discriminate validity among non-IBD volunteers and correlation between IBD-KNOW and VAS) and reliability (through internal consistency, test-retest, and intraclass correlation). Statistical analysis was performed using SPSS version 25.0.

Results

The mean IBD-KNOW score was significantly different among non-IBD validation group (doctors: 23, nurses: 18, and non-medical volunteers: 12, p < 0.001). IBD-KNOW showed a high internal consistency (Cronbach's α 0.78) and intraclass correlation (0.90). As expected, the IBD-KNOW score was positively correlated with VAS for self-perceived knowledge (r = 0.45, p < 0.001). One hundred and one patients with IBD (54 with ulcerative colitis and 47 with Crohn's disease) completed the questionnaire at baseline. Multivariate analyses showed that a high IBD-KNOW score was associated with longer disease duration (OR: 2.59 [CI 1.11-5.74]; p = 0.04), previous hospitalization (OR: 3.63 [CI 1.301-9.96]; p = 0.01), current biologic treatment (OR: 3.37 [CI 1.31-8.65]; p = 0.02), and higher educational level (OR: 4.66 [CI 1.74-10.21]; p = 0.02). Moreover, there was no significant correlation between overall IBD-KNOW and SIBDQ, nor between IBD treatment adherence (MMAS-8 = 8) and a higher mean IBD-KNOW score (p = 0.552).

Conclusion

The Portuguese version of IBD-KNOW is a simple, valid, and reliable tool for assessing IBD-related knowledge. Longer disease duration, hospitalization, use of biologics, and higher educational level are associated with higher levels of knowledge. Higher patient knowledge was not associated with higher HRQoL and adherence to therapy.

A novel abbreviated version of the Luria neuropsychological diagnosis battery: reliability and convergent validity in Spanish older adults

OBJECTIVE

To estimate the test-retest and inter-rater reliability of the new Spanish abbreviated version of the Luria Neuropsychological Diagnosis (DNA-2) battery for older adults.

METHOD

A total of thirty cognitively healthy volunteers were examined in this study. The participants completed a comprehensive standardized assessment, encompassing cognitive and functional performance. Intraclass correlation coefficients (ICC) were used to examine test-retest and inter-rater reliability. One month was allowed between administrations. Furthermore, correlations between Luria DNA-2 (total and domain subscores) and other classical cognitive measures were explored.

RESULTS

The test-retest reliability on the overall Luria DNA-2 score was high (ICC= .834, 95% CI [.680, .917], p < .001). Furthermore, the inter-rater reliability for the total score demonstrated an excellent concordance between administrators (ICC= .990, 95% CI [.979, .995], p < .001). Positive and significant correlations were observed between Luria DNA-2 (both total and domain subscores) and the Addenbrooke's Cognitive Examination (ACE-III; ρ = .857, p < .001).

CONCLUSIONS

This study supports the adequate reliability of the Luria DNA-2, as an abbreviated neuropsychological battery, for assessing cognitive performance in Spaniards aged 55 years and older. Future studies should continue to explore the psychometric properties of the Luria DNA-2, particularly those related to its diagnostic validity for early detection of cognitive impairment.

Reliability of the Moover® 3D Inertial Motion Sensor in Greek Patients With Chronic Neck Pain in a Primary Care Urban Setting

Introduction Neck pain has a high lifetime prevalence and represents a significant health issue. Reduced active cervical range of motion (ACROM) has been found in neck pain patients. Inertial sensor technology can provide objective measurements to assess the impaired ACROM. Purpose Primarily, this study investigated the inter- and intra-rater reliability of the Moover® three-dimensional (3D) inertial motion sensor (Sensor Medica, Rome, Italy) in Greek patients with non-specific chronic neck pain. Secondly, the intra-rater reliability of the Neck Disability Index (NDI) was also assessed. Methods Fifty patients (18 males and 32 females) suffering from non-specific chronic neck pain participated in this study. Two physiotherapists measured separately each participant's ACROM in three planes, within a 48-hour period. The participants' position and the sequence and direction of the three cervical movements (cervical rotation, lateral flexion, and flexion-extension) were standardized. Results The inter-rater reliability intraclass correlation coefficient (ICC) values were good to excellent ranging from 0.77 to 0.95 for the first measurement and 0.85 to 0.95 for the second (p < 0.001). The intra-rater reliability ICC values were moderate to excellent ranging from 0.74 to 0.92 for the first rater and good to excellent ranging from 0.83 to 0.94 for the secondrater (p < 0.001). Intra-rater reliability of the overall NDI was indicated as good, and ICC was 0.80 (95%CI: 0.65-0.89; p < 0.001). ICC values for all sections were significant and ranged from 0.40 to 0.88. Conclusion This study showed the reliability of the Moover 3D inertial sensor for ACROM measurement in Greek patients with chronic neck pain. The NDI scale also showed good intra-rater reliability in the same sample. Both intra- and inter-rater reliability of the Moover 3D were proven to be acceptable over a 48-hour period. The specific sensor might have a potential application in a clinical setting.

Lower extremity deformity and its risk factors in patients with solitary osteochondromas

BACKGROUND

This study aimed to demonstrate the occurrence of lower extremity deformities and their risk factors in patients with solitary osteochondromas.

METHODS

We retrospectively reviewed consecutive patients with solitary osteochondromas around the knee. The laterality (left or right), involved bone (femur or tibia), tumor type (pedunculated or sessile), and direction (medial or lateral) were examined. The whole limb length (WLL), mechanical lateral distal femoral angle (mLDFA), and medial proximal tibial angle (MPTA) were measured using teleroentgenogram. Lower limb deformity was defined as a difference of more than 5° in mLDFA or MPTA in both lower extremities or a difference in WLL of more than 1 cm. Patients were divided into two groups, with deformity and without deformity.

RESULTS

Lower extremity deformities were observed in 8 of 83 patients. Significant difference in the type of osteochondroma (p = 0.004) between the groups was observed. Differences in sex, age, laterality, involved bone, direction, and distance from the physis to the osteochondroma between groups were not statistically significant. The sessile type of osteochondroma was a risk factor for lower limb deformity with an odds ratio of 24.0 according to Firth's logistic regression analysis.

CONCLUSION

In our cohort with solitary osteochondroma, lower limb deformities were observed in 8 (9.6%) out of the 83 patients and these were significantly associated with sessile-type tumors. Therefore, patients with sessile-type solitary osteochondroma around the knee require careful surveillance of lower limb alignment with whole leg teleroentgenogram.

Changes in femoral anteversion after intramedullary nailing for pediatric femoral shaft fracture: a multicenter study

BACKGROUND

The rotational change after using a flexible intramedullary (IM) nail for femoral shaft fractures has been a concern for many surgeons. Recently, a statistical shape model (SSM) was developed for the three-dimensional reconstruction of the femur from two-dimensional plain radiographs. In this study, we measured postoperative femoral anteversion (FAV) in patients diagnosed with femoral shaft fractures who were treated with flexible IM nails and investigated age-related changes in FAV using the SSM.

METHODS

This study used radiographic data collected from six regional tertiary centers specializing in pediatric trauma in South Korea. Patients diagnosed with femoral shaft fractures between September 2002 and June 2020 and patients aged < 18 years with at least two anteroposterior (AP) and lateral (LAT) femur plain radiographs obtained at least three months apart were included. A linear mixed model (LMM) was used for statistical analysis.

RESULTS

Overall, 72 patients were included in the study. The average patient age was 7.6 years and the average follow-up duration was 6.8 years. The average FAV of immediate postoperative images was 27.5 ± 11.5°. Out of 72 patients, 52 patients (72.2%) showed immediate postoperative FAV greater than 20°. The average FAV in patients with initial FAV > 20° was 32.74°, and the LMM showed that FAV decreased by 2.5° (p = 0.0001) with each 1-year increase from the time of initial trauma.

CONCLUSIONS

This study explored changes in FAV after femoral shaft fracture using a newly developed technology that allows 3D reconstruction from uncalibrated 2D images. There was a pattern of change on the rotation of the femur after initial fixation, with a 2.5° decrease of FAV per year.

Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay task

Empirical studies reporting low test-retest reliability of individual blood oxygen-level dependent (BOLD) signal estimates in functional magnetic resonance imaging (fMRI) data have resurrected interest among cognitive neuroscientists in methods that may improve reliability in fMRI. Over the last decade, several individual studies have reported that modeling decisions, such as smoothing, motion correction and contrast selection, may improve estimates of test-retest reliability of BOLD signal estimates. However, it remains an empirical question whether certain analytic decisions consistently improve individual and group level reliability estimates in an fMRI task across multiple large, independent samples. This study used three independent samples (Ns: 60, 81, 119) that collected the same task (Monetary Incentive Delay task) across two runs and two sessions to evaluate the effects of analytic decisions on the individual (intraclass correlation coefficient [ICC(3,1)]) and group (Jaccard/Spearman rho) reliability estimates of BOLD activity of task fMRI data. The analytic decisions in this study vary across four categories: smoothing kernel (five options), motion correction (four options), task parameterizing (three options) and task contrasts (four options), totaling 240 different pipeline permutations. Across all 240 pipelines, the median ICC estimates are consistently low, with a maximum median ICC estimate of .43 - .55 across the three samples. The analytic decisions with the greatest impact on the median ICC and group similarity estimates are the Implicit Baseline contrast, Cue Model parameterization and a larger smoothing kernel. Using an Implicit Baseline in a contrast condition meaningfully increased group similarity and ICC estimates as compared to using the Neutral cue. This effect was largest for the Cue Model parameterization; however, improvements in reliability came at the cost of interpretability. This study illustrates that estimates of reliability in the MID task are consistently low and variable at small samples, and a higher test-retest reliability may not always improve interpretability of the estimated BOLD signal.

Sample size calculation for data reliability and diagnostic performance: a go-to review

Sample size, namely the number of subjects that should be included in a study to reach the desired endpoint and statistical power, is a fundamental concept of scientific research. Indeed, sample size must be planned a priori, and tailored to the main endpoint of the study, to avoid including too many subjects, thus possibly exposing them to additional risks while also wasting time and resources, or too few subjects, failing to reach the desired purpose. We offer a simple, go-to review of methods for sample size calculation for studies concerning data reliability (repeatability/reproducibility) and diagnostic performance. For studies concerning data reliability, we considered Cohen's κ or intraclass correlation coefficient (ICC) for hypothesis testing, estimation of Cohen's κ or ICC, and Bland-Altman analyses. With regards to diagnostic performance, we considered accuracy or sensitivity/specificity versus reference standards, the comparison of diagnostic performances, and the comparisons of areas under the receiver operating characteristics curve. Finally, we considered the special cases of dropouts or retrospective case exclusions, multiple endpoints, lack of prior data estimates, and the selection of unusual thresholds for α and β errors. For the most frequent cases, we provide example of software freely available on the Internet.Relevance statement Sample size calculation is a fundamental factor influencing the quality of studies on repeatability/reproducibility and diagnostic performance in radiology.Key points• Sample size is a concept related to precision and statistical power.• It has ethical implications, especially when patients are exposed to risks.• Sample size should always be calculated before starting a study.• This review offers simple, go-to methods for sample size calculations.

Validity and reliability of a new clinician-rated tool for freezing of gait severity

PURPOSE

The Freezing of Gait Severity Tool (FOG Tool) was developed because of limitations in existing assessments. This cross-sectional study investigated its validity and reliability.

METHODS

People with Parkinson's disease (PD) were recruited consecutively from clinics. Those who could not walk eight-metres independently (with or without an assistive device), comprehend instructions, or with co-morbidities affecting walking were excluded. Participants completed a set of assessments including the FOG Tool, Timed Up and Go (TUG), and Freezing of Gait Questionnaire. The FOG Tool was repeated and those reporting no medication state change evaluated for test-retest reliability. Validity and reliability were investigated through Spearman's correlations and ICC (two-way, random). McNemar's test was applied to compare the FOG Tool and TUG on the proportion of people with freezing.

RESULTS

Thirty-nine participants were recruited [79.5%(n = 31) male; Median(IQR): age-73.0(9.0) years; disease duration-4.0(5.8) years]. Fifteen (38.5%) contributed to test-retest reliability analyses. The FOG Tool demonstrated strongest associations with the Freezing of Gait Questionnaire (ρ = 0.67, 95%CI 0.43-0.83). Test-retest reliability was excellent (ICC = 0.96, 95%CI 0.88-0.99). The FOG Tool had 6.2 times the odds (95%CI 2.4-20.4, p < 0.001) of triggering freezing compared to the TUG.

CONCLUSIONS

The FOG Tool appeared adequately valid and reliable in this small sample of people with PD. It was more successful in triggering freezing than the TUG.

Recurrent patellar dislocation patients with high-grade J-sign have multiple structural bone abnormalities in the lower limbs

PURPOSE

To explore the relationship between preoperative J-sign grading and structural bone abnormalities in patients with recurrent patellar dislocation (RPD).

METHODS

A retrospective study was conducted on RPD patients over 5 years. Patients were categorised based on J-sign grade into low (J- and J1+), moderate (J2+) and high groups (J3+). Trochlear dysplasia (TD) and osseous structures (femoral anteversion angle [FAA], knee torsion, tibial tuberosity-trochlear groove [TT-TG] distance, Caton-Deschamps index) were assessed and grouped according to risk factor thresholds. The χ2 test was used to compare composition ratio differences of structural bone abnormalities among the groups.

RESULTS

A total of 256 patients were included, with 206 (80.5%) females. The distribution of J-sign grade was as follows: 89 knees (34.8%) of low grade, 86 moderate (33.6%) and 81 high (31.6%). Among the five structural bone abnormalities, TD was the most common with a prevalence of 78.5%, followed by increased TT-TG at 47.4%. Excessive tibiofemoral rotation had the lowest occurrence at 28.9%. There were 173 (67.6%) patients who had two or more abnormalities, while 45 (17.6%) had four to five bony abnormalities. Among patients with any bony abnormality, the proportion of high-grade J-sign surpassed 40%. Patients with moderate and high-grade J-sign had more increased FAA and more pronounced patella alta (all p < 0.001). The proportion of excessive knee torsion and TD increased with increasing each J-sign grade, with the more notable tendency in knee torsion (high vs. moderate vs. low-grade: 61% vs. 22% vs 7%, p < 0.001). Furthermore, the higher J-sign grade was also associated with more combined bony abnormalities (p < 0.001). In the high-grade J-sign group, 90.2% of the knees had two or more bony risk factors and 40.7% had four or more, which were significantly higher than the moderate and low-grade J-sign groups (40.7% vs. 11.6% vs. 2.2%, p < 0.001).

CONCLUSION

In patients with a high-grade J-sign, over 90% of the lower limbs had two or more structural bone risk factors, and more than 40% had four or more. These proportions were significantly higher compared to knees with low-grade and moderate J-sign. In clinical practice, when treating high-grade patellar mal-tracking, it is important to focus on and correct these strongly correlated abnormal bone structures.

LEVEL OF EVIDENCE

Level III.

Test-retest reliability and validity of vagally-mediated heart rate variability to monitor internal training load in older adults: a within-subjects (repeated-measures) randomized study

BACKGROUND

Vagally-mediated heart rate variability (vm-HRV) shows promise as a biomarker of internal training load (ITL) during exergame-based training or motor-cognitive training in general. This study evaluated the test-retest reliability of vm-HRV during exergaming in healthy older adults (HOA) and its validity to monitor ITL.

METHODS

A within-subjects (repeated-measures) randomized study was conducted that included baseline assessments and 4 measurement sessions. Participants played 5 exergames at 3 standardized levels of external task demands (i.e., "easy", "challenging", and "excessive") in random order for 90 s. Test-retest reliability was assessed on the basis of repeated-measures analyses of variance (ANOVA), intraclass correlation coefficients (ICC3,1), standard errors of measurement (SEM), and smallest detectable differences (SDD). Validity was determined by examining the effect of game level on vm-HRV in the ANOVA.

RESULTS

Fourty-three HOA (67.0 ± 7.0 years; 58.1% females (25 females, 18 males); body mass index = 23.7 ± 3.0 kg·m-2) were included. Mean R-R time intervals (mRR) and parasympathetic nervous system tone index (PNS-Index) exhibited mostly good to excellent relative test-retest reliability with no systematic error. Mean SEM% and SDD% were 36.4% and 100.7% for mRR, and 44.6% and 123.7% for PNS-Index, respectively. Significant differences in mRR and PNS-Index were observed between standardized levels of external task demands, with mostly large effect sizes (mean r = 0.847). These results persisted irrespective of the type of neurocognitive domain trained and when only motoric and cognitive demands were manipulated while physical intensity was kept constant. The remaining vm-HRV parameters showed inconsistent or poor reliability and validity.

CONCLUSION

Only mRR and PNS-Index demonstrated reliable measurement and served as valid biomarkers for ITL during exergaming at a group level. Nonetheless, the presence of large SEMs hampers the detection of individual changes over time and suggests insufficient precision of these measurements at the individual level. Future research should further investigate the reliability and validity of vm-HRV with a specific focus on comparing different measurement methodologies and exercise conditions, particularly focusing on ultra-short-term HRV measurements, and investigate the potential implications (i.e., superiority to other markers of ITL or monitoring strategies?) of using vm-HRV as a biomarker of ITL.

The dynamic strength index is a reliable and feasible tool to assess neuromuscular performance in male and female handball players

The aim of this study was to explore the reliability and feasibility of the isometric mid-thigh pull (IMTP) and dynamic strength index (DSI) in semi-professional handball players (seventeen male and eighteen female). A cross-sectional design was used to determine the test-retest reliability of several kinetic metrics registered with a force plates. The peak force, peak relative force, rate of force development (RFD 0-250 ms), and impulse 0-250 ms were selected from the IMTP test, whereas the peak propulsive force was chosen from the countermovement jump test to obtain the DSI. The intraclass correlation coefficient (ICC), coefficient of variation (CV), standard error of the measurement (SEM) and smallest detectable difference (SDD) were calculated. A paired sample t-test was also performed. No significant differences were found between the testing sessions for all variables, except for peak propulsive force for all players (p = 0.036) and DSI for female players (p = 0.037). Reliability for all kinetic metrics was good to excellent (ICC = 0.78-0.97), with low variability (CV ≤ 8.64%), being the SEM scores lower than SDD. In conclusion, the IMTP test and DSI are highly reliable and feasible tools for assessing neuromuscular performance in semi-professional handball players.

Adapting the stroke therapy outcome measure for use by Multidisciplinary Teams: considering reliability

PURPOSE

The Therapy Outcome Measure (TOM) comprises many profession and client group-specific adapted scales based on the International Classification of Functioning Model, used by different Health Care Professionals (HCPs). A new Multidisciplinary stroke TOM scale (MDT Stroke TOMs) was developed by amalgamating the relevant scales. This study aimed to develop a scale to describe patients' abilities and improve communication and collaboration within the stroke Multidisciplinary Team (MDT). The present study investigated the inter-rater and intra-rater reliability of this adaptation.

MATERIALS AND METHODS

The MDT Stroke TOM Scale was developed by combining and rewording four profession-specific adapted TOM scales following iterative trials and discussions leading to an agreed version. 150 stroke Allied Health Professional (AHPs) and nurses were trained virtually in TOM and the MDT Stroke TOM Scale. Ten AHP and nursing raters from five professions evaluated ten composite stroke case studies for inter-rater reliability. Six participated in the intra-rater reliability review of the same three case studies at different time points. Reliability was quantified using intraclass correlation coefficients and measurement error using the smallest detectable change.

RESULTS

There was good to excellent concordance between the raters in terms of scoring. Raters' scores were also consistent. The MDT Stroke TOMs is being used consistently across the South West London Stroke Network.

CONCLUSION

The Stroke MDT TOMs is psychometrically robust and should assist with improving team work in the rehabilitation of stroke patients and their carers. Future research may use MDT Stroke TOM to promote interprofessional team working and facilitate communication in Stroke Rehabilitation.

Concurrent Validity and Reliability of Video-Based Approach to Assess Physical Function in Adults With Knee Osteoarthritis

OBJECTIVES

The aim of this study was to determine the concurrent validity and reliability of the Osteoarthritis Research Society International recommended performance-based tests delivered by video-based in adults with knee osteoarthritis.

METHODS

Thirty-two participants (aged 40-70 years; 15 men) undertook assessments of 4 performance-based tests via both video-based (real-time and recorded) and face-to-face approaches, on the same day. Outcome measures were performance-based test and the number of technical issues encountered. The performance-based tests included the 40-Meter Fast-Paced Walk Test (velocity, m/s), the 30-Second Chair Stand Test (number of repetitions), the Stair Climb Test (time, seconds), and the Timed "Up & Go" Test (time, seconds). The Bland-Altman limit of agreement measures, standard error of measurement (SEM), coefficient of variation (CV), minimal detectable changes, and bias (mean difference) were employed to analyze the concurrent validity between video-based and face-to-face approaches of the performance-based tests. Reliability was measured using intraclass correlation coefficients, CV, and SEM.

RESULTS

A high degree of concurrent validity for the Timed "Up & Go" Test (bias = -0.22), the 30-Second Chair Stand Test (bias = -0.22), the Stair Climb Test (bias = -0.31), and the 40-Meter Fast-Paced Walk Test (bias = -0.06) was found. SEM and CV values were within the acceptable level for concurrent validity. There was a high degree of reliability demonstrated for all tests analyzed. Intraclass correlation coefficient measures ranged from 0.95 to 1.00 for intrarater reliability, and from 0.95 to 0.99 for interrater reliability.

CONCLUSIONS

Video-based assessment of physical performance tests is a valid and reliable tool for measuring physical function among adults with knee osteoarthritis via Microsoft Teams (Microsoft Corp, Redmond, WA, USA).

IMPACT

Video-based assessment is a promising public health tool to measure physical function in adults with knee osteoarthritis.

The Reliability and Validity of the OneStep Smartphone Application for Gait Analysis among Patients Undergoing Rehabilitation for Unilateral Lower Limb Disability

An easy-to-use and reliable tool is essential for gait assessment of people with gait pathologies. This study aimed to assess the reliability and validity of the OneStep smartphone application compared to the C-Mill-VR+ treadmill (Motek, Nederlands), among patients undergoing rehabilitation for unilateral lower extremity disability. Spatiotemporal gait parameters were extracted from the treadmill and from two smartphones, one on each leg. Inter-device reliability was evaluated using Pearson correlation, intra-cluster correlation coefficient (ICC), and Cohen's d, comparing the application's readings from the two phones. Validity was assessed by comparing readings from each phone to the treadmill. Twenty-eight patients completed the study; the median age was 45.5 years, and 61% were males. The ICC between the phones showed a high correlation (r = 0.89-1) and good-to-excellent reliability (ICC range, 0.77-1) for all the gait parameters examined. The correlations between the phones and the treadmill were mostly above 0.8. The ICC between each phone and the treadmill demonstrated moderate-to-excellent validity for all the gait parameters (range, 0.58-1). Only 'step length of the impaired leg' showed poor-to-good validity (range, 0.37-0.84). Cohen's d effect size was small (d < 0.5) for all the parameters. The studied application demonstrated good reliability and validity for spatiotemporal gait assessment in patients with unilateral lower limb disability.

Psychometric properties of the Brazilian-Portuguese version of the Falls Behavioral Scale in people with Parkinson's disease

PURPOSE

To verify the psychometric properties of the Brazilian-Portuguese version of the Falls Behavioral (FaB-Brazil) Scale in Parkinson's disease (PD).

MATERIAL AND METHODS

Participants (n = 96) were assessed by disease-specific, self-report and functional mobility measures. Internal consistency of the FaB-Brazil scale was evaluated using Cronbach's alpha and inter-rater and test-retest reliability using intraclass correlation coefficients (ICC). The standard error of measurement (SEM), minimal detectable change (MDC), ceiling and floor effects, and convergent and discriminative validity were evaluated.

RESULTS

Internal consistency was moderate (α = 0.77). Excellent inter-rater (ICC = 0.90; p < 0.001) and test-retest (ICC = 0.91; p < 0.001) reliability were found. The SEM was 0.20 and MDC was 0.38. Ceiling and floor effects were not found. Convergent validity was established by the positive correlations between the FaB-Brazil scale and age, modified Hoehn and Yahr, PD duration, Movement Disorders Society-Unified Parkinson's Disease Rating Scale, Motor Aspects of Experiences of Daily Living, Timed Up & Go and 8-item Parkinson's Disease Questionnaire, and negative correlations between the FaB-Brazil scale and community mobility, Schwab & England, and Activities-specific Balance Confidence scale. Females showed greater protective behaviors than males; recurrent fallers showed greater protective behaviors than non-recurrent fallers (p < 0.05).

CONCLUSIONS

The FaB-Brazil scale is reliable and valid for assessing people with PD.

Validating the Physician Documentation Quality Instrument for Intensive Care Unit-Ward Transfer Notes

Background

Physician communication failures during transfers of patients from the intensive care unit (ICU) to the general ward are common and can lead to adverse events. Efforts to improve written handoffs during these transfers are increasingly prominent, but no instruments have been developed to assess the quality of physician ICU-ward transfer notes.

Objective

To collect validity evidence for the modified nine-item Physician Documentation Quality Instrument (mPDQI-9) for assessing ICU-ward transfer note usefulness across several hospitals.

Methods

Twenty-four physician raters independently used the mPDQI-9 to grade 12 notes collected from three academic hospitals. A priori, we excluded the "up-to-date" and "accurate" domains, because these could not be assessed without giving the rater access to the complete patient chart. Assessments therefore used the domains "thorough," "useful," "organized," "comprehensible," "succinct," "synthesized," and "consistent." Raters scored each domain on a Likert scale ranging from 1 (low) to 5 (high). The total mPDQI-9 was the sum of these domain scores. The primary outcome was the raters' perceived clinical utility of the notes, and the primary measures of interest were criterion validity (Spearman's ρ) and interrater reliability (intraclass correlation [ICC]).

Results

Mean mPDQI-9 scores by note ranged from 19 (SD = 5.5) to 30 (SD = 4.2). Mean note ratings did not systematically differ by rater expertise (for interaction, P = 0.15). The proportion of raters perceiving each note as independently sufficient for patient care (the primary outcome) ranged from 33% to 100% across the set of notes. We found a moderately positive correlation between mPDQI-9 ratings and raters' overall assessments of each note's clinical utility (ρ = 0.48, P < 0.001). Interrater reliability was strong; the overall ICC was 0.89 (95% confidence interval [CI], 0.80-0.85), and ICCs were similar among reviewer groups. Finally, Cronbach's α was 0.87 (95% CI, 0.84-0.89), indicating good internal consistency.

Conclusions

We report moderate validity evidence for the mPDQI-9 to assess the usefulness of ICU-ward transfer notes written by internal medicine residents.

Reliability and measurement error of a maximal voluntary toe plantarflexion measurement process

Despite the growing interest, information regarding the psychometric properties of maximal voluntary isometric toe plantarflexion force and rate of force development (RFD) is lacking. Hence, we investigate the test-retest reliability and measurement error of these outcome measurement instruments measured with a custom-built dynamometer. Twenty-six healthy adults participated in a crossed design with four sessions separated by 5-7 days. RFD was quantified using manual onset and calculating the impulse and the slope in the following time windows: 0-50 ms, 0-100 ms, 0-150 ms, 0-200 ms, 0-250 ms. We estimated the systematic bias of the mean, the intraclass correlation coefficient (ICC) and standard error of measurement (SEM) from the agreement and consistency models. The ICC and the SEM agreement for maximal voluntary isometric toe plantarflexion force along the perpendicular axis were respectively 0.87 (95%CI: 0.76, 0.93) and 27 N (22, 32), while along the resultant of the perpendicular and anterior posterior axis they were 0.85 (0.73, 0.92) and 29 N (23, 35). The results of the consistency model were similar as the estimated variance for session was closer to zero. A systematic bias of the mean between session 1 and 3 was found. For the RFD variables, the ICC agreement ranged from 0.35 to 0.65. The measurement process was found to be reliable to assess maximal voluntary isometric toe plantarflexion force but not RFD. However, a familiarization session is mandatory and these results need to be confirmed in less coordinated (e.g. aging population) individuals.

Development and Calibration of a PATCH Device for Monitoring Children's Heart Rate and Acceleration

INTRODUCTION

Current wearables that collect heart rate and acceleration were not designed for children and/or do not allow access to raw signals, making them fundamentally unverifiable. This study describes the creation and calibration of an open-source multichannel platform (PATCH) designed to measure heart rate and acceleration in children ages 3-8 yr.

METHODS

Children (N = 63; mean age, 6.3 yr) participated in a 45-min protocol ranging in intensities from sedentary to vigorous activity. Actiheart-5 was used as a comparison measure. We calculated mean bias, mean absolute error (MAE) mean absolute percent error (MA%E), Pearson correlations, and Lin's concordance correlation coefficient (CCC).

RESULTS

Mean bias between PATCH and Actiheart heart rate was 2.26 bpm, MAE was 6.67 bpm, and M%E was 5.99%. The correlation between PATCH and Actiheart heart rate was 0.89, and CCC was 0.88. For acceleration, mean bias was 1.16 mg and MAE was 12.24 mg. The correlation between PATCH and Actiheart was 0.96, and CCC was 0.95.

CONCLUSIONS

The PATCH demonstrated clinically acceptable accuracies to measure heart rate and acceleration compared with a research-grade device.

Validity and reliability of the Glittre-ADL test in individuals with idiopathic pulmonary fibrosis

BACKGROUND

Patients with idiopathic pulmonary fibrosis (IPF) often present with dyspnea, fatigue, and desaturation. These symptoms can be highly limiting, as they lead to a decrease in performing activities of daily living (ADL). Therefore, it is essential to evaluate the degree of functional limitation of these individuals.

OBJECTIVE

The present study aimed to evaluate the validity and reliability of the Glittre-ADL test (TGlittre) and its association with self-reported limitation in ADL and health-related quality of life (HRQoL) in patients with IPF.

METHODS

Twenty-seven individuals with IPF (60.5 ± 10.6 years), with forced vital capacity 2.26 ± 1.03 L (51.09 ± 20.62% of predicted) were assessed for the time spent in TGlittre, 6-minute walking distance (6MWD), limitation in ADL and HRQoL.

RESULTS

TGlittre was reliable (intraclass correlation coefficient3,1 = 0.96; P < .001); however, a learning effect of 10.6% was observed between the first and second execution of TGlittre. The time spent in TGlittre correlated with 6MWD, limitation in ADL, and disease-specific HRQoL (P < .05).

CONCLUSION

TGlittre is valid and reliable for assessing functional capacity in patients with IPF. Still, it presents a learning effect and should be performed twice when assessing functional capacity in clinical practice.

Measurement proprieties of the CROM instrument for assessing head posture, neck retraction and protraction

BACKGROUND

The CROM instrument is widely used clinically and in research to measure neck range of motion. However, its measurement proprieties during the assessment of protraction and retraction movements were not examined so far.

OBJECTIVE

To analyse the intra- and inter-rater reliability, the concurrent validity of the CROM for measuring head posture, retraction and protraction in healthy subjects.

METHODS

Thirty-three asymptomatic subjects were recruited and assigned in a random order to one of two raters. After a 10-min break, they were examined by a second rater (Assessment 1). After a 30-min break, both raters repeated the examination (Assessment 2). The examination consisted of measuring the head posture, maximum head protraction and maximum retraction. Each movement was repeated 3 times and measured simultaneously with the CROM and with a 3D capture system laboratory.

RESULTS

The intra-rater reliability of the CROM was excellent for both raters for head posture and all head movements (ICC>0.9, 95% CI: 0.82-0.99, p < 0.01). The inter-rater reliability was excellent for head posture (ICC>0.95, 95% CI: 0.92-0.98, p < 0.01) and good-to-excellent for all movements at both time-points (ICC = 0.73-0.98, 95%CI: 0.45-0.99, p < 0.01). The validity analysis showed moderate-to-strong correlation between instruments for the head posture and head movements [(r) = -0.47 to -0.78), 95% CI: 0.99 to -0.24, p < 0.01].

CONCLUSION

The CROM instrument has good-to-excellent reliability and adequate validity for measuring cervical position and displacement in the sagittal plane.

Test-retest reliability and longitudinal validity of drop vertical jump biomechanics during rehabilitation after ACL reconstruction

Hip and knee biomechanics measured during a drop vertical jump (DVJ) can be used to assess patients undergoing rehabilitation after anterior cruciate ligament (ACL) reconstruction. To confidently interpret such data for use as outcome measures, additional information about reliability and validity is required. Therefore, the objective of this study was to estimate the test-retest reliability and longitudinal validity of selected lower limb biomechanics assessed during a DVJ in patients undergoing rehabilitation after ACL reconstruction. Biomechanical analysis of the DVJ in primary unilateral ACL reconstruction patients (22.3 ± 5.5y) were tested twice within 1 week at 6 months post-surgery (n = 46), and again at 12 months post-surgery (n = 36). Peak and initial contact knee angles and moments, hip impulse, vertical ground reaction forces (VGRF), isokinetic knee extension and flexion strength, and global ratings of change (GRC) were assessed. Reliability was evaluated based on the 6-month post-surgery data using intraclass correlation coefficients (ICC2,1), standard errors of measurement and minimum detectable change. Longitudinal validity was evaluated by assessing change from 6 to 12 months, using standardized response means (SRM), and by assessing the correlation (Pearson's r) of change in landing biomechanics with change in strength, and GRC. ICCs ranged from 0.58 to 0.90 for peak knee abduction and flexion moments, 0.44-0.85 for knee flexion and abduction angles, 0.82-0.93 for VGRFs, and 0.42-0.65 for hip impulse. SRMs and correlations of change ranged from 0.00 to 0.50. Reliability and longitudinal validity of DVJ measures varied, ranging from poor-to-excellent; the present results assist in their interpretation when assessed during rehabilitation after ACL reconstruction.

Parallel-Forms Reliability and Minimal Detectable Change of the Four Telerehabilitation Version Mobility-Related Function Scales in Stroke Survivors

OBJECTIVE

To investigate the parallel-forms reliability, minimal detectable change with 95% confidence interval (MDC95), and feasibility of the 4 telerehabilitation version mobility-related function scales: Fugl-Meyer Assessment-lower extremity subscale (Tele-FMA-LE), Berg Balance Scale (Tele-BBS), Tinetti Performance Oriented Mobility Assessment-Gait subscale (Tele-POMA-G), and Rivermead Mobility Index (Tele-RMI).

DESIGN

Reliability and agreement study and cross-sectional study.

SETTING

Medical center.

PARTICIPANTS

Stroke survivors' ability to independently walk 3 meters with assistive devices, age of ≥18 years for participants and their partners, stable physical condition, and absence of cognitive impairment (N=60).

INTERVENTIONS

Not applicable.

MAIN OUTCOMES MEASURES

Parallel-forms reliability and MDC95 of Tele-FMA-LE, Tele-BBS, Tele-POMA-G, and Tele-RMI.

RESULTS

No significant differences (P>.05) were observed among the mean scores of the telerehabilitation version and face-to-face version mobility-related function scales. Intraclass correlation coefficients (ICCs) indicated good reliability for most scales, with Tele-FMA-LE, Tele-BBS, and Tele-RMI scores achieving values of 0.81, 0.78, and 0.84. Tele-POMA-G scores demonstrated moderate reliability (ICC=0.72). Weighted kappa (κw) showed good-to-excellent reliability for most individual items (κw>0.60). The MDCs of the Tele-FMA-LE, Tele-BBS, Tele-POMA-G, and Tele-RMI were 5.84, 8.10, 2.74, and 1.31, respectively. Bland-Altman analysis showed adequate agreement between tele-assessment and face-to-face assessment for all scales. The 5 dimensions affirm the robust feasibility of tele-assessment: assessment time, subjective fatigue perception, overall preference, participant satisfaction, and system usability.

CONCLUSIONS

The study demonstrates good parallel-forms reliability, MDC, and promising feasibility of the 4 telerehabilitation version mobility-related function scales (Tele-FMA-LE, Tele-BBS, Tele-POMA-G, and Tele-RMI) in survivors of stroke.

Enhanced clinical decisions for management of benign prostatic hyperplasia using patient-reported outcomes: protocol for a prospective observational study

BACKGROUND

Lower urinary tract symptoms (LUTS) due to benign prostatic hyperplasia (BPH) significantly impact quality of life among older men. Despite the prevalent use of the American Urological Association Symptom Index (AUA-SI) for BPH, this measure overlooks key symptoms such as pain and incontinence, underscoring the need for more comprehensive patient-reported outcome (PRO) tools. This study aims to integrate enhanced PROs into routine clinical practice to better capture the spectrum of LUTS, thereby improving clinical outcomes and patient care.

METHODS

This prospective observational study will recruit men with LUTS secondary to BPH aged ≥ 50 years from urology clinics. Participants will be stratified into medical and surgical management groups, with PRO assessments scheduled at regular intervals to monitor LUTS and other health outcomes. The study will employ the LURN Symptom Index (SI)-29 alongside the traditional AUA-SI and other non-urologic PROs to evaluate a broad range of symptoms. Data on comorbidities, symptom severity, and treatment efficacy will be collected through a combination of electronic health records and PROs. Analyses will focus on the predictive power of these tools in relation to symptom trajectories and treatment responses. Aims are to: (1) integrate routine clinical tests with PRO assessment to enhance screening, diagnosis, and management of patients with BPH; (2) examine psychometric properties of the LURN SIs, including test-retest reliability and establishment of clinically meaningful differences; and (3) create care-coordination recommendations to facilitate management of persistent symptoms and common comorbidities measured by PROs.

DISCUSSION

By employing comprehensive PRO measures, this study expects to refine symptom assessment and enhance treatment monitoring, potentially leading to improved personalized care strategies. The integration of these tools into clinical settings could revolutionize the management of LUTS/BPH by providing more nuanced insights into patient experiences and outcomes. The findings could have significant implications for clinical practices, potentially leading to updates in clinical guidelines and better health management strategies for men with LUTS/BPH.

TRIAL REGISTRATION

This study is registered in ClinicalTrials.gov (NCT05898932).