Psychometric properties of the WHOQOL-BREF(PT) in a sample of elderly citizens

Background

The goal of this article was to research the psychometric properties of the WHOQOL-BREF(PT) instrument in a sample of elderly citizens residing in a rural area in their own homes or at family members’ or friends’ homes and to compare the results: (i) to those reported by the team of Portuguese researchers that undertaken the instrument's translation/validation to the Portuguese language and (ii) to those reported internationally by the World Health Organization Quality of Life group. An overall quality of life scoring (QOL₂₄—all facets) is also proposed in this article as novelty. The correlation level between QOL₂₄ and the instrument’s general facet was also investigated.

Methods

This was a cross-sectional study with a sample of 351 elderly citizens (46.4% males and 53.6% females) randomly selected from the official dataset of the Local Health Unit of Baixo Alentejo. All the data were collected by health professionals at the participants’ homes following the structured interview methodology and using the WHOQOL-BREF(PT) instrument. Three different structural equation models were developed: (i) a first-order confirmatory factor analysis, to assess the instrument’s psychometric properties; (ii) a hierarchical second-order confirmatory factor analysis model, to allow determining the QOL₂₄ scoring; and (iii) a more generic structural equation model, to investigate the correlation level between QOL₂₄ and the instrument’s general facet.

Results

The WHOQOL-BREF(PT) showed an “almost very good” goodness of fit (comparative fit index of 0.949 and Tucker-Lewis index of 0.943), an adequate internal consistency (Cronbach’s alpha: from 0.64 to 0.90; composite reliability: from 0.59 to 0.88) and tolerable convergent validity (average variance extracted: from 0.374 to 0.614). However, discriminant validity was not reached because strong correlations between the first-order factors (four QOL domains) were obtained, together with low values of the average variance extracted. The scoring of QOL domains and QOL₂₄, determined as weighted averages (proposed in this article as novelty) were significantly different than those determined as unweighted averages. The standardized correlation coefficient between QOL₂₄ and the instrument’s general facet was of 0.89 (statistically highly significant).

Conclusions

The WHOQOL-BREF(PT) is a psychometrically sound instrument to assess the QOL of the considered population sample. However, the QOL domains were found strongly intertwined. More studies are necessary to validate the weighted average scoring strategy of QOL domains and QOL₂₄. Concurrent validity between QOL₂₄ and the instrument’s general facet was considered as “strong”.

A novel scale for suspicion of psychogenic nonepileptic seizures: development and accuracy

OBJECTIVE

The differential diagnosis between epileptic and psychogenic nonepileptic seizures (PNES) is challenging, yet suspicion of PNES is crucial to rethink treatment strategies and select patients for diagnostic confirmation through video EEG (VEEG). We developed a novel scale to prospectively suspect PNES.

METHODS

First, we developed a 51-item scale in two steps, based upon literature review and panel expert opinion. A pilot study verified the applicability of the instrument, followed by a prospective evaluation of 158 patients (66.5% women, mean age 33 years) who were diagnosed for prolonged VEEG. Only epileptic seizures were recorded in 103 patients, and the other 55 had either isolated PNES or both types of seizures. Statistical procedures identified 15 items scored between 0 and 3 that best discriminated patients with and without PNES, with a high degree of consistency.

RESULTS

Internal consistency reliability of the scale for suspicion of PNES was 0.77 with Cronbach's Alpha Coefficient and 0.95 with Rasch Item Reliability Index, and performance did not differ according to the patient's gender. For a cut-off score of 20 (of 45) points, area under the curve was 0.92 (95% IC: 0.87-0.96), with an accuracy of 87%, sensitivity of 89%, specificity of 85%, positive predictive value of 77%, and negative predictive value of 94% (95% IC) for a diagnosis of PNES.

CONCLUSIONS

The scale for suspicion of PNES (SS-PNES) has high accuracy to a reliable suspicion of PNES, helping with the interpretation of apparent seizure refractoriness, reframing treatment strategies, and streamlining referral for prolonged VEEG.

Transcultural adaptation of the neck disability index to mexican spanish and assessment of its psychometric properties

PURPOSE

To transculturally adapt the Neck Disability Index to Mexican Spanish (NDI-Mx) and to evaluate its psychometric properties.

METHODS

Translation and transcultural adaptation of the NDI were conducted according to published guidelines. The test-retest reliability of the NDI-Mx was assessed with intraclass correlation coefficient (ICC_3,1), the student t-test, standard error of measurement, minimal detectable change and Bland-Altman plot. Cronbach's α coefficient was used to evaluate internal consistency. Floor and ceiling effects were also evaluated. Convergent validity was assessed by comparison of the NDI-Mx with the Northwick Park Neck Pain Questionnaire (NPQ) through the Spearman correlation coefficient. Finally, a confirmatory factor analysis (CFA) was conducted.

RESULTS

The sample was composed of 113 subjects (38 men and 75 women) with a mean age of 30 (SD, 12.19) years. All items of the NDI-Mx showed good test-retest reliability (ICC_3,1 = 0.86) and good internal consistency (Cronbach's α = 0.85). Floor and ceiling effects were not observed. There was good convergent validity with a high correlation between NDI-Mx and NPQ (ρ = 0.83). The CFA revealed that a one-factor solution fitted adequately the data (χ²(32) = 41.18, p = .13).

CONCLUSION

The NDI-Mx seems to be a valid and reliable tool that can be used in clinical practice and research on Mexican populations with neck pain.

Psychometric Analysis for fear of COVID-19 Scale (FCV-19S) and its association with depression in patients with diabetes: A cross sectional study from a Tertiary Care Centre in Karachi, Pakistan

BACKGROUND AND AIMS

To assess the psychometric properties of the Fear of COVID-19 (FCV-19S) scale and to determine its associated factors among the Pakistani patients with diabetes.

METHODS

This observational study was conducted in 24-h helpline service, a department of Baqai Institute of Diabetology and Endocrinology (BIDE). Study duration was from August to September 2020. The target population was registered adult patients with type 2 diabetes aged >16 years. Baseline demographic details were obtained from hospital management system of BIDE. Forward-backward translation method was used to translate the existing Fear scale (FCV-19S). Symptoms of depressive disorder were assessed through Patient Health Questionnaire (PHQ9).

RESULTS

Total of 380 participants with mean age 51.93 ± 12.03 years contributed in the study. Three factors loading and item correlation of fear COVID-19 explained 96% of total variance having unidimensional Cronbach's alpha of 0.881. All demographic indicators that showed significance in univariate model were included in multivariate model. Females had more fear for COVID-19 compared to males (OR = 1.73, 95% CI (1.15-2.6)), whereas current smokers had also showed 4 times more fear than non-smokers (OR = 4.19, 95% CI (1.18-14.83). Depression assessed by PHQ9 showed maximum fear of COVID-19 in participants with moderate depression.

CONCLUSION

FCV-19S had adequate psychometric properties for assessing effects of pandemic in people with diabetes attending tertiary care center.

Evaluating the psychometric properties of the e-cigarette barriers to cessation scale

Evidence suggests that electronic cigarette (e-cigarette) users have difficulty quitting e-cigarettes. The Electronic Cigarette Barriers to Cessation Scale (E-BCS) was developed to assess barriers to cessation among e-cigarette users. Yet, no work has evaluated the psychometric properties of the E-BCS. The current study utilized data from two independent samples of adult e-cigarette users to evaluate the psychometric properties and structure of the E-BCS. In Study 1, competing models of the E-BCS were evaluated, and initial construct validity and reliability were explored using data from 599 adult e-cigarettes users (52.3% female, M_age = 35.16 years, SD = 10.30). Results supported a unidimensional structure for the E-BCS comprised of 18 items. In Study 2, the unidimensional structure of the 18-item E-BCS and construct validity were evaluated among a sample of 516 current e-cigarette using adults (52.3% female; M_age = 34.74, SD = 11.37). Results confirmed the unidimensional structure, measurement invariance across sex, and construct validity across related e-cigarette behavior constructs and psychopathology for the E-BCS. These findings suggest that the E-BCS is a potentially useful clinical instrument for measuring barriers that may interfere with e-cigarette cessation.

Validity and reliability of the motivation for physical activity (RM4-FM) questionnaire

There is a lack of validated instruments measuring motivation for physical activity (RM4-FM) in the Finnish language. The study examined the translated RM4-FM instrument's psychometric properties in a sample of healthy, older Finnish adults. RM4-FM was translated and linguistically validated adhering to published guidelines. 65-75-year olds (n=102), completed the RM4-FM, the physical activity acceptance questionnaire (PAAQ) and sociodemographic characteristics questionnaires electronically. The RM4-FM was readministered one month after the initial assessment. RM4-FM translated well into Finnish. Motivation dimension scores were skewed towards high internal and low external motivation. A floor effect was confirmed in the external regulation dimension and a ceiling effect was confirmed in the identified regulation dimension. Confirmatory factor analysis indicated inadequacy of the four-dimension model. Separate assessment of each of the four motivation dimensions with Exploratory factor analysis showed unidimensionality for all dimensions. Exploratory factor analysis provided a best-fit model of three factors (influence of other people, intention of well-being and emotional aspect of motivation). Readministration of the instruments showed good test-retest reliability in all motivation dimensions. Female gender, higher education, and higher PAAQ score were associated with higher internal motivation and lower external motivation scores. The Finnish version of the RM4-FM instrument provides valid and reliable scores in assessing motivation for physical activity in healthy, older Finnish adults. The score distributions suggested shortages in the scale when evaluating internal motivation. The three-factor model of the RM4-FM provided more favorable structural validity compared to the original version.

Measuring functional outcome in Dupuytren's disease: A systematic review of patient-reported outcome measures

BACKGROUND

Functional impairments related to Dupuytren's disease (DD) can be assessed using patient-reported outcome measures (PROMs). A systematic review was published in 2013 on outcome measures for assessing treatment in individuals with DD; however, several articles have since been published on this matter.

PURPOSE

To conduct a systematic review to analyze the quality and content of the evidence on the psychometric properties of PROMs used in individuals with DD.

STUDY DESIGN

Systematic review.

METHODS

CINAHL, EBM reviews, Embase, Medline, and Web of Science were searched to identify studies evaluating the psychometric properties of PROMs used with individuals with DD. All studies retained were appraised by two independent assessors using two validated critical appraisal tools.

RESULTS

Fifteen articles on the psychometric properties of 10 PROMs were included. Construct validity and responsiveness were the most studied. Eighty percent of the studies were of good to very good methodological quality according to MacDermid's Critical appraisal checklist for psychometric articles, whereas 67% of the studies comported risks of bias according to the COSMIN checklist. Of the 10 PROMs, three were specifically developed for DD but remain mostly under-studied for their psychometric properties (≤ 2 studies for the SDSS and DIF-CHUM). The QuickDASH, MHQ, BriefMHQ, and URAM present moderate to good convergent validity. Test-retest reliability was found to be good for the MHQ, briefMHQ, URAM, SDSS, SF-36, and the multi-attribute of the HUI-3. The MHQ and BriefMHQ are highly responsive.

CONCLUSION

There is a need for more psychometric studies on the PROMs used with individuals with DD. However, to date, the results included in this systematic review support that the MHQ and briefMHQ are the PROMs with the most acceptable psychometric properties.

Cross-cultural adaptation of the Perceived Risk of HIV Scale in Brazilian Portuguese

BACKGROUND

Valid and reliable instruments are needed to measure the multiple dimensions of perceived risk. The Perceived Risk of HIV Scale is an 8-item measure that assesses how people think and feel about their risk of infection. We set out to perform a cross-cultural adaptation of the scale to Brazilian Portuguese among key populations (gay, bisexual and other men who have sex with men and transgender/non-binary) and other populations (cisgender heterosexual men and cisgender women).

METHODS

Methodological study with cross-sectional design conducted online during October/2019 (key populations [sample 1] and other populations) and February-March/2020 (key populations not on pre-exposure prophylaxis [sample 2]). Cross-cultural adaptation of the Perceived Risk of HIV Scale followed Beaton et al. 2000 guidelines and included confirmatory factor analysis, differential item functioning (DIF) using the Multiple-Indicator Multiple-Cause model, and concurrent validity to verify if younger individuals, those ever testing for HIV, and engaging in high-risk behaviors had higher scores on the scale.

RESULTS

4342 participants from key populations (sample 1 = 235; sample 2 = 4107) and 155 participants from other populations completed the measure. We confirmed the single-factor structure of the original measure (fit indices for sample 1 plus other populations: CFI = 0.98, TLI = 0.98, RMSEA = 0.07; sample 2 plus other populations: CFI = 0.97, TLI = 0.95, RMSEA = 0.09). For the comparisons between key populations and other populations, three items (item 2: "I worry about getting infected with HIV", item 4: "I am sure I will not get infected with HIV", and item 8: "Getting HIV is something I have") exhibited statistically significant DIF. Items 2 and 8 were endorsed at higher levels by key populations and item 4 by other populations. However, the effect of DIF on overall scores was negligible (0.10 and 0.02 standard deviations for the models with other populations plus sample 1 and 2, respectively). Those ever testing for HIV scored higher than those who never tested (p < .001); among key populations, those engaging in high-risk behaviors scored higher than those reporting low-risk.

CONCLUSION

The Perceived Risk of HIV Scale can be used among key populations and other populations from Brazil.

Psychometric properties of the Thai Mood and Feelings Questionnaire (MFQ) for adolescent depression

BACKGROUND

The Mood and Feelings Questionnaire (MFQ) is a widely used screening tool for child and adolescence depression but has not been validated with young people in Thailand. This study aimed to assess the reliability and validity and to determine the optimal clinical cut-off of the Thai MFQ.

METHODS

The Thai MFQ was evaluated in two parts. In part 1, The MFQ was translated and back translated into the Thai language and piloted on a small number of Thai adolescents. Then 1275 young people aged 12-18 years from three secondary schools in Thailand completed the MFQ and related measures of depression. In part 2, 138 students were invited to take part in a structured diagnostic interview (the Thai translation of the Kiddie Schedule for Affective Disorders and Schizophrenia for School-Age Children -Present and Lifetime Version (the K-SADS-PL). Of those, 103 students were interviewed and completed the Thai MFQ a second time to assess test-retest reliability. Receiver Operating Characteristics (ROC) analyses were conducted to evaluate diagnosis accuracy and examine the optimal cut-off score of the Thai MFQ.

RESULTS

The Thai MFQ had excellent internal consistency (α = 0.92) and good to moderate test-retest reliability in 2-week and 4-week intervals. The Thai MFQ also had good convergent validity with related measures of depression. The ROC analyses demonstrated that the Thai MFQ also had excellent accuracy distinguishing between depressed and non-depressed adolescents [AUC = 0.95, 95% CI [0.92, 0.99]. A total score of 28 on the Thai MFQ was the optimal cut-off score (sensitivity was 0.97 and specificity was 0.83).

DISCUSSION

The Thai MFQ demonstrated excellent psychometric properties and accurately distinguished between depressed and non-depressed adolescents. It is appropriate to use as a screening measure to identify adolescents with depression in community settings in Thailand.

Rasch model of the bridging social capital questionnaire

Bridging social capital is defined as the connections between individuals who are dissimilar with respect to socioeconomic status and other characteristics. We previously identified an important gap in the literature related to its measurement. We developed and validated a scale to measure bridging social capital to be used in Latinx immigrant populations living in the U.S using Classical Test Theory. The structure of the questionnaire comprised the following sub-scales: Socializing in the work place (5 items); Participation in community activities (16 items); Socializing in community activities (5 items); Contact with similar/different people (7 items); Assistance (17 items); Trust of institutions, corporations and other people (14 items); and Trust of intimate people (3 items). Although basic psychometric validation was performed on our original instrument (e.g., content and construct validity, internal consistency reliability), modern testing theory recommends a more comprehensive set of evaluations, including assessment of data quality, scaling assumptions, targeting, reliability, validity and responsiveness. Rasch measurement theory (RMT) is one of the Modern Test Theory methods that assesses the extent to which rigorous measurement is achieved. In the present work, our objective was to further evaluate the instrument using CTT and to use modern psychometric techniques to further validate the questionnaire and create version 2 (v2) using a new sample (N = 224). We developed a Rasch model of the questionnaire to evaluate item fit statistics, item category thresholds, person separation index (PSI), local dependency, differential item functioning (DIF), unidimensionality and targeting and item locations. Assistance was the most problematic sub-scale of all, as item-to-total correlations ranged from 0.27 to 0.66. There were no disordered thresholds on any item, either examined as part of the overall score or as part of sub-scales. However, the analysis provided evidence of the need to modify some of the sub-scales as there was lack of support for unidimensionality or fit to the Rasch model. The Bridging Social Capital Questionnaire v2 has 61 items (compared to 67 in version 1). Our questionnaire may be suitable for adaptation to other immigrant groups in different countries.

•

The measurement of bridging social capital is crucial in underserved populations.

•

It is crucial to use valid questionnaires to evaluate bridging social capital.

•

The use of modern psychometric techniques to evaluate questionnaires is key.

•

We present a validated questionnaire using the Rasch model.

The Persian Version of the COVID-19 Phobia Scale (Persian-C19P-S) and the Differences in COVID-19-Related Phobic Reactions in Patients with Anxiety Disorders

Coronavirus disease 2019 (COVID-19) is a pandemic outbreak increasing several psychological distress, such as anxiety and phobia, and may affect patients with anxiety disorders. A scale has been recently designed to assess COVID-19-related phobic reactions named the COVID-19 Phobia Scale (C19P-S). The present study aimed to evaluate factor structure, reliability, and validity of the Persian version of the C19P-S (Persian-C19P-S) in patients with anxiety disorders and to compare COVID-19-related phobia among these patients. Three hundred patients with anxiety disorders completed the Persian-C19P-S and other scales assessing anxiety traits (e.g., the Short Health Anxiety Inventory (SHAI), the Health Concerns Questionnaire-54 (HCQ-54), and the Patient Health Questionnaire-4 (PHQ-4)) and COVID-19-related distress (e.g., the COVID Stress Scales (CSS) and the Fear of COVID-19 Scale (FCV-19)). The results showed that the Persian-C19P-S replicated the four-factor structure of the original C19P-S. Internal consistency and test-retest reliability coefficients evidenced the reliability of the scale. The validity of the scale (convergent and discriminant validity) was confirmed. Patients who had generalized anxiety and panic disorders showed higher phobic reactions related to COVID-19 than those with social anxiety disorder and specific phobia. This study indicates that the Persian version of the C19P-S is a valid scale to be used in Iranian patients with anxiety disorders to evaluate COVID-19-related phobia. Moreover, COVID-19-related phobic reactions are higher in some specific types of anxiety disorders.

"Reading the Mind in the Eyes Test": Translated and Korean Versions

OBJECTIVE

The Reading the Mind in the Eyes Test (RMET) was developed by using Caucasian eyes, which may not be appropriate to be used in Korean. The aims of the present study were 1) to develop a Korean version of the RMET (K-RMET) by using Korean eye stimuli and 2) to examine the psychometric properties of the Korean-translated version of the RMET and the K-RMET.

METHODS

Thirty-six photographs of Korean eyes were selected. A total of 196 (101 females) healthy subjects were asked to take the Korean-translated version of the RMET and K-RMET. To assess internal consistency reliability, Cronbach's alpha coefficients were computed, and test-retest reliability was assessed by the intraclass correlation coefficient (ICC) and Bland-Altman plots. Confirmatory factor analysis (CFA) and item analysis were also conducted.

RESULTS

Internal consistency, measured by Cronbach's alpha, was 0.542 for the Korean-translated version of the RMET, and 0.540 for the K-RMET. Test-retest reliability (n=25), measured by the ICC, was 0.787 for the Korean-translated version of the RMET, and 0.758 for the K-RMET. In CFA, the assumed single and 3-factor model fit indices were not good in the both types of RMETs. There was difficulty in discrimination in nine items of the Korean-translated version of the RMET and 10 items of the K-RMET.

CONCLUSION

The psychometric properties of both the Korean-translated version of the RMET and the K-RMET are acceptable. Both tests are applicable to the clinical population, as well as the general population in Korea.

Korean Version of the Thought-Action Fusion Scale: The Evidence for Its Psychometric Properties

OBJECTIVE

The Thought-Action Fusion Scale (TAFS) is a self-reported instrument used to measure a cognitive bias, namely, thoughtaction fusion (TAF), in which intrusive thoughts have moral and actual consequences. The aim of this study is to investigate the reliability and validity of the Korean version of the 19-item TAFS (K-TAFS) in Korean samples.

METHODS

In this study, 628 university students and 93 patients with obsessive-compulsive disorder (OCD) completed the K-TAFS and several other psychological scales. Descriptive analyses, correlations, group comparisons, and exploratory and confirmatory factor analyses were performed.

RESULTS

The results of the exploratory and confirmatory factor analyses indicated a two-factor structure with TAF-Morality and TAFLikelihood that best fits the data in the university sample. The reliability analyses showed that TAFS and its factors had excellent internal consistencies. Regarding the concurrent validity, positive correlations were observed between TAF-Likelihood and cognitive fusion, while the TAFS scores did not show any consistent correlations with other symptoms such as depression and anxiety. Compared to the university students, the OCD patients showed higher TAFS scores and their obsessive-compulsive symptoms were significantly associated with both TAF-Morality and TAF-Likelihood.

CONCLUSION

Overall, the findings of this study support the reliability and validity of the K-TAFS.

Observing cultural competence of healthcare professionals: A systematic review of observational assessment instruments

OBJECTIVE

Observational instruments are preferred for assessment of cultural competence. The aim of the current study is to identify observational instruments to assess cultural competence in healthcare providers and dieticians specifically and assess their psychometric properties.

METHODS

A systematic review was conducted in Cinahl, Cochrane, EMBASE, PsycInfo, Pubmed, and Web of Science using search terms related to cultural competency and measurement properties. Methodological quality of the selected studies of observational cultural competence instruments in dieticians, other healthcare professionals and psychological counsellors and the measurement properties of instruments were assessed using the COSMIN checklist.

RESULTS

From 11,913 articles, six articles on five instruments were selected. Instruments were targeted at health professionals and counsellors only, and designed for face-to-face communication (n = 4) or verbal responses to videotaped simulated interactions (n = 1). The instruments' content varied largely, with main focus on attitude, and little on knowledge and skills. The measurement properties were suboptimal.

CONCLUSION

No observational instrument are available to evaluate cultural competence of dieticians. Studies on psychometric properties of instruments targeted at other health professionals lack methodological rigour.

PRACTICE IMPLICATIONS

Future work should focus on developing an instrument that encompasses both 'general' cultural competences necessary for all healthcare professionals and dietetic specific competences.

Validity and Reliability of Interactive Virtual Reality in Assessing the Musculoskeletal System: a Systematic Review

PURPOSE OF REVIEW

Assessment of the musculoskeletal system requires consideration of its integrated function with the nervous system. This may be assisted by using valid and reliable methods that simulate real-life situations. Interactive virtual reality (VR) technology may introduce various auditory and visual inputs that mimic real-life scenarios. However, evidence supporting the quality and strength of evidence regarding the adequacy of its psychometric properties in assessing the musculoskeletal function has not been evaluated yet. Therefore, this study reviewed the validity and reliability of VR games and real-time feedback in assessing the musculoskeletal system.

RECENT FINDINGS

Nine studies were included in quality assessment. Based on outcome measures, studies were categorized into range of motion (ROM), balance, reaction time, and cervical motion velocity and accuracy. The majority of the studies were of moderate quality and provided evidence of VR adequate concurrent and, in some cases, known-groups validity. Also, VR showed high intra-rater reliability for most of the measured outcomes. Based on the included studies, there is a limited promising evidence that interactive VR using games or real-time feedback is highly valid and reliable in assessing ROM in asymptomatic participants and patients with chronic neck pain and radial fracture. For the remaining outcomes, evidence is limited to draw a robust conclusion. Future studies are recommended to test VR psychometric properties in different patients' population using a rigor research methodology.

Psychometric properties of the Persian version of preschool age psychiatric assessment (PAPA) for attention-deficit/hyperactivity disorder: Based on DSM-5

Childhood and adolescence psychiatric disorders affect subsequent stages; early diagnosis of these disorders, such as attention-deficit/hyperactivity disorder (ADHD), is necessary. There is no reliable and valid diagnostic interview for ADHD in Asian Persian or Farsi speaking countries. The DSM 5-based version of the interview was sent to the 14 child and adolescent and general psychiatrists to ensure the validity of the ADHD section of the PAPA interview through an online website. Out of 59 health centers, 15 centers were selected via systematic random sampling. Three hundred children participated in the study. ADHD questions of the PAPA had the power to differentiate, with a sensitivity of 0.92, a specificity of 0.01. It had positive diagnostic value = 95.83 %, negative diagnostic value = 98.91 %, negative correlation ratio = 0.12, overall diagnostic accuracy = 98.67 % and diagnostic chance ratio = 2085.35. ADHD questions of the PAPA diagnostic interview can diagnose ADHD in preschool as a reliable tool based on DSM-5.

Psychometric Properties of the Persian Montreal Cognitive Assessment in Mild Cognitive Impairment and Alzheimer Disease

Introduction

The Montreal Cognitive Assessment (MoCA) is a cognitive screening test widely used in clinical practice and suited for the detection of Mild Cognitive Impairment (MCI). The aims were to evaluate the psychometric properties of the Persian MoCA as a screening test for mild cognitive dysfunction in Iranian older adults and to assess its accuracy as a screening test for MCI and mild Alzheimer disease (AD).

Method

One hundred twenty elderly with a mean age of 73.52 ± 7.46 years participated in this study. Twenty-one subjects had mild AD (MMSE score ≤21), 40 had MCI, and 59 were cognitively healthy controls. All the participants were administered the Mini-Mental State Examination (MMSE) to evaluate their general cognitive status. Also, a battery of comprehensive neuropsychological assessments was administered.

Results

The mean score on the Persian version of the MoCA and the MMSE were 19.32 and 25.62 for MCI and 13.71 and 22.14 for AD patients, respectively. Using an optimal cutoff score of 22 the MoCA test detected 86% of MCI subjects, whereas the MMSE with a cutoff score of 26 detected 72% of MCI subjects. In AD patients with a cutoff score of 20, the MoCA had a sensitivity of 94% whereas the MMSE detected 61%. The specificity of the MoCA was 70% and 90% for MCI and AD, respectively.

Discussion

The results of this study show that the Persian version of the MoCA is a reliable screening tool for detection of MCI and early stage AD. The MoCA is more sensitive than the MMSE in screening for cognitive impairment, proving it to be superior to MMSE in detecting MCI and mild AD.

Validity and reliability of the French version of the Pediatric Quality of Life Inventory™ brain tumor module

INTRODUCTION

Assessing health-related quality of life (HRQoL) is an increasingly important aspect of standard care in pediatric oncology. Currently, there is a gap in the availability of French questionnaires to assess the quality of life of French-speaking pediatric brain tumor (PBT) patients, which has important implications in the care of this population. The first aim of this study was to translate the original English Pediatric Quality of Life Inventory™ (PedsQL) brain tumor module version into French. The second aim was to describe the stability, repeatability and convergent validity of the French PedsQL brain tumor module.

METHODS

A total of 61 PBT patients were included in this study. Among them, 15 children and 20 parents participated in the translation process. As part of the validation study, 48 children and 48 parents answered the PedsQL brain tumor module twice, and the PedsQL generic core scales and the patient-reported outcomes measurement information system (PROMIS-37 pediatric profile v2.0) questionnaire were administered once to the participants. The mean age of the 25 boys and 23 girls was 8.3 ± 4.8 years. For temporal stability, we used intraclass correlation coefficients (ICCs), for repeatability, we used the Bland and Altman method to assess the accuracy at a 1-week interval, and we used Pearson's correlation coefficients for convergent validity between the PedsQL brain tumor module, PedsQL general module and the PROMIS.

RESULTS

Temporal stability for the parent proxy-reports (average ICC = 0.98) and the child self-reports (average ICC = 0.98) were excellent. There was a high absolute stability over a 1-week interval for the parent proxy-reports (ICC > 0.96) and child self-reports (ICC > 0.96). Convergent validity between parent proxy-reports and child self-reports was supported by positive correlations for five subscales. Children reported higher scores in cognitive problems and the movement and balance parameters than their parents and reported lower scores on the worry parameter than their parents.

CONCLUSION

The strong psychometric properties of the French version of the PedsQL brain tumor module indicate that it is a validate and reliable questionnaire to measure HRQoL in PBT patients. The availability of a French version of the PedsQL brain tumor module supports the wider dissemination of the assessment of HRQOL in PBT patients.

Measuring test-retest reliability (TRR) of AMSTAR provides moderate to perfect agreement - a contribution to the discussion of the importance of TRR in relation to the psychometric properties of assessment tools

Background

Systematic Reviews (SRs) can build the groundwork for evidence-based health care decision-making. A sound methodological quality of SRs is crucial. AMSTAR (A Measurement Tool to Assess Systematic Reviews) is a widely used tool developed to assess the methodological quality of SRs of randomized controlled trials (RCTs). Research shows that AMSTAR seems to be valid and reliable in terms of interrater reliability (IRR), but the test retest reliability (TRR) of AMSTAR has never been investigated. In our study we investigated the TRR of AMSTAR to evaluate the importance of its measurement and contribute to the discussion of the measurement properties of AMSTAR and other quality assessment tools.

Methods

Seven raters at three institutions independently assessed the methodological quality of SRs in the field of occupational health with AMSTAR. Between the first and second ratings was a timespan of approximately two years. Answers were dichotomized, and we calculated the TRR of all raters and AMSTAR items using Gwet’s AC1 coefficient. To investigate the impact of variation in the ratings over time, we obtained summary scores for each review.

Results

AMSTAR item 4 (Was the status of publication used as an inclusion criterion?) provided the lowest median TRR of 0.53 (moderate agreement). Perfect agreement of all reviewers was detected for AMSTAR-item 1 with a Gwet’s AC1 of 1, which represented perfect agreement. The median TRR of the single raters varied between 0.69 (substantial agreement) and 0.89 (almost perfect agreement). Variation of two or more points in yes-scored AMSTAR items was observed in 65% (73/112) of all assessments.

Conclusions

The high variation between the first and second AMSTAR ratings suggests that consideration of the TRR is important when evaluating the psychometric properties of AMSTAR.. However, more evidence is needed to investigate this neglected issue of measurement properties. Our results may initiate discussion of the importance of considering the TRR of assessment tools. A further examination of the TRR of AMSTAR, as well as other recently established rating tools such as AMSTAR 2 and ROBIS (Risk Of Bias In Systematic reviews), would be useful.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12874-021-01231-y.

Inter-rater reliability and test-retest reliability of the Performance and Fitness (PERF-FIT) test battery for children: a test for motor skill related fitness

Background

The Performance and Fitness (PERF-FIT) test battery for children is a recently developed, valid assessment tool for measuring motor skill-related physical fitness in 5 to 12-year-old children living in low-income settings. The aim of this study was to determine: (1) inter-rater reliability and (2) test-retest reliability of the PERF-FIT in children from 3 different countries (Ghana, South Africa and the Netherlands).

Method

For inter-rater reliability 29 children, (16 boys and 13 girls, 6–10 years) were scored by 2 raters simultaneously. For test–retest reliability 72 children, (33 boys and 39 girls, 5–12 years) performed the test twice, minimally 1 week and maximally 2 weeks apart. Relative and absolute reliability indices were calculated. ANOVA was used to examine differences between the three assessor teams in the three countries.

Results

The PERF-FIT demonstrated excellent inter-rater reliability (ICC, 0.99) and good test-retest reliability (ICC, ≥ 0.80) for 11 of the 12 tasks, with a poor ICC for the Jumping item, due to low spread in values. A significant difference between first and second test occasion was present on half of the items, but the differences were small (Cohen’s d 0.01–0.17), except for Stepping, Side jump and Bouncing and Catching (Cohen’s d 0.34, 0.41 and 0.33, respectively). Overall, measurement error, Limits of Agreement and Coefficient of Variation had acceptable levels to support clinical use. No systematic dissimilarities in error were found between first and second measurement between the three countries but for one item (Overhead throw).

Conclusions

The PERF-FIT can reliably measure motor skill related fitness in 5 to 12-year-old children in different settings and help clinicians monitor levels of fundamental motor skills (throwing, bouncing, catching, jumping, hopping and balance), power and agility.

Content validity and psychometric evaluation of the Functional Assessment of Chronic Illness Therapy-Fatigue scale in patients with chronic lymphocytic leukemia

PURPOSE

Fatigue is a prominent symptom in individuals with chronic lymphocytic leukemia (CLL). This work evaluates the content validity and psychometric properties of the Functional Assessment of Chronic Illness Therapy-Fatigue scale (FACIT-Fatigue) in patients with CLL to determine if it is fit for purpose in CLL research.

METHODS

The FACIT-Fatigue yields a 13-item total score from a five-item symptom subscale and an eight-item impact subscale. To evaluate content validity, cognitive debriefing interviews were conducted with 40 patients with CLL in the first-line or relapsed or refractory setting. Psychometric properties, including structural validity, internal consistency, construct and known-groups validity, were investigated using data from a phase 3 trial in relapsed or refractory CLL (NCT02970318).

RESULTS

Interviewed patients considered the FACIT-Fatigue items relevant to their CLL experience, understood the terminology and agreed with response options. Confirmatory factor analysis confirmed the presence of symptom and impact subscales, but also supported unidimensionality of the FACIT-Fatigue. The FACIT-Fatigue total, symptom and impact subscales demonstrated good internal consistency (Cronbach's coefficient α > 0.85 and McDonald's omega ω > 0.90), and strong correlations with relevant EORTC QLQ-C30 scales (all Spearman's r ≥ 0.5). Known-groups validity was shown by significant differences between groups defined by baseline performance status, hemoglobin level and constitutional symptoms (all p < .0001). Cluster analysis supported FACIT-Fatigue score thresholds of 30 and 34 to define a severe fatigue population.

CONCLUSIONS

Content validity and psychometric evaluation in patients with CLL demonstrated that the FACIT-Fatigue has good psychometric properties and is fit for purpose in CLL.

The resilience scale: factorial structure, reliability, validity, and parenting-related factors among disaster-exposed adolescents

BACKGROUND

In this study, we examined psychometric properties of the Chinese version of the Resilience Scale (RS) and parenting-related factors associated with resilience among disaster-exposed adolescents.

METHODS

Eighteen months after the earthquake, a total of 1266 adolescents (43.4% male, mean age = 15.98; SD = 1.28) were assessed using the RS, the Post-traumatic Stress Disorder Self-Rating Scale, the Depression Self-rating Scale for Children, the Screen for Child Anxiety Related Emotional Disorders, and Parental Bonding Instrument.

RESULTS

Through exploratory factor analyses (EFAs) and parallel analysis, responses were characterized into a 3-factor structure: personal competence, meaningfulness, and acceptance of self and life. Cronbach's alpha coefficient for the RS was 0.89 and the test-retest reliability coefficient was 0.72. In terms of predictive validity, resilience was found to be a significant predictor for PTSD, depression, and anxiety. Multiple regression analysis showed that maternal parenting styles were significant predictors of resilience after adjusting for gender, age, sibling number, and earthquake experiences.

CONCLUSIONS

The Chinese version of RS is a reliable and valid tool for assessing resilience among adolescent survivors after disasters. The implications for research and resilience-oriented interventions were also discussed.

Investigating psychometric properties of the arm activity measure - Thai version (ArmA-TH) sub-scales using the Rasch model

BACKGROUND

This study investigated the ArmA-TH sub-scale measurement properties based on item response theory using the Rasch model.

METHODS

Patients with upper limb hemiplegia resulting from cerebrovascular and other brain disorders were asked to complete the ArmA-TH questionnaire. Rasch analysis was performed to test how well the ArmA-TH passive and active function sub-scales fit the Rasch model by investigating unidimensionality, response category functioning, reliability of person and item, and differential item functioning (DIF) for age, sex, and education.

RESULTS

Participants had stroke or other acquired brain injury (n = 185), and the majority were men (126, 68.1 %), with a mean age of 55 (SD 22). Most patients (91, 49.2 %) had graduated from elementary/primary school. For the ArmA-TH passive function scale, all items had acceptable fit statistics. The scale's unidimensionality and local independence were supported. The reliability was acceptable. A disordered threshold was found for five items, and none indicated DIF. For the ArmA-TH active function scale, one item was misfit and three were locally dependent. The reliability was good. No items showed DIF. All items had disordered thresholds, and the data fitted the Rasch model better after rescoring.

CONCLUSIONS

Both sub-scales of ArmA-TH fitted the Rasch model and were valid and reliable. The disordered thresholds should be further investigated.

[Standardized documentation of health-related quality of life in patients with psoriatic arthritis : Validation of the German version of the psoriatic arthritis quality of life (PsAQoL) questionnaire]

BACKGROUND

The standardized assessment of health-related quality of life is becoming increasingly more important. The English questionnaire on psoriatic arthritis quality of life (PsAQoL) is a disease-specific instrument for measuring the quality of life of patients with psoriatic arthritis (PsA). The aim of the present study was to translate the PsAQoL into German and to validate the German version in a cohort of PsA patients recruited from routine care.

METHOD

The translation and validation of the PsAQoL questionnaire was carried out in a stepwise procedure involving affected patients with PsA. After translation of the original English questionnaire the German version was evaluated in a field test. The psychometric features of the questionnaire were then examined in a PsA cohort from routine care. In addition to the construct and group validity, the reliability of the questionnaire was tested using test-retest reliability and internal consistency. The physical functioning was measured with the health assessment questionnaire (HAQ) and domains of the quality of life with the Nottingham health profile (NHP).

RESULTS

In a field test with 10 patients the German version of the PsAQoL questionnaire proved to be relevant, easily understandable and feasible (processing time 4.7 ± 2.1 min). A total of 126 patients (37.3% male, age 55.6 ± 11.3 years) were included in the validation cohort. The PsAQoL showed moderate correlation with the HAQ (r = 0.65) and moderate to good correlation with the NHP (subdomains r = 0.58-0.75). The internal consistency was high (Cronbach's α 0.92) and reliability in patients with stable disease course was very good (Spearman correlation coefficient 0.94). The PsAQoL can differentiate between different patient groups.

CONCLUSION

The German translation of the PsAQoL provides a valid disease-specific instrument for the standardized assessment of health-related quality of life in patients with PsA. The psychometric characteristics of this questionnaire are comparable with the original English version. The German PsAQoL can therefore be recommended for clinical and scientific application.

The supportive supervisory scale: psychometric properties in Chinese health care aides samples

Objective

To sinicize the Supportive Supervisory Scale (SSS) and analyze the psychometric properties of the Chinese version of SSS (SSS-C).

Methods

The SSS (the original English version) was firstly sinicized and adjusted, then its psychometric properties were examined in 300 health care aides from four long-term care (LTC) facilities. SPSS 22.0 was used to process the data and calculate the reliability and validity.

Results

The 15-item SSS-C had satisfactory internal consistency (Cronbach’s α coefficient = 0.852), split half reliability (Spearman-Brown coefficient = 0.834) and test–retest reliability (Pearson correlation coefficient = 0.784), and three factors were extracted. If the four items with their communality < 0.4 were deleted, the remaining 11 items could explain 55.654% of the total variance. The discriminant validity of the SSS-C varied significantly between sites.

Conclusions

The Chinese version of SSS can be used to effectively measure the supervisory support of the nurses within the LTC settings.