Determining the MMPI-3 SUI scale's cross-sectional and prospective utility in suicide risk assessment

OBJECTIVE

In-depth suicide risk assessments are particularly important to long-term suicide prevention. Broadband measures of psychopathology, such as the Minnesota Multiphasic Personality Inventory (MMPI) instruments, assess suicide risk factors and various mental health comorbidities. With the recent release of the MMPI-3, the Suicidal/Death Ideation (SUI) scale underwent revisions to improve its construct validity and detection of suicide risk factors. Thus, we hypothesized the MMPI-3 SUI scale would demonstrate medium to large associations with suicidal experience and behaviors, future ideation, and interpersonal risk factors of suicide.

METHODS

A sample of 124 college students screened for elevated depressive symptoms completed a brief longitudinal study. Participants completed a baseline session including the MMPI-3 and criterion measures and three brief follow-ups every 2 weeks.

RESULTS

SUI scores were most robustly associated with increased risk for past suicidal ideation, planning, and perceived burdensomeness. Prospectively assessed suicidal ideation was also meaningfully associated with SUI. SUI scale elevations indicate an increased risk of suicide-related risk factors.

CONCLUSION

The MMPI-3 is a valuable tool to inform long-term suicide prevention for those experiencing elevated depressive symptoms as the SUI scale can assess past, current, and future suicide-related risk factors, including suicidal ideation and behaviors.

The Kessler Psychological Distress Scale in Australian adolescents: Analysis of the second Australian Child and Adolescent Survey of Mental Health and Wellbeing

INTRODUCTION

The 10-item Kessler Psychological Distress Scale (K10) is used to screen adolescents for mental disorders in Australian clinical practice; however, there are no Australian adolescent normative data.

METHODS

Data were drawn from a nationally representative sample (N = 2964) of Australian adolescents (11-17 years). This study had three aims: (1) to examine concurrent validity between the K10 and Strengths and Difficulties Questionnaire (SDQ) emotional symptoms subscale, (2) to establish normative Australian adolescent K10 data and (3) to determine optimal K10 cut-off scores for screening for major depressive disorder (MDD) via receiver operator characteristic curve analysis and stratum-specific likelihood ratios.

RESULTS

The K10 and SDQ emotional symptoms scales were moderately correlated (rs = 0.63, p < 0.001). Older female adolescents reported higher total K10 scores compared with younger female adolescents (15-17 years: M = 20.2, standard error [SE] = 0.3; 11-14 years: M = 16.8, SE = 0.3) and male adolescents (11-14 years: M = 16.6, SE = 0.2; 15-17 years: M = 16.0, SE=0.2). K10 scores to optimally discriminate those with and without MDD varied by age and sex and had low specificities. Stratum-specific likelihood ratios indicated adolescents with a K10 score of ≥30 will have a 12.9 (95% confidence interval = [10.2, 16.2]) increased likelihood of MDD.

CONCLUSION

The K10 has utility for assessing psychological distress in health care and epidemiological research in Australian adolescents. Adolescents with K10 scores in the 'very high' range are at increased risk of MDD. Further assessment of these young people is indicated to identify those with or at risk of developing MDD.

Corrigendum: Construct validity of the General Health Questionnaire (GHQ-12) in patients with COVID-19 and its demographic and medical correlates

[This corrects the article DOI: 10.3389/fpsyg.2023.1132154.].

Patient-Reported Outcomes Measurement Information System Physical Function and Global Physical Health Subscale Strongly Correlate and Perform Similarly to the Knee Injury and Osteoarthritis Outcome Score-Physical Function Short Form

BACKGROUND

Arthroplasty surgeons use a variety of patient-reported outcome measures (PROMs) to assess functional well-being, including the Knee Injury and Osteoarthritis Outcome Score (KOOS) Physical Function short form (KOOS-PS), Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function Short Form 10a (PROMIS PF SF 10a), and PROMIS Global-10 Physical Health subscale. However, there is a paucity of literature assessing their concurrent validity and performance.

METHODS

Between June 2016 and December 2020, patient visits at an arthroplasty clinic for knee concerns were identified. Patients who completed KOOS-PS, PROMIS PF SF 10a, and PROMIS Global-10, including its physical and mental health subscales, at the same visit were identified. Spearman rho (ρ) correlations were calculated and ceiling and floor effects identified. Overall, 5,303 patient encounters were included.

RESULTS

Among physical function domains, strong correlation existed between the KOOS-PS and PROMIS PF SF 10a (ρ = 0.76, P < .001), KOOS-PS and PROMIS Global Physical Health (ρ = 0.71, P < .001), and PROMIS PF SF 10a and PROMIS Global Physical Health (ρ = 0.78, P < .001). No physical function-focused PROM had an appreciable floor effect (ie, at or more than 1%). The KOOS-PS had a small but measurable ceiling effect (n = 105 [2.0%]).

CONCLUSIONS

All of the examined PROMs are acceptable to measure the functional status of patients with knee pathology, with the PROMIS Global-10 also being able to capture elements of mental health too. The PROMIS Global-10 may be of most value of the PROMs assessed, as the United States Centers for Medicare and Medicaid Services already incorporate the mental health component into new alternative payment models.

The reliability and validity of the 30-second chair stand test and modified four square step test in persons with multiple sclerosis

BACKGROUND

The 30-second Chair Stand Test (30s-CST) and Modified Four Square Step Test (mFSST) are used to determine the functional status of individuals with multiple sclerosis (MS). No other studies have demonstrated the reliability and validity of the 30s-CST and mFSST.

PURPOSE

To identify the test-retest reliability, concurrent validity and the known-group validity of the 30s-CST and mFSST in persons with MS.

METHODS

A total of 64 persons with MS were enrolled. 30s-CST, mFSST, Timed Up and Go Test (TUG) and Five Times Sit to Stand (FTST) tests were performed. 30s-CST and mFSST were conducted again one-hour later.

RESULTS

The mean age of the persons with MS were 37.9±11.3 years. The test-retest reliability of the 30s-CST and mFSST were excellent (ICC30s-CST = 0.974, 95%CI: 0.95-0.98; ICCmFSST = 0.992, 95%CI: 0.98-0.99). The 30s-CST was strongly correlated with FTST and TUG (r1 = -0.871, p1 = 0.0001; r2 = -0.741,p2 = 0.0001). There was a strong relationship between mFSST with TUG and FTST (r1 = 0.781,p1 = 0.0001;r2 = 0.788,p2 = 0.0001). The SEM95 and MDC95 values of the 30s-CST and mFSST were 0.41/1.13 and 0.34/0.94, respectively. Besides, there were significant differences between the persons with or without fall history in 30s-CST (MD: 1.66, CI: 0.27 to 3.05, p = .019) and mFSST CST (MD:-2.70, CI: -4.73 to -0.67, p = .010) performances.

CONCLUSION

The 30s-CST and mFSST are both valid and reliable in mildly-disabled individuals with MS.

A Digital Box and Block Test for Hand Dexterity Measurement: Instrument Validation Study

BACKGROUND

The Box and Block Test (BBT) measures unilateral gross manual dexterity and is widely used in clinical settings with a wide range of populations, including older people and clients with neurological disorders.

OBJECTIVE

In this study, we present a newly developed digitized version of the BBT, called the digital BBT (dBBT). The physical design is similar to the original BBT, but the dBBT contains digital electronics that automate the test procedure, timing, and score measurement. The aim of this study is to investigate the validity and reliability of the dBBT.

METHODS

We performed measurements at 2 time points for 29 healthy participants. BBT and dBBT were used at the first measurement time point, and dBBT was used again at the second measurement time point. Concurrent validity was assessed using the correlation between BBT and dBBT, the paired t test, and the Bland-Altman analysis. Test-retest reliability and interrater reliability were examined using the interclass correlation coefficient (ICC) by repeated measures with the dBBT within an interval of 10 days.

RESULTS

Our results showed moderate concurrent validity (r=0.48, P=.008), moderate test-retest reliability (ICC 0.72, P<.001), a standard error of measurement of 3.1 blocks, and the smallest detectable change at a 95% CI of 8.5 blocks. Interrater reliability was moderate with an ICC of 0.67 (P=.02). The Bland-Altman analysis showed sufficient accuracy of the dBBT in comparison with the conventional BBT.

CONCLUSIONS

The dBBT can contribute to objectifying the measurement of gross hand dexterity without losing its important characteristics and is simple to implement.

Evaluating and Comparing the Correlation and Performance of PROMIS and FAAM ADL in a Foot and Ankle Patient Population

BACKGROUND

There is a paucity of literature assessing 2 of the commonly used static Patient-Reported Outcomes Measurement Information System (PROMIS) forms (PROMIS Global-10 and PROMIS Physical Function Short Form 10a [PF SF 10a]) and the Foot and Ankle Ability Measure Activities of Daily Living (FAAM ADL).

METHODS

The PROMIS Global-10, PROMIS PF SF 10a, and FAAM ADL were compared among new foot and ankle patients. Spearman rho (ρ) correlations were calculated, and ceiling and floor effects were determined.

RESULTS

The FAAM ADL demonstrated strong correlations with PROMIS PF SF 10a, P = .88, 95% confidence interval (CI): 0.86-0.90, P < .001, and PROMIS Global-10 Physical Health (P = .75, 95% CI: 0.71-0.78, p < .001). The FAAM ADL and PROMIS Global-10 Mental Health demonstrated a moderate correlation (P = .41, 95% CI: 0.34-0.47, P < .001). No PROM demonstrated an appreciable floor effect. The PROMIS Global-10 Physical Health demonstrated the lowest ceiling effect (n=11 [1.6%]).

CONCLUSION

Because the PROMIS Global-10 captures physical health adequately, provides mental health insight, and performs as well (if not better), we recommend the PROMIS Global-10 among the PROMs studied.Level of Evidence: Level III.

Measuring Depression in Young Adults: Preliminary Development of an English Version of the Teate Depression Inventory

Depression is a common and debilitating condition that impacts individuals with various cultural backgrounds, medical conditions, and life circumstances. Thus, assessment tools need to be useful among different cultural groups. The 21-item Teate Depression Inventory (TDI) was developed in Italy, is designed to assess major depression, and focuses on cognitive and affective rather than somatic symptoms. This study aims to examine the factor structure and concurrent validity of the TDI English version among a non-clinical population in the United States. Participants included 398 adults (mean age 19.89 years, SD = 2.72, range: 18 to 46 years old) who completed the TDI and The Center for Epidemiologic Studies Depression Scale-Revised (CESD-R). The results supported a three-factor bifactor structure of the TDI (Positive Affect, Negative Affect, and Daily Functioning), which largely corresponds to the Tripartite Model of affective disorders. These findings support the use of TDI scores as measures of depressive symptoms among U.S. young adults, offering researchers and practitioners a brief and useful tool.

Construct validity of the General Health Questionnaire (GHQ-12) in patients with COVID-19 and its demographic and medical correlates

Introduction

The present cross sectional study aimed to evaluate the construct and criterion validity, reliability, and gender and age differences of the 12-item General Health Questionnaire (GHQ-12) among hospitalized patients with COVID-19 in 2020. The criterion validity was assessed via its link with perceived stress, sleep quality, daily life activities, and demographic and medical characteristics.

Methods

A total of 328 COVID-19 patients (55.8% men; Mage = 50.49, SD = 14.96) completed the GHQ-12, the Perceived Stress Scale (PSS), the Pittsburgh Sleep Quality Index (PSQI), the Activities of Daily Life (ADL)-Katz Scale, and the Lawton Instrumental Activities of Daily Living Scale (IADL).

Results

Among 13 factorial models, the three-factor model (successful coping, self-esteem, and stress) was shown to have the best fit. GHQ-12 was positively associated with PSQI, PSS, Hyperlipidemia, psychiatry disorders, hospitalization duration, the change in sleep time, and use of sleeping pills, and negatively correlated with educational level, and the number of family members. The GHQ-12 also had a negative correlation with ADL and IADL in over 60 years of age group. Females scored higher on total GHQ-12 scores, compared to males. Finally, the hospitalization duration was longer for patients over 60 (mean = 8.8 days, SD = 5.9) than patients under 60 (mean = 6.35 days, SD = 5.87).

Discussion

Overall, the findings provided evidence that mental distress in patients with COVID-19 is correlated with high perceived stress, low sleep quality, low ADL and IADL, and a range of demographic features and medical conditions. Designing psychological interventions for these patients that target the aforementioned correlates of mental distress is warranted.

The Validity of Hawkin Dynamics Wireless Dual Force Plates for Measuring Countermovement Jump and Drop Jump Variables

Force plate testing is becoming more commonplace in sport due to the advent of commercially available, portable, and affordable force plate systems (i.e., hardware and software). Following the validation of the Hawkin Dynamics Inc. (HD) proprietary software in recent literature, the aim of this study was to determine the concurrent validity of the HD wireless dual force plate hardware for assessing vertical jumps. During a single testing session, the HD force plates were placed directly atop two adjacent Advanced Mechanical Technology Inc. in-ground force plates (the "gold standard") to simultaneously collect vertical ground reaction forces produced by 20 participants (27 ± 6 years, 85 ± 14 kg, 176.5 ± 9.23 cm) during the countermovement jump (CMJ) and drop jump (DJ) tests (1000 Hz). Agreement between force plate systems was determined via ordinary least products regression using bootstrapped 95% confidence intervals. No bias was present between the two force plate systems for any of the CMJ and DJ variables, except DJ peak braking force (proportional bias) and DJ peak braking power (fixed and proportional bias). The HD system may be considered a valid alternative to the industry gold standard for assessing vertical jumps because fixed or proportional bias was identified for none of the CMJ variables (n = 17) and only 2 out of 18 DJ variables.

Implementation of a Canine Ergonomic Abdominal Simulator for Training Basic Laparoscopic Skills in Veterinarians

The validity of the CALMA Veterinary Lap-trainer simulator (CVLTS) for training basic veterinary laparoscopic skills was assessed and compared to a simple collapsible mobile box trainer. Ten veterinarian surgeons with no experience in laparoscopic surgery and four experts with at least two years of experience in minimally invasive surgery (MIS) were included. The training curriculum included object transfer, non-woven gauze cutting with curved scissors, and interrupted and continuous intracorporeal sutures, which were practiced on the CVLTS. The initial and final assessments were carried out in both the CVLTS and in a collapsible mobile simulator. These were video-recorded and evaluated by external experts using the Objective Structured Assessment of Technical Skills (OSATS) and a specific scale evaluation in a double-blinded schedule. The time, angular displacement, number, and movement smoothness were recorded using a hands movement assessment system (HMAS). Through a survey, the face validity and content were evaluated. The data were analyzed by a Pearson's proportions comparison or Mann Whitney U test and a bilateral Student's t-test. The experimental group OSATS, specific scores, and HMAS values, with the exception of the smoothness of movements, significantly improved after training, with no statistically significant differences compared to the expert group. No differences were found between the two simulators. The experts' and experimental participants' CVLTS mean score was 4.8. Our data support the CVLTS validations for laparoscopic surgery basic skills training.

Measures of Maximal Tactile Pressures during a Sustained Grasp Task Using a TactArray Device Have Satisfactory Reliability and Concurrent Validity in People with Stroke

Sensor-based devices can record pressure or force over time during grasping and therefore offer a more comprehensive approach to quantifying grip strength during sustained contractions. The objectives of this study were to investigate the reliability and concurrent validity of measures of maximal tactile pressures and forces during a sustained grasp task using a TactArray device in people with stroke. Participants with stroke (n = 11) performed three trials of sustained maximal grasp over 8 s. Both hands were tested in within- and between-day sessions, with and without vision. Measures of maximal tactile pressures and forces were measured for the complete (8 s) grasp duration and plateau phase (5 s). Tactile measures are reported using the highest value among three trials, the mean of two trials, and the mean of three trials. Reliability was determined using changes in mean, coefficients of variation, and intraclass correlation coefficients (ICCs). Pearson correlation coefficients were used to evaluate concurrent validity. This study found that measures of reliability assessed by changes in means were good, coefficients of variation were good to acceptable, and ICCs were very good for maximal tactile pressures using the average pressure of the mean of three trials over 8 s in the affected hand with and without vision for within-day sessions and without vision for between-day sessions. In the less affected hand, changes in mean were very good, coefficients of variations were acceptable, and ICCs were good to very good for maximal tactile pressures using the average pressure of the mean of three trials over 8 s and 5 s, respectively, in between-day sessions with and without vision. Maximal tactile pressures had moderate correlations with grip strength. The TactArray device demonstrates satisfactory reliability and concurrent validity for measures of maximal tactile pressures in people with stroke.

Can rehabilitation adherence among stroke patients be measured using a single item?

AIMS AND OBJECTIVES

To assess the concurrent validity between logbooks and a single-item rehabilitation adherence measurement for patients with stroke. Agreement between caregivers and patients and between caregivers and physical therapists regarding a single-item measurement was investigated, and its predictive validity was explored.

BACKGROUND

Adherence to therapy is a primary determinant of treatment success. There are no standard instruments for measuring rehabilitation adherence available for stroke patients.

DESIGN

Prospective longitudinal study.

METHODS

Seventy-five patients with stroke were recruited, measured four times and followed for 6 months. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) checklist was used to ensure comprehensive reporting. Adherence was documented in logbooks, and single-item measurements were compared. Predictive validity was explored by assessing associations between adherence levels, self-care ability and health-related quality of life. The Spearman's correlation coefficients, weighted kappa, and generalised estimating equations statistics were used to explore the concurrent validity, measurement agreement, and predictive validity, respectively.

RESULTS

Logbook records had a fair correlation (r_s  = .23, p = .04) with the single-item rehabilitation adherence measurements. There was moderate agreement (kappa = 0.42, p < .001) between caregiver and patient assessments and fair agreement (kappa = 0.29, p = .017) between caregiver and physical therapist assessments of patients' rehabilitation adherence levels. Perfect rehabilitation adherence, based on the logbook and single-item measurements, predicted better scores for self-care ability and quality of life than imperfect rehabilitation adherence during 6 months after inclusion.

CONCLUSIONS

There was fair concurrent validity between logbooks and single-item rehabilitation adherence measurements and moderate and fair adherence measure agreement between caregivers and patients and caregivers and physical therapists, respectively. Logbooks and single-item rehabilitation adherence measurements had adequate predictive validity.

RELEVANCE TO CLINICAL PRACTICE

Single-item rehabilitation adherence measurement is a workable and straightforward method to assess stroke patients' rehabilitation adherence in busy clinical care settings. Caregivers can represent stroke patients regarding their reported rehabilitation adherence.

PATIENT OR PUBLIC CONTRIBUTION

Patients were diagnosed with stroke in the study hospital. Rehabilitation physicians transferred patients to a research nurse who then screened them for the inclusion criteria and invited them and their family caregivers to participate in this study if they met the requirements. We also recruited seven physical therapists responsible for the physical therapy of the study participants. After participants signed informed consent, the research nurse encouraged participants to respond to research questions face to face, including rehabilitation adherence data, daily physical function, and quality of life. Each participant was measured four times at baseline and at 1, 3, and 6 months after inclusion in this study. Physical therapists had to score their patients' rehabilitation adherence levels before discharge.

TRIAL REGISTRATION DETAILS

Not applicable.

Concurrent validity and reliability of suicide risk assessment instruments: A meta-analysis of 20 instruments across 27 international cohorts

OBJECTIVE

A major limitation of current suicide research is the lack of power to identify robust correlates of suicidal thoughts or behavior. Variation in suicide risk assessment instruments used across cohorts may represent a limitation to pooling data in international consortia.

METHOD

Here, we examine this issue through two approaches: (a) an extensive literature search on the reliability and concurrent validity of the most commonly used instruments and (b) by pooling data (N ∼ 6,000 participants) from cohorts from the Enhancing NeuroImaging Genetics Through Meta-Analysis (ENIGMA) Major Depressive Disorder and ENIGMA-Suicidal Thoughts and Behaviour working groups, to assess the concurrent validity of instruments currently used for assessing suicidal thoughts or behavior.

RESULTS

We observed moderate-to-high correlations between measures, consistent with the wide range (κ range: 0.15-0.97; r range: 0.21-0.94) reported in the literature. Two common multi-item instruments, the Columbia Suicide Severity Rating Scale and the Beck Scale for Suicidal Ideation were highly correlated with each other (r = 0.83). Sensitivity analyses identified sources of heterogeneity such as the time frame of the instrument and whether it relies on self-report or a clinical interview. Finally, construct-specific analyses suggest that suicide ideation items from common psychiatric questionnaires are most concordant with the suicide ideation construct of multi-item instruments.

CONCLUSIONS

Our findings suggest that multi-item instruments provide valuable information on different aspects of suicidal thoughts or behavior but share a modest core factor with single suicidal ideation items. Retrospective, multisite collaborations including distinct instruments should be feasible provided they harmonize across instruments or focus on specific constructs of suicidality. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Development of a mobile application for assessing reaction time in walking and TUG duration: Concurrent validity in female older adults

Introduction

The TUG can be used to distinguish between people who fall and people who don't fall. To evaluate cognitive dual-task performance while walking for fall prediction, TUG-dual was frequently employed. A recent study has created a mobile application that enables simple interaction to provide greater convenience for monitoring the duration of TUG, TUG-subtraction, and reaction time.

Objective

The research aim was to ascertain the concurrent validity of the mobile application that was developed for the clinical assessment of TUG, TUG-subtraction, and reaction time.

Methods

Twenty-nine older persons participated in this study. The testing protocol involved the TUG, TUG-subtraction, and reaction time assessment. For TUG and TUG-subtraction, the duration to complete the task was recorded by the APDM Mobility Lab system and the mobile application. For the reaction time tests, the reaction times (msec) were recorded by the Multi Choice Reaction timer and the Mobile application. The TUG durations recorded by the APDM Mobility Lab system were correlated with those recorded by the mobile application to verify the concurrent validity using Pearson's product moment correlation coefficient. Also, the reaction time by the Multi Choice Reaction timer was correlated with the mobile application. Bland-Altman plots were used to explore the existence of any systematic differences between the measurements.

Results

Our results showed very strong correlations between the TUG and TUG-subtraction duration derived from the APDM Mobility Lab system and the mobile application (r = 0.96 and 0.96, respectively). For the reaction time, the results showed a moderate correlation between the reaction time derived from the mobile application and the Multi Choice Reaction Timer (r = 0.67).

Conclusion

The mobile application, which allows measurement in TUG and TUG-subtraction, is a highly valid tool for TUG duration assessment. However, this application is capable for assess the reaction time with moderate validity for reaction time assessment.

Video-Conference-Based Graphomotor Examination for Children: A Validation Study

BACKGROUND

Telehealth can assist with providing accessible pediatric occupational therapy services.

OBJECTIVES

This study aimed to investigate the acceptability, inter-rater reliability, and concurrent validity of the Gilboa Functional Test (GIFT) as a video-conference-based graphomotor examination for children (GIFT-Online).

METHODOLOGY

A community-based sample of 157 children aged 3 to 7 years was screened using the GIFT-Online.

FINDINGS

Inter-rater reliability was excellent (r = 0.97; p < .001; n = 40). In addition, significant correlations were found between the total GIFT-Online scores and the Developmental Coordination Disorder Questionnaire 2007 (DCDQ'07), the Little DCDQ (LDCDQ) (r = 0.29, p < .001; n = 157), and the Drawing Proficiency Screening Questionnaire (DPSQ) (r = -0.35, p < .001; n = 157); demonstrating construct and concurrent validity. The online assessment was well received by parents and children.

CONCLUSIONS

The GIFT-Online was found to be an acceptable method of assessing graphomotor performance. Our results support the validity and reliability of the GIFT-Online as a screening tool administered remotely, thereby overcoming physical distancing and travel restrictions.

Clinimetric properties of the diagnostic criteria for psychosomatic research among the elderly

INTRODUCTION

Among the elderly, the availability of tool assessing psychosomatic syndromes is limited. The present study aims at testing inter-rater reliability and concurrent validity of the semi-structured interview for the Diagnostic Criteria for Psychosomatic Research (DCPR-R-SSI) in the elderly of the general population.

METHOD

One hundred eight subjects were recruited. Participants received a clinical assessment which included the DCPR-R-SSI, the Illness Attitude Scale (IAS), the Geriatric Depression Scale (GDS), the Psychosocial Index (PSI), the Toronto Alexithymia Scale-20 (TAS-20). Analyses of inter-rater reliability of DCPR-R-SSI and concurrent validity between DCPR-R-SSI and self-administered questionnaires were conducted.

RESULTS

DCPR-R-SSI showed excellent inter-rater reliability with a percent of agreement of 90.7% (K Cohen: 0.856 [SE = 0.043], 95% CI: 0.77-0.94). DCPR-R demoralization showed fair concurrent validity with GDS; concurrent validity was also fair between DCPR-R Alexithymia and TAS-20, and between DCPR-R allostatic overload and PSI allostatic load, while the concurrent validity between DCPR-R Disease Phobia and IAS was moderate.

CONCLUSION

DCPR-R-SSI represents a reliable and valid tool to assess psychosomatic syndromes in the elderly. DCPR-R is in need of being implemented in the elderly clinical evaluation.

Psychometric properties of the Kessler psychological scales in a Swiss young-adult community sample indicate poor suitability for community screening for mental disorders

AIM

The Kessler psychological distress scales (K10 and K6) are used as screening tools to assess psychological distress related to the likely presence of a mental disorder. Thus, we studied the psychometric properties of their German versions in a Swiss community sample to evaluate their potential usefulness to screen for mental disorders or relevant mental problems in the community and, relatedly, for low threshold transdiagnostic German-speaking services.

METHODS

The sample consisted of 829 citizens of the Swiss canton Bern of age 19-43 years. K10/K6 were validated against mini-international neuropsychiatric interview (M.I.N.I.) diagnoses, questionnaires about health status and quality of life. Receiver operating characteristic (ROC) curve analyses were used to test for general discriminative ability and to select optimal cut-offs of the K10 and K6 for non-psychotic full-blown and subthreshold mental disorders.

RESULTS

Cronbach's alphas were 0.81 (K10) and 0.70 (K6). ROC analyses indicated much lower optimal thresholds than earlier suggested; 10 for K10 and 6 for K6. At these thresholds, against M.I.N.I. diagnoses, Cohen's κ (≤0.173) and correspondence rates (≤58.14%) were insufficient throughout. Values were higher at the earlier suggested threshold, yet, at the cost of sensitivity that was below 0.5 in all but three, and below 0.3 in all but six cases.

CONCLUSIONS

For the lack of sufficient validity and sensitivity, respectively, our findings suggest that both K10 and K6 would only be of limited use in a low-threshold transdiagnostic mental health service for young adults in Switzerland and likely other German-speaking countries.

Examining concurrent validity and item selection of the Session Wants and Needs Outcome Measure (SWAN-OM) in a children and young people web-based therapy service

BACKGROUND

Single-session mental health interventions are frequently attended by children and young people (CYP) in both web-based and face-to-face therapy settings. The Session "Wants" and "Needs" Outcome Measure (SWAN-OM) is an instrument developed in a web-based therapy service to overcome the challenges of collecting outcomes and experiences of single-session therapies (SSTs). It provides pre-defined goals for the session, selected by the young person prior to the intervention, on which progress toward achievement is scored at the end of the session.

OBJECTIVE

The objective of this study was to evaluate the instrument's psychometric properties, including concurrent validity against three other frequently used outcome and experience measures, at a web-based and text-based mental health service.

METHODS

The SWAN-OM was administered for a period of 6 months to 1,401 CYP (aged 10-32 years; 79.3% white; 77.59% female) accessing SST on a web-based service. Item correlations with comparator measures and hierarchical logistic regressions to predict item selection were calculated for concurrent validity and psychometric exploration.

RESULTS

The most frequently selected items were "Feel better" (N = 431; 11.61%) and "Find ways I can help myself" (N = 411; 11.07%); unpopular items were "Feel safe in my relationships" (N = 53; 1.43%) and "Learn the steps to achieve something I want" (N = 58; 1.56%). The SWAN-OM was significantly correlated with the Experience of Service Questionnaire, particularly the item "Feel better" [rs₍₁₀₉₎ = 0.48, p < 0.001], the Youth Counseling Impact Scale, particularly the item "Learn the steps to achieve something I want" [rs₍₂₂₎ = 0.76, p < 0.001], and the Positive and Negative Affect Schedule, particularly the items "Learn how to feel better" [rs₍₂₂₎ = 0.72, p < 0.001] and "Explore how I feel" [rs₍₇₀₎ = -0.44, p < 0.001].

CONCLUSION

The SWAN-OM demonstrates good concurrent validity with common measures of outcome and experience. Analysis suggests that lesser-endorsed items may be removed in future iterations of the measure to improve functionality. Future research is required to explore SWAN-OM's potential to measure meaningful change in a range of therapeutic settings.

Using ICD-9 diagnostic codes for external validation of topic models derived from primary care electronic medical record clinical text data

Background/Objectives: Unsupervised topic models are often used to facilitate improved understanding of large unstructured clinical text datasets. In this study we investigated how ICD-9 diagnostic codes, collected alongside clinical text data, could be used to establish concurrent-, convergent- and discriminant-validity of learned topic models. Design/Setting: Retrospective open cohort design. Data were collected from primary care clinics located in Toronto, Canada between 01/01/2017 through 12/31/2020. Methods: We fit a non-negative matrix factorization topic model, with K = 50 latent topics/themes, to our input document term matrix (DTM). We estimated the magnitude of association between each Boolean-valued ICD-9 diagnostic code and each continuous latent topical vector. We identified ICD-9 diagnostic codes most strongly associated with each latent topical vector; and qualitatively interpreted how these codes could be used for external validation of the learned topic model. Results: The DTM consisted of 382,666 documents and 2210 words/tokens. We correlated concurrently assigned ICD-9 diagnostic codes with learned topical vectors, and observed semantic agreement for a subset of latent constructs (e.g. conditions of the breast, disorders of the female genital tract, respiratory disease, viral infection, eye/ear/nose/throat conditions, conditions of the urinary system, and dermatological conditions, etc.). Conclusions: When fitting topic models to clinical text corpora, researchers can leverage contemporaneously collected electronic medical record data to investigate the external validity of fitted latent variable models.

Comparative validity between the Canadian and the Dutch norms of the Alberta Infant Motor Scale in a preterm population

BACKGROUND

Prematurity remains a leading cause of motor developmental delays. The Alberta Infant Motor Scales (AIMS) is a useful tool to easily assess motor development. However, during the last decade, cross-cultural differences have been identified regarding the original AIMS norms. Therefore, the aim of this study is twofold: confirm the validity of the AIMS in a preterm population and compare the new Dutch AIMS norms to the original Canadian ones in our Belgian population.

METHOD

Ninety-six preterm infants were assessed simultaneously on the AIMS and on the Bayley Scales of Infant-Toddler Development (Bayley-III) at age 9-14 months. Concurrent validity was evaluated by correlation analysis. Among these, 89 were assessed on the AIMS at age 3-6 months. Clinimetric properties of both AIMS norms were calculated to compare their ability to detect a motor delay on the Bayley-III at age 9-14 months.

RESULT

Pearson's coefficient showed an excellent level of correlation between the two scales (r = 0.91). At age 3-6 months, only the 10th Canadian centile showed acceptable properties to predict a significant motor delay. At age 9-14 months, the 5th centile of both norms showed good properties to diagnose a significant motor delay, while only the Canadian norms seems to be sensitive enough to diagnose a mild motor delay.

CONCLUSION

The new Dutch norms seem to be less sensitive but more specific than the Canadian ones and therefore require adapted cut-offs to diagnose motor developmental delays in a preterm population.

Concurrent and convergent validity of culture-specific psychopathology syndromes among Cambodian adolescents

Psychopathology is defined in part by its impacts on life functioning (e.g., fulfillment of daily responsibilities at work or school, in family relationships). Relations to life functioning are particularly important in the validation of culture-specific syndromes (patterns of mental health symptoms specific to a particular culture), to demonstrate that culture-specific symptom patterns do in fact represent pathology. The current study's goal was to assess the construct validity of the Cambodian Somatic Symptom and Syndrome Inventory (CSSI). The study focused on the statistically unique effects of the CSSI on life functioning (i.e., effects of the CSSI on life functioning, controlling for Western psychopathology syndromes), to determine whether the CSSI contributes information beyond standard Western measures, which would support CSSI culture-specific convergent validity. Because adolescence is a key period when psychopathology often develops, study participants were 391 high-school students in one urban and one rural area of Cambodia. Participants completed the CSSI, the Western psychopathology surveys Patient Health Questionnaire (PHQ-9) and Generalized Anxiety Disorder questionnaire (GAD-7), and life functioning measures assessing functional impairment, quality of life, and help-seeking. Results indicated strong CSSI concurrent validity (canonical correlation = 0.75) with the PHQ-9 and GAD-7, and CSSI total effects convergent validity on life functioning indicators. All CSSI statistically unique effects (controlling for the PHQ-9 and GAD-7) on life functioning measures were non-significant indicating that the CSSI, shown to be a valid assessment measure in the current study, does not add predictive information beyond standard Western measures. A key limitation that should be considered in interpretation of these results is that the life functioning measures, although reviewed by Khmer psychologists, were Western-based, thus potentially inflating relations with Western psychopathology measures.

Isokinetic Leg-Press Power-Force-Velocity Profiles Are Reliable in Male and Female Elite Athletes but Not Interchangeable With Vertical Jump Profiles

PURPOSE

To evaluate the test-retest reliability of isokinetic leg-press power-force-velocity profile (P-F-v) parameters in male and female elite athletes. In addition, we determined the concurrent validity of leg-press against squat-jump (SJ) P-F-v parameters in task-experienced athletes.

METHODS

For test-retest reliability, 22 female and 23 male elite athletes (22.3 [4.1] y) with different sporting backgrounds conducted 3 isokinetic leg-press test sessions over 3 consecutive weeks. The testing consisted of bilateral leg extensions at isokinetic velocities of 0.1, 0.3, 0.7, and 1.2 m·s-1. For concurrent validity, 13 ski jumpers (20.3 [3.3] y) were recruited to perform the isokinetic leg-press and SJ P-F-v profile tests using 5 predefined loading conditions of 0%, +20%, +40%, +60%, and +80% of body mass.

RESULTS

Relative and absolute reliability were acceptable for female (intraclass correlation coefficient ≥.87 and coefficient of variation ≤6.5%) and male (intraclass correlation coefficient ≥.89 and coefficient of variation ≤5.7%) elite athletes. In contrast, concurrent validity was insufficient, with correlations ranging from -.26 to .69 between isokinetic and SJ P-F-v parameters.

CONCLUSION

Irrespective of sex, isokinetic leg-press P-F-v profiles provide reliable parameters. However, leg-press P-F-v profiles do not serve as a valid substitute for SJ P-F-v profiles. P-F-v parameter magnitudes are likely dependent on the constraints of the tested movement and testing device.

Concurrent and Predictive Validity of an Exercise-Specific Scale for the Perception of Velocity in the Back Squat

BACKGROUND

the aim of the study was to develop and validate a specific perception velocity scale for the Back Squat exercise to discriminate the velocity of each repetition during a set.

METHODS

31 resistance trained participants completed 3 evaluation sessions, consisting of 3 blinded loads (light, medium, heavy). For each repetition, barbell mean velocity (Vr) was measured with a linear position transducer while perceived velocity (Vp) was reported using the Squat Perception of Velocity (PV) Scale.

RESULTS

Pearson correlation coefficients (r) showed very high values for each intensity in the 3 different days (range r = 0.73-0.83) and practically perfect correlation for all loads (range r = 0.97-0.98). The simple linear regression analysis between Vp and Vr revealed values ranging from R² = 0.53 to R² = 0.69 in the 3 intensities and values ranging from R² = 0.95 to R² = 0.97 considering all loads. The reliability (ICC_2.1, SEM) of Vp was tested for light (0.85, 0.03), medium (0.90, 0.03) and heavy loads (0.86, 0.03) and for all loads (0.99, 0.11). The delta score (ds = Vp - Vr) showed higher accuracy of the PV at heavy loads.

CONCLUSIONS

these results show that the PV Squat Scale is a valid and reliable tool that can be used to accurately quantify exercise intensity.

Measuring positive health: Concurrent and factorial validity based on a representative Dutch sample

The definition of health has been shifting from disease absence to physical, emotional and social well-being. To demedicalise societal problems, the term Positive Health (PH) was introduced-a concept focused on the ability to adapt and to self-manage, in the face of physical, emotional and social challenges. The concept of PH receives broad attention, among others because a PH dialogue tool is intensively being used as a communication instrument while reflecting on patients' health, but a PH measurement instrument is not yet fully established. Recently, however, a 17-item PH measurement model was proposed. In this paper, a factor analysis and regression analyses were performed to test the factorial validity and concurrent validity of this PH measurement model based on a representative sample of the Dutch population (n = 1016, 50.0% women; age: from 15 until 39 = 29.8%, from 40 until 65 = 43.0%, older than 65 = 27.2%; education levels: low = 28.7%, medium = 42.6%, high = 28.7%). These tests are crucial to understand how well the PH measurement model is suitable as a measurement instrument. The factor analysis provided support for the factorial validity of the proposed PH measurement model. When comparing the proposed PH measurement model with domains of other measurements of health (i.e. BRS, HR-SWB, ICECAP, and EQ5D), to test the concurrent validity, the model explained more than half of the variance in measurements of the domains happiness (R²  = 0.60) and overall self-rated health (R²  = 0.57), but explained less than a quarter of the variance in measurements of autonomy (R²  = 0.17 / R²  = 0.13), personal growth (R²  = 0.21), stability (R²  = 0.20), self-care (R²  = 0.15), and resilience (R²  = 0.24). Two of the six domains of the PH measurement model-mental functioning and daily functioning-were weakly related to the other measurements of health. The results of this study imply that the PH measurement model is suitable to measure multiple dimensions of health. They also suggest that the PH measurement model may not be an encompassing measure for the concepts measured through other health measurements and might explain variance in health beyond these other measurements.

Wearable Devices and Smartphone Inertial Sensors for Static Balance Assessment: A Concurrent Validity Study in Young Adult Population

Falls represent a public health issue around the world and prevention is an important part of the politics of many countries. The standard method of evaluating balance is posturography using a force platform, which has high financial costs. Other instruments, such as portable devices and smartphones, have been evaluated as low-cost alternatives to the screening of balance control. Although smartphones and wearables have different sizes, shapes, and weights, they have been systematically validated for static balance control tasks. Different studies have applied different experimental configurations to validate the inertial measurements obtained by these devices. We aim to evaluate the concurrent validity of a smartphone and a portable device for the evaluation of static balance control in the same group of participants. Twenty-six healthy and young subjects comprised the sample. The validity for static balance control evaluation of built-in accelerometers inside portable smartphone and wearable devices was tested considering force platform recordings as a gold standard for comparisons. A linear correlation (r) between the quantitative variables obtained from the inertial sensors and the force platform was used as an indicator of the concurrent validity. Reliability of the measures was calculated using Intraclass correlation in a subsample (n = 14). Smartphones had 11 out of 12 variables with significant moderate to very high correlation (r > 0.5, p < 0.05) with force platform variables in open eyes, closed eyes, and unipedal conditions, while wearable devices had 8 out of 12 variables with moderate to very high correlation (r > 0.5, p < 0.05) with force platform variables under the same task conditions. Significant reliabilities were found in closed eye conditions for smartphones and wearables. The smartphone and wearable devices had concurrent validity for the static balance evaluation and the smartphone had better validity results than the wearables for the static balance evaluation.

The Arabic Version of the Impact of Event Scale-Revised: Psychometric Evaluation among Psychiatric Patients and the General Public within the Context of COVID-19 Outbreak and Quarantine as Collective Traumatic Events

The Coronavirus Disease-19 (COVID-19) pandemic has provoked the development of negative emotions in almost all societies since it first broke out in late 2019. The Impact of Event Scale-Revised (IES-R) is widely used to capture emotions, thoughts, and behaviors evoked by traumatic events, including COVID-19 as a collective and persistent traumatic event. However, there is less agreement on the structure of the IES-R, signifying a need for further investigation. This study aimed to evaluate the psychometric properties of the Arabic version of the IES-R among individuals in Saudi quarantine settings, psychiatric patients, and the general public during the COVID-19 outbreak. Exploratory factor analysis revealed that the items of the IES-R present five factors with eigenvalues > 1. Examination of several competing models through confirmatory factor analysis resulted in a best fit for a six-factor structure, which comprises avoidance, intrusion, numbing, hyperarousal, sleep problems, and irritability/dysphoria. Multigroup analysis supported the configural, metric, and scalar invariance of this model across groups of gender, age, and marital status. The IES-R significantly correlated with the Depression Anxiety Stress Scale-8, perceived health status, and perceived vulnerability to COVID-19, denoting good criterion validity. HTMT ratios of all the subscales were below 0.85, denoting good discriminant validity. The values of coefficient alpha in the three samples ranged between 0.90 and 0.93. In path analysis, correlated intrusion and hyperarousal had direct positive effects on avoidance, numbing, sleep, and irritability. Numbing and irritability mediated the indirect effects of intrusion and hyperarousal on sleep and avoidance. This result signifies that cognitive activation is the main factor driving the dynamics underlying the behavioral, emotional, and sleep symptoms of collective COVID-19 trauma. The findings support the robust validity of the Arabic IES-R, indicating it as a sound measure that can be applied to a wide range of traumatic experiences.

Psychometric Evaluation of the Personal Feelings Questionnaire-2 (PFQ-2) Shame Subscale Among Spanish-Speaking Female Sex Workers in Mexico

Shame may increase HIV risk among stigmatized populations. The Personal Feelings Questionnaire-2 (PFQ-2) measures shame, but has not been validated in Spanish-speaking or nonclinical stigmatized populations disproportionately affected by HIV in resource-limited settings. We examined the psychometric properties of the Spanish-translated PFQ-2 shame subscale among female sex workers in two Mexico-U.S. border cities. From 2016 to 2017, 602 HIV-negative female sex workers in Tijuana and Ciudad Juarez participated in an efficacy trial evaluating a behavior change maintenance intervention. Interviewer-administered surveys collected information on shame (10-item PFQ-2 subscale), psychosocial factors, and sociodemographics. Item performance, confirmatory factor analysis, internal consistency, differential item functioning by city, and concurrent validity were assessed. Response options were collapsed to 3-point responses to improve item performance, and one misfit item was removed. The revised 9-item shame subscale supported a single construct and had good internal consistency (Cronbach's α = .86). Notable differential item functioning was found but resulted in a negligible effect on overall scores. Correlations between the revised shame subscale and guilt (r = .79, p < .01), depression (r = .69, p < .01), and emotional support (r = -.28, p < .01) supported concurrent validity. The revised PFQ-2 shame subscale showed good reliability and concurrent validity in our sample, and should be explored in other stigmatized populations.

The Chinese version of the Memory for Intentions Test (MIST): development and evaluation of its reliability and concurrent validity

This study aims to develop a simplified Chinese version of the "Memory for Intentions Test" (MIST), evaluate its reliability and concurrent validity, explore the inter-relationships among the MIST variables and the relationships between the MIST variables and socio-demographic factors.

Two hundred healthy, Chinese-speaking adults of the Han community participated in this study. Form A of the Chinese MIST and two prospective items of the Rivermead Behavioural Memory Test, Second Edition (RBMT-II, Chinese version) were administered to all participants to evaluate internal consistency, split-half reliability, and concurrent validity. Twenty of these participants were assessed twice on Form A with a two-week interval to examine test-retest reliability. They were also assessed on both Form A and Form B to examine alternate-form reliability.

The findings of the study indicated good internal consistency (Cronbach's α = .833) and excellent split-half reliability (r = .924-.930) among the six subscales of the Chinese MIST, although the internal consistency was low (Cronbach's α = .129) for individual PM trials. We also found adequate concurrent validity (ρ = .722, p< .001), test-retest reliability (ρ = .716, p < .001), and alternate-form reliability (ρ= .828, p < .001).

The Chinese MIST demonstrated suitable reliability and concurrent validity in the Chinese-speaking population. The present study provides a new standardized prospective memory test for the Chinese population, which would enhance future clinical research in this field on the Chinese mainland.

Self-Report Measures of Procrastination Exhibit Inconsistent Concurrent Validity, Predictive Validity, and Psychometric Properties

Procrastination is a chronic and widespread problem; however, emerging work raises questions regarding the strength of the relationship between self-reported procrastination and behavioral measures of task engagement. This study assessed the internal reliability, concurrent validity, predictive validity, and psychometric properties of 10 self-report procrastination assessments using responses collected from 242 students. Participants' scores on each self-report instrument were compared to each other using correlations and cluster analysis. Lasso estimation was used to test the self-report scores' ability to predict two behavioral measures of delay (days to study completion; pacing style). The self-report instruments exhibited strong internal reliability and moderate levels of concurrent validity. Some self-report measures were predictive of days to study completion. No self-report measures were predictive of deadline action pacing, the pacing style most commonly associated with procrastination. Many of the self-report measures of procrastination exhibited poor fit. These results suggest that researchers should exercise caution in selecting self-report measures and that further study is necessary to determine the factors that drive misalignment between self-reports and behavioral measures of delay.

Concurrent validity of the Alcohol Purchase Task for measuring the reinforcing efficacy of alcohol: an updated systematic review and meta-analysis

BACKGROUND AND AIMS

An early meta-analysis testing the concurrent validity of the Alcohol Purchase Task (APT), a measure of alcohol's relative reinforcing value, reported mixed associations, but predated a large number of studies. This systematic review and meta-analysis sought to: (1) estimate the relationships between trait-based alcohol demand indices from the APT and multiple alcohol indicators, (2) test several moderators and (3) analyze small study effects.

METHODS

A meta-analysis of 50 cross-sectional studies in four databases (n = 18 466, females = 43.32%). Sex, year of publication, number of APT prices and index transformations (logarithmic, square root or none) were considered as moderators. Small study effects were examined by using the Begg-Mazumdar, Egger's and Duval & Tweedie's trim-and-fill tests. Alcohol indicators were quantity of alcohol use, number of heavy drinking episodes, alcohol-related problems and hazardous drinking. APT indices were intensity (i.e. consumption at zero cost), elasticity (i.e. sensitivity to increases in costs), O_max (i.e. maximum expenditure), P_max (i.e. price associated to O_max ) and breakpoint (i.e. price at which consumption ceases).

RESULTS

All alcohol demand indices were significantly associated with all alcohol-related outcomes (r = 0.132-0.494), except P_max , which was significantly associated with alcohol-related problems only (r = 0.064)_. The greatest associations were evinced between intensity in relation to alcohol use, hazardous drinking and heavy drinking and between O_max and alcohol use. All the tested moderators emerged as significant moderators. Evidence of small-study effects was limited.

CONCLUSIONS

The Alcohol Purchase Task appears to have concurrent validity in alcohol research. Intensity and O_max are the most relevant indices to account for alcohol involvement.

Development and Preliminary Italian Validation of the Emergency Response and Psychological Adjustment Scale

Evaluating the personal adaptation response to the emergency situations is very important for the prevention of mental distress, for the activation of network and community synergies and for the planning and implementation of appropriate psycho-social interventions. So far there are no short tools for the overall assessment of cognitive, emotional and behavioral responses of psychological adaptation to the emergency in the psychometric panorama. The Emergency Response and Psychological Adjustment Scale (ERPAS) was administered to a sample of 1,088 participants, while the concurrent validity was tested through a second administration to 600 participants along with the GSE (Generalized Self-Efficacy Scale) and the BDI-II (Beck Depression Inventory-II). Confirmatory factor analysis bore out a five-factor solution (including 18 items) with good fit indices of adaptation to data, χ²/df = 1.440, RMSEA = 0.028, RMSEA 90% CI = 0.018–0.038, GFI = 0.996, AGFI = 0.959, CFI = 0.982, and NFI = 0.944. Evidence of convergent validity was provided by the significant correlations with variables such as cognitive and somatic depression, and perceived general self-efficacy. The analyses also showed a strong invariance across gender. The ERPAS tool prefigures application during the assessment in multiple emergency contexts (e.g. earthquakes, floods, pandemics, terrorist attacks, war events, major accidents, major fires). This validation study of the ERPAS has shown that this version is a reliable and valid measurement for assessing people's modes of personal response (cognitive, emotional, behavioral) in emergency contexts.

Reliability and Validity of the ONAPS Physical Activity Questionnaire in Assessing Physical Activity and Sedentary Behavior in French Adults

This study was conducted to assess the validity and reliability of a new questionnaire, the ONAPS-PAQ, developed to assess physical activity (PA) and sedentary behaviors (SB) in the general population. A total of 137 healthy adults aged 18 to 69 years were included. Following completion of two physical activity questionnaires (ONAPS-PAQ and GPAQ, the Global physical activity questionnaire) to study concurrent validity, participants wore an accelerometer (UKK-RM42) for 7 days to study criterion validity. A subsample (n = 36) also completed a 7-day-interval test-retest protocol to assess its reliability. Reliability was tested by the intraclass correlation coefficient (ICC) and Kappa coefficient; concurrent and criterion validity by the Spearman correlation coefficient (ρ) and Bland-Altman plot analyses. The ONAPS-PAQ showed good reliability (ICC = 0.71-0.98; Kappa = 0.61-0.99) and concurrent validity (ρ = 0.56-0.86), but only poor criterion validity (ρ = 0.26-0.41), and wide limits of agreement. Self-reported and accelerometer-measured SB were better correlated with ONAPS-PAQ than GPAQ (0.41 vs. 0.26, respectively) and medians were comparable, whereas the GPAQ underestimated SB (SB_acc = 481 (432-566), SB_ONAPS = 480 (360-652), SB_GPAQ = 360 (240-540) min·day^-1; median (q1-q3)). The ONAPS-PAQ provides good reliability and acceptable validity for the measurement of PA and SB and seems to provide a better assessment of SB than GPAQ.

Validity of Hololens Augmented Reality Head Mounted Display for Measuring Gait Parameters in Healthy Adults and Children with Cerebral Palsy

Serious games are a promising approach to improve gait rehabilitation for people with gait disorders. Combined with wearable augmented reality headset, serious games for gait rehabilitation in a clinical setting can be envisaged, allowing to evolve in a real environment and provide fun and feedback to enhance patient’s motivation. This requires a method to obtain accurate information on the spatiotemporal gait parameters of the playing patient. To this end, we propose a new algorithm called HoloStep that computes spatiotemporal gait parameters using only the head pose provided by an augmented reality headset (Hololens). It is based on the detection of peaks associated to initial contact event, and uses a combination of locking distance, locking time, peak amplitude detection with custom thresholds for children with CP. The performance of HoloStep was compared during a walking session at comfortable speed to Zeni’s reference algorithm, which is based on kinematics and a full 3D motion capture system. Our study included 62 children with cerebral palsy (CP), classified according to Gross Motor Function Classification System (GMFCS) between levels I and III, and 13 healthy participants (HP). Metrics such as sensitivity, specificity, accuracy and precision for step detection with HoloStep were above 96%. The Intra-Class Coefficient between steps length calculated with HoloStep and the reference was 0.92 (GMFCS I), 0.86 (GMFCS II/III) and 0.78 (HP). HoloStep demonstrated good performance when applied to a wide range of gait patterns, including children with CP using walking aids. Findings provide important insights for future gait intervention using augmented reality games for children with CP.

Psychometric Properties of the Malay Version of the Internet Gaming Disorder Scale-Short Form (IGDS9-SF-M): Evidence from a Sample of Malaysian Undergraduates

In recent years, increased interest in Internet Gaming Disorder has led to the development of the Internet Gaming Disorder Scale-Short Form. Translation and subsequent validation of such a scale are important for cross-cultural use. The aim of the present study was to examine the psychometric properties (factor structure, reliability, and validity) of the Malay Version of the Internet Gaming Disorder Scale-Short Form using a sample of Malaysian undergraduates. The present sample included 137 Malaysian undergraduates. Participants completed a self-administered online survey containing demographic items, the Malay Version of the Internet Gaming Disorder Scale-Short Form, the Problematic Online Gaming Questionnaire-Short Form, and the Malay Version of the Internet Addiction Test. The present findings confirm the one-factor model of the Malay Version of the Internet Gaming Disorder Scale-Short Form. Good reliability, as measured by Cronbach alpha, was found for the Malay Version of the Internet Gaming Disorder Scale-Short Form. The Malay Version of the Internet Gaming Disorder Scale-Short Form has demonstrated concurrent validity by significantly correlating with the Problematic Online Gaming Questionnaire-Short Form as well as demonstrated convergent validity with respect to the Malay Version of the Internet Addiction Test. The Malay Version of the Internet Gaming Disorder Scale-Short Form is a reliable and valid tool for assessing Internet Gaming Disorder in Malaysian undergraduates. As more research is still needed to confirm the status of Internet Gaming Disorder as a formal disorder, it is hoped that the Malay Version of the Internet Gaming Disorder Scale-Short Form can facilitate future research examining antecedents and consequences of Internet Gaming Disorder in a Malaysian setting.

Determining validity, discriminant ability, responsiveness, and minimal clinically important differences for PROMIS in adult spinal deformity

OBJECTIVE

The aim of this study was to determine the concurrent validity, discriminant ability, and responsiveness of the Patient-Reported Outcomes Measurement Information System (PROMIS) in adult spinal deformity (ASD) and to calculate minimal clinically important differences (MCIDs) for PROMIS scores.

METHODS

The authors used data obtained in 186 surgical patients with ASD. Concurrent validity was determined through correlations between preoperative PROMIS scores and legacy measure scores. PROMIS discriminant ability between disease severity groups was determined using the preoperative Oswestry Disability Index (ODI) value as the anchor. Responsiveness was determined through distribution- and anchor-based methods, using preoperative to postoperative changes in PROMIS scores. MCIDs were estimated on the basis of the responsiveness analysis.

RESULTS

The authors found strong correlations between PROMIS Pain Interference and ODI and the Scoliosis Research Society 22-item questionnaire Pain component; PROMIS Physical Function and ODI; PROMIS Anxiety and Depression domains and the 12-Item Short Form Health Survey version 2, Physical and Mental Components, Scoliosis Research Society 22-item questionnaire Mental Health component (anxiety only), 9-Item Patient Health Questionnaire (anxiety only), and 7-Item Generalized Anxiety Disorder questionnaire; PROMIS Fatigue and 9-Item Patient Health Questionnaire; and PROMIS Satisfaction with Participation in Social Roles (i.e., Social Satisfaction) and ODI. PROMIS discriminated between disease severity groups in all domains except between none/mild and moderate Anxiety, with mean differences ranging from 3.7 to 8.4 points. PROMIS showed strong responsiveness in Pain Interference; moderate responsiveness in Physical Function and Social Satisfaction; and low responsiveness in Anxiety, Depression, Fatigue, and Sleep Disturbance. Final PROMIS MCIDs were as follows: -6.3 for Anxiety, -4.4 for Depression, -4.6 for Fatigue, -5.0 for Pain Interference, 4.2 for Physical Function, 5.7 for Social Satisfaction, and -3.5 for Sleep Disturbance.

CONCLUSIONS

PROMIS is a valid assessment of patient health, can discriminate between disease severity levels, and shows responsiveness to changes after ASD surgery. The MCIDs provided herein may help clinicians interpret postoperative changes in PROMIS scores, taking into account the fact that they are pending external validation.

Assessing the performance of the Caregiver Reported Early Development Instruments (CREDI) in rural India

Although many education and health programs aim to improve early childhood development, it is challenging to assess developmental levels of infants and small children through large household surveys. The Caregiver Reported Early Development Instruments (CREDI) has been proposed as an adaptable, practical, and low‐cost instrument for measuring the developmental status of children under 3 years of age at scale, as it is relatively short and collected by caregiver report. This study employed the CREDI to measure the development of a sample of 994 children ages 22–35 months in rural India and compared the results to those obtained using the Bayley Scales of Infant and Toddler Development (Bayley‐III), a reliable and widely used instrument, albeit one not always suited to large‐scale data collection efforts given its length, cost, and complexity of administration. The CREDI validation exercise showed that caregivers can provide assessments in keeping with the more interactive (hence more time‐consuming and training‐intensive) Bayley‐III instrument. Noteworthy, there was no indication that concordance of the instruments differed by education of the caregiver. This is important as it points to alternate feasible tools to measure child development outcomes through large‐scale surveys.

The validity of an isiZulu speech reception threshold test for use with adult isiZulu speakers

Background

This study continued the development of an isiZulu speech reception threshold (zSRT) test for use with first language, adult speakers of isiZulu.

Objectives

The objective of this study was to determine the convergent and concurrent validity of the zSRT test.

Methods

One hundred adult isiZulu first-language speakers with normal hearing and 76 first-language, adult isiZulu speakers with conductive or sensorineural hearing losses ranging from mild to severe were assessed on pure tone audiometry and a newly developed isiZulu SRT test. Convergent validity was established through agreement of the zSRT scores with pure tone average (PTA) scores. Concurrent validity was assessed by examining the steepness of the psychometric curve for each word in the zSRT test for each type and degree of hearing loss.

Results

Intraclass correlation coefficient analyses showed zSRT scores were in substantial to very high agreement with PTA scores for the normal hearing and hearing loss groups (NH – right ear ICC consistency = 0.78, left ear ICC = 0.67; HL – right ear ICC consistency = 0.97, left ear ICC consistency = 0.95). The mean psychometric slope (%/dB) at 50% correct perception for all words in the zSRT test was 4.92%/dB for the mild conductive hearing loss group, 5.26%/dB for the moderate conductive hearing loss group, 2.85%/dB for the moderately severe sensorineural hearing loss group and 2.47%/dB for the severe sensorineural hearing loss group. These slopes were appropriate for the degree of hearing loss observed in each group.

Conclusion

The zSRT test showed convergent and concurrent validity for assessing SRT in first language, adult speakers of isiZulu.

Psychometric validity and reliability of the Danish version of the MD Anderson Symptom Inventory Brain Tumor Module

Background

The complexity of disease- and treatment-related symptoms causes profound distress and deterioration of health-related quality of life among patients with brain tumors. Currently, there is no Danish validated disease-specific instrument that focuses solely on measures of both neurologic and cancer-related symptoms of patients with brain tumors. The MD Anderson Symptom Inventory Brain Tumor Module (MDASI-BT) is a validated patient self-report questionnaire that measures symptom prevalence, intensity, and interference with daily life. The aim of the present study was to determine the psychometric validity of the Danish translation of the MDASI-BT, and to test its utility in 3 cohorts of Danish patients across the spectrum of the brain cancer disease and treatment trajectory.

Methods

A linguistic validation process was conducted. Danish patients with malignant primary brain tumors were included to establish the psychometric validity and reliability of the Danish MDASI-BT. Cognitive debriefing interviews were conducted to support the psychometric properties.

Results

A total of 120 patients participated in this study. Coefficient αs for the symptom and interference subscales indicate a high level of reliability across all items. Corresponding symptom and interference or functional items and subscales in the MDASI-BT and European Organisation for Research and Treatment of Cancer Brain Tumor Module BN20 were significantly correlated. Cognitive debriefing provided evidence for content validity and questionnaire utility as participants were comfortable answering the questions and had no problem with the understandability or number of questions asked.

Conclusion

The MDASI-BT is a simple, concise symptom assessment tool useful for assessing the symptom severity and interference of Danish-speaking patients with brain cancer.

Validity of the GAITRite Walkway Compared to Functional Balance Tests for Fall Risk Assessment in Geriatric Outpatients

This study examined the concurrent validity between gait parameters from the GAITRite walkway and functional balance test commonly used in fall risk assessment. Patients were sampled from one geriatric outpatient clinic. One physiotherapist evaluated the patients on the GAITRite walkway with three repetitions in both single- and dual-task conditions. Patients were further evaluated with Bergs Balance scale (BBS), Dynamic Gait index (DGI), Timed Up and Go (TUG), and Sit To Stand test (STS). Correlations between quantitative gait parameters and functional balance test were analyzed with Spearman’s rank correlations. Correlations strength was considered as follows: negligible <0.1, weak 0.10–0.39, moderate 0.40–0.69, and strong ≥0.70. We included 24 geriatric outpatients in the study with a mean age of 80.6 years (SD: 5.9). Patients received eight (SD: 4.5) different medications on average, and seven (29.2%) patients used walkers during ambulation. Correlations between quantitative gait parameters and functional balance test ranged from weak to moderate in both single- and dual-task conditions. Moderate correlations were observed for DGI, TUG, and BBS, while STS showed weak correlations with all GAITRite parameters. For outpatients analyzed on the GAITRite while using walkers, correlations showed no clear pattern across parameters with large variation within balance tests.

Portable, One-Dimensional, Trunk-Flexor Muscle Strength Measurement System

Trunk-flexor muscle strength plays a fundamental role in athletic performance, but objective measurements are usually obtained using expensive and nonportable equipment, such as isokinetic dynamometers. The aim of this study was to assess the concurrent validity of a portable, one-dimensional, trunk-flexor muscle strength measurement system (Measurement System) that uses calibrated barbells and the reliability of the measurements obtained using the Measurement System, by conducting test-retests. As a complementary assessment, the measurements obtained during a maximum contraction test performed by a group of 15 subjects were also recorded. Four conditions were assessed: repeatability, time reproducibility, position reproducibility, and subject reproducibility. The results demonstrate that both the concurrent validity and the measured reliability (intraclass correlation coefficient > .98) of the Measurement System are acceptable. The Measurement System provides valid and reliable measures of trunk-flexor muscle strength.

Validity and Reliability of a Photoelectric Cells System for the Evaluation of Change of Direction and Lateral Jumping Abilities in Collegiate Basketball Athletes

The validity and reliability of the Optojump system were investigated for jumping height and flight time in vertical jump tests. Conversely, the purpose of the present study was to investigate the validity and reliability of the Optojump system for measuring contact time and lateral displacement in change of direction and lateral jump tests. Thirty basketball collegiate athletes were tested on two 10 m sprints with a 60° (COD60) or 180° (COD180) change of direction, lateral controlled (CLRJ) and maximal (MLRJ) rebound jump, and lateral countermovement (LCMJ) and squat (LSJ) jump with the concomitant use of two force plates and the Optojump system for the measurement of contact time in COD60, COD180, CLRJ, MLRJ, and lateral jumping distance in all the lateral jump tests. Almost perfect coefficients (r ≥ 0.95) emerged for contact time in COD60, COD180, CLRJ, MLRJ, although a systematic bias was found for COD60 (-0.01 s). Good-to-excellent reliability was found for almost all the measurements of contact time and lateral jumping distance for change of direction and lateral jump tests. Therefore, the use of Optojump system for testing change of direction and lateral jumping abilities should be executed with caution, avoiding misinterpretation of data.

Validation of a Sensor-Fitted Simulator for Upper Airway Examination

OBJECTIVE

To validate a simulator for upper airway examination, fitted with sensors, for use as an academic tool for learning how to conduct examination of the upper airway and for evaluation of that learning.

STUDY DESIGN

Validation study.

SETTING

Undergraduate medical education.

SUBJECTS AND METHODS

A group of 18 fifth-year medical students and another of 6 otorhinolaryngology specialists conducted 6 examinations each with the simulator. To investigate concurrent validity, we calculated the correlation between damage scores provided by the simulator and damage assessment by a specialist. To evaluate construct validity, we compared both groups with regard to damage scores, technical procedure, and time spent. To examine content and face validity, we used questionnaires based on a 5-point Likert scale.

RESULTS

For concurrent validity, the correlation between the simulator's damage scores and the specialist's damage assessment was high: Spearman's ρ was 0.828 (P < .001). For construct validity, the group of students differed from the group of specialists in damage scores (P = .027) and in technical procedures (P < .001) but not in time spent. For content validity, all questionnaire statements were scored highly, and both groups had similar average scores. For face validity, the group of specialists considered the simulator to be realistic, and all statements on the questionnaire were rated with at least 4/5.

CONCLUSION

Concurrent, construct, content, and face validity have been demonstrated for a sensor-fitted simulator for upper airway examination, which is therefore accurate enough to be used as an academic tool for learning and evaluation of learning.

Comparing Monitoring Results of Two Motion Trackers for Geriatric Patients

BACKGROUND

Fitbit and Garmin motion tracker devices are highly used in research. The validity and reliability of these devices is proven for healthy adults between 18 and 64.

OBJECTIVES

Comparing data output of two devices.

METHODS

Observational case study on a test track and in the domestic environment of a 80- year-old female multimorbide geriatric patient.

RESULTS

High significant correlation of the devices on the test track [r=.776, p≤.001, Bca-CI-95% (.618;.874), N=33], but significant different in the domestic environment over time (z=4.840, p≤.001).

CONCLUSION

The dominant/non-dominant body side and further sources of error may play a role in monitoring steps with these devices.

Quantifying Spatiotemporal Gait Parameters with HoloLens in Healthy Adults and People with Parkinson's Disease: Test-Retest Reliability, Concurrent Validity, and Face Validity

Microsoft’s HoloLens, a mixed-reality headset, provides, besides holograms, rich position data of the head, which can be used to quantify what the wearer is doing (e.g., walking) and to parameterize such acts (e.g., speed). The aim of the current study is to determine test-retest reliability, concurrent validity, and face validity of HoloLens 1 for quantifying spatiotemporal gait parameters. This was done in a group of 23 healthy young adults (mean age 21 years) walking at slow, comfortable, and fast speeds, as well as in a group of 24 people with Parkinson’s disease (mean age 67 years) walking at comfortable speed. Walking was concurrently measured with HoloLens 1 and a previously validated markerless reference motion-registration system. We comprehensively evaluated HoloLens 1 for parameterizing walking (i.e., walking speed, step length and cadence) in terms of test-retest reliability (i.e., consistency over repetitions) and concurrent validity (i.e., between-systems agreement), using the intraclass correlation coefficient (ICC) and Bland–Altman’s bias and limits of agreement. Test-retest reliability and between-systems agreement were excellent for walking speed (ICC ≥ 0.861), step length (ICC ≥ 0.884), and cadence (ICC ≥ 0.765), with narrower between-systems than over-repetitions limits of agreement. Face validity was demonstrated with significantly different walking speeds, step lengths and cadences over walking-speed conditions. To conclude, walking speed, step length, and cadence can be reliably and validly quantified from the position data of the wearable HoloLens 1 measurement system, not only for a broad range of speeds in healthy young adults, but also for self-selected comfortable speed in people with Parkinson’s disease.

Reliability and concurrent validity of Alzheimer's disease assessment scale - Cognitive subscale, Chinese version (ADAS-Cog-C) among Chinese community-dwelling older people population

OBJECTIVE

To evaluate reliability and concurrent validity of the Alzheimer's Disease Assessment Scale - Cognitive Subscale, Chinese Version (ADAS-Cog-C) among Chinese community older adults.

METHOD

Three groups, comprising of 1,276 community-dwelling older adults, were included in this study: a normal control (NC), a mild cognitive impairment (MCI), and an Alzheimer's disease (AD) group. All participants were assessed through ADAS-Cog-C, clinical interviews, physical examinations, Mini Mental State Examination (MMSE), and the Clinical Dementia Rating Scale (CDR). Internal consistency was assessed to evaluate the reliability of ADAS-Cog-C. Pearson and Spearman correlation coefficients were calculated to evaluate the concurrent validity between ADAS-Cog-C, MMSE, and CDR.

RESULTS

Overall, the Cronbach's alpha coefficients of ADAS-Cog-C for the AD and MCI groups were 0.843 and 0.554, respectively. The split-half reliability coefficients for the AD and MCI groups were 0.860 and 0.539, respectively. ADAS-Cog-C scores were negatively correlated with MMSE scores (r = -0.706, p < 0.001) and positively associated with CDR scores (r = 0.546, p < 0.001). After excluding the MCI group from the analysis, the internal consistency of ADAS-Cog-C for the total population improved (α = 0.813, r _hh = 0.852, all p < 0.001), as did the correlation between ADAS-Cog-C and MMSE (r = -0.828, p < 0.001) and CDR (r = 0.429, all p < 0.001) scores.

CONCLUSIONS

ADAS-Cog-C has good internal consistency and concurrent validity for assessing Chinese community older adults with AD, but poor consistency, good concurrent validity with the MMSE while moderate concurrent validity with the CDR for MCI.

DataSpoon: Validation of an Instrumented Spoon for Assessment of Self-Feeding

Clinically feasible assessment of self-feeding is important for adults and children with motor impairments such as stroke or cerebral palsy. However, no validated assessment tool for self-feeding kinematics exists. This work presents an initial validation of an instrumented spoon (DataSpoon) developed as an evaluation tool for self-feeding kinematics. Ten young, healthy adults (three male; age 27.2 ± 6.6 years) used DataSpoon at three movement speeds (slow, comfortable, fast) and with three different grips: “natural”, power and rotated power grip. Movement kinematics were recorded concurrently using DataSpoon and a magnetic motion capture system (trakSTAR). Eating events were automatically identified for both systems and kinematic measures were extracted from yaw, pitch and roll (YPR) data as well as from acceleration and tangential velocity profiles. Two-way, mixed model Intraclass correlation coefficients (ICC) and 95% limits of agreement (LOA) were computed to determine agreement between the systems for each kinematic variable. Most variables demonstrated fair to excellent agreement. Agreement for measures of duration, pitch and roll exceeded 0.8 (excellent agreement) for >80% of speed and grip conditions, whereas lower agreement (ICC < 0.46) was measured for tangential velocity and acceleration. A bias of 0.01–0.07 s (95% LOA [−0.54, 0.53] to [−0.63, 0.48]) was calculated for measures of duration. DataSpoon enables automatic detection of self-feeding using simple, affordable movement sensors. Using movement kinematics, variables associated with self-feeding can be identified and aid clinical reasoning for adults and children with motor impairments.

The Spanish Version of the Sexual Opinion Survey (SOS-6): Evidence of Validity of a Short Version

The aim of this work was to provide validity evidences of the short Spanish version of the Sexual Opinion Survey (SOS-6). First, a psychometric study was performed to examine the factorial invariance of the scale across different groups. A sample of 1,500 heterosexual adults (50% men, 50% women) from the general Spanish population, aged 18 to 80, was examined. Results showed that the unidimensional model of the SOS-6 is invariant across sex, age range, relationship status, and educational level. Secondly, a laboratory study was performed to determine the relationship between erotophilia and objective and subjective sexual arousal in response to sexual stimuli. The sample consisted of 130 young Spanish university students (46.92% men, 53.08% women) with heterosexual orientation. In men, erotophilia was related to subjective sexual arousal; in women, erotophilia was related to subjective sexual arousal and estimation of genital sensations. In conclusion, this work provides validity evidences of the short version of the SOS-6 and describes the factorial equivalence of the scale across groups and its concurrent validity.

Intra-Rater Reliability and Concurrent Validity of Quantified Muscle Testing for Maximal Knee Extensors Strength in Men with Myotonic Dystrophy Type 1

BACKGROUND

Myotonic dystrophy type 1 (DM1) is the most prevalent degenerative neuromuscular disease in adults. Knee extensor (KE) maximal strength loss is a strong indicator of physical limitations in DM1. A reliable, precise and accessible maximal strength evaluation method needs to be validated for this slowly progressive disease.

OBJECTIVE

This paper aims to assess the intra-rater reliability, the standard error of measurement (SEM), the minimal detectable change (MDC), and the concurrent validity of quantified muscle testing (QMT) using a handheld dynamometer with a gold standard: the Biodex isokinetic device.

METHODS

Nineteen men with the adult form of DM1 participated in this study by attending 2 visits spaced by one week. The evaluation of KE muscle strength with QMT was completed on the first visit and the same QMT evaluation in addition to the maximal muscle strength evaluation using an isokinetic device were performed on the second visit.

RESULTS

The intra-rater reliability was excellent with an intraclass correlation coefficient (ICC) of 0.98 (0.96-0.99 : 95% confidence interval). SEM and MDC values were 1.05 Nm and 2.92 Nm, respectively. Concurrent validity of QMT of KE muscle group with the Biodex was also excellent with a Spearman's correlation of ρ= 0.98.

CONCLUSIONS

The excellent concurrent validity and intra-rater reliability, and the small SEM and MDC of the QMT make this test a method of choice, in either a clinical or research setting, to precisely evaluate muscle strength impairments of the KE in men with DM1.