Are personality measures valid for different populations? A systematic review of measurement invariance across cultures, gender, and age

Gender, age, and longitudinal measurement invariance of child and adolescent depression scales: A systematic review

Understanding developmental trajectories and gender differences in depressive symptoms is clinically relevant. Discerning true differences across gender, age groups, and time is based on the often-neglected premise of measurement invariance (MI) of child and adolescent depression scales. In this systematic review, we assessed available evidence for MI across gender, age groups, and time for depression scales validated in children and adolescents, in studies with at least one assessment under age 18. A literature search using Medline, PsychInfo, Scopus, Web of Science, and Google Scholar databases identified 42 studies that examined MI. MI of eleven scales was tested in 1-9 studies per scale. Conclusions are hampered by different factor solutions tested within some scales. All included questionnaires showed preliminary evidence for MI across gender. Across some studies, crying had higher factor loadings in females compared to males, indicating that crying may be differently related to depression across gender. MI evidence was preliminary in just four scales across time, mostly confined to ages 13-17. One study showed developmental conclusions differed when non-invariance is not accounted for in observed scores. Overall, evidence for MI in child and adolescent depression scales is currently limited.

Validation of the Spanish Version of the Nurses' Global Assessment of Suicide Risk Scale (NGAR) in Nonclinical Settings

AIM

To validate the Nurses' Global Assessment of Suicide Risk (NGASR) in Spanish for an early detection identification of the risk of suicide.

DESIGN

A descriptive cross-sectional survey design was used for this work through face-to-face clinical interviews with each participant.

METHOD

Following EQUATOR TRIPOD checklist, the index was translated and administered to a sample of 30 mental health experts and 151 university students. To examine the psychometric properties of the NGASR, the questionnaires also included other standardised scales such as BDI, SBQ and SEEQ. The research was conducted between 2022 and 2023.

RESULTS

The content validity index-scale (CVI-S) was 81% and the NGASR presented high reliability with a Kuder-Richardson coefficient of 0.83. Exploratory factor analysis (EFA) returned a six-factor structure for the NGASR items. The results showed that 21.7% of the students assessed had an intermediate to very high suicide risk. This study also revealed that people with mental health problems and depression had a higher risk of suicide.

PUBLIC CONTRIBUTION

Beyond the sociolinguistic Spanish validation of the scale, it should be noted that it is carried out on a young population in a nonclinical environment, something that many authors have been requesting in their previous validations. The NGASR is a useful prevention tool in university educational settings.

Validation and measurement invariance of the Chinese version of the academic self-efficacy scale for university students

Objectives

The objective of this study was to examine the psychometric properties of the Chinese version of the Academic Self-Efficacy Scale (ASES-C) and confirm its measurement invariance across gender identities.

Methods

In this study, 502 university students (29.68% male, 70.32% female) with a mean age of 19.93 years (SD = 1.64) voluntarily participated. The Academic Self-Efficacy Scale (ASE) was utilized as a unidimensional measure of students' learning efficacy. The English version of ASES was translated into Chinese using a forward-backward translation procedure. Confirmatory factor analysis (CFA) and invariance testing were conducted with the single-factor model of ASES. Composite reliability (CR) and internal consistency were calculated based on Cronbach's alpha.

Results

Upon re-specification of the model, CFA results for the hypothesized single-factor model with eight items indicated an acceptable fit (CFI = 0.959, TLI = 0.943, SRMR = 0.036, RMSEA = 0.065). Cronbach's alpha and CR values were 0.785 and 0.880, respectively. Multi-group CFA results demonstrated measurement equivalence for the Chinese version of ASES across gender identities. The findings supported the measurement invariance of ASES-C for both male and female participants.

Conclusion

The ASES-C, consisting of one factor and eight items, is a reliable instrument for assessing Chinese university students' self-efficacy in learning. Furthermore, it is suitable for making meaningful comparisons across gender identities.

Validation in Spanish and English of the Transgender Inclusive Behavior Scale

The Transgender Inclusive Behavior Scale (TIBS) seeks to measure transgender-inclusive behavior, specifically actions and language use that support transgender people. The TIBS was developed in the United States. This study aimed to develop a Spanish version of the TIBS and confirm the structure of the English version to explore the psychometric properties and evaluate the construct validity in new contexts. We examined predictors of transgender-inclusive behavior by conducting a comparative analysis between participants from Spain and the United Kingdom. The study involved 1,110 university students, with 545 participants hailing from Spain (375 women, 162 men, and 8 non-binary individuals) and 565 participants from the United Kingdom (368 women, 178 men, and 19 non-binary individuals). Exploratory and confirmatory factor analysis were conducted to investigate and validate the factorial structure of the TIBS. The factor analysis results for the 15 items on the scale confirmed a three-dimensional structure in both languages. The scale score reliability was excellent with a Cronbach's alpha (α) = .95 in the British sample and with an α = .89 in the Spanish sample. Being a woman, being lesbian, gay, bisexual, trans, queer, intersex, and/or asexual, and being non-religious were the strongest predictors of inclusive behaviors towards transgender people in both countries. The correlations found indicated that people with lower sexual risk behaviors, and lower sexist, homophobic, and transphobic attitudes also presented higher inclusive behaviors towards trans people. These findings support the development of community strategies to increase the social inclusion of transgender people. The TIBS is a useful measure to track their success.

Examining the Validity of the Levels of Personality Functioning Questionnaire for Adolescents Aged 12-18 (LOPF-Q 12-18): A Replication and Extension With a Sample of Lithuanian Adolescents

With the shift to the dimensional model of personality pathology, the need for measures assessing personality functioning in adolescence has emerged. The Levels of Personality Functioning Questionnaire 12-18 (LoPF-Q 12-18) was developed specifically for adolescents, tailoring the Alternative Model of Personality Disorders in the DSM-5. Using the Lithuanian LoPF-Q 1218, we further investigate its validity by reexamining its factorial structure and extending convergent, discriminant, and incremental validity analyses. A total of 1,048 community-based and clinically referred 12-18-year-old adolescents completed the LoPF-Q 12-18 along with other self-report measures of personality pathology, psychopathological symptoms, and psychosocial functioning. In line with previous findings, the results supported the bifactor model consisting of a strong general factor and little multidimensionality caused by the group factors, overall suggesting an essentially unidimensional structure. Further analyses provided additional information on the construct validity of the LoPF-Q 12-18.

Conducting cross-cultural, multi-lingual or multi-country scale development and validation in health care research: A 10-step framework based on a scoping review

Background

Valid, reliable and cross-cultural equivalent scales and measurement instruments that enable comparisons across diverse populations in different countries are important for global health research and practice. We developed a 10-step framework through a scoping review of the common strategies and techniques used for scale development and validation in a cross-cultural, multi-lingual, or multi-country setting, especially in health care research.

Methods

We searched MEDLINE, Embase, and PsycINFO for peer-reviewed studies that collected data from two or more countries or in two or more languages at any stages of scale development or validation and published between 2010-22. We categorised the techniques into three commonly used scale development and validation stages (item generation, scale development, and scale evaluation) as well as during the translation stage. We described the most commonly used techniques at each stage.

Results

We identified 141 studies that were included in the analysis. We summarised 14 common techniques and strategies, including focus groups or interviews with diverse target populations, and involvement of measurement experts and linguists for item content validity expert panel at the item generation stage; back-and-forth translation, collaborative team approach for the translation stage; cognitive interviews and different recruitment strategies and incentives in different settings for scale development stage; and three approaches for measurement invariance (multigroup confirmatory factor analysis, differential item functioning and multiple indicator multiple causes) for scale evaluation stage.

Conclusions

We provided a 10-step framework for cross-cultural, multi-lingual or multi-country scale development and validation based on these techniques and strategies. More research and synthesis are needed to make scale development more culturally competent and enable scale application to better meet local health and development needs.

Sociability across Eastern-Western cultures: Is it the same underlying construct?

In this study, we examined cross-cultural differences in sociability, a core personality facet of the higher order extraversion trait, which has been reported at lower levels in Eastern versus Western cultures several decades ago. Up until now, however, East-West cultural comparisons on the Western-defined construct of sociability have been limited, despite the extensive research published on extraversion indicating that this personality dimension is globally relevant across cultures. Following current practices, we first assessed for measurement invariance (MI) on the Cheek and Buss sociability scale between Chinese (n = 816, 47.2% male, M = 18.51 years, SD = 1.26 years) and Canadian (n = 995, 30.8% male, M = 19.62 years, SD = 1.25 years) young adult samples to ensure any comparisons would be valid and meaningful. Results from a multigroup confirmatory factor analysis (exact invariance) showed that there was measurement non-invariance at the scalar level in the sociability construct across country and country by sex, and the newer alignment method (approximate invariance) confirmed these results, suggesting that mean level comparisons of sociability were biased and noninformative. Our findings indicated that although a few of the higher-level personality dimensions such as extraversion are considered universal, the facets underlying their meaning, like sociability, are not as clearly delineated between cultures. Alongside the present-day pursuit of understanding personality across cultures through an indigenous measurement lens in tandem with the notion of universality, researchers should also consider narrowing their focus onto lower-level facets, each of which is likely to be uniquely embedded into a cultural context.

Construct Validity, Longitudinal Measurement Invariance, Incremental Validity, and Predictive Validity of the Original Grit Scale in Chinese Young Adults

Although many studies have attempted to validate grit scales because of the construct's popularity, most have considered the shorter rather than the longer Original Grit Scale (Grit-O). We examined the Grit-O's construct validity, longitudinal measurement invariance, incremental validity for academic performance, and longitudinal predictive validity for subjective well-being among young Chinese. We used a cross-sectional sample of 3,322 college students and a longitudinal sample of 1,884 college students, tested twice over 10 months. The first-order factor model fit the data better than other models and showed partial configural and metric measurement invariance over time. Grit and its two facets longitudinally predicted subjective well-being (i.e., life satisfaction, happiness, positive affect, negative affect, and depression) but had negligible incremental validity for two semesters' grades after controlling for conscientiousness. So, while the Grit-O could be a useful construct for young adults, its predictive value overlaps with a better-established construct, conscientiousness.

Development of a Culture-Common Formal Characteristics of Behavior - Temperament Markers Inventory (FCB-TMI-CC)

The goal was to create a brief temperament inventory grounded in the Regulative Theory of Temperament (FCB-TMI-CC), with a user-friendly, online applicability for studies in different cultures. As the regulative role of temperament is strongly revealed under meaningful stress, the study was planned within the time of the COVID-19 pandemic. To ensure high diversity in terms of culture, economic and environmental conditions, data from nine countries (Poland, United States of America, Italy, Japan, Argentina, South Korea, Ireland, United Kingdom and Kazakhstan) were utilized (min. N = 200 per country). Validation data were gathered on the level of COVID-19 stressors, posttraumatic stress disorder (PTSD), depression, anxiety and stress symptoms, and Big Five personality traits. Multigroup confirmatory factor analysis served as the basis for the inventory's construction. The final culture-common version includes 37 items (5-6 in each of the 7 scales) and covers the core aspects of temperament dimensions. Temperament structure was confirmed to be equivalent across measured cultures. The measurement is invariant at the level of factor loadings and the reliability (internal consistency) and theoretical validity of the scales were at least acceptable. Therefore, the FCB-TMI-CC may serve as a valuable tool for studying temperament across diverse cultures and facilitate cross-cultural comparisons.

Does the Paraphilia Scale Work for Everyone? Confirmatory Factor Analysis and Measurement Invariance Across Gender and Sexual Orientation Groups

We conducted three studies to examine the factor structure and measurement invariance of the Paraphilia Scale, a measure of paraphilic interests used in multiple studies. In the first study, we conducted a confirmatory factor analysis (CFA) testing different a priori models with a community sample of 1,040 adults previously reported by Seto et al. (2021), and found support for a hierarchical four-factor model: An agonistic continuum involving coercion or physical pain (biastophilia, sexual sadism, masochism), chronophilias (pedophilia, hebephilia), courtship disorders (voyeurism, exhibitionism, and frotteurism), and fetishism (object fetishism, transvestic fetishism, urophilia-coprophilia). This factor structure was replicated in a second study comprising a combined sample of 400 mTurk participants and 870 university students. The third study analyzed the community sample and found evidence of configural invariance but not scalar or metric invariance across gender (man or woman) and sexual orientation for gender (heterosexual or other sexual orientation). This indicates that the factor structure of the Paraphilia Scale is robust for gender and sexual orientation for gender, but factor loadings differ across these groups, as do the loadings of individual items on the four factors. Implications for research on gender and sexual orientation differences in paraphilic interests are discussed.

Academic grit scale for Chinese middle- and upper-grade primary school students: testing its factor structure and measurement invariance

The Academic Grit Scale (AGS) is a novel measure of academic-specific grit. However, its factor structure and measurement invariance have yet to be thoroughly supported. The present study tested the factor structure and measurement invariance of the AGS with a large sample of early adolescents (aged 9-14 years) from China (N = 1,894). The bifactor model showed that the AGS was predominately accounted for by the general factor rather than the domain-specific factors; the parallel model from the AGS's one-factor model showed good fit indices; thus, the AGS should be described as a univocal solution and reported as the total score. Gender and grade measurement invariance were supported at a scalar level, warranting further mean difference comparisons. In addition, academic grit was significantly associated with positive academic emotions and academic achievement, yielding evidence of good criteria-related validity. The current study contributes additional evidence to the construct validity of the Chinese version of the AGS among middle- and upper-grade primary school students in China.

Measuring Intellectual Curiosity across Cultures: Validity and Comparability of a New Scale in Six Languages

Intellectual curiosity-the tendency to seek out and engage in opportunities for effortful cognitive activity-is a crucial construct in educational research and beyond. Measures of intellectual curiosity vary widely in psychometric quality, and few measures have demonstrated validity and comparability of scores across multiple languages. We analyzed a novel, six-item intellectual curiosity scale (ICS) originally developed for cross-national comparisons in the context of the OECD's Programme for the International Assessment of Adult Competencies (PIAAC). Samples from six countries representing six national languages (U.S. Germany, France, Spain, Poland, and Japan; total N = 5,557) confirmed that the ICS possesses very good psychometric properties. The scale is essentially unidimensional and showed excellent reliability estimates. On top of factorial validity, the scale demonstrated strict measurement invariance across demographic segments (gender, age groups, and educational strata) and at least partial scalar invariance across countries. As per its convergent and divergent associations with a broad range of constructs (e.g., Open-Mindedness and other Big Five traits, Perseverance, Sensation Seeking, Job Orientations, and Vocational Interests), it also showed convincing construct validity. Given its internal and external relationships, we recommend the ICS for assessing intellectual curiosity, especially in cross-cultural research applications, yet we also point out future research areas.

Can personality disorder be accurately assessed in older age? A differential item functioning analysis of ICD-11 inventories

OBJECTIVES

The contested categorical personality disorder (PD) criteria are not well suited to inform PD diagnoses in older adults. Yet, the classification of PDs is undergoing a critical transition phase with a paradigm shift to a dimensional approach for diagnosing PDs. No special attention was given to the expression of PDs in older age when the dimensional ICD-11 model was developed. Given that PDs are highly prevalent in older adults, there is an urgent need to examine if ICD-11 related instruments are able to adequately assess for PDs in older adults.

METHODS

The age-neutrality of ICD-11 measures was examined in a sample of 208 Dutch community-dwelling adults (N = 208, M age = 54.96, SD = 21.65), matched on sex into 104 younger (age range 18-64) and 104 older (age range 65-93) adults. An instrument is considered not to be age-neutral if a collective large level of differential item functioning (DIF) exists in a group of items of an instrument (i.e., 25% or more with DIF). We therefore set out to detect possible DIF in the following ICD-11 self-report measures: the Standardized Assessment of Severity of Personality Disorder (SASPD), the Personality Inventory for ICD-11 (PiCD), and the Borderline Pattern Scale (BPS).

RESULTS

DIF analyses using a non-parametric odds ratio approach demonstrated that SASPD, PiCD, and BPS were age-neutral with less than 25% of items showing DIF. Yet, impact of DIF at scale level, examined by way of differential test functioning (DTF), indicated a DTF effect on the SASPD total score.

CONCLUSIONS

These results of age-neutrality of the PiCD and BPS are promising for measuring ICD-11 traits and the borderline pattern. Yet, the age-neutral measurement of PD severity requires further research. With a rapidly aging population, its accurate assessment across the entire adult life span, including older age, is a prerequisite for an adequate detection of PDs.

Personality traits and their influence on Echo chamber formation in social media: a comparative study of Twitter and Weibo

The echo chamber effect on social media has attracted attention due to its potentially disruptive consequences on society. This study presents a framework to evaluate the impact of personality traits on the formation of echo chambers. Using Weibo and Twitter as platforms, we first define an echo chamber as a network where users interact solely with those sharing their opinions, and quantify echo chamber effects through selective exposure and homophily. We then employ an unsupervised personality recognition method to assign a personality model to each user, and compare the distribution differences of echo chambers and personality traits across platforms and topics. Our findings show that, although user personality trait models exhibit similar distributions between topics, differences exist between platforms. Among 243 personality model combinations, over 20% of Weibo echo chamber members are "ynynn" models, while over 15% of Twitter echo chamber members are "nnnny" models. This indicates significant differences in personality traits among echo chamber members between platforms. Specific personality traits attract like-minded individuals to engage in discussions on particular topics, ultimately forming homogeneous communities. These insights are valuable for developing targeted management strategies to prevent the spread of fake news or rumors.

Brief Version of the Revised-Abbreviated Eysenck Personality Questionnaire in a Spanish Young Adult Population

Eysenck's PEN model is one of the most relevant and fruitful models with empirical support, and continues eliciting a large research corpus. Neverthe less, the systematic limitations regarding the psychoticism dimension and questionable inclusion of social desirability as a personality dimension have limited the model. The current research aimed to estimate an alternative PEN model including social desirability as a control and test its validity and reliability. This sample consists of 2969 Spanish young adults. Confirmatory factor analysis was carried out to test the fitting of four different models to the data. Once the best-fitting model was obtained, multiple-group analyses were carried out to assess the configural, metric, and scalar invariance of the model across sexes. The results showed that the three-dimension PEN model and two-dimension EN model controlling social desirability best fit the data and were invariant across sexes. Despite the apparent appropriateness of both models, the EN model controlling for social desirability is more appropriate due to the weakness of the P dimension.

Measurement invariance and adapted preferences: evidence for the ICECAP-A and WeRFree instruments

BACKGROUND

Self-report instruments are used to evaluate the effect of interventions. However, individuals adapt to adversity. This could result in individuals reporting higher levels of well-being than one would expect. It is possible to test for the influence of adapted preferences on instrument responses using measurement invariance testing. This study conducts such a test with the Wellbeing Related option-Freedom (WeRFree) and ICECAP-A instruments.

METHODS

A multi-group confirmatory factor analysis was conducted to iteratively test four increasingly stringent types of measurement invariance: (1) configural invariance, (2) metric invariance, (3) scalar invariance, and (4) residual invariance. Data from the Multi Instrument Comparison study were divided into subsamples that reflect groups of participants that differ by age, gender, education, or health condition. Measurement invariance was assessed with (changes in) the Comparative Fit Index (CFI), Root Mean Square Error of Approximation (RMSEA), and Root Mean Square Residual (SRMR) fit indices.

RESULTS

For the WeRFree instrument, full measurement invariance could be established in the gender and education subsamples. Scalar invariance, but not residual invariance, was established in the health condition and age group subsamples. For the ICECAP-A, full measurement invariance could be established in the gender, education, and age group subsamples. Scalar invariance could be established in the health group subsample.

CONCLUSIONS

This study tests the measurement invariance properties of the WeRFree and ICECAP-A instruments. The results indicate that these instruments were scalar invariant in all subsamples, which means that group means can be compared across different subpopulations. We suggest that measurement invariance of capability instruments should routinely be tested with a reference group that does not experience a disadvantage to study whether responses could be affected by adapted preferences.

Ensuring cross-cultural data comparability by means of anchoring vignettes in heterogeneous refugee samples

BACKGROUND

Configural, metric, and scalar measurement invariance have been indicators of bias-free statistical cross-group comparisons, although they are difficult to verify in the data. Low comparability of translated questionnaires or the different understanding of response formats by respondents might lead to rejection of measurement invariance and point to comparability bias in multi-language surveys. Anchoring vignettes have been proposed as a method to control for the different understanding of response categories by respondents (the latter is referred to as differential item functioning related to response categories or rating scales: RC-DIF). We evaluate the question whether the cross-cultural comparability of data can be assured by means of anchoring vignettes or by considering socio-demographic heterogeneity as an alternative approach.

METHODS

We used the Health System Responsiveness (HSR) questionnaire and collected survey data in English (n = 183) and Arabic (n = 121) in a random sample of refugees in the third largest German federal state. We conducted multiple-group Confirmatory Factor Analyses (MGCFA) to analyse measurement invariance and compared the results when 1) using rescaled data on the basis of anchoring vignettes (non-parametric approach), 2) including information on RC-DIF from the analyses with anchoring vignettes as covariates (parametric approach) and 3) including socio-demographic covariates.

RESULTS

For the HSR, every level of measurement invariance between the Arabic and English languages was rejected. Implementing rescaling or modelling on the basis of anchoring vignettes provided superior results over the initial MGCFA analysis, since configural, metric and - for ordered categorical analyses-scalar invariance could not be rejected. A consideration of socio-demographic variables did not show such an improvement.

CONCLUSIONS

Surveys may consider anchoring vignettes as a method to assess cross-cultural comparability of data, whereas socio-demographic variables cannot be used to improve data comparability as a standalone method. More research on the efficient implementation of anchoring vignettes and further development of methods to incorporate them when modelling measurement invariance is needed.

Estimating Local Structural Equation Models

Local structural equation models (LSEM) are structural equation models that study model parameters as a function of a moderator. This article reviews and extends LSEM estimation methods and discusses the implementation in the R package sirt. In previous studies, LSEM was fitted as a sequence of models separately evaluated as each value of the moderator variables. In this article, a joint estimation approach is proposed that is a simultaneous estimation method across all moderator values and also allows some model parameters to be invariant with respect to the moderator. Moreover, sufficient details on the main estimation functions in the R package sirt are provided. The practical implementation of LSEM is demonstrated using illustrative datasets and an empirical example. Moreover, two simulation studies investigate the statistical properties of parameter estimation and significance testing in LSEM.

An Examination of Racial/Ethnic Differences on the Neurobehavioral Symptom Inventory Among Veterans Completing the Comprehensive Traumatic Brain Injury Evaluation: A Veterans Affairs Million Veteran Program Study

OBJECTIVE

The purpose of this study was to explore racial/ethnic differences in neurobehavioral symptom reporting and symptom validity testing among military veterans with a history of traumatic brain injury (TBI).

METHOD

Participants of this observational cross-sectional study (N = 9,646) were post-deployed Iraq-/Afghanistan-era veterans enrolled in the VA's Million Veteran Program with a clinician-confirmed history of TBI on the Comprehensive TBI Evaluation (CTBIE). Racial/ethnic groups included White, Black, Hispanic, Asian, Multiracial, Another Race, American Indian or Alaska Native, and Native Hawaiian or Other Pacific Islander. Dependent variables included neurobehavioral symptom domains and symptom validity assessed via the Neurobehavioral Symptom Inventory (NSI) and Validity-10, respectively.

RESULTS

Chi-square analyses showed significant racial/ethnic group differences for vestibular, somatic/sensory, and affective symptoms as well as for all Validity-10 cutoff scores examined (≥33, ≥27, ≥26, >22, ≥22, ≥13, and ≥7). Follow-up analyses compared all racial/ethnic groups to one another, adjusting for sociodemographic- and injury-related characteristics. These analyses revealed that the affective symptom domain and the Validity-10 cutoff of ≥13 revealed the greatest number of racial/ethnic differences.

CONCLUSIONS

Results showed significant racial/ethnic group differences on neurobehavioral symptom domains and symptom validity testing among veterans who completed the CTBIE. An enhanced understanding of how symptoms vary by race/ethnicity is vital so that clinical care can be appropriately tailored to the unique needs of all veterans. Results highlight the importance of establishing measurement invariance of the NSI across race/ethnicity and underscore the need for ongoing research to determine the most appropriate Validity-10 cutoff score(s) to use across racially/ethnically diverse veterans.

Burnout of Greek Teachers: Measurement Invariance and Differences across Individual Characteristics

Burnout (BT) is a vital determinant of work effectiveness and a well-studied psychological construct. The dominant theoretical perspectives have defined BT via the proposed dimensional structures and have provided the corresponding instruments for measuring them. The present endeavor adopts the Oldenburg Burnout Inventory (OLBI), as its purpose is to examine the psychometric properties of a short version for the Greek teachers and to find differences across their individual characteristics. The Greek short version of OLBI comprises two dimensions: Disengagement (four items) and Exhaustion (five items), with reliability measures utilizing Cronbach's alpha and McDonald's omega: Exhaustion (α = 0.810/ω = 0.823) and Disengagement (α = 0.742/ω = 0.756). Confirmatory factor analysis showed an adequate fit of the measurement model: χ² = 320.291, df = 26, p < 0.001; CFI = 0.970; TLI = 0.958; RMSEA = 0.068; 90% CI of RMSEA = [0.062; 0.075]; SRMR = 0.067; NFI = 0.967; GFI = 0.986]. The proposed model is extracted after two studies (N₁ = 134, N₂ = 2437). The novel aspect of this endeavor is the measurement invariance explored across selected demographic variables. The findings supporting the measurement invariance make an essential contribution to the field, and the implications for educational research are provided along with a concise presentation of theoretical issues.

Cross-cultural equivalence of parental ratings of child difficulties during the pandemic: Findings from a six-site study

OBJECTIVES

The Strengths and Difficulties Questionnaire (SDQ) has been shown to be invariant across informants, developmental stage and settings, but tests of cross-cultural equivalence are limited to adolescents' self-reports. The COVID-19 pandemic makes this gap particularly pertinent, given the need to understand whether distinct government approaches (e.g., school closures) are uniquely associated with variability in children's psychosocial outcomes and the reliance on parents' ratings for young children.

METHODS

Within a Confirmatory Factor Analysis framework, we tested the cross-cultural measurement invariance of the SDQ across six countries: Australia, China, Italy, Sweden, the United Kingdom and USA, using a sample of 1761 parents of 3- to 8-year-olds (M = 5.76, SD = 1.09).

RESULTS

A five-factors model showed good fit to the data and partial cross-cultural scalar invariance. In this sample, Swedish parents reported the fewest peer problems (Cohen's d = 0.950) and the highest prosocial scores (Cohen's d = 0.547), whilst British parents reported the greatest child emotional (Cohen's d = 0.412) and hyperactivity problems (Cohen's d = 0.535).

CONCLUSIONS

The present results indicate that the parent-version of the SDQ is appropriate for use and comparison across different contexts during the pandemic.

The Körperkoordinations Test Für Kinder for Iranian Youth: Factor Structure, Measurement Invariance, and Covariates

Purpose: To examine the factor structure and measurement invariance of the Körperkoordinations Test Für Kinder (KTK) and covariates of motor competence in a sample of Iranian children aged 5–14 years. Methods: Participants were children aged 5–14 years (N = 432, 61% boys). Age, sex, and body mass index were collected. Confirmatory factor analysis (CFA) was conducted to investigate the factorial structure of KTK and multigroup CFA carried out to test measurement invariance across sexes and age groups. In addition, we calculated a model with covariates to identify the association between KTK items with age, sex, and body mass index z score. Results: CFA supported the construct validity of a one-factor model with an appropriate fit indices that the four subtests loaded on the same factor namely motor competence. Furthermore, according to the magnitude of changes in root mean square error of approximation and comparative fit index between nested models, the assumption of KTK measurement invariance across age-groups and sex were valid. Finally, adequate fit indices were found for the multigroup CFA path model of KTK with the covariates sex, age, and body mass index z score. Conclusion: The KTK is a valid, reliable, and valuable instrument for assessing motor competence of Iranian children and adolescents.

Measuring Personality Systems in Older Adults: Age-Neutrality of the Dutch BIS/BAS Questionnaire

Introduction

With a rapidly aging population, age-neutrality of psychological instruments is becoming ever more important for accurate assessment of older adults. This study aims to test the age-neutrality of the Dutch Behavioral Inhibition System/Behavioral Approach System (BIS/BAS) scales by means of Differential Item Functioning (DIF) and Differential Test Functioning (DTF) analyses.

Methods

DIF and DTF analyses were conducted using an odds ratio approach. Potential DIF was examined for the two primary scales and three BAS subscales in 390 Dutch-speaking participants divided over three age groups.

Results

Overall, the BIS-BAS scales lacked age-neutrality when comparing older adults to young adults: eight out of 20 items (ie, 40%) displayed DIF according to the adjusted Bonferroni corrected cut-offs, which exceeds the threshold of 25% for large DIF. Thus, for 40% of the test items, items were differently endorsed by young and older adults with the same position on the construct measured by the item. Therefore, the implications of the item-level DIF on the scale level were investigated across age groups. DTF analyses revealed large DTF for all BIS and BAS scales according to the adjusted Bonferroni corrected cut-offs.

Discussion

DIF found in items on the BIS scale and BAS-Drive and BAS-Fun Seeking scale can probably be explained by a difference in degree of expression across age groups. A solution could be the development of age-specific norms. DIF on BAS-Reward Responsiveness subscale could be partly due to measuring a different construct across age groups. Rephrasing or replacing such items with DIF may increase age-neutrality of the BIS/BAS Scales.

Cross-cultural Study of the Personality Inventory for the DSM-5 (PID-5) across the Portuguese and the United Arab Emirates (UAE) Community and Clinical Populations

Aims

The present paper focused on compare the PID-5 mean score levels across two matched community and clinical samples of Portugal and the UAE.

Background

The generalizability and universality of the Alternative Model of Personality Disorders has been thoroughly studied through the Personality Inventory for DSM-5 (PID-5) across countries and languages. However, studies comparing Western and Middle Eastern countries are still limited, in particular those who assess the PID-5 measurement invariance.

Objectives

We examined measurement invariance of the PID-5 scales across matched Emirati and Portuguese clinical and nonclinical groups, as well as compare and contrast the PID-5 mean score levels across both countries and samples.

Methods

The Arabic and the Portuguese versions of the PID-5 was administered to Emirati community participants (N = 300, 80% women and 20% men, M_age = 27.95) which were matched with Portuguese community participants (N = 300, 80.3% women and 19.7% men, M_age = 28.96), as well as clinical participants of the UAE (N = 150, 61.3% women and 38.7% men, M_age = 31.29) and Portugal (N = 150, 52% men and 48% women, M_age = 44.97). We examined measurement invariance through an unrestricted Factor Analysis based program, and mean scores levels were compared and analyzed.

Results

Our findings supported the PID-5 measurement invariance across the Emirati and Portuguese clinical samples pointing to the universality and generalizability of the Alternative Model of Personality Disorders. The Emirati psychiatric sample exhibited somehow higher results than the Portuguese psychiatric participants, albeit the small effect size for most of the PID-5 scales.

Conclusion

Further research is needed to examine the applicability of the PID-5 across non-clinical representative samples of Portugal and the UAE, and other Middle Eastern countries.

How Fair Is My Test?

Abstract. The degree to which test scores can support justified and fair decisions about demographically diverse participants has been an important aspect of educational and psychological testing for millennia. In the last 30 years, this aspect of measurement has come to be known as consequential validity, and it has sparked scholarly debate as to how responsible psychometricians should be for the fairness of the tests they create and how the field might be able to quantify that fairness and communicate it to applied researchers and other stakeholders of testing programs. Here, we formulate a relatively simple-to-calculate ratio coefficient that is meant to capture how well the scores from a given test can predict a criterion free from the undue influence of student demographics. We posit three example calculations of this Consequential Validity Ratio (CVR): one where the CVR is quite strong, another where the CVR is more moderate, and a third where the CVR is weak. We provide preliminary suggestions for interpreting the CVR and discuss its utility in instances where new tests are being developed, tests are being adapted to a new population, or the fairness of an established test has become an empirical question.

PERMA Model of Well-Being Applied to Portuguese Senior Tourists: A Confirmatory Factor Analysis

Tourism has been affirmed as an activity that promotes health and well-being. The present study aims to present a confirmatory analysis of the PERMA model in a sample of Portuguese senior tourists who visited the island of São Miguel (Azores). After approval of the study by the ethics committee (reference 6/2022), a Sociodemographic Questionnaire, PERMA Profiler, and Life Satisfaction Scale—SWLS were applied to 1083 senior tourists (≥55 years) of various nationalities. To evaluate the PERMA model for senior tourism in Portugal, a total of 434 senior tourists of Portuguese nationality were extracted from the sample. The results revealed that most of the participants attributed scores above the midpoint in the five dimensions of PERMA (positive emotions, engagement, relationships, meaning, accomplishment) and in the satisfaction with life scale. Using scale reliability analyses, we found that some of the dimensions in the PERMA model showed relatively low values both for Cronbach alpha and composite reliability. Several confirmatory structural equation models (single factorial, second order, and five factors) were calculated, as well as the usual adjustment measures, with the five-factor PERMA model presenting the best structure, although with a relatively low fit. The modification of the model by the weight of regressions between some of the items with larger covariances allowed a better adjustment: χ2(73) = 264.960, p < 0.001, χ2/df = 3.63, CFI = 0.94, TLI = 0.91, IFI = 0.94; GFI = 0.92, RMSEA = 0.078, p < 0.001. Although the results revealed that the experiences of senior tourists when visiting the island of São Miguel contributed significantly to their well-being and the modified model presented superior adjustment quality, future studies are suggested to evaluate the quality of the PERMA model applied to tourism.

Measurement invariance of body image measures by age, gender, sexual orientation, race, weight status, and age: The U.S. Body Project I

Despite growing interest in comparing body image experiences across diverse groups, limited work has examined whether body image measures operate similarly across different populations, raising important questions about the appropriateness of comparing scale means across demographic groups. This study employed measurement invariance testing to evaluate whether such comparisons are appropriate with existing body image measures. Specifically, multi-group confirmatory factor analysis was conducted using a community sample of 11,620 men and women to test increasing levels of invariance (configural, metric, scalar) across five key demographic variables (age group, gender, sexual orientation, race, weight status) for five commonly used body image measures (the Sociocultural Attitudes Towards Appearance Questionnaire-4, the Body Surveillance subscale of the Objectified Body Consciousness Scale, the Appearance Evaluation and Overweight Preoccupation subscales of the Multidimensional Body-Self Relations Questionnaire, and the Body Image Quality of Life Inventory). Results provided evidence of scalar (i.e., strong) invariance for all five measures across age, gender, sexual orientation, race, and weight status groups, indicating that the latent factors captured by these measures have the same meaning across demographic groups. Findings therefore support the comparison of scale/subscale means across multiple demographic groups for these body image measures.

Perceived stress during the prenatal period: assessing measurement invariance of the Perceived Stress Scale (PSS-10) across cultures and birth parity

Maternal prenatal stress places a substantial burden on mother's mental health. Expectant mothers in low- and middle-income countries (LMICs) have thus far received less attention than mothers in high-income settings. This is particularly problematic, as a range of triggers, such as exposure to traumatic events (e.g. natural disasters, previous pregnancy losses) and adverse life circumstances (e.g. poverty, community violence), put mothers at increased risk of experiencing prenatal stress. The ten-item Perceived Stress Scale (PSS-10) is a widely recognised index of subjective experience of stress that is increasingly used in LMICs. However, evidence for its measurement equivalence across settings is lacking. This study aims to assess measurement invariance of the PSS-10 across eight LMICs and across birth parity. This research was carried out as part of the Evidence for Better Lives Study (EBLS, vrc.crim.cam.ac.uk/vrcresearch/EBLS). The PSS-10 was administered to N = 1,208 expectant mothers from Ghana, Jamaica, Pakistan, the Philippines, Romania, South Africa, Sri Lanka and Vietnam during the third trimester of pregnancy. Confirmatory factor analysis suggested a good model fit of a two-factor model across all sites, with items on experiences of stress loading onto a negative factor and items on perceived coping onto a positive factor. Configural and metric, but not full or partial scalar invariance, were established across all sites. Configural, metric and full scalar invariance could be established across birth parity. On average, first-time mothers reported less stress than mothers who already had children. Our findings indicate that the PSS-10 holds utility in assessing stress across a broad range of culturally diverse settings; however, caution should be taken when comparing mean stress levels across sites.

Validation of a Spanish Translation of the Faceted Inventory of the Five-Factor Model in Two Mexican University Student Samples

The validity, and thus utility, of psychological instruments requires continued evaluation of their underlying psychometric properties across contexts. Measurement tools have been developed over the past few decades to assess personality constructs developed through various theoretical frameworks. The Big Five has been a particular focus of such inquiry; however, few studies have validated a Spanish version for use in Mexico. Using two separate Mexican college student samples (Sample 1: n = 289, Sample 2: n = 309) we tested factorial structure, reliability, and validity of a Spanish translation of the Faceted Inventory of the Five-Factor Model (FI-FFM; Watson, Nus, & Wu). An exploratory factor analysis showed a similar structure to the original FI-FFM, albeit with some exceptions primarily within the Extraversion and Agreeableness domains. Furthermore, the FI-FFM scales were internally consistent and highly stable over time (average interval = 5 months). Finally, the scales showed strong convergent and discriminant validity and the facet scales displayed validity in predicting outcomes.

Borderline personality disorder in young people: associations with support and negative interactions in relationships with mothers and a best friend

BACKGROUND

Impaired interpersonal functioning has been highlighted as a core feature of borderline personality disorder (BPD). Adolescence and young adulthood form important developmental stages within both the emergence of BPD and the development of interpersonal functioning, which takes place mostly in relationships with parents and friends. This study aimed to: (i) investigate relations between BPD symptoms and both supportive and negative interactions with mothers and best friends; (ii) investigate whether the relations were moderated by age; (iii) test the robustness of our findings by comparing the results based on self-reports with results from a subsample in which supportive and negative interactions with mothers were rated by the mother.

METHODS

312 young people referred to mental healthcare completed self-report measures on BPD and supportive and negative interactions. Multiple regression analyses were conducted to examine the relations between BPD features and perceived supportive and negative interactions with mothers and a best friend, and to investigate whether these relations were moderated by age. Robustness of our findings was studied in a subsample (n = 104), by using a multi-informant design in maternal report on supportive and negative interactions with mothers.

RESULTS

Multiple regression analyses demonstrated that negative interactions with mothers as well as with a best friend were related to more BPD symptoms in young people. Supportive interactions were not related to BPD symptoms. Both BPD and quality of relations were not related to age. In a subsample in which supportive and negative interactions with mothers were rated by the mother, the maternal report showed slightly different results. In this model, both supportive and negative interactions with a best friend were positively related, whereas interactions with mothers were not related to BPD symptoms in young people.

CONCLUSIONS

Results highlight the importance of relationships with mothers and a best friend during adolescence and young adulthood. Given that BPD often emerges during this developmental phase, future research is needed to clarify how quality of relationships could alter pathways toward BPD in young people.

TRIAL REGISTRATION

Not applicable.

Detecting Idiographic Personality Change

Personality changes across the lifespan, but strong evidence regarding the mechanisms responsible for personality change remains elusive. Studies of personality change and life events, for example, suggest that personality is difficult to change. But there are two key issues with assessing personality change. First, most change models optimize population-level, not individual-level, effects, which ignores heterogeneity in patterns of change. Second, optimizing change as mean-levels of self-reports fails to incorporate methods for assessing personality dynamics, such as using changes in variances of and correlations in multivariate time series data that often proceed changes in mean-levels, making variance change detection a promising technique for the study of change. Using a sample of N = 388 participants (total N = 21,790) assessed weekly over 60 weeks, we test a permutation-based approach for detecting individual-level personality changes in multivariate time series and compare the results to event-based methods for assessing change. We find that a non-trivial number of participants show change over the course of the year but that there was little association between these change points and life events they experienced. We conclude by highlighting the importance in idiographic and dynamic investigations of change.

Measuring Early Childhood Mathematical Cognition: Validating and Equating Two Forms of the Research-Based Early Mathematics Assessment

Psychometric work with young children faces the particular challenge that children’s attention spans are relatively short, and therefore, shorter assessments are required while retaining comprehensive coverage. This article reports on three empirical studies that encompass the development and validation of the research-based early mathematics assessment-short form (REMA-SF), an instrument that measures the early mathematical competency of children from 3 to 8 years of age. The developed measure captures both children’s mathematical performance and the strategies children use to solve math problems. Results indicated that the REMA-SF can produce valid scores for measuring children’s math skills in early childhood, and the validity of the measure can be well-generalized to an external (or independent) sample. Additionally, we also equated the REMA scores between the long and short forms of the assessment: anchor items common across the forms were selected and refined in the equating process.

The HEX-ACO-18: Developing an Age-Invariant HEXACO Short Scale Using Ant Colony Optimization

In this study, we developed an age-invariant 18-item short form of the HEXACO Personality Inventory for use in developmental personality research. We combined the item selection procedure ant colony optimization (ACO) and the model estimation approach local structural equation modeling (LSEM). ACO is a metaheuristic algorithm that evaluates items based on the quality of the resulting short scale, thus directly optimizing criteria that can only be estimated with combinations of items, such as model fit and measurement invariance. LSEM allows for model estimation and measurement invariance testing across a continuous age variable by weighting participants, rather than splitting the sample into artificial age groups. Using a HEXACO-100 dataset of N = 6,419 participants ranging from 16 to 90 years of age, we selected a short form optimized for model fit, measurement invariance, facet coverage, and balance of item keying. To achieve scalar measurement invariance and brevity, but maintain construct coverage, we selected 18 items to represent three out of four facets from each HEXACO trait domain. The resulting HEX-ACO-18 short scale showed adequate model fit and scalar measurement invariance across age. Furthermore, the usefulness and versatility of the item and person sampling procedures ACO and LSEM is demonstrated.

Inner Harmony as an Essential Facet of Well-Being: A Multinational Study During the COVID-19 Pandemic

This study aimed to explore the role of two models of well-being in the prediction of psychological distress during the COVID-19 pandemic, namely PERMA and mature happiness. According to PERMA, well-being is mainly composed of five elements: positive emotions, engagement, relationships, meaning in life, and achievement. Instead, mature happiness is understood as a positive mental state characterized by inner harmony, calmness, acceptance, contentment, and satisfaction with life. Rooted in existential positive psychology, this harmony-based happiness represents the result of living in balance between positive and negative aspects of one's life. We hypothesized that mature happiness would be a more prominent protective factor during the present pandemic than the PERMA composite. A total of 12,203 participants from 30 countries responded to an online survey including the Depression Anxiety Stress Scale (DASS-21), the PERMA-Profiler, and the Mature Happiness Scale-Revised (MHS-R). Confirmatory factor analyses indicated that PERMA and mature happiness were highly correlated, but nonetheless, they represented two separate factors. After controlling for demographic factors and country-level variables, both PERMA Well-being and MHS-R were negative predictors of psychological distress. Mature happiness was a better predictor of stress, anxiety, and general distress, while PERMA showed a higher prediction of depression. Mature happiness moderated the relation between the perceived noxious effects of the pandemic and all markers of distress (depression, anxiety, stress, and total DASS-21). Instead, PERMA acted as a moderator in the case of depression and stress. These findings indicate that inner harmony, according to the mature happiness theory, is an essential facet of well-being to be taken into consideration. The results of this study can also orient policies aimed to alleviate the negative effects of the pandemic on mental health through the promotion of well-being.

Lp Loss Functions in Invariance Alignment and Haberman Linking with Few or Many Groups

The comparison of group means in latent variable models plays a vital role in empirical research in the social sciences. The present article discusses an extension of invariance alignment and Haberman linking by choosing the robust power loss function ρ(x)=|x|p(p>0). This power loss function with power values p smaller than one is particularly suited for item responses that are generated under partial invariance. For a general class of linking functions, asymptotic normality of estimates is shown. Moreover, the theory of M-estimation is applied for obtaining linking errors (i.e., inference with respect to a population of items) for this class of linking functions. In a simulation study, it is shown that invariance alignment and Haberman linking have comparable performance, and in some conditions, the newly proposed robust Haberman linking outperforms invariance alignment. In three examples, the influence of the choice of a particular linking function on the estimation of group means is demonstrated. It is concluded that the choice of the loss function in linking is related to structural assumptions about the pattern of noninvariance in item parameters.