Assessment of adaptive behavior in people with intellectual disabilities: Design and development of a new test battery

Background

Adaptive behavior is an important characteristic of people with intellectual disabilities, and it has been associated with a person's performance in social and work contexts. Indeed, adaptive behavior denotes what a person does independently, without help, support, reminders, or prompts. In Peru, available measures of adaptive behavior are commercial; thus, there is a need for an open-access tool to assess the adaptive behavior of people with intellectual disabilities. For this reason, the aim of the study was to design and develop a new Adaptive Behavior Test Battery for people from 13 to 60 years old with intellectual disabilities who have an interest in being part of the economically active population.

Methods

A cross-sectional design was defined, starting with a qualitative approach to designing and constructing the item pool for the test battery. Then, quantitative indexes Aiken's V for content validity and Krippendorff's alpha for inter-observer reliability were estimated, resulting in a first version of the three subscales that comprised the test battery. The initial versions were tested on a sample of 566 persons with intellectual disabilities from two regions of Peru: Lima (Coast) and San Martín (Jungle). The internal structure was analyzed under a factor analysis approach, along with internal consistency measures of reliability. Further analyses of invariance regarding gender, region, and age were carried out.

Results

Three observer subscales were proposed: Daily living activities (11 items), Instrumental skills (4 items), and Communication (9 items). All subscales showed excellent psychometric properties denoted by the Aiken's V coefficient, Krippendorff's alpha, factor analysis, internal consistency analysis, and invariance analyses.

Conclusion

The developed a new Adaptive Behavior Test Battery is a useful tool for the measurement of adaptive behavior and the monitoring of social and labor inclusion programs for people with intellectual disabilities.

Examining Measurement Invariance in the Personality Inventory for DSM-5 Brief Form Across Sexual and Gender Minority Status

The Personality Inventory for Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition, Brief Form (PID-5-BF) was developed with an assumption of invariance across sexual and gender minority (SGM) individuals. This assumption has yet to be tested empirically. Using multigroup confirmatory factor analysis, we examined measurement invariance in the PID-5-BF across the SGM status in clinical (N = 1,174; n = 254 SGM) and nonclinical (N = 1,456; n = 151 SGM) samples. Measurement invariance was supported for the PID-5-BF structure, item thresholds, and factor loadings, but not at the item intercept level. SGM individuals endorsed higher negative affectivity, antagonism, disinhibition, and psychoticism domains in both samples. In the clinical sample, adjusting for partial invariance decreased detachment and antagonism levels for SGM persons. In the nonclinical sample, adjusting for partial invariance reduced antagonism disparities in the SGM group, even rendering original group differences null. Our results support the use of the PID-5-BF in SGM populations but indicate that some measurement bias may drive observed disparities in maladaptive trait domains and, in turn, personality disorder diagnosis.

A New Measure of the Revised Reinforcement Sensitivity Theory

Abstract. The reinforcement sensitivity theory (RST) proposes that neurobiological systems mediate behavior and their functioning can be associated with personality. The functions and associations of RST systems were revised into fight–flight–freeze system (FFFS), behavioral approach/activation system (rBAS), and behavioral inhibition system (rBIS); however, there is limited study of the revised systems due to lack of validated measures. We investigated scale structure, sex invariance, and psychometric properties of the revised RST questionnaire (rRST-Q). The rRST-Q showed good fit as a 5-factor structure with free interfactor correlations and was sex invariant, and associations with personality and mental health measures were consistent with theory and literature. The rRST-Q is a reliable measure, and its use will help understand the link between brain, personality, and behavior.

Embedding Attitudes Toward Immigrants in Solidarity Contexts: A Cross-European Study

This article aims to retrospectively investigate the embeddedness of attitudes toward immigrants (ATI) in cultures of solidarity seen as general orientations toward solidarity measured at a country level. We predict individual-level ATI with country-level aggregated indicators of solidarity that were observed decades earlier. The latter measure local, social, and global solidarity and are explained by a general, overall orientation toward solidarity. For computing the indicators, we combine aggregate data from the European Values Study (EVS) 1999 and 2008 and individual-level data from the spring 2015 Eurobarometer to show that the effect of country-level solidarity on individual-level ATI is strong and stable. The findings reveal that cultures of solidarity have a long-term effect and are the strongest contextual determinant for individual-level ATI. Both 1999 and 2008 data proved to be related to 2015 individual-level attitudes, having a positive effect. In particular, local solidarity positively affects attitudes toward both European Union (EU) and (to a smaller extent) non-EU immigrants. General solidarity remains the most relevant, and it should be used for boosting positive views about immigrants.

Psychometric Assessment and Gender Invariance of the Polish Version of the Gaming Disorder Test

In 2019, Gaming Disorder (GD) was officially recognised by the World Health Organization (WHO) as an official mental health disorder. Currently, the Gaming Disorder Test (GDT) is one of the most widely utilised psychometric tools to assess GD symptoms according to the WHO framework. In this context, the present study aimed to develop the Polish version of the GDT so that this tool can be used within the Polish cultural context. Additionally, the research aimed to ascertain the psychometric properties and appropriateness of the Polish GDT. To achieve this goal, the Polish GDT was investigated in terms of its validity, reliability, and gender measurement invariance through two studies. Accordingly, study 1 recruited a total of 675 gamers (340 female; Meanage = 31.74 years; SD = 7.75 years; range: 15-45 years) and study 2 comprised 575 gamers (275 female; M age = 29.45 years; SD = 4.25 years; range: 18-35 years). A Confirmatory Factor Analysis (CFA) was used to assess psychometric properties of the Polish GDT. The reliability was assessed using Cronbach's alpha, McDonald's omega, and Average Variance Extracted. Gender measurement invariance was investigated using multiple-group CFA, and the unidimensionality was tested using mean of item residual absolute loadings (MIREAL), explained common variance (ECV), and unidimensional congruence (UC). The results of the psychometric analysis showed that the Polish GDT had a one-factor structure. Additionally, the present study demonstrated that the Polish GDT exhibited adequate levels of convergent validity, reliability, and strict gender measurement invariance. These findings suggest that the Polish version of GDT is a suitable psychometric test to assess GD and facilitate research on GD.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11469-022-00929-4.

Four Decades of Challenges by Culture to Mainstream Psychology: Finding Ways Forward

Over 5 days at the Nag’s Head Conference Center, USA in 1987, social and cross-cultural psychologists discussed what would be required if research relating to culture were to gain greater attention from psychology in general, and in particular from what was perceived at the time as its mainstream. The criteria for gaining greater credibility laid down by three leading social psychologists proved daunting in relation to the cross-cultural work presented at the meeting but subsequently inspired cross-culturalists to “raise their game.” In this paper, we describe these crucial challenges and how they have been addressed more recently by cross-cultural psychologists. We assess the extent to which studies focused on cultural differences are now thoughtfully represented in social, personality, and organizational psychology by briefly surveying the content of a single year’s issues of the Journal of Personality and Social Psychology, Journal of International Business Studies, and the Journal of Personality in relation to the concurrent content of the Journal of Cross-Cultural Psychology. We identify the perils of assimilation to psychology in general by diluting the concept of culture and by tyrannizing research with over-specified criteria of statistical rectitude. We also identify studies published in top-rated journals that have nonetheless advanced our field. We reiterate the need for defensible measures of cultural difference and methods for identifying and examining them as a basis for multi-level explanations of cultural effects and cultural change. We conclude by proposing a gold standard for assaying cross-cultural studies of psychological processes and outcomes.

Development and Validation of an Improved Hardiness Measure

Abstract. Previous research shows that psychological hardiness is an important factor contributing to stress resilience in individuals. Of the various instruments available to measure hardiness, the most commonly used is the Dispositional Resilience Scale (DRS). Despite its demonstrated utility, the DRS-15 still has a number of serious limitations, including low subscale reliability and limited construct validity. The present work aims to create a new hardiness scale that addresses these limitations. A pool of new items plus the original DRS item set was administered to a census-matched stratified sample of N = 2,021 men and women across the United States. Items for the new scale were selected based on item distribution characteristics, item response theory plots, scale reliabilities, item-total correlations, and confirmatory factor analysis (CFA). CFA results showed the best fitting model reflected a hierarchical structure with three factors (commitment, control, and challenge) nested under a broad hardiness factor. This factor structure is replicated in two independent validation samples and also holds invariant across gender and age. The new scale shows much improved reliability coefficients (e.g., Cronbach’s α of .93, .85, .84, and .89 for total hardiness, challenge, control, and commitment, respectively), as well as structural equivalence across gender and age. Validity is demonstrated in multiple samples via predictive associations of hardiness scores with theoretically relevant outcome measures, including coping, life satisfaction, anxiety, and depression. The Hardiness Resilience Gauge (HRG) possesses excellent reliability and validity and appears to be a more effective tool for measuring hardiness in adult populations.

Bridging Classical and Revised Reinforcement Sensitivity Theory Research: A Longitudinal Analysis of a Large Population Study

The reinforcement sensitivity theory (RST) proposes that neurobiological systems mediate protective and appetitive behaviours and the functioning of these systems is associated to personality traits. In this manner, the RST is a link between neuroscience, behaviour, and personality. The theory evolved to the present revised version describing three systems: fight-flight-freezing, behavioural approach/activation (BAS), and behavioural inhibition (BIS). However, the most widely available measure of the theory, the BIS/BAS scales, only investigates two systems. Using a large longitudinal community survey, we found that the BIS/BAS scales can be re-structured to investigate the three systems of the theory with a BIS scale, three BAS scales, and a separate fight-flight-freezing system (FFFS) scale. The re-structured scales were age, sex, and longitudinally invariant, and associations with personality and mental health measures followed theoretical expectations and previously published associations. The proposed framework can be used to investigate behavioural choices influencing physical and mental health and bridge historical with contemporary research.

Developmental Trajectories of Science Identity Beliefs: Within-Group Differences among Black, Latinx, Asian, and White Students

Though adolescents' science identity beliefs predict positive STEM outcomes, researchers have yet to examine developmental differences within racial/ethnic groups despite theoretical arguments for such studies. The current study examined science identity trajectories for Black (14%), Latinx (22%), Asian (4%), and White (52%) students (N = 21,170; 50% girls) from 9^th grade to three years post-high school and the variability within each racial/ethnic group based on gender and college generational status. Contrary to the literature, students' science identities increased over time, and the increases were larger for potential first- versus continuing-generation White students. Potential continuing-generation boys had stronger 9^th grade science identities than potential first-generation girls in all groups except Asians. The findings suggest who might benefit from additional supports within each racial/ethnic group.

Teacher Versus Parent Informant Measurement Invariance of the Strengths and Difficulties Questionnaire

Background and Objectives

Obtaining a multi-informant perspective is important when assessing mental health issues in childhood and adolescence. Obtaining ratings from both parents and teachers also facilitates the evaluation of similarities and contrasts in the nature and severity of symptoms across home and school contexts. However, these informants may differ in their interpretations of observed behaviors, raising questions about the validity of comparing parents’ and teachers’ ratings.

Methods

We evaluated the cross-informant measurement invariance of one of the most widely used measures of child and adolescent mental health: The Strengths and Difficulties Questionnaire (SDQ). Using data from the UK-population representative Millennium Cohort Study, we evaluated configural, metric, and scalar measurement invariance across parents and teachers when children were aged 7 (N = 10,221) and 11 (N = 10,543).

Results

Scalar measurement invariance held at both ages. Parents reported higher levels of symptoms in all domains measured at both ages as well as higher prosociality.

Conclusions

For a UK sample, valid comparisons of parent and teacher SDQ ratings at ages 7 and 11 appear to be possible, facilitating the evaluation of contextual differences in child mental health problems. Further, parents report more problem and prosocial behavior in their children than teachers attribute to them.

Validation of the Swedish version of the Reynolds Adolescent Depression Scale second edition (RADS-2) in a normative sample

BACKGROUND

Due to the sharp global increase in prevalence of adolescent major depressive disorder as defined by the Diagnostic and Statistical Manual of Mental Disorders, we need internationally validated tools for multi-dimensional assessment. Reynolds Adolescent Depression Scale second edition (RADS-2) measures dysphoric mood, anhedonia/negative affect, negative self-evaluation and somatic complaints and is widely used internationally, but not yet available in Swedish.

AIM

The aim of this study is to test the psychometric characteristics of the Swedish version of RADS-2 in a normative sample.

MATERIAL AND METHOD

Data was gathered from junior and high school students in Northern Sweden (N = 637). We performed: 1. Confirmatory factor analysis to examine the 4-factor structure proposed by Reynolds, 2. Measurement invariance analysis for sex (girls, boys) and age group (12-15 years, 16-20 years). 3. Reliability testing and 4. Tests for concurrent, discriminant and convergent validity using Beck's Youth Inventories of Emotional and Social Impairment Depression and Anger subscales, the Patient Reported Outcome Measurements Information System, Anxiety and Friends subscales and the World Health Organization Wellness Index.

RESULTS

The sample consisted of n = 637 students (n = 389 girls and n = 248 boys), mean age 15.73 (SD = 1.76); 12-20 years. The 4-factor structure was confirmed, as well as measurement invariance for sex and age group. Reliability was acceptable to excellent for all subscales and RADS-2 total scale. Concurrent, convergent and discriminant validity was good.

CONCLUSION

The Swedish version of RADS-2 showed acceptable reliability and validity in a Swedish normative sample.

A Longitudinal and Gender Invariance Analysis of the Strengths and Difficulties Questionnaire Across Ages 3, 5, 7, 11, 14, and 17 in a Large U.K.-Representative Sample

Developmental invariance is important for making valid inferences about child development from longitudinal data; however, it is rarely tested. We evaluated developmental and gender invariance for one of the most widely used measures of child mental health: the parent-reported Strengths and Difficulties Questionnaire (SDQ). Using data from the large U.K. population-representative Millennium Cohort Study (N = 10,207; with data at ages 3, 5, 7, 11, 14, and 17 years), we tested configural, metric, scalar, and residual invariance in emotional problems, conduct problems, hyperactivity/inattention, prosociality, and peer problems. We found that the SDQ showed poor fit at age 3 in both males and females and at age 17 in males; however, it fit reasonably well and its scores were measurement invariant up to the residual level across gender at ages 5, 7, 11, and 14 years. Scores were also longitudinally measurement invariant across this age range up to the partial residual level. Results suggest that the parent-reported SDQ can be used to estimate developmental trajectories of emotional problems, conduct problems, hyperactivity/inattention, prosociality, and peer problems and their gender differences across the age range 5 to 14 years using a latent model. Developmental differences outside of this range may; however, partly reflect measurement differences.

Inequality in socio-emotional skills: A cross-cohort comparison

We examine changes in inequality in socio-emotional skills very early in life in two British cohorts born 30 years apart. We construct comparable scales using two validated instruments for the measurement of child behaviour and identify two dimensions of socio-emotional skills: 'internalising' and 'externalising'. Using recent methodological advances in factor analysis, we establish comparability in the inequality of these early skills across cohorts, but not in their average level. We document for the first time that inequality in socio-emotional skills has increased across cohorts, especially for boys and at the bottom of the distribution. We also formally decompose the sources of the increase in inequality and find that compositional changes explain half of the rise in inequality in externalising skills. On the other hand, the increase in inequality in internalising skills seems entirely driven by changes in returns to background characteristics. Lastly, we document that socio-emotional skills measured at an earlier age than in most of the existing literature are significant predictors of health and health behaviours. Our results show the importance of formally testing comparability of measurements to study skills differences across groups, and in general point to the role of inequalities in the early years for the accumulation of health and human capital across the life course.

Translation and validation of body image instruments: Challenges, good practice guidelines, and reporting recommendations for test adaptation

Body image research has grown rapidly to include new cultural and linguistic populations, but this gives rise to a need for measurement instruments that are sensitive to local contextual variations while remaining equivalent across groups. Test adaptation, or the translation and validation of a source instrument for use in a new cultural group, is an important part of this process. Here, we offer an operational framework for conducting effective test adaptation. We cover good-practice guidelines for instrument translation and suggest effective strategies for achieving semantic equivalence of translated instruments. We also focus on measurement invariance and provide good-practice and reporting guidelines for conducting exploratory and confirmatory factor analyses. Finally, we suggest good-practice guidelines for demonstrating that scores on translated measures have good reliability and validity. It is our hope that the availability of this article will assist body image scholars seeking to conduct robust test adaptations of existing measurement tools.