Acquiescence in personality questionnaires: Relevance, domain specificity, and stability

The Effects of Questionnaire Length on the Relative Impact of Response Styles in Ambulatory Assessment

Ambulatory assessment (AA) is becoming an increasingly popular research method in the fields of psychology and life science. Nevertheless, knowledge about the effects that design choices, such as questionnaire length (i.e., number of items per questionnaire), have on AA data quality is still surprisingly restricted. Additionally, response styles (RS), which threaten data quality, have hardly been analyzed in the context of AA. The aim of the current research was to experimentally manipulate questionnaire length and investigate the association between questionnaire length and RS in an AA study. We expected that the group with the longer (82-item) questionnaire would show greater reliance on RS relative to the substantive traits than the group with the shorter (33-item) questionnaire. Students (n = 284) received questionnaires three times a day for 14 days. We used a multigroup two-dimensional item response tree model in a multilevel structural equation modeling framework to estimate midpoint and extreme RS in our AA study. We found that the long questionnaire group showed a greater reliance on RS relative to trait-based processes than the short questionnaire group. Although further validation of our findings is necessary, we hope that researchers consider our findings when planning an AA study in the future.

Grandiose narcissism associates with higher cognitive performance under stress through more efficient attention distribution: An eye-tracking study

Narcissism is a part of the Dark Triad that consists also of the traits of Machiavellianism and psychopathy. Two main types of narcissism exist: grandiose and vulnerable narcissism. Being a Dark Triad trait, narcissism is typically associated with negative outcomes. However, recent research suggests that at least the grandiose type may be linked (directly or indirectly) to positive outcomes including lower levels of psychopathology, higher school grades in adolescents, deeper and more strategic learning in university students and higher cognitive performance in experimental settings. The current pre-registered, quasi-experimental study implemented eye-tracking to assess whether grandiose narcissism indirectly predicts cognitive performance through wider distribution of attention on the Raven's Progressive Matrices task. Fifty-four adults completed measures of the Dark Triad, self-esteem and psychopathology. Eight months to one year later, participants completed the Raven's, while their eye-movements were monitored during high stress conditions. When controlling for previous levels of psychopathology, grandiose narcissism predicted higher Raven's scores indirectly, through increased variability in the number of fixations across trials. These findings suggest that grandiose narcissism predicts higher cognitive performance, at least in experimental settings, and call for further research to understand the implications of this seemingly dark trait for performance across various settings.

Measuring Self-Esteem with Expanded Format in a Fraction of Time: ESE-S and ESE-US

Despite the ubiquity of Likert format scales, they are not without problems-distorted dimensionality being one of the most serious. Zhang and Savalei proposed an alternative to Likert format called the Expanded format, in which each response option in the Likert scale is replaced with a series of complete statements. In response to their recent call, the purpose of the present study is to develop concise but valid Expanded format scales for the Rosenberg Self-Esteem Scale. Short (four-item) and ultra-short (two-item) scales were constructed, and their validity was examined in four studies. Results showed both new scales had good psychometric properties (dimensionality, reliability, and validity). Therefore, they would seem to be practical alternatives to the RSES for future research.

The Big Five model in rural Southeast Asia: Validation, stability, and its role in household income

OBJECTIVE

We investigate the applicability of the Big Five model in rural Southeast Asia and thereby challenge recent concerns about the validity of the model in developing countries.

METHOD

We use a novel data set on personality traits from rural Thailand and Vietnam (N = 3811 individuals). In our analysis, we (i) assess the factor structure of the data, (ii) test the internal consistency of the items, (iii) compare the traits across two consecutive survey waves, and (iv) employ regressions to demonstrate the economic relevance of the traits.

RESULTS

The results demonstrate a five-factor structure that fits the Big Five model. We observe changes in personality traits over time but Cohen's d coefficients only range between 0.06 and 0.21. The average rank-order stability, measured by the test-retest correlation of the Big Five between the two consecutive waves, lies at 0.21. Individual changes in personality traits over time relate to experienced shocks and appear to be largely independent of age, gender, and education. We further find that openness and emotional stability positively correlate with rural incomes.

CONCLUSIONS

While there is skepticism, pertaining to the use of personality trait models in developing countries, our study demonstrates that their importance and usage cannot be rejected.

Undergraduate Lay Theories of Abilities: Mindset, universality, and brilliance beliefs uniquely predict undergraduate educational outcomes

Students' beliefs about their abilities (called "lay theories") affect their motivations, behaviors, and academic success. Lay theories include beliefs about the potential to improve intelligence (mindset), who (i.e., everyone or only some people) has the potential to be excellent in a field (universality), and whether reaching excellence in a field requires raw intellectual talent (brilliance). Research demonstrates that each of these beliefs influences students' educational experiences and academic outcomes. However, it remains unclear whether they represent distinct latent constructs or are susceptible to the "jangle fallacy" (i.e., different names given to the same underlying construct). We conducted a multiphase, mixed-methods study to 1) evaluate whether mindset, universality, and brilliance beliefs represent conceptually and empirically discriminable concepts, and 2) evaluate whether mindset, universality, and brilliance beliefs contribute unique explanatory value for both psychosocial (e.g., sense of belonging) and academic outcomes (e.g., course grades). To address these questions, we developed and collected validity evidence for a new measure of science and math undergraduates' lay theories, called the Undergraduate Lay Theories of Abilities (ULTrA) survey. Factor analyses suggest that mindset, brilliance, and universality are distinct and empirically discriminable constructs. Structural Equation Models indicate that each lay theory contributes unique predictive value to relevant outcomes.

Why Do Regular and Reversed Items Load on Separate Factors? Response Difficulty vs. Item Extremity

When constructing measurement scales, regular and reversed items are often used (e.g., "I am satisfied with my job"/"I am not satisfied with my job"). Some methodologists recommend excluding reversed items because they are more difficult to understand and therefore engender a second, artificial factor distinct from the regular-item factor. The current study compares two explanations for why a construct's dimensionality may become distorted: response difficulty and item extremity. Two types of reversed items were created: negation items ("The conditions of my life are not good") and polar opposites ("The conditions of my life are bad"), with the former type having higher response difficulty. When extreme wording was used (e.g., "excellent/terrible" instead of "good/bad"), negation items did not load on a factor distinct from regular items, but polar opposites did. Results thus support item extremity over response difficulty as an explanation for dimensionality distortion. Given that scale developers seldom check for extremity, it is unsurprising that regular and polar opposite items often load on distinct factors.

Awareness Is Bliss: How Acquiescence Affects Exploratory Factor Analysis

Assessing the measurement model (MM) of self-report scales is crucial to obtain valid measurements of individuals' latent psychological constructs. This entails evaluating the number of measured constructs and determining which construct is measured by which item. Exploratory factor analysis (EFA) is the most-used method to evaluate these psychometric properties, where the number of measured constructs (i.e., factors) is assessed, and, afterward, rotational freedom is resolved to interpret these factors. This study assessed the effects of an acquiescence response style (ARS) on EFA for unidimensional and multidimensional (un)balanced scales. Specifically, we evaluated (a) whether ARS is captured as an additional factor, (b) the effect of different rotation approaches on the content and ARS factors recovery, and (c) the effect of extracting the additional ARS factor on the recovery of factor loadings. ARS was often captured as an additional factor in balanced scales when it was strong. For these scales, ignoring extracting this additional ARS factor, or rotating to simple structure when extracting it, harmed the recovery of the original MM by introducing bias in loadings and cross-loadings. These issues were avoided by using informed rotation approaches (i.e., target rotation), where (part of) the rotation target is specified according to a priori expectations on the MM. Not extracting the additional ARS factor did not affect the loading recovery in unbalanced scales. Researchers should consider the potential presence of ARS when assessing the psychometric properties of balanced scales and use informed rotation approaches when suspecting that an additional factor is an ARS factor.

A validation of the Japanese adaptation of the Big Five Inventory-2

The purpose of this study was to adapt a Japanese version of the Big Five Inventory-2 (BFI-2-J) to examine its factor structure, reliability, validity, and measurement invariance. The BFI-2-J assesses five domains and 15 facets of the Big Five personality traits. We analyzed two datasets: 487 Japanese undergraduates and 500 Japanese adults. The results of the principal component analysis and confirmatory factor analysis revealed that the domain-facet structure of the BFI-2-J was similar to that of other language versions. The reliability of the BFI-2-J is sufficient. The correlation coefficients between the BFI-2-J and the other Big Five and self-esteem measures supported convergent and discriminant validity. Moreover, we confirmed measurement invariance across age and sex groups in domain-level and facet-level models. The results suggest that the BFI-2-J is a good instrument for measuring the Big Five personality traits and their facets in Japan. The BFI-2-J is expected to be useful in Japanese personality research and international comparative research.

Modeling Changes in Response Style with Longitudinal IRTree Models

Traditional psychometric modeling focuses on observed categorical item responses, which can over-simplify the respondent cognitive response process. A further weakness is that analysis of ordinal responses has been primarily limited to a single substantive trait at one time point. We propose a significant expansion of this modeling framework to account for complex response processes across multiple waves of data collection using the beneficial item response tree framework. This study proposes a novel model, the longitudinal IRTree, for response processes in longitudinal studies, and investigates whether the response style changes are proportional to changes in the substantive trait of interest. A simulation study demonstrates adequate item parameter recovery in a Bayesian framework, especially with larger sample sizes of 2000. The longitudinal change parameters were recovered similarly well, with improved recovery using informative priors over default priors in Mplus. The empirical application demonstrates that relatively stable observed scores are due to a decrease in response styles offsetting an increase in the latent trait of interest.

When Happiness is Both Joy and Purpose: The Complexity of the Pursuit of Happiness and Well-Being is Related to Actual Well-Being

People differ in how they define and pursue happiness and well-being (HWB). Previous studies suggested that the best way to achieve a high level of well-being might be to pursue different facets of HWB simultaneously. We expand on this idea and introduce the concept of complexity of HWB definitions to describe how many HWB definitions people endorse simultaneously, and the complexity of HWB-related intentions to describe how many unique facets of HWB people intend to pursue in everyday life. To operationalize these novel concepts, we developed two parallel measures that integrate psychological and philosophical definitions of HWB. In two independent studies (total N = 542), exploratory and confirmatory factor analyses revealed eight reliable and valid factors for both parallel scales: absence of negativity, positive attitude, tranquility, personal development, luck, joy and desires, purpose, and belonging. Complexity of HWB-related intentions was positively associated with all facets of well-being, whereas complexity of HWB definitions was only positively associated with some facets of well-being. HWB-related intentions and their complexity emerged as more important for the experience of well-being than HWB definitions and their complexity. These studies highlight the importance of a multifaceted conceptualization of HWB when investigating how the pursuit of HWB is related to actual levels of well-being.

Measuring Response Style Stability Across Constructs With Item Response Trees

Individual response style behaviors, unrelated to the latent trait of interest, may influence responses to ordinal survey items. Response style can introduce bias in the total score with respect to the trait of interest, threatening valid interpretation of scores. Despite claims of response style stability across scales, there has been little research into stability across multiple scales from the beneficial perspective of item response trees. This study examines an extension of the IRTree methodology to include mixed item formats, providing an empirical example of responses to three scales measuring perceptions of social media, climate change, and medical marijuana use. Results show extreme and midpoint response styles were not stable across scales within a single administration and 5-point Likert-type items elicited higher levels of extreme response style than the 4-point items. Latent trait of interest estimation varied, particularly at the lower end of the score distribution, across response style models, demonstrating as appropriate response style model is important for adequate trait estimation using Bayesian Markov chain Monte Carlo estimation.

Cognitive Motivation as a Resource for Affective Adjustment and Mental Health

Background: Depressive symptoms compromise cognitive and self-regulating capacities. Overcoming associated deficits (e.g., attentional bias) demands cognitive effort and motivation. Previous studies on healthy individuals have found cognitive motivation to positively relate to self-regulation and negatively to depressive symptoms. A test of these associations in a clinical sample is lacking. Methods: We assessed cognitive motivation, self-regulation and depressive symptoms by means of well-validated questionnaires in N = 1,060 psychosomatic rehabilitation in-patients before and after treatment. Data were split and analyzed in two steps: We tested previously reported cross-sectional and longitudinal associations of all variables as well as their longitudinal changes in a first sample. Afterward, findings and derived hypotheses were replicated and tested in a second sample. Results: Analyses of both samples confirmed earlier reports on positive associations between cognitive motivation and self-regulation, and negative associations of both with depressive symptoms. While the change in all variables was predicted by their baseline scores, higher baseline cognitive motivation was found to predict stronger improvements in self-regulation, and lower baseline depression scores to predict smaller changes in cognitive motivation and self-regulation. In addition, the change in cognitive motivation partially mediated the association between the changes in depressive symptoms and self-regulation. Conclusion: Based on a large longitudinal data set, the present study expands previous findings and suggests a resource allocation model in which decreasing depressive symptoms lead to a release of capacities benefitting self-regulation directly, and indirectly via cognitive motivation.

Measuring Self-Control in International Large-Scale Surveys

Abstract. Self-control – that is, the ability to control impulses, emotions, or actions in order to achieve goals – is associated with a broad range of positive life outcomes, such as educational attainment and health. The present study describes the development and validation of a four-item self-control scale in English, French, German, Japanese, Polish, and Spanish. We used a sample comprising 973 survey respondents from the United States to select the scale items, and a sample comprising 5,557 respondents from six countries to validate the short scale. Results suggest that with just four items, self-control can be measured in a valid, partially scalar invariant, and time-efficient way, and can be adjusted for acquiescence.

Explaining Variability in Response Style Traits: A Covariate-Adjusted IRTree

Contamination of responses due to extreme and midpoint response style can confound the interpretation of scores, threatening the validity of inferences made from survey responses. This study incorporated person-level covariates in the multidimensional item response tree model to explain heterogeneity in response style. We include an empirical example and two simulation studies to support the use and interpretation of the model: parameter recovery using Markov chain Monte Carlo (MCMC) estimation and performance of the model under conditions with and without response styles present. Item intercepts mean bias and root mean square error were small at all sample sizes. Item discrimination mean bias and root mean square error were also small but tended to be smaller when covariates were unrelated to, or had a weak relationship with, the latent traits. Item and regression parameters are estimated with sufficient accuracy when sample sizes are greater than approximately 1,000 and MCMC estimation with the Gibbs sampler is used. The empirical example uses the National Longitudinal Study of Adolescent to Adult Health's sexual knowledge scale. Meaningful predictors associated with high levels of extreme response latent trait included being non-White, being male, and having high levels of parental support and relationships. Meaningful predictors associated with high levels of the midpoint response latent trait included having low levels of parental support and relationships. Item-level covariates indicate the response style pseudo-items were less easy to endorse for self-oriented items, whereas the trait of interest pseudo-items were easier to endorse for self-oriented items.

Validating Indigenous Versions of the South African Personality Inventory

Personality assessments are frequently used to make decisions and predictions, creating a demand for assessments that are non-discriminatory. South African legislation requires psychological tests to be scientifically proven to be valid, reliable, fair and non-biased. In response to the necessity for a measure sensitive to indigenous differences, South African and Dutch researchers developed the South African Personality Inventory (SAPI). The SAPI represents a theoretical model of personality that uses an indigenous (emic) and universal (etic) approach to capture South Africa’s rich multicultural and multilingual view of personhood. The development of SAPI items and its simultaneous translation from English into all official languages necessitated the investigation of all the translated language versions’ psychometric properties. This study used Exploratory Structural Equation Modelling to examine the factor structure and model fit of two indigenous language versions of the SAPI, targeting the Tshivenda and the Southern Sotho languages. To accomplish this objective, Study 1 (N = 290) was done in South Africa among the Tshivenda ethnic group, while Study 2 (N = 293) was conducted in South Africa among the Sesotho ethnic group. An acquiescence response pattern was noticed in both studies, possibly to adhere to group consensus and emphasizing harmony within relationships. The ESEM solutions generated an excellent fit for both language versions, and most facets loaded acceptably on their expected factors. The Neuroticism factor proved to be problematic in both language versions. Within the Tshivenda version, the Emotional Stability facet did not generate adequate loadings on any SAPI factors. In contrast, neither Emotional Stability nor Negative Emotionality loaded sufficiently on the Neuroticism factor for the Southern Sotho version. While the overall fit of the six-factor model was excellent, the language in which a person completes a personality questionnaire seems to influence such an assessment’s factor structure. The Tshivenda and Sesotho versions of the SAPI cannot yet be positioned as equitable alternatives when using an indigenous version of the SAPI is needed. The implications of the results and proposals for future studies are discussed.

Modeling Wording Effects Does Not Help in Recovering Uncontaminated Person Scores: A Systematic Evaluation With Random Intercept Item Factor Analysis

The item wording (or keying) effect consists of logically inconsistent answers to positively and negatively worded items that tap into similar (but polarly opposite) content. Previous research has shown that this effect can be successfully modeled through the random intercept item factor analysis (RIIFA) model, as evidenced by the improvements in the model fit in comparison to models that only contain substantive factors. However, little is known regarding the capability of this model in recovering the uncontaminated person scores. To address this issue, the study analyzes the performance of the RIIFA approach across three types of wording effects proposed in the literature: carelessness, item verification difficulty, and acquiescence. In the context of unidimensional substantive models, four independent variables were manipulated, using Monte Carlo methods: type of wording effect, amount of wording effect, sample size, and test length. The results corroborated previous findings by showing that the RIIFA models were consistently able to account for the variance in the data, attaining an excellent fit regardless of the amount of bias. Conversely, the models without the RIIFA factor produced increasingly a poorer fit with greater amounts of wording effects. Surprisingly, however, the RIIFA models were not able to better estimate the uncontaminated person scores for any type of wording effect in comparison to the substantive unidimensional models. The simulation results were then corroborated with an empirical dataset, examining the relationship between learning strategies and personality with grade point average in undergraduate studies. The apparently paradoxical findings regarding the model fit and the recovery of the person scores are explained, considering the properties of the factor models examined.

Correlated personality change across time and age

The goal of this study was to examine differential and correlated change in personality across the adult lifespan. Studying differential and correlated change can help understand whether intraindividual trait change trajectories deviate from the norm and how these trajectories are coupled with each other. We used data from two large longitudinal panel studies from the United States that covered a total age range of 20 to 95 years on the first measurement occasion. We used correlated factor models and bivariate latent change score models to examine the rank-order stability and correlations between change across three measurement waves covering 18 years ( N = 3250) and four measurement waves covering 12 years ( N = 4145). We examined the moderation effects of continuous age on these model parameters using local structural equation modeling. The results suggest that the test–retest correlations decrease with increasing time between measurements but are unaffected by participants’ age. We found that change processes in Extraversion, Openness, Agreeableness, and Conscientiousness were strongly related, particularly in late adulthood. Correlated change patterns were highly stable across time intervals and similar to the initial cross-sectional Big Five correlations. We discuss potential mechanisms and implications for personality development research.

Adaptation and Validation of the Authoritative School Climate Survey in a Sample of Chilean Adolescents

Authoritative school climate is a relevant and novel construct that improves the academic performance and social-emotional development of students. This study aimed to evaluate the psychometric properties of reliability and validity of the Authoritative School Climate Survey (ASCS) in a sample of Chilean adolescents. A cross-sectional study was carried out, in which 808 students from 12 schools in Chile participated (55.1% men and 44.9% women), with a mean age of 15.94 (SD = 1.32). The results obtained through exploratory and confirmatory factor analyzes ratified the hypothesized structure of two correlated factors. As expected, evidence of criterion validity showed significant relationships between the measures of authoritative school climate and attitude toward institutional authority. This study provides evidence regarding the psychometric quality of the scale to assess authoritative school climate, allowing its use in the Chilean context.

On the Use of Balanced Item Parceling to Counter Acquiescence Bias in Structural Equation Models

We propose the use of balanced item parcels to account for method effects caused by acquiescent responding. The use of balanced parcels avoids the need to model method effects explicitly and results in a parsimonious specification of measurement and full structural equation models in the presence of unwanted method effects, particularly when a scale consists of a relatively large number of items. Balanced item parcels are sums or averages of individual items consisting of an equal number of regular and reversed items measuring the same construct. When regular and reversed items are combined into parcels, method effects cancel out (assuming that the method effects affecting the regular and reversed items in a parcel are equal in magnitude), and model fit and parameter estimates will no longer be negatively affected by acquiescent responding. We discuss why balanced item parceling works and when it is likely to prove beneficial, and we present a step-by-step procedure explaining how to use balanced item parceling in practice. We also report a brief hypothetical example to illustrate the proposed approach.

Modelling the incremental value of personality facets: the domains-incremental facets-acquiescence bifactor showmodel

Personality can be described at different levels of abstraction. Whereas the Big Five domains are the dominant level of analysis, several researchers have called for more fine-grained approaches, such as facet-level analysis. Personality facets allow more comprehensive descriptions, more accurate predictions of outcomes, and a better understanding of the mechanisms underlying trait–outcome relationships. However, several methodological issues plague existing evidence on the added value of facet-level descriptions: Manifest facet scale scores differ with respect to their reliability, domain-level variance (variance that is due to the domain factor) and incremental facet-level variance (variance that is specific to a facet and not shared with the other facets). Moreover, manifest scale scores overlap substantially, which affects associations with criterion variables. We suggest a structural equation modelling approach that allows domain-level variance to be separated from incremental facet-level variance. We analysed data from a heterogeneous sample of adults in the USA (N = 1193) who completed the 60-item Big Five Inventory-2. The results illustrate how the variance of manifest personality items and scale scores can be decomposed into domain-level and incremental facet-level variance. The association with criterion variables (educational attainment, income, health, and life satisfaction) further demonstrates the incremental predictive power of personality facets.

Psychometric Analysis and Effectiveness of the Psychological Readiness of Injured Athlete to Return to Sport (PRIA-RS) Questionnaire on Injured Soccer Players

The decision-making process about when an athlete may safely return to training and competition after an injury is a difficult decision. Safe return to training and competition is characterised by physical and psychological readiness to return to the sport. The objectives of this study are (1) to assess the measurement properties of the Psychological Readiness of Injured Athlete to Return to Sport questionnaire (PRIA-RS), and (2) to analyse the effectiveness which the PRIA-RS questionnaire possesses when applied during four consecutive seasons on professional soccer players. One hundred and nine male soccer players from the Albacete Soccer Club (Spain) were involved during four consecutive seasons for the current study: 2012–2013, 2013–2014, 2014–2015 and 2015–2016. Psychometric analysis (validity, reliability, internal consistency and effectiveness) and external psychometric analysis (evaluating measures of patient-reported outcomes (EMPRO)) were confirmed and supported. The main results of the study reveal that the psychometric properties of this questionnaire are optimum for their application in a professional sports context.

New wine in an old bottle? A facet-level perspective on the added value of Grit over BFI-2 Conscientiousness

There is emerging consensus that Grit's two facets-perseverance of effort and consistency of interest-are best understood as facets of the Big Five dimension of Conscientiousness. However, an in-depth investigation on whether Grit's facet offer any added value over more established facets of Conscientiousness is absent from the literature. In the present study, we investigated whether Grit's facets are empirically distinguishable from three facets of Conscientiousness as conceived in the well-validated Big-Five Inventory 2 (BFI-2), namely, Organization, Responsibility, Productiveness. Moreover, we investigated whether Grit's facets show different (and possibly stronger) associations than the facets of Conscientiousness with a broad set of external criteria (age, educational attainment, monthly income, life satisfaction, mental and physical health, fluid and crystallized intelligence); as well as whether the criterion correlations of Grit's facets are incremental over Conscientiousness. Findings from two latent-variable models in a large and diverse sample (N = 1,244) indicated that the facets of Grit showed moderate to strong relationships related to each other and to the three Conscientiousness facets of the BFI-2 (.41 ≤ r ≤ .94). Grit-Perseverance was almost indistinguishable from the Productiveness facet of Conscientiousness, whereas Grit-Consistency appeared to capture something unique beyond the Conscientiousness facets. The relationships with external criteria of Grit's facets were similar in direction and size to those of the Conscientiousness facets. The results give further purchase to the view that Grit's facets can be subsumed under the Conscientiousness domain.

Development of the Inventory of Supporting for Socio-Emotional Skills, evidence of internal structure controlling for acquiescence

Abstract This study aims to develop the Inventory of Supporting for Socio-Emotional Skills, which is an instrument for assessing the support for socio-emotional development provided by teachers, rated by students. It also aims to gather validity evidence of the internal structure of Inventory of Supporting for Socio-Emotional Skills and to control acquiescence. We elaborated the items, which content were evaluated by six experts. For the internal structure, a sample composed of elementary and high-school students (N = 443) was used to answer the instrument. The instrument presented good psychometric parameters after controlling for acquiescence using the Random Intercept Model. The final structure was set as unidimensional. We suggest controlling acquiescence to avoid biased scores. In addition, we make an inventory available that can be helpful for socio-emotional skills development.

Individual, situational, and cultural correlates of acquiescent responding: Towards a unified conceptual framework

Acquiescence ('yea-saying') can seriously harm the validity of self-report questionnaire data. Towards a better understanding of why some individuals and groups acquiesce more strongly than others do, we developed a unified conceptual framework of acquiescent responding. Our framework posits that acquiescent responding is a joint function of respondent characteristics (e.g. age, education, values), situational/survey characteristics (e.g., interview privacy, respondents' interest), and cultural characteristics (e.g., social norms, economic development). The framework posits two putative mechanisms through which these characteristics may relate to acquiescence: cognitive processing capacities and deferential communication styles. Multilevel analyses using data from 60 heterogeneous countries from the World Values Survey (N = 90,347) support our framework's proposition that acquiescence is a joint function of respondent, situational, and cultural characteristics. Acquiescence was higher among respondents who were older (over 55 years old), less educated, who valued deference (i.e., conformity and tradition), and, unexpectedly, were male. Interview privacy corresponded to lower acquiescence, but this association was small and vanished after including respondent characteristics. Unexpectedly, acquiescence was higher in interviewees who showed a stronger interest in the interview. Finally, acquiescence was considerably higher in countries with stronger social norms of deference. We discuss implications of these findings for the validity of research based on self-report data and delineate how our framework can guide future inquiries into acquiescent responding.

Controlling for Response Biases in Self-Report Scales: Forced-Choice vs. Psychometric Modeling of Likert Items

One important problem in the measurement of non-cognitive characteristics such as personality traits and attitudes is that it has traditionally been made through Likert scales, which are susceptible to response biases such as social desirability (SDR) and acquiescent (ACQ) responding. Given the variability of these response styles in the population, ignoring their possible effects on the scores may compromise the fairness and the validity of the assessments. Also, response-style-induced errors of measurement can affect the reliability estimates and overestimate convergent validity by correlating higher with other Likert-scale-based measures. Conversely, it can attenuate the predictive power over non-Likert-based indicators, given that the scores contain more errors. This study compares the validity of the Big Five personality scores obtained: (1) ignoring the SDR and ACQ in graded-scale items (GSQ), (2) accounting for SDR and ACQ with a compensatory IRT model, and (3) using forced-choice blocks with a multi-unidimensional pairwise preference model (MUPP) variant for dominance items. The overall results suggest that ignoring SDR and ACQ offered the worst validity evidence, with a higher correlation between personality and SDR scores. The two remaining strategies have their own advantages and disadvantages. The results from the empirical reliability and the convergent validity analysis indicate that when modeling social desirability with graded-scale items, the SDR factor apparently captures part of the variance of the Agreeableness factor. On the other hand, the correlation between the corrected GSQ-based Openness to Experience scores, and the University Access Examination grades was higher than the one with the uncorrected GSQ-based scores, and considerably higher than that using the estimates from the forced-choice data. Conversely, the criterion-related validity of the Forced Choice Questionnaire (FCQ) scores was similar to the results found in meta-analytic studies, correlating higher with Conscientiousness. Nonetheless, the FCQ-scores had considerably lower reliabilities and would demand administering more blocks. Finally, the results are discussed, and some notes are provided for the treatment of SDR and ACQ in future studies.

Challenges to capture the big five personality traits in non-WEIRD populations

Can personality traits be measured and interpreted reliably across the world? While the use of Big Five personality measures is increasingly common across social sciences, their validity outside of western, educated, industrialized, rich, and democratic (WEIRD) populations is unclear. Adopting a comprehensive psychometric approach to analyze 29 face-to-face surveys from 94,751 respondents in 23 low- and middle-income countries, we show that commonly used personality questions generally fail to measure the intended personality traits and show low validity. These findings contrast with the much higher validity of these measures attained in internet surveys of 198,356 self-selected respondents from the same countries. We discuss how systematic response patterns, enumerator interactions, and low education levels can collectively distort personality measures when assessed in large-scale surveys. Our results highlight the risk of misinterpreting Big Five survey data and provide a warning against naïve interpretations of personality traits without evidence of their validity.

Das Big Five Inventar 2

Zusammenfassung. Die deutsche Version des Big Five Inventars 2 (BFI-2) erfasst die 5 Persönlichkeitsdomänen Extraversion, Verträglichkeit, Gewissenhaftigkeit, Negative Emotionalität (Neurotizismus) und Offenheit sowie insgesamt 15 Persönlichkeitsfacetten mit 60 Items. Das Inventar wurde im Rahmen eines mehrstufigen Übersetzungsprozesses vom Englischen ins Deutsche übertragen. Anhand einer nach Alter, Geschlecht und Bildungsabschluss quotieren Bevölkerungsstichprobe ( N = 1 224) wurden Reliabilität, Validität und Messinvarianz über Geschlechter und Altersgruppen untersucht. Die Ergebnisse der Studien deuten auf gute Reliabilitäten der Domänenwerte und ausreichende Reliabilitäten der Facettenwerte hin. Einzelitems und die Facettenwerte zeigen erwartungskonforme Ladungsmuster. Die Domänen- und Facettenwerte korrelieren erwartungsgemäß mit anderen Persönlichkeitsinventaren und sind mit Kriterien wie Bildungsabschluss, Einkommen, Gesundheit und Lebenszufriedenheit assoziiert. Strukturgleichungsmodelle belegen die residuale Invarianz über Geschlechter. Die durchschnittliche Bearbeitungszeit beträgt 8 Minuten. Normwerte für die deutsche Allgemeinbevölkerung werden berichtet.

A New Model for Acquiescence at the Interface of Psychometrics and Cognitive Psychology

When measuring psychological traits, one has to consider that respondents often show content-unrelated response behavior in answering questionnaires. To disentangle the target trait and two such response styles, extreme responding and midpoint responding, Böckenholt ( 2012a ) developed an item response model based on a latent processing tree structure. We propose a theoretically motivated extension of this model to also measure acquiescence, the tendency to agree with both regular and reversed items. Substantively, our approach builds on multinomial processing tree (MPT) models that are used in cognitive psychology to disentangle qualitatively distinct processes. Accordingly, the new model for response styles assumes a mixture distribution of affirmative responses, which are either determined by the underlying target trait or by acquiescence. In order to estimate the model parameters, we rely on Bayesian hierarchical estimation of MPT models. In simulations, we show that the model provides unbiased estimates of response styles and the target trait, and we compare the new model and Böckenholt's model in a recovery study. An empirical example from personality psychology is used for illustrative purposes.

A New Measure of Life Satisfaction: The Riverside Life Satisfaction Scale

The Satisfaction With Life Scale (Diener, Emmons, Larsen, & Griffin, 1985) has been the dominant measure of life satisfaction since its creation more than 30 years ago. We sought to develop an improved measure that includes indirect indicators of life satisfaction (e.g., wishing to change one's life) to increase the bandwidth of the measure and account for acquiescence bias. In 3 studies, we developed a 6-item measure of life satisfaction, the Riverside Life Satisfaction Scale, and obtained reliability and validity evidence. Importantly, the Riverside Life Satisfaction Scale retained the high internal consistency, test-retest stability, and unidimensionality of the Satisfaction With Life Scale. In addition, the Riverside Life Satisfaction Scale correlated with other well-being measures, Big Five personality traits, values, and demographic information in expected ways. Although the Riverside Life Satisfaction Scale correlated highly with the Satisfaction With Life Scale, we believe it improves the Satisfaction With Life Scale by appropriately increasing construct breadth and reducing the potential for bias.

Modeling General, Specific, and Method Variance in Personality Measures: Results for ZKA-PQ and NEO-PI-R

Contemporary models of personality assume a hierarchical structure in which broader traits contain narrower traits. Individual differences in response styles also constitute a source of score variance. In this study, the bifactor model is applied to separate these sources of variance for personality subscores. The procedure is illustrated using data for two personality inventories-NEO Personality Inventory-Revised and Zuckerman-Kuhlman-Aluja Personality Questionnaire. The inclusion of the acquiescence method factor generally improved the fit to acceptable levels for the Zuckerman-Kuhlman-Aluja Personality Questionnaire, but not for the NEO Personality Inventory-Revised. This effect was higher in subscales where the number of direct and reverse items is not balanced. Loadings on the specific factors were usually smaller than the loadings on the general factor. In some cases, part of the variance was due to domains being different from the main one. This information is of particular interest to researchers as they can identify which subscale scores have more potential to increase predictive validity.