A Meta-Analytic Multitrait Multirater Separation of Substance and Style in Social Desirability Scales

On the Utility of Indirect Methods for Detecting Faking

Indirect indices for faking detection in questionnaires make use of a respondent's deviant or unlikely response pattern over the course of the questionnaire to identify them as a faker. Compared with established direct faking indices (i.e., lying and social desirability scales), indirect indices have at least two advantages: First, they cannot be detected by the test taker. Second, their usage does not require changes to the questionnaire. In the last decades, several such indirect indices have been proposed. However, at present, the researcher's choice between different indirect faking detection indices is guided by relatively little information, especially if conceptually different indices are to be used together. Thus, we examined and compared how well indices of a representative selection of 12 conceptionally different indirect indices perform and how well they perform individually and jointly compared with an established direct faking measure or validity scale. We found that, first, the score on the agreement factor of the Likert-type item response process tree model, the proportion of desirable scale endpoint responses, and the covariance index were the best-performing indirect indices. Second, using indirect indices in combination resulted in comparable and in some cases even better detection rates than when using direct faking measures. Third, some effective indirect indices were only minimally correlated with substantive scales and could therefore be used to partial faking variance from response sets without losing substance. We, therefore, encourage researchers to use indirect indices instead of direct faking measures when they aim to detect faking in their data.

Can People With Higher Versus Lower Scores on Impression Management or Self-Monitoring Be Identified Through Different Traces Under Faking?

According to faking models, personality variables and faking are related. Most prominently, people's tendency to try to make an appropriate impression (impression management; IM) and their tendency to adjust the impression they make (self-monitoring; SM) have been suggested to be associated with faking. Nevertheless, empirical findings connecting these personality variables to faking have been contradictory, partly because different studies have given individuals different tests to fake and different faking directions (to fake low vs. high scores). Importantly, whereas past research has focused on faking by examining test scores, recent advances have suggested that the faking process could be better understood by analyzing individuals' responses at the item level (response pattern). Using machine learning (elastic net and random forest regression), we reanalyzed a data set (N = 260) to investigate whether individuals' faked response patterns on extraversion (features; i.e., input variables) could reveal their IM and SM scores. We found that individuals had similar response patterns when they faked, irrespective of their IM scores (excluding the faking of high scores when random forest regression was used). Elastic net and random forest regression converged in revealing that individuals higher on SM differed from individuals lower on SM in how they faked. Thus, response patterns were able to reveal individuals' SM, but not IM. Feature importance analyses showed that whereas some items were faked differently by individuals with higher versus lower SM scores, others were faked similarly. Our results imply that analyses of response patterns offer valuable new insights into the faking process.

Time to level up: A systematic review of interventions aiming to reduce stigma toward autistic people

LAY ABSTRACT

How non-autistic people think about autistic people impacts autistic people negatively. Many studies developed trainings to reduce autism stigma. The existing trainings vary a lot in terms of study design, content, and reported effectiveness. This means that a review studying how the studies have been conducted is needed. We also looked at the quality of these studies. We collected and studied 26 studies that tried to reduce stigma toward autistic people. The studies often targeted White K-12 students and college students. Most trainings were implemented once. Trainings frequently used video or computer. Especially, recent studies tended to use online platforms. The study quality was poor for most studies. Some studies made inaccurate claims about the intervention effectiveness. Studies did not sufficiently address study limitations. Future trainings should aim to figure out why and how interventions work. How intervention changes people's behavior and thoughts should be studied. Researchers should study whether the training can change the societal stigma. Also, researchers should use a better study design.

Impression management in daily life: an experience sampling test for the expression of impression management as interpersonally oriented self-control

Impression management (IM) scales (often called lie or social desirability scales) have long been applied as validity scales in assessment processes. Recent developments have indicated that these scales measure a substantive personality predisposition and not response bias, but the nature of the disposition is disputable. According to the 'interpersonally oriented self-control' approach, IM is associated with high self-control exerted mainly in public social contexts to facilitate adaptation. Supported in laboratory settings, this approach has not been tested in real-life dynamics. In the present experience sampling study, participants reported 3 times a day (10 days) about their social condition (alone/'with others') and their level of self-control. Results revealed that IM was associated with stronger self-control when with other people than when alone. Comparable reactions to public social context were not found for self-deception enhancement, trait self-control, or agreeableness, marking this a unique aspect of IM. The findings further stress the need to reconsider the use of IM scales for validity purposes in assessment processes.

Performance on a virtual environment shopping task and adaptive functioning among older adults

Neuropsychologists are often asked to evaluate patients' functional capacities, yet traditional neuropsychological tests have limited correspondence with real-world outcomes. The Virtual Environment Grocery Store (VEGS) is a virtual environment that simulates shopping tasks. The purpose of this study was to investigate the relationship between older adults' performance on the VEGS in relation to their self-reported adaptive functioning as well as performance on a performance-based adaptive functioning measure. Older adults (n = 98; age 65-90, M = 75.82, SD = 6.27) were administered the VEGS, the Instrumental Activities of Daily Living Scale (IADLS), and the Texas Functional Living Scale (TFLS). Neither premorbid functioning nor the VEGS variables were associated with self-rated adaptive functioning. However, all three VEGS variables were associated with performance-based adaptive functioning (i.e., the TFLS). Performance on the VEGS measure of correct items in the shopping cart explained 13.9% of the variance in performance on the performance-based adaptive functioning task. Whether the participant picked up the VEGS prescription explained 12.6% of the variance in performance on the performance-based adaptive functioning task. Performance on VEGS long delay free recall explained 35.1% of the variance in performance on the performance-based adaptive functioning task. These results suggest that the VEGS demonstrates value in predicting older adults' functional capacities.

The NB5I

Abstract. Personality is usually measured by means of self-ratings. Despite some drawbacks, the method is here to stay, and improving on it, particularly regarding social desirability, is essential. One way to do this is evaluative neutralization, that is, to rephrase items such that it is less obvious to the respondent what would be a desirable response. We present a 120-item evaluatively neutralized five-factor inventory and compare it to the IPIP-NEO ( Goldberg et al., 2006 ). Psychometric analyses revealed that the new inventory has high factor homogeneity, relatively independent facets with acceptable homogeneity and normally distributed ratings, and relatively evaluatively neutral ratings (as indicated by the level of item popularity). In sum, this new inventory captures the same personality variance as other five-factor inventories but with less influence from individual differences in evaluative responding, resulting in less correlation between factors and a factor structure more in line with the simple structure model than many other five-factor inventories. Evaluatively neutralized inventories should be particularly useful when the factor structure is central to the research question and focuses on discriminant validity, such as identifying theoretically valid relationships between personality traits and other concepts.

Are social desirability scales desirable? A meta-analytic test of the validity of social desirability scales in the context of prosocial behavior

Social desirability (SD) scales have been used for decades in psychology and beyond. These scales are sought to measure individuals' tendencies to present themselves overly positive in self-reports, thus allowing to control for SD biases. However, research increasingly questions the validity of SD scales, proposing that SD scales measure substantive trait characteristics rather than response bias. To provide a large-scale empirical test of the validity of SD scales, we conducted a meta-analysis (k = 41; N = 8980) on the relation between SD scale scores and prosocial behavior in economic games (where acting in a prosocial manner is highly socially desirable). If SD scales measure what they are supposed to (namely, SD bias), they should be negatively linked to prosocial behavior; if SD scales measure socially desirable traits, they should be positively linked to prosocial behavior. Unlike both possibilities, the meta-analytic correlation between SD scores and prosocial behavior was close to zero, suggesting that SD scales neither clearly measure bias nor substantive traits. This conclusion was also supported by moderation analyses considering differences in the implementation of games and the SD scales used. The results further question the validity of SD scales with the implication that scholars and practitioners should refrain from using them.

The Properties and Utility of Less Evaluative Personality Scales: Reduction of Social Desirability; Increase of Construct and Discriminant Validity

Evaluative neutralization implies rephrasing items such that it is less clear to the respondent what would be a desirable response in the given population. The current research compares evaluatively neutralized scales measuring the FFM model with standard counterparts. Study 1 reveals that evaluatively neutralized scales are less influenced by social desirability. Study 2 estimates higher-order factor models for neutralized vs. standard five-factor scales. In contrast to standard inventories, there was little support for higher-order factors for neutralized scales. Study 3 demonstrates the convergent and discriminant validity for the neutralized scales, e.g., by less inflated correlations to external measures. It is argued that evaluatively neutralized inventories help researchers come to grips with social desirability in personality measurement, and are particularly useful when the factor structure is central to the research question and there is a focus on discriminant validity.

The Motivation and Opportunity for Socially Desirable Responding Does Not Alter the General Factor of Personality

Socially desirable responding may affect the factor structure of personality questionnaires and may be one of the reasons for the common variance among personality traits. In this study, we test this hypothesis by investigating the influence of the motivational test-taking context (development vs. selection) and the opportunity to distort responses (forced-choice vs. Likert response format) on personality questionnaire scores. Data from real selection and assessment candidates (total N = 3,980) matched on gender, age, and educational level were used. Mean score differences were found between the selection and development groups, with smaller differences for the FC version. Yet, exploratory structural equation models showed that the overall factor structures as well as the general factor were highly similar across the four groups. Thus, although socially desirable responding may affect mean scores on personality traits, it does not appear to affect factor structures. This study further suggests that the common variance in personality questionnaires is consistent and appears to be little influenced by motivational pressures for response distortion.

Predictors of self-perceived cultural responsiveness in entry-level physiotherapy students in Australia and Aotearoa New Zealand

BACKGROUND

Ensuring physiotherapy students are well prepared to work safely and effectively in culturally diverse societies upon graduation is vital. Therefore, determining whether physiotherapy programs are effectively developing the cultural responsiveness of students is essential. This study aimed to evaluate the level of self-perceived cultural responsiveness of entry level physiotherapy students during their training, and explore the factors that might be associated with these levels.

METHODS

A cross sectional study of physiotherapy students from nine universities across Australia and Aotearoa New Zealand was conducted using an online self-administered questionnaire containing three parts: The Cultural Competence Assessment tool, Altemeyer's Dogmatism scale, and the Marlowe-Crowne social desirability scale- short form. Demographic data relating to university, program, and level of study were also collected. Data was analysed using one-way ANOVA, t-tests and multiple regression analysis.

RESULTS

A total of 817 (19% response rate) students participated in this study. Overall, students had a moderate level of self-perceived cultural responsiveness (Mean (SD) = 5.15 (0.67)). Fewer number of weeks of clinical placement attended, lower levels of dogmatism, and greater social desirability were related to greater self-perceived cultural responsiveness. Additionally, fourth year undergraduate students perceived themselves to be less culturally responsive than first and second year students (p < 0.05).

CONCLUSIONS

These results provide educators with knowledge about the level of self-perceived cultural responsiveness in physiotherapy students, and the factors that may need to be assessed and addressed to support the development of culturally responsive practice.

Overlap Between the General Factor of Personality and Trait Emotional Intelligence: A Genetic Correlation Study

A previous meta-analysis (Van der Linden et al., Psychol Bull 143:36-52, 2017) showed that the General Factor of Personality (GFP) overlaps with ability as well as trait emotional intelligence (EI). The correlation between trait EI and the GFP was so high (ρ = 0.88) in that meta-analysis that these two may be considered virtually identical constructs. The present study builds on these findings by examining whether the strong phenotypic correlation between the GFP and trait EI has a genetic component. In a sample of monozygotic and dizygotic twins, the heritability estimates for the GFP and trait EI were 53 and 45%, respectively. Moreover, there was a strong genetic correlation of r = .90 between the GFP and trait EI. Additional analyses suggested that a substantial proportion of the genetic correlations reflects non-additive genetic effects (e.g., dominance and epistasis). These findings are discussed in light of evolutionary accounts of the GFP.

Accounting for Missing Correlation Coefficients in Fixed-Effects MASEM

Meta-analytic structural equation modeling (MASEM) is increasingly applied to advance theories by synthesizing existing findings. MASEM essentially consists of two stages. In Stage 1, a pooled correlation matrix is estimated based on the reported correlation coefficients in the individual studies. In Stage 2, a structural model (such as a path model) is fitted to explain the pooled correlations. Frequently, the individual studies do not provide all the correlation coefficients between the research variables. In this study, we modify the currently optimal MASEM-method to deal with missing correlation coefficients, and compare its performance with existing methods. This study is the first to evaluate the performance of fixed-effects MASEM methods under different levels of missing correlation coefficients. We found that the often used univariate methods performed very poorly, while the multivariate methods performed well overall.

Use of Social Desirability Scales in Clinical Psychology: A Systematic Review

OBJECTIVE

There is still an open debate about the utility of social desirability indicators. This report systematically reviewed the use of social desirability scales in studies addressing social desirability in clinical psychology.

METHOD

A systematic review (January 2010-March 2015) was conducted, including 35 studies meeting the inclusion criteria of being published in peer-reviewed journals and describing quantitative findings about an association of social desirability with clinical psychology variables using a cross-sectional or longitudinal design.

RESULTS

Social desirability was associated with self-reports of various clinical-psychological dimensions. Most of the included studies treated social desirability as a 1-dimensional variable and only 10 of 35 disentangled the impression management and self-deception components. Although theoretical literature does not consider social desirability a mere response bias, only 4 of the reviewed articles controlled for the possible suppressor effect of personality variables on social desirability, while the majority focused upon the stylistic (response bias) rather than the substantive (personality) nature of this construct.

CONCLUSION

The present review highlighted some limitations in the use of social desirability scales in recent clinical psychology research and tried to offer a few suggestions for handling this issue.