Testing construct independence in the Short Dark Triad using Item Response Theory

Gender Differences or Gender Bias?

Abstract. Sadism, defined by the infliction of pain and suffering on others for pleasure or subjugation, has recently garnered substantial attention in the psychological research literature. The Assessment of Sadistic Personality (ASP) was developed to measure levels of everyday sadism and has been shown to possess excellent reliability and validity using classical test theory methods. However, it is not known how well ASP items discriminate between respondents of different trait levels, or which Likert categories are endorsed by persons of various trait levels. Additionally, individual items should be evaluated to ensure that men and women of similar levels of sadism have an equal probability of response endorsement. The purpose of this research was to apply item response theory (IRT) and differential item functioning (DIF) to investigate item properties of the ASP across its three translations: English, Polish, and Italian. Overall, the results of the IRT analysis showed that with the exception of Item 9, the ASP demonstrated sound item properties. The DIF rate analyses identified two items from each questionnaire that were of practical significance across gender. Implications of these results are discussed.

The Measurement Invariance of the Short Dark Triad

Abstract. Given the fact that most of the dark personality measures are developed based on data collected in low-stake settings, the present study addresses the appropriateness of their use in high-stake contexts. Specifically, we examined item- and scale-level differential functioning of the Short Dark Triad (SD3; Paulhus & Jones, 2011 ) measure across testing contexts. The Short Dark Triad was administered to applicant ( N = 457) and non-applicant ( N = 592) samples. Item- and scale-level invariances were tested using an Item Response Theory (IRT)-based approach and a Structural Equation Modeling (SEM) approach, respectively. Results show that more than half of the SD3 items were flagged for Differential Item Functioning (DIF), and Exploratory Structural Equation Modeling (ESEM) results supported configural, but not metric invariance. Implications for theory and practice are discussed.

Validation of Two Short Personality Inventories Using Self-Descriptions in Natural Language and Quantitative Semantics Test Theory

Background

If individual differences are relevant and prominent features of personality, then they are expected to be encoded in natural language, thus manifesting themselves in single words. Recently, the quantification of text data using advanced natural language processing techniques offers innovative opportunities to map people’s own words and narratives to their responses to self-reports. Here, we demonstrate the usefulness of self-descriptions in natural language and what we tentatively call Quantitative Semantic Test Theory (QuSTT) to validate two short inventories that measure character traits.

Method

In Study 1, participants (N₁ = 997) responded to the Short Character Inventory, which measures self-directedness, cooperativeness, and self-transcendence. In Study 2, participants (N₂ = 2373) responded to Short Dark Triad, which measures Machiavellianism, narcissism, and psychopathy. In both studies, respondents were asked to generate 10 self-descriptive words. We used the Latent Semantic Algorithm to quantify the meaning of each trait using the participants’ self-descriptive words. We then used these semantic representations to predict the self-reported scores. In a second set of analyses, we used word-frequency analyses to map the self-descriptive words to each of the participants’ trait scores (i.e., one-dimensional analysis) and character profiles (i.e., three-dimensional analysis).

Results

The semantic representation of each character trait was related to each corresponding self-reported score. However, participants’ self-transcendence and Machiavellianism scores demonstrated similar relationships to all three semantic representations of the character traits in their respective personality model. The one-dimensional analyses showed that, for example, “loving” was indicative of both high cooperativeness and self-transcendence, while “compassionate,” “kind,” and “caring” was unique for individuals high in cooperativeness. The words “kind” and “caring” indicated low levels of Machiavellianism and psychopathy, whereas “shy” or “introvert” indicated low narcissism. We also found specific keywords that unify or that make the individuals in some profiles unique.

Conclusion

Despite being short, both inventories capture individuals’ identity as expected. Nevertheless, our method also points out some shortcomings and overlaps between traits measured with these inventories. We suggest that self-descriptive words can be quantified to validate measures of psychological constructs (e.g., prevalence in self-descriptions or QuSTT) and that this method may complement traditional methods for testing the validity of psychological measures.

Enthusiastic Acts of Evil: The Assessment of Sadistic Personality in Polish and Italian Populations

Subclinical sadism has received substantial attention in recent research as a trait that predicts a variety of malevolent behaviors. The objective of this study was to assess the 'psychometric robustness and portability' of the Assessment of Sadistic Personality (ASP). We examined the convergent and discriminant validity, and invariance of translated versions of the ASP within community samples of Polish and Italian individuals. The study included 568 individuals (340 women and 228 men) residing in Italy (Mage = 23.57, SDage = 2.55) and 556 individuals (411 women, 144 men, 1 other) residing in Poland (Mage = 23.48, SDage = 4.60). For cultural invariance purposes, data from a Canadian sample comprising 638 students were used. To establish convergent and discriminant validity, participants completed measures of sadism, the Dark Triad, the Big Five, interpersonal reactivity, and maladaptive traits described in the DSM-5. Across both samples, convergent and discriminant validity were supported. Configural and partial metric invariance were satisfied, and following implementation of alignment optimization, latent mean differences were evaluated between countries. Results of the study supported the psychometric qualities of the ASP across different cultures and languages, and the utility of the ASP as a valid measure extending beyond university samples.

Dark malevolent traits and everyday perceived stress

Stress is a factor that greatly impacts our lives. Previous research has examined individual differences in relation to stress. However, research regarding malevolent personality traits in relation to how stress is perceived is limited. The purpose of the present study was to investigate relationships between dark malevolent personality traits; psychopathy (EPA), Machiavellianism (MACH-IV), vulnerable narcissism (HSNS), grandiose narcissism (NPI-13), and perceived stress (PSS-10) in a community sample (N = 346). The results showed a strong positive relationship between vulnerable narcissism and perceived stress, while grandiose narcissism and psychopathy showed a small negative relationship with perceived stress. The discussion centers on that narcissism should be treated as two separate traits, and that psychopathy and Machiavellianism overlap in relation to the experience of stress in everyday life.

IRT analyses of the Swedish Dark Triad Dirty Dozen

Background

The Dark Triad (i.e., Machiavellianism, narcissism, and psychopathy) can be captured quickly with 12 items using the Dark Triad Dirty Dozen (Jonason and Webster, 2010). Previous Item Response Theory (IRT) analyses of the original English Dark Triad Dirty Dozen have shown that all three subscales adequately tap into the dark domains of personality. The aim of the present study was to analyze the Swedish version of the Dark Triad Dirty Dozen using IRT.

Method

570 individuals (n_males = 326, n_females = 242, and 2 unreported), including university students and white-collar workers with an age range between 19 and 65 years, responded to the Swedish version of the Dark Triad Dirty Dozen (Garcia et al., 2017a,b).

Results

Contrary to previous research, we found that the narcissism scale provided most information, followed by psychopathy, and finally Machiavellianism. Moreover, the psychopathy scale required a higher level of the latent trait for endorsement of its items than the narcissism and Machiavellianism scales. Overall, all items provided reasonable amounts of information and are thus effective for discriminating between individuals. The mean item discriminations (alphas) were 1.92 for Machiavellianism, 2.31 for narcissism, and 1.99 for psychopathy.

Conclusion

This is the first study to provide IRT analyses of the Swedish version of the Dark Triad Dirty Dozen. Our findings add to a growing literature on the Dark Triad Dirty Dozen scale in different cultures and highlight psychometric characteristics, which can be used for comparative studies. Items tapping into psychopathy showed higher thresholds for endorsement than the other two scales. Importantly, the narcissism scale seems to provide more information about a lack of narcissism, perhaps mirroring cultural conditions.

The Dark Cube: dark character profiles and OCEAN

BACKGROUND

The Big Five traits (i.e., openness, conscientiousness, extraversion, agreeableness, and neuroticism: OCEAN) have been suggested to provide a meaningful taxonomy for studying the Dark Triad: Machiavellianism, narcissism, and psychopathy. Nevertheless, current research consists of mixed and inconsistent associations between the Dark Triad and OCEAN. Here we used the Dark Cube (Garcia & Rosenberg, 2016), a model of malevolent character theoretically based on Cloninger's biopsychosocial model of personality and in the assumption of a ternary structure of malevolent character. We use the dark cube profiles to investigate differences in OCEAN between individuals who differ in one dark character trait while holding the other two constant (i.e., conditional relationships).

METHOD

Participants (N = 330) responded to the Short Dark Triad Inventory and the Big Five Inventory and were grouped according to the eight possible combinations using their dark trait scores (M, high Machiavellianism; m, low Machiavellianism; N, high narcissism; n, low narcissism; P, high psychopathy; p, low psychopathy): MNP "maleficent", MNp "manipulative narcissistic", MnP "anti-social", Mnp "Machiavellian", mNP "psychopathic narcissistic", mNp "narcissistic", mnP "psychopathic", and mnp "benevolent".

RESULTS

High narcissism-high extraversion and high psychopathy-low agreeableness were consistently associated across comparisons. The rest of the comparisons showed a complex interaction. For example, high Machiavellianism-high neuroticism only when both narcissism and psychopathy were low (Mnp vs. mnp), high narcissism-high conscientiousness only when both Machiavellianism and psychopathy were also high (MNP vs. MnP), and high psychopathy-high neuroticism only when Machiavellianism was low and narcissism was high (mNP vs. mNp).

CONCLUSIONS

We suggest that the Dark Cube is a useful tool in the investigation of a consistent Dark Triad Theory. This approach suggests that the only clear relationships were narcissism-extraversion and psychopathy-agreeableness and that the malevolent character traits were associated to specific OCEAN traits only under certain conditions. Hence, explaining the mixed and inconsistent linear associations in the Dark Triad literature.

The Dark Triad Traits from a Life History Perspective in Six Countries

Work on the Dark Triad traits has benefited from the use of a life history framework but it has been limited to primarily Western samples and indirect assessments of life history strategies. Here, we examine how the Dark Triad traits (i.e., psychopathy, Machiavellianism, and narcissism) relate to two measures of individual differences in life history strategies. In Study 1 (N = 937), we replicated prior observed links between life history strategies, as measured by the Mini-K, and the Dark Triad traits using samples recruited from three countries. In Study 2 (N = 1032), we measured life history strategies using the Consideration of Future Consequences Scale and correlated it with the Dark Triad traits in samples recruited from three additional countries. While there was some variability across participants’ sex and country, the results were generally consistent in that psychopathy and (to a lesser extent) Machiavellianism were related to faster life history strategies and narcissism was related to slower life history strategies. These results add cross-cultural data and the use of two measures of life history speed to understand the Dark Triad traits from a life history perspective.