Zur Verwendung projektiver Verfahren in der Familienrechtspsychologie: ein Diskussionsbeitrag

Projektive Verfahren werden auch heute noch in der familienrechtspsychologischen Diagnostik eingesetzt. Erfahrungsgemäß lassen sich 3 unterschiedliche Anwendungsarten unterscheiden: a) als klassisch diagnostisches Instrument, b) als informelle Verhaltensprobe oder c) als Explorationshilfe bzw. Gesprächseinstieg. In der folgenden Übersicht werden diese 3 Anwendungsarten dargestellt sowie ihr Nutzen für die familienrechtspsychologische Diagnostik kritisch diskutiert. Hierfür wird zunächst ein Überblick über die empirische Fundierung der am meisten genutzten projektiven Verfahren (des Thematischen Apperzeptionstests und zeichnerische Verfahren allgemein) gegeben. Es wird dann diskutiert, ob die klassischen psychometrischen Gütekriterien auf projektive Verfahren anwendbar sind. Hinsichtlich der Verwendung projektiver Verfahren als informelle Verhaltensprobe wird auf mögliche Urteilsverzerrungen hingewiesen, insbesondere den „confirmation bias“, den Effekt der illusorischen Korrelation und den möglichen Einfluss irrelevanter Informationen auf den diagnostischen Prozess. Angesichts der potenziell negativen Auswirkungen auf die Validität der Diagnostik empfehlen wir, projektive Verfahren nicht in der Einzelfalldiagnostik einzusetzen, wenn keine direkten empirischen Belege für die Validität des spezifischen Verfahrens für die genutzte Auswertungsart und das zu diagnostizierende Konstrukt vorliegen.

What are agile, flexible, or adaptable employees and students? A typology of dynamic individual differences in applied settings

The applied psychology literature has discussed and used a variety of different definitions of dynamic individual differences. Descriptions like dynamic, agile, adaptive, or flexible can refer to a variety of different types of constructs. The present article contributes to the literature by presenting an organizing typology of dynamic constructs. We also conducted a literature review of four major applied journals over the last 15 years to validate the taxonomy and to use it to map what type of dynamic individual differences constructs are typically studied in the applied psychology literature. The typology includes six basic conceptualizations of dynamic individual differences: Variability constructs (inconsistency across situations), skill acquisition constructs (learning new skills), transition constructs (avoiding “loss” in behavior/skill after unforeseen change), reacquisition constructs (relearning after change), acceleration/deceleration constructs (losing or gaining energy by displaying the behavior), and integration/dissolution constructs (behavior becomes more or less uniform). We provide both verbal and statistical definitions for each of these constructs, and demonstrate how these conceptualizations can be operationalized in assessment and criterion measurement using R code and simulated data. We also show how researchers can test different dynamic explanations using likelihood-based R2 statistics.

Improving Measurement Precision in Experimental Psychopathology Using Item Response Theory

Although item response models have grown in popularity in many areas of educational and psychological assessment, there are relatively few applications of these models in experimental psychopathology. In this article, we explore the use of item response models in the context of a computerized cognitive task designed to assess visual working memory capacity in people with psychosis as well as healthy adults. We begin our discussion by describing how item response theory can be used to evaluate and improve unidimensional cognitive assessment tasks in various examinee populations. We then suggest how computerized adaptive testing can be used to improve the efficiency of cognitive task administration. Finally, we explore how these ideas might be extended to multidimensional item response models that better represent the complex response processes underlying task performance in psychopathological populations.

Measuring Implicit Motives with the Picture Story Exercise (PSE): Databases of Expert-Coded German Stories, Pictures, and Updated Picture Norms

We present two openly accessible databases related to the assessment of implicit motives using Picture Story Exercises (PSEs): (a) A database of 183,415 German sentences, nested in 26,389 stories provided by 4,570 participants, which have been coded by experts using Winter's coding system for the implicit affiliation/intimacy, achievement, and power motives, and (b) a database of 54 classic and new pictures which have been used as PSE stimuli. Updated picture norms are provided which can be used to select appropriate pictures for PSE applications. Based on an analysis of the relations between raw motive scores, word count, and sentence count, we give recommendations on how to control motive scores for story length, and validate the recommendation with a meta-analysis on gender differences in the implicit affiliation motive that replicates existing findings. We discuss to what extent the guiding principles of the story length correction can be generalized to other content coding systems for narrative material. Several potential applications of the databases are discussed, including (un)supervised machine learning of text content, psychometrics, and better reproducibility of PSE research.

Validity of the TAT in Brazil: Theoretical and Methodological Issues

Abstract Although the Thematic Apperception Test (TAT) is popular in Brazil, showing evidences of its validity remains a challenge. In the present article, we discuss such issue by analyzing the definition of the TAT as a projective method and a psychological test, its use by different theoretical traditions, relations between nomothetic and idiographic analysis levels, limitations of Classical Test Theory for evaluating the instrument’s properties, and challenges regarding research and practice with the instrument in Brazil. We advocate that overcoming a traditional view of projective techniques, using multidimensional methods and performing wider empirical studies on norms and validation evidences with multicenter databases may allow more secure and informed practices with the instrument among researchers and practitioners in the country.

Translating Informal Theories Into Formal Theories: The Case of the Dynamic Computational Model of the Integrated Model of Work Motivation

Theories are the core of any science, but many imprecisely stated theories in organizational and management science are hampering progress in the field. Computational modeling of existing theories can help address the issue. Computational models are a type of formal theory that are represented mathematically or by other formal logic and can be simulated, allowing theorists to assess whether the theory can explain the phenomena intended as well as make testable predictions. As an example of the process, Locke’s integrated model of work motivation is translated into static and dynamic computational models. Simulations of these models are compared to the empirical data used to develop and test the theory. For the static model, the simulations revealed largely strong associations with robust empirical findings. However, adding dynamics created several challenges to key precepts of the theory. Moreover, the effort revealed where empirical work is needed to further refine or refute the theory. Discussion focuses on the value of computational modeling as a method for formally testing, pruning, and extending extant theories in the field.

Improving the Assessment of Implicit Motives Using IRT: Cultural Differences and Differential Item Functioning

Researchers have long been interested in studying differences in implicit motive between different groups. Implicit motives are typically measured by scoring text that respondents have written in response to picture cues. Recently, research on the measurement of implicit motives has made progress through the application of a dynamic Thurstonian item-response theory model (DTM; Lang, 2014 ) that captures 2 basic motivational processes in motivational research: motive competition and dynamic reduction of motive strength after a motive has been acted out. In this article, the authors use the DTM to investigate differential item functioning (DIF) in implicit motive measures. The article first discusses DIF in the context of the DTM. The authors then conduct a DIF analysis of data from a study that used a picture set of the Operant Motive Test (OMT; Kuhl & Scheffer, 2002) with participants from Cameroon, Germany, and Costa Rica. Results showed no evidence of DIF in 9 pictures and some evidence for DIF in 3 pictures. The authors show a partial invariance model can be specified and use this partial invariance model to study latent mean differences between Cameroon, Germany, and Costa Rica. The discussion focuses on the use of IRT DIF methods in future research on implicit motives.

Not Your Same Old Story: New Rules for Thematic Apperceptive Techniques (TATs)

Stories told about pictures have been used for both research and clinical practice since the beginning of modern personality assessment. However, with the growing science-practice gap, these thematic apperceptive techniques (TATs) have been used differently in those 2 venues. Scientific validation is presumptively general, but clinical application is idiographic and situation-specific. A bridge is needed. The manualized human-scored narrative analysis systems discussed here are valuable scientist-practitioner tools, but they require a validation literature to support further research publication, maintain their role in clinical training, and justify clinicians' reimbursement by third-party payers. To facilitate wider understanding of manualized TAT methodologies, this article addresses long-standing criticisms of TAT reliability and proposes some strategic solutions to the measurement error problem for both researchers and clinicians, including analyzing person-situation interactions, purposeful situation sampling for within-storyteller comparisons, and uses of small samples. The new rules for TATs include conceptual and methodological standards that researchers should aim to meet and report, reviewers should apply to manuscripts, and clinical assessors can use to analyze their own data and justify third-party payment.

Is the Achievement Motive Gender-Biased? The Validity of TAT/PSE in Women and Men

In picture story exercises like the Thematic Apperception Test (TAT; Heckhausen, 1963), different pictures are presented to a person with the instruction to create a story using the scenes portrayed in the image. It is assumed, that people identify themselves with the people in the images and project their unconscious motives (e.g., achievement motive) onto them. As the TAT shows only men in the pictures, critics claimed the test is gender-biased; assuming women cannot identify with men in pictures. However, it was not assessed, whether female protagonists of the picture really trigger the same achievement motive as men. Therefore, two studies were conducted to address the gender difference and validity of the TAT using a version with only men in the pictures (study 1) or only women in the pictures (study 2). The results shows that the original TAT of Heckhausen is a valid instrument for women and men, but the modified version with only women in the pictures cannot validly measure the achievement motive in the male sample.

The Measurement of Implicit Motives in Three Cultures

This article examines methodological issues related to the measurement of implicit motives in culturally divergent samples. Implicit motives are seen as basic needs shared by all human beings. However, crosscultural comparisons are very restricted because many cross-cultural studies on implicit motives with non-Western cultures developed and discussed culture-inherent stimuli. The aim of the study here was to search for a culture-independent set of picture stimuli measuring two basic motives (affiliation and power motive) in three different cultures. Two pretests and one main study were carried out in Cameroon, Costa Rica, and Germany with student and nonstudent samples, respectively, and an extended methodological cross-cultural analysiswas conducted. Construct bias, method bias, and item bias that threaten the cross-cultural comparability of findings were addressed. In analyses, unbiased culture-independent sets of picture stimuli were identified that can be used for cross-cultural comparisons of these two implicit motives.

Methodological Considerations of Applying a Tat-Type Picture-Story Test in Cross-Cultural Research

This article examines problems associated with the selection and use of picture cues to assess data on implicit motives in cross-cultural research. A TAT-type picture-story test was administered to 121 Gwembe Tonga adolescents in Zambia. The stories were coded following Winter’s scoring system. The cue strength of each of the five picture stimuli in Zambia was identified and compared to findings on cue strength in a German student sample. Cue strengths differed markedly in both samples. Analyses on differential item functioning (item bias) showed that cross-cultural comparisons on motive strengths are not advisable. In further analyses, the influence of Zambian participants’educational level and written language on the stimulus pull of the picture cues was verified. Consequences of the validity of the findings on motive strength and some possible guidelines for future cross-cultural research are discussed.

Measuring the reliability of picture story exercises like the TAT

As frequently reported, psychometric assessments on Picture Story Exercises, especially variations of the Thematic Apperception Test, mostly reveal inadequate scores for internal consistency. We demonstrate that the reason for this apparent shortcoming is not caused by the coding system itself but from the incorrect use of internal consistency coefficients, especially Cronbach's α. This problem could be eliminated by using the category-scores as items instead of the picture-scores. In addition to a theoretical explanation we prove mathematically why the use of category-scores produces an adequate internal consistency estimation and examine our idea empirically with the origin data set of the Thematic Apperception Test by Heckhausen and two additional data sets. We found generally higher values when using the category-scores as items instead of picture-scores. From an empirical and theoretical point of view, the estimated reliability is also superior to each category within a picture as item measuring. When comparing our suggestion with a multifaceted Rasch-model we provide evidence that our procedure better fits the underlying principles of PSE.

Arousal of Achievement Motivation Among Student Samples in Three Different Cultural Contexts: Self and Social Standards of Evaluation

This article examines the influence of different situational contexts on the arousal of need for achievement in student samples from different cultural contexts. Implicit achievement motivation was assessed by a Thematic Apperception Test—type story test for which two different instructions were used: Although one group was informed that the best performance would be identified (me-oriented instruction), the other group was told that only the performance of the whole group (we-oriented instruction) would be evaluated. In Study 1, analyses revealed that Cameroonian participants who received the we-oriented instructions showed a significantly higher achievement motivation even if study groups did not differ in explicit life goals. In Study 2, the relationship between situational context and arousal of need for achievement was scrutinized in Chinese and German student samples. Within both cultural groups, students who were assigned to the me-oriented condition showed the highest levels of need for achievement. Findings are discussed with respect to differences in students’ self-construal.

Associations of Culture and Personality With McClelland’s Motives: A Cross-Cultural Study of Managers in 24 Countries

Using a cross-cultural sample of 17,538 managers from 24 countries, this study explores the interrelationships between McClelland’s motives and specific aggregate-level cultural dimensions and personality factors. The results reveal significant relationships between the Achievement, Affiliation, and Power Motives, and the cultural dimensions of Performance Orientation, Humane Orientation, and Power Distance, respectively. Support for posited relationships between the managers’ motives and aggregate-level personality, as measured by the Big Five factors, was also obtained. Finally, the results demonstrate that the relationships between McClelland’s motives and managers’ aggregate-level Big Five factors are moderated by the cultural dimensions of Performance Orientation, Humane Orientation, and Power Distance.

The Thematic Apperception Test: Toward a Standard Measure of the Big Three Motives

The application of the Thematic Apperception Test to the assessment of motives has been heralded as an important milestone in personality psychology. However, although this approach is well established, there is at present no standard battery of cues for measuring the Big Three motives (achievement, affiliation, power). Furthermore, the extent to which scoring subcategories contribute to overall motive scores has been neglected. Our research with students and managers examined the effectiveness of picture cues in eliciting motive imagery and the prevalence of scoring subcategories within each motive scoring system. Results from 2 data sets comprising 547 men and women suggested that there were 3 cues that should be retained for future research and that motive scoring systems could be refined through removal of redundant subcategories. Further research is needed to systematically investigate the effectiveness of a standard battery of cues and the validity of revised motive scoring systems.

Measuring individual differences in sensitivities to basic emotions in faces

The assessment of individual differences in facial expression recognition is normally required to address two major issues: (1) high agreement level (ceiling effect) and (2) differential difficulty levels across emotions. We propose a new assessment method designed to quantify individual differences in the recognition of the six basic emotions, 'sensitivities to basic emotions in faces.' We attempted to address the two major assessment issues by using morphing techniques and item response theory (IRT). We used morphing to create intermediate, mixed facial expression stimuli with various levels of recognition difficulty. Applying IRT enabled us to estimate the individual latent trait levels underlying the recognition of respective emotions (sensitivity scores), unbiased by stimulus properties that constitute difficulty. In a series of two experiments we demonstrated that the sensitivity scores successfully addressed the two major assessment issues and their concomitant individual variability. Intriguingly, correlational analyses of the sensitivity scores to different emotions produced orthogonality between happy and non-happy emotion recognition. To our knowledge, this is the first report of the independence of happiness recognition, unaffected by stimulus difficulty.

Using the Multifaceted Rasch Model to Improve the TAT/PSE Measure of Need for Achievement

We used the Rasch (1980) model to develop new pictures for the Thematic Apperception Test (C. D. Morgan & Murray, 1938; McClelland, Atkinson, Clark, & Lowell, 1953) or picture story exercise to measure need for achievement (nAch). In Experiments 1 and 2, we analyzed stories to assess the difficulty level of a total of 8 pictures using the multifaceted Rasch model with picture difficulty, story probe difficulty, and participant ability as facets with a partial credit model (FACETS; Linacre, 2005). A total of 6 pictures were retained and 4 new ones added for Experiment 3 in which 201 participants wrote 6 stories to a random set of the 10 pictures. FACETS analysis revealed improved person separation reliability. In Experiment 4, 206 participants wrote 1 story to the Studying picture either before or after filling out a battery of achievement-related questionnaires. The 2 experimental groups did not differ in the amount of nAch in their stories. The coder facet was demonstrated with 2 independent coders using the revised coding system for nAch.

Implicit and self-attributed motives to achieve: two separate but interacting needs

This research examined how implicit and self-attributed needs to achieve (labeled as n Ach and san Ach, respectively) combine with self-referenced and norm-referenced feedback to predict effort-related (task performance) and choice-related (task continuation) indexes of students' engagement in a mental concentration task. In Experiment 1 the authors found that in a task-focused setting, task performance was predicted by the joint effect of self-referenced feedback and n Ach, whereas task continuation was predicted by the joint effect of norm-referenced feedback and san Ach. In Experiment 2 the authors found that in an ego-focused setting, n Ach and san Ach interacted in the prediction of task performance but not of task continuation. In Experiment 3 the authors found that the effects of n Ach and san Ach on students' performance were mediated by the anticipated affective value of achievement outcomes. These findings are discussed in relation to a 2-system approach to achievement motivation.

A nonlinear mixed model framework for item response theory

Mixed models take the dependency between observations based on the same cluster into account by introducing 1 or more random effects. Common item response theory (IRT) models introduce latent person variables to model the dependence between responses of the same participant. Assuming a distribution for the latent variables, these IRT models are formally equivalent with nonlinear mixed models. It is shown how a variety of IRT models can be formulated as particular instances of nonlinear mixed models. The unifying framework offers the advantage that relations between different IRT models become explicit and that it is rather straightforward to see how existing IRT models can be adapted and extended. The approach is illustrated with a self-report study on anger.