Field Reliability of Comprehensive System Scoring in an Adolescent Inpatient Sample

Rorschach Performance Assessment System (R-PAS) Interrater Reliability in a Brazilian Adolescent Sample and Comparisons With Three Other Studies

We examine interrater reliability for scoring the Rorschach Performance Assessment System (R-PAS) in a sample of 89 adolescents (M_Age = 13.2, SD = 1.01) from Brazil using exact agreement intraclass correlations coefficient (ICCs) for the 60 protocol-level scores that are the focus of interpretation. The first author completed or reviewed all of the primary coding, and seven R-PAS proficient psychologists trained at different sites independently produced secondary coding. Overall, excellent agreement was found (M ICC = 0.89; SD = 0.09). When averaged across this study and three other comparison studies, stronger reliability was present, in general, for commonly coded variables (M = 0.87) as opposed to rare or infrequent variables (M = 0.78). In addition, 78.3% of the variables showed excellent interrater reliability and an additional 20.0% had good reliability. The results also showed that the ICCs for most variables had low variability across studies, suggesting clear coding guidelines. However, variables with higher ICC variability across studies indicated domains where it would be desirable to expand guidelines with more detailed parameters. Overall, the findings indicate excellent interrater reliability for the great majority of codes and present solid grounds for future research on interrater reliability with R-PAS.

Response character styles in adolescents: a replication of convergent validity between the MMPI-A and the Rorschach

This study explored the extent to which similar or discordant response character styles (RCS) affected convergence between MMPI-A and Rorschach findings in a sample of 673 adolescents from a psychiatric inpatient setting. Meyer's (Meyer, 1997; Meyer, Riethmiller, Brooks, Benoit, & Handler, 2000) findings for adult samples were generally replicated in that adolescents showing similar RCS across both measures showed moderate to strong relationships between Rorschach and MMPI-A indicants of affective distress, psychosis, and interpersonal wariness, whereas those showing discordant RCS demonstrated negligible or negative correlations between these indicants. This pattern was evident for conceptually similar, but not conceptually unrelated variable pairs. Similarity and discordance of RCS was also found to have an impact on relationships with external criterion variables, including therapist ratings and discharge diagnoses. Moderated regression analysis supports the hypothesis that RCS moderates the strength of the relationship between Rorschach and MMPI-A. Implications for practice and future research are discussed.

Rorschach intercoder reliability for protocol-level comprehensive system variables in an international sample

This study examines the intercoder reliability of Rorschach Comprehensive System (CS; Exner, 2001) protocol-level variables. A large international sample was combined to obtain intercoder agreement for 489 Rorschach protocols coded using the CS. Intercoder agreement was calculated using an Iota coefficient, a statistical coefficient similar to kappa that is corrected for chance. Iota values for the variables analyzed ranged from .31 to 1.00, with 2 in the poor range of agreement, 4 in the fair range, 25 in the good range, and 116 in the excellent range of agreement. Discrepancies between variables are discussed.

One more datum on Rorschach form quality

The central purpose of this work is to examine to what extent Form Quality (FQ) scoring of Rorschach responses, using Exner's (2003) Table A, is the reason for lower FQ to often be found in normative data outside the United States. The Rorschach protocols of 180 Portuguese boys and girls between 6 and 10 years of age were codified with respect to Form Quality in accordance with Exner's table of objects classified as ordinary, unusual, and minus, based on frequencies seen among U.S. adults and on an analogous Portuguese table (Table P) constructed from the protocols of 400 nonpatient children. Mean differences between the various FQ variables of the 2 tables were found to be insignificant. However, use of Janson's (2003) iota coefficient to evaluate agreement between the 2 approaches to scoring on the same protocols revealed that the more striking differences occurred in the FQu variable when agreement was assessed on the basis of each individual response. In view of these results, the authors recognize the possibility of Rorschach normative data to be universally applied, but still consider the possible advantage of each country or culture to build its own FQ table that will permit preservation of its particularities.

Rorschach correlates of adolescent self-mutilation

The present study examined various Rorschach variables of aggression, dysphoric affect, and disordered thinking in relation to self-mutilation in samples of self-mutilating (SM; n=16) and nonself-mutilating (N-SM; n=26) adolescent inpatients. Categorical comparisons indicated that SM patients had significantly higher mean scores for Aggressive Past (AgPast), but not for Aggressive Content (AgC), Aggressive Movement (AG), Morbid Content (MOR), Inanimate Movement (m), Sum Shading (SumY), and the Perceptual-Thinking Index (PTI), than N-SM patients. Additionally, logistic regression results suggested that PTI and AgPast were the most robust predictors of group membership. The authors propose that self-mutilating adolescents may struggle with internally directed aggression and victimized sense of self that, when coupled with disordered thinking, significantly predicts self-mutilation.