1
|
Ales F, Meyer GJ, Mihura JL, Loia AC, Pasqualini S, Zennaro A, Giromini L. Can the Rorschach be Administered Remotely? A Review of Options and a Pilot Study Using a Newly Developed R-PAS App. PSYCHOLOGICAL INJURY & LAW 2022; 16:1-17. [PMID: 35308458 PMCID: PMC8923744 DOI: 10.1007/s12207-022-09447-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2021] [Accepted: 02/26/2022] [Indexed: 11/16/2022]
Abstract
The ongoing COVID-19 pandemic has required psychologists to adopt measures like physical distancing and mask wearing, though other safety procedures such as travel restrictions or prohibitions on in-person practice and research have fostered the use of tele-health tools. In this article, we review options for using the Rorschach task via videoconference and provide preliminary data from using a new electronic app for remote R-PAS administration to determine whether the remote administration in an electronic form yields different information than in-person administration with the cards in hand. As a pilot study, our focus is on the "first factor" of all Rorschach scores, i.e., complexity. Data were collected from 60 adult Italian community volunteers, and statistical analyses evaluated the extent to which the average complexity score significantly departed from R-PAS normative expectations (SS = 100), accompanied by Bayesian likelihoods for supporting the null hypothesis. Results suggest that the general level of complexity shown by the test-takers when administered the Rorschach remotely with the new R-PAS app closely resembles that previously observed using "standard" in-person procedures. Tentative analyses of other R-PAS scores suggested normative departures that could be due to the effects of the app, testing at home, or responses to the pandemic. We offer recommendations for future research and discuss practical implications.
Collapse
Affiliation(s)
- Francesca Ales
- Department of Psychology, University of Turin, Via Verdi 10, 10123 Turin, TO Italy
| | | | - Joni L. Mihura
- Department of Psychology, University of Toledo, Toledo, OH USA
| | - Andrea Corgiat Loia
- Department of Psychology, University of Turin, Via Verdi 10, 10123 Turin, TO Italy
| | - Sara Pasqualini
- Department of Psychology, University of Turin, Via Verdi 10, 10123 Turin, TO Italy
| | - Alessandro Zennaro
- Department of Psychology, University of Turin, Via Verdi 10, 10123 Turin, TO Italy
| | - Luciano Giromini
- Department of Psychology, University of Turin, Via Verdi 10, 10123 Turin, TO Italy
| |
Collapse
|
2
|
Diener MJ, Hilsenroth MJ, Shaffer SA, Sexton JE. A Meta-Analysis of the relationship between the Rorschach Ego Impairment Index (EII) and psychiatric severity. Clin Psychol Psychother 2010; 18:464-85. [DOI: 10.1002/cpp.725] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
3
|
Hartmann E, Grønnerød C. Rorschach variables and Big Five scales as predictors of military training completion: a replication study of the selection of candidates to the naval special forces in Norway. J Pers Assess 2009; 91:254-64. [PMID: 19365766 DOI: 10.1080/00223890902794309] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
We tested 140 male candidates at the Naval Special Forces (NFS) of Norway on the Rorschach (Exner, 2003; Rorschach, 1921/1942) and the Norwegian version of the Big Five personality dimensions (Engvik & Føllesdal, 2005). Rorschach variables significantly correlated with training completion (effect sizes of r(e) = .14-.25), whereas none of the Big Five factors or facets did. The combination of Rorschach and Big Five variables framed in the illusory mental health concept provided strong predictive ability. Testing under stress produced slightly higher predictive validity coefficients between the Rorschach variables and pass-fail than under calm testing. The findings support the results of Hartmann, Sunde, Kristensen, and Martinussen (2003), indicating that Rorschach variables and indications of good mental health may be valid predictors of NFS training.
Collapse
Affiliation(s)
- Ellen Hartmann
- Department of Psychology, University of Oslo, Oslo, Norway.
| | | |
Collapse
|
4
|
Kochinski S, Smith SR, Baity MR, Hilsenroth MJ. Rorschach correlates of adolescent self-mutilation. Bull Menninger Clin 2008; 72:54-77. [PMID: 18419244 DOI: 10.1521/bumc.2008.72.1.54] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
The present study examined various Rorschach variables of aggression, dysphoric affect, and disordered thinking in relation to self-mutilation in samples of self-mutilating (SM; n=16) and nonself-mutilating (N-SM; n=26) adolescent inpatients. Categorical comparisons indicated that SM patients had significantly higher mean scores for Aggressive Past (AgPast), but not for Aggressive Content (AgC), Aggressive Movement (AG), Morbid Content (MOR), Inanimate Movement (m), Sum Shading (SumY), and the Perceptual-Thinking Index (PTI), than N-SM patients. Additionally, logistic regression results suggested that PTI and AgPast were the most robust predictors of group membership. The authors propose that self-mutilating adolescents may struggle with internally directed aggression and victimized sense of self that, when coupled with disordered thinking, significantly predicts self-mutilation.
Collapse
Affiliation(s)
- Sivan Kochinski
- Lucile Salter Packard Children's Hospital at Stanford and The Children's Health Council, USA.
| | | | | | | |
Collapse
|
5
|
Kimhy D, Corcoran C, Harkavy-Friedman JM, Ritzler B, Javitt DC, Malaspina D. Visual form perception: a comparison of individuals at high risk for psychosis, recent onset schizophrenia and chronic schizophrenia. Schizophr Res 2007; 97:25-34. [PMID: 17884347 PMCID: PMC2171044 DOI: 10.1016/j.schres.2007.08.022] [Citation(s) in RCA: 32] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/01/2007] [Revised: 08/16/2007] [Accepted: 08/20/2007] [Indexed: 11/28/2022]
Abstract
Schizophrenia has been associated with deficits in visual perception and processing, but there is little information about their temporal development and stability. We assessed visual form perception using the Rorschach Comprehensive System (RCS) in 23 individuals at clinical high risk for psychosis, 15 individuals with recent onset schizophrenia (< or =2 years since onset), and 34 with chronic schizophrenia (> or =3 years since onset). All three groups demonstrated reduced conventional form perception (X+%), as compared with published norms, but did not differ significantly from one another. In contrast, the high-risk group had significantly better performance on an index of clarity of conceptual thinking (WSUM6) compared to the chronic schizophrenia patients, with the recent onset group scoring intermediate to the high-risk and chronic schizophrenia groups. The results suggest that individuals at clinical high risk for psychosis display substantial deficits in visual form perception prior to the onset of psychosis and that these deficits are comparable in severity to those observed in individuals with schizophrenia. Therefore, visual form perception deficits may constitute a trait-like risk factor for psychosis in high-risk individuals and may potentially serve as an endophenotype of risk for development of psychosis. Clarity of conceptual thinking was relatively preserved among high-risk patients, consistent with a relationship to disease expression, not risk. These deficits are discussed in the context of the putative neurobiological underpinnings of visual deficits and the developmental pathophysiology of psychosis in schizophrenia.
Collapse
Affiliation(s)
- D Kimhy
- Department of Psychiatry, Columbia University, New York, NY 10032, USA.
| | | | | | | | | | | |
Collapse
|
6
|
Duarte CS, Bordin IA, Yazigi L, Mooney J. Factors associated with stress in mothers of children with autism. AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2006; 9:416-27. [PMID: 16155057 DOI: 10.1177/1362361305056081] [Citation(s) in RCA: 131] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
The objective of this case-control study was to investigate the determinants of maternal stress in mothers of children with autism. Mothers of 31 children with autism from mental health clinics were matched by child age/gender and mother age to 31 mothers of children without mental health problems, drawn from public schools and a primary care unit. Logistic regression models showed that the presence of stress in mothers was primarily associated with having a child with autism. However, poor expression of affect, little interest in people, being an older mother, and having a younger child also contributed to increased stress levels. Although having a child with autism was the main factor responsible for stress, the presence of the other factors further increased maternal stress. The implication is that a subgroup of mothers of children with autism is more prone to experience stress, thus requiring special attention from mental health professionals.
Collapse
Affiliation(s)
- Cristiane S Duarte
- Division of Child and Adolescent Psychiatry, Columbia University/NY State Psychiatric Institute, New York, NY 10032, USA.
| | | | | | | |
Collapse
|
7
|
Abstract
BACKGROUND It is estimated that between 10% and 65% of people with schizophrenia use illicit drugs such as amphetamines. This group have an increased rate of hospitalisation, homelessness, unemployment and suicide compared with those with schizophrenia who do not abuse drugs. OBJECTIVES To evaluate the effects of amphetamines for people with schizophrenia in terms of clinically meaningful outcomes, cognitive functioning and physiological tests. SEARCH STRATEGY We searched the Cochrane Schizophrenia Group's Register (February 2002). SELECTION CRITERIA We included all randomised controlled trials investigating the effects of amphetamines on people with schizophrenia, compared with a placebo intervention. DATA COLLECTION AND ANALYSIS Working independently, we selected and critically appraised studies, extracted data and analysed on an intention-to-treat basis. Where possible and appropriate we calculated risk ratios (RR) and their 95% confidence intervals (CI), with the number needed to treat (NNT). For continuous data we calculated Weighted Mean Differences (WMD). MAIN RESULTS We included four short studies with a total of 83 participants. Data were few and poorly reported. The results indicated a reduction of negative symptoms for people allocated to amphetamines (n = 16, 1 RCT, WMD -3 CI -5.02 to -0.98). No such effect was found for positive symptom change (n = 16, 1 RCT, WMD 0 CI -4.46 to 4.46). Compared with placebo, amphetamines significantly increased metabolism in the left and right cerebellum (n = 23, 1 RCT, WMD 0.12 CI 0.06 to 0.18; n = 23 1 RCT, WMD 0.12 CI 0.06 to 0.18) and left striatum (n = 23, 1 RCT, WMD 0.14 CI 0.00 to 0.28) and also significantly decreased metabolism in the left dorsolateral prefrontal cortex (n = 23, 1 RCT, WMD -0.09 CI -0.17 to -0.01). REVIEWERS' CONCLUSIONS Understandably amphetamines are rarely formally evaluated in randomised studies and therefore unpublished work in this area is likely to exist. Addition of more studies may clarify reasons why people with schizophrenia persist in taking these harmful stimulants.
Collapse
Affiliation(s)
- S Nolte
- Department of Psychiatry & Behavioural Sciences, 15 Hyde Terrace, Leeds, LS2 9JT, West Yorkshire, UK.
| | | | | |
Collapse
|
8
|
Viglione DJ, Perry W, Jansak D, Meyer G, Exner JE. Modifying the Rorschach Human Experience Variable to create the Human Representational Variable. J Pers Assess 2003; 81:64-73. [PMID: 12842803 DOI: 10.1207/s15327752jpa8101_06] [Citation(s) in RCA: 19] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
Abstract
The Human Experience Variable (HEV; Perry & Viglione, 1991) provided information about interpersonal perceptions not previously available within the Comprehensive System (CS; Exner, 1993). Research data suggests that it was related to interpersonal functioning and as a result, psychological impairment and health. In this article, we present the rationale and empirical basis for recent psychometric refinements to the HEV, consequently renamed the Human Representational Variable (HRV). Research addressing the reliability and validity for the HRV is summarized. Based on data and experience with the HEV, this study summarized some small modifications to the original algorithm. The refined variable, the HRV, has been added to the CS (Exner, 2000). Data presented here suggest that the HRV has improved psychometric properties compared to the HEV and that it is simpler to understand. Research recommendations and interpretive suggestions are also presented.
Collapse
Affiliation(s)
- Donald J Viglione
- California School of Professional Psychology, San Diego Alliant International University, San Diego, CA 92131-1799, USA.
| | | | | | | | | |
Collapse
|
9
|
Perry W, Minassian A, Cadenhead K, Sprock J, Braff D. The use of the Ego Impairment Index across the schizophrenia spectrum. J Pers Assess 2003; 80:50-7. [PMID: 12584067 DOI: 10.1207/s15327752jpa8001_13] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
Abstract
The goal of this study was to assess perceptual and thought disturbance, as indexed by the Ego Impairment Index (EII; Perry & Viglione, 1991), a Rorschach-derived measure, across the schizophrenia spectrum. We hypothesized that there would be an increase in EII scores (indicating increased disturbance) across the spectrum from nonpatients to severely disturbed, hospitalized schizophrenia patients. Normal comparison participants (n = 66), students with elevated scores on either the Perceptual Aberration/Magical Ideation or the Physical Anhedonia Scales (n = 24), first-degree relatives of schizophrenia patients (n = 36), participants diagnosed with Diagnostic and Statistical Manual of Mental Disorders (4th ed. [DSM-IV]; American Psychiatric Association, 1994) schizotypal personality disorder (n = 36), outpatient schizophrenia participants (n = 33), and hospitalized schizophrenia patients (n = 56) were studied. As hypothesized, we found increased EII scores in all of the schizophrenia spectrum groups when compared against normal comparison participants. Furthermore, the EII was significantly different between the schizophrenia patients and the other schizophrenia spectrum groups. These findings support the use of the EII as a sensitive measure of perceptual and thought disturbance across the schizophrenia spectrum that yields specific information regarding the type of thinking problems that occur within schizophrenia spectrum subgroups.
Collapse
Affiliation(s)
- William Perry
- Department of Psychiatry, University of California, San Diego, La Jolla, CA 92093-8620, USA.
| | | | | | | | | |
Collapse
|
10
|
Hartmann E, Sunde T, Kristensen W, Martinussen M. Psychological measures as predictors of military training performance. J Pers Assess 2003; 80:87-98. [PMID: 12584071 DOI: 10.1207/s15327752jpa8001_17] [Citation(s) in RCA: 41] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
Abstract
The predictive validity of 7 ability tests, the Big Five, and the Rorschach method administered to 71 male applicants at the Naval Special Forces (NSF) of Norway was evaluated based on pass/fail results in training. The findings showed: (a) small correlations between the ability tests, the Big Five scales, and the success criterion; (b) Rorschach variables measuring stress tolerance, reality testing, cognition, and social adjustment correlated significantly (r =.25 to.48) with pass/fail results in training, and (c) logistic regression analysis revealed that 3 of the Rorschach variables accumulated incrementally in the prediction of training completion when entered after the ability tests and the Big Five scales, thus supporting the merit of using Rorschach variables for predicting NSF training performance
Collapse
|
11
|
Meyer GJ, Hilsenroth MJ, Baxter D, Exner JE, Fowler JC, Piers CC, Resnick J. An examination of interrater reliability for scoring the Rorschach Comprehensive System in eight data sets. J Pers Assess 2002; 78:219-74. [PMID: 12067192 DOI: 10.1207/s15327752jpa7802_03] [Citation(s) in RCA: 105] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
Abstract
In this article, we describe interrater reliability for the Comprehensive System (CS; Exner. 1993) in 8 relatively large samples, including (a) students, (b) experienced re- searchers, (c) clinicians, (d) clinicians and then researchers, (e) a composite clinical sample (i.e., a to d), and 3 samples in which randomly generated erroneous scores were substituted for (f) 10%, (g) 20%, or (h) 30% of the original responses. Across samples, 133 to 143 statistically stable CS scores had excellent reliability, with median intraclass correlations of.85, .96, .97, .95, .93, .95, .89, and .82, respectively. We also demonstrate reliability findings from this study closely match the results derived from a synthesis of prior research, CS summary scores are more reliable than scores assigned to individual responses, small samples are more likely to generate unstable and lower reliability estimates, and Meyer's (1997a) procedures for estimating response segment reliability were accurate. The CS can be scored reliably, but because scoring is the result of coder skills clinicians must conscientiously monitor their accuracy.
Collapse
Affiliation(s)
- Gregory J Meyer
- Department of Psychology, University of Alaska, Anchorage 99508, USA.
| | | | | | | | | | | | | |
Collapse
|
12
|
Rosenthal R, Hiller JB, Bornstein RF, Berry DT, Brunell-Neuleib S. Meta-analytic methods, the Rorschach, and the MMPI. Psychol Assess 2001; 13:449-51. [PMID: 11793890 DOI: 10.1037/1040-3590.13.4.449] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
In response to concerns described by H. N. Garb, J. M. Wood, M. T. Nezworski, W. M. Grove, and W. J. Stejskal (2001), the authors present the weighted and unweighted means and medians of the effect sizes obtained by J. B. Hiller, R. Rosenthal, R. F. Bornstein, D. T. R. Berry, and S. Brunell-Neuleib (1999). These indices of central tendency are presented separately for Minnesota Multiphasic Personality Inventory (MMPI) and Rorschach effect sizes, both for all the studies in the meta-analysis and for a 10% trimmed sample designed to obtain more robust estimates of central tendency. The variability of these 4 indices is noticeably greater for the MMPI than for the Rorschach. Meta-analysts must compute, compare, and evaluate a variety of indices of central tendency, and they must examine the effects of moderator variables. The authors also comment briefly on the use of phi versus kappa, combining correlated effect sizes and possible hindsight biases.
Collapse
Affiliation(s)
- R Rosenthal
- Department of Psychology, University of California, Riverside, USA
| | | | | | | | | |
Collapse
|
13
|
Abstract
This article examined the incremental validity of the Ego Impairment Index (EII), a Rorschach measure of cognition, perception, and reasoning. R. M. Dawes (1999) borrowed 2 previously published data sets to assess the incremental validity of the EII. Dawes determined that in order for the EII to be considered a valid measure, the overall EII score should "outperform" 2 of the variables that compose the index. Using this approach, Dawes reported that the EII had "deficient" (p = .059) incremental validity. In this study, the incremental validity of the EII was re-examined using 1 of the data sets used by R. M. Dawes (1999). Applying the same strategy as Dawes, the author tested the incremental validity of the EII in predicting positive symptoms of schizophrenia, a more appropriate and clinically relevant criterion measure of impairment. The EII significantly predicted positive symptoms (p < .005) even after the 2 EII variables selected by Dawes and the measure of social competence were 1st entered into the equation. The results suggest that the EII adds meaningful information in the assessment of thought disturbance.
Collapse
Affiliation(s)
- W Perry
- Department of Psychiatry, University of California, San Diego, 9500 Gilman Drive, La Jolla, California 92093-8218, USA.
| |
Collapse
|
14
|
Wood JM, Lilienfeld SO, Nezworski MT, Garb HN. Coming to grips with negative evidence for the Comprehensive System for the Rorschach: a comment on Gacono, Loving, and Bodholdt; Ganellen; and Bornstein. J Pers Assess 2001; 77:48-70. [PMID: 11562104 DOI: 10.1207/s15327752jpa7701_04] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
Abstract
The Comprehensive System (CS; Exner, 1991, 1993) for the Rorschach is currently engulfed in controversy. This comment article responds to 3 articles by Rorschach proponents in this issue of the Journal of Personality Assessment. Contrary to the claims of Gacono, Loving, and Bodholdt (this issue), CS scores do not bear a well-demonstrated relationship to psychopathy, antisocial personality disorder, or conduct disorder. Contrary to the claims of Ganellen (this issue), both the original and the revised CS Depression Index (Exner, 1993) bear little or no relationship to depression diagnoses. Furthermore, the scoring reliability of some CS scores is problematic. Although we agree with Bornstein (this issue) that Rorschach scores generally bear little or no relation to psychiatric diagnoses or self-report questionnaires, we believe this lack of relationship tends to disconfirm hypotheses concerning the validity of the Rorschach. In the spirit of the philosopher Sir Karl Popper, the Rorschach community should not minimize negative evidence or engage in post hoc arguments to immunize the CS against falsification.
Collapse
Affiliation(s)
- J M Wood
- Department of Psychology, University of Texas at El Paso, 79968, USA.
| | | | | | | |
Collapse
|
15
|
|
16
|
Advancing the science of psychological assessment: The Rorschach Inkblot Method as exemplar. Psychol Assess 2001. [DOI: 10.1037/1040-3590.13.4.423] [Citation(s) in RCA: 44] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
17
|
Wood JM, Lilienfeld SO, Garb HN, Nezworski MT. Limitations of the Rorschach as a diagnostic tool: A reply to Garfield (2000), Lerner (2000), and Weiner (2000). J Clin Psychol 2000; 56:441-8. [PMID: 10798912 DOI: 10.1002/(sici)1097-4679(200003)56:3<441::aid-jclp19>3.0.co;2-q] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
18
|
Wood JM, Lilienfeld SO, Garb HN, Nezworski MT. The Rorschach test in clinical diagnosis: a critical review, with a backward look at Garfield (1947). J Clin Psychol 2000; 56:395-430; discussion 431-4. [PMID: 10726675 DOI: 10.1002/(sici)1097-4679(200003)56:3<395::aid-jclp15>3.0.co;2-o] [Citation(s) in RCA: 76] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
The present article comments on a classic study by Garfield (1947) then reviews research on the Rorschach and psychiatric diagnoses. Despite a few positive findings, the Rorschach has demonstrated little validity as a diagnostic tool. Deviant verbalizations and bad form on the Rorschach, and indices based on these variables, are related to Schizophrenia and perhaps to Bipolar Disorder and Schizotypal Personality Disorder. Patients with Borderline Personality Disorder also seem to give an above-average number of deviant verbalizations. Otherwise the Rorschach has not shown a well-demonstrated relationship to these disorders or to Major Depressive Disorder, Posttraumatic Stress Disorder (PTSD), anxiety disorders other than PTSD, Dissociative Identity Disorder, Dependent, Narcissistic, or Antisocial Personality Disorders, Conduct Disorder, or psychopathy.
Collapse
Affiliation(s)
- J M Wood
- Department of Psychology, University of Texas at El Paso, 79968, USA.
| | | | | | | |
Collapse
|
19
|
Acklin MW, McDowell CJ, Verschell MS, Chan D. Interobserver agreement, intraobserver reliability, and the Rorschach Comprehensive System. J Pers Assess 2000; 74:15-47. [PMID: 10779931 DOI: 10.1207/s15327752jpa740103] [Citation(s) in RCA: 64] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
Abstract
Interrater agreement and reliability for the Rorschach have recently come under increasing scrutiny. This is the second report examining methods of Comprehensive System reliability using principles derived from observational methodology and applied behavioral analysis. This study examined a previous nonpatient sample of 20 protocols (N = 412 responses) and also examined a new clinical sample of 20 protocols (N = 374 responses) diagnosed with Research Diagnostic Criteria. Reliability was analyzed at multiple levels of Comprehensive System data, including response-level individual codes and coding decisions and ratios, percentages, and derivations from the Structural Summary. With a number of exceptions, most Comprehensive System codes, coding decisions, and summary scores yield acceptable, and in many instances excellent, levels of reliability. Limitations arising from the nature of Rorschach data and Comprehensive System coding criteria are discussed.
Collapse
|
20
|
Meyer GJ. Construct Validation of Scales Derived From the Rorschach Method: A Review of issues and Introduction to the Rorschach Rating Scale. J Pers Assess 1996; 67:598-628. [PMID: 16367677 DOI: 10.1207/s15327752jpa6703_14] [Citation(s) in RCA: 18] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
Abstract
I suggest the main goal of Rorschach validation should be a refined understanding of what each score means. Toward this end, I review general issues in construct validity, hurdles unique to the Rorschach, and general limitations with validation criteria. I then recommend two approaches for improving criteria so they can begin approximating the gold standards that are necessary for a refined understanding of what scores actually measure. The first is a method for improving expert clinical judgment, and the second is a method for aggregating data across diverse judges. Finally, the Rorschach Rating Scale (RRS) is presented as a criterion tool to be used with either of these approaches to validation. The RRS is a fairly comprehensive summary of the constructs thought to be measured by various Rorschach scoring systems. The utility of the RRS for research and training are discussed, as are other practical, theoretical, and psychometric issues in its application.
Collapse
|