Reliability and Validity of the Social Cognition and Object Relations Scale (SCORS) in the Assessment of Dream Narratives

In this study, we aimed to investigate the application of an externally rated measure of interpersonal representations (Social Cognition and Object Relations Scale [SCORS]; Westen, 1995) to dream narratives. A total of 80 student participants enrolled at a private university in the New York City metropolitan area completed a Dream Log and affect adjective checklist (Wellman, 2002) based on a recalled dream at both 1 month and 3 months following the September 11, 2001, terrorist attacks. Using the dreams provided in this study we examined the interrater reliability of SCORS ratings, the relationship of SCORS variables to an independently rated measure of dream distortion, and the relationship of SCORS variables to participants' own ratings of dream affect. Results indicated that dreams were reliably rated using the SCORS, 3 cognitive SCORS variables were significantly related to dream distortion, and affective SCORS variables were meaningfully related to participants' own ratings of affect in their dreams. Findings from this study provide support for the application of SCORS ratings to dream narratives. We discuss implications for further research and clinical application.

The capacity for dynamic process scale (CDPS) and patient engagement in opiate addiction treatment

This study examined the relationship between continuation in an opiate treatment program and patient characteristics such as affect regulation, insight, and capacity for interpersonal relations. Participants consisted of 63 patients randomly selected from those completing an initial interview at a short-term heroin detoxification program. Patient characteristics were assessed using the Capacity for Dynamic Process Scale (CDPS). Results of this study indicated that the CDPS total score for each patient was related to the subsequent number of treatment sessions attended by that patient and significantly differentiated dropouts from completers. These findings support previous use of the CDPS in psychotherapy research. In addition, this study extends use of the CDPS to research on brief pharmacotherapy treatment of opiate addiction.

Childhood sexual abuse and adult defensive functioning

Differences in defensive functioning between those who reported a history of childhood sexual abuse (CSA) and those who did not was examined in a naturalistic treatment-seeking sample of adult outpatients (N = 67). Defensive functioning and childhood sexual abuse history were rated by clinicians and external raters utilizing the DSM-IV Defensive Functioning Scale and the Abuse Dimensions Inventory, respectively, based on information gathered as part of a larger therapeutic assessment. Individuals reporting a history of CSA were found to use more major image-distorting level defenses than the non-CSA group, and abuse severity was also related to greater use of major image-distorting level defenses. Those reporting a history of CSA relied more on defenses indicative of impairment in realistic perception of self and others. This defensive style likely contributes to the greater difficulties in interpersonal functioning and psychological problems in adulthood.

Clinical utility of the Defensive Functioning Scale in the assessment of depression

The Defensive Functioning Scale (DFS) and Overall Defensive Functioning score (ODF) have been used as reliable and valid measures of defense structure when applied to clinical narratives. This study aims to replicate and extend positive clinical validity data for the ODF in the assessment of depression and examine the relationship between specific defense levels of the DFS and depressive symptoms. Sixty-nine outpatients who completed the Symptom Checklist 90-Revised and Personality Assessment Inventory were rated on the DFS by trained clinicians. Lower (more maladaptive) scores on the ODF were significantly related to the presence and severity of patient-reported depression symptoms. Furthermore, depression symptoms were significantly related to both the presence of low-level action defenses and an absence of higher-range defenses in the mental inhibitions-obsessional level. Findings from this study provide further support for the clinical application and relevance of the DFS system; support the theory of defensive processes falling into a hierarchy of adaptive functioning; and, because of a naturalistic setting, are highly generalizable to real-world practice.

The Development of Therapeutic Alliance During Psychological Assessment: Patient and Therapist Perspectives Across Treatment

We examined the impact of patient- and therapist-rated alliance developed during psychological assessment on the subsequent alliance measured early and late in formal psychotherapy. We hypothesized that a working alliance developed during psychological assessment conducted from a collaborative therapeutic model of assessment (TMA; Finn & Tonsager, 1992, 1997; Fischer, 1994) between the patient and therapist would carry into formal psychotherapy. We also hypothesized that alliance for those patients receiving a TMA would be significantly greater than patients receiving psychological testing as usual. To test this hypothesis, we administered the Combined Alliance Short Form-Patient Version (Hatcher & Barends, 1996) and the Combined Alliance Short Form-Therapist Version (Hatcher, 1999) to a sample of outpatients and their therapists at the end of the assessment feedback session, early, and late in psychotherapy. The hypotheses were supported as alliance scales rated at the assessment feedback session demonstrated positive and significant relationships with alliance throughout formal psychotherapy and in relation to a control group. The clinical utility and research implications of these findings are discussed.

A Consideration of Challenges to Psychological Assessment Instruments Used in Forensic Settings: Rorschach As Exemplar

In this brief primer, we provide an outline of key issues that will help psychologists organize and prepare their expert testimony. These issues include the need to obtain essential sources of research, a review of the actual legal standards regarding admissibility of test data in expert testimony, the nature of the expert relative to the assessment instrument in expert testimony, the nature of legal versus scientific debate, and the examination of appropriate qualifications of expertise when offering legal testimony. In addition, we use a summary of information contained in several recent articles to address challenges directed against forensic psychological testing. We use the empirical literature on the Rorschach as an exemplar in discussing these issues, as the admissibility of the Rorschach in particular has been challenged, and the issues frequently focused on with the Rorschach are equally applicable to other psychological measures. In this article, we provide essential sources of Rorschach research regarding several empirical studies that summarize important information and directly address previous criticisms of the measure.

Multimethod Validity Assessment of the SWAP-200 Dysphoric Q-Factor

The aim of this study was to investigate the convergent validity of the Shedler-Westen Assessment Procedure Q-Sort Dysphoric Q-Factor with scales from the therapist, the patient, and independent observers. Therapists used the Shedler-Westen Assessment Procedure Q-Sort to describe their patients after the therapeutic assessment and the first two therapy sessions (when available). Independent observers completed a number of symptom distress, global functioning, and Axis II psychopathology measures after watching videotapes of the therapeutic assessment. They also completed a measure of social cognition and object relations after watching videotape of the therapeutic assessment and the first two therapy sessions (when available). Patients completed measures of symptomatology and personality assessment. Results indicated several significant correlations between the Dysphoric Q-Factor and a number of the clinician ratings of depressive symptomatology. In addition, three clinician ratings (Personality Disorder Index, Global Assessment of Functioning scale, and the experience and management of aggressive impulses variable of the Social Cognition and Object Relations Scale) demonstrated unique and nonredundant predictive ability in accounting for the variance of the Dysphoric Q-Factor. The patient self-report measures, however, did not correlate significantly with the Dysphoric Q-Factor, although several correlations demonstrated trends toward statistical significance.

DSM-IV Major Depressive Episode criteria: An evaluation of reliability and validity across three different rating methods

This study examined the reliability and validity of the DSM-IV Major Depressive Episode (MDE) symptoms in a sample of outpatients based on clinician ratings of assessment interviews, videotape of these interviews, and chart information. A group of 44 patients admitted to a university based outpatient community clinic were rated by trained clinicians on the nine MDE symptom criteria (A1-A9). Patients also completed a self-report measure of depressive symptomatology. Interrater reliability was found to be highest between the interview and videotape ratings. Conversely, when comparing chart ratings with those made from either interview or videotape, reliability for many of the individual criteria were found to be in the poor range of reliability. Good internal consistency was found for both the interview and videotape ratings, while internal consistency was less adequate for chart-based ratings. However, the three MDE ratings converge on a single dimension in a similar manner regardless of which source (i.e. interview, videotape, or chart) provided the rating. Additional analyses revealed a consistent relationship between the three MDE ratings (interview, videotape, and chart) with measures of patient reported depressive symptoms that exceeded the relationship between these scores with global levels/severity of psychopathology. The effects of longer interviews as well as examining depressive symptoms within the context of interpersonal functioning is discussed regarding the reliable assessment of depressive symptomatology in the mild to moderate range of severity. (Int J Psych Can Pract 2004; 8: 3-10).

Further reliability, convergent and discriminant validity of overall defensive functioning

The reliability, convergent and discriminant validity of the Defensive Functioning Scale (DFS) and the overall defensive functioning score (ODF) has been previously examined. This study aims to address gaps in the literature as well as to replicate and extend the initial positive clinical validity data emerging on the DFS ( Blais et al., 1996; Hoglend and Perry, 1998; Lingiardi et al., 1999; Perry 2001; Perry and Hoglend, 1998; Perry et al., 1998). Fifty-three outpatient clients were rated by clinicians trained on the DFS. The relationship between the ODF with both clinician-rated and self-report measures of psychopathology was examined. The mean interrater reliability for the DFS levels rated in this study was found to be moderate to high, and reliability for the ODF score was found to be excellent. Coefficient alpha of individual defense levels as well as across the entire DFS indicated high levels of internal consistency. Factor analysis revealed that the ODF represents a construct different from various aspects of patient self-report and clinician ratings of psychopathology. These results provide further support for the clinical application and relevance of the DFS system.

Assessment of patient and therapist perspectives of process: a revision of the Vanderbilt Psychotherapy Process Scale

The present study was designed to revise the Vanderbilt Psychotherapy Process Scale (VPPS), an external-rater completed measure, into both patient and therapist-rated versions. The VPPS was altered into two versions by using simple pronoun changes and then submitted to a principal components analysis in order to identify component factors. This procedure resulted in two identical forms of the VPPS, one completed by the therapist (VPPS-T) and one completed by patients (VPPS-P). These scales have identical items and factor structures. Preliminary results suggest that the VPPS-P and VPPS-T may be useful measures of psychotherapy process when perspectives of session activity is desired from both patients and therapists.

Short-term psychodynamic psychotherapy for depression: an examination of statistical, clinically significant, and technique-specific change

This study investigates the effectiveness of short-term psychodynamic psychotherapy (STPP) for depression in a naturalistic setting utilizing a hybrid effectiveness/efficacy treatment research model. Twenty-one patients were assessed pre- and post-treatment through clinician ratings and patient self-report on scales representing specific DSM-IV depressive, global symptomatology, relational, social, and occupational functioning. Treatment credibility, fidelity, and satisfaction were examined, all of which were found to be high. All areas of functioning assessed exhibited significant and positive changes. These adaptive changes in functioning demonstrated large statistical effects. Likewise, changes in depressive symptoms evaluated at the patient level utilizing clinical significance methodology were found to be high. A significant direct process/outcome link between STPP therapist techniques and changes in depressive symptoms was observed. Alternative treatment interventions within STPP were evaluated in relation to subsequent improvements in depression and were found to be nonsignificant. The present results demonstrate that robust statistical and clinically significant improvement can occur in a naturalistic/hybrid model of outpatient STPP for depression.

Four studies extending the utility of the Schwartz Outcome Scale (SOS-10)

The Schwartz Outcome Scale (SOS-10; Blais et al., 1999) is a brief, cost free, and easy to administer assessment device designed to measure a broad domain of psychological health. The 4 studies using the SOS-10 reported here extend the initial reliability and validity studies beyond psychiatric patients in a hospital setting to examine (a) test-retest reliability in a college student population, (b) concurrent validity with college students using an indirect technique assessing maladjustment, (c) concurrent validity with college counseling center clients using a self-report measure of client distress, and (d) sensitivity to treatment changes with outpatient clients. These studies lend further support for using the SOS-10 as a measure of psychological well-being and as an outcome measure in varied settings.

Psychological assessment of adult survivors of childhood sexual abuse within a naturalistic clinical sample

This study investigates the long-term effects of childhood sexual abuse (CSA). Differences between abused and nonabused individuals in psychiatric symptomatology, interpersonal functioning, social and occupational functioning, personality dynamics, and therapeutic alliance were examined. The relationship between abuse severity and long-term effects was also analyzed. Data were gathered from 51 patients seeking individual psychotherapy at a community outpatient clinic. Findings suggested that CSA survivors tend to experience greater psychiatric distress and poorer interpersonal functioning than nonabused clinical controls. No significant differences were found in social and occupational functioning or in alliance developed by the end of the therapeutic assessment process. Abuse severity was significantly related to increased symptomatology and poorer interpersonal functioning. Findings support and extend existing literature and are especially useful for clinicians working with abuse survivors.