1
|
Greene T, Sznitman S, Contractor AA, Prakash K, Fried EI, Gelkopf M. The memory-experience gap for PTSD symptoms: The correspondence between experience sampling and past month retrospective reports of traumatic stress symptoms. Psychiatry Res 2022; 307:114315. [PMID: 34896842 DOI: 10.1016/j.psychres.2021.114315] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/12/2021] [Revised: 11/14/2021] [Accepted: 11/25/2021] [Indexed: 11/25/2022]
Abstract
Posttraumatic stress disorder assessments typically require individuals to provide an aggregate report on the frequency or severity of symptoms they have experienced over a particular time period. Yet retrospective aggregate assessments are susceptible to memory recall and retrieval difficulties. This study examined the correspondence between a month of real-time experience sampling methodology (ESM) reports of traumatic stress symptoms and a retrospective assessment of past-month traumatic stress symptoms for that same period. Participants were a convenience community sample (n=96) from Southern and Central Israel exposed to rocket fire during the Israel-Gaza July-Aug 2014 conflict. Participants provided ESM reports on traumatic stress symptoms twice a day for 30 days via smartphone. Average ESM scores, rather than peak or most recent reports, were most highly correlated with retrospective assessments. For individual symptoms, concentration difficulties had the highest correspondence between ESM and retrospective reports, while amnesia had the lowest correspondence. Regression analysis found that average ESM scores and younger age significantly predicted past-month retrospective assessments of PTSD symptoms. Additionally, previously experiencing more types of trauma predicted PTSD symptoms, but did not moderate the relationship between ESM and retrospective assessments. These findings have implications for assessment.
Collapse
Affiliation(s)
- Talya Greene
- Department of Community Mental Health, University of Haifa, Israel; Division of Psychiatry, University College London, UK.
| | | | | | | | - Eiko I Fried
- Department of Clinical Psychology, Leiden University, The Netherlands
| | - Marc Gelkopf
- Department of Community Mental Health, University of Haifa, Israel
| |
Collapse
|
2
|
Leertouwer IJ, Cramer AOJ, Vermunt JK, Schuurman NK. A Review of Explicit and Implicit Assumptions When Providing Personalized Feedback Based on Self-Report EMA Data. Front Psychol 2021; 12:764526. [PMID: 34955984 PMCID: PMC8693716 DOI: 10.3389/fpsyg.2021.764526] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Accepted: 10/15/2021] [Indexed: 11/30/2022] Open
Abstract
Ecological Momentary Assessment (EMA) in which participants report on their moment-to-moment experiences in their natural environment, is a hot topic. An emerging field in clinical psychology based on either EMA, or what we term Ecological Retrospective Assessment (ERA) as it requires retrospectivity, is the field of personalized feedback. In this field, EMA/ERA-data-driven summaries are presented to participants with the goal of promoting their insight in their experiences. Underlying this procedure are some fundamental assumptions about (i) the relation between true moment-to-moment experiences and retrospective evaluations of those experiences, (ii) the translation of these experiences and evaluations to different types of data, (iii) the comparison of these different types of data, and (iv) the impact of a summary of moment-to-moment experiences on retrospective evaluations of those experiences. We argue that these assumptions deserve further exploration, in order to create a strong evidence-based foundation for the personalized feedback procedure.
Collapse
Affiliation(s)
- IJsbrand Leertouwer
- Department of Methodology and Statistics, Tilburg University, Tilburg, Netherlands
| | - Angélique O J Cramer
- Department of Methodology and Statistics, Tilburg University, Tilburg, Netherlands
| | - Jeroen K Vermunt
- Department of Methodology and Statistics, Tilburg University, Tilburg, Netherlands
| | - Noémi K Schuurman
- Department of Methodology and Statistics, Utrecht University, Utrecht, Netherlands
| |
Collapse
|
3
|
Hader S, Kratz O, Eichler A, Moll GH, Irlbauer-Müller V. [Sleep behavior and problems in children and adolescents of a psychiatric day clinic sample: results and requirements for systematic diagnostic]. ZEITSCHRIFT FUR KINDER-UND JUGENDPSYCHIATRIE UND PSYCHOTHERAPIE 2021; 49:387-400. [PMID: 34238031 DOI: 10.1024/1422-4917/a000815] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
Sleep behavior and problems in children and adolescents of a psychiatric day clinic sample: results and requirements for systematic diagnostic Abstract. Sleep disorders are common in adults as well as children and adolescents. Children and adolescents in psychiatric treatment (CAP) are especially affected by sleep problems. Cognitive behavioral therapy represents the first-line treatment, preceded by a standardized procedure for sleep diagnostics. To date, no study has investigated sleep behavior in CAP day clinics in Germany. In this study, N = 46 children/adolescents receiving CAP treatment in a day clinic completed a sleep diary (7 days) and a sleep anamnesis scheme with the help of their parents, and their sleep behavior was assessed by a clinician. Furthermore, a parent- and a self-report questionnaire plus a clinical assessment of the mental disorders in the children/adolescents were collected. 52 % of the children/ adolescents exhibited sleep disorders or sleep abnormalities (= sleep disorder symptoms in the context of comorbid disorders), in particular problems falling asleep or to falling asleep and sleeping through the night (26 %). In addition, 33 % reported having nightmares. Their sleep behavior correlated significantly with their external behavior problems (r = .38 .61, p = .02-.04); their sex (female: p = .01-≤ .001, |d| = 1.57-2.50) and their age (older: p = .05, |d| = .78) also significantly influenced sleep behavior. Particularly external behavior problems were associated with sleep problems in this day-care population. In summary, a multi-method-multi-informant procedure should be established for the systematic diagnostics of sleep abnormalities, together with individualized cognitive-behavioral therapy of sleep problems, especially in patients with external behavior problems.
Collapse
Affiliation(s)
- Saskia Hader
- Kinder- und Jugendabteilung für Psychische Gesundheit, Universitätsklinikum Erlangen
| | - Oliver Kratz
- Kinder- und Jugendabteilung für Psychische Gesundheit, Universitätsklinikum Erlangen
| | - Anna Eichler
- Kinder- und Jugendabteilung für Psychische Gesundheit, Universitätsklinikum Erlangen
| | - Gunther H Moll
- Kinder- und Jugendabteilung für Psychische Gesundheit, Universitätsklinikum Erlangen
| | | |
Collapse
|
4
|
Mneimne M, Furr RM, Mendygal D, Law MK, Arnold EM, Fleeson W. Degree of Correspondence Between Retrospective and Proximal Reports of Borderline Personality Disorder Symptoms, Symptom Triggers, and Emotions. J Pers Disord 2021; 35:1-20. [PMID: 30920939 PMCID: PMC10901452 DOI: 10.1521/pedi_2019_33_418] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
This study investigated the degree of correspondence of retrospective reports of personality disorder symptoms, triggers, and emotions with reports closer in time to the actual experiences. Retrospective reports of symptoms, triggers, and emotions are heavily used in both clinical and research settings, yet no study has investigated the correspondence for symptoms or triggers of personality disorders. A total of 257 participants, including 75 with BPD, completed overlapping daily, weekly, monthly, and semi-annual questionnaires. Retrospective reports showed: (1) systematic biases, reporting fewer symptom and situational trigger occurrences, and greater emotion intensities; but (2) little unsystematic error, largely reproducing bias-adjusted individual levels of symptoms, situational triggers, and emotions (rs generally .70-.80). People with BPD did not retrospectively misremember their symptoms, triggers, or emotions much more than others. Thus, retrospective reports of symptoms, triggers, and emotions should be adjusted for systematic bias, but after such adjustment can be taken as relatively faithful accounts of individuals' experiences.
Collapse
|
5
|
Rinner MTB, Meyer AH, Mikoteit T, Hoyer J, Imboden C, Hatzinger M, Bader K, Lieb R, Miché M, Wersebe H, Gloster AT. General or specific? The memory-experience gap for individuals diagnosed with a major depressive disorder or a social phobia diagnosis, and individuals without such diagnoses. Memory 2019; 27:1194-1203. [PMID: 31311430 DOI: 10.1080/09658211.2019.1640252] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
Psychological treatment and assessment necessarily rely on patients' recall. Yet several empirical studies have documented a gap between memory and real-life experience (i.e., memory-experience gap; MeG). We investigated and compared the MeG of sadness, social anxiety, happiness, and physical activity for participants diagnosed with a major depressive disorder (MDD), a social phobia (SP), and participants without such diagnoses (CG). The study included 118 participants diagnosed with a MDD, 47 with a SP, and 119 CG. Using event-sampling methods (ESM), participants were asked via smartphone to report their experiences throughout a week and then to recall those again retrospectively at the end of the study week. Results indicate significant differences in the MeG with respect to the experience that was salient to them (e.g., MDD group - sadness; SP group - social anxiety; CG group - happiness). Furthermore, all groups showed a MeG for physical activity and, the results indicate significant group differences in the magnitude of the MeGs. This study demonstrated the presence of a MeG in individuals in a MDD, SP, and CG group and in positive and negative affective experiences. Differential patterns across the samples contribute to a better understanding of this gap and its implications.
Collapse
Affiliation(s)
- Marcia T B Rinner
- a Division of Clinical Psychology and Intervention Science, Department of Psychology, University of Basel , Basel , Switzerland.,b Psychiatric University Clinics UPK , Basel , Switzerland
| | - Andrea H Meyer
- c Division of Clinical Psychology and Epidemiology, Department of Psychology, University of Basel , Basel , Switzerland
| | - Thorsten Mikoteit
- d Centre for Affective, Stress and Sleep Disorders, Psychiatric Hospital, University of Basel , Basel , Switzerland
| | - Jürgen Hoyer
- e Institute of Clinical Psychology and Psychotherapy, Technische Universität Dresden , Dresden , Germany
| | - Christian Imboden
- f Psychiatric Services Solothurn, Solothurn & University of Basel , Basel , Switzerland.,g Private Clinic Wyss , Muenchenbuchsee , Switzerland
| | - Martin Hatzinger
- f Psychiatric Services Solothurn, Solothurn & University of Basel , Basel , Switzerland
| | - Klaus Bader
- b Psychiatric University Clinics UPK , Basel , Switzerland
| | - Roselind Lieb
- c Division of Clinical Psychology and Epidemiology, Department of Psychology, University of Basel , Basel , Switzerland
| | - Marcel Miché
- c Division of Clinical Psychology and Epidemiology, Department of Psychology, University of Basel , Basel , Switzerland
| | - Hanna Wersebe
- c Division of Clinical Psychology and Epidemiology, Department of Psychology, University of Basel , Basel , Switzerland
| | - Andrew T Gloster
- a Division of Clinical Psychology and Intervention Science, Department of Psychology, University of Basel , Basel , Switzerland.,c Division of Clinical Psychology and Epidemiology, Department of Psychology, University of Basel , Basel , Switzerland
| |
Collapse
|
6
|
Campbell SB, Krenek M, Simpson TL. The Role of Patient Characteristics in the Concordance of Daily and Retrospective Reports of PTSD. Behav Ther 2017; 48:448-461. [PMID: 28577582 PMCID: PMC5458524 DOI: 10.1016/j.beth.2017.01.003] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/01/2016] [Revised: 01/07/2017] [Accepted: 01/09/2017] [Indexed: 11/19/2022]
Abstract
Research has documented discrepancies between daily and retrospective reports of psychological symptoms in a variety of conditions. A limited number of studies have assessed these discrepancies in samples of individuals with posttraumatic stress disorder (PTSD), with even less research addressing potential covariates that may influence such discrepancies. In the current study, 65 individuals with co-occurring PTSD and alcohol use disorder (AUD) completed daily assessments of their PTSD symptoms for 1 month, followed by a standard retrospective report of PTSD over the same month. Initial analyses explored the mean levels of daily and retrospective PTSD symptoms, while multilevel models assessed the level of agreement between daily and retrospective reports and the role of demographic variables and comorbid psychopathology (e.g., depression) or substance use (e.g., alcohol use) in moderating the association of daily and retrospective reports. Results showed that retrospective reports of arousal and avoidance symptoms were weakly related to daily reports of these symptoms, while reports of reexperiencing and numbing symptoms showed better agreement. Intra-individual alcohol consumption also moderated associations of reexperiencing and avoidance symptoms, such that on days individuals drank more, their daily reports resembled their retrospective reports less well. Future research should explore the degree to which these results generalize to nondually diagnosed samples, as well as the role such reporting discrepancies may play in PTSD treatment.
Collapse
Affiliation(s)
- Sarah B Campbell
- VA Puget Sound Health Care System, Seattle Division; George Mason University.
| | - Marketa Krenek
- VA Puget Sound Health Care System, Seattle Division; Mental Illness Research, Education, and Clinical Center, VA Puget Sound Health Care System
| | - Tracy L Simpson
- VA Puget Sound Health Care System, Seattle Division; Mental Illness Research, Education, and Clinical Center, VA Puget Sound Health Care System; Center of Excellence in Substance Abuse Treatment and Education, VA Puget Sound Health Care System; University of Washington, Seattle
| |
Collapse
|
7
|
Gloster AT, Meyer AH, Witthauer C, Lieb R, Mata J. 'I feel better when…': An analysis of the memory-experience gap for peoples' estimates of the relationship between health behaviours and experiences. Psychol Health 2017; 32:1152-1166. [PMID: 28498009 DOI: 10.1080/08870446.2017.1327586] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
OBJECTIVE People often overestimate how strongly behaviours and experiences are related. This memory-experience gap might have important implications for health care settings, which often require people to estimate associations, such as "my mood is better when I exercise". This study examines how subjective correlation estimates between health behaviours and experiences relate to calculated correlations from online reports and whether subjective estimates are associated with engagement in actual health behaviour. DESIGN Seven-month online study on physical activity, sleep, affect and stress, with 61 online assessments. MAIN OUTCOME MEASURES University students (N = 168) retrospectively estimated correlations between physical activity, sleep, positive affect and stress over the seven-month study period. RESULTS Correlations between experiences and behaviours (online data) were small (r = -.12-.14), estimated correlations moderate (r = -.35-.24). Correspondence between calculated and estimated correlations was low. Importantly, estimated correlations of physical activity with stress, positive affect and sleep were associated with actual engagement in physical activity. CONCLUSION Estimation accuracy of relations between health behaviours and experiences is low. However, association estimates could be an important predictor of actual health behaviours. This study identifies and quantifies estimation inaccuracies in health behaviours and points towards potential systematic biases in health settings, which might seriously impair intervention efficacy.
Collapse
Affiliation(s)
- Andrew T Gloster
- a Division of Clinical Psychology and Epidemiology, Department of Psychology , University of Basel , Basel , Switzerland.,b Division of Clinical Psychology and Intervention Science, Department of Psychology , University of Basel , Basel , Switzerland
| | - Andrea H Meyer
- a Division of Clinical Psychology and Epidemiology, Department of Psychology , University of Basel , Basel , Switzerland
| | - Cornelia Witthauer
- a Division of Clinical Psychology and Epidemiology, Department of Psychology , University of Basel , Basel , Switzerland
| | - Roselind Lieb
- a Division of Clinical Psychology and Epidemiology, Department of Psychology , University of Basel , Basel , Switzerland
| | - Jutta Mata
- a Division of Clinical Psychology and Epidemiology, Department of Psychology , University of Basel , Basel , Switzerland.,c Division of Health Psychology, Department of Psychology , University of Mannheim , Mannheim , Germany
| |
Collapse
|
8
|
Ben-Zeev D, Scherer EA, Wang R, Xie H, Campbell AT. Next-generation psychiatric assessment: Using smartphone sensors to monitor behavior and mental health. Psychiatr Rehabil J 2015; 38:218-226. [PMID: 25844912 PMCID: PMC4564327 DOI: 10.1037/prj0000130] [Citation(s) in RCA: 169] [Impact Index Per Article: 16.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
Abstract
OBJECTIVE Optimal mental health care is dependent upon sensitive and early detection of mental health problems. We have introduced a state-of-the-art method for the current study for remote behavioral monitoring that transports assessment out of the clinic and into the environments in which individuals negotiate their daily lives. The objective of this study was to examine whether the information captured with multimodal smartphone sensors can serve as behavioral markers for one's mental health. We hypothesized that (a) unobtrusively collected smartphone sensor data would be associated with individuals' daily levels of stress, and (b) sensor data would be associated with changes in depression, stress, and subjective loneliness over time. METHOD A total of 47 young adults (age range: 19-30 years) were recruited for the study. Individuals were enrolled as a single cohort and participated in the study over a 10-week period. Participants were provided with smartphones embedded with a range of sensors and software that enabled continuous tracking of their geospatial activity (using the Global Positioning System and wireless fidelity), kinesthetic activity (using multiaxial accelerometers), sleep duration (modeled using device-usage data, accelerometer inferences, ambient sound features, and ambient light levels), and time spent proximal to human speech (i.e., speech duration using microphone and speech detection algorithms). Participants completed daily ratings of stress, as well as pre- and postmeasures of depression (Patient Health Questionnaire-9; Spitzer, Kroenke, & Williams, 1999), stress (Perceived Stress Scale; Cohen et al., 1983), and loneliness (Revised UCLA Loneliness Scale; Russell, Peplau, & Cutrona, 1980). RESULTS Mixed-effects linear modeling showed that sensor-derived geospatial activity (p < .05), sleep duration (p < .05), and variability in geospatial activity (p < .05), were associated with daily stress levels. Penalized functional regression showed associations between changes in depression and sensor-derived speech duration (p < .05), geospatial activity (p < .05), and sleep duration (p < .05). Changes in loneliness were associated with sensor-derived kinesthetic activity (p < .01). CONCLUSIONS AND IMPLICATIONS FOR PRACTICE Smartphones can be harnessed as instruments for unobtrusive monitoring of several behavioral indicators of mental health. Creative leveraging of smartphone sensing could provide novel opportunities for close-to-invisible psychiatric assessment at a scale and efficiency that far exceeds what is currently feasible with existing assessment technologies.
Collapse
Affiliation(s)
- Dror Ben-Zeev
- Dartmouth Psychiatric Research Center, Department of Psychiatry, Geisel School of Medicine at Dartmouth
| | - Emily A. Scherer
- Division of Biostatistics, Department of Community and Family Medicine, Geisel School of Medicine at Dartmouth
| | - Rui Wang
- Department of Computer Science, Dartmouth College
| | - Haiyi Xie
- Dartmouth Psychiatric Research Center, Department of Psychiatry, Geisel School of Medicine at Dartmouth
| | | |
Collapse
|
9
|
Tilley PJM, Rees CS. A clinical case study of the use of ecological momentary assessment in obsessive compulsive disorder. Front Psychol 2014; 5:339. [PMID: 24860521 PMCID: PMC4029001 DOI: 10.3389/fpsyg.2014.00339] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2014] [Accepted: 04/01/2014] [Indexed: 11/26/2022] Open
Abstract
Accurate assessment of obsessions and compulsions is a crucial step in treatment planning for Obsessive-Compulsive Disorder (OCD). In this clinical case study, we sought to determine if the use of Ecological Momentary Assessment (EMA) could provide additional symptom information beyond that captured during standard assessment of OCD. We studied three adults diagnosed with OCD and compared the number and types of obsessions and compulsions captured using the Yale-Brown Obsessive-Compulsive Scale (Y-BOCS) compared to EMA. Following completion of the Y-BOCS interview, participants then recorded their OCD symptoms into a digital voice recorder across a 12-h period in reply to randomly sent mobile phone SMS prompts. The EMA approach yielded a lower number of symptoms of obsessions and compulsions than the Y-BOCS but produced additional types of obsessions and compulsions not previously identified by the Y-BOCS. We conclude that the EMA-OCD procedure may represent a worthy addition to the suite of assessment tools used when working with clients who have OCD. Further research with larger samples is required to strengthen this conclusion.
Collapse
Affiliation(s)
- P J Matt Tilley
- Brain, Behaviour and Mental Health Research Group, School of Psychology and Speech Pathology, Curtin University Perth, WA, Australia
| | - Clare S Rees
- Brain, Behaviour and Mental Health Research Group, School of Psychology and Speech Pathology, Curtin University Perth, WA, Australia
| |
Collapse
|
10
|
Rate of improvement during and across three treatments for panic disorder with or without agoraphobia: cognitive behavioral therapy, selective serotonin reuptake inhibitor or both combined. J Affect Disord 2013; 150:313-9. [PMID: 23676529 DOI: 10.1016/j.jad.2013.04.012] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/28/2012] [Revised: 03/13/2013] [Accepted: 04/13/2013] [Indexed: 11/21/2022]
Abstract
BACKGROUND Existing literature on panic disorder (PD) yields no data regarding the differential rates of improvement during Cognitive Behavioral Therapy (CBT), Selective Serotonin Reuptake Inhibitor (SSRI) or both combined (CBT+SSRI). METHOD Patients were randomized to CBT, SSRI or CBT+SSRI which each lasted one year including three months of medication taper. Participating patients kept record of the frequency of panic attacks throughout the full year of treatment. Rate of improvement on panic frequency and the relationship between rate of improvement and baseline agoraphobia (AG) were examined. RESULTS A significant decline in frequency of panic attacks was observed for each treatment modality. SSRI and CBT+SSRI were associated with a significant faster rate of improvement as compared to CBT. Gains were maintained after tapering medication. For patients with moderate or severe AG, CBT+SSRI was associated with a more rapid improvement on panic frequency as compared to patients receiving either mono-treatment. LIMITATIONS Frequency of panic attacks was not assessed beyond the full year of treatment. Second, only one process variable was used. CONCLUSIONS Patients with PD respond well to each treatment as indicated by a significant decline in panic attacks. CBT is associated with a slower rate of improvement as compared to SSRI and CBT+SSRI. Discontinuation of SSRI treatment does not result in a revival of frequency of panic attacks. Our data suggest that for patients without or with only mild AG, SSRI-only will suffice. For patients with moderate or severe AG, the combined CBT+SSRI treatment is recommended.
Collapse
|
11
|
Pfaltz MC, Michael T, Meyer AH, Wilhelm FH. Reexperiencing symptoms, dissociation, and avoidance behaviors in daily life of patients with PTSD and patients with panic disorder with agoraphobia. J Trauma Stress 2013; 26:443-50. [PMID: 23893375 DOI: 10.1002/jts.21822] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Panic attacks are frequently perceived as life threatening. Panic disorder (PD) patients may therefore experience symptoms of posttraumatic stress disorder (PTSD). The authors explored this in 28 healthy controls, 17 PTSD patients, and 24 PD patients with agoraphobia who completed electronic diaries 36 times during 1 week. Patient groups frequently reported dissociation as well as thoughts, memories, and reliving of their trauma or panic attacks. PTSD patients reported more trauma/panic attack thoughts (incidence rate ratio [IRR] = 2.9) and memories (IRR = 2.8) than PD patients. Patient groups relived their trauma or panic attacks equally frequently, and reported comparable bodily reactions and distress associated with trauma or panic attack memories. Clinical groups avoided trauma or panic attack reminders more often than healthy controls (avoidance of trauma- or panic attack-related thoughts (IRR = 8.0); avoidance of things associated with the trauma or panic attack (IRR = 40.7). PD patients avoided trauma or panic attack reminders less often than PTSD patients (avoidance of trauma- or panic attack-related thoughts [IRR = 2.5]; avoidance of things associated with the trauma or panic attack [IRR = 4.1]), yet these differences were nonsignificant when controlling for functional impairment. In conclusion, trauma-like symptoms are common in PD with agoraphobia and panic attacks may be processed similarly as trauma in PTSD.
Collapse
Affiliation(s)
- Monique C Pfaltz
- Department of Psychology, Harvard University, Cambridge, Massachusetts 02138-2044, USA.
| | | | | | | |
Collapse
|
12
|
Naragon-Gainey K, Simpson TL, Moore SA, Varra AA, Kaysen DL. The correspondence of daily and retrospective PTSD reports among female victims of sexual assault. Psychol Assess 2012; 24:1041-7. [PMID: 22612649 DOI: 10.1037/a0028518] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Research addressing the association between daily and retrospective symptom reports suggests that retrospective reports are typically inflated. The present study examined the association between daily posttraumatic stress disorder (PTSD) symptom reports over 1 month and a corresponding retrospective report (PTSD Checklist [PCL]; Weathers et al., 1993) for both total scores and symptom clusters. The authors hypothesized that greater PTSD symptom instability and greater depression would be associated with poorer agreement between daily and retrospective reports. Data were collected from 132 female college students who were sexually assaulted. Multilevel modeling indicated very strong agreement between mean daily and retrospective reports for total scores and symptom clusters, with pseudo-R2 ranging from .55 to .77. Depression symptoms did not moderate this association, but daily-retrospective agreement was lowest for the avoidance cluster, which was also the most unstable. Finally, retrospective recall for each symptom cluster showed acceptable specificity to the corresponding daily symptom clusters. Overall, these findings suggest that retrospective memories for global PTSD symptoms and symptom clusters, as assessed by the PCL, are consistent with daily reports over a 1-month period. Implications for clinical assessment methodology are discussed.
Collapse
Affiliation(s)
- Kristin Naragon-Gainey
- Veterans Affairs (VA) Puget Sound Health Care System, Seattle Division, Seattle, WA, USA.
| | | | | | | | | |
Collapse
|
13
|
Ben-Zeev D, McHugo GJ, Xie H, Dobbins K, Young MA. Comparing retrospective reports to real-time/real-place mobile assessments in individuals with schizophrenia and a nonclinical comparison group. Schizophr Bull 2012; 38:396-404. [PMID: 22302902 PMCID: PMC3329976 DOI: 10.1093/schbul/sbr171] [Citation(s) in RCA: 78] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Retrospective reports are often used as the primary source of information for important diagnostic decisions, treatment, and clinical research. Whether such reports accurately represent individuals' past experiences in the context of a serious mental illness such as schizophrenia is unclear. In the current study, 24 individuals with schizophrenia and 26 nonclinical participants used a mobile device to complete multiple real-time/real-place assessments daily, over 7 consecutive days. At the end of the week, participants were also asked to provide a retrospective report summarizing the same period. Comparison of the data captured by the 2 methods showed that participants from both groups retrospectively overestimated the intensity of negative and positive daily experiences. In the clinical group, overestimations for affect were greater than for psychotic symptoms, which were relatively comparable to their retrospective reports. In both samples, retrospective reports were more closely associated with the week's average than the most intense or most recent ratings captured with a mobile device. Multilevel modeling revealed that much of the variability in weekly assessments was not explained by between-person differences and could not be captured by a single retrospective estimate. Based on the findings of this study, clinicians and researchers should be aware that while retrospective summary reports of the severity of certain symptoms compare relatively well with average momentary ratings, they are limited in their ability to capture variability in one's affective or psychotic experiences over time.
Collapse
Affiliation(s)
- Dror Ben-Zeev
- Department of Psychiatry, Dartmouth Psychiatric Research Center, Dartmouth Medical School, Hanover, NH, USA.
| | - Gregory J. McHugo
- Department of Psychiatry, Dartmouth Psychiatric Research Center, Dartmouth Medical School, Hanover, NH
| | - Haiyi Xie
- Department of Psychiatry, Dartmouth Psychiatric Research Center, Dartmouth Medical School, Hanover, NH
| | - Katy Dobbins
- Thresholds-Dartmouth Research Center, Chicago, IL
| | - Michael A. Young
- College of Psychology, Illinois Institute of Technology, Chicago, IL
| |
Collapse
|
14
|
Instability of physical anxiety symptoms in daily life of patients with panic disorder and patients with posttraumatic stress disorder. J Anxiety Disord 2010; 24:792-8. [PMID: 20580527 DOI: 10.1016/j.janxdis.2010.06.001] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/15/2008] [Revised: 03/02/2010] [Accepted: 06/02/2010] [Indexed: 11/22/2022]
Abstract
The present study examined severity as well as degree and temporal pattern of instability of DSM-IV-based bodily symptoms of anxiety (BSA) in daily life of 26 panic disorder (PD) patients, 17 posttraumatic stress disorder (PTSD) patients, and 28 healthy controls (HC) during 1 week, using electronic diaries. The ecological momentary assessment around every 3h during wake times was accepted well by patients. Compared to HC, patient groups exhibited elevated instability of BSA. BSA instability was more pronounced in PTSD than PD (p<0.005), even after controlling for mean symptom level. Numbers of symptomatic episodes were comparable in PTSD and PD, but the duration of symptom-free episodes was shorter in PTSD than PD. Results indicate that PTSD patients are particularly burdened by fluctuations in somatic symptoms of anxiety, implying perceived unpredictability and uncontrollability. Electronic diaries can be applied in innovative ways to provide novel insights into the phenomenology of anxiety disorders that may not be captured well by retrospective interviews and questionnaires.
Collapse
|
15
|
Ruwaard J, Broeksteeg J, Schrieken B, Emmelkamp P, Lange A. Web-based therapist-assisted cognitive behavioral treatment of panic symptoms: a randomized controlled trial with a three-year follow-up. J Anxiety Disord 2010; 24:387-96. [PMID: 20227241 DOI: 10.1016/j.janxdis.2010.01.010] [Citation(s) in RCA: 49] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/13/2009] [Revised: 11/20/2009] [Accepted: 01/30/2010] [Indexed: 01/04/2023]
Abstract
BACKGROUND Internet-delivered treatment may reduce barriers to care in those unwilling or unable to access traditional forms of treatment. OBJECTIVE To assesses the efficacy of web-based therapist-assisted cognitive behavioral treatment (web-CBT) of panic symptoms. DESIGN A randomized waiting-list controlled trial with an uncontrolled three-year follow-up. PARTICIPANTS A community sample of 58 participants with chronic panic symptoms of varying severity (immediate treatment: n=27, waiting-list control: n=31). OUTCOME MEASURES The primary outcome measures were a one-week Panic Diary and the Panic Disorder Severity Scale - Self-Report (PDSS-SR); secondary measures were the Agoraphobic Cognitions Questionnaire (ACQ), the Body Sensations Questionnaire (BSQ), the Mobility Inventory - Alone subscale (MI-AAL), and the Depression Anxiety Stress Scales (DASS-42). RESULTS In the RCT, 54 participants (93%) completed posttest measurements. With regard to the primary outcome measures, intention-to-treat ANCOVAs revealed that participants in the treatment condition improved more than the participants in the waiting-list control condition (p<.03), with a pooled between-group effect size of d=.7. After three years (n=47; 81% study compliance), effects were more pronounced. CONCLUSION The results demonstrate the efficacy of therapist-assisted web-CBT in the treatment of panic symptoms.
Collapse
Affiliation(s)
- Jeroen Ruwaard
- University of Amsterdam, Department of Clinical Psychology, Amsterdam, The Netherlands.
| | | | | | | | | |
Collapse
|
16
|
Accuracy of hospitalized depressed patients' and healthy controls' retrospective symptom reports: an experience sampling study. J Nerv Ment Dis 2010; 198:280-5. [PMID: 20386257 DOI: 10.1097/nmd.0b013e3181d6141f] [Citation(s) in RCA: 56] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
A growing body of literature suggests that retrospective recall of psychiatric symptoms is often inaccurate and may distort knowledge about the course of illness and impact treatment. The current study examined the accuracy of retrospective recall of a variety of depressive symptoms in hospitalized depressed patients and nonclinical controls. Using the Experience Sampling Method, we compared average momentary symptom reports of 1 week to retrospective summaries of the same period. The depressed group exhibited negative biases in their recall of experienced anhedonia, sadness, confusion, and suicidality, but were relatively accurate in recall of helplessness, detachment, and self-control. Controls exhibited a different pattern; they were relatively accurate in their retrospective recall of confusion, suicidality and sadness, but exhibited positive biases in recall of anhedonia, helplessness, detachment, and self-control. Both groups exhibited comparable negative biases in their recall of experienced tension, difficulty concentrating, guilt, and fear. The findings suggest that for maximum accuracy in the assessment of depressive symptoms, scientists and practitioners should supplement retrospective self-reports with momentary measures, and consider using ambulatory assessment in cognitive behavioral treatments of depression.
Collapse
|
17
|
Myin-Germeys I, Oorschot M, Collip D, Lataster J, Delespaul P, van Os J. Experience sampling research in psychopathology: opening the black box of daily life. Psychol Med 2009; 39:1533-1547. [PMID: 19215626 DOI: 10.1017/s0033291708004947] [Citation(s) in RCA: 506] [Impact Index Per Article: 31.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
A growing body of research suggests that momentary assessment technologies that sample experiences in the context of daily life constitute a useful and productive approach in the study of behavioural phenotypes and a powerful addition to mainstream cross-sectional research paradigms. Momentary assessment strategies for psychopathology are described, together with a comprehensive review of research findings illustrating the added value of daily life research for the study of (1) phenomenology, (2) aetiology, (3) psychological models, (4) biological mechanisms, (5) treatment and (6) gene-environment interactions in psychopathology. Overall, this review shows that variability over time and dynamic patterns of reactivity to the environment are essential features of psychopathological experiences that need to be captured for a better understanding of their phenomenology and underlying mechanisms. The Experience Sampling Method (ESM) allows us to capture the film rather than a snapshot of daily life reality of patients, fuelling new research into the gene-environment-experience interplay underlying psychopathology and its treatment.
Collapse
Affiliation(s)
- I Myin-Germeys
- Department of Psychiatry and Neuropsychology, South Limburg Mental Health Research and Teaching Network, EURON, Maastricht University, Maastricht, The Netherlands.
| | | | | | | | | | | |
Collapse
|
18
|
Abstract
Convergent experimental data, autobiographical studies, and investigations on daily life have all demonstrated that gathering information retrospectively is a highly dubious methodology. Retrospection is subject to multiple systematic distortions (i.e., affective valence effect, mood congruent memory effect, duration neglect; peak end rule) as it is based on (often biased) storage and recollection of memories of the original experience or the behavior that are of interest. The method of choice to circumvent these biases is the use of electronic diaries to collect self-reported symptoms, behaviors, or physiological processes in real time. Different terms have been used for this kind of methodology: ambulatory assessment, ecological momentary assessment, experience sampling method, and real-time data capture. Even though the terms differ, they have in common the use of computer-assisted methodology to assess self-reported symptoms, behaviors, or physiological processes, while the participant undergoes normal daily activities. In this review we discuss the main features and advantages of ambulatory assessment regarding clinical psychology and psychiatry: (a) the use of realtime assessment to circumvent biased recollection, (b) assessment in real life to enhance generalizability, (c) repeated assessment to investigate within person processes, (d) multimodal assessment, including psychological, physiological and behavioral data, (e) the opportunity to assess and investigate context-specific relationships, and (f) the possibility of giving feedback in real time. Using prototypic examples from the literature of clinical psychology and psychiatry, we demonstrate that ambulatory assessment can answer specific research questions better than laboratory or questionnaire studies.
Collapse
|
19
|
Gloster AT, Richard DC, Himle J, Koch E, Anson H, Lokers L, Thornton J. Accuracy of retrospective memory and covariation estimation in patients with obsessive–compulsive disorder. Behav Res Ther 2008; 46:642-55. [DOI: 10.1016/j.brat.2008.02.010] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2007] [Revised: 02/27/2008] [Accepted: 02/27/2008] [Indexed: 11/28/2022]
|
20
|
Riley WT, Carson SC, Martin N, Behar A, Forman-Hoffman VL, Jerome A. Initial feasibility of a researcher configurable computerized self-monitoring system. COMPUTERS IN HUMAN BEHAVIOR 2005. [DOI: 10.1016/j.chb.2004.02.026] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
21
|
Abstract
Zusammenfassung: Pocketcomputer eignen sich, psychologische Daten in Feldstudien technisch zuverlässiger als mit Fragebogen bzw. Tagebüchern zu erfassen. In einer Methodenstudie wurde MONITOR, ein für den Pocket-PC PSION geschriebenes, flexibles Programm eingesetzt. Unter Alltagsbedingungen wurden von 61 Studierenden verschiedener Fächer an zwei Tagen mit je fünf Eingaben Selbstprotokolle erhoben. Dazu gehörten Settingmerkmale wie Ort und Tätigkeit, Befindlichkeit sowie zwei Aufmerksamkeitstests. Zusätzlich wurde ein abendlicher und ein morgendlicher Rückblick erhoben. Zwischen den Erhebungstagen und zwischen verschiedenen Tageszeiten ergaben sich Unterschiede, die teils als Übungs- und Gewöhnungseffekte, teils als zirkadiane Effekte interpretierbar sind. Rückblickend wird das Befinden negativer beurteilt, als es aus dem Mittelwert der einzelnen Protokolle zu erwarten war. Dieser negative Retrospektionseffekt war bei emotional labilen Personen stärker ausgeprägt. Diese Befunde und andere Vorzüge der computer-unterstützten Methodik legen eine breitere Anwendung nahe.
Collapse
|
22
|
|
23
|
Abstract
The discrepancy between retrospective and prospective rating of anxiety symptoms and cognition was examined in 20 agoraphobics. Subjects were required to complete a checklist of symptoms and cognitions during exposure to an agoraphobic situation. and then to complete a similar set retrospectively. More cognitions were rated retrospectively than prospectively, with the discrepancy especially evident for cognitions about physical catastrophe. In contrast, there was no discrepancy between anxiety symptoms rated prospectively versus retrospectively. This may be because anxiety symptoms are easier for patients to identify than cognitions. require less introspection. or are less affected by context than cognition. Implications of the findings are discussed and suggestions for future research are made.
Collapse
Affiliation(s)
- M Marks
- Department of Psychology, Institute of Psychiatry, De Crespigny Park, London, UK
| | | |
Collapse
|
24
|
Hofmann SG. The value of psychophysiological data for cognitive behavioral treatment of panic disorder. COGNITIVE AND BEHAVIORAL PRACTICE 1999. [DOI: 10.1016/s1077-7229(99)80082-0] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
25
|
Abstract
The cognitive models of panic disorder with (PDA) or without (PD) agoraphobia are now widely recognised. These models propose that patients misinterpret external or internal cues in a catastrophic manner and as a result of these catastrophic cognitions the symptoms are maintained. There is now a large body of empirical evidence for this proposal and the aim of this paper is to systematically review the literature to evaluate whether the empirical evidence supports the contribution of catastrophic cognitions to PD and PDA. Empirical studies using different methodologies, such as interview, questionnaire, self-monitoring, and in vivo techniques are reviewed. The results indicate there is substantial empirical evidence in support of the central role of catastrophic cognition in cognitive models. Different methodologies provided convergent support for the importance of catastrophic cognitions in the maintenance of panic disorder and agoraphobia. Limitations in the interpretation of the existing research are highlighted and future research directions are proposed.
Collapse
Affiliation(s)
- N G Khawaja
- School of Psychology, University of Queensland, Brisbane, Australia
| | | |
Collapse
|
26
|
Sharp DM, Power KG. Treatment-outcome research in panic disorder: dilemmas in reconciling the demands of pharmacological and psychological methodologies. J Psychopharmacol 1998; 11:373-80. [PMID: 9443528 DOI: 10.1177/026988119701100415] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Panic disorder with or without agoraphobia has been the subject of sustained treatment-outcome research. Studies have been conducted by both pharmacologically- and psychologically-oriented researchers each employing their own methodologies. Problems arise in attempting to reconcile the demands of these two treatment-outcome methodologies, whilst at the same time ensuring that research designs reflect the reality of wider clinical practice. In the following discussion a series of studies comparing pharmacological and psychological treatments for panic disorder and agoraphobia are reviewed. The review highlights areas where the competing demands of research design and clinical applicability lead to dilemmas for the researcher. Attempts to overcome such dilemmas are described and alternative solutions discussed.
Collapse
Affiliation(s)
- D M Sharp
- Anxiety and Stress Research Centre, Department of Psychology, University of Stirling, UK.
| | | |
Collapse
|
27
|
Bouchard S, Pelletier MH, Gauthier JG, Côté G, Laberge B. The assessment of panic using self-report: a comprehensive survey of validated instruments. J Anxiety Disord 1997; 11:89-111. [PMID: 9131884 DOI: 10.1016/s0887-6185(96)00037-0] [Citation(s) in RCA: 22] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
A repertoire of reliable and valid self-report instruments to assess panic and panic disorder would help both researchers and clinicians. This review presents a description and an analysis of the available instruments. Following a comprehensive search of the literature, 14 instruments with published information on reliability and validity were reviewed. The following information is reported for each instrument: brief description of the instrument and its development, mean and standard deviation for clinical and nonclinical samples, and psychometric properties. Four types of instruments are presented: general assessment and information (n = 2), severity of panic disorder (n = 2), body sensations (n = 2) and cognitive dimensions of panic (n = 8). Overall, it would seem that panic measures have moderate to excellent psychometric qualities. However, the comparison between the instruments is difficult because the amount of empirical support available varies widely from one instrument to the other.
Collapse
Affiliation(s)
- S Bouchard
- Départment de Psychoéducation, Université du Québec à Hull.
| | | | | | | | | |
Collapse
|
28
|
Marks M, de Silva P. The 'match/mismatch' model of fear: empirical status and clinical implications. Behav Res Ther 1994; 32:759-70. [PMID: 7980363 DOI: 10.1016/0005-7967(94)90034-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
This paper reviews empirical evidence for the 'match/mismatch' model of fear and defines what is currently known about the prediction of fear. It also outlines several gaps in the literature on this topic and problems with the methodology used to study this phenomenon. Some of these gaps are filled by studies on the prediction of pain and where relevant these are discussed. Important areas for future research are identified, the clinical implications of the model are outlined and specific suggestions for treatment are made.
Collapse
Affiliation(s)
- M Marks
- Institute of Psychiatry, University of London, U.K
| | | |
Collapse
|
29
|
Abstract
Data on naturally occurring panic attacks were gathered through continuous self-monitoring for 94 patients suffering from panic disorder with agoraphobia. A total of 1276 panic attacks were collected. In this article various aspects of panic attacks, including severity, duration and time of onset and situations in which panic occurs are addressed. In addition, the symptoms of panic were investigated, examining the (in)variability of attacks within each patient and the patterning of symptoms in the entire group of patients. The most important findings were as follows: attacks occurred predominantly in nonphobic situations; nocturnal panic attacks were generally more severe than attacks during the day; symptom patterns across various attacks, stemming from the same patient, were rather variable; and finally, a substantial number of the attacks (40%) did not meet the DSM-III-R criteria for number of symptoms.
Collapse
Affiliation(s)
- E de Beurs
- Faculty of Clinical Psychology, University of Amsterdam, The Netherlands
| | | | | | | | | | | |
Collapse
|
30
|
Dijkman-Caes CI, de Vries MW, Kraan HF, Volovics A. Agoraphobic behavior in daily life: effects of social roles and demographic characteristics. Psychol Rep 1993; 72:1283-93. [PMID: 8337342 DOI: 10.2466/pr0.1993.72.3c.1283] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
Agoraphobia is related to demographic characteristics and social roles. To unravel behavioral aspects from demographic characteristics, daily life situations were registered with the Experience Sampling Method for 65 panic patients with and without agoraphobia. Surprisingly, panic patients with and without agoraphobia did not differ as hypothesized in reported frequencies of visits to public places. Panic subjects with agoraphobia did, however, spend significantly more time at home and with their families than did panic patients without agoraphobia and normal controls. When adjusted for demographic variables such as sex, marital status, family life, and employment, no significant differences between panic patients with and without agoraphobia emerged on the avoidance variables of remaining at home or being with a family member. The lack of discrimination of the diagnosis on these crucial behavioral variables highlights the influence of demographic characteristics and social roles on agoraphobia in daily life. Such findings challenge current diagnostic conceptualizations that rely on retrospective reports by patients of the avoidance of public places. Moreover, reliance on retrospective reports obscured the important role of significant others for understanding etiology and course.
Collapse
Affiliation(s)
- C I Dijkman-Caes
- Department of Psychiatry, Neuropsychology and Sociobehavioral Science, University of Limburg, The Netherlands
| | | | | | | |
Collapse
|