1
|
Yousif SR, Lee SHY, Sherman BE, Papafragou A. Event representation at the scale of ordinary experience. Cognition 2024; 249:105833. [PMID: 38833780 DOI: 10.1016/j.cognition.2024.105833] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Revised: 05/15/2024] [Accepted: 05/22/2024] [Indexed: 06/06/2024]
Abstract
Weeks are divided into weekdays and weekends; years into semesters and seasons; lives into stages like childhood, adulthood, and adolescence. How does the structure of experience shape memory? Though much work has examined event representation in human cognition, little work has explored event representation at the scale of ordinary experience. Here, we use shared experiences - in the form of popular television shows - to explore how memories are shaped by event structure at a large scale. We find that memories for events in these shows exhibit several hallmarks of event cognition. Namely, we find that memories are organized with respect to their event structure (boundaries), and that beginnings and endings are better remembered at multiple levels of the event hierarchy simultaneously. These patterns seem to be partially, but not fully, explained by the perceived story-relevance of events. Lastly, using a longitudinal design, we also show how event representations evolve over periods of several months. These results offer an understanding of event cognition at the scale of ordinary human lives.
Collapse
Affiliation(s)
- Sami R Yousif
- University of Pennsylvania, Department of Psychology, United States of America.
| | - Sarah Hye-Yeon Lee
- University of Pennsylvania, Department of Linguistics, United States of America
| | - Brynn E Sherman
- University of Pennsylvania, Department of Psychology, United States of America
| | - Anna Papafragou
- University of Pennsylvania, Department of Linguistics, United States of America
| |
Collapse
|
2
|
Choe S, Kwon OS. An event-termination cue causes perceived time to dilate. Psychon Bull Rev 2024; 31:659-669. [PMID: 37653279 DOI: 10.3758/s13423-023-02368-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/13/2023] [Indexed: 09/02/2023]
Abstract
The perceived duration of time does not veridically reflect the physical duration but is distorted by various factors, such as the stimulus magnitude or the observer's emotional state. Here, we showed that knowledge about an event's termination time is another significant factor. We often experience time passage differently when we know that an event will terminate soon. To quantify this, we asked 33 university students to report a rotating clock hand's duration with or without a termination cue that indicated the position at which the clock hand disappeared. The results showed that the presence of the termination cue dilated perceived durations, and the dilating effect was larger when the stimulus duration was longer, or the speed of the rotating stimulus was slower. A control experiment with a start-cue excluded the possibility that the cue's mere existence caused the results. Further computational analyses based on the attention theory-of-time perception revealed that the size of dilation is best explained by neither an event's duration nor the distance traveled by the clock hand, but by how long the clock hand spends time near the termination cue. The results imply that an event-termination cue generates a field in which the perceived time dilates.
Collapse
Affiliation(s)
- Seonggyu Choe
- Department of Biomedical Engineering, Ulsan National Institute of Science and Technology, 50 UNIST-gil, Ulsan, 44919, Republic of Korea
| | - Oh-Sang Kwon
- Department of Biomedical Engineering, Ulsan National Institute of Science and Technology, 50 UNIST-gil, Ulsan, 44919, Republic of Korea.
| |
Collapse
|
3
|
Sherman BE, DuBrow S, Winawer J, Davachi L. Mnemonic Content and Hippocampal Patterns Shape Judgments of Time. Psychol Sci 2023; 34:221-237. [PMID: 36442582 PMCID: PMC10068509 DOI: 10.1177/09567976221129533] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Accepted: 09/09/2022] [Indexed: 11/30/2022] Open
Abstract
Our experience of time can feel dilated or compressed, rather than reflecting true "clock time." Although many contextual factors influence the subjective perception of time, it is unclear how memory accessibility plays a role in constructing our experience of and memory for time. Here, we used a combination of behavioral and functional MRI measures in healthy young adults (N = 147) to ask the question of how memory is incorporated into temporal duration judgments. Behaviorally, we found that event boundaries, which have been shown to disrupt ongoing memory integration processes, result in the temporal compression of duration judgments. Additionally, using a multivoxel pattern similarity analysis of functional MRI data, we found that greater temporal pattern change in the left hippocampus within individual trials was associated with longer duration judgments. Together, these data suggest that mnemonic processes play a role in constructing representations of time.
Collapse
Affiliation(s)
| | | | - Jonathan Winawer
- Department of Psychology and Center for
Neural Science, New York University
| | - Lila Davachi
- Department of Psychology, Columbia
University
- Department of Clinical Research, Nathan
Kline Institute for Psychiatric Research
| |
Collapse
|
4
|
Kovarski K, Dos Reis J, Chevais C, Hamel A, Makowski D, Sperduti M. Movie editing influences spectators' time perception. Sci Rep 2022; 12:20084. [PMID: 36418366 PMCID: PMC9684412 DOI: 10.1038/s41598-022-23992-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Accepted: 11/08/2022] [Indexed: 11/24/2022] Open
Abstract
Filmmakers use different techniques (e.g., camera movements, editing) to shape viewers' experience. In particular, editing can be used to handle the temporal unfolding of events represented in a movie. Nevertheless, little is known about how different editing types impact viewers' time perception. In an exploratory on-line study (90 participants) and a pre-registered conceptual replication study (60 participants), we asked participants to judge (Study 1) or reproduce (Study 2) the duration of 45 excerpts of the movie "Le Ballon Rouge" containing either continuous editing, action discontinuity editing or no editing. Each excerpt was formatted in three durations (2000, 2500 or 3000 ms). In both studies, we reported that scenes containing continuous editing were perceived as longer than the other two scene types. Moreover, scenes containing action discontinuity editing were perceived as longer than scenes with no editing. This study contributes to the emerging field of psycho-cinematics which could ultimately develop the dialog between arts and science.
Collapse
Affiliation(s)
- Klara Kovarski
- grid.419339.5Hôpital Fondation Rothschild, Paris, France ,grid.508487.60000 0004 7885 7602Integrative Neuroscience and Cognition Center-CNRS, Université Paris Cité, Paris, France ,grid.462844.80000 0001 2308 1657Sorbonne Université, INSPE, Paris, France ,grid.462521.6LaPsyDÉ, Université Paris Cité, CNRS, Paris, France
| | - Joanna Dos Reis
- grid.508487.60000 0004 7885 7602Laboratoire Mémoire, Cerveau and Cognition, (LMC2 UPR 7536), Institut de Psychologie, Université Paris Cité, 92100 Boulogne-Billancourt, France
| | - Claire Chevais
- grid.508487.60000 0004 7885 7602Laboratoire Mémoire, Cerveau and Cognition, (LMC2 UPR 7536), Institut de Psychologie, Université Paris Cité, 92100 Boulogne-Billancourt, France
| | - Anaïs Hamel
- grid.412043.00000 0001 2186 4076Normandie Univ, UNICAEN, INSERM, U1237, PhIND “Physiopathology and Imaging of Neurological Disorders”, Neuropresage Team, Institut Blood and Brain @ Caen-Normandie, Cyceron, Caen, France ,grid.4989.c0000 0001 2348 0746UR2NF-Neuropsychology and Functional Neuroimaging Research Unit at CRCN-Center for Research in Cognition and Neurosciences and UNI - ULB Neuroscience Institute, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Dominique Makowski
- grid.59025.3b0000 0001 2224 0361Clinical Brain Lab, Nanyang Technological University, Singapore, Singapore
| | - Marco Sperduti
- grid.508487.60000 0004 7885 7602Laboratoire Mémoire, Cerveau and Cognition, (LMC2 UPR 7536), Institut de Psychologie, Université Paris Cité, 92100 Boulogne-Billancourt, France
| |
Collapse
|
5
|
Bredun EV, Shcheglova EA. Psychological Features of the Human <I>Tempoworld</I> as Predictors of Solving a Cognitive Task. BULLETIN OF KEMEROVO STATE UNIVERSITY 2022. [DOI: 10.21603/2078-8975-2022-24-4-430-439] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
The paper reviews such phenomena as time perception, temporal structure of the human world, the so-called tempoworld, and the psychophysiological mechanism of temporal dynamics. The article also covers various ways of assessing the relationship between the characteristic features of solving cognitive tasks and the temporal characteristics and structuraldynamic components of positional strategies of personal cognitive-noetic development. The research results revealed the specificity of the process of solving cognitive tasks in groups of respondents with different typological temporal characteristics. Students who knew their dominant temporal-cognitive features made fewer mistakes when solving cognitive tasks related to spatial perception. The experiment revealed some positional strategies as significant predictors of the process of solving a cognitive task, manifested in the features of the human tempoworld. The speed and accuracy of performing cognitive tasks depended not so much on the specifics of these tasks, but on the temporal characteristics of a person, manifested in the degree of balance of modal assessments of life fulfillment. The list of significant predictors of the solving a cognitive task included such psychological features of the human tempoworld as positional strategies, which were dominated by the value-semantic component and motivational self-determination. The research revealed various features of cognitive involvement in the subjective past, present, and future, as well as the relationship between temporal modality and ready-made action algorithms when solving cognitive tasks.
Collapse
|
6
|
Singhal I, Srinivasan N. A wrinkle in and of time: Contraction of felt duration with a single perceptual switch. Cognition 2022; 225:105151. [DOI: 10.1016/j.cognition.2022.105151] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2021] [Revised: 04/25/2022] [Accepted: 04/26/2022] [Indexed: 11/27/2022]
|
7
|
Wen T, Egner T. Retrieval context determines whether event boundaries impair or enhance temporal order memory. Cognition 2022; 225:105145. [PMID: 35483158 DOI: 10.1016/j.cognition.2022.105145] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2022] [Revised: 03/07/2022] [Accepted: 04/18/2022] [Indexed: 11/03/2022]
Abstract
Meaningful changes in context create "event boundaries", segmenting continuous experience into distinct episodes in memory. A foundational finding in this literature is that event boundaries impair memory for the temporal order of stimuli spanning a boundary compared to equally spaced stimuli within an event. This seems surprising in light of intuitions about memory in everyday life, where the order of within-event experiences (did I have coffee before the first bite of bagel?) often seems more difficult to recall than the order of events per se (did I have breakfast or do the dishes first?). Here, we aimed to resolve this discrepancy by manipulating whether stimuli carried information about their encoding context during retrieval, as they often do in everyday life (e.g., bagel-breakfast). In Experiments 1 and 2, we show that stimuli inherently associated with a unique encoding context produce a "flipped" order memory effect, whereby temporal memory was superior for cross-boundary than within-event item pairs. In Experiments 3 and 4, we added context information at retrieval to a standard laboratory event memory protocol where stimuli were encoded in the presence of arbitrary context cues (colored frames). We found that whether temporal order memory for cross-boundary stimuli was enhanced or impaired relative to within-event items depended on whether the context was present or absent during the memory test. Taken together, we demonstrate that the effect of event boundaries on temporal memory is malleable, and determined by the availability of context information at retrieval.
Collapse
Affiliation(s)
- Tanya Wen
- Center for Cognitive Neuroscience, Duke University, Durham, NC, USA.
| | - Tobias Egner
- Center for Cognitive Neuroscience, Duke University, Durham, NC, USA; Department of Psychology and Neuroscience, Duke University, Durham, NC, USA
| |
Collapse
|
8
|
Time perception in film is modulated by sensory modality and arousal. Atten Percept Psychophys 2022; 84:926-942. [PMID: 35304701 DOI: 10.3758/s13414-022-02464-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/20/2022] [Indexed: 11/08/2022]
Abstract
Considerable research has shown that the perception of time can be distorted subjectively, but little empirical work has examined what factors affect time perception in film, a naturalistic multimodal stimulus. Here, we explore the effect of sensory modality, arousal, and valence on how participants estimate durations in film. Using behavioral ratings combined with pupillometry in a within-participants design, we analyzed responses to and duration estimates of film clips in three experimental conditions: audiovisual (containing music and sound effects), visual (without music and sound effects), and auditory (music and sound effects without a visual scene). Participants viewed clips from little-known nature documentaries, fiction, animation, and experimental films. They were asked to judge clip duration and to report subjective arousal and valence, as their pupil sizes were recorded. Data were analyzed using linear mixed-effects models. Results reveal duration estimates varied between experimental conditions. Clip durations were judged to be shorter than actual durations in all three conditions, with visual-only clips perceived as longer (i.e., less distorted in time) than auditory-only and audiovisual clips. High levels of Composite Arousal (an average of self-reported arousal and pupil size changes) were correlated with longer (more accurate) estimates of duration, particularly in the audiovisual modality. This effect may reflect stimulus complexity or greater cognitive engagement. Increased ratings of valence were correlated with longer estimates of duration. The use of naturalistic, complex stimuli such as film can enhance our understanding of the psychology of time perception.
Collapse
|
9
|
Pu Y, Kong XZ, Ranganath C, Melloni L. Event boundaries shape temporal organization of memory by resetting temporal context. Nat Commun 2022; 13:622. [PMID: 35110527 PMCID: PMC8810807 DOI: 10.1038/s41467-022-28216-9] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2020] [Accepted: 01/11/2022] [Indexed: 11/09/2022] Open
Abstract
In memory, our continuous experiences are broken up into discrete events. Boundaries between events are known to influence the temporal organization of memory. However, how and through which mechanism event boundaries shape temporal order memory (TOM) remains unknown. Across four experiments, we show that event boundaries exert a dual role: improving TOM for items within an event and impairing TOM for items across events. Decreasing event length in a list enhances TOM, but only for items at earlier local event positions, an effect we term the local primacy effect. A computational model, in which items are associated to a temporal context signal that drifts over time but resets at boundaries captures all behavioural results. Our findings provide a unified algorithmic mechanism for understanding how and why event boundaries affect TOM, reconciling a long-standing paradox of why both contextual similarity and dissimilarity promote TOM. Our memory is temporally organized, but our internal clock can be distorted. The authors demonstrate how environmental changes (termed event boundaries) affect memory for event order, and provide a computational model to explain these effects.
Collapse
Affiliation(s)
- Yi Pu
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany.
| | - Xiang-Zhen Kong
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China.
| | - Charan Ranganath
- UC Davis Center for Neuroscience, University of California, Davis, CA, USA.,Department of Psychology, University of California, Davis, CA, USA
| | - Lucia Melloni
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany. .,Department of Neurology, NYU Grossman School of Medicine, New York City, NY, USA.
| |
Collapse
|
10
|
Peer M, Epstein RA. The human brain uses spatial schemas to represent segmented environments. Curr Biol 2021; 31:4677-4688.e8. [PMID: 34473949 PMCID: PMC8578397 DOI: 10.1016/j.cub.2021.08.012] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2021] [Revised: 06/25/2021] [Accepted: 08/03/2021] [Indexed: 11/25/2022]
Abstract
Humans and animals use cognitive maps to represent the spatial structure of the environment. Although these maps are typically conceptualized as extending in an equipotential manner across known space, psychological evidence suggests that people mentally segment complex environments into subspaces. To understand the neurocognitive mechanisms behind this operation, we familiarized participants with a virtual courtyard that was divided into two halves by a river; we then used behavioral testing and fMRI to understand how spatial locations were encoded within this environment. Participants' spatial judgments and multivoxel activation patterns were affected by the division of the courtyard, indicating that the presence of a boundary can induce mental segmentation even when all parts of the environment are co-visible. In the hippocampus and occipital place area (OPA), the segmented organization of the environment manifested in schematic spatial codes that represented geometrically equivalent locations in the two subspaces as similar. In the retrosplenial complex (RSC), responses were more consistent with an integrated spatial map. These results demonstrate that people use both local spatial schemas and integrated spatial maps to represent segmented environment. We hypothesize that schematization may serve as a general mechanism for organizing complex knowledge structures in terms of their component elements.
Collapse
Affiliation(s)
- Michael Peer
- Department of Psychology, University of Pennsylvania, 3710 Hamilton Walk, Philadelphia, PA 19104, USA.
| | - Russell A Epstein
- Department of Psychology, University of Pennsylvania, 3710 Hamilton Walk, Philadelphia, PA 19104, USA
| |
Collapse
|
11
|
Petrucci AS, Palombo DJ. A matter of time: how does emotion influence temporal aspects of remembering? Cogn Emot 2021; 35:1499-1515. [PMID: 34496726 DOI: 10.1080/02699931.2021.1976733] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
Spatiotemporal context is an intrinsic aspect of episodic memory. Although a large literature has demonstrated that emotion enhances episodic memory, less research has considered whether and how emotion affects memory for the timing of an experience, despite theoretical and practical importance. In this review, we bridge three heavily researched cognitive domains - memory, emotion, and time - by discussing findings from a burgeoning literature on their intersection. We identify and review two broad ways in which memory for time has been conceptualised in the emotional memory literature, namely (1) memory for relative aspects of event timing ("when" an event detail occurred), which includes studies of temporal-order and source memory; and (2) memory for the time that elapsed during an event ("how long"), which includes studies of retrospective duration estimation. Emerging trends demonstrate that although temporal-order memory can be impaired or enhanced by emotion depending on study demands, temporal source memory, instead, is usually enhanced. Studies of duration memory show that the remembered duration of negative experiences is dilated, but it is less clear how duration memory is affected for positive events. These findings are considered under the lens of broader emotional memory literature theories, and directions for future research are proposed.
Collapse
Affiliation(s)
- Aria S Petrucci
- Department of Psychology, University of British Columbia, Vancouver, Canada
| | - Daniela J Palombo
- Department of Psychology, University of British Columbia, Vancouver, Canada
| |
Collapse
|
12
|
Bellmund JLS, Polti I, Doeller CF. Sequence Memory in the Hippocampal-Entorhinal Region. J Cogn Neurosci 2020; 32:2056-2070. [PMID: 32530378 DOI: 10.1162/jocn_a_01592] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Episodic memories are constructed from sequences of events. When recalling such a memory, we not only recall individual events, but we also retrieve information about how the sequence of events unfolded. Here, we focus on the role of the hippocampal-entorhinal region in processing and remembering sequences of events, which are thought to be stored in relational networks. We summarize evidence that temporal relations are a central organizational principle for memories in the hippocampus. Importantly, we incorporate novel insights from recent studies about the role of the adjacent entorhinal cortex in sequence memory. In rodents, the lateral entorhinal subregion carries temporal information during ongoing behavior. The human homologue is recruited during memory recall where its representations reflect the temporal relationships between events encountered in a sequence. We further introduce the idea that the hippocampal-entorhinal region might enable temporal scaling of sequence representations. Flexible changes of sequence progression speed could underlie the traversal of episodic memories and mental simulations at different paces. In conclusion, we describe how the entorhinal cortex and hippocampus contribute to remembering event sequences-a core component of episodic memory.
Collapse
Affiliation(s)
- Jacob L S Bellmund
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Ignacio Polti
- Kavli Institute for Systems Neuroscience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, Norwegian University of Science and Technology, Trondheim, Norway
| | - Christian F Doeller
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.,Kavli Institute for Systems Neuroscience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, Norwegian University of Science and Technology, Trondheim, Norway
| |
Collapse
|