1
|
Lidström A. Serial dependence in facial identity perception and visual working memory. Atten Percept Psychophys 2023; 85:2226-2241. [PMID: 37794301 PMCID: PMC10584723 DOI: 10.3758/s13414-023-02799-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/20/2023] [Indexed: 10/06/2023]
Abstract
Serial dependence (SD) refers to the effect in which a person's current perceptual judgment is attracted toward recent stimulus history. Perceptual and memory processes, as well as response and decisional biases, are thought to contribute to SD effects. The current study examined the processing stages of SD facial identity effects in the context of task-related decision processes and how such effects may differ from visual working memory (VWM) interactions. In two experiments, participants were shown a series of two sequentially presented face images. In Experiment 1, the two faces were separated by an interstimulus interval (ISI) of 1, 3, 6, or 10 s, and participants were instructed to reproduce the second face after a varying response delay of 0, 1, 3, 6, or 10 s. Results showed that SD effects occurred most consistently at ISI of 1 s and response delays of 1 and 6 s consistent with early and late stages of processing. In Experiment 2, the ISI was held constant at 1 s, and to separate SD from VWM interactions participants were post-cued to reproduce either the first or the second face. When the second face was the target, SD effects again occurred at response delays of 1 and 6 s, but not when the first face was the target. Together, the results demonstrates that SD facial identity effects occur independently of task-related processes in a distinct temporal fashion and suggest that SD and VWM interactions may rely on separate underlying mechanisms.
Collapse
Affiliation(s)
- Anette Lidström
- Department of Psychology, Lund University, Allhelgona kyrkogata 16A, 223 50, Lund, Sweden.
| |
Collapse
|
2
|
Search asymmetry in periodical changes of motion directions. Vision Res 2022; 195:108025. [DOI: 10.1016/j.visres.2022.108025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2021] [Revised: 02/11/2022] [Accepted: 02/11/2022] [Indexed: 11/21/2022]
|
3
|
mixtur: An R package for designing, analysing, and modelling continuous report visual short-term memory studies. Behav Res Methods 2022; 54:2071-2100. [PMID: 35102520 PMCID: PMC9579120 DOI: 10.3758/s13428-021-01688-1] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/09/2021] [Indexed: 12/25/2022]
Abstract
Visual short-term memory (vSTM) is often measured via continuous-report tasks whereby participants are presented with stimuli that vary along a continuous dimension (e.g., colour) with the goal of memorising the stimulus features. At test, participants are probed to recall the feature value of one of the memoranda in a continuous manner (e.g., by clicking on a colour wheel). The angular deviation between the participant response and the true feature value provides an estimate of recall precision. Two prominent models of performance on such tasks are the two- and three-component mixture models (Bays et al., Journal of Vision, 9(10), Article 7, 2009; Zhang and Luck, Nature, 453(7192), 233–235, 2008). Both models decompose participant responses into probabilistic mixtures of: (1) responses to the true target value based on a noisy memory representation; (2) random guessing when memory fails. In addition, the three-component model proposes (3) responses to a non-target feature value (i.e., binding errors). Here we report the development of mixtur, an open-source package written for the statistical programming language R that facilitates the fitting of the two- and three-component mixture models to continuous report data. We also conduct simulations to develop recommendations for researchers on trial numbers, set sizes, and memoranda similarity, as well as parameter recovery and model recovery. In the Discussion, we discuss how mixtur can be used to fit the slots and the slots-plus-averaging models, as well as how mixtur can be extended to fit explanatory models of visual short-term memory. It is our hope that mixtur will lower the barrier of entry for utilising mixture modelling.
Collapse
|
4
|
Teeuwen RRM, Wacongne C, Schnabel UH, Self MW, Roelfsema PR. A neuronal basis of iconic memory in macaque primary visual cortex. Curr Biol 2021; 31:5401-5414.e4. [PMID: 34653360 PMCID: PMC8699744 DOI: 10.1016/j.cub.2021.09.052] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Revised: 07/13/2021] [Accepted: 09/21/2021] [Indexed: 11/30/2022]
Abstract
After a briefly presented visual stimulus disappears, observers retain a detailed representation of this stimulus for a short period of time. This sensory storage is called iconic memory. We measured iconic memory in the perception of monkeys and its neuronal correlates in the primary visual cortex (area V1). We determined how many milliseconds extra viewing time iconic memory is worth and how it decays by varying the duration of a brief stimulus and the timing of a mask. The V1 activity that persists after the disappearance of a stimulus predicted accuracy, with a time course resembling the worth and decay of iconic memory. Finally, we examined how iconic memory interacts with attention. A cue presented after the stimulus disappears boosts attentional influences pertaining to a relevant part of the stimulus but only if it appears before iconic memory decayed. Our results relate iconic memory to neuronal activity in early visual cortex.
Collapse
Affiliation(s)
- Rob R M Teeuwen
- Department of Vision & Cognition, Netherlands Institute for Neuroscience, Meibergdreef 47, 1105 Amsterdam, the Netherlands
| | - Catherine Wacongne
- Department of Vision & Cognition, Netherlands Institute for Neuroscience, Meibergdreef 47, 1105 Amsterdam, the Netherlands
| | - Ulf H Schnabel
- Department of Vision & Cognition, Netherlands Institute for Neuroscience, Meibergdreef 47, 1105 Amsterdam, the Netherlands
| | - Matthew W Self
- Department of Vision & Cognition, Netherlands Institute for Neuroscience, Meibergdreef 47, 1105 Amsterdam, the Netherlands
| | - Pieter R Roelfsema
- Department of Vision & Cognition, Netherlands Institute for Neuroscience, Meibergdreef 47, 1105 Amsterdam, the Netherlands; Psychiatry Department, Academic Medical Center, University of Amsterdam, Nieuwe Achtergracht 129-B, 1018 Amsterdam, the Netherlands; Department of Integrative Neurophysiology, Center for Neurogenomics and Cognitive Research, VU University, De Boelelaan 1085, 1081 Amsterdam, the Netherlands.
| |
Collapse
|
5
|
Akbarian A, Clark K, Noudoost B, Nategh N. A sensory memory to preserve visual representations across eye movements. Nat Commun 2021; 12:6449. [PMID: 34750376 PMCID: PMC8575989 DOI: 10.1038/s41467-021-26756-0] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Accepted: 10/13/2021] [Indexed: 11/09/2022] Open
Abstract
Saccadic eye movements (saccades) disrupt the continuous flow of visual information, yet our perception of the visual world remains uninterrupted. Here we assess the representation of the visual scene across saccades from single-trial spike trains of extrastriate visual areas, using a combined electrophysiology and statistical modeling approach. Using a model-based decoder we generate a high temporal resolution readout of visual information, and identify the specific changes in neurons' spatiotemporal sensitivity that underly an integrated perisaccadic representation of visual space. Our results show that by maintaining a memory of the visual scene, extrastriate neurons produce an uninterrupted representation of the visual world. Extrastriate neurons exhibit a late response enhancement close to the time of saccade onset, which preserves the latest pre-saccadic information until the post-saccadic flow of retinal information resumes. These results show how our brain exploits available information to maintain a representation of the scene while visual inputs are disrupted.
Collapse
Affiliation(s)
- Amir Akbarian
- grid.223827.e0000 0001 2193 0096Department of Ophthalmology and Visual Sciences, University of Utah, Salt Lake City, UT USA
| | - Kelsey Clark
- grid.223827.e0000 0001 2193 0096Department of Ophthalmology and Visual Sciences, University of Utah, Salt Lake City, UT USA
| | - Behrad Noudoost
- Department of Ophthalmology and Visual Sciences, University of Utah, Salt Lake City, UT, USA.
| | - Neda Nategh
- Department of Ophthalmology and Visual Sciences, University of Utah, Salt Lake City, UT, USA. .,Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, UT, USA.
| |
Collapse
|
6
|
The effects of Botulinum toxin on the detection of gradual changes in facial emotion. Sci Rep 2019; 9:11734. [PMID: 31409880 PMCID: PMC6692314 DOI: 10.1038/s41598-019-48275-1] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2017] [Accepted: 08/01/2019] [Indexed: 12/24/2022] Open
Abstract
When we feel sad or depressed, our face invariably “drops”. Conversely, when we try to cheer someone up, we might tell them “keep your smile up”, so presupposing that modifying the configuration of their facial muscles will enhance their mood. A crucial assumption that underpins this hypothesis is that mental states are shaped by information originating from the peripheral neuromotor system — a view operationalised as the Facial Feedback Hypothesis. We used botulinum toxin (BoNT-A) injected over the frown area to temporarily paralyse muscles necessary to express anger. Using a pre-post treatment design, we presented participants with gradually changing videos of a face morphing from neutral to full-blown expressions of either anger or happiness and asked them to press a button as soon as they had detected any change in the display. Results indicate that while all participants (control and BoNT-A) improved their reaction times from pre-test to post-test, the BoNT-A group did not when detecting anger in the post-test. We surmise that frown paralysis disadvantaged participants in their ability to improve the detection of anger. Our finding suggests that facial feedback causally affects perceptual awareness of changes in emotion, as well as people’s ability to use perceptual information to learn.
Collapse
|
7
|
Abstract
Studies of visual working memory (VWM) typically have used a "one-shot" change detection task to arrive at a capacity estimate of three to four objects, with additional limits imposed by the precision of the information needed for each object. Unlike the one-shot task, the flicker change detection task permits measurement of VWM capacity over time and with larger numbers of objects present in the scene, but it has rarely been used to assess the capacity of VWM. We used the flicker task to examine (a) whether capacity is close to the typical three to four items when using subtly different stimuli; (b) which dependent measure provides the most meaningful estimate of the capacity of VWM in the flicker task (response time or number of changes viewed); (c) whether capacity remains fixed at three to four items for displays containing many more objects; and (d) how VWM operates over time, with repeated opportunities to encode, retain, and compare elements in a display. Four experiments using grids of simple items varying only in luminance or color revealed a range for VWM capacity limits that was largely impervious to changes in display duration, interstimulus intervals, and array size. This estimate of VWM capacity was correlated with an estimate from the more typical one-shot task, further validating the flicker task as a tool for measuring the capacity of VWM.
Collapse
|
8
|
Tripathy SP, Öǧmen H. Sensory Memory Is Allocated Exclusively to the Current Event-Segment. Front Psychol 2018; 9:1435. [PMID: 30245646 PMCID: PMC6137426 DOI: 10.3389/fpsyg.2018.01435] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2017] [Accepted: 07/23/2018] [Indexed: 11/18/2022] Open
Abstract
The Atkinson-Shiffrin modal model forms the foundation of our understanding of human memory. It consists of three stores (Sensory Memory (SM), also called iconic memory, Short-Term Memory (STM), and Long-Term Memory (LTM)), each tuned to a different time-scale. Since its inception, the STM and LTM components of the modal model have undergone significant modifications, while SM has remained largely unchanged, representing a large capacity system funneling information into STM. In the laboratory, visual memory is usually tested by presenting a brief static stimulus and, after a delay, asking observers to report some aspect of the stimulus. However, under ecological viewing conditions, our visual system receives a continuous stream of inputs, which is segmented into distinct spatio-temporal segments, called events. Events are further segmented into event-segments. Here we show that SM is not an unspecific general funnel to STM but is allocated exclusively to the current event-segment. We used a Multiple-Object Tracking (MOT) paradigm in which observers were presented with disks moving in different directions, along bi-linear trajectories, i.e., linear trajectories, with a single deviation in direction at the mid-point of each trajectory. The synchronized deviation of all of the trajectories produced an event stimulus consisting of two event-segments. Observers reported the pre-deviation or the post-deviation directions of the trajectories. By analyzing observers' responses in partial- and full-report conditions, we investigated the involvement of SM for the two event-segments. The hallmarks of SM hold only for the current event segment. As the large capacity SM stores only items involved in the current event-segment, the need for event-tagging in SM is eliminated, speeding up processing in active vision. By characterizing how memory systems are interfaced with ecological events, this new model extends the Atkinson-Shiffrin model by specifying how events are stored in the first stage of multi-store memory systems.
Collapse
Affiliation(s)
- Srimant P Tripathy
- School of Optometry and Vision Science, University of Bradford, Bradford, United Kingdom
| | - Haluk Öǧmen
- Department of Electrical and Computer Engineering, University of Denver, Denver, CO, United States
| |
Collapse
|
9
|
Abstract
Our visual system briefly retains a trace of a stimulus after it disappears. This phenomenon is known as iconic memory and its contents are thought to be temporally integrated with subsequent visual inputs to produce a single composite representation. However, there is little consensus on the temporal integration between iconic memory and subsequent visual inputs. Here, we show that iconic memory revises its contents depending upon the configuration of the newly produced single representation with particular temporal characteristics. The Poggendorff illusion, in which two collinear line segments are perceived as non-collinear by an intervening rectangle, was observed when the rectangle was presented during a period spanning from 50 ms before to 200 ms after the presentation of the line segments. The illusion was most prominent when the rectangle was presented approximately 100 to 150 ms after the line segments. Furthermore, the illusion was observed at the center of a moving object, but only when the line segments were presented before the rectangle. These results indicate that the contents of iconic memory are susceptible to the modulatory influence of subsequent visual inputs before being translated into conscious perception in a time-locked manner both in retinotopic and non-retinotopic, object-centered frames of reference.
Collapse
|
10
|
Rensink RA. To Have Seen or Not to Have Seen: A Look at Rensink, O'Regan, and Clark (1997). PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2018; 13:230-235. [PMID: 29592637 DOI: 10.1177/1745691617707269] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Rensink, O'Regan, and Clark drew attention to the phenomenon of change blindness, in which even large changes can be difficult to notice if made during the appearance of motion transients elsewhere in the image. This article provides a sketch of the events that inspired that article as well as its subsequent impact on psychological science and on society at large.
Collapse
Affiliation(s)
- Ronald A Rensink
- Departments of Psychology and Computer Science, University of British Columbia
| |
Collapse
|
11
|
Thomas C, Didierjean A, Kuhn G. It is magic! How impossible solutions prevent the discovery of obvious ones? Q J Exp Psychol (Hove) 2018. [DOI: 10.1177/1747021817743439] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
When confronted with an insight problem, some factors limit our capacity to discover the optimal solution. Previous research on problem solving has shown that the first idea that comes to participants’ minds can inhibit them from finding better alternative solutions. We used a magic trick to demonstrate that this mind fixing effect is more general than previously thought: a solution that participants knew to be incorrect and impossible inhibited the discovery of an easy alternative. We show that a simple exposure to an obvious false solution (e.g., the magician hides the card in the palm of his hand to secretly transfer it to his back pocket) can inhibit participants from finding the real secret of the trick (e.g., he used a duplicate card), even if the magician proves that this false solution is impossible (e.g., he shows his hand is empty). We discuss the psychological processes underlying this robust fixing effect.
Collapse
Affiliation(s)
- Cyril Thomas
- Department of Psychology, Goldsmiths, University of London, London, UK
| | - André Didierjean
- Laboratoire de Psychologie and MSHE, Université Bourgogne-Franche-Comté, Besançon, France
| | - Gustav Kuhn
- Department of Psychology, Goldsmiths, University of London, London, UK
| |
Collapse
|
12
|
Yi W, Kang MS, Lee KM. Visual attribute modulates the time course of iconic memory decay. VISUAL COGNITION 2017. [DOI: 10.1080/13506285.2017.1416007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
- Woojong Yi
- Interdisciplinary Program of Cognitive Science, Seoul National University, Seoul, Republic of Korea
| | - Min-Suk Kang
- Department of Psychology, Sungkyunkwan University, Seoul, Republic of Korea
- Center for Neuroscience Imaging Research (CNIR), Institute for Basic Science (IBS), Suwon, Republic of Korea
| | - Kyoung-Min Lee
- Interdisciplinary Program of Cognitive Science, Seoul National University, Seoul, Republic of Korea
- Department of Neurology, Seoul National University Hospital, Seoul, Republic of Korea
| |
Collapse
|
13
|
Aru J, Bachmann T. Expectation creates something out of nothing: The role of attention in iconic memory reconsidered. Conscious Cogn 2017; 53:203-210. [PMID: 28687418 DOI: 10.1016/j.concog.2017.06.017] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2017] [Revised: 06/16/2017] [Accepted: 06/28/2017] [Indexed: 12/27/2022]
Abstract
Conscious experience is modulated by attention and expectation, yet is believed to be independent of attention. The experiments on iconic memory (IM) are usually taken as support for this claim. However, a recent experiment demonstrated that when attention is diverted away from the IM letter display subjects fail to see the absence of IM letters. Here we contribute to the ongoing debate by overcoming experimental shortcomings of this previous experiment, by measuring subjective visibility and by testing the effect of the post-cue. We were able to replicate these earlier findings and extend them by demonstrating that subjects who do not realize the absence of letters perceive illusory letters. This result means that there is still phenomenal consciousness, even when attention is diverted. Expectation creates illusory content that overwrites valid IM content. Taken together these findings suggest that the present experimental paradigm is not appropriate to make claims about IM content.
Collapse
Affiliation(s)
- Jaan Aru
- Institute of Penal Law, University of Tartu, Estonia; Institute of Computer Science, University of Tartu, Estonia.
| | | |
Collapse
|
14
|
Thomas C, Didierjean A, Maquestiaux F, Gygax P. Does Magic Offer a Cryptozoology Ground for Psychology? REVIEW OF GENERAL PSYCHOLOGY 2015. [DOI: 10.1037/gpr0000041] [Citation(s) in RCA: 32] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Affiliation(s)
- Cyril Thomas
- Laboratoire de Psychologie, Université de Franche-Comté
| | | | | | - Pascal Gygax
- Département de Psychologie, Université de Fribourg
| |
Collapse
|
15
|
|
16
|
Kafaligonul H, Breitmeyer BG, Öğmen H. Feedforward and feedback processes in vision. Front Psychol 2015; 6:279. [PMID: 25814974 PMCID: PMC4357201 DOI: 10.3389/fpsyg.2015.00279] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2015] [Accepted: 02/25/2015] [Indexed: 11/13/2022] Open
Affiliation(s)
- Hulusi Kafaligonul
- National Magnetic Resonance Research Center (UMRAM), Bilkent University Ankara, Turkey
| | - Bruno G Breitmeyer
- Department of Psychology, University of Houston Houston, TX, USA ; Center for Neuro-Engineering and Cognitive Science, University of Houston Houston, TX, USA
| | - Haluk Öğmen
- Center for Neuro-Engineering and Cognitive Science, University of Houston Houston, TX, USA ; Department of Electrical and Computer Engineering, University of Houston Houston, TX, USA
| |
Collapse
|
17
|
VQone MATLAB toolbox: A graphical experiment builder for image and video quality evaluations: VQone MATLAB toolbox. Behav Res Methods 2015; 48:138-50. [PMID: 25595311 DOI: 10.3758/s13428-014-0555-y] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2014] [Revised: 11/27/2014] [Accepted: 12/05/2014] [Indexed: 11/08/2022]
Abstract
This article presents VQone, a graphical experiment builder, written as a MATLAB toolbox, developed for image and video quality ratings. VQone contains the main elements needed for the subjective image and video quality rating process. This includes building and conducting experiments and data analysis. All functions can be controlled through graphical user interfaces. The experiment builder includes many standardized image and video quality rating methods. Moreover, it enables the creation of new methods or modified versions from standard methods. VQone is distributed free of charge under the terms of the GNU general public license and allows code modifications to be made so that the program's functions can be adjusted according to a user's requirements. VQone is available for download from the project page (http://www.helsinki.fi/psychology/groups/visualcognition/).
Collapse
|