1
|
Manassi M, Murai Y, Whitney D. Serial dependence in visual perception: A meta-analysis and review. J Vis 2023; 23:18. [PMID: 37642639 PMCID: PMC10476445 DOI: 10.1167/jov.23.8.18] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Accepted: 07/12/2023] [Indexed: 08/31/2023] Open
Abstract
Positive sequential dependencies are phenomena in which actions, perception, decisions, and memory of features or objects are systematically biased toward visual experiences from the recent past. Among many labels, serial dependencies have been referred to as priming, sequential dependencies, sequential effects, or serial effects. Despite extensive research on the topic, the field still lacks an operational definition of what counts as serial dependence. In this meta-analysis, we review the vast literature on serial dependence and quantitatively assess its key diagnostic characteristics across several different domains of visual perception. The meta-analyses fully characterize serial dependence in orientation, face, and numerosity perception. They show that serial dependence is defined by four main kinds of tuning: serial dependence decays with time (temporal-tuning), it depends on relative spatial location (spatial-tuning), it occurs only between similar features and objects (feature-tuning), and it is modulated by attention (attentional-tuning). We also review studies of serial dependence that report single observer data, highlighting the importance of individual differences in serial dependence. Finally, we discuss a range of outstanding questions and novel research avenues that are prompted by the meta-analyses. Together, the meta-analyses provide a full characterization of serial dependence as an operationally defined family of visual phenomena, and they outline several of the key diagnostic criteria for serial dependence that should serve as guideposts for future research.
Collapse
Affiliation(s)
- Mauro Manassi
- School of Psychology, University of Aberdeen, King's College, Aberdeen, UK
| | - Yuki Murai
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, Osaka, Japan
| | - David Whitney
- Department of Psychology University of California, Berkeley, CA, USA
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA
- Vision Science Group, University of California, Berkeley, CA, USA
| |
Collapse
|
2
|
Haseeb Z, Wolfe B, Kosovicheva A. Spatial variability in localization biases predicts crowding performance. J Vis 2023; 23:9. [PMID: 37432845 DOI: 10.1167/jov.23.7.9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/13/2023] Open
Abstract
Visual processing varies substantially across individuals, and prior work has shown significant individual differences in fundamental processes such as spatial localization. For example, when asked to report the location of a briefly flashed target in the periphery, different observers systematically misperceive its location in an idiosyncratic manner, showing different patterns of reproduction error across visual field locations. In this study, we tested whether these individual differences may propagate to other stages of visual processing, affecting the strength of visual crowding, which depends on the spacing between objects in the periphery. We, therefore, investigated the relationship between observers' idiosyncratic biases in localization and the strength of crowding to determine whether these spatial biases limit peripheral object recognition. To examine this relationship, we measured the strength of crowding at 12 locations at 8° eccentricity, in addition to the perceived spacing between pairs of Gaussian patches at these same locations. These measurements show an association between variability in crowding strength and perceived spacing at the same visual field locations: at locations where a participant experienced stronger crowding, their perceived spacing was smaller, and vice versa. We demonstrate that spatial heterogeneity in perceived spacing affects observers' ability to recognize objects in the periphery. Our results support the idea that variability in both spatial sensitivity and bias contribute to variability in the strength of crowding and bolster the account that variability in spatial coding may propagate across multiple stages of visual processing.
Collapse
Affiliation(s)
- Zainab Haseeb
- Department of Psychology, University of Toronto Mississauga, Mississauga, Ontario, Canada
- https://applylab.org/
| | - Benjamin Wolfe
- Department of Psychology, University of Toronto Mississauga, Mississauga, Ontario, Canada
- https://applylab.org/
| | - Anna Kosovicheva
- Department of Psychology, University of Toronto Mississauga, Mississauga, Ontario, Canada
- https://applylab.org/
| |
Collapse
|
3
|
Ren Z, Canas-Bajo T, Ghirardo C, Manassi M, Yu SX, Whitney D. Serial dependence in perception across naturalistic generative adversarial network-generated mammogram. J Med Imaging (Bellingham) 2023; 10:045501. [PMID: 37408983 PMCID: PMC10319294 DOI: 10.1117/1.jmi.10.4.045501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Revised: 05/12/2023] [Accepted: 06/20/2023] [Indexed: 07/07/2023] Open
Abstract
Purpose Human perception and decisions are biased toward previously seen stimuli. This phenomenon is known as serial dependence and has been extensively studied for the last decade. Recent evidence suggests that clinicians' judgments of mammograms might also be impacted by serial dependence. However, the stimuli used in previous psychophysical experiments on this question, consisting of artificial geometric shapes and healthy tissue backgrounds, were unrealistic. We utilized realistic and controlled generative adversarial network (GAN)-generated radiographs to mimic images that clinicians typically encounter. Approach Mammograms from the digital database for screening mammography (DDSM) were utilized to train a GAN. This pretrained GAN was then adopted to generate a large set of authentic-looking simulated mammograms: 20 circular morph continuums, each with 147 images, for a total of 2940 images. Using these stimuli in a standard serial dependence experiment, participants viewed a random GAN-generated mammogram on each trial and subsequently matched the GAN-generated mammogram encountered using a continuous report. The characteristics of serial dependence from each continuum were analyzed. Results We found that serial dependence affected the perception of all naturalistic GAN-generated mammogram morph continuums. In all cases, the perceptual judgments of GAN-generated mammograms were biased toward previously encountered GAN-generated mammograms. On average, perceptual decisions had 7% categorization errors that were pulled in the direction of serial dependence. Conclusions Serial dependence was found even in the perception of naturalistic GAN-generated mammograms created by a GAN. This supports the idea that serial dependence could, in principle, contribute to decision errors in medical image perception tasks.
Collapse
Affiliation(s)
- Zhihang Ren
- University of California, Berkeley, Vision Science Graduate Group, Berkeley, California, United States
| | - Teresa Canas-Bajo
- University of California, Berkeley, Vision Science Graduate Group, Berkeley, California, United States
| | - Cristina Ghirardo
- University of California, Berkeley, Department of Psychology, Berkeley, California, United States
| | - Mauro Manassi
- University of Aberdeen, King’s College, School of Psychology, Aberdeen, United Kingdom
| | - Stella X. Yu
- University of California, Berkeley, Vision Science Graduate Group, Berkeley, California, United States
- University of Michigan, Department of Electrical Engineering and Computer Science, Ann Arbor, Michigan, United States
| | - David Whitney
- University of California, Berkeley, Vision Science Graduate Group, Berkeley, California, United States
- University of California, Berkeley, Department of Psychology, Berkeley, California, United States
- University of California, Berkeley, Helen Wills Neuroscience Institute, Berkeley, California, United States
| |
Collapse
|
4
|
Wang Z, Manassi M, Ren Z, Ghirardo C, Canas-Bajo T, Murai Y, Zhou M, Whitney D. Idiosyncratic biases in the perception of medical images. Front Psychol 2022; 13:1049831. [PMID: 36600706 PMCID: PMC9806180 DOI: 10.3389/fpsyg.2022.1049831] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Accepted: 11/29/2022] [Indexed: 12/23/2022] Open
Abstract
Introduction Radiologists routinely make life-altering decisions. Optimizing these decisions has been an important goal for many years and has prompted a great deal of research on the basic perceptual mechanisms that underlie radiologists' decisions. Previous studies have found that there are substantial individual differences in radiologists' diagnostic performance (e.g., sensitivity) due to experience, training, or search strategies. In addition to variations in sensitivity, however, another possibility is that radiologists might have perceptual biases-systematic misperceptions of visual stimuli. Although a great deal of research has investigated radiologist sensitivity, very little has explored the presence of perceptual biases or the individual differences in these. Methods Here, we test whether radiologists' have perceptual biases using controlled artificial and Generative Adversarial Networks-generated realistic medical images. In Experiment 1, observers adjusted the appearance of simulated tumors to match the previously shown targets. In Experiment 2, observers were shown with a mix of real and GAN-generated CT lesion images and they rated the realness of each image. Results We show that every tested individual radiologist was characterized by unique and systematic perceptual biases; these perceptual biases cannot be simply explained by attentional differences, and they can be observed in different imaging modalities and task settings, suggesting that idiosyncratic biases in medical image perception may widely exist. Discussion Characterizing and understanding these biases could be important for many practical settings such as training, pairing readers, and career selection for radiologists. These results may have consequential implications for many other fields as well, where individual observers are the linchpins for life-altering perceptual decisions.
Collapse
Affiliation(s)
- Zixuan Wang
- Department of Psychology, University of California, Berkeley, Berkeley, CA, United States,*Correspondence: Zixuan Wang,
| | - Mauro Manassi
- School of Psychology, University of Aberdeen, King’s College, Aberdeen, United Kingdom
| | - Zhihang Ren
- Department of Psychology, University of California, Berkeley, Berkeley, CA, United States,Vision Science Group, University of California, Berkeley, Berkeley, CA, United States
| | - Cristina Ghirardo
- Department of Psychology, University of California, Berkeley, Berkeley, CA, United States
| | - Teresa Canas-Bajo
- Department of Psychology, University of California, Berkeley, Berkeley, CA, United States,Vision Science Group, University of California, Berkeley, Berkeley, CA, United States
| | - Yuki Murai
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, Koganei, Japan
| | - Min Zhou
- Department of Pediatrics, The First People's Hospital of Shuangliu District, Chengdu, Sichuan, China
| | - David Whitney
- Department of Psychology, University of California, Berkeley, Berkeley, CA, United States,Vision Science Group, University of California, Berkeley, Berkeley, CA, United States,Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, United States
| |
Collapse
|
5
|
Structure of visual biases revealed by individual differences. Vision Res 2022; 195:108014. [DOI: 10.1016/j.visres.2022.108014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Revised: 01/14/2022] [Accepted: 01/19/2022] [Indexed: 11/21/2022]
|
6
|
Abstract
Redundancy masking is the reduction of the perceived number of items in repeating patterns. It shares a number of characteristics with crowding, the impairment of target identification in visual clutter. Crowding strongly depends on the location of the target in the visual field. For example, it is stronger in the upper compared to the lower visual field and is usually weakest on the horizontal meridian. This pattern of visual field asymmetries is common in spatial vision, as revealed by tasks measuring, for example, spatial resolution and contrast sensitivity. Here, to characterize redundancy masking and reveal its similarities to and differences from other spatial tasks, we investigated whether redundancy masking shows the same typical visual field asymmetries. Observers were presented with three to six radially arranged lines at 10° eccentricity at one of eight locations around fixation and were asked to report the number of lines. We found asymmetries that differed pronouncedly from those found in crowding. Redundancy masking did not differ between upper and lower visual fields. Importantly, redundancy masking was stronger on the horizontal meridian than on the vertical meridian, the opposite of what is usually found in crowding. These results show that redundancy masking diverges from crowding in regard to visual field asymmetries, suggesting different underlying mechanisms of redundancy masking and crowding. We suggest that the observed atypical visual field asymmetries in redundancy masking are due to the superior extraction of regularity and a more pronounced compression of visual space on the horizontal compared to the vertical meridian.
Collapse
Affiliation(s)
| | - Daniel R Coates
- Institute of Psychology, University of Bern, Bern, Switzerland.,College of Optometry, University of Houston, Houston, TX, USA.,
| | - Bilge Sayim
- Institute of Psychology, University of Bern, Bern, Switzerland.,Sciences Cognitives et Sciences Affectives (SCALab), CNRS, UMR 9193, University of Lille, Lille, France.,
| |
Collapse
|
7
|
Kondo A, Murai Y, Whitney D. The test-retest reliability and spatial tuning of serial dependence in orientation perception. J Vis 2022; 22:5. [PMID: 35293956 PMCID: PMC8944387 DOI: 10.1167/jov.22.4.5] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
Humans perceive objects and scenes consistently, even in situations where visual input is noisy and unstable. One of the mechanisms that underlies this perceptual stability is serial dependence, whereby the perception of objects or features at any given moment is pulled toward what was previously seen. Although recent findings from several studies have reported large individual differences in serial dependence, it is not clear how stable the serial dependence is within an individual. Here, we investigated the stability of serial dependence in orientation perception over two different days within the same observers. In addition, we also examined the visual field location specificity of perceptual serial dependence. On each trial, observers viewed a Gabor patch and then reported its apparent orientation by adjusting the orientation of a bar. For each observer, the Gabor was located in the foveal or peripheral (10° right or left eccentricity) visual field on both days or changed location from day to day. The results showed a very high degree of test-retest reliability in serial dependence measured across days within individual observers. Interestingly, this high within-subject consistency was only found when serial dependence was measured at the same visual field location. These results suggest that individual differences in serial dependence are stable across days, and that the spatiotemporal range in which the previous stimulus assimilates the perception of the current stimulus (the continuity field) may vary across different visual field locations in an observer-specific manner.
Collapse
Affiliation(s)
- Aki Kondo
- Waseda Institute for Advanced Study, Waseda University, Tokyo, Japan.,
| | - Yuki Murai
- University of California, Berkeley, Berkeley, CA, USA.,Osaka University, Osaka, Japan.,Japan Society for the Promotion of Science, Tokyo, Japan.,
| | - David Whitney
- University of California, Berkeley, Berkeley, CA, USA.,
| |
Collapse
|
8
|
Manassi M, Ghirardo C, Canas-Bajo T, Ren Z, Prinzmetal W, Whitney D. Serial dependence in the perceptual judgments of radiologists. COGNITIVE RESEARCH-PRINCIPLES AND IMPLICATIONS 2021; 6:65. [PMID: 34648124 PMCID: PMC8517058 DOI: 10.1186/s41235-021-00331-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Accepted: 08/21/2021] [Indexed: 11/10/2022]
Abstract
In radiological screening, clinicians scan myriads of radiographs with the intent of recognizing and differentiating lesions. Even though they are trained experts, radiologists’ human search engines are not perfect: average daily error rates are estimated around 3–5%. A main underlying assumption in radiological screening is that visual search on a current radiograph occurs independently of previously seen radiographs. However, recent studies have shown that human perception is biased by previously seen stimuli; the bias in our visual system to misperceive current stimuli towards previous stimuli is called serial dependence. Here, we tested whether serial dependence impacts radiologists’ recognition of simulated lesions embedded in actual radiographs. We found that serial dependence affected radiologists’ recognition of simulated lesions; perception on an average trial was pulled 13% toward the 1-back stimulus. Simulated lesions were perceived as biased towards the those seen in the previous 1 or 2 radiographs. Similar results were found when testing lesion recognition in a group of untrained observers. Taken together, these results suggest that perceptual judgements of radiologists are affected by previous visual experience, and thus some of the diagnostic errors exhibited by radiologists may be caused by serial dependence from previously seen radiographs.
Collapse
Affiliation(s)
- Mauro Manassi
- School of Psychology, King's College, University of Aberdeen, Aberdeen, UK.
| | - Cristina Ghirardo
- Department of Psychology, University of California, Berkeley, CA, USA
| | - Teresa Canas-Bajo
- Department of Psychology, University of California, Berkeley, CA, USA.,Vision Science Group, University of California, Berkeley, CA, USA
| | - Zhihang Ren
- Department of Psychology, University of California, Berkeley, CA, USA.,Vision Science Group, University of California, Berkeley, CA, USA
| | | | - David Whitney
- Department of Psychology, University of California, Berkeley, CA, USA.,Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA.,Vision Science Group, University of California, Berkeley, CA, USA
| |
Collapse
|