1
|
Xie T, Fu S. Enhancing change perception through object-based attention. Atten Percept Psychophys 2025:10.3758/s13414-025-03086-7. [PMID: 40360864 DOI: 10.3758/s13414-025-03086-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/23/2025] [Indexed: 05/15/2025]
Abstract
Change perception refers to the sensitivity in perceiving changes, yet its modulation by objects has been less studied. To address this question, the gap-contingent technique was employed in the double-rectangle paradigm, with two rectangles briefly inserted between the pre-changed and post-changed stimuli. The changed items could either occur in the same rectangle (within condition) or across two rectangles (between condition). In Experiment 1, participants showed faster response times (RTs) when changes occurred within the same object compared to when changes occurred across different objects, indicating an object-based attention (OBA) effect. In the following experiments, factors such as the number of changes (Experiment 2), RT limit (Experiment 3), task difficulty (Experiment 4), and task relevance of the objects (Experiment 5) were considered, and the OBA effect was consistently observed across experiments. Additionally, the drift-diffusion model revealed faster information accumulation when changes occurred within the same object, providing further evidence for the object-based enhancement of change perception. In conclusion, the present study suggested that changes occurring within the same object are perceived better, highlighting the role of object-based attention in enhancing perceptual sensitivity.
Collapse
Affiliation(s)
- Tong Xie
- Department of Psychology and Center for Brain and Cognitive Sciences, School of Education, Guangzhou University, Guangzhou, 510006, China
| | - Shimin Fu
- Department of Psychology and Center for Brain and Cognitive Sciences, School of Education, Guangzhou University, Guangzhou, 510006, China.
| |
Collapse
|
2
|
Mason LA, Miller A, Hughes G, Taylor HA. Something's different: elaboration's transferrable role for false alarm reduction. Cogn Res Princ Implic 2025; 10:12. [PMID: 40102247 PMCID: PMC11920462 DOI: 10.1186/s41235-025-00623-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2024] [Accepted: 02/26/2025] [Indexed: 03/20/2025] Open
Abstract
False alarming, or detecting an error when there is not one, is a pervasive problem across numerous industries. The present study investigated the role of elaboration, or additional information about non-error differences in complex visual displays, for mitigating false error responding. In Experiment 1, learners studied errors and non-error differences about a virtual LEGO® model. Half of the participants received information about the error (location, omission, orientation) and difference (color, addition) categorization and identification (i.e., what constituted the error or difference). The other half of participants received the same information plus further elaboration about (1) the potential consequences of errors and (2) why differences would not pose potential problems. Receiving additional elaboration about errors and differences aided learners' ability to accurately reject non-error differences at test. Experiment 2 replicated these results with a new stimulus model and extended findings by testing whether receiving elaboration on the first model transferred to support learning in a second, similar model that did not provide elaborations. Our results replicated and extended findings from Experiment 1, such that learners who received elaboration while learning the first model also performed better at correctly rejecting non-error differences at test on the second model. Taken together, our findings provide insight on the transferrable role of feature elaboration to reduce false alarm rates during complex visual display assessments.
Collapse
Affiliation(s)
- Lauren A Mason
- Tufts University, 490 Boston Ave., Medford, MA, 02155, USA.
| | - Abigail Miller
- Tufts University, 490 Boston Ave., Medford, MA, 02155, USA
| | - Gregory Hughes
- U.S. Army DEVCOM Soldier Center, 15 General Greene Ave., Natick, MA, 01760, USA
| | - Holly A Taylor
- Tufts University, 490 Boston Ave., Medford, MA, 02155, USA
- Center for Applied Brain and Cognitive Sciences, Tufts University, 177 College Ave., Medford, MA, 02155, USA
| |
Collapse
|
3
|
Xie Y, Zhao T, Zhang W, Chen Q, Qiu A, Li Y, Ku Y. Neural deterioration and compensation in visual short-term memory among individuals with amnestic mild cognitive impairment. Alzheimers Dement 2025; 21:e14475. [PMID: 39822072 PMCID: PMC11848150 DOI: 10.1002/alz.14475] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2024] [Revised: 11/01/2024] [Accepted: 11/22/2024] [Indexed: 01/19/2025]
Abstract
INTRODUCTION Visual short-term memory (VSTM) is a critical indicator of Alzheimer's disease (AD), but whether its neural substrates could adapt to early disease progression and contribute to cognitive resilience in amnestic mild cognitive impairment (aMCI) has been unclear. METHODS Fifty-five aMCI patients and 68 normal controls (NC) performed a change-detection task and underwent multimodal neuroimaging scanning. RESULTS Among the atrophic brain regions in aMCI, VSTM performance correlated with the volume of the right prefrontal cortex (PFC) but not the medial temporal lobe (MTL), and this correlation was mainly present in patients with greater MTL atrophy. Furthermore, VSTM was primarily correlated with frontal structural connectivity in aMCI but was correlated with more distributed frontal and MTL connectivity in NC. DISCUSSION This study provided evidence on neural adaptation in the precursor stages of AD, highlighting the compensatory role of PFC as MTL deteriorated and suggesting potential targets in early intervention for cognitive preservation. HIGHLIGHTS Atrophic left medial temporal lobe (MTL) no longer correlated with visual short-term memory (VSTM) in amnestic mild cognitive impairment (aMCI). Atrophic right middle frontal area continued to correlate with VSTM in aMCI. Frontal brain-behavior correlation was mainly present in the aMCI subgroup with greater medial temporal lobe (MTL) atrophy. Reliance of VSTM on frontal connectivity increased in compensation for MTL dysfunction.
Collapse
Affiliation(s)
- Ye Xie
- Guangdong Provincial Key Laboratory of Brain Function and DiseaseCenter for Brain and Mental Well‐BeingDepartment of PsychologySun Yat‐sen UniversityGuangzhouChina
- School of PsychologyShenzhen UniversityShenzhenChina
| | - Tinghao Zhao
- Guangdong Provincial Key Laboratory of Brain Function and DiseaseCenter for Brain and Mental Well‐BeingDepartment of PsychologySun Yat‐sen UniversityGuangzhouChina
| | - Wei Zhang
- Department of NeurologyShanghai Pudong HospitalFudan University Pudong Medical CenterPudongShanghaiChina
- Department of NeurologyTongji HospitalSchool of MedicineTongji UniversityShanghaiChina
| | - Qi Chen
- School of PsychologyShenzhen UniversityShenzhenChina
| | - Anqi Qiu
- Department of Health Technology and InformaticsHong Kong Polytechnic UniversityHong KongChina
| | - Yunxia Li
- Department of NeurologyShanghai Pudong HospitalFudan University Pudong Medical CenterPudongShanghaiChina
- Department of NeurologyTongji HospitalSchool of MedicineTongji UniversityShanghaiChina
- Shanghai Key Laboratory of Vascular Lesions Regulation and RemodelingPudongShanghaiChina
| | - Yixuan Ku
- Guangdong Provincial Key Laboratory of Brain Function and DiseaseCenter for Brain and Mental Well‐BeingDepartment of PsychologySun Yat‐sen UniversityGuangzhouChina
- Peng Cheng LaboratoryShenzhenChina
| |
Collapse
|
4
|
Allegretti E, D'Innocenzo G, Coco MI. The Visual Integration of Semantic and Spatial Information of Objects in Naturalistic Scenes (VISIONS) database: attentional, conceptual, and perceptual norms. Behav Res Methods 2025; 57:42. [PMID: 39753746 DOI: 10.3758/s13428-024-02535-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/23/2024] [Indexed: 01/11/2025]
Abstract
The complex interplay between low- and high-level mechanisms governing our visual system can only be fully understood within ecologically valid naturalistic contexts. For this reason, in recent years, substantial efforts have been devoted to equipping the scientific community with datasets of realistic images normed on semantic or spatial features. Here, we introduce VISIONS, an extensive database of 1136 naturalistic scenes normed on a wide range of perceptual and conceptual norms by 185 English speakers across three levels of granularity: isolated object, whole scene, and object-in-scene. Each naturalistic scene contains a critical object systematically manipulated and normed regarding its semantic consistency (e.g., a toothbrush vs. a flashlight in a bathroom) and spatial position (i.e., left, right). Normative data are also available for low- (i.e., clarity, visual complexity) and high-level (i.e., name agreement, confidence, familiarity, prototypicality, manipulability) features of the critical object and its embedding scene context. Eye-tracking data during a free-viewing task further confirms the experimental validity of our manipulations while theoretically demonstrating that object semantics is acquired in extra-foveal vision and used to guide early overt attention. To our knowledge, VISIONS is the first database exhaustively covering norms about integrating objects in scenes and providing several perceptual and conceptual norms of the two as independently taken. We expect VISIONS to become an invaluable image dataset to examine and answer timely questions above and beyond vision science, where a diversity of perceptual, attentive, mnemonic, or linguistic processes could be explored as they develop, age, or become neuropathological.
Collapse
Affiliation(s)
- Elena Allegretti
- Department of Psychology, Sapienza, University of Rome, Rome, Italy.
| | | | - Moreno I Coco
- Department of Psychology, Sapienza, University of Rome, Rome, Italy.
- I.R.C.C.S. Fondazione Santa Lucia, Rome, Italy.
| |
Collapse
|
5
|
Haase TM, Rich AN, Gilchrist ID, Kent C. Attention moderates the motion silencing effect for dynamic orientation changes in a discrimination task. J Vis 2024; 24:13. [PMID: 39705049 DOI: 10.1167/jov.24.13.13] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2024] Open
Abstract
Being able to detect changes in our visual environment reliably and quickly is important for many daily tasks. The motion silencing effect describes a decrease in the ability to detect feature changes for faster moving objects compared with stationary or slowly moving objects. One theory is that spatiotemporal receptive field properties in early vision might account for the silencing effect, suggesting that its origins are low-level visual processing. Here, we explore whether spatial attention can modulate motion silencing of orientation changes to gain greater understanding of the underlying mechanisms. In Experiment 1, we confirm that the motion silencing effect occurs for the discrimination of orientation changes. In Experiment 2, we use a Posner-style cueing paradigm to investigate whether manipulating covert attention modulates motion silencing for orientation. The results show a clear spatial cueing effect: Participants were able to discriminate orientation changes successfully at higher velocities when the cue was valid compared to neutral cues and performance was worst when the cue was invalid. These results show that motion silencing can be modulated by directing spatial attention toward a moving target and provides support for a role for higher level processes, such as attention, in motion silencing of orientation changes.
Collapse
Affiliation(s)
- Tabea-Maria Haase
- School of Psychological Science, University of Bristol, Bristol, UK
- Macquarie University Performance and Expertise Research Centre and School of Psychological Sciences, Macquarie University, Sydney, Australia
| | - Anina N Rich
- Macquarie University Performance and Expertise Research Centre and School of Psychological Sciences, Macquarie University, Sydney, Australia
| | - Iain D Gilchrist
- School of Psychological Science, University of Bristol, Bristol, UK
| | - Christopher Kent
- School of Psychological Science, University of Bristol, Bristol, UK
| |
Collapse
|
6
|
Favieri F, Troisi G, Forte G, Corbo I, Marselli G, Blasutto B, Ponce R, Di Pace E, Langher V, Tambelli R, Casagrande M. Effects of bottom-up and top-down attentional processes on change blindness for COVID-related stimuli: influence of heart rate variability. Front Neurosci 2024; 18:1458627. [PMID: 39649660 PMCID: PMC11621853 DOI: 10.3389/fnins.2024.1458627] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2024] [Accepted: 11/01/2024] [Indexed: 12/11/2024] Open
Abstract
Introduction Top-down mechanisms that regulate attentional control are influenced by task demands and individuals' goals, while bottom-up processes are influenced by salient stimuli. Analogous networks are involved in both processes (e.g., frontostriatal areas). However, they are affected differently by the emotional salience of stimuli, which determines the allocation of attention. This study aims to determine whether the recent pandemic experience continues to exert an influence on cognitive processes. To this end, the study will determine attentional biases toward pandemic-related stimuli compared to negative and neutral stimuli. Furthermore, the study will investigate whether pandemic-related stimuli influence top-down and bottom-up attentional processes and whether the latter affect autonomic control as indexed by Heart Rate Variability (HRV). Methods Ninety-six undergraduate students completed a Flicker Task with stimuli categorized by emotional valence (neutral, negative non-COVID, negative COVID-related). This paradigm involves the presentation of two different pictures, which are identical except for a specific detail. The task required to detect the specific detail that has been changed. Given that the task employs images of natural scenes, participants tend to focus more on specific areas of the scene than others. As a result, changes in central interest (CI) areas are detected more rapidly than changes in marginal interest (MI) areas. Participants' response times (RTs) at the task and their HRV data were used to assess attentional performance and the associated autonomic nervous system activity. Results The results indicate slower responses to COVID-related stimuli than negative and neutral stimuli for both CI and MI changes, requiring the involvement of bottom-up (CI changes) and top-down (MI changes) processes. The HRV was associated with a slower detection of CI changes in COVID-related scenes. Discussion These findings highlight the intricate interplay between emotional salience, attentional mechanisms, and physiological responses to threatening stimuli. Contextual factors, particularly those related to pandemic-related stress, influence attentional processing and its relationship with autonomic activity.
Collapse
Affiliation(s)
- Francesca Favieri
- Department of Dynamic and Clinical Psychology and Health Studies, “Sapienza” University of Rome, Rome, Italy
| | - Giovanna Troisi
- Department of Psychology, “Sapienza” University of Rome, Rome, Italy
- Department of Experimental Psychology, and Mind, Brain, and Behavior Research Center (CIMCYC), University of Granada, Granada, Spain
| | - Giuseppe Forte
- Department of Dynamic and Clinical Psychology and Health Studies, “Sapienza” University of Rome, Rome, Italy
| | - Ilaria Corbo
- Department of Dynamic and Clinical Psychology and Health Studies, “Sapienza” University of Rome, Rome, Italy
| | - Giulia Marselli
- Department of Psychology, “Sapienza” University of Rome, Rome, Italy
| | - Barbara Blasutto
- Department of Psychology, “Sapienza” University of Rome, Rome, Italy
| | - Renato Ponce
- Department of Psychology, “Sapienza” University of Rome, Rome, Italy
- Department of Experimental Psychology, and Mind, Brain, and Behavior Research Center (CIMCYC), University of Granada, Granada, Spain
| | - Enrico Di Pace
- Department of Psychology, “Sapienza” University of Rome, Rome, Italy
| | - Viviana Langher
- Department of Dynamic and Clinical Psychology and Health Studies, “Sapienza” University of Rome, Rome, Italy
| | - Renata Tambelli
- Department of Dynamic and Clinical Psychology and Health Studies, “Sapienza” University of Rome, Rome, Italy
| | - Maria Casagrande
- Department of Dynamic and Clinical Psychology and Health Studies, “Sapienza” University of Rome, Rome, Italy
| |
Collapse
|
7
|
Cohen MA, Sung S, Alaoui Z. Familiarity Alters the Bandwidth of Perceptual Awareness. J Cogn Neurosci 2024; 36:1546-1556. [PMID: 38527082 DOI: 10.1162/jocn_a_02140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/27/2024]
Abstract
Results from paradigms like change blindness and inattentional blindness indicate that observers are unaware of numerous aspects of the visual world. However, intuition suggests that perceptual experience is richer than these results indicate. Why does it feel like we see so much when the data suggests we see so little? One possibility stems from the fact that experimental studies always present observers with stimuli that they have never seen before. Meanwhile, when forming intuitions about perceptual experience, observers reflect on their experiences with scenes with which they are highly familiar (e.g., their office). Does prior experience with a scene change the bandwidth of perceptual awareness? Here, we asked if observers were better at noticing alterations to the periphery in familiar scenes compared with unfamiliar scenes. We found that observers noticed changes to the periphery more frequently with familiar stimuli. Signal detection theoretic analyses revealed that when observers are unfamiliar with a stimulus, they are less sensitive at noticing (d') and are more conservative in their response criterion (c). Taken together, these results suggest that prior knowledge expands the bandwidth of perceptual awareness. It should be stressed that these results challenge the widely held idea that prior knowledge fills in perception. Overall, these findings highlight how prior knowledge plays an important role in determining the limits of perceptual experience and is an important factor to consider when attempting to reconcile the tension between empirical observation and personal introspection.
Collapse
|
8
|
Rosenbaum RS, Halilova JG, Agnihotri S, D'Angelo MC, Winocur G, Ryan JD, Moscovitch M. Dramatic changes to well-known places go unnoticed. Neuropsychologia 2024; 196:108818. [PMID: 38355037 DOI: 10.1016/j.neuropsychologia.2024.108818] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Accepted: 02/05/2024] [Indexed: 02/16/2024]
Abstract
How well do we know our city? It turns out, much more poorly than we might imagine. We used declarative memory and eye-tracking techniques to examine people's ability to detect modifications to real-world landmarks and scenes in Toronto locales with which they have had extensive experience. Participants were poor at identifying which scenes contained altered landmarks, whether the modification was to the landmarks' relative size, internal features, or relation to surrounding context. To determine whether an indirect measure would prove more sensitive, we tracked eye movements during viewing. Changes in overall visual exploration, but not to specific regions of change, were related to participants' explicit endorsement of scenes as modified. These results support the contention that very familiar landmarks are represented at a global or gist level, but not local or fine-grained, level. These findings offer a unified view of memory for gist across verbal and spatial domains, and across recent and remote memory, with implications for hippocampal-neocortical interactions.
Collapse
Affiliation(s)
- R S Rosenbaum
- York University, Toronto, ON, Canada; Rotman Research Institute, Baycrest, Toronto, ON, Canada.
| | | | - S Agnihotri
- York University, Toronto, ON, Canada; University of Toronto, ON, Canada
| | - M C D'Angelo
- Rotman Research Institute, Baycrest, Toronto, ON, Canada
| | - G Winocur
- Rotman Research Institute, Baycrest, Toronto, ON, Canada
| | - J D Ryan
- Rotman Research Institute, Baycrest, Toronto, ON, Canada; University of Toronto, ON, Canada
| | - M Moscovitch
- Rotman Research Institute, Baycrest, Toronto, ON, Canada; University of Toronto, ON, Canada
| |
Collapse
|
9
|
Lin Y, Stavans M, Li X, Baillargeon R. Infants can use temporary or scant categorical information to individuate objects. Cogn Psychol 2024; 149:101640. [PMID: 38412626 PMCID: PMC11113335 DOI: 10.1016/j.cogpsych.2024.101640] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Revised: 01/21/2024] [Accepted: 02/01/2024] [Indexed: 02/29/2024]
Abstract
In a standard individuation task, infants see two different objects emerge in alternation from behind a screen. If they can assign distinct categorical descriptors to the two objects, they expect to see both objects when the screen is lowered; if not, they have no expectation at all about what they will see (i.e., two objects, one object, or no object). Why is contrastive categorical information critical for success at this task? According to the kind account, infants must decide whether they are facing a single object with changing properties or two different objects with stable properties, and access to permanent, intrinsic, kind information for each object resolves this difficulty. According to the two-system account, however, contrastive categorical descriptors simply provide the object-file system with unique tags for individuating the two objects and for communicating about them with the physical-reasoning system. The two-system account thus predicts that any type of contrastive categorical information, however temporary or scant it may be, should induce success at the task. Two experiments examined this prediction. Experiment 1 tested 14-month-olds (N = 96) in a standard task using two objects that differed only in their featural properties. Infants succeeded at the task when the object-file system had access to contrastive temporary categorical descriptors derived from the objects' distinct causal roles in preceding support events (e.g., formerly a support, formerly a supportee). Experiment 2 tested 9-month-olds (N = 96) in a standard task using two objects infants this age typically encode as merely featurally distinct. Infants succeeded when the object-file system had access to scant categorical descriptors derived from the objects' prior inclusion in static arrays of similarly shaped objects (e.g., block-shaped objects, cylinder-shaped objects). These and control results support the two-system account's claim that in a standard task, contrastive categorical descriptors serve to provide the object-file system with unique tags for the two objects.
Collapse
Affiliation(s)
- Yi Lin
- Psychology Department, New York University, New York, NY 10003, USA.
| | - Maayan Stavans
- Psychology Department, University of Illinois at Urbana-Champaign, IL 61820, USA
| | - Xia Li
- Early Childhood Education/Arts Education, Brooklyn College, Brooklyn, NY 11210, USA
| | - Renée Baillargeon
- Psychology Department, University of Illinois at Urbana-Champaign, IL 61820, USA
| |
Collapse
|
10
|
Csikós N, Petro B, Kojouharova P, Gaál ZA, Czigler I. Automatic Change Detection in Interwoven Sequences: A Visual Mismatch Negativity Study. J Cogn Neurosci 2024; 36:534-550. [PMID: 38165736 DOI: 10.1162/jocn_a_02099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2024]
Abstract
In this study, we investigated whether the cognitive system, known to be able to register regular visual event sequences and the violation of these sequences automatically, had the capacity of processing two sequences simultaneously. To this end, we measured the visual mismatch negativity (vMMN) component of ERPs as interwoven event sequences simultaneously presented to the left and right side of the screen. One of the sequences consisted of geometric patterns (diamonds); the other, photographs of human faces. In successive cycles, parts of the stimuli vanished and then re-appeared (the OFF/ON method). The vanishing parts served as either standard (frequently vanishing parts) or infrequent (deviant) events, but these events were task-irrelevant. The 20 adult participants (age 21.40 ± 2.72 years) performed a visual tracking task, with the OFF/ON task being a passive oddball paradigm. According to the results, both OFF and ON events, and both diamond and face stimuli elicited the vMMN component, showing that the system underlying this activity is capable of processing two event sequences if the sequences consist of fairly different kind of objects as stimuli. The sLORETA analysis showed that the source of vMMN was more frequent contralaterally to the deviant event, and the sources comprised loci from ventral and dorsal structures, as well as some anterior loci.
Collapse
Affiliation(s)
- Nóra Csikós
- Research Centre for Natural Sciences, HUN-REN, Budapest, Hungary
- Budapest University of Technology and Economics
| | - Bela Petro
- Pázmány Péter Catholic University, Budapest, Hungary
| | | | - Zsófia Anna Gaál
- Research Centre for Natural Sciences, HUN-REN, Budapest, Hungary
| | - István Czigler
- Research Centre for Natural Sciences, HUN-REN, Budapest, Hungary
| |
Collapse
|
11
|
Qiu T, An Q, Wang J, Wang J, Qiu CW, Li S, Lv H, Cai M, Wang J, Cong L, Qu S. Vision-driven metasurfaces for perception enhancement. Nat Commun 2024; 15:1631. [PMID: 38388545 PMCID: PMC10883922 DOI: 10.1038/s41467-024-45296-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Accepted: 01/16/2024] [Indexed: 02/24/2024] Open
Abstract
Metasurfaces have exhibited unprecedented degree of freedom in manipulating electromagnetic (EM) waves and thus provide fantastic front-end interfaces for smart systems. Here we show a framework for perception enhancement based on vision-driven metasurface. Human's eye movements are matched with microwave radiations to extend the humans' perception spectrum. By this means, our eyes can "sense" visual information and invisible microwave information. Several experimental demonstrations are given for specific implementations, including a physiological-signal-monitoring system, an "X-ray-glasses" system, a "glimpse-and-forget" tracking system and a speech reception system for deaf people. Both the simulation and experiment results verify evident advantages in perception enhancement effects and improving information acquisition efficiency. This framework can be readily integrated into healthcare systems to monitor physiological signals and to offer assistance for people with disabilities. This work provides an alternative framework for perception enhancement and may find wide applications in healthcare, wearable devices, search-and-rescue and others.
Collapse
Affiliation(s)
- Tianshuo Qiu
- Department of Biomedical Engineering, Fourth Military Medical University, Xi'an, China
- Fundamentals Department, Air Force Engineering University, Xi'an, China
- State Key Laboratory of Millimeter Waves, Southeast University, Nanjing, China
| | - Qiang An
- Department of Biomedical Engineering, Fourth Military Medical University, Xi'an, China
| | - Jianqi Wang
- Department of Biomedical Engineering, Fourth Military Medical University, Xi'an, China.
| | - Jiafu Wang
- Aerospace metamaterials laboratory of SuZhou National Laboratory, Suzhou, China.
| | - Cheng-Wei Qiu
- Department of Electrical and Computer Engineering, National University of Singapore, Singapore, Singapore.
| | - Shiyong Li
- School of Integrated Circuits and Electronics, Beijing Institute of Technology, Beijing, China
| | - Hao Lv
- Department of Biomedical Engineering, Fourth Military Medical University, Xi'an, China.
| | - Ming Cai
- Fundamentals Department, Air Force Engineering University, Xi'an, China
| | - Jianyi Wang
- Department of Neurology, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, China
| | - Lin Cong
- Department of Biomedical Engineering, Fourth Military Medical University, Xi'an, China
| | - Shaobo Qu
- Aerospace metamaterials laboratory of SuZhou National Laboratory, Suzhou, China.
| |
Collapse
|
12
|
Cutler A, Rivest J, Cavanagh P. The role of memory color in visual attention. Atten Percept Psychophys 2024; 86:28-35. [PMID: 37217821 DOI: 10.3758/s13414-023-02714-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/15/2023] [Indexed: 05/24/2023]
Abstract
The expected color of an object influences how it is perceived. For example, a banana in a greyscale photo may appear slightly yellow because bananas are expected to be yellow. This phenomenon is known as the memory color effect (MCE), and the objects with a memory color are called "color-diagnostic." The MCE is theorized to be a top-down influence of color knowledge on visual perception. However, its validity has been questioned because most evidence for the MCE is based on subjective reports. Here a change detection task is used as an objective measure of the effect and the results show that change detection differs for color-diagnostic objects. Specifically, it was predicted and found that unnaturally colored color-diagnostic objects (e.g., a blue banana) would attract attention and thus be discovered more quickly and accurately. In the experiment, two arrays alternated with the target present in one array and absent in the other while all other objects remained unchanged. Participants had to find the target as quickly and accurately as possible. In the experimental condition, the targets were color-diagnostic objects (e.g., a banana) presented in either their natural (yellow) or an unnatural (blue) color. In the control condition, non-color-diagnostic objects (e.g., a mug) were presented with the same colors as the color-diagnostic objects. Unnaturally colored color-diagnostic objects were found more quickly, which suggests that the MCE is a top-down, preattentive process that can influence a nonsubjective visual perceptual task such as change detection.
Collapse
Affiliation(s)
- Anson Cutler
- Department of Psychology, Glendon College, Toronto, ON, Canada.
- Centre for Vision Research, York University, Toronto, ON, Canada.
| | - Josée Rivest
- Department of Psychology, Glendon College, Toronto, ON, Canada
- Centre for Vision Research, York University, Toronto, ON, Canada
| | - Patrick Cavanagh
- Department of Psychology, Glendon College, Toronto, ON, Canada
- Centre for Vision Research, York University, Toronto, ON, Canada
| |
Collapse
|
13
|
Wan Y, Sarter N. Attention Limitations in the Detection and Identification of Alarms in Close Temporal Proximity. HUMAN FACTORS 2024; 66:234-257. [PMID: 35012376 DOI: 10.1177/00187208211063991] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
OBJECTIVE The aim of this study was to establish the effects of simultaneous and asynchronous masking on the detection and identification of visual and auditory alarms in close temporal proximity. BACKGROUND In complex and highly coupled systems, malfunctions can trigger numerous alarms within a short period of time. During such alarm floods, operators may fail to detect and identify alarms due to asynchronous and simultaneous masking. To date, the effects of masking on detection and identification have been studied almost exclusively for two alarms during single-task performance. This research examines 1) how masking affects alarm detection and identification in multitask environments and 2) whether those effects increase as a function of the number of alarms. METHOD Two experiments were conducted using a simulation of a drone-based package delivery service. Participants were required to ensure package delivery and respond to visual and auditory alarms associated with eight drones. The alarms were presented at various stimulus onset asynchronies (SOAs). The dependent measures included alarm detection rate, identification accuracy, and response time. RESULTS Masking was observed intramodally and cross-modally for visual and auditory alarms. The SOAs at which asynchronous masking occurred were longer than reported in basic research on masking. The effects of asynchronous and, even more so, simultaneous masking became stronger as the number of alarms increased. CONCLUSION Masking can lead to breakdowns in the detection and identification of alarms in close temporal proximity in complex data-rich domains. APPLICATION The findings from this research provide guidance for the design of alarm systems.
Collapse
|
14
|
Li Y, Zhuang X, Ma G. Use of minimal working memory in visual comparison: An eye-tracking study. Perception 2023; 52:759-773. [PMID: 37583302 DOI: 10.1177/03010066231194488] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/17/2023]
Abstract
In this study, we used a novel application of the previous paradigm provided by Pomplun to examine the eye movement strategies of using minimal working memory in visual comparison. This paradigm includes two tasks: one is a free comparison and the other is a single sequential comparison. In the free comparison, participants can freely view two horizontally presented stimuli until they judge whether the two stimuli are the same or not. In the single sequential comparison, participants can only view the left-side stimuli one time, and when their eyes cross the invisible boundary at the center of the screen, the left-side stimuli disappear and the right-side stimuli appear. Participants need to judge whether the right-side stimuli are the same as the disappeared left-side stimuli. Eye movement data showed significant differences between the single sequential comparison and free comparison tasks that suggests the use of minimal working memory in free comparison. Moreover, when the number of items was more than three, an average of 2.87 items would be processed in each view sequence. Participants also used the alternating left-right reference strategy that made the shortest scan path with the use of minimal working memory. The typical eye movement strategy in visual comparison and its theoretical significance were discussed.
Collapse
Affiliation(s)
- Yijing Li
- Shaanxi Key Laboratory of Behavior and Cognitive Neuroscience, School of Psychology, Shaanxi Normal University, Xi'an, China
| | - Xiangling Zhuang
- Shaanxi Key Laboratory of Behavior and Cognitive Neuroscience, School of Psychology, Shaanxi Normal University, Xi'an, China
| | - Guojie Ma
- Shaanxi Key Laboratory of Behavior and Cognitive Neuroscience, School of Psychology, Shaanxi Normal University, Xi'an, China
| |
Collapse
|
15
|
Barzy M, Morgan R, Cook R, Gray KLH. Are social interactions preferentially attended in real-world scenes? Evidence from change blindness. Q J Exp Psychol (Hove) 2023; 76:2293-2302. [PMID: 36847458 PMCID: PMC10503233 DOI: 10.1177/17470218231161044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 10/03/2022] [Accepted: 11/02/2022] [Indexed: 03/01/2023]
Abstract
In change detection paradigms, changes to social or animate aspects of a scene are detected better and faster compared with non-social or inanimate aspects. While previous studies have focused on how changes to individual faces/bodies are detected, it is possible that individuals presented within a social interaction may be further prioritised, as the accurate interpretation of social interactions may convey a competitive advantage. Over three experiments, we explored change detection to complex real-world scenes, in which changes either occurred by the removal of (a) an individual on their own, (b) an individual who was interacting with others, or (c) an object. In Experiment 1 (N = 50), we measured change detection for non-interacting individuals versus objects. In Experiment 2 (N = 49), we measured change detection for interacting individuals versus objects. Finally, in Experiment 3 (N = 85), we measured change detection for non-interacting versus interacting individuals. We also ran an inverted version of each task to determine whether differences were driven by low-level visual features. In Experiments 1 and 2, we found that changes to non-interacting and interacting individuals were detected better and more quickly than changes to objects. We also found inversion effects for both non-interaction and interaction changes, whereby they were detected more quickly when upright compared with inverted. No such inversion effect was seen for objects. This suggests that the high-level, social content of the images was driving the faster change detection for social versus object targets. Finally, we found that changes to individuals in non-interactions were detected faster than those presented within an interaction. Our results replicate the social advantage often found in change detection paradigms. However, we find that changes to individuals presented within social interaction configurations do not appear to be more quickly and easily detected than those in non-interacting configurations.
Collapse
Affiliation(s)
- Mahsa Barzy
- School of Psychology and Clinical Language Sciences, University of Reading, Reading, UK
| | - Rachel Morgan
- School of Mathematics and Statistics, University of Reading, Reading, UK
| | - Richard Cook
- Department of Psychological Sciences, Birkbeck, University of London, London, UK
- Department of Psychology, University of York, York, UK
| | - Katie LH Gray
- School of Psychology and Clinical Language Sciences, University of Reading, Reading, UK
| |
Collapse
|
16
|
Sasin E, Markov Y, Fougnie D. Meaningful objects avoid attribute amnesia due to incidental long-term memories. Sci Rep 2023; 13:14464. [PMID: 37660090 PMCID: PMC10475071 DOI: 10.1038/s41598-023-41642-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Accepted: 08/29/2023] [Indexed: 09/04/2023] Open
Abstract
Attribute amnesia describes the failure to unexpectedly report the attribute of an attended stimulus, likely reflecting a lack of working memory consolidation. Previous studies have shown that unique meaningful objects are immune to attribute amnesia. However, these studies used highly dissimilar foils to test memory, raising the possibility that good performance at the surprise test was based on an imprecise (gist-like) form of long-term memory. In Experiment 1, we explored whether a more sensitive memory test would reveal attribute amnesia in meaningful objects. We used a four-alternative-forced-choice test with foils having mis-matched exemplar (e.g., apple pie/pumpkin pie) and/or state (e.g., cut/full) information. Errors indicated intact exemplar, but not state information. Thus, meaningful objects are vulnerable to attribute amnesia under the right conditions. In Experiments 2A-2D, we manipulated the familiarity signals of test items by introducing a critical object as a pre-surprise target. In the surprise trial, this critical item matched one of the foil choices. Participants selected the critical object more often than other items. By demonstrating that familiarity influences responses in this paradigm, we suggest that meaningful objects are not immune to attribute amnesia but instead side-step the effects of attribute amnesia.
Collapse
Affiliation(s)
- Edyta Sasin
- Department of Psychology, New York University Abu Dhabi, Abu Dhabi, UAE.
| | - Yuri Markov
- Department of Psychology, Goethe University Frankfurt, Frankfurt am Main, Germany
| | - Daryl Fougnie
- Department of Psychology, New York University Abu Dhabi, Abu Dhabi, UAE
| |
Collapse
|
17
|
Leising K, Magnotti J, Elliott C, Nerz J, Wright A. Properties of iconic and visuospatial working memory in pigeons and humans using a location change-detection procedure. Learn Behav 2023; 51:228-245. [PMID: 35882748 DOI: 10.3758/s13420-022-00539-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/11/2022] [Indexed: 11/08/2022]
Abstract
Tests of visuospatial memory following short (<1 s) and medium (1 to 30 s) delays have revealed characteristically different patterns of behavior in humans. These data have been interpreted as evidence for different memory systems operating during short (iconic memory) and long delays (working memory). Leising et al. (2019, Behavioural Processes, 169, Article 103957 ) found evidence for both systems in pigeons and humans completing a location change-detection task using a visual mask that disrupted accuracy following a short (100 ms), but not a long (1,000 ms) delay. Another common finding is that adding to-be-remembered items should disrupt accuracy after a long, but not short, delay. Experiments 1a and 1b reported this memory system crossover effect in pigeons and people, respectively, tested on location change detection with delays of 0, 100, and 1,000 ms and displays of two to 16 items. Experiments 2a and 2b reported that the color of the items had little (pigeons) or no (humans) effect on change-detection accuracy. Pigeons tested in Experiment 3 with longer delays (2,000, 4,000, and 8,000 ms) and large set sizes demonstrated the crossover effect with most displays but did not demonstrate an abrupt drop in accuracy characteristic of iconic memory. In Experiment 4, accuracy with novel types of change (color, shape, and size) was better after a 0-ms delay and above-chance levels on color and shape trials. These data demonstrate the memory system crossover effect in both humans and pigeons and expand our knowledge of the properties of memory systems across species.
Collapse
Affiliation(s)
- Ken Leising
- Department of Psychology, Texas Christian University, 2800 S. University Dr., Box 298920, Fort Worth, TX, 76129, USA.
| | - John Magnotti
- Department of Neurosurgery, University of Pennsylvania, Philadelphia, PA, USA
| | - Cheyenne Elliott
- Department of Psychology, Texas Christian University, 2800 S. University Dr., Box 298920, Fort Worth, TX, 76129, USA
| | - Jordan Nerz
- Department of Psychology, Texas Christian University, 2800 S. University Dr., Box 298920, Fort Worth, TX, 76129, USA
| | - Anthony Wright
- Department of Neurobiology and Anatomy, University of Texas Health Science Center, Houston, TX, USA
| |
Collapse
|
18
|
Hon N. Attention and expectation likely underlie temporal binding measured using the Libet Clock. Q J Exp Psychol (Hove) 2023; 76:2084-2093. [PMID: 36214087 DOI: 10.1177/17470218221132762] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/23/2023]
Abstract
An interesting finding that has emerged in studies of the sense of agency is that of a perceived compression of the temporal interval between actions and the outcomes they produce. This is generally referred to as temporal binding. Although temporal binding has been studied using various paradigms, possibly the most popular of these is the Libet Clock task. The Libet task is also interesting because it suggests that temporal binding can be decomposed into two components, one purportedly relating to actions and the other relating to outcomes. These are termed action binding and outcome binding, respectively. In this article, I focus specifically on temporal binding revealed using the Libet Clock task and propose the idea that attention underpins the action binding effect, while outcome binding, on the other hand, is driven by the effects of expectation.
Collapse
Affiliation(s)
- Nicholas Hon
- Department of Psychology, National University of Singapore, Singapore
| |
Collapse
|
19
|
Mancı E, Herold F, Günay E, Güdücü Ç, Müller NG, Bediz CŞ. The Influence of Acute Sprint Interval Training on the Cognitive Performance of Male Basketball Players: An Investigation of Expertise-Related Differences. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:4719. [PMID: 36981625 PMCID: PMC10048824 DOI: 10.3390/ijerph20064719] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Revised: 02/27/2023] [Accepted: 03/03/2023] [Indexed: 06/18/2023]
Abstract
Highly developed cognitive abilities are an important prerequisite for reaching elite athletic levels. This study aimed to investigate the effect of an acute sprint interval training (SIT) session on the cognitive performance of amateur and elite players. Eighteen amateur and ten elite male basketball players were included in this study. They were asked to perform an acute SIT consisting of the Wingate Test (i.e., four bouts of 30 s all-out sprints) on a cycle ergometer, interspersed with 4 min of active recovery. Before and after the acute SIT, three cognitive tests (i.e., Change Detection Test, Timewall Test, Mackworth Clock Test) were performed. Exercise-induced changes in cognitive performance and between-group differences were analyzed. We did not observe significant between-group differences in the performance of any cognitive test at the pretest, but elite basketball players outperformed the amateur players in specific measures of the Change Detection Test and Timewall Test after the acute SIT (p < 0.05). In addition, for the Clock Test, only the elite basketball players' performance improved from pre- to posttest. The current study's findings suggest that male elite basketball players, compared to amateur basketball players, can preserve their cognitive performance after an acute bout of SIT.
Collapse
Affiliation(s)
- Egemen Mancı
- Faculty of Sport Science, Dokuz Eylül University, Izmir 35320, Turkey
| | - Fabian Herold
- Research Group Degenerative and Chronic Diseases, Movement, Faculty of Health Sciences Brandenburg, University of Potsdam, 14476 Potsdam, Germany
| | - Erkan Günay
- Faculty of Sport Science, Celal Bayar University, Manisa 45140, Turkey
| | - Çağdaş Güdücü
- Department of Biophysics, Dokuz Eylül University, Izmir 35320, Turkey
| | - Notger G. Müller
- Research Group Degenerative and Chronic Diseases, Movement, Faculty of Health Sciences Brandenburg, University of Potsdam, 14476 Potsdam, Germany
| | - Cem Ş. Bediz
- Department of Physiology, University of Kyrenia, Kyrenia 99138, Cyprus
| |
Collapse
|
20
|
Plater L, Nyman S, Joubran S, Al-Aidroos N. Repetition enhances the effects of activated long-term memory. Q J Exp Psychol (Hove) 2023; 76:621-631. [PMID: 35400220 PMCID: PMC9936439 DOI: 10.1177/17470218221095755] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Recent research indicates that visual long-term memory (vLTM) representations directly interface with perception and guide attention. This may be accomplished through a state known as activated LTM, however, little is known about the nature of activated LTM. Is it possible to enhance the attentional effects of these activated representations? And furthermore, is activated LTM discrete (i.e., a representation is either active or not active, but only active representations interact with perception) or continuous (i.e., there are different levels within the active state that all interact with perception)? To answer these questions, in the present study, we measured intrusion effects during a modified Sternberg task. Participants saw two lists of three complex visual objects, were cued that only one list was relevant for the current trial (the other list was, thus, irrelevant), and then their memory for the cued list was probed. Critically, half of the trials contained repeat objects (shown 10 times each), and half of the trials contained non-repeat objects (shown only once each). Results indicated that repetition enhanced activated LTM, as the intrusion effect (i.e., longer reaction times to irrelevant list objects than novel objects) was larger for repeat trials compared with non-repeat trials. These initial findings provide preliminary support that LTM activation is continuous, as the intrusion effect was not the same size for repeat and non-repeat trials. We conclude that researchers should repeat stimuli to increase the size of their effects and enhance how LTM representations interact with perception.
Collapse
Affiliation(s)
- Lindsay Plater
- Lindsay Plater, Department of Psychology, University of Guelph, Guelph, Ontario, Canada N1G 2W1.
| | | | | | | |
Collapse
|
21
|
Conscious interpretation: A distinct aspect for the neural markers of the contents of consciousness. Conscious Cogn 2023; 108:103471. [PMID: 36736210 DOI: 10.1016/j.concog.2023.103471] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Revised: 12/22/2022] [Accepted: 01/11/2023] [Indexed: 02/04/2023]
Abstract
Progress in the science of consciousness depends on the experimental paradigms and varieties of contrastive analysis available to researchers. Here we highlight paradigms where the object is represented in consciousness as a set of its features but the interpretation of this set alternates in consciousness. We group experimental paradigms with this property under the label "conscious interpretation". We compare the paradigms studying conscious interpretation of the already consciously perceived objects with other types of experimental paradigms. We review previous and recent studies investigating this interpretative aspect of consciousness and propose future directions. We put forward the hypothesis that there are types of stimuli with a hierarchy of interpretations for which the rule applies: conscious experience is drawn towards higher-level interpretation and reverting back to the lower level of interpretation is impossible. We discuss how theories of consciousness might incorporate knowledge and constraints arising from the characteristics of conscious interpretation.
Collapse
|
22
|
Voice Over Body? Older Adults' Reactions to Robot and Voice Assistant Facilitators of Group Conversation. Int J Soc Robot 2023; 15:143-163. [PMID: 36406778 PMCID: PMC9651097 DOI: 10.1007/s12369-022-00925-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2022] [Revised: 07/29/2022] [Accepted: 09/05/2022] [Indexed: 11/13/2022]
Abstract
Intelligent agents have great potential as facilitators of group conversation among older adults. However, little is known about how to design agents for this purpose and user group, especially in terms of agent embodiment. To this end, we conducted a mixed methods study of older adults' reactions to voice and body in a group conversation facilitation agent. Two agent forms with the same underlying artificial intelligence (AI) and voice system were compared: a humanoid robot and a voice assistant. One preliminary study (total n = 24) and one experimental study comparing voice and body morphologies (n = 36) were conducted with older adults and an experienced human facilitator. Findings revealed that the artificiality of the agent, regardless of its form, was beneficial for the socially uncomfortable task of conversation facilitation. Even so, talkative personality types had a poorer experience with the "bodied" robot version. Design implications and supplementary reactions, especially to agent voice, are also discussed. Supplementary Information The online version contains supplementary material available at 10.1007/s12369-022-00925-7.
Collapse
|
23
|
Gaba A, Setlur V, Srinivasan A, Hoffswell J, Xiong C. Comparison Conundrum and the Chamber of Visualizations: An Exploration of How Language Influences Visual Design. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2023; 29:1211-1221. [PMID: 36155465 DOI: 10.1109/tvcg.2022.3209456] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
The language for expressing comparisons is often complex and nuanced, making supporting natural language-based visual comparison a non-trivial task. To better understand how people reason about comparisons in natural language, we explore a design space of utterances for comparing data entities. We identified different parameters of comparison utterances that indicate what is being compared (i.e., data variables and attributes) as well as how these parameters are specified (i.e., explicitly or implicitly). We conducted a user study with sixteen data visualization experts and non-experts to investigate how they designed visualizations for comparisons in our design space. Based on the rich set of visualization techniques observed, we extracted key design features from the visualizations and synthesized them into a subset of sixteen representative visualization designs. We then conducted a follow-up study to validate user preferences for the sixteen representative visualizations corresponding to utterances in our design space. Findings from these studies suggest guidelines and future directions for designing natural language interfaces and recommendation tools to better support natural language comparisons in visual analytics.
Collapse
|
24
|
Alexander RG, Macknik SL, Martinez-Conde S. What the Neuroscience and Psychology of Magic Reveal about Misinformation. PUBLICATIONS 2022; 10:33. [PMID: 36275197 PMCID: PMC9583043 DOI: 10.3390/publications10040033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/07/2024] Open
Abstract
When we believe misinformation, we have succumbed to an illusion: our perception or interpretation of the world does not match reality. We often trust misinformation for reasons that are unrelated to an objective, critical interpretation of the available data: Key facts go unnoticed or unreported. Overwhelming information prevents the formulation of alternative explanations. Statements become more believable every time they are repeated. Events are reframed or given "spin" to mislead audiences. In magic shows, illusionists apply similar techniques to convince spectators that false and even seemingly impossible events have happened. Yet, many magicians are "honest liars," asking audiences to suspend their disbelief only during the performance, for the sole purpose of entertainment. Magic misdirection has been studied in the lab for over a century. Psychological research has sought to understand magic from a scientific perspective and to apply the tools of magic to the understanding of cognitive and perceptual processes. More recently, neuroscientific investigations have also explored the relationship between magic illusions and their underlying brain mechanisms. We propose that the insights gained from such studies can be applied to understanding the prevalence and success of misinformation. Here, we review some of the common factors in how people experience magic during a performance and are subject to misinformation in their daily lives. Considering these factors will be important in reducing misinformation and encouraging critical thinking in society.
Collapse
Affiliation(s)
- Robert G. Alexander
- Departments of Ophthalmology, Neurology, and Physiology & Pharmacology, State University of New York Downstate Health Sciences University, Brooklyn, NY 11203, USA
| | - Stephen L. Macknik
- Departments of Ophthalmology, Neurology, and Physiology & Pharmacology, State University of New York Downstate Health Sciences University, Brooklyn, NY 11203, USA
| | - Susana Martinez-Conde
- Departments of Ophthalmology, Neurology, and Physiology & Pharmacology, State University of New York Downstate Health Sciences University, Brooklyn, NY 11203, USA
| |
Collapse
|
25
|
File D, Petro B, Gaál ZA, Csikós N, Czigler I. Automatic change detection: Mismatch negativity and the now-classic Rensink, O’Reagan, and Clark (1997) stimuli. Front Psychol 2022; 13:975714. [PMID: 36092095 PMCID: PMC9458516 DOI: 10.3389/fpsyg.2022.975714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2022] [Accepted: 07/26/2022] [Indexed: 11/13/2022] Open
Abstract
Change blindness experiments had demonstrated that detection of significant changes in natural images is extremely difficult when brief blank fields are placed between alternating displays of an original and a modified scene. On the other hand, research on the visual mismatch negativity (vMMN) component of the event-related potentials (ERPs) identified sensitivity to events (deviants) different from the regularity of stimulus sequences (standards), even if the deviant and standard events are non-attended. The present study sought to investigate the apparent controversy between the experience under the change blindness paradigm and the ERP results. To this end, the stimulus of Rensink, O’Reagen, and Clark (1997) was adapted to a passive oddball ERP paradigm to investigate the underlying processing differences between the standard (original) and deviant (altered) stimuli measured in 22 subjects. Posterior negativity within the 280–330 ms latency range emerged as the difference between ERPs elicited by standard and deviant stimuli, identified as visual mismatch negativity (vMMN). These results raise the possibility that change blindness is not based on the lack of detailed visual representations or the deficiency of comparing two representations. However, effective discrimination of the two scene versions requires considerable frequency differences between them.
Collapse
Affiliation(s)
- Domonkos File
- Institute of Psychology, Eötvös Loránd University, Budapest, Hungary
- *Correspondence: Domonkos File,
| | - Bela Petro
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
| | - Zsófia Anna Gaál
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
| | - Nóra Csikós
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
| | - István Czigler
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
| |
Collapse
|
26
|
D'Innocenzo G, Della Sala S, Coco MI. Similar mechanisms of temporary bindings for identity and location of objects in healthy ageing: an eye-tracking study with naturalistic scenes. Sci Rep 2022; 12:11163. [PMID: 35778449 PMCID: PMC9249875 DOI: 10.1038/s41598-022-13559-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Accepted: 05/25/2022] [Indexed: 11/25/2022] Open
Abstract
The ability to maintain visual working memory (VWM) associations about the identity and location of objects has at times been found to decrease with age. To date, however, this age-related difficulty was mostly observed in artificial visual contexts (e.g., object arrays), and so it is unclear whether it may manifest in naturalistic contexts, and in which ways. In this eye-tracking study, 26 younger and 24 healthy older adults were asked to detect changes in a critical object situated in a photographic scene (192 in total), about its identity (the object becomes a different object but maintains the same position), location (the object only changes position) or both (the object changes in location and identity). Aging was associated with a lower change detection performance. A change in identity was harder to detect than a location change, and performance was best when both features changed, especially in younger adults. Eye movements displayed minor differences between age groups (e.g., shorter saccades in older adults) but were similarly modulated by the type of change. Latencies to the first fixation were longer and the amplitude of incoming saccades was larger when the critical object changed in location. Once fixated, the target object was inspected for longer when it only changed in identity compared to location. Visually salient objects were fixated earlier, but saliency did not affect any other eye movement measures considered, nor did it interact with the type of change. Our findings suggest that even though aging results in lower performance, it does not selectively disrupt temporary bindings of object identity, location, or their association in VWM, and highlight the importance of using naturalistic contexts to discriminate the cognitive processes that undergo detriment from those that are instead spared by aging.
Collapse
Affiliation(s)
- Giorgia D'Innocenzo
- Centro de Investigação em Ciência Psicológica (CICPSI), Faculdade de Psicologia, Universidade de Lisboa, Lisbon, Portugal.
| | - Sergio Della Sala
- Human Cognitive Neuroscience, Department of Psychology, University of Edinburgh, Edinburgh, UK
| | - Moreno I Coco
- Centro de Investigação em Ciência Psicológica (CICPSI), Faculdade de Psicologia, Universidade de Lisboa, Lisbon, Portugal. .,Department of Psychology, "Sapienza" University of Rome, Rome, Italy. .,IRCCS Santa Lucia, Rome, Italy.
| |
Collapse
|
27
|
Prieto A, Peinado V, Mayas J. Does perceptual grouping improve visuospatial working memory? Optimized processing or encoding bias. PSYCHOLOGICAL RESEARCH 2022; 86:1297-1309. [PMID: 34236493 PMCID: PMC9090850 DOI: 10.1007/s00426-021-01555-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Accepted: 06/28/2021] [Indexed: 11/09/2022]
Abstract
Visual working memory has been defined as a system of limited capacity that enables the maintenance and manipulation of visual information. However, some perceptual features like Gestalt grouping could improve visual working memory effectiveness. In two different experiments, we aimed to explore how the presence of elements grouped by color similarity affects the change detection performance of both, grouped and non-grouped items. We combined a change detection task with a retrocue paradigm in which a six item array had to be remembered. An always valid, variable-delay retrocue appeared in some trials during the retention interval, either after 100 ms (iconic-trace period) or 1400 ms (working memory period), signaling the location of the probe. The results indicated that similarity grouping biased the information entered into the visual working memory, improving change detection accuracy only for previously grouped probes, but hindering change detection for non-grouped probes in certain conditions (Exp. 1). However, this bottom-up automatic encoding bias was overridden when participants were explicitly instructed to ignore grouped items as they were irrelevant for the task (Exp. 2).
Collapse
Affiliation(s)
- Antonio Prieto
- Department of Basic Psychology I, Universidad Nacional de Educación a Distancia, C/Juan del Rosal, 10, 28040, Madrid, Madrid, Spain.
| | - Vanesa Peinado
- Department of Personality, Evaluation and Clinical Psychology, Universidad Complutense de Madrid, Campus Somosaguas, 28223, Pozuelo de Alarcón , Madrid, Spain.
| | - Julia Mayas
- Department of Basic Psychology II, Universidad Nacional de Educación a Distancia, C/Juan del Rosal, 10, 28040, Madrid, Madrid, Spain.
| |
Collapse
|
28
|
Gambarota F, Tsuchiya N, Pastore M, Di Polito N, Sessa P. Unconscious Visual Working Memory: A critical review and Bayesian meta-analysis. Neurosci Biobehav Rev 2022; 136:104618. [PMID: 35289273 DOI: 10.1016/j.neubiorev.2022.104618] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Revised: 03/08/2022] [Accepted: 03/09/2022] [Indexed: 11/16/2022]
Abstract
The relationship between consciousness and working memory (WM) has been recently debated both at the theoretical and methodological levels (Persuh et al., 2018; Velichkovsky, 2017). While there is behavioral and neural evidence that argues for the existence of unconscious WM, several methodological concerns have been raised, rendering this issue highly controversial. To address the robustness of the previous findings, here we adopt a meta-analytic approach to estimate the effect size and heterogeneity of the previously reported unconscious WM results, also including unpublished results. We used meta-regression to isolate relevant experimental variables, in particular, consciousness manipulation and the WM paradigm to identify the source of the heterogeneity in the reported effect size of the unconscious WM. Our meta-analysis supports the existence of the unconscious WM effect and critically reveals several experimental variables that contribute to relevant heterogeneity. Our analysis clarifies several theoretical and methodological issues. We recommend that future studies explicitly operationalize the definition of consciousness, standardize the methodology and systematically explore the role of critical variables for the unconscious WM effect.
Collapse
Affiliation(s)
- Filippo Gambarota
- Department of Developmental and Social Psychology, University of Padova, Via Venezia 8, 35131, Padova, Italy; Padova Neuroscience Center, University of Padova, Via Giuseppe Orus, 2, 35131 Padova, Italy.
| | - Naotsugu Tsuchiya
- Turner Institute for Brain and Mental Health & School of Psychological Sciences, Faculty of Medicine, Nursing, and Health Sciences, Monash University, Melbourne, Victoria, Australia; Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology (NICT), Suita, Osaka 565-0871, Japan; Advanced Telecommunications Research Computational Neuroscience Laboratories, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan.
| | - Massimiliano Pastore
- Department of Developmental and Social Psychology, University of Padova, Via Venezia 8, 35131, Padova, Italy.
| | - Nicola Di Polito
- Medical Neurosciences Program, Charité Universitätsmedizin, Charitépl 1, 10117, Berlin, Germany.
| | - Paola Sessa
- Department of Developmental and Social Psychology, University of Padova, Via Venezia 8, 35131, Padova, Italy; Padova Neuroscience Center, University of Padova, Via Giuseppe Orus, 2, 35131 Padova, Italy.
| |
Collapse
|
29
|
An Empirical Study on the Effects of Temporal Trends in Spatial Patterns on Animated Choropleth Maps. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION 2022. [DOI: 10.3390/ijgi11050273] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Animated cartographic visualization incorporates the concept of geomedia presented in this Special Issue. The presented study aims to examine the effectiveness of spatial pattern and temporal trend recognition on animated choropleth maps. In a controlled laboratory experiment with participants and eye tracking, fifteen animated maps were used to show a different spatial patterns and temporal trends. The participants’ task was to correctly detect the patterns and trends on a choropleth map. The study results show that effective spatial pattern and temporal trend recognition on a choropleth map is related to participants’ visual behavior. Visual attention clustered in the central part of the choropleth map supports effective spatio-temporal relationship recognition. The larger the area covered by the fixation cluster, the higher the probability of correct temporal trend and spatial pattern recognition. However, animated choropleth maps are more suitable for presenting temporal trends than spatial patterns. Understanding the difficulty in the correct recognition of spatio-temporal relationships might be a reason for implementing techniques that support effective visual searches such as highlighting, cartographic redundancy, or interactive tools. For end-users, the presented study reveals the necessity of the application of a specific visual strategy. Focusing on the central part of the map is the most effective strategy for the recognition of spatio-temporal relationships.
Collapse
|
30
|
Gruber RP, Block RA, Montemayor C. Physical Time Within Human Time. Front Psychol 2022; 13:718505. [PMID: 35432085 PMCID: PMC9005802 DOI: 10.3389/fpsyg.2022.718505] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Accepted: 02/23/2022] [Indexed: 11/13/2022] Open
Abstract
A possible solution is offered to help resolve the "two times problem" regarding the veridical and illusory nature of time. First it is recognized that the flow (passage) of time is part of a wider array of temporal experiences referred to as manifest time, all of which need to be reconciled. Then, an information gathering and utilizing system (IGUS) model is used as a basis for a view of manifest time. The model IGUS robot of Hartle that solves the "unique present" debate is enhanced with veridical and (corresponding) illusory components of not only the flow of time but also the larger entity of manifest time, providing a dualistic IGUS robot that represents all of the important temporal experiences. Based upon a variety of prior experiments, that view suggests that the veridical system is a reflection of accepted spacetime cosmologies and through natural selection begets the illusory system for functional purposes. Thus, there are not two opposing times, one outside and one inside the cranium. There is just one fundamental physical time which the brain developed, now possesses and is itself sufficient for adaption but then enhances. The illusory system is intended to provide a more satisfying experience of physical time, and better adaptive behavior. Future experiments to verify that view are provided. With a complete veridical system of temporal experiences there may be less need to reify certain temporal experiences so that the two times problem is less of a problem and more of a phenomenon.
Collapse
Affiliation(s)
- Ronald P. Gruber
- Stanford University Medical Center, Stanford University, Stanford, CA, United States
| | - Richard A. Block
- Department of Psychology, Montana State University, Bozeman, MT, United States
| | - Carlos Montemayor
- Department of Philosophy, San Francisco State University, San Francisco, CA, United States
| |
Collapse
|
31
|
Coşkunçay M, Ikier S, Şener S. Detection of expected versus unexpected changes. CURRENT PSYCHOLOGY 2022. [DOI: 10.1007/s12144-020-00633-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
32
|
Manassi M, Whitney D. Illusion of visual stability through active perceptual serial dependence. SCIENCE ADVANCES 2022; 8:eabk2480. [PMID: 35020432 PMCID: PMC11580026 DOI: 10.1126/sciadv.abk2480] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Accepted: 09/28/2021] [Indexed: 06/14/2023]
Abstract
Despite a noisy and ever-changing visual world, our perceptual experience seems remarkably stable over time. How does our visual system achieve this apparent stability? Here, we introduce a previously unknown visual illusion that shows direct evidence for an online mechanism continuously smoothing our percepts over time. As a result, a continuously seen physically changing object can be misperceived as unchanging. We find that online object appearance is captured by past visual experience up to 15 seconds ago. We propose that, because of an underlying active mechanism of serial dependence, the representation of the object is continuously merged over time, and the consequence is an illusory stability in which object appearance is biased toward the past. Our results provide a direct demonstration of the link between serial dependence in visual representations and perceived visual stability in everyday life.
Collapse
Affiliation(s)
- Mauro Manassi
- Department of Psychology, University of California, Berkeley, CA, USA
- School of Psychology, University of Aberdeen, King’s College, Aberdeen, UK
| | - David Whitney
- Department of Psychology, University of California, Berkeley, CA, USA
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA
- Vision Science Group, University of California, Berkeley, CA, USA
| |
Collapse
|
33
|
Horikawa T, Kamitani Y. Attention modulates neural representation to render reconstructions according to subjective appearance. Commun Biol 2022; 5:34. [PMID: 35017660 PMCID: PMC8752808 DOI: 10.1038/s42003-021-02975-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2021] [Accepted: 12/15/2021] [Indexed: 11/09/2022] Open
Abstract
Stimulus images can be reconstructed from visual cortical activity. However, our perception of stimuli is shaped by both stimulus-induced and top-down processes, and it is unclear whether and how reconstructions reflect top-down aspects of perception. Here, we investigate the effect of attention on reconstructions using fMRI activity measured while subjects attend to one of two superimposed images. A state-of-the-art method is used for image reconstruction, in which brain activity is translated (decoded) to deep neural network (DNN) features of hierarchical layers then to an image. Reconstructions resemble the attended rather than unattended images. They can be modeled by superimposed images with biased contrasts, comparable to the appearance during attention. Attentional modulations are found in a broad range of hierarchical visual representations and mirror the brain-DNN correspondence. Our results demonstrate that top-down attention counters stimulus-induced responses, modulating neural representations to render reconstructions in accordance with subjective appearance.
Collapse
Affiliation(s)
- Tomoyasu Horikawa
- Department of Neuroinformatics, ATR Computational Neuroscience Laboratories, Kyoto, Japan.
| | - Yukiyasu Kamitani
- Department of Neuroinformatics, ATR Computational Neuroscience Laboratories, Kyoto, Japan. .,Graduate School of Informatics, Kyoto University, Kyoto, Japan.
| |
Collapse
|
34
|
Jung K, Han SW, Min Y. Comparing the temporal dynamics and efficacy of task-relevant and task-irrelevant memory-driven attention. Cogn Process 2022; 23:299-308. [PMID: 35001208 DOI: 10.1007/s10339-021-01069-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Accepted: 11/26/2021] [Indexed: 11/03/2022]
Abstract
People's attention is well attracted to a stimulus matching their memory. For example, when people are required to remember the color of a visual object, stimuli matching the memory color powerfully capture attention. Remarkably, stimuli with the shape of the memory object, that is, irrelevant-matching stimuli were also found to capture attention. Here, we examined how task relevance affects the temporal dynamics and the strength of memory-driven attention. In the experiment, participants performed a visual search task while maintaining the color or shape of a colored shape. When participants were required to memorize the color of the memory sample, the shape of the sample stimulus is task-irrelevant feature and vice versa. Importantly, while a search item matching working memory in the task-relevant dimension was presented for one group of participants, an irrelevant-matching search item appeared for the other group of participants. Further, we varied stimulus onset asynchrony (SOA) between the memory sample and search items. We found that relevant-matching stimuli captured attention regardless of whether the SOA was short or long. However, attentional capture by irrelevant-matching stimuli depended on the SOA; no memory-driven capture was observed at the shortest SOA, but significant capture was found at longer SOAs. Further, the capture effects by relevant-matching stimuli were greater than that of irrelevant-matching stimuli. These findings suggest both task-relevant and -irrelevant features in working memory affect the attentional selection in visual search task, but its temporal dynamics and strength are modulated by the task-relevance.
Collapse
Affiliation(s)
- Koeun Jung
- Institute of Social Science, Chungnam National University, Daehak-ro 99, Daejeon, 34134, Korea
| | - Suk Won Han
- Department of Psychology, Chungnam National University, Daehak-ro 99, Daejeon, 34134, Korea.
| | - Yoonki Min
- Department of Psychology, Chungnam National University, Daehak-ro 99, Daejeon, 34134, Korea.
| |
Collapse
|
35
|
Xiong C, Setlur V, Bach B, Koh E, Lin K, Franconeri S. Visual Arrangements of Bar Charts Influence Comparisons in Viewer Takeaways. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2022; 28:955-965. [PMID: 34587056 DOI: 10.1109/tvcg.2021.3114823] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Well-designed data visualizations can lead to more powerful and intuitive processing by a viewer. To help a viewer intuitively compare values to quickly generate key takeaways, visualization designers can manipulate how data values are arranged in a chart to afford particular comparisons. Using simple bar charts as a case study, we empirically tested the comparison affordances of four common arrangements: vertically juxtaposed, horizontally juxtaposed, overlaid, and stacked. We asked participants to type out what patterns they perceived in a chart and we coded their takeaways into types of comparisons. In a second study, we asked data visualization design experts to predict which arrangement they would use to afford each type of comparison and found both alignments and mismatches with our findings. These results provide concrete guidelines for how both human designers and automatic chart recommendation systems can make visualizations that help viewers extract the "right" takeaway.
Collapse
|
36
|
La perception multisource : une nouvelle approche de la perception de scènes. PSYCHOLOGIE FRANCAISE 2021. [DOI: 10.1016/j.psfr.2021.10.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
37
|
|
38
|
Deep learning helps EEG signals predict different stages of visual processing in the human brain. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102996] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
39
|
Li J, Yang J, Qin Y, Zhang Y. Expert and Novice Goalkeepers' Perceptions of Changes During Open Play Soccer. Percept Mot Skills 2021; 128:2725-2744. [PMID: 34459301 DOI: 10.1177/00315125211040750] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In the present study we investigated expert and novice football (i.e., soccer) goalkeepers' three stages of perceiving changes in open play situations-detection, localization, and identification-with and without time constraints. We adopted the continual cycling flicker paradigm to investigate goalkeepers' perceptions when provided with sufficient time (Experiment 1), and we utilized the limited display one-shot change detection paradigm to study their perceptions under time constraints (Experiment 2). Images of goalkeepers' first-person views of open play soccer scenes were used as stimuli. Semantic or non-semantic changes in these scenes were produced by modifying one element in each image. Separate groups of expert and novice goalkeepers were required to detect, localize, and identify the scene changes. We found that expert goalkeepers detected scene changes more quickly than novices under both time allowances. Furthermore, compared to novices, experts localized the changes more accurately under time constraints and identified the changes more quickly when given sufficient time. Additionally, semantic changes were detected more quickly and localized and identified more accurately than non-semantic changes when there was sufficient time. Under time constraints expert goalkeepers' greater efficiency was likely due to pre-attentive processing; with sufficient time, they were able to focus attention to extracting detailed information for identification.
Collapse
Affiliation(s)
- Jie Li
- Center for Cognition and Brain Disorders, the Affiliated Hospital, Hangzhou Normal University, Hangzhou, China.,Institutes of Psychological Sciences, Hangzhou Normal University, Hangzhou, China.,Zhejiang Key Laboratory for Research in Assessment of Cognitive Impairments, Hangzhou Normal University, Hangzhou, China.,School of Psychology, 47838Beijing Sport University, Beijing Sport University, Beijing, China
| | - Jing Yang
- School of Psychology, 47838Beijing Sport University, Beijing Sport University, Beijing, China.,Beijing Jianhua Experimental Etown School, Beijing, China
| | - Yue Qin
- School of Psychology, 47838Beijing Sport University, Beijing Sport University, Beijing, China
| | - Yu Zhang
- School of Psychology, 47838Beijing Sport University, Beijing Sport University, Beijing, China
| |
Collapse
|
40
|
Venkataramanan K, Gawde S, Hathibelagal AR, Bharadwaj SR. Binocular fusion enhances the efficiency of spot-the-difference gameplay. PLoS One 2021; 16:e0254715. [PMID: 34283852 PMCID: PMC8291752 DOI: 10.1371/journal.pone.0254715] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2021] [Accepted: 07/01/2021] [Indexed: 11/18/2022] Open
Abstract
Spot-the-difference, the popular childhood game and a prototypical change blindness task, involves identification of differences in local features of two otherwise identical scenes using an eye scanning and matching strategy. Through binocular fusion of the companion scenes, the game becomes a visual search task, wherein players can simply scan the cyclopean percept for local features that may distinctly stand-out due to binocular rivalry/lustre. Here, we had a total of 100 visually normal adult (18-28 years of age) volunteers play this game in the traditional non-fusion mode and after cross-fusion of the companion images using a hand-held mirror stereoscope. The results demonstrate that the fusion mode significantly speeds up gameplay and reduces errors, relative to the non-fusion mode, for a range of target sizes, contrasts, and chromaticity tested (all, p<0.001). Amongst the three types of local feature differences available in these images (polarity difference, presence/absence of a local feature difference and shape difference in a local feature difference), features containing polarity difference was identified as first in ~60-70% of instances in both modes of gameplay (p<0.01), with this proportion being larger in the fusion than in the non-fusion mode. The binocular fusion advantage is lost when the lustre cue is purposefully weakened through alterations in target luminance polarity. The spot-the-difference game may thus be cheated using binocular fusion and the differences readily identified through a vivid experience of binocular rivalry/lustre.
Collapse
Affiliation(s)
- Kavitha Venkataramanan
- Brien Holden Institute of Optometry and Vision Sciences, L V Prasad Eye Institute, Hyderabad, Telangana, India
| | - Swanandi Gawde
- Brien Holden Institute of Optometry and Vision Sciences, L V Prasad Eye Institute, Hyderabad, Telangana, India
| | - Amithavikram R Hathibelagal
- Brien Holden Institute of Optometry and Vision Sciences, L V Prasad Eye Institute, Hyderabad, Telangana, India
- Prof Brien Holden Eye Research Centre, L V Prasad Eye Institute, Hyderabad, Telangana, India
| | - Shrikant R Bharadwaj
- Brien Holden Institute of Optometry and Vision Sciences, L V Prasad Eye Institute, Hyderabad, Telangana, India
- Prof Brien Holden Eye Research Centre, L V Prasad Eye Institute, Hyderabad, Telangana, India
| |
Collapse
|
41
|
Crowe EM, Howard CJ, Gilchrist ID, Kent C. Motion disrupts dynamic visual search for an orientation change. Cogn Res Princ Implic 2021; 6:47. [PMID: 34175977 PMCID: PMC8236006 DOI: 10.1186/s41235-021-00312-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Accepted: 06/13/2021] [Indexed: 11/10/2022] Open
Abstract
Visual search in dynamic environments, for example lifeguarding or CCTV monitoring, has several fundamentally different properties to standard visual search tasks. The visual environment is constantly moving, a range of items could become targets and the task is to search for a certain event. We developed a novel task in which participants were required to search static and moving displays for an orientation change thus capturing components of visual search, multiple object tracking and change detection paradigms. In Experiment 1, we found that the addition of moving distractors slowed participants' response time to detect an orientation changes in a moving target, showing that the motion of distractors disrupts the rapid detection of orientation changes in a moving target. In Experiment 2 we found that, in displays of both moving and static objects, response time was slower if a moving object underwent a change than if a static object did, thus demonstrating that motion of the target itself also disrupts the detection of an orientation change. Our results could have implications for training in real-world occupations where the task is to search a dynamic environment for a critical event. Moreover, we add to the literature highlighting the need to develop lab-based tasks with high experimental control from any real-world tasks researchers may wish to investigate rather than extrapolating from static visual search tasks to more dynamic environments.
Collapse
Affiliation(s)
- Emily M Crowe
- School of Psychological Science, University of Bristol, Bristol, UK
- Department of Human Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | | | - Iain D Gilchrist
- School of Psychological Science, University of Bristol, Bristol, UK
| | - Christopher Kent
- School of Psychological Science, University of Bristol, Bristol, UK.
| |
Collapse
|
42
|
Sasin E, Fougnie D. The road to long-term memory: Top-down attention is more effective than bottom-up attention for forming long-term memories. Psychon Bull Rev 2021; 28:937-945. [PMID: 33443709 PMCID: PMC8219582 DOI: 10.3758/s13423-020-01856-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/25/2020] [Indexed: 11/10/2022]
Abstract
Does the strength of representations in long-term memory (LTM) depend on which type of attention is engaged? We tested participants' memory for objects seen during visual search. We compared implicit memory for two types of objects-related-context nontargets that grabbed attention because they matched the target defining feature (i.e., color; top-down attention) and salient distractors that captured attention only because they were perceptually distracting (bottom-up attention). In Experiment 1, the salient distractor flickered, while in Experiment 2, the luminance of the salient distractor was alternated. Critically, salient and related-context nontargets produced equivalent attentional capture, yet related-context nontargets were remembered far better than salient distractors (and salient distractors were not remembered better than unrelated distractors). These results suggest that LTM depends not only on the amount of attention but also on the type of attention. Specifically, top-down attention is more effective in promoting the formation of memory traces than bottom-up attention.
Collapse
Affiliation(s)
- Edyta Sasin
- Department of Psychology, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates.
| | - Daryl Fougnie
- Department of Psychology, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| |
Collapse
|
43
|
Türkan BN, İyilikci O, Amado S. Ways of processing semantic information during different change detection tasks. VISUAL COGNITION 2021. [DOI: 10.1080/13506285.2021.1927276] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Affiliation(s)
| | - Osman İyilikci
- Department of Psychology, Manisa Celal Bayar University, Manisa, Turkey
| | - Sonia Amado
- Department of Psychology, Ege University, Izmir, Turkey
| |
Collapse
|
44
|
Zhu Z, Tomassetti AJ, Dalal RS, Schrader SW, Loo K, Sabat IE, Alaybek B, Zhou Y, Jones C, Fyffe S. A Test-Retest Reliability Generalization Meta-Analysis of Judgments Via the Policy-Capturing Technique. ORGANIZATIONAL RESEARCH METHODS 2021. [DOI: 10.1177/10944281211011529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Policy capturing is a widely used technique, but the temporal stability of policy-capturing judgments has long been a cause for concern. This article emphasizes the importance of reporting reliability, and in particular test-retest reliability, estimates in policy-capturing studies. We found that only 164 of 955 policy-capturing studies (i.e., 17.17%) reported a test-retest reliability estimate. We then conducted a reliability generalization meta-analysis on policy-capturing studies that did report test-retest reliability estimates—and we obtained an average reliability estimate of .78. We additionally examined 16 potential methodological and substantive antecedents to test-retest reliability (equivalent to moderators in validity generalization studies). We found that test-retest reliability was robust to variation in 14 of the 16 factors examined but that reliability was higher in paper-and-pencil studies than in web-based studies and was higher for behavioral intention judgments than for other (e.g., attitudinal and perceptual) judgments. We provide an agenda for future research. Finally, we provide several best-practice recommendations for researchers (and journal reviewers) with regard to (a) reporting test-retest reliability, (b) designing policy-capturing studies for appropriate reportage, and (c) properly interpreting test-retest reliability in policy-capturing studies.
Collapse
Affiliation(s)
- Ze Zhu
- Department of Psychology, George Mason University, Fairfax, VA, USA
| | | | - Reeshad S. Dalal
- Department of Psychology, George Mason University, Fairfax, VA, USA
| | | | - Kevin Loo
- Department of Psychology, George Mason University, Fairfax, VA, USA
| | - Isaac E. Sabat
- Department of Psychology, Texas A&M University, College Station, TX, USA
| | - Balca Alaybek
- Department of Psychology, George Mason University, Fairfax, VA, USA
| | - You Zhou
- Department of Psychology, George Mason University, Fairfax, VA, USA
| | - Chelsea Jones
- Department of Psychology, George Mason University, Fairfax, VA, USA
| | - Shea Fyffe
- Department of Psychology, George Mason University, Fairfax, VA, USA
| |
Collapse
|
45
|
Abstract
Visual processing varies dramatically across the visual field. These differences start in the retina and continue all the way to the visual cortex. Despite these differences in processing, the perceptual experience of humans is remarkably stable and continuous across the visual field. Research in the last decade has shown that processing in peripheral and foveal vision is not independent, but is more directly connected than previously thought. We address three core questions on how peripheral and foveal vision interact, and review recent findings on potentially related phenomena that could provide answers to these questions. First, how is the processing of peripheral and foveal signals related during fixation? Peripheral signals seem to be processed in foveal retinotopic areas to facilitate peripheral object recognition, and foveal information seems to be extrapolated toward the periphery to generate a homogeneous representation of the environment. Second, how are peripheral and foveal signals re-calibrated? Transsaccadic changes in object features lead to a reduction in the discrepancy between peripheral and foveal appearance. Third, how is peripheral and foveal information stitched together across saccades? Peripheral and foveal signals are integrated across saccadic eye movements to average percepts and to reduce uncertainty. Together, these findings illustrate that peripheral and foveal processing are closely connected, mastering the compromise between a large peripheral visual field and high resolution at the fovea.
Collapse
Affiliation(s)
- Emma E M Stewart
- Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany.,
| | - Matteo Valsecchi
- Dipartimento di Psicologia, Universitá di Bologna, Bologna, Italy.,
| | - Alexander C Schütz
- Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany.,Center for Mind, Brain and Behavior, Philipps-Universität Marburg, Marburg, Germany., https://www.uni-marburg.de/en/fb04/team-schuetz/team/alexander-schutz
| |
Collapse
|
46
|
Deep learning-based denoising algorithm in comparison to iterative reconstruction and filtered back projection: a 12-reader phantom study. Eur Radiol 2021; 31:8755-8764. [PMID: 33885958 DOI: 10.1007/s00330-021-07810-3] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2020] [Revised: 01/02/2021] [Accepted: 02/17/2021] [Indexed: 10/21/2022]
Abstract
OBJECTIVES (1) To compare low-contrast detectability of a deep learning-based denoising algorithm (DLA) with ADMIRE and FBP, and (2) to compare image quality parameters of DLA with those of reconstruction methods from two different CT vendors (ADMIRE, IMR, and FBP). MATERIALS AND METHODS Using abdominal CT images of 100 patients reconstructed via ADMIRE and FBP, we trained DLA by feeding FBP images as input and ADMIRE images as the ground truth. To measure the low-contrast detectability, the randomized repeat scans of Catphan® phantom were performed under various conditions of radiation exposures. Twelve radiologists evaluated the presence/absence of a target on a five-point confidence scale. The multi-reader multi-case area under the receiver operating characteristic curve (AUC) was calculated, and non-inferiority tests were performed. Using American College of Radiology CT accreditation phantom, contrast-to-noise ratio, target transfer function, noise magnitude, and detectability index (d') of DLA, ADMIRE, IMR, and FBPs were computed. RESULTS The AUC of DLA in low-contrast detectability was non-inferior to that of ADMIRE (p < .001) and superior to that of FBP (p < .001). DLA improved the image quality in terms of all physical measurements compared to FBPs from both CT vendors and showed profiles of physical measurements similar to those of ADMIRE. CONCLUSIONS The low-contrast detectability of the proposed deep learning-based denoising algorithm was non-inferior to that of ADMIRE and superior to that of FBP. The DLA could successfully improve image quality compared with FBP while showing the similar physical profiles of ADMIRE. KEY POINTS • Low-contrast detectability in the images denoised using the deep learning algorithm was non-inferior to that in the images reconstructed using standard algorithms. • The proposed deep learning algorithm showed similar profiles of physical measurements to advanced iterative reconstruction algorithm (ADMIRE).
Collapse
|
47
|
Thornton IM. A Search Advantage for Horizontal Targets in Dynamic Displays. Iperception 2021; 12:20416695211004616. [PMID: 33912338 PMCID: PMC8047869 DOI: 10.1177/20416695211004616] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2020] [Accepted: 03/02/2021] [Indexed: 11/16/2022] Open
Abstract
Several lines of evidence point to the existence of a visual processing advantage for horizontal over vertical orientations. We investigated whether such a horizontal advantage exists in the context of top-down visual search. Inspired by change detection studies, we created displays where a dynamic target -- a horizontal or a vertical group of five dots that changed contrast synchronously -- was embedded within a randomly flickering grid of dots. The display size (total dots) varied across trials, and the orientation of the target was constant within interleaved blocks. As expected, search was slow and inefficient. Importantly, participants were almost a second faster finding horizontal compared to vertical targets. They were also more efficient and more accurate during horizontal search. Such findings establish that the attentional templates thought to guide search for known targets can exhibit strong orientation anisotropies. We discuss possible underlying mechanisms and how these might be explored in future studies.
Collapse
Affiliation(s)
- Ian M. Thornton
- Department of Cognitive Science, Faculty of Media and Knowledge Sciences, University of Malta, Msida, Malta
| |
Collapse
|
48
|
Kim HY, Lee K, Chang W, Kim Y, Lee S, Oh DY, Sunwoo L, Lee YJ, Kim YH. Robustness of Deep Learning Algorithm to Varying Imaging Conditions in Detecting Low Contrast Objects In Computed Tomography Phantom Images: in Comparison to 12 Radiologists. Diagnostics (Basel) 2021; 11:410. [PMID: 33670866 PMCID: PMC7997324 DOI: 10.3390/diagnostics11030410] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Revised: 02/23/2021] [Accepted: 02/24/2021] [Indexed: 12/20/2022] Open
Abstract
The performance of deep learning algorithm (DLA) to that of radiologists was compared in detecting low contrast objects in CT phantom images under various imaging conditions. For training, 10,000 images were created using American College of Radiology CT phantom as the background. In half of the images, objects of 3-20 mm size and 5-30 HU contrast difference were generated in random locations. Binary responses were used as the ground truth. For testing, 640 images of Catphan® phantom were used, half of which had objects of either 5 or 9 mm size with 10 HU contrast difference. Twelve radiologists evaluated the presence of objects on a five-point scale. The performances of the DLA and radiologists were compared across different imaging conditions in terms of area under receiver operating characteristics curve (AUC). Multi-reader multi-case AUC and Hanley and McNeil tests were used. We performed post-hoc analysis using bootstrapping and verified that the DLA is less affected by the changing imaging conditions. The AUC of DLA was consistently higher than those of the radiologists across different imaging conditions (p < 0.0001), and it was less affected by varying imaging conditions. The DLA outperformed the radiologists and showed more robust performance under varying imaging conditions.
Collapse
Affiliation(s)
- Hae Young Kim
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do 13620, Korea; (H.Y.K.); (Y.K.); (L.S.); (Y.J.L.); (Y.H.K.)
| | - Kyeorye Lee
- Interdisciplinary Program in Bioengineering, Seoul National University, Seoul 08826, Korea; (K.L.); (D.Y.O.)
| | - Won Chang
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do 13620, Korea; (H.Y.K.); (Y.K.); (L.S.); (Y.J.L.); (Y.H.K.)
| | - Youngjune Kim
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do 13620, Korea; (H.Y.K.); (Y.K.); (L.S.); (Y.J.L.); (Y.H.K.)
| | | | - Dong Yul Oh
- Interdisciplinary Program in Bioengineering, Seoul National University, Seoul 08826, Korea; (K.L.); (D.Y.O.)
| | - Leonard Sunwoo
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do 13620, Korea; (H.Y.K.); (Y.K.); (L.S.); (Y.J.L.); (Y.H.K.)
| | - Yoon Jin Lee
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do 13620, Korea; (H.Y.K.); (Y.K.); (L.S.); (Y.J.L.); (Y.H.K.)
| | - Young Hoon Kim
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do 13620, Korea; (H.Y.K.); (Y.K.); (L.S.); (Y.J.L.); (Y.H.K.)
| |
Collapse
|
49
|
Elliott MA, Nothelfer C, Xiong C, Szafir DA. A Design Space of Vision Science Methods for Visualization Research. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2021; 27:1117-1127. [PMID: 33090954 DOI: 10.1109/tvcg.2020.3029413] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
A growing number of efforts aim to understand what people see when using a visualization. These efforts provide scientific grounding to complement design intuitions, leading to more effective visualization practice. However, published visualization research currently reflects a limited set of available methods for understanding how people process visualized data. Alternative methods from vision science offer a rich suite of tools for understanding visualizations, but no curated collection of these methods exists in either perception or visualization research. We introduce a design space of experimental methods for empirically investigating the perceptual processes involved with viewing data visualizations to ultimately inform visualization design guidelines. This paper provides a shared lexicon for facilitating experimental visualization research. We discuss popular experimental paradigms, adjustment types, response types, and dependent measures used in vision science research, rooting each in visualization examples. We then discuss the advantages and limitations of each technique. Researchers can use this design space to create innovative studies and progress scientific understanding of design choices and evaluations in visualization. We highlight a history of collaborative success between visualization and vision science research and advocate for a deeper relationship between the two fields that can elaborate on and extend the methodological design space for understanding visualization and vision.
Collapse
|
50
|
Rowe EG, Tsuchiya N, Garrido MI. Detecting (Un)seen Change: The Neural Underpinnings of (Un)conscious Prediction Errors. Front Syst Neurosci 2020; 14:541670. [PMID: 33262694 PMCID: PMC7686547 DOI: 10.3389/fnsys.2020.541670] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2020] [Accepted: 10/08/2020] [Indexed: 11/16/2022] Open
Abstract
Detecting changes in the environment is fundamental for our survival. According to predictive coding theory, detecting these irregularities relies both on incoming sensory information and our top-down prior expectations (or internal generative models) about the world. Prediction errors (PEs), detectable in event-related potentials (ERPs), occur when there is a mismatch between the sensory input and our internal model (i.e., a surprise event). Many changes occurring in our environment are irrelevant for survival and may remain unseen. Such changes, even if subtle, can nevertheless be detected by the brain without emerging into consciousness. What remains unclear is how these changes are processed in the brain at the network level. Here, we used a visual oddball paradigm in which participants engaged in a central letter task during electroencephalographic (EEG) recordings while presented with task-irrelevant high- or low-coherence background, random-dot motion. Critically, once in a while, the direction of the dots changed. After the EEG session, we confirmed that changes in motion direction at high- and low-coherence were visible and invisible, respectively, using psychophysical measurements. ERP analyses revealed that changes in motion direction elicited PE regardless of the visibility, but with distinct spatiotemporal patterns. To understand these responses, we applied dynamic causal modeling (DCM) to the EEG data. Bayesian Model Averaging showed visible PE relied on a release from adaptation (repetition suppression) within bilateral MT+, whereas invisible PE relied on adaptation at bilateral V1 (and left MT+). Furthermore, while feedforward upregulation was present for invisible PE, the visible change PE also included downregulation of feedback between right MT+ to V1. Our findings reveal a complex interplay of modulation in the generative network models underlying visible and invisible motion changes.
Collapse
Affiliation(s)
- Elise G. Rowe
- School of Psychological Sciences, Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, VIC, Australia
- Turner Institute for Brain and Mental Health, Monash University, Clayton, VIC, Australia
- Queensland Brain Institute, The University of Queensland, Saint Lucia, QLD, Australia
- Centre for Advanced Imaging, The University of Queensland, Saint Lucia, QLD, Australia
| | - Naotsugu Tsuchiya
- School of Psychological Sciences, Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, VIC, Australia
- Turner Institute for Brain and Mental Health, Monash University, Clayton, VIC, Australia
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, Suita, Japan
- Advanced Telecommunications Research Computational Neuroscience Laboratories, Kyoto, Japan
- ARC Centre of Excellence for Integrative Brain Function, Clayton, VIC, Australia
| | - Marta I. Garrido
- Queensland Brain Institute, The University of Queensland, Saint Lucia, QLD, Australia
- Centre for Advanced Imaging, The University of Queensland, Saint Lucia, QLD, Australia
- ARC Centre of Excellence for Integrative Brain Function, Clayton, VIC, Australia
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, VIC, Australia
| |
Collapse
|