1
|
DeYoe EA, Huddleston W, Greenberg AS. Are neuronal mechanisms of attention universal across human sensory and motor brain maps? Psychon Bull Rev 2024:10.3758/s13423-024-02495-3. [PMID: 38587756 DOI: 10.3758/s13423-024-02495-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/10/2024] [Indexed: 04/09/2024]
Abstract
One's experience of shifting attention from the color to the smell to the act of picking a flower seems like a unitary process applied, at will, to one modality after another. Yet, the unique and separable experiences of sight versus smell versus movement might suggest that the neural mechanisms of attention have been separately optimized to employ each modality to its greatest advantage. Moreover, addressing the issue of universality can be particularly difficult due to a paucity of existing cross-modal comparisons and a dearth of neurophysiological methods that can be applied equally well across disparate modalities. Here we outline some of the conceptual and methodological issues related to this problem and present an instructive example of an experimental approach that can be applied widely throughout the human brain to permit detailed, quantitative comparison of attentional mechanisms across modalities. The ultimate goal is to spur efforts across disciplines to provide a large and varied database of empirical observations that will either support the notion of a universal neural substrate for attention or more clearly identify the degree to which attentional mechanisms are specialized for each modality.
Collapse
Affiliation(s)
- Edgar A DeYoe
- Department of Radiology, Medical College of Wisconsin, 8701 Watertown Plank Rd, Milwaukee, WI, 53226, USA.
- , Signal Mountain, USA.
| | - Wendy Huddleston
- School of Rehabilitation Sciences and Technology, College of Health Professions and Sciences, University of Wisconsin - Milwaukee, 3409 N. Downer Ave, Milwaukee, WI, 53211, USA
| | - Adam S Greenberg
- Department of Biomedical Engineering, Medical College of Wisconsin and Marquette University, Milwaukee, WI, 53226, USA
| |
Collapse
|
2
|
Cai Y, Hofstetter S, Harvey BM, Dumoulin SO. Attention drives human numerosity-selective responses. Cell Rep 2022; 39:111005. [PMID: 35767956 DOI: 10.1016/j.celrep.2022.111005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2021] [Revised: 04/18/2022] [Accepted: 06/03/2022] [Indexed: 11/03/2022] Open
Abstract
Numerosity, the set size of a group of items, helps guide behavior and decisions. Previous studies have shown that neural populations respond selectively to numerosities. How numerosity is extracted from the visual scene is a longstanding debate, often contrasting low-level visual with high-level cognitive processes. Here, we investigate how attention influences numerosity-selective responses. The stimuli consisted of black and white dots within the same display. Participants' attention was focused on either black or white dots, while we systematically changed the numerosity of black, white, and total dots. Using 7 T fMRI, we show that the numerosity-tuned neural populations respond only when attention is focused on their preferred numerosity, irrespective of the unattended or total numerosities. Without attention, responses to preferred numerosity are suppressed. Unlike traditional effects of attention in the visual cortex, where attention enhances already existing responses, these results suggest that attention is required to drive numerosity-selective responses.
Collapse
Affiliation(s)
- Yuxuan Cai
- Spinoza Centre for Neuroimaging, Meibergdreef 75, 1105BK Amsterdam, the Netherlands; Computational Cognitive Neuroscience and Neuroimaging, Netherlands Institute for Neuroscience, Amsterdam, the Netherlands; Experimental and Applied Psychology, Vrije University Amsterdam, Amsterdam, the Netherlands.
| | - Shir Hofstetter
- Spinoza Centre for Neuroimaging, Meibergdreef 75, 1105BK Amsterdam, the Netherlands; Computational Cognitive Neuroscience and Neuroimaging, Netherlands Institute for Neuroscience, Amsterdam, the Netherlands
| | - Ben M Harvey
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, the Netherlands
| | - Serge O Dumoulin
- Spinoza Centre for Neuroimaging, Meibergdreef 75, 1105BK Amsterdam, the Netherlands; Computational Cognitive Neuroscience and Neuroimaging, Netherlands Institute for Neuroscience, Amsterdam, the Netherlands; Experimental and Applied Psychology, Vrije University Amsterdam, Amsterdam, the Netherlands; Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, the Netherlands.
| |
Collapse
|
3
|
Wu J, Wang C, Wang L, Wang Y, Yang J, Yan T, Suo D, Wang L, Liu X, Zhang J. Development of a Piezoelectric Actuated Tactile Stimulation Device for Population Receptive Field Mapping in Human Somatosensory Cortex With fMRI. J Magn Reson Imaging 2022; 56:1055-1065. [PMID: 35324031 DOI: 10.1002/jmri.28173] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Revised: 03/11/2022] [Accepted: 03/14/2022] [Indexed: 12/12/2022] Open
Abstract
BACKGROUND Multichannel tactile stimulation devices is need to investigate human finger population receptive field (pRF) characteristics in the primary somatosensory cortex during functional magnetic resonance imaging (fMRI). PURPOSE To accurately characterize right-hand somatosensory representation based on the Bayesian pRF model. STUDY TYPE Prospective. POPULATION A water phantom and six healthy participants (four males, mean 23.8 years old). FIELD STRENGTH/SEQUENCE T1-weighted magnetization-prepared rapid gradient-echo, T2*-weighted echo planar imaging at 3 T. ASSESSMENT The piezoelectric actuated tactile stimulation device consisted of execution unit and control unit. The output performance of the device was measured by a laser displacement sensor. The effect of the device on images' signal-to-noise ratio (SNR) was measured by phantom experiments. The activation representation arrangement order, relative volumes, and receptive field size of the right hand were assessed during the along-digits and cross-digits paradigms. STATISTICAL TESTS The normality of the data was tested by the Shapiro-Wilk method. A paired-sample t test was performed to test pRF characteristics for all digit pairings. The significance level was set to P = 0.05 (false discovery rate [FDR] correct). RESULTS Percussive stimulation provided by the piezoelectric actuated tactile stimulator had a stable displacement (2.64 mm) over a wide range of vibration frequencies (0-30 Hz). The output delay of the device was 1 millisecond. The device did not affect the image's SNR (without the device: SNR = 138.24 ± 7.87, temporal SNR [TSNR] = 440.03 ± 52.08. With the device: SNR = 138.06 ± 8.44, TSNR = 438.52 ± 56.38. PSNR = 0.88, PTSNR = 0.46). Representations of right-hand fingers showed the same arrangement order in both experiments (D1-D5 arranged along the central sulcus). However, the relative volumes of D3 showed significant differences in S1 (P = 0.003). Among four subareas, the relative volumes of D3 were significantly different in area 1 (P = 0.047). DATA CONCLUSION This developed stimulator, through experimental verification, could play a role in pRF mapping exploration. LEVEL OF EVIDENCE 2 TECHNICAL EFFICACY STAGE: 1.
Collapse
Affiliation(s)
- Jinglong Wu
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China.,Research Center for Medical Artificial Intelligence, Shenzhen Institutes of Advanced Technology, Chinese Academy of Science, Shenzhen, China
| | - Chenyu Wang
- Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Okayama, Japan
| | - Luyao Wang
- School of Life Science, Shanghai University, Shanghai, China
| | - Yutong Wang
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
| | - Jiajia Yang
- Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Okayama, Japan.,Section on Functional Imaging Methods, National Institute of Mental Health, Bethesda, Maryland, USA
| | - Tianyi Yan
- School of Life Science, Beijing Institute of Technology, Beijing, China
| | - Dingjie Suo
- School of Life Science, Beijing Institute of Technology, Beijing, China
| | - Li Wang
- School of Life Science, Beijing Institute of Technology, Beijing, China
| | - Xin Liu
- Department of Radiology, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Jian Zhang
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
| |
Collapse
|
4
|
Duwell EJ, Woertz EN, Mathis J, Carroll J, DeYoe EA. Aberrant visual population receptive fields in human albinism. J Vis 2021; 21:19. [PMID: 34007988 PMCID: PMC8142699 DOI: 10.1167/jov.21.5.19] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022] Open
Abstract
Retinotopic organization is a fundamental feature of visual cortex thought to play a vital role in encoding spatial information. One important aspect of normal retinotopy is the representation of the right and left hemifields in contralateral visual cortex. However, in human albinism, many temporal retinal afferents decussate aberrantly at the optic chiasm resulting in partially superimposed representations of opposite hemifields in each hemisphere of visual cortex. Previous functional magnetic resonance imaging (fMRI) studies in human albinism suggest that the right and left hemifield representations are superimposed in a mirror-symmetric manner. This should produce imaging voxels which respond to two separate locations mirrored across the vertical meridian. However, it is not yet clear how retino-cortical miswiring in albinism manifests at the level of single voxel population receptive fields (pRFs). Here, we used pRF modeling to fit both single and dual pRF models to the visual responses of voxels in visual areas V1 to V3 of five subjects with albinism. We found that subjects with albinism (but not controls) have sizable clusters of voxels with unequivocal dual pRFs consistently corresponding to, but not fully coextensive with, regions of hemifield overlap. These dual pRFs were typically positioned at locations roughly mirrored across the vertical meridian and were uniquely clustered within a portion of the visual field for each subject.
Collapse
Affiliation(s)
- Ethan J Duwell
- Department of Biophysics, Medical College of Wisconsin, Milwaukee, WI, USA.,
| | - Erica N Woertz
- Department of Cell Biology, Neurobiology, and Anatomy, Medical College of Wisconsin, Milwaukee, WI, USA.,
| | - Jedidiah Mathis
- Department of Neurology, Medical College of Wisconsin, USA.,
| | - Joseph Carroll
- Department of Biophysics, Medical College of Wisconsin, Milwaukee, WI, USA.,Department of Cell Biology, Neurobiology, and Anatomy, Medical College of Wisconsin, Milwaukee, WI, USA.,Department of Ophthalmology and Visual Sciences, Medical College of Wisconsin, Milwaukee, WI, USA.,
| | - Edgar A DeYoe
- Department of Radiology, Medical College of Wisconsin, Milwaukee, WI, USA.,
| |
Collapse
|
5
|
Woertz EN, Wilk MA, Duwell EJ, Mathis JR, Carroll J, DeYoe EA. The relationship between retinal cone density and cortical magnification in human albinism. J Vis 2020; 20:10. [PMID: 32543650 PMCID: PMC7416892 DOI: 10.1167/jov.20.6.10] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023] Open
Abstract
The human fovea lies at the center of the retina and supports high-acuity vision. In normal visual system development, the highest acuity is correlated with both a high density of cone photoreceptors in the fovea and a magnified retinotopic representation of the fovea in the visual cortex. Both cone density and the cortical area dedicated to each degree of visual space—the latter describing cortical magnification (CM)—steadily decrease with increasing eccentricity from the fovea. In albinism, peak cone density at the fovea and visual acuity are decreased, but seem to be within normal limits in the periphery, thus providing a model to explore the correlation between retinal structure, cortical structure, and behavior. Here, we used adaptive optics scanning light ophthalmoscopy to assess retinal cone density and functional magnetic resonance imaging to measure CM in the primary visual cortex of normal controls and individuals with albinism. We find that retinotopic organization is more varied among individuals with albinism than previously appreciated. Additionally, CM outside the fovea is similar to that in controls, but also more variable. CM in albinism and controls exceeds that which might be predicted based on cone density alone, but is more accurately predicted by retinal ganglion cell density. This finding suggests that decreased foveal cone density in albinism may be partially counteracted by nonuniform connectivity between cones and their downstream signaling partners. Together, these results emphasize that central as well as retinal factors must be included to provide a complete picture of aberrant structure and function in albinism.
Collapse
|
6
|
Prabhakaran GT, Carvalho J, Invernizzi A, Kanowski M, Renken RJ, Cornelissen FW, Hoffmann MB. Foveal pRF properties in the visual cortex depend on the extent of stimulated visual field. Neuroimage 2020; 222:117250. [PMID: 32798683 DOI: 10.1016/j.neuroimage.2020.117250] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2020] [Revised: 07/29/2020] [Accepted: 08/03/2020] [Indexed: 01/28/2023] Open
Abstract
Previous studies demonstrated that alterations in functional MRI derived receptive field (pRF) properties in cortical projection zones of retinal lesions can erroneously be mistaken for cortical large-scale reorganization in response to visual system pathologies. We tested, whether such confounds are also evident in the normal cortical projection zone of the fovea for simulated peripheral visual field defects. We applied fMRI-based visual field mapping of the central visual field at 3 T in eight controls to compare the pRF properties of the central visual field of a reference condition (stimulus radius: 14°) and two conditions with simulated peripheral visual field defect, i.e., with a peripheral gray mask, stimulating only the central 7° or 4° radius. We quantified, for the cortical representation of the actually stimulated visual field, the changes in the position and size of the pRFs associated with reduced peripheral stimulation using conventional and advanced pRF modeling. We found foveal pRF-positions (≤3°) to be significantly shifted towards the periphery (p<0.05, corrected). These pRF-shifts were largest for the 4° condition [visual area (mean eccentricity shift): V1 (0.9°), V2 (0.9°), V3 (1.0°)], but also evident for the 7° condition [V1 (0.5°), V2 (0.5°), V3 (0.9°)]. Further, an overall enlargement of pRF-sizes was observed. These findings indicate the dependence of foveal pRF parameters on the spatial extent of the stimulated visual field and are likely associated with methodological biases and/or physiological mechanisms. Consequently, our results imply that, previously reported similar findings in patients with actual peripheral scotomas need to be interpreted with caution and indicate the need for adequate control conditions in investigations of visual cortex reorganization.
Collapse
Affiliation(s)
| | - Joana Carvalho
- Laboratory of Experimental Ophthalmology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | - Azzurra Invernizzi
- Laboratory of Experimental Ophthalmology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | - Martin Kanowski
- Department of Neurology, Otto-von-Guericke University, Magdeburg, Germany
| | - Remco J Renken
- Laboratory of Experimental Ophthalmology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands; Cognitive Neuroscience Center, University Medical Center Groningen, University of Groningen, the Netherlands
| | - Frans W Cornelissen
- Laboratory of Experimental Ophthalmology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | - Michael B Hoffmann
- Department of Ophthalmology, Otto-von-Guericke University, Magdeburg, Germany; Center for Behavioural Brain Sciences, Magdeburg, Germany.
| |
Collapse
|
7
|
Puckett AM, Schira MM, Isherwood ZJ, Victor JD, Roberts JA, Breakspear M. Manipulating the structure of natural scenes using wavelets to study the functional architecture of perceptual hierarchies in the brain. Neuroimage 2020; 221:117173. [PMID: 32682991 PMCID: PMC8239382 DOI: 10.1016/j.neuroimage.2020.117173] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Revised: 05/11/2020] [Accepted: 07/14/2020] [Indexed: 01/08/2023] Open
Abstract
Functional neuroimaging experiments that employ naturalistic stimuli (natural scenes, films, spoken narratives) provide insights into cognitive function "in the wild". Natural stimuli typically possess crowded, spectrally dense, dynamic, and multimodal properties within a rich multiscale structure. However, when using natural stimuli, various challenges exist for creating parametric manipulations with tight experimental control. Here, we revisit the typical spectral composition and statistical dependences of natural scenes, which distinguish them from abstract stimuli. We then demonstrate how to selectively degrade subtle statistical dependences within specific spatial scales using the wavelet transform. Such manipulations leave basic features of the stimuli, such as luminance and contrast, intact. Using functional neuroimaging of human participants viewing degraded natural images, we demonstrate that cortical responses at different levels of the visual hierarchy are differentially sensitive to subtle statistical dependences in natural images. This demonstration supports the notion that perceptual systems in the brain are optimally tuned to the complex statistical properties of the natural world. The code to undertake these stimulus manipulations, and their natural extension to dynamic natural scenes (films), is freely available.
Collapse
Affiliation(s)
- Alexander M Puckett
- School of Psychology, The University of Queensland, Brisbane QLD 4072, Australia; Queensland Brain Institute, The University of Queensland, Brisbane QLD 4072, Australia.
| | - Mark M Schira
- School of Psychology, University of Wollongong, Wollongong NSW 2522, Australia
| | - Zoey J Isherwood
- School of Psychology, University of Nevada, Reno NV 89557, United States
| | - Jonathan D Victor
- Feil Family Brain and Mind Research Institute and Department of Neurology, Weill Cornell Medical College, New York NY 10065, United States
| | - James A Roberts
- Brain Modelling Group, QIMR Berghofer Medical Research Institute, Brisbane QLD 4006, Australia
| | - Michael Breakspear
- Brain and Mind PRC, University of Newcastle, Newcastle NSW 2308, Australia
| |
Collapse
|
8
|
Bayesian population receptive field modeling in human somatosensory cortex. Neuroimage 2020; 208:116465. [DOI: 10.1016/j.neuroimage.2019.116465] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2019] [Revised: 12/09/2019] [Accepted: 12/12/2019] [Indexed: 11/17/2022] Open
|
9
|
Yeshurun Y. The spatial distribution of attention. Curr Opin Psychol 2019; 29:76-81. [DOI: 10.1016/j.copsyc.2018.12.008] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2018] [Revised: 11/10/2018] [Accepted: 12/13/2018] [Indexed: 10/27/2022]
|
10
|
Itthipuripat S, Vo VA, Sprague TC, Serences JT. Value-driven attentional capture enhances distractor representations in early visual cortex. PLoS Biol 2019; 17:e3000186. [PMID: 31398186 PMCID: PMC6703696 DOI: 10.1371/journal.pbio.3000186] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2019] [Revised: 08/21/2019] [Accepted: 07/17/2019] [Indexed: 12/22/2022] Open
Abstract
When a behaviorally relevant stimulus has been previously associated with reward, behavioral responses are faster and more accurate compared to equally relevant but less valuable stimuli. Conversely, task-irrelevant stimuli that were previously associated with a high reward can capture attention and distract processing away from relevant stimuli (e.g., seeing a chocolate bar in the pantry when you are looking for a nice, healthy apple). Although increasing the value of task-relevant stimuli systematically up-regulates neural responses in early visual cortex to facilitate information processing, it is not clear whether the value of task-irrelevant distractors influences behavior via competition in early visual cortex or via competition at later stages of decision-making and response selection. Here, we measured functional magnetic resonance imaging (fMRI) in human visual cortex while subjects performed a value-based learning task, and we applied a multivariate inverted encoding model (IEM) to assess the fidelity of distractor representations in early visual cortex. We found that the fidelity of neural representations related to task-irrelevant distractors increased when the distractors were previously associated with a high reward. This finding suggests that value-driven attentional capture begins with sensory modulations of distractor representations in early areas of visual cortex.
Collapse
Affiliation(s)
- Sirawaj Itthipuripat
- Learning Institute, King Mongkut’s University of Technology Thonburi, Bangkok, Thailand
- Futuristic Research in Enigmatic Aesthetics Knowledge Laboratory, King Mongkut’s University of Technology Thonburi, Bangkok, Thailand
- Department of Psychology and Center for Integrative and Cognitive Neuroscience, Vanderbilt University, Nashville, Tennessee, United States of America
- Neurosciences Graduate Program, University of California San Diego, La Jolla, California, United States of America
| | - Vy A. Vo
- Neurosciences Graduate Program, University of California San Diego, La Jolla, California, United States of America
| | - Thomas C. Sprague
- Neurosciences Graduate Program, University of California San Diego, La Jolla, California, United States of America
- Department of Psychology, New York University, New York, New York, United States of America
- Department of Psychological and Brain Sciences, University of California Santa Barbara, Santa Barbara, California, United States of America
| | - John T. Serences
- Neurosciences Graduate Program, University of California San Diego, La Jolla, California, United States of America
- Department of Psychology and Kavli Foundation for the Brain and Mind, University of California San Diego, La Jolla, California, United States of America
| |
Collapse
|
11
|
Itthipuripat S, Sprague TC, Serences JT. Functional MRI and EEG Index Complementary Attentional Modulations. J Neurosci 2019; 39:6162-6179. [PMID: 31127004 PMCID: PMC6668200 DOI: 10.1523/jneurosci.2519-18.2019] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2018] [Revised: 04/12/2019] [Accepted: 05/16/2019] [Indexed: 02/07/2023] Open
Abstract
Functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) are two noninvasive methods commonly used to study neural mechanisms supporting visual attention in humans. Studies using these tools, which have complementary spatial and temporal resolutions, implicitly assume they index similar underlying neural modulations related to external stimulus and internal attentional manipulations. Accordingly, they are often used interchangeably for constraining understanding about the impact of bottom-up and top-down factors on neural modulations. To test this core assumption, we simultaneously manipulated bottom-up sensory inputs by varying stimulus contrast and top-down cognitive modulations by changing the focus of spatial attention. Each of the male and female subjects participated in both fMRI and EEG sessions performing the same experimental paradigm. We found categorically different patterns of attentional modulation on fMRI activity in early visual cortex and early stimulus-evoked potentials measured via EEG (e.g., the P1 component and steady-state visually-evoked potentials): fMRI activation scaled additively with attention, whereas evoked EEG components scaled multiplicatively with attention. However, across longer time scales, a contralateral negative-going potential and oscillatory EEG signals in the alpha band revealed additive attentional modulation patterns like those observed with fMRI. These results challenge prior assumptions that fMRI and early stimulus-evoked potentials measured with EEG can be interchangeably used to index the same neural mechanisms of attentional modulations at different spatiotemporal scales. Instead, fMRI measures of attentional modulations are more closely linked with later EEG components and alpha-band oscillations. Considered together, hemodynamic and electrophysiological signals can jointly constrain understanding of the neural mechanisms supporting cognition.SIGNIFICANCE STATEMENT fMRI and EEG have been used as tools to measure the location and timing of attentional modulations in visual cortex and are often used interchangeably for constraining computational models under the assumption that they index similar underlying neural processes. However, by varying attentional and stimulus parameters, we found differential patterns of attentional modulations of fMRI activity in early visual cortex and commonly used stimulus-evoked potentials measured via EEG. Instead, across longer time scales, a contralateral negative-going potential and EEG oscillations in the alpha band exhibited attentional modulations similar to those observed with fMRI. Together, these results suggest that different physiological processes assayed by these complementary techniques must be jointly considered when making inferences about the neural underpinnings of cognitive operations.
Collapse
Affiliation(s)
- Sirawaj Itthipuripat
- Neurosciences Graduate Program,
- Learning Institute
- Futuristic Research in Enigmatic Aesthetics Knowledge Laboratory, King Mongkut's University of Technology Thonburi, Bangkok, 10140, Thailand
- Department of Psychology, Center for Integrative and Cognitive Neuroscience, and Interdisciplinary Program in Neuroscience, Vanderbilt University, Nashville, Tennessee 37235, and
| | - Thomas C Sprague
- Neurosciences Graduate Program,
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, Santa Barbara, California 93106-9660
| | - John T Serences
- Neurosciences Graduate Program
- Department of Psychology
- Kavli Foundation for the Brain and Mind, University of California, San Diego, La Jolla, California 92093
| |
Collapse
|
12
|
Nikolaev AR, van Leeuwen C. Scene Buildup From Latent Memory Representations Across Eye Movements. Front Psychol 2019; 9:2701. [PMID: 30687166 PMCID: PMC6336688 DOI: 10.3389/fpsyg.2018.02701] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2018] [Accepted: 12/17/2018] [Indexed: 12/16/2022] Open
Abstract
An unresolved problem in eye movement research is how a representation is constructed on-line from several consecutive fixations of a scene. Such a scene representation is generally understood to be sparse; yet, for meeting behavioral goals a certain level of detail is needed. We propose that this is achieved through the buildup of latent representations acquired at fixation. Latent representations are retained in an activity-silent manner, require minimal energy expenditure for their maintenance, and thus allow a larger storage capacity than traditional, activation based, visual working memory. The latent representations accumulate and interact in working memory to form to the scene representation. The result is rich in detail while sparse in the sense that it is restricted to the task-relevant aspects of the scene sampled through fixations. Relevant information can quickly and flexibly be retrieved by dynamical attentional prioritization. Latent representations are observable as transient functional connectivity patterns, which emerge due to short-term changes in synaptic weights. We discuss how observing latent representations could benefit from recent methodological developments in EEG-eye movement co-registration.
Collapse
Affiliation(s)
- Andrey R Nikolaev
- Laboratory for Perceptual Dynamics, Brain & Cognition Research Unit, KU Leuven, Leuven, Belgium
| | - Cees van Leeuwen
- Laboratory for Perceptual Dynamics, Brain & Cognition Research Unit, KU Leuven, Leuven, Belgium
| |
Collapse
|
13
|
van Es DM, Theeuwes J, Knapen T. Spatial sampling in human visual cortex is modulated by both spatial and feature-based attention. eLife 2018; 7:e36928. [PMID: 30526848 PMCID: PMC6286128 DOI: 10.7554/elife.36928] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2018] [Accepted: 11/13/2018] [Indexed: 11/13/2022] Open
Abstract
Spatial attention changes the sampling of visual space. Behavioral studies suggest that feature-based attention modulates this resampling to optimize the attended feature's sampling. We investigate this hypothesis by estimating spatial sampling in visual cortex while independently varying both feature-based and spatial attention. Our results show that spatial and feature-based attention interacted: resampling of visual space depended on both the attended location and feature (color vs. temporal frequency). This interaction occurred similarly throughout visual cortex, regardless of an area's overall feature preference. However, the interaction did depend on spatial sampling properties of voxels that prefer the attended feature. These findings are parsimoniously explained by variations in the precision of an attentional gain field. Our results demonstrate that the deployment of spatial attention is tailored to the spatial sampling properties of units that are sensitive to the attended feature.
Collapse
Affiliation(s)
- Daniel Marten van Es
- Behavioural and Movement SciencesVrije Universiteit AmsterdamAmsterdamThe Netherlands
| | - Jan Theeuwes
- Behavioural and Movement SciencesVrije Universiteit AmsterdamAmsterdamThe Netherlands
| | - Tomas Knapen
- Behavioural and Movement SciencesVrije Universiteit AmsterdamAmsterdamThe Netherlands
- Spinoza Centre for NeuroimagingRoyal Academy of SciencesAmsterdamThe Netherlands
| |
Collapse
|
14
|
Dumoulin SO, Knapen T. How Visual Cortical Organization Is Altered by Ophthalmologic and Neurologic Disorders. Annu Rev Vis Sci 2018; 4:357-379. [DOI: 10.1146/annurev-vision-091517-033948] [Citation(s) in RCA: 39] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Receptive fields are a core property of cortical organization. Modern neuroimaging allows routine access to visual population receptive fields (pRFs), enabling investigations of clinical disorders. Yet how the underlying neural circuitry operates is controversial. The controversy surrounds observations that measurements of pRFs can change in healthy adults as well as in patients with a range of ophthalmological and neurological disorders. The debate relates to the balance between plasticity and stability of the underlying neural circuitry. We propose that to move the debate forward, the field needs to define the implied mechanism. First, we review the pRF changes in both healthy subjects and those with clinical disorders. Then, we propose a computational model that describes how pRFs can change in healthy humans. We assert that we can correctly interpret the pRF changes in clinical disorders only if we establish the capabilities and limitations of pRF dynamics in healthy humans with mechanistic models that provide quantitative predictions.
Collapse
Affiliation(s)
- Serge O. Dumoulin
- Spinoza Centre for Neuroimaging, 1105 BK Amsterdam, Netherlands
- Department of Experimental and Applied Psychology, VU University Amsterdam, 1181 BT Amsterdam, Netherlands
- Department of Experimental Psychology, Helmholtz Institute, Utrecht University, 3584 CS Utrecht, Netherlands
| | - Tomas Knapen
- Spinoza Centre for Neuroimaging, 1105 BK Amsterdam, Netherlands
- Department of Experimental and Applied Psychology, VU University Amsterdam, 1181 BT Amsterdam, Netherlands
| |
Collapse
|
15
|
Tkacz-Domb S, Yeshurun Y. The size of the attentional window when measured by the pupillary response to light. Sci Rep 2018; 8:11878. [PMID: 30089801 PMCID: PMC6082875 DOI: 10.1038/s41598-018-30343-7] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2018] [Accepted: 07/09/2018] [Indexed: 11/09/2022] Open
Abstract
This study measured the size of the attentional window when attention is narrowly focused, using attentional modulation of the pupillary light response - pupillary constriction when covertly attending a brighter than darker area. This allowed us to avoid confounds and biases involved in relying on observers' response (e.g., RT), which contaminated previous measurements of this window. We presented letters to the right and left of fixation, each surrounded by task-irrelevant disks with varying distances. The disks were bright on one side and dark on the other. A central cue indicated which letter to attend. Luminance levels were identical across trials. We found that pupil size was modulated by the disks' luminance when they were 1° away from the attended letter, but not when this distance was larger. This suggests that the diameter of the attentional window is at least 2°, which is twice as large as that established with behavioral measurements.
Collapse
Affiliation(s)
- Shira Tkacz-Domb
- Psychology Department and Institute of Information Processing and Decision Making, University of Haifa, Haifa, 3498838, Israel.
| | - Yaffa Yeshurun
- Psychology Department and Institute of Information Processing and Decision Making, University of Haifa, Haifa, 3498838, Israel
| |
Collapse
|
16
|
Rosli Y, Carle CF, Ho Y, James AC, Kolic M, Rohan EMF, Maddess T. Retinotopic effects of visual attention revealed by dichoptic multifocal pupillography. Sci Rep 2018; 8:2991. [PMID: 29445236 PMCID: PMC5813021 DOI: 10.1038/s41598-018-21196-1] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2017] [Accepted: 01/31/2018] [Indexed: 01/10/2023] Open
Abstract
Multifocal pupillographic objective perimetry (mfPOP) has recently been shown to be able to measure cortical function. Here we assessed 44 regions of the central 60 degrees of the visual fields of each eye concurrently in 7 minutes/test. We examined how foveally- and peripherally-directed attention changed response sensitivity and delay across the 44 visual field locations/eye. Four experiments were completed comparing white, yellow and blue stimulus arrays. Experiments 1 to 4 tested 16, 23, 9 and 6 subjects, 49/54 being unique. Experiment 1, Experiments 2 and 3, and Experiment 4 used three variants of the mfPOP method that provided increasingly improved signal quality. Experiments 1 to 3 examined centrally directed attention, and Experiment 4 compared effects of attention directed to different peripheral targets. Attention reduced the sensitivity of the peripheral locations in Experiment 1, but only for the white stimuli not yellow. Experiment 2 confirmed that result. Experiment 3 showed that blue stimuli behaved like white. Peripheral attention showed increased sensitivity around the attentional targets. The results are discussed in terms of the cortical inputs to the pupillary system. The results agree with those from multifocal and other fMRI and VEP studies. mfPOP may be a useful adjunct to those methods.
Collapse
Affiliation(s)
- Yanti Rosli
- Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University, Canberra, Australia
- Biomedical Science Program, Diagnostic & Applied Health Sciences, Faculty of Health Science, Universiti Kebangsaan Malaysia, Jalan Raja Muda Abdul Aziz, 50300, Kuala Lumpur, Malaysia
| | - Corinne Frances Carle
- Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University, Canberra, Australia
| | - Yiling Ho
- Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University, Canberra, Australia
| | - Andrew Charles James
- Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University, Canberra, Australia
| | - Maria Kolic
- Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University, Canberra, Australia
- Centre for Eye Research Australia, University of Melbourne, East Melbourne, Australia
| | - Emilie Marie Françoise Rohan
- Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University, Canberra, Australia
| | - Ted Maddess
- Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University, Canberra, Australia.
| |
Collapse
|
17
|
Spatially selective responses to Kanizsa and occlusion stimuli in human visual cortex. Sci Rep 2018; 8:611. [PMID: 29330457 PMCID: PMC5766606 DOI: 10.1038/s41598-017-19121-z] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2017] [Accepted: 12/16/2017] [Indexed: 11/12/2022] Open
Abstract
Early visual cortex responds to illusory contours in which abutting lines or collinear edges imply the presence of an occluding surface, as well as to occluded parts of an object. Here we used functional magnetic resonance imaging (fMRI) and population receptive field (pRF) analysis to map retinotopic responses in early visual cortex using bar stimuli defined by illusory contours, occluded parts of a bar, or subtle luminance contrast. All conditions produced retinotopic responses in early visual field maps even though signal-to-noise ratios were very low. We found that signal-to-noise ratios and coherence with independent high-contrast mapping data increased from V1 to V2 to V3. Moreover, we found no differences of signal-to-noise ratios or pRF sizes between the low-contrast luminance and illusion conditions. We propose that all three conditions mapped spatial attention to the bar location rather than activations specifically related to illusory contours or occlusion.
Collapse
|
18
|
Extensive Tonotopic Mapping across Auditory Cortex Is Recapitulated by Spectrally Directed Attention and Systematically Related to Cortical Myeloarchitecture. J Neurosci 2017; 37:12187-12201. [PMID: 29109238 PMCID: PMC5729191 DOI: 10.1523/jneurosci.1436-17.2017] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2017] [Revised: 10/04/2017] [Accepted: 10/06/2017] [Indexed: 11/21/2022] Open
Abstract
Auditory selective attention is vital in natural soundscapes. But it is unclear how attentional focus on the primary dimension of auditory representation—acoustic frequency—might modulate basic auditory functional topography during active listening. In contrast to visual selective attention, which is supported by motor-mediated optimization of input across saccades and pupil dilation, the primate auditory system has fewer means of differentially sampling the world. This makes spectrally-directed endogenous attention a particularly crucial aspect of auditory attention. Using a novel functional paradigm combined with quantitative MRI, we establish in male and female listeners that human frequency-band-selective attention drives activation in both myeloarchitectonically estimated auditory core, and across the majority of tonotopically mapped nonprimary auditory cortex. The attentionally driven best-frequency maps show strong concordance with sensory-driven maps in the same subjects across much of the temporal plane, with poor concordance in areas outside traditional auditory cortex. There is significantly greater activation across most of auditory cortex when best frequency is attended, versus ignored; the same regions do not show this enhancement when attending to the least-preferred frequency band. Finally, the results demonstrate that there is spatial correspondence between the degree of myelination and the strength of the tonotopic signal across a number of regions in auditory cortex. Strong frequency preferences across tonotopically mapped auditory cortex spatially correlate with R1-estimated myeloarchitecture, indicating shared functional and anatomical organization that may underlie intrinsic auditory regionalization. SIGNIFICANCE STATEMENT Perception is an active process, especially sensitive to attentional state. Listeners direct auditory attention to track a violin's melody within an ensemble performance, or to follow a voice in a crowded cafe. Although diverse pathologies reduce quality of life by impacting such spectrally directed auditory attention, its neurobiological bases are unclear. We demonstrate that human primary and nonprimary auditory cortical activation is modulated by spectrally directed attention in a manner that recapitulates its tonotopic sensory organization. Further, the graded activation profiles evoked by single-frequency bands are correlated with attentionally driven activation when these bands are presented in complex soundscapes. Finally, we observe a strong concordance in the degree of cortical myelination and the strength of tonotopic activation across several auditory cortical regions.
Collapse
|
19
|
Puckett AM, Bollmann S, Barth M, Cunnington R. Measuring the effects of attention to individual fingertips in somatosensory cortex using ultra-high field (7T) fMRI. Neuroimage 2017; 161:179-187. [PMID: 28801252 DOI: 10.1016/j.neuroimage.2017.08.014] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2016] [Revised: 06/13/2017] [Accepted: 08/03/2017] [Indexed: 11/19/2022] Open
Abstract
Attention to sensory information has been shown to modulate the neuronal processing of that information. For example, visuospatial attention acts by modulating responses at retinotopically appropriate regions of visual cortex (Puckett and DeYoe, 2015; Tootell et al. 1998). Much less, however, is known about the neuronal processing associated with attending to other modalities of sensory information. One reason for this is that visual cortex is relatively large, and therefore easier to access non-invasively in humans using tools such as functional magnetic resonance imaging (fMRI). With high-resolution fMRI, however, it is now possible to access smaller cortical areas such as primary somatosensory cortex (Martuzzi et al., 2014; Sanchez-Panchuelo et al., 2010; Schweisfurth et al. 2014; Schweizer et al. 2008). Here, we combined a novel experimental design and high-resolution fMRI at ultra-high field (7T) to measure the effects of attention to tactile stimulation in primary somatosensory cortex, S1. We find that attention modulates somatotopically appropriate regions of S1, and importantly, that this modulation can be measured at the level of the cortical representation of individual fingertips.
Collapse
Affiliation(s)
- Alexander M Puckett
- Queensland Brain Institute, The University of Queensland, Brisbane, QLD 4072, Australia.
| | - Saskia Bollmann
- Centre for Advanced Imaging, The University of Queensland, Brisbane, QLD 4072, Australia
| | - Markus Barth
- Centre for Advanced Imaging, The University of Queensland, Brisbane, QLD 4072, Australia
| | - Ross Cunnington
- Queensland Brain Institute, The University of Queensland, Brisbane, QLD 4072, Australia; School of Psychology, The University of Queensland, Brisbane, QLD 4072, Australia
| |
Collapse
|
20
|
Visual attention spreads broadly but selects information locally. Sci Rep 2016; 6:35513. [PMID: 27759056 PMCID: PMC5069499 DOI: 10.1038/srep35513] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2016] [Accepted: 09/22/2016] [Indexed: 01/23/2023] Open
Abstract
Visual attention spreads over a range around the focus as the spotlight metaphor describes. Spatial spread of attentional enhancement and local selection/inhibition are crucial factors determining the profile of the spatial attention. Enhancement and ignorance/suppression are opposite effects of attention, and appeared to be mutually exclusive. Yet, no unified view of the factors has been provided despite their necessity for understanding the functions of spatial attention. This report provides electroencephalographic and behavioral evidence for the attentional spread at an early stage and selection/inhibition at a later stage of visual processing. Steady state visual evoked potential showed broad spatial tuning whereas the P3 component of the event related potential showed local selection or inhibition of the adjacent areas. Based on these results, we propose a two-stage model of spatial attention with broad spread at an early stage and local selection at a later stage.
Collapse
|
21
|
Huang D, Xue L, Wang X, Chen Y. Using spatial uncertainty to manipulate the size of the attention focus. Sci Rep 2016; 6:32364. [PMID: 27582047 PMCID: PMC5007663 DOI: 10.1038/srep32364] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2016] [Accepted: 08/08/2016] [Indexed: 11/10/2022] Open
Abstract
Preferentially processing behaviorally relevant information is vital for primate survival. In visuospatial attention studies, manipulating the spatial extent of attention focus is an important question. Although many studies have claimed to successfully adjust attention field size by either varying the uncertainty about the target location (spatial uncertainty) or adjusting the size of the cue orienting the attention focus, no systematic studies have assessed and compared the effectiveness of these methods. We used a multiple cue paradigm with 2.5° and 7.5° rings centered around a target position to measure the cue size effect, while the spatial uncertainty levels were manipulated by changing the number of cueing positions. We found that spatial uncertainty had a significant impact on reaction time during target detection, while the cue size effect was less robust. We also carefully varied the spatial scope of potential target locations within a small or large region and found that this amount of variation in spatial uncertainty can also significantly influence target detection speed. Our results indicate that adjusting spatial uncertainty is more effective than varying cue size when manipulating attention field size.
Collapse
Affiliation(s)
- Dan Huang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Linyan Xue
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China.,School of Quality and Technical Supervision, Hebei University, Baoding, 071002, China
| | - Xin Wang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Yao Chen
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| |
Collapse
|
22
|
Hummer A, Ritter M, Tik M, Ledolter AA, Woletz M, Holder GE, Dumoulin SO, Schmidt-Erfurth U, Windischberger C. Eyetracker-based gaze correction for robust mapping of population receptive fields. Neuroimage 2016; 142:211-224. [PMID: 27389789 DOI: 10.1016/j.neuroimage.2016.07.003] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2016] [Revised: 06/14/2016] [Accepted: 07/02/2016] [Indexed: 11/26/2022] Open
Abstract
Functional MRI enables the acquisition of a retinotopic map that relates regions of the visual field to neural populations in the visual cortex. During such a "population receptive field" (PRF) experiment, stable gaze fixation is of utmost importance in order to correctly link the presented stimulus patterns to stimulated retinal regions and the resulting Blood Oxygen Level Dependent (BOLD) response of the appropriate region within the visual cortex. A method is described that compensates for unstable gaze fixation by recording gaze position via an eyetracker and subsequently modifies the input stimulus underlying the PRF analysis according to the eyetracking measures. Here we show that PRF maps greatly improve when the method is applied to data acquired with either saccadic or smooth eye movements. We conclude that the technique presented herein is useful for studies involving subjects with unstable gaze fixation, particularly elderly patient populations.
Collapse
Affiliation(s)
- A Hummer
- MR Centre of Excellence, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Währinger Gürtel 18-20, 1090 Vienna, Austria
| | - M Ritter
- Department of Ophthalmology and Optometry, Medical University of Vienna, Währinger Gürtel 18-20, 1090 Vienna, Austria
| | - M Tik
- MR Centre of Excellence, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Währinger Gürtel 18-20, 1090 Vienna, Austria
| | - A A Ledolter
- Department of Ophthalmology and Optometry, Medical University of Vienna, Währinger Gürtel 18-20, 1090 Vienna, Austria
| | - M Woletz
- MR Centre of Excellence, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Währinger Gürtel 18-20, 1090 Vienna, Austria
| | - G E Holder
- Institute of Ophthalmology, University College London, 11-43 Bath Street, London, EC1V 2PD, UK; Moorfields Eye Hospital, 162 City Road, London, EC1V 9EL, UK
| | - S O Dumoulin
- Experimental Psychology, Helmholtz Institute, Utrecht University, Heidelberglaan 1, 3584 CS Utrecht, The Netherlands; Spinoza Centre for Neuroimaging, Meibergdreef 75, 1105BK, Amsterdam, The Netherlands
| | - U Schmidt-Erfurth
- Department of Ophthalmology and Optometry, Medical University of Vienna, Währinger Gürtel 18-20, 1090 Vienna, Austria
| | - C Windischberger
- MR Centre of Excellence, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Währinger Gürtel 18-20, 1090 Vienna, Austria.
| |
Collapse
|