1
|
Sousa T, Sayal A, Duarte JV, Costa GN, Castelo-Branco M. A human cortical adaptive mutual inhibition circuit underlying competition for perceptual decision and repetition suppression reversal. Neuroimage 2024; 285:120488. [PMID: 38065278 DOI: 10.1016/j.neuroimage.2023.120488] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Revised: 09/17/2023] [Accepted: 12/05/2023] [Indexed: 01/13/2024] Open
Abstract
A model based on inhibitory coupling has been proposed to explain perceptual oscillations. This 'adapting reciprocal inhibition' model postulates that it is the strength of inhibitory coupling that determines the fate of competition between percepts. Here, we used an fMRI-based adaptation technique to reveal the influence of neighboring neuronal populations, such as reciprocal inhibition, in motion-selective hMT+/V5. If reciprocal inhibition exists in this region, the following predictions should hold: 1. stimulus-driven response would not simply decrease, as predicted by simple repetition-suppression of neuronal populations, but instead, increase due to the activity from adjacent populations; 2. perceptual decision involving competing representations, should reflect decreased reciprocal inhibition by adaptation; 3. neural activity for the competing percept should also later on increase upon adaptation. Our results confirm these three predictions, showing that a model of perceptual decision based on adapting reciprocal inhibition holds true. Finally, they also show that the net effect of the well-known repetition suppression phenomenon can be reversed by this mechanism.
Collapse
Affiliation(s)
- Teresa Sousa
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), University of Coimbra, Portugal; Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Portugal
| | - Alexandre Sayal
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), University of Coimbra, Portugal; Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Portugal; Siemens Healthineers, Portugal
| | - João V Duarte
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), University of Coimbra, Portugal; Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Portugal; Faculty of Medicine, University of Coimbra, Portugal
| | - Gabriel N Costa
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), University of Coimbra, Portugal; Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Portugal
| | - Miguel Castelo-Branco
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), University of Coimbra, Portugal; Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Portugal; Faculty of Medicine, University of Coimbra, Portugal; Faculty of Psychology and Neuroscience, University of Maastricht, the Kingdom of the Netherlands.
| |
Collapse
|
2
|
Cortês AB, Duarte JV, Castelo-Branco M. Hysteresis reveals a happiness bias effect in dynamic emotion recognition from ambiguous biological motion. J Vis 2023; 23:5. [PMID: 37962533 PMCID: PMC10653266 DOI: 10.1167/jov.23.13.5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2023] [Accepted: 10/10/2023] [Indexed: 11/15/2023] Open
Abstract
Considering the nonlinear dynamic nature of emotion recognition, it is believed to be strongly dependent on temporal context. This can be investigated by resorting to the phenomenon of hysteresis, which features a form of serial dependence, entailed by continuous temporal stimulus trajectories. Under positive hysteresis, the percept remains stable in visual memory (persistence) while in negative hysteresis, it shifts earlier (adaptation) to the opposite interpretation. Here, we asked whether positive or negative hysteresis occurs in emotion recognition of inherently ambiguous biological motion, while testing for the controversial debate of a negative versus positive emotional bias. Participants (n = 22) performed a psychophysical experiment in which they were asked to judge stimulus transitions between two emotions, happiness and sadness, from an actor database, and report perceived emotion across time, from one emotion to the opposite as physical cues were continuously changing. Our results reveal perceptual hysteresis in ambiguous emotion recognition, with positive hysteresis (visual persistence) predominating. However, negative hysteresis (adaptation/fatigue) was also observed in particular in the direction from sadness to happiness. This demonstrates a positive (happiness) bias in emotion recognition in ambiguous biological motion recognition. Finally, the interplay between positive and negative hysteresis suggests an underlying competition between visual persistence and adaptation mechanisms during ambiguous emotion recognition.
Collapse
Affiliation(s)
- Ana Borges Cortês
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Coimbra, Portugal
| | - João Valente Duarte
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Coimbra, Portugal
- Faculty of Medicine, University of Coimbra, Coimbra, Portugal
| | - Miguel Castelo-Branco
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Coimbra, Portugal
- Faculty of Medicine, University of Coimbra, Coimbra, Portugal
| |
Collapse
|
3
|
Malaya CA, Parikh PJ, Smith DL, Riaz A, Chandrasekaran S, Layne CS. Effects of simulated hypo-gravity on lower limb kinematic and electromyographic variables during anti-gravitational treadmill walking. Front Physiol 2023; 14:1141015. [PMID: 37362436 PMCID: PMC10285399 DOI: 10.3389/fphys.2023.1141015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Accepted: 05/26/2023] [Indexed: 06/28/2023] Open
Abstract
Introduction: This study investigated kinematic and EMG changes in gait across simulated gravitational unloading levels between 100% and 20% of normal body weight. This study sought to identify if each level of unloading elicited consistent changes-particular to that percentage of normal body weight-or if the changes seen with unloading could be influenced by the previous level(s) of unloading. Methods: 15 healthy adult participants (26.3 ± 2.5 years; 53% female) walked in an Alter-G anti-gravity treadmill unloading system (mean speed: 1.49 ± 0.37 mph) for 1 min each at 100%, 80%, 60%, 40% and 20% of normal body weight, before loading back to 100% in reverse order. Lower-body kinematic data were captured by inertial measurement units, and EMG data were collected from the rectus femoris, biceps femoris, medial gastrocnemius, and anterior tibialis. Data were compared across like levels of load using repeated measures ANOVA and statistical parametric mapping. Difference waveforms for adjacent levels were created to examine the rate of change between different unloading levels. Results: This study found hip, knee, and ankle kinematics as well as activity in the rectus femoris, and medial gastrocnemius were significantly different at the same level of unloading, having arrived from a higher, or lower level of unloading. There were no significant changes in the kinematic difference waveforms, however the waveform representing the change in EMG between 100% and 80% load was significantly different from all other levels. Discussion: This study found that body weight unloading from 100% to 20% elicited distinct responses in the medial gastrocnemius, as well as partly in the rectus femoris. Hip, knee, and ankle kinematics were also affected differentially by loading and unloading, especially at 40% of normal body weight. These findings suggest the previous level of gravitational load is an important factor to consider in determining kinematic and EMG responses to the current level during loading and unloading below standard g. Similarly, the rate of change in kinematics from 100% to 20% appears to be linear, while the rate of change in EMG was non-linear. This is of particular interest, as it suggests that kinematic and EMG measures decouple with unloading and may react to unloading uniquely.
Collapse
Affiliation(s)
- Christopher A. Malaya
- Center for Neuromotor and Biomechanics Research, Department of Health and Human Performance, University of Houston, Houston, TX, United States
- Grail Laboratory, Parker University, Dallas, TX, United States
| | - Pranav J. Parikh
- Center for Neuromotor and Biomechanics Research, Department of Health and Human Performance, University of Houston, Houston, TX, United States
| | - Dean L. Smith
- Nutrition and Health, Department of Kinesiology, Miami University, Oxford, OH, United States
| | - Arshia Riaz
- Center for Neuromotor and Biomechanics Research, Department of Health and Human Performance, University of Houston, Houston, TX, United States
| | - Subhalakshmi Chandrasekaran
- Center for Neuromotor and Biomechanics Research, Department of Health and Human Performance, University of Houston, Houston, TX, United States
| | - Charles S. Layne
- Center for Neuromotor and Biomechanics Research, Department of Health and Human Performance, University of Houston, Houston, TX, United States
| |
Collapse
|
4
|
Bidelman GM, Carter JA. Continuous dynamics in behavior reveal interactions between perceptual warping in categorization and speech-in-noise perception. Front Neurosci 2023; 17:1032369. [PMID: 36937676 PMCID: PMC10014819 DOI: 10.3389/fnins.2023.1032369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Accepted: 02/14/2023] [Indexed: 03/05/2023] Open
Abstract
Introduction Spoken language comprehension requires listeners map continuous features of the speech signal to discrete category labels. Categories are however malleable to surrounding context and stimulus precedence; listeners' percept can dynamically shift depending on the sequencing of adjacent stimuli resulting in a warping of the heard phonetic category. Here, we investigated whether such perceptual warping-which amplify categorical hearing-might alter speech processing in noise-degraded listening scenarios. Methods We measured continuous dynamics in perception and category judgments of an acoustic-phonetic vowel gradient via mouse tracking. Tokens were presented in serial vs. random orders to induce more/less perceptual warping while listeners categorized continua in clean and noise conditions. Results Listeners' responses were faster and their mouse trajectories closer to the ultimate behavioral selection (marked visually on the screen) in serial vs. random order, suggesting increased perceptual attraction to category exemplars. Interestingly, order effects emerged earlier and persisted later in the trial time course when categorizing speech in noise. Discussion These data describe interactions between perceptual warping in categorization and speech-in-noise perception: warping strengthens the behavioral attraction to relevant speech categories, making listeners more decisive (though not necessarily more accurate) in their decisions of both clean and noise-degraded speech.
Collapse
Affiliation(s)
- Gavin M. Bidelman
- Department of Speech, Language and Hearing Sciences, Indiana University, Bloomington, IN, United States
- Program in Neuroscience, Indiana University, Bloomington, IN, United States
| | - Jared A. Carter
- School of Communication Sciences and Disorders, University of Memphis, Memphis, TN, United States
- Hearing Sciences – Scottish Section, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Glasgow, United Kingdom
| |
Collapse
|
5
|
Duarte JV, Guerra C, Moreno C, Gomes L, Castelo-Branco M. Changes in hemodynamic response function components reveal specific changes in neurovascular coupling in type 2 diabetes. Front Physiol 2023; 13:1101470. [PMID: 36703928 PMCID: PMC9872943 DOI: 10.3389/fphys.2022.1101470] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Accepted: 12/12/2022] [Indexed: 01/11/2023] Open
Abstract
Type 2 Diabetes Mellitus (T2DM) is a metabolic disease that leads to multiple vascular complications with concomitant changes in human neurophysiology, which may lead to long-term cognitive impairment, and dementia. Early impairments of neurovascular coupling can be studied using event-related functional magnetic resonance imaging (fMRI) designs. Here, we aimed to characterize the changes in the hemodynamic response function (HRF) in T2DM to probe components from the initial dip to late undershoot. We investigated whether the HRF morphology is altered throughout the brain in T2DM, by extracting several parameters of the fMRI response profiles in 141 participants (64 patients with T2DM and 77 healthy controls) performing a visual motion discrimination task. Overall, the patients revealed significantly different HRFs, which extended to all brain regions, suggesting that this is a general phenomenon. The HRF in T2DM was found to be more sluggish, with a higher peak latency and lower peak amplitude, relative slope to peak, and area under the curve. It also showed a pronounced initial dip, suggesting that the initial avidity for oxygen is not compensated for, and an absent or less prominent but longer undershoot. Most HRF parameters showed a higher dispersion and variability in T2DM. In sum, we provide a definite demonstration of an impaired hemodynamic response function in the early stages of T2DM, following a previous suggestion of impaired neurovascular coupling. The quantitative demonstration of a significantly altered HRF morphology in separate response phases suggests an alteration of distinct physiological mechanisms related to neurovascular coupling, which should be considered in the future to potentially halt the deterioration of the brain function in T2DM.
Collapse
Affiliation(s)
- João Valente Duarte
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), Institute for Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Coimbra, Portugal,Faculty of Medicine, University of Coimbra, Coimbra, Portugal,Intelligent Systems Associate Laboratory (LASI), Coimbra, Portugal
| | - Catarina Guerra
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), Institute for Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Coimbra, Portugal
| | - Carolina Moreno
- Service of Endocrinology, Diabetes and Metabolism, Coimbra University Hospital, Coimbra, Portugal
| | - Leonor Gomes
- Service of Endocrinology, Diabetes and Metabolism, Coimbra University Hospital, Coimbra, Portugal
| | - Miguel Castelo-Branco
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), Institute for Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Coimbra, Portugal,Faculty of Medicine, University of Coimbra, Coimbra, Portugal,Intelligent Systems Associate Laboratory (LASI), Coimbra, Portugal,*Correspondence: Miguel Castelo-Branco,
| |
Collapse
|
6
|
Esposito A, Chiarella SG, Raffone A, Nikolaev AR, van Leeuwen C. Perceptual bias contextualized in visually ambiguous stimuli. Cognition 2023; 230:105284. [PMID: 36174260 DOI: 10.1016/j.cognition.2022.105284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Revised: 09/06/2022] [Accepted: 09/09/2022] [Indexed: 11/28/2022]
Abstract
The visual appearance of an object is a function of stimulus properties as well as perceptual biases imposed by the observer. The context-specific trade-off between both can be measured accurately in a perceptual judgment task, involving grouping by proximity in ambiguous dot lattices. Such grouping depends lawfully on a stimulus parameter of the dot lattices known as their aspect ratio (AR), whose effect is modulated by a perceptual bias representing the preference for a cardinal orientation. In two experiments, we investigated how preceding context can lead to bias modulation, either in a top-down fashion via visual working memory (VWM) or bottom-up via sensory priming. In Experiment 1, we embedded the perceptual judgment task in a change detection paradigm and studied how the factors of VWM load (complexity of the memory array) and content (congruency in orientation to the ensuing dot lattice) affect the prominence of perceptual bias. A robust vertical orientation bias was observed, which was increased by VWM load and modulated by congruent VWM content. In Experiment 2, dot lattices were preceded by oriented primes. Here, primes regardless of orientation elicited a vertical orientation bias in dot lattices compared to a neutral baseline. Taken together, the two experiments demonstrate that top-down context (VWM load and content) effectively controls orientation bias modulation, while bottom-up context (i.e., priming) merely acts as an undifferentiated trigger to perceptual bias. These findings characterize the temporal context sensitivity of Gestalt perception, shed light on the processes responsible for different perceptual outcomes of ambiguous stimuli, and identify some of the mechanisms controlling perceptual bias.
Collapse
Affiliation(s)
- Antonino Esposito
- Department of Psychology, Sapienza University of Rome, Italy; Brain and Cognition Research Unit, KU Leuven, Belgium.
| | - Salvatore Gaetano Chiarella
- Department of Psychology, Sapienza University of Rome, Italy; Brain and Cognition Research Unit, KU Leuven, Belgium
| | | | - Andrey R Nikolaev
- Brain and Cognition Research Unit, KU Leuven, Belgium; Department of Psychology, Lund University, Sweden
| | - Cees van Leeuwen
- Brain and Cognition Research Unit, KU Leuven, Belgium; Center for Cognitive Science, TU Kaiserslautern, Germany
| |
Collapse
|
7
|
Fan L, Li C, Huang ZG, Zhao J, Wu X, Liu T, Li Y, Wang J. The longitudinal neural dynamics changes of whole brain connectome during natural recovery from poststroke aphasia. NEUROIMAGE: CLINICAL 2022; 36:103190. [PMID: 36174256 PMCID: PMC9668607 DOI: 10.1016/j.nicl.2022.103190] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2022] [Revised: 07/24/2022] [Accepted: 09/08/2022] [Indexed: 12/14/2022] Open
Abstract
Poststroke aphasia is one of the most dramatic functional deficits that results from direct damage of focal brain regions and dysfunction of large-scale brain networks. The reconstruction of language function depends on the hierarchical whole-brain dynamic reorganization. However, investigations into the longitudinal neural changes of large-scale brain networks for poststroke aphasia remain scarce. Here we characterize large-scale brain dynamics in left-frontal-stroke aphasia through energy landscape analysis. Using fMRI during an auditory comprehension task, we find that aphasia patients suffer serious whole-brain dynamics perturbation in the acute and subacute stages after stroke, in which the brains were restricted into two major activity patterns. Following spontaneous recovery process, the brain flexibility improved in the chronic stage. Critically, we demonstrated that the abnormal neural dynamics are correlated with the aberrant brain network coordination. Taken together, the energy landscape analysis exhibited that the acute poststroke aphasia has a constrained, low dimensional brain dynamics, which were replaced by less constrained and high dimensional dynamics at chronic aphasia. Our study provides a new perspective to profoundly understand the pathological mechanisms of poststroke aphasia.
Collapse
Affiliation(s)
- Liming Fan
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Institute of Health and Rehabilitation Science, School of Life Science and Technology, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, PR China,National Engineering Research Center of Health Care and Medical Devices. Guangzhou, Guangdong 510500, PR China
| | - Chenxi Li
- Department of the Psychology of Military Medicine, Air Force Medical University, Xi’an, Shaanxi 710032, PR China
| | - Zi-gang Huang
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Institute of Health and Rehabilitation Science, School of Life Science and Technology, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, PR China,National Engineering Research Center of Health Care and Medical Devices. Guangzhou, Guangdong 510500, PR China
| | - Jie Zhao
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Institute of Health and Rehabilitation Science, School of Life Science and Technology, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, PR China,National Engineering Research Center of Health Care and Medical Devices. Guangzhou, Guangdong 510500, PR China
| | - Xiaofeng Wu
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Institute of Health and Rehabilitation Science, School of Life Science and Technology, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, PR China,National Engineering Research Center of Health Care and Medical Devices. Guangzhou, Guangdong 510500, PR China
| | - Tian Liu
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Institute of Health and Rehabilitation Science, School of Life Science and Technology, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, PR China,National Engineering Research Center of Health Care and Medical Devices. Guangzhou, Guangdong 510500, PR China
| | - Youjun Li
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Institute of Health and Rehabilitation Science, School of Life Science and Technology, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, PR China,National Engineering Research Center of Health Care and Medical Devices. Guangzhou, Guangdong 510500, PR China,Corresponding authors at: The Key Laboratory of Biomedical Information Engineering of Ministry of Education, and Institute of Biomedical Engineering, School of Life Science and Technology, Xi’an Jiaotong University, Xi’an 710049, PR China.
| | - Jue Wang
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Institute of Health and Rehabilitation Science, School of Life Science and Technology, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, PR China,National Engineering Research Center of Health Care and Medical Devices. Guangzhou, Guangdong 510500, PR China,The Key Laboratory of Neuro-informatics & Rehabilitation Engineering of Ministry of Civil Affairs, Xi’an, Shaanxi 710049, PR China,Corresponding authors at: The Key Laboratory of Biomedical Information Engineering of Ministry of Education, and Institute of Biomedical Engineering, School of Life Science and Technology, Xi’an Jiaotong University, Xi’an 710049, PR China.
| |
Collapse
|
8
|
Duarte JV, Abreu R, Castelo-Branco M. A two-stage framework for neural processing of biological motion. Neuroimage 2022; 259:119403. [PMID: 35738331 DOI: 10.1016/j.neuroimage.2022.119403] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2022] [Revised: 05/18/2022] [Accepted: 06/19/2022] [Indexed: 11/26/2022] Open
Abstract
It remains to be understood how biological motion is hierarchically computed, from discrimination of local biological motion animacy to global dynamic body perception. Here, we addressed this functional separation of the correlates of the perception of local biological motion from perception of global motion of a body. We hypothesized that local biological motion processing can be isolated, by using a single dot motion perceptual decision paradigm featuring the biomechanical details of local realistic motion of a single joint. To ensure that we were indeed tackling processing of biological motion properties we used a discrimination instead of detection task. We discovered using representational similarity analysis that two key early dorsal and two ventral stream regions (visual motion selective hMT+ and V3A, extrastriate body area EBA and a region within fusiform gyrus FFG) showed robust and separable signals related to encoding of local biological motion and global motion-mediated shape. These signals reflected two independent processing stages, as revealed by representational similarity analysis and deconvolution of fMRI responses to each motion pattern. This study showed that higher level pSTS encodes both classes of biological motion in a similar way, revealing a higher-level integrative stage, reflecting scale independent biological motion perception. Our results reveal a two-stage framework for neural computation of biological motion, with an independent contribution of dorsal and ventral regions for the initial stage.
Collapse
Affiliation(s)
- João Valente Duarte
- Centre of Biomedical Imaging and Translational Research (CIBIT), Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Portugal; Faculty of Medicine, University of Coimbra, Portugal
| | - Rodolfo Abreu
- Centre of Biomedical Imaging and Translational Research (CIBIT), Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Portugal
| | - Miguel Castelo-Branco
- Centre of Biomedical Imaging and Translational Research (CIBIT), Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Portugal; Faculty of Medicine, University of Coimbra, Portugal.
| |
Collapse
|
9
|
Carter JA, Buder EH, Bidelman GM. Nonlinear dynamics in auditory cortical activity reveal the neural basis of perceptual warping in speech categorization. JASA EXPRESS LETTERS 2022; 2:045201. [PMID: 35434716 PMCID: PMC8984957 DOI: 10.1121/10.0009896] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Accepted: 03/03/2022] [Indexed: 06/14/2023]
Abstract
Surrounding context influences speech listening, resulting in dynamic shifts to category percepts. To examine its neural basis, event-related potentials (ERPs) were recorded during vowel identification with continua presented in random, forward, and backward orders to induce perceptual warping. Behaviorally, sequential order shifted individual listeners' categorical boundary, versus random delivery, revealing perceptual warping (biasing) of the heard phonetic category dependent on recent stimulus history. ERPs revealed later (∼300 ms) activity localized to superior temporal and middle/inferior frontal gyri that predicted listeners' hysteresis/enhanced contrast magnitudes. Findings demonstrate that interactions between frontotemporal brain regions govern top-down, stimulus history effects on speech categorization.
Collapse
Affiliation(s)
- Jared A Carter
- Institute for Intelligent Systems, University of Memphis, Memphis, Tennessee 38152, USA
| | - Eugene H Buder
- School of Communication Sciences and Disorders, University of Memphis, Memphis, Tennessee 38152, USA
| | - Gavin M Bidelman
- Department of Speech, Language and Hearing Sciences, Indiana University, , Bloomington, Indiana 47408, USA , ,
| |
Collapse
|
10
|
Positive hysteresis in emotion recognition: Face processing visual regions are involved in perceptual persistence, which mediates interactions between anterior insula and medial prefrontal cortex. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2022; 22:1275-1289. [PMID: 35857280 PMCID: PMC9622546 DOI: 10.3758/s13415-022-01024-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Accepted: 06/22/2022] [Indexed: 01/27/2023]
Abstract
Facial emotion perception can be studied from the point of view of dynamic systems whose output may depend not only on current input but also on prior history - a phenomenon known as hysteresis. In cognitive neuroscience, hysteresis has been described as positive (perceptual persistence) or negative (fatigue of current percept) depending on whether perceptual switching occurs later or earlier than actual physical stimulus changes. However, its neural correlates remain elusive. We used dynamic transitions between emotional expressions and combined behavioral assessment with functional magnetic resonance imaging (fMRI) to investigate the underlying circuitry of perceptual hysteresis in facial emotion recognition. Our findings revealed the involvement of face-selective visual areas - fusiform face area (FFA) and superior temporal sulcus (STS) - in perceptual persistence as well as the right anterior insula. Moreover, functional connectivity analyses revealed an interplay between the right anterior insula and medial prefrontal cortex, which showed to be dependent on the presence of positive hysteresis. Our results support the hypothesis that high-order regions are involved in perceptual stabilization and decision during perceptual persistence (positive hysteresis) and add evidence to the role of the anterior insula as a hub of sensory information in perceptual decision-making.
Collapse
|
11
|
Ernst MR, Burwick T, Triesch J. Recurrent processing improves occluded object recognition and gives rise to perceptual hysteresis. J Vis 2021; 21:6. [PMID: 34905052 PMCID: PMC8684313 DOI: 10.1167/jov.21.13.6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
Over the past decades, object recognition has been predominantly studied and modelled as a feedforward process. This notion was supported by the fast response times in psychophysical and neurophysiological experiments and the recent success of deep feedforward neural networks for object recognition. Recently, however, this prevalent view has shifted and recurrent connectivity in the brain is now believed to contribute significantly to object recognition — especially under challenging conditions, including the recognition of partially occluded objects. Moreover, recurrent dynamics might be the key to understanding perceptual phenomena such as perceptual hysteresis. In this work we investigate if and how artificial neural networks can benefit from recurrent connections. We systematically compare architectures comprised of bottom-up, lateral, and top-down connections. To evaluate the impact of recurrent connections for occluded object recognition, we introduce three stereoscopic occluded object datasets, which span the range from classifying partially occluded hand-written digits to recognizing three-dimensional objects. We find that recurrent architectures perform significantly better than parameter-matched feedforward models. An analysis of the hidden representation of the models suggests that occluders are progressively discounted in later time steps of processing. We demonstrate that feedback can correct the initial misclassifications over time and that the recurrent dynamics lead to perceptual hysteresis. Overall, our results emphasize the importance of recurrent feedback for object recognition in difficult situations.
Collapse
Affiliation(s)
- Markus R Ernst
- Frankfurt Institute for Advanced Studies, Frankfurt am Main, Germany.,Goethe-Universität Frankfurt, Frankfurt am Main, Germany.,
| | - Thomas Burwick
- Frankfurt Institute for Advanced Studies, Frankfurt am Main, Germany.,Goethe-Universität Frankfurt, Frankfurt am Main, Germany.,
| | - Jochen Triesch
- Frankfurt Institute for Advanced Studies, Frankfurt am Main, Germany.,Goethe-Universität Frankfurt, Frankfurt am Main, Germany., https://www.fias.science/en/fellows/detail/triesch-jochen/
| |
Collapse
|