1
|
Newell FN, McKenna E, Seveso MA, Devine I, Alahmad F, Hirst RJ, O'Dowd A. Multisensory perception constrains the formation of object categories: a review of evidence from sensory-driven and predictive processes on categorical decisions. Philos Trans R Soc Lond B Biol Sci 2023; 378:20220342. [PMID: 37545304 PMCID: PMC10404931 DOI: 10.1098/rstb.2022.0342] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Accepted: 06/29/2023] [Indexed: 08/08/2023] Open
Abstract
Although object categorization is a fundamental cognitive ability, it is also a complex process going beyond the perception and organization of sensory stimulation. Here we review existing evidence about how the human brain acquires and organizes multisensory inputs into object representations that may lead to conceptual knowledge in memory. We first focus on evidence for two processes on object perception, multisensory integration of redundant information (e.g. seeing and feeling a shape) and crossmodal, statistical learning of complementary information (e.g. the 'moo' sound of a cow and its visual shape). For both processes, the importance attributed to each sensory input in constructing a multisensory representation of an object depends on the working range of the specific sensory modality, the relative reliability or distinctiveness of the encoded information and top-down predictions. Moreover, apart from sensory-driven influences on perception, the acquisition of featural information across modalities can affect semantic memory and, in turn, influence category decisions. In sum, we argue that both multisensory processes independently constrain the formation of object categories across the lifespan, possibly through early and late integration mechanisms, respectively, to allow us to efficiently achieve the everyday, but remarkable, ability of recognizing objects. This article is part of the theme issue 'Decision and control processes in multisensory perception'.
Collapse
Affiliation(s)
- F. N. Newell
- School of Psychology and Institute of Neuroscience, Trinity College Dublin, College Green, Dublin D02 PN40, Ireland
| | - E. McKenna
- School of Psychology and Institute of Neuroscience, Trinity College Dublin, College Green, Dublin D02 PN40, Ireland
| | - M. A. Seveso
- School of Psychology and Institute of Neuroscience, Trinity College Dublin, College Green, Dublin D02 PN40, Ireland
| | - I. Devine
- School of Psychology and Institute of Neuroscience, Trinity College Dublin, College Green, Dublin D02 PN40, Ireland
| | - F. Alahmad
- School of Psychology and Institute of Neuroscience, Trinity College Dublin, College Green, Dublin D02 PN40, Ireland
| | - R. J. Hirst
- School of Psychology and Institute of Neuroscience, Trinity College Dublin, College Green, Dublin D02 PN40, Ireland
| | - A. O'Dowd
- School of Psychology and Institute of Neuroscience, Trinity College Dublin, College Green, Dublin D02 PN40, Ireland
| |
Collapse
|
2
|
Thoma P, Soria Bauser D, Edel MA, Juckel G, Suchan B. Configural processing of emotional bodies and faces in patients with attention deficit hyperactivity disorder. J Clin Exp Neuropsychol 2020; 42:1028-1048. [PMID: 33161842 DOI: 10.1080/13803395.2020.1840521] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
Introduction: Attention Deficit Disorder (ADHD) is associated with interpersonal problems and difficulties in inferring other peoples' emotions. Previous research has focused on face processing, mostly in children. Our study investigated configural processing of emotional bodies and faces in adults with ADHD in comparison with healthy controls, analyzing P100, N170 and P250 event-related potentials (ERPs) and relating them to (socio)cognitive functioning. Method: Nineteen patients with ADHD and 25 healthy controls were presented upright and inverted bodies and faces which had to be categorized as neutral, happy or angry while ERPs were recorded. Additionally, sociocognitive and executive functioning was assessed. Results: In ADHD patients relative to controls, recognition of emotions depicted by bodies but not by faces was impaired and P100 amplitudes were enhanced for angry bodies. Furthermore, patients showed enhanced P250 amplitudes in response to both bodies and faces, specifically for happy and neutral emotions. Larger N170 amplitudes to bodies and faces correlated with lower alexithymia scores only in controls, while enhanced P250 amplitudes to both categories were associated with poorer inhibition only in patients. Conclusion: Adults with ADHD show potentially compensatory enhanced semantic processing of emotional bodies and faces, as reflected by increased P250 amplitudes, associated with poorer executive functioning and subtle alterations of emotional and configural processing, as reflected by ERPs.
Collapse
Affiliation(s)
- Patrizia Thoma
- Neuropsychological Therapy Centre, Faculty of Psychology, Ruhr University Bochum , Bochum, Germany
| | - Denise Soria Bauser
- Neuropsychological Therapy Centre, Faculty of Psychology, Ruhr University Bochum , Bochum, Germany
| | | | - Georg Juckel
- LWL University Hospital, Ruhr University Bochum , Bochum, Germany
| | - Boris Suchan
- Neuropsychological Therapy Centre, Faculty of Psychology, Ruhr University Bochum , Bochum, Germany
| |
Collapse
|
3
|
Schenk S, Bellebaum C, Lech RK, Heinen R, Suchan B. Play to Win: Action Video Game Experience and Attention Driven Perceptual Exploration in Categorization Learning. Front Psychol 2020; 11:933. [PMID: 32477224 PMCID: PMC7239510 DOI: 10.3389/fpsyg.2020.00933] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2019] [Accepted: 04/15/2020] [Indexed: 01/01/2023] Open
Abstract
Categorization learning is a fundamental and complex cognitive ability. The present EEG study examined how much action video gamers differ from non-gamers in the usage of visual exploration and attention driven perceptual analyses during a categorization learning task. Seventeen healthy right-handed non-gamers and 16 healthy right-handed action video gamers performed a visual categorization task with 14 ring stimuli, which were divided into two categories. All stimuli had the same structure but differed with respect to their color combinations and were forming two categories including a prototype, five typical stimuli and one exception. The exception shared most similarities with the prototype of the opposite group. Prototypes and typical stimuli were correctly categorized at an early stage of the experiment, whereas the successful categorization of exceptions occurred later. The behavioral data yield evidence that action video gamers perform correct categorizations of exceptions earlier than non-gamers. Additionally, groups differed with respect to differential expressions of the attention related P150 ERP component (early perceptual analysis) and the N170 ERP component, which reflected differential processing demands for the stimulus material. In comparison to non-gamers, the analyses of the eye movements yield for action video gamers different, more central fixations possibly indicating covert peripheral processing. For both groups fixations as well as saccades decrease and in the case of exceptions, one of the two segments that are decisive for correct categorization shows higher fixation rates at the end of the experiment. These findings indicate for both groups a learning process regarding the stimulus material. Regarding the group differences, we interpret the results to indicate that action video gamers show a different stimulus exploration, use an enhanced early perceptual analysis of the stimulus material and therefore may detect changes in objects faster and learned the belonging of the stimuli to their categories in an earlier trial phase.
Collapse
Affiliation(s)
- Sabrina Schenk
- Institute of Cognitive Neuroscience, Clinical Neuropsychology, Neuropsychological Therapy Centre, Ruhr University Bochum, Bochum, Germany
- Department of Children’s Pain Therapy and Paediatric Palliative Care, Faculty of Health, School of Medicine, Witten/Herdecke University, Witten, Germany
- German Paediatric Pain Centre, Children’s and Adolescents’ Hospital, Datteln, Germany
| | | | - Robert K. Lech
- Institute of Cognitive Neuroscience, Clinical Neuropsychology, Neuropsychological Therapy Centre, Ruhr University Bochum, Bochum, Germany
| | - Rebekka Heinen
- Institute of Cognitive Neuroscience, Neuropsychology, Ruhr University Bochum, Bochum, Germany
| | - Boris Suchan
- Institute of Cognitive Neuroscience, Clinical Neuropsychology, Neuropsychological Therapy Centre, Ruhr University Bochum, Bochum, Germany
| |
Collapse
|
4
|
Paul M, Fellner MC, Waldhauser GT, Minda JP, Axmacher N, Suchan B, Wolf OT. Stress Elevates Frontal Midline Theta in Feedback-based Category Learning of Exceptions. J Cogn Neurosci 2018; 30:799-813. [DOI: 10.1162/jocn_a_01241] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
Adapting behavior based on category knowledge is a fundamental cognitive function, which can be achieved via different learning strategies relying on different systems in the brain. Whereas the learning of typical category members has been linked to implicit, prototype abstraction learning, which relies predominantly on prefrontal areas, the learning of exceptions is associated with explicit, exemplar-based learning, which has been linked to the hippocampus. Stress is known to foster implicit learning strategies at the expense of explicit learning. Procedural, prefrontal learning and cognitive control processes are reflected in frontal midline theta (4–8 Hz) oscillations during feedback processing. In the current study, we examined the effect of acute stress on feedback-based category learning of typical category members and exceptions and the oscillatory correlates of feedback processing in the EEG. A computational modeling procedure was applied to estimate the use of abstraction and exemplar strategies during category learning. We tested healthy, male participants who underwent either the socially evaluated cold pressor test or a nonstressful control procedure before they learned to categorize typical members and exceptions based on feedback. The groups did not differ significantly in their categorization accuracy or use of categorization strategies. In the EEG, however, stressed participants revealed elevated theta power specifically during the learning of exceptions, whereas the theta power during the learning of typical members did not differ between the groups. Elevated frontal theta power may reflect an increased involvement of medial prefrontal areas in the learning of exceptions under stress.
Collapse
|
5
|
Dopkins S, Galyer D. Analytic processing of distance. Acta Psychol (Amst) 2018; 182:129-137. [PMID: 29179018 DOI: 10.1016/j.actpsy.2017.11.016] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2017] [Revised: 11/07/2017] [Accepted: 11/17/2017] [Indexed: 11/25/2022] Open
Abstract
How does a human observer extract from the distance between two frontal points the component corresponding to an axis of a rectangular reference frame? To find out we had participants classify pairs of small circles, varying on the horizontal and vertical axes of a computer screen, in terms of the horizontal distance between them. A response signal controlled response time. The error rate depended on the irrelevant vertical as well as the relevant horizontal distance between the test circles with the relevant distance effect being larger than the irrelevant distance effect. The results implied that the horizontal distance between the test circles was imperfectly extracted from the overall distance between them. The results supported an account, derived from the Exemplar Based Random Walk model (Nosofsky & Palmieri, 1997), under which distance classification is based on the overall distance between the test circles, with relevant distance being extracted from overall distance to the extent that the relevant and irrelevant axes are differentially weighted so as to reduce the contribution of irrelevant distance to overall distance. The results did not support an account, derived from the General Recognition Theory (Ashby & Maddox, 1994), under which distance classification is based on the relevant distance between the test circles, with the irrelevant distance effect arising because a test circle's perceived location on the relevant axis depends on its location on the irrelevant axis, and with relevant distance being extracted from overall distance to the extent that this dependency is absent.
Collapse
|