1
|
Cantarella G, Mioni G, Bisiacchi PS. Young adults and multisensory time perception: Visual and auditory pathways in comparison. Atten Percept Psychophys 2024; 86:1386-1399. [PMID: 37674041 PMCID: PMC11093818 DOI: 10.3758/s13414-023-02773-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/01/2023] [Indexed: 09/08/2023]
Abstract
The brain continuously encodes information about time, but how sensorial channels interact to achieve a stable representation of such ubiquitous information still needs to be determined. According to recent research, children show a potential interference in multisensory conditions, leading to a trade-off between two senses (sight and audition) when considering time-perception tasks. This study aimed to examine how healthy young adults behave when performing a time-perception task. In Experiment 1, we tested the effects of temporary sensory deprivation on both visual and auditory senses in a group of young adults. In Experiment 2, we compared the temporal performances of young adults in the auditory modality with those of two samples of children (sighted and sighted but blindfolded) selected from a previous study. Statistically significant results emerged when comparing the two pathways: young adults overestimated and showed a higher sensitivity to time in the auditory modality compared to the visual modality. Restricting visual and auditory input did not affect their time sensitivity. Moreover, children were more accurate at estimating time than young adults after a transient visual deprivation. This implies that as we mature, sensory deprivation does not constitute a benefit to time perception, and supports the hypothesis of a calibration process between senses with age. However, more research is needed to determine how this calibration process affects the developmental trajectories of time perception.
Collapse
Affiliation(s)
- Giovanni Cantarella
- Department of Psychology, University of Bologna, Viale Berti Pichat, 5, 40127, Bologna, Italy
| | - Giovanna Mioni
- Department of General Psychology, University of Padova, Via Venezia, 8, 35131, Padova, Italy
| | - Patrizia Silvia Bisiacchi
- Department of General Psychology, University of Padova, Via Venezia, 8, 35131, Padova, Italy.
- Padova Neuroscience Center, Padova, Italy.
| |
Collapse
|
2
|
Bertonati G, Amadeo MB, Campus C, Gori M. Task-dependent spatial processing in the visual cortex. Hum Brain Mapp 2023; 44:5972-5981. [PMID: 37811869 PMCID: PMC10619374 DOI: 10.1002/hbm.26489] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Revised: 07/31/2023] [Accepted: 08/30/2023] [Indexed: 10/10/2023] Open
Abstract
To solve spatial tasks, the human brain asks for support from the visual cortices. Nonetheless, representing spatial information is not fixed but depends on the reference frames in which the spatial inputs are involved. The present study investigates how the kind of spatial representations influences the recruitment of visual areas during multisensory spatial tasks. Our study tested participants in an electroencephalography experiment involving two audio-visual (AV) spatial tasks: a spatial bisection, in which participants estimated the relative position in space of an AV stimulus in relation to the position of two other stimuli, and a spatial localization, in which participants localized one AV stimulus in relation to themselves. Results revealed that spatial tasks specifically modulated the occipital event-related potentials (ERPs) after the onset of the stimuli. We observed a greater contralateral early occipital component (50-90 ms) when participants solved the spatial bisection, and a more robust later occipital response (110-160 ms) when they processed the spatial localization. This observation suggests that different spatial representations elicited by multisensory stimuli are sustained by separate neurophysiological mechanisms.
Collapse
Affiliation(s)
- G. Bertonati
- Unit for Visually Impaired People (U‐VIP)Istituto Italiano di TecnologiaGenoaItaly
- Department of Informatics, Bioengineering, Robotics and Systems Engineering (DIBRIS)Università degli Studi di GenovaGenoaItaly
| | - M. B. Amadeo
- Unit for Visually Impaired People (U‐VIP)Istituto Italiano di TecnologiaGenoaItaly
| | - C. Campus
- Unit for Visually Impaired People (U‐VIP)Istituto Italiano di TecnologiaGenoaItaly
| | - M. Gori
- Unit for Visually Impaired People (U‐VIP)Istituto Italiano di TecnologiaGenoaItaly
| |
Collapse
|
3
|
Feng Z, Zhu S, Duan J, Lu Y, Li L. Cross-modality effect in implicit learning of temporal sequence. CURRENT PSYCHOLOGY 2023. [DOI: 10.1007/s12144-022-04228-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
|
4
|
Gori M, Amadeo MB, Pavani F, Valzolgher C, Campus C. Temporal visual representation elicits early auditory-like responses in hearing but not in deaf individuals. Sci Rep 2022; 12:19036. [PMID: 36351944 PMCID: PMC9646881 DOI: 10.1038/s41598-022-22224-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2022] [Accepted: 10/11/2022] [Indexed: 11/10/2022] Open
Abstract
It is evident that the brain is capable of large-scale reorganization following sensory deprivation, but the extent of such reorganization is to date, not clear. The auditory modality is the most accurate to represent temporal information, and deafness is an ideal clinical condition to study the reorganization of temporal representation when the audio signal is not available. Here we show that hearing, but not deaf individuals, show a strong ERP response to visual stimuli in temporal areas during a time-bisection task. This ERP response appears 50-90 ms after the flash and recalls some aspects of the N1 ERP component usually elicited by auditory stimuli. The same ERP is not evident for a visual space-bisection task, suggesting that the early recruitment of temporal cortex is specific for building a highly resolved temporal representation within the visual modality. These findings provide evidence that the lack of auditory input can interfere with typical development of complex visual temporal representations.
Collapse
Affiliation(s)
- Monica Gori
- grid.25786.3e0000 0004 1764 2907Unit for Visually Impaired People, Fondazione Istituto Italiano di Tecnologia, Via Enrico Melen 83, 16152 Genoa, Italy
| | - Maria Bianca Amadeo
- grid.25786.3e0000 0004 1764 2907Unit for Visually Impaired People, Fondazione Istituto Italiano di Tecnologia, Via Enrico Melen 83, 16152 Genoa, Italy
| | - Francesco Pavani
- grid.11696.390000 0004 1937 0351Center for Mind/Brain Sciences (CIMeC), University of Trento, Trento, Italy ,grid.11696.390000 0004 1937 0351Centro Interateneo di Ricerca Cognizione, Linguaggio e Sordità (CIRCLeS), University of Trento, Trento, Italy ,grid.461862.f0000 0004 0614 7222Integrative, Multisensory, Perception, Action and Cognition Team (IMPACT), Centre de Recherche en Neuroscience de Lyon (CRNL), Bron, France
| | - Chiara Valzolgher
- grid.11696.390000 0004 1937 0351Center for Mind/Brain Sciences (CIMeC), University of Trento, Trento, Italy ,grid.461862.f0000 0004 0614 7222Integrative, Multisensory, Perception, Action and Cognition Team (IMPACT), Centre de Recherche en Neuroscience de Lyon (CRNL), Bron, France
| | - Claudio Campus
- grid.25786.3e0000 0004 1764 2907Unit for Visually Impaired People, Fondazione Istituto Italiano di Tecnologia, Via Enrico Melen 83, 16152 Genoa, Italy
| |
Collapse
|
5
|
Gori M, Bertonati G, Campus C, Amadeo MB. Multisensory representations of space and time in sensory cortices. Hum Brain Mapp 2022; 44:656-667. [PMID: 36169038 PMCID: PMC9842891 DOI: 10.1002/hbm.26090] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Revised: 08/05/2022] [Accepted: 09/07/2022] [Indexed: 01/25/2023] Open
Abstract
Clear evidence demonstrated a supramodal organization of sensory cortices with multisensory processing occurring even at early stages of information encoding. Within this context, early recruitment of sensory areas is necessary for the development of fine domain-specific (i.e., spatial or temporal) skills regardless of the sensory modality involved, with auditory areas playing a crucial role in temporal processing and visual areas in spatial processing. Given the domain-specificity and the multisensory nature of sensory areas, in this study, we hypothesized that preferential domains of representation (i.e., space and time) of visual and auditory cortices are also evident in the early processing of multisensory information. Thus, we measured the event-related potential (ERP) responses of 16 participants while performing multisensory spatial and temporal bisection tasks. Audiovisual stimuli occurred at three different spatial positions and time lags and participants had to evaluate whether the second stimulus was spatially (spatial bisection task) or temporally (temporal bisection task) farther from the first or third audiovisual stimulus. As predicted, the second audiovisual stimulus of both spatial and temporal bisection tasks elicited an early ERP response (time window 50-90 ms) in visual and auditory regions. However, this early ERP component was more substantial in the occipital areas during the spatial bisection task, and in the temporal regions during the temporal bisection task. Overall, these results confirmed the domain specificity of visual and auditory cortices and revealed that this aspect selectively modulates also the cortical activity in response to multisensory stimuli.
Collapse
Affiliation(s)
- Monica Gori
- Unit for Visually Impaired People (U‐VIP)Istituto Italiano di TecnologiaGenoaItaly
| | - Giorgia Bertonati
- Unit for Visually Impaired People (U‐VIP)Istituto Italiano di TecnologiaGenoaItaly,Department of Informatics, Bioengineering, Robotics and Systems Engineering (DIBRIS)Università degli Studi di GenovaGenoaItaly
| | - Claudio Campus
- Unit for Visually Impaired People (U‐VIP)Istituto Italiano di TecnologiaGenoaItaly
| | - Maria Bianca Amadeo
- Unit for Visually Impaired People (U‐VIP)Istituto Italiano di TecnologiaGenoaItaly
| |
Collapse
|
6
|
Time perception in film is modulated by sensory modality and arousal. Atten Percept Psychophys 2022; 84:926-942. [PMID: 35304701 DOI: 10.3758/s13414-022-02464-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/20/2022] [Indexed: 11/08/2022]
Abstract
Considerable research has shown that the perception of time can be distorted subjectively, but little empirical work has examined what factors affect time perception in film, a naturalistic multimodal stimulus. Here, we explore the effect of sensory modality, arousal, and valence on how participants estimate durations in film. Using behavioral ratings combined with pupillometry in a within-participants design, we analyzed responses to and duration estimates of film clips in three experimental conditions: audiovisual (containing music and sound effects), visual (without music and sound effects), and auditory (music and sound effects without a visual scene). Participants viewed clips from little-known nature documentaries, fiction, animation, and experimental films. They were asked to judge clip duration and to report subjective arousal and valence, as their pupil sizes were recorded. Data were analyzed using linear mixed-effects models. Results reveal duration estimates varied between experimental conditions. Clip durations were judged to be shorter than actual durations in all three conditions, with visual-only clips perceived as longer (i.e., less distorted in time) than auditory-only and audiovisual clips. High levels of Composite Arousal (an average of self-reported arousal and pupil size changes) were correlated with longer (more accurate) estimates of duration, particularly in the audiovisual modality. This effect may reflect stimulus complexity or greater cognitive engagement. Increased ratings of valence were correlated with longer estimates of duration. The use of naturalistic, complex stimuli such as film can enhance our understanding of the psychology of time perception.
Collapse
|
7
|
Reconfiguration of Cortical Brain Network from Searching to Spotting for Dynamic Visual Targets. J Neurosci Methods 2022; 375:109577. [PMID: 35339507 DOI: 10.1016/j.jneumeth.2022.109577] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2021] [Revised: 12/28/2021] [Accepted: 03/20/2022] [Indexed: 11/22/2022]
Abstract
BACKGROUND Detecting dynamic targets from complex visual scenes is an important problem in real world. However, the cognitive mechanism accounting for dynamic visual target detection remains unclear. NEW METHOD Herein, we aim to explore the cognitive process of dynamic visual target detection from searching to spotting and provide more concrete evidence for cognitive studies related to target detection. Cortical source responses with high spatiotemporal resolution were reconstructed from scalp EEG signals. Then, time-varying cortical networks were built using adaptive directed transfer function to explore the cognitive processes while detecting the dynamic visual target. RESULTS The experimental results demonstrated that the dynamic visual target detection enhanced the activation in both the visual and attention networks. Specially, the information flow from the middle occipital gyrus (MOG) mainly contributed to the position function, whereas the activation of the prefrontal cortex (PFC) reflected spatial attention maintenance. CONCLUSION The left "frontal-central-parietal" network played as a leading information source in dynamic target detection tasks. These findings provide new insights into cognitive processes of dynamic visual target detection. DATA AVAILABILITY STATEMENT The datasets in this study are available on request to the corresponding author.
Collapse
|
8
|
Late development of audio-visual integration in the vertical plane. CURRENT RESEARCH IN BEHAVIORAL SCIENCES 2021. [DOI: 10.1016/j.crbeha.2021.100043] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
|
9
|
Amadeo MB, Campus C, Gori M. Years of Blindness Lead to "Visualize" Space Through Time. Front Neurosci 2020; 14:812. [PMID: 32848573 PMCID: PMC7418563 DOI: 10.3389/fnins.2020.00812] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2020] [Accepted: 07/10/2020] [Indexed: 11/29/2022] Open
Abstract
Spatial representation has been widely studied in early blindness, whereas research about late blindness is still limited. We recently demonstrated that the early (50-90 ms) event-related potential (ERP) response observed in sighted people during a spatial bisection task, is altered in early blind people and is influenced by the amount of time spent without vision in late blind individuals. Specifically, in late blind people a shorter period of blindness is associated with strong contralateral activation in occipital cortex and good performance during the spatial task-similar to that of sighted people. In contrast, non-lateralized occipital activation and lower performance characterize late blind individuals who have experienced a longer period of blindness-similar to that of early blind people. However, the same early occipital response activated in sighted individuals by spatial cues has been found to be activated by temporal cues in early blind individuals. Here, we investigate whether a similar temporal attraction can explain the neural and behavioral changes observed after many years of blindness in late blind people. An EEG recording was taken during a spatial bisection task where coherent and conflicting spatio-temporal information was presented. In participants with long blindness duration, the early recruitment of both visual and auditory areas is sensitive to temporal instead of spatial coordinates. These findings highlight some limits of neuroplasticity. Perceptual advantages from cross-sensory calibration during development seem to be subsequently lost following years of visual deprivation. This result has important implications for clinical outcomes following late blindness, highlighting the importance of timing in intervention and rehabilitation programs that activate compensatory strategies soon after sensory loss.
Collapse
Affiliation(s)
- Maria Bianca Amadeo
- Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Genova, Italy
- Department of Informatics, Bioengineering, Robotics and Systems Engineering, Università degli Studi di Genova, Genova, Italy
| | - Claudio Campus
- Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Genova, Italy
| | - Monica Gori
- Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Genova, Italy
| |
Collapse
|