1
|
Lubinus C, Einhäuser W, Schiller F, Kircher T, Straube B, van Kemenade BM. Action-based predictions affect visual perception, neural processing, and pupil size, regardless of temporal predictability. Neuroimage 2022; 263:119601. [PMID: 36064139 DOI: 10.1016/j.neuroimage.2022.119601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Revised: 08/30/2022] [Accepted: 09/01/2022] [Indexed: 10/31/2022] Open
Abstract
Sensory consequences of one's own action are often perceived as less intense, and lead to reduced neural responses, compared to externally generated stimuli. Presumably, such sensory attenuation is due to predictive mechanisms based on the motor command (efference copy). However, sensory attenuation has also been observed outside the context of voluntary action, namely when stimuli are temporally predictable. Here, we aimed at disentangling the effects of motor and temporal predictability-based mechanisms on the attenuation of sensory action consequences. During fMRI data acquisition, participants (N = 25) judged which of two visual stimuli was brighter. In predictable blocks, the stimuli appeared temporally aligned with their button press (active) or aligned with an automatically generated cue (passive). In unpredictable blocks, stimuli were presented with a variable delay after button press/cue, respectively. Eye tracking was performed to investigate pupil-size changes and to ensure proper fixation. Self-generated stimuli were perceived as darker and led to less neural activation in visual areas than their passive counterparts, indicating sensory attenuation for self-generated stimuli independent of temporal predictability. Pupil size was larger during self-generated stimuli, which correlated negatively with the blood oxygenation level dependent (BOLD) response: the larger the pupil, the smaller the BOLD amplitude in visual areas. Our results suggest that sensory attenuation in visual cortex is driven by action-based predictive mechanisms rather than by temporal predictability. This effect may be related to changes in pupil diameter. Altogether, these results emphasize the role of the efference copy in the processing of sensory action consequences.
Collapse
Affiliation(s)
- Christina Lubinus
- Department of Neuroscience, Max-Planck-Institute for Empirical Aesthetics, Grüneburgweg 14, Frankfurt am Main D-60322, Germany; Department of Psychiatry and Psychotherapy and Center for Mind, Brain and Behavior (CMBB), University of Marburg, Rudolf-Bultmann-Str. 8, Marburg D-35039, Germany.
| | - Wolfgang Einhäuser
- Institute of Physics, Physics of Cognition Group, Chemnitz University of Technology, Chemnitz D-09107, Germany
| | - Florian Schiller
- Department of Psychology, Justus Liebig University Giessen, Otto-Behaghel-Str. 10, Giessen D-35394, Germany
| | - Tilo Kircher
- Department of Psychiatry and Psychotherapy and Center for Mind, Brain and Behavior (CMBB), University of Marburg, Rudolf-Bultmann-Str. 8, Marburg D-35039, Germany
| | - Benjamin Straube
- Department of Psychiatry and Psychotherapy and Center for Mind, Brain and Behavior (CMBB), University of Marburg, Rudolf-Bultmann-Str. 8, Marburg D-35039, Germany
| | - Bianca M van Kemenade
- Department of Psychiatry and Psychotherapy and Center for Mind, Brain and Behavior (CMBB), University of Marburg, Rudolf-Bultmann-Str. 8, Marburg D-35039, Germany; Center for Cognitive Neuroimaging, Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK
| |
Collapse
|
2
|
Sugimoto F, Kimura M, Takeda Y. Attenuation of auditory N2 for self-modulated tones during continuous actions. Biol Psychol 2021; 166:108201. [PMID: 34653547 DOI: 10.1016/j.biopsycho.2021.108201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2021] [Revised: 10/01/2021] [Accepted: 10/04/2021] [Indexed: 11/19/2022]
Abstract
Event-related potentials elicited by tones generated by one's own discrete actions (e.g., button presses) are attenuated compared to those elicited by tones generated externally. The present study investigated whether ERP attenuation would occur when the timing or pitch of tones is modulated by continuous actions, as for such actions, a weak association between actions and their auditory consequences is assumed. In a modulation condition, participants modulated the time interval between tones (Experiment 1) or the pitch of tones (Experiment 2) by turning a steering wheel. In a listening condition, participants listened to the same tones as in the modulation condition without any action. The results revealed that the amplitude of N2 elicited by tones decreased in the modulation compared to listening conditions, consistently in the two experiments, suggesting relatively higher-order auditory processing can be mainly influenced by the prediction of action consequences when continuous actions modulate features of auditory stimuli.
Collapse
Affiliation(s)
- Fumie Sugimoto
- Human-Centered Mobility Research Center, National Institute of Advanced Industrial Science and Technology (AIST), Japan.
| | - Motohiro Kimura
- Human-Centered Mobility Research Center, National Institute of Advanced Industrial Science and Technology (AIST), Japan
| | - Yuji Takeda
- Human-Centered Mobility Research Center, National Institute of Advanced Industrial Science and Technology (AIST), Japan
| |
Collapse
|
3
|
The auditory brain in action: Intention determines predictive processing in the auditory system-A review of current paradigms and findings. Psychon Bull Rev 2021; 29:321-342. [PMID: 34505988 PMCID: PMC9038838 DOI: 10.3758/s13423-021-01992-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/29/2021] [Indexed: 11/08/2022]
Abstract
According to the ideomotor theory, action may serve to produce desired sensory outcomes. Perception has been widely described in terms of sensory predictions arising due to top-down input from higher order cortical areas. Here, we demonstrate that the action intention results in reliable top-down predictions that modulate the auditory brain responses. We bring together several lines of research, including sensory attenuation, active oddball, and action-related omission studies: Together, the results suggest that the intention-based predictions modulate several steps in the sound processing hierarchy, from preattentive to evaluation-related processes, also when controlling for additional prediction sources (i.e., sound regularity). We propose an integrative theoretical framework—the extended auditory event representation system (AERS), a model compatible with the ideomotor theory, theory of event coding, and predictive coding. Initially introduced to describe regularity-based auditory predictions, we argue that the extended AERS explains the effects of action intention on auditory processing while additionally allowing studying the differences and commonalities between intention- and regularity-based predictions—we thus believe that this framework could guide future research on action and perception.
Collapse
|
4
|
Altmann CF, Yamasaki D, Song Y, Bucher B. Processing of self-initiated sound motion in the human brain. Brain Res 2021; 1762:147433. [PMID: 33737062 DOI: 10.1016/j.brainres.2021.147433] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2020] [Revised: 03/10/2021] [Accepted: 03/11/2021] [Indexed: 12/01/2022]
Abstract
Interacting with objects in our environment usually leads to audible noise. Brain responses to such self-initiated sounds have been shown to be attenuated, in particular the so-called N1 component measured with electroencephalography (EEG). This attenuation has been proposed to be the effect of an internal forward model that allows for cancellation of the sensory consequences of a motor command. In the current study we asked whether the attenuation due to self-initiation of a sound also affects a later event-related potential - the so-called motion-onset response - that arises in response to moving sounds. To this end, volunteers were instructed to move their index fingers either left or rightward which resulted in virtual movement of a sound either to the left or to the right. In Experiment 1, sound motion was induced with in-ear head-phones by shifting interaural time and intensity differences and thus shifting the intracranial sound image. We compared the motion-onset responses under two conditions: a) congruent, and b) incongruent. In the congruent condition, the sound image moved in the direction of the finger movement, while in the incongruent condition sound motion was in the opposite direction of the finger movement. Clear motion-onset responses with a negative cN1 component peaking at about 160 ms and a positive cP2 component peaking at about 230 ms after motion-onset were obtained for both the congruent and incongruent conditions. However, the motion-onset responses did not significantly differ between congruent and incongruent conditions in amplitude or latency. In Experiment 2, in which sounds were presented with loudspeakers, we observed attenuation for self-induced versus externally triggered sound motion-onset, but again, there was no difference between congruent and incongruent conditions. In sum, these two experiments suggest that the motion-onset response measured by EEG can be attenuated for self-generated sounds. However, our result did not indicate that this attenuation depended on congruency of action and sound motion direction.
Collapse
Affiliation(s)
- Christian F Altmann
- Human Brain Research Center, Graduate School of Medicine, Kyoto University, Kyoto 606-8507, Japan; Parkinson-Klinik Ortenau, 77709 Wolfach, Germany.
| | - Daiki Yamasaki
- Department of Psychology, Graduate School of Letters, Kyoto University, Kyoto 606-8501, Japan; Japan Society for the Promotion of Science, Tokyo 102-0083, Japan
| | - Yunqing Song
- Human Brain Research Center, Graduate School of Medicine, Kyoto University, Kyoto 606-8507, Japan
| | - Benoit Bucher
- Department of Psychology, Graduate School of Letters, Kyoto University, Kyoto 606-8501, Japan
| |
Collapse
|
5
|
Vercillo T, O'Neil S, Jiang F. Action-effect contingency modulates the readiness potential. Neuroimage 2018; 183:273-279. [PMID: 30114465 PMCID: PMC6450698 DOI: 10.1016/j.neuroimage.2018.08.028] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2018] [Revised: 08/08/2018] [Accepted: 08/13/2018] [Indexed: 11/24/2022] Open
Abstract
The ability to constantly anticipate events in the world is critical to human survival. It has been suggested that predictive processing originates from the motor system and that incoming sensory inputs can be altered to facilitate sensorimotor integration. In the current study, we investigated the role of the readiness potentials, i.e. the premotor brain activity registered within the fronto-parietal areas, in sensorimotor integration. We recorded EEG data during three conditions: a motor condition in which a simple action was required, a visual condition in which a visual stimulus was presented on the screen, and a visuomotor condition wherein the visual stimulus appeared in response to a button press. We measured evoked potentials before the motor action and/or after the appearance of the visual stimulus. Anticipating a visual feedback in response to a voluntary action modulated the amplitude of the readiness potentials. We also found an enhancement in the amplitude of the visual N1 and a reduction in the amplitude of the visual P2 when the visual stimulus was induced by the action rather than externally generated. Our results suggest that premotor brain activity might reflect predictive processes in sensory-motor binding and that the readiness potentials may possibly represent a neural marker of these predictive mechanisms.
Collapse
Affiliation(s)
- Tiziana Vercillo
- Ernest J. Del Monte Institute for Neuroscience, Department of Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, NY, 14642, USA.
| | - Sean O'Neil
- Department of Psychology, University of Nevada, Reno, USA
| | - Fang Jiang
- Department of Psychology, University of Nevada, Reno, USA
| |
Collapse
|
6
|
Elijah RB, Le Pelley ME, Whitford TJ. Act Now, Play Later: Temporal Expectations Regarding the Onset of Self-initiated Sensations Can Be Modified with Behavioral Training. J Cogn Neurosci 2018; 30:1145-1156. [DOI: 10.1162/jocn_a_01269] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Abstract
Mechanisms of motor-sensory prediction are dependent on expectations regarding when self-generated feedback will occur. Existing behavioral and electrophysiological research suggests that we have a default expectation for immediate sensory feedback after executing an action. However, studies investigating the adaptability of this temporal expectation have been limited in their ability to differentiate modified expectations per se from effects of stimulus repetition. Here, we use a novel, within-participant procedure that allowed us to disentangle the effect of repetition from expectation and allowed us to determine whether the default assumption for immediate feedback is fixed and resistant to modification or is amenable to change with experience. While EEG was recorded, 45 participants completed a task in which they repeatedly pressed a button to produce a tone that occurred immediately after the button press (immediate training) or after a 100-msec delay (delayed training). The results revealed significant differences in the patterns of cortical change across the two training conditions. Specifically, there was a significant reduction in the cortical response to tones across delayed training blocks but no significant change across immediate training blocks. Furthermore, experience with delayed training did not result in increased cortical activity in response to immediate feedback. These findings suggest that experience with action–sensation delays broadens the window of temporal expectations, allowing for the simultaneous anticipation of both delayed and immediate motor-sensory feedback. This research provides insights into the mechanisms underlying motor-sensory prediction and may represent a novel therapeutic avenue for psychotic symptoms, which are ostensibly associated with sensory prediction abnormalities.
Collapse
|
7
|
Mifsud NG, Beesley T, Watson TL, Elijah RB, Sharp TS, Whitford TJ. Attenuation of visual evoked responses to hand and saccade-initiated flashes. Cognition 2018; 179:14-22. [PMID: 29894867 DOI: 10.1016/j.cognition.2018.06.005] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2017] [Revised: 06/04/2018] [Accepted: 06/05/2018] [Indexed: 12/01/2022]
Abstract
Sensory attenuation refers to reduced brain responses to self-initiated sensations relative to those produced by the external world. It is a low-level process that may be linked to higher-level cognitive tasks such as reality monitoring. The phenomenon is often explained by prediction error mechanisms of universal applicability to sensory modality; however, it is most widely reported for auditory stimuli resulting from self-initiated hand movements. The present series of event-related potential (ERP) experiments explored the generalizability of sensory attenuation to the visual domain by exposing participants to flashes initiated by either their own button press or volitional saccade and comparing these conditions to identical, computer-initiated stimuli. The key results showed that the largest reduction of anterior visual N1 amplitude occurred for saccade-initiated flashes, while button press-initiated flashes evoked an intermediary response between the saccade-initiated and externally initiated conditions. This indicates that sensory attenuation occurs for visual stimuli and suggests that the degree of electrophysiological attenuation may relate to the causal likelihood of pairings between the type of motor action and the modality of its sensory response.
Collapse
Affiliation(s)
- Nathan G Mifsud
- School of Psychology, UNSW Sydney, Sydney, New South Wales, Australia.
| | - Tom Beesley
- School of Psychology, UNSW Sydney, Sydney, New South Wales, Australia
| | - Tamara L Watson
- School of Social Sciences and Psychology, Western Sydney University, Bankstown, New South Wales, Australia
| | - Ruth B Elijah
- School of Psychology, UNSW Sydney, Sydney, New South Wales, Australia
| | - Tegan S Sharp
- School of Psychology, UNSW Sydney, Sydney, New South Wales, Australia
| | - Thomas J Whitford
- School of Psychology, UNSW Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
8
|
Cao L, Veniero D, Thut G, Gross J. Role of the Cerebellum in Adaptation to Delayed Action Effects. Curr Biol 2017; 27:2442-2451.e3. [PMID: 28781049 PMCID: PMC5571438 DOI: 10.1016/j.cub.2017.06.074] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2017] [Revised: 06/08/2017] [Accepted: 06/29/2017] [Indexed: 01/02/2023]
Abstract
Actions are typically associated with sensory consequences. For example, knocking at a door results in predictable sounds. These self-initiated sensory stimuli are known to elicit smaller cortical responses compared to passively presented stimuli, e.g., early auditory evoked magnetic fields known as M100 and M200 components are attenuated. Current models implicate the cerebellum in the prediction of the sensory consequences of our actions. However, causal evidence is largely missing. In this study, we introduced a constant delay (of 100 ms) between actions and action-associated sounds, and we recorded magnetoencephalography (MEG) data as participants adapted to the delay. We found an increase in the attenuation of the M100 component over time for self-generated sounds, which indicates cortical adaptation to the introduced delay. In contrast, no change in M200 attenuation was found. Interestingly, disrupting cerebellar activity via transcranial magnetic stimulation (TMS) abolished the adaptation of M100 attenuation, while the M200 attenuation reverses to an M200 enhancement. Our results provide causal evidence for the involvement of the cerebellum in adapting to delayed action effects, and thus in the prediction of the sensory consequences of our actions.
Collapse
Affiliation(s)
- Liyu Cao
- School of Psychology, University of Glasgow, Glasgow G12 8QB, UK; Institute of Neuroscience and Psychology, University of Glasgow, Glasgow G12 8QB, UK; Department of Psychology (III), University of Würzburg, 97070 Würzburg, Germany.
| | - Domenica Veniero
- School of Psychology, University of Glasgow, Glasgow G12 8QB, UK; Institute of Neuroscience and Psychology, University of Glasgow, Glasgow G12 8QB, UK
| | - Gregor Thut
- School of Psychology, University of Glasgow, Glasgow G12 8QB, UK; Institute of Neuroscience and Psychology, University of Glasgow, Glasgow G12 8QB, UK
| | - Joachim Gross
- School of Psychology, University of Glasgow, Glasgow G12 8QB, UK; Institute of Neuroscience and Psychology, University of Glasgow, Glasgow G12 8QB, UK
| |
Collapse
|
9
|
Mifsud NG, Whitford TJ. Sensory attenuation of self-initiated sounds maps onto habitual associations between motor action and sound. Neuropsychologia 2017; 103:38-43. [DOI: 10.1016/j.neuropsychologia.2017.07.019] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2017] [Revised: 05/06/2017] [Accepted: 07/14/2017] [Indexed: 10/19/2022]
|
10
|
Zhao K, Tang Z, Wang H, Guo Y, Peng W, Hu L. Analgesia induced by self-initiated electrotactile sensation is mediated by top-down modulations. Psychophysiology 2017; 54:848-856. [PMID: 28169425 DOI: 10.1111/psyp.12839] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2016] [Accepted: 12/30/2016] [Indexed: 11/26/2022]
Abstract
It is well known that sensory perception can be attenuated when sensory stimuli are controlled by self-initiated actions. This phenomenon is explained by the consistency between forward models of anticipated action effects and actual sensory feedback. Specifically, the brain state related to the binding between motor processing and sensory perception would have inhibitory function by gating sensory information via top-down control. Since the brain state could casually influence the perception of subsequent stimuli of different sensory modalities, we hypothesize that pain evoked by nociceptive stimuli following the self-initiated tactile stimulation would be attenuated as compared to that following externally determined tactile stimulation. Here, we compared psychophysical and neurophysiological responses to identical nociceptive-specific laser stimuli in two different conditions: self-initiated tactile sensation condition (STS) and nonself-initiated tactile sensation condition (N-STS). We observed that pain intensity and unpleasantness, as well as laser-evoked brain responses, were significantly reduced in the STS condition compared to the N-STS condition. In addition, magnitudes of alpha and beta oscillations prior to laser onset were significantly larger in the STS condition than in the N-STS condition. These results confirmed that pain perception and pain-related brain responses were attenuated when the tactile stimulation was initiated by subjects' voluntary actions, and exploited neural oscillations reflecting the binding between motor processing and sensory feedback. Thus, our study elaborated the understanding of underlying neural mechanisms related to top-down modulations of the analgesic effect induced by self-initiated tactile sensation, which provided theoretical basis to improve the analgesic effect in various clinical applications.
Collapse
Affiliation(s)
- Ke Zhao
- CAS Key Laboratory of Mental Health, Institute of Psychology, Beijing, China
| | - Zhengyu Tang
- Faculty of Psychology, Southwest University, Chongqing, China
| | - Huiquan Wang
- Faculty of Psychology, Southwest University, Chongqing, China
| | - Yifei Guo
- CAS Key Laboratory of Mental Health, Institute of Psychology, Beijing, China
| | - Weiwei Peng
- Brain Function and Psychological Science Research Center, Shenzhen University, Shenzhen, China
| | - Li Hu
- CAS Key Laboratory of Mental Health, Institute of Psychology, Beijing, China.,Faculty of Psychology, Southwest University, Chongqing, China
| |
Collapse
|
11
|
Weller L, Schwarz KA, Kunde W, Pfister R. Was it me? – Filling the interval between action and effects increases agency but not sensory attenuation. Biol Psychol 2017; 123:241-249. [DOI: 10.1016/j.biopsycho.2016.12.015] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2016] [Revised: 11/03/2016] [Accepted: 12/16/2016] [Indexed: 11/16/2022]
|