Rearranging the world: neural network supporting the processing of temporal connectives

The impact of music training on temporal order processing in Mandarin Chinese sentence reading: Evidence from event-related potentials (ERPs)

The objective of this study was to investigate the impact of music training on the processing of temporal order in Mandarin sentence reading using event-related potentials (ERPs). Two-clause sentences with temporal connectives ("before" or "after") were presented to both musicians and non-musicians. Additionally, a verbal N-back task was utilized to evaluate the participants' working memory capacities. The findings revealed that musicians, but not nonmusicians, demonstrated a more negative amplitude in the second clauses of "before" sentences compared with "after" sentences. In the N-back task, musicians exhibited faster reaction times than nonmusicians in the two-back condition. Furthermore, a correlation was observed between the ERP amplitude differences (before vs. after) and reaction time differences in the N-back task (0-back vs. 2-back) among musicians. These findings suggested that music training enhances the depth of temporal order processing, potentially mediated by improvements in working memory capacity.

Music training influences online temporal order processing during reading comprehension

Numerous studies have demonstrated the influence of musical expertise on spoken language processing; however, its effects on reading comprehension remain largely unexplored. This study aims to investigate the role of musical expertise in sentence comprehension, particularly concerning the processing of temporal order. Using two self-paced reading experiments, we examined individuals' responses to two-clause sentences connected by the temporal connectives "before" or "after". "After" sentences consistently presented events in their actual order of temporal occurrence, while "before" sentences described events in reverse temporal order. In both experiments, our analyses of reading times consistently uncovered a significant temporal order effect, with words immediately following the temporal connectives being processed slower in "before" sentences compared to "after" sentences. This suggests the presence of immediate online processing costs associated with "before" sentences. Notably, these processing costs were found to be attenuated in individuals with musical expertise compared to those without. However, analyses of comprehension accuracy showed no advantage of musicians over non-musicians. Specifically, in Experiment 1, the two groups showed no difference in comprehension accuracy, while in Experiment 2, musicians exhibited lower accuracy rates compared to non-musicians in both "before" and "after" sentences. These results suggest that musical expertise may attenuate online processing costs associated with complex linguistic constructs, but could not promote reading accuracy. We concluded that music training is associated with a restricted effect on written sentence comprehension.

Temporal Shift Length and Antecedent Occurrence Likelihood Modulate Counterfactual Conditional Comprehension: Evidence from Event-Related Potentials

Counterfactual conditionals posit hypothetical scenarios in which antecedent events contradict reality. This study examined whether and how the processing difficulty of Chinese counterfactual conditionals (yaobushi, equivalent to if it had not been for in English) can be affected by the length of temporal shifts of the events across clauses and the likelihood of the antecedent occurrence. Participants read Chinese counterfactuals that contained either long (e.g., qunian-xianzai [last year-right now]) or short temporal shifts (e.g., zuotian-xianzai [yesterday-right now]) within highly likely (e.g., sign up for school activity) or less likely contexts (e.g., sign up for Arctic scientific research). ERP results revealed a significant N400 interaction between the temporal shift length and antecedent likelihood on the temporal indicators in the consequent and the sentence-ending verbs. Specifically, the less likely events elicited larger negativity than highly likely events with short temporal shifts on the temporal indicator. On the sentence-ending word, the long temporal shift elicited enlarged negativity than the short temporal shift when the antecedent was highly likely. These findings have two key implications regarding the interplay of implied causality and falsity constraints during counterfactual comprehension. First, salient falsity constraints can override effects of causal coherence on processing. Second, greater negativity for unlikely antecedents suggests that counterfactual markers concurrently activate factual and hypothetical representations.

The neural correlates of individual differences in numerosity perception: A voxel-based morphometry study

Numerosity perception is a fundamental cognitive function in humans and animals. Using an individual difference approach with a comprehensive dataset (N = 249), we performed a voxel-based morphometry analysis to unravel the neuroanatomical substrates associated with individual differences in numerosity perception sensitivity, measured by a classical non-symbolic numerical judgment task. Results showed that greater gray matter volume (GMV) in the left cerebellum, right temporal pole, and right parahippocampal was positively correlated to higher perceptual sensitivity to numerosity. In contrast, the GMV in the left intraparietal sulcus, and bilateral precentral/postcentral gyrus was negatively correlated to the sensitivity of numerosity perception. These findings indicate that a wide range of brain structures, rather than a specific anatomical structure or circuit, forms the neuroanatomical basis of numerosity perception, lending support to the emerging network view of the neural representation of numerosity. This work contributes to a more comprehensive understanding of how the brain processes numerical information.

•Unveils neuroanatomical basis of numerosity perception •Discovers positive and negative greater GMV correlations •Links GMV in a wide range of brain regions to numerical sensitivity •Supports the network view of the neural representation of numerosity perception

Understanding an implicated causality: The brain network for processing concessive relations

Concessive relations, often indicated by conjunction words such as although, are semantically and pragmatically more complex than causal relations (expressed using because), as they involve more semantic features such as implicated meaning and negation. However, it remains unclear how linguistic-level complexity is manifested through different brain activities and functional connectivities. This fMRI study investigated how the neural underpinnings of concessive relations differ from those of causal relations. Pragmatically congruent and incongruent words were embedded in causal as well as concessive sentences. The whole-brain analysis revealed that relative to because-congruent sentences, although-congruent sentences evoked increased activations in a left network including IFG, bilateral MFG, mPFC, pMTG, and TPJ. DCM analysis showed that while the functional connectivity from IFG to MFG was commonly involved in processing concessive and causal relations, functional connectivities from pMTG to IFG and from pMTG to TPJ were involved in processing causal and concessive relations, respectively.

Understanding Temporal Relations in Mandarin Chinese: An ERP Investigation

Temporal connectives play a crucial role in marking the sequence of events during language comprehension. Although existing studies have shown that sentence comprehension can be modulated by temporal connectives, they have mainly focused on languages with grammatical tense such as English. It thus remains unclear how temporal information is processed in tenseless languages. The present study used event-related potentials (ERPs) to examine how world knowledge is retrieved and integrated in sentences linked by zhiqian (before) and zhihou (after) in Mandarin Chinese (e.g., After/Before going to the countryside, Grandpa went to the city because the air there was fresh and pure). The critical words (e.g., fresh) were either congruent or incongruent with world knowledge. Relative to the after-congruent sentences, the after-incongruent sentences evoked a P600 on critical words and a negativity on sentence-final words, whereas relative to before-congruent sentences, before-incongruent sentences showed no significant difference on critical words but a sustained negativity on sentence-final words. Additionally, before-congruent sentences elicited a larger sustained positivity (P600) than after-congruent sentences. The results suggest that before is more difficult to process than after in Mandarin Chinese, supporting the iconicity account of temporal relations.

Corticostriatal Regulation of Language Functions

The role of corticostriatal circuits in language functions is unclear. In this review, we consider evidence from language learning, syntax, and controlled language production and comprehension tasks that implicate various corticostriatal circuits. Converging evidence from neuroimaging in healthy individuals, studies in populations with subcortical dysfunction, pharmacological studies, and brain stimulation suggests a domain-general regulatory role of corticostriatal systems in language operations. The role of corticostriatal systems in language operations identified in this review is likely to reflect a broader function of the striatum in responding to uncertainty and conflict which demands selection, sequencing, and cognitive control. We argue that this role is dynamic and varies depending on the degree and form of cognitive control required, which in turn will recruit particular corticostriatal circuits and components organised in a cognitive hierarchy.

Subthalamic Nucleus Stimulation Impairs Sequence Processing in Patients with Parkinson's Disease

BACKGROUND

Maintaining and manipulating sequences online is essential for language and memory. In Parkinson's disease (PD), poor performance in sequencing tasks has been associated with basal ganglia dysfunction, especially subthalamic hyperactivity.

OBJECTIVE

This study is aimed to investigate the impact of high-frequency subthalamic nucleus (STN) deep brain stimulation (DBS) on sequence processing in PD.

METHODS

Twenty-nine patients with PD (17 women) completed a 'before/after' sentence task and a digit ordering task with STN DBS ON and OFF. In the sentence task, patients read a sequence of events expressed in the actual order of occurrence ('after' sentences) or reversed order ('before' sentences) for comprehension. In the digit task, patients recalled a sequence of ordered digits (ordered trials) or reordered and recalled random digits in ascending order (random trials). Volumes of tissue activated (VTAs) were estimated for the motor and associative STN.

RESULTS

Patients were slower with STN DBS ON versus OFF in both tasks, although their motor symptoms were significantly improved under DBS. In the sentence task, patients showed higher ordering-related reaction time costs ('before' > 'after') with DBS ON versus OFF. Moreover, patients with larger left associative VTAs, smaller total motor VTAs, and more daily exposure to dopaminergic drugs tended to show larger reaction time cost increases under DBS. In the digit ordering task, patients with too large or too small right associative VTAs tended to show larger reaction time cost increases under DBS.

CONCLUSION

Stimulating the STN, especially its associative part, might impair sequence processing in language and memory.

Reasoning about Durations

A set of assertions is consistent provided they can all be true at the same time. Naive individuals could prove consistency using the formal rules of a logical calculus, but it calls for them to fail to prove the negation of one assertion from the remainder in the set. An alternative procedure is for them to use an intuitive system (System 1) to construct a mental model of all the assertions. The task should be easy in this case. However, some sets of consistent assertions have no intuitive models and call for a deliberative system (System 2) to construct an alternative model. Formal rules and mental models therefore make different predictions. We report three experiments that tested their respective merits. The participants assessed the consistency of temporal descriptions based on statements using "during" and "before." They were more accurate for consistent problems with intuitive models than for those that called for deliberative models. There was no robust difference in accuracy between consistent and inconsistent problems. The results therefore corroborated the model theory.

Individual differences in children's comprehension of temporal relations: Dissociable contributions of working memory capacity and working memory updating

In two experiments, we examined 9- to 12-year-old children's comprehension and processing of two-clause sentences with a temporal connective (before or after) in the sentence-medial or sentence-initial position. We obtained measures of individual differences in working memory (WM) capacity and WM updating to test their contributions to comprehension. We measured the accuracy of children's responses to the questions "What happened first?" (Experiment 1; N = 74) and "What happened last?" (Experiment 2; N = 50) as well as their sentence reading times. Together, these experiments show continued development of comprehension of temporal relations in children in upper elementary school and suggest that children's comprehension difficulties (i.e., more comprehension errors and longer reading times) were influenced by clause salience and recency effects rather than sentence chronology or the familiarity of the connective. Our findings are consistent with a memory resource-limited account and suggest that individual differences in WM updating and WM capacity make dissociable contributions to processing and comprehension of sentences with temporal order information.

Temporarily Out of Order: Temporal Perspective Taking in Language in Children With Autism Spectrum Disorder

Clinical reports suggest that children with autism spectrum disorder (ASD) struggle with time perception, but few studies have investigated this. This is the first study to examine these children's understanding of before and after. These temporal conjunctions have been argued to require additional cognitive effort when conjoining two events in a clause order that is incongruent with their order in time. Given the suggested time perception impairment and well-established cognitive deficits of children with ASD, we expected them to have difficulties interpreting temporal conjunctions, especially in an incongruent order. To investigate this, the interpretation of before and after in congruent and incongruent orders was examined in 48 children with ASD and 43 typically developing (TD) children (age 6-12). Additional tasks were administered to measure Theory of Mind (ToM), working memory (WM), cognitive inhibition, cognitive flexibility, IQ, and verbal ability. We found that children with ASD were less accurate in their interpretation of temporal conjunctions than their TD peers. Contrary to our expectations, they did not have particular difficulties in an incongruent order. Furthermore, older children showed better overall performance than younger children. The difference between children with ASD and TD children was explained by WM, ToM, IQ, and verbal ability, but not by cognitive inhibition and flexibility. These cognitive functions are more likely to be impaired in children with ASD than in TD children, which could account for their poorer performance. Thus, the cognitive factors found to affect the interpretation of temporal language in children with ASD are likely to apply in typical development as well. Sufficient WM capacity and verbal ability may help children to process complex sentences conjoined by a temporal conjunction. Additionally, ToM understanding was found to be related to children's interpretation of temporal conjunctions in an incongruent order, indicating that perspective taking is required when events are presented out of order. We conclude from this that perspective-taking abilities are needed for the interpretation of temporal conjunctions, either to shift one's own perspective as a hearer to another point in time, or to shift to the perspective of the speaker to consider the speaker's linguistic choices.

"Before" and "after": Investigating the relationship between temporal connectives and chronological ordering using event-related potentials

Sentence-initial temporal clauses headed by before, as in "Before the scientist submitted the paper, the journal changed its policy", have been shown to elicit sustained negative-going brain potentials compared to maximally similar clauses headed by after, as in "After the scientist submitted the paper, the journal changed its policy". Such effects may be due to either one of two potential causes: before clauses may be more difficult than after clauses because they cause the two events in the sentence to be mentioned in an order opposite the order in which they actually occurred, or they may be more difficult because they are ambiguous with regard to whether the event described in the clause actually happened. The present study examined the effect of before and after clauses on sentence processing in both sentence-initial contexts, like those above, and in sentence-final contexts ("The journal changed its policy before/after the scientist submitted the paper"), where an order-of-mention account of the sustained negativity predicts a negativity for after relative to before. There was indeed such a reversal, with before eliciting more negative brain potentials than after in sentence-initial clauses but more positive in sentence-final clauses. The results suggest that the sustained negativity indexes processing costs related to comprehending events that were mentioned out of order.

Children's processing and comprehension of complex sentences containing temporal connectives: The influence of memory on the time course of accurate responses

In a touch-screen paradigm, we recorded 3- to 7-year-olds' (N = 108) accuracy and response times (RTs) to assess their comprehension of 2-clause sentences containing before and after. Children were influenced by order: performance was most accurate when the presentation order of the 2 clauses matched the chronological order of events: "She drank the juice, before she walked in the park" (chronological order) versus "Before she walked in the park, she drank the juice" (reverse order). Differences in RTs for correct responses varied by sentence type: accurate responses were made more speedily for sentences that afforded an incremental processing of meaning. An independent measure of memory predicted this pattern of performance. We discuss these findings in relation to children's knowledge of connective meaning and the processing requirements of sentences containing temporal connectives. (PsycINFO Database Record

The Truth Before and After: Brain Potentials Reveal Automatic Activation of Event Knowledge during Sentence Comprehension

How does knowledge of real-world events shape our understanding of incoming language? Do temporal terms like “before” and “after” impact the online recruitment of real-world event knowledge? These questions were addressed in two ERP experiments, wherein participants read sentences that started with “before” or “after” and contained a critical word that rendered each sentence true or false (e.g., “Before/After the global economic crisis, securing a mortgage was easy/harder”). The critical words were matched on predictability, rated truth value, and semantic relatedness to the words in the sentence. Regardless of whether participants explicitly verified the sentences or not, false-after-sentences elicited larger N400s than true-after-sentences, consistent with the well-established finding that semantic retrieval of concepts is facilitated when they are consistent with real-world knowledge. However, although the truth judgments did not differ between before- and after-sentences, no such sentence N400 truth value effect occurred in before-sentences, whereas false-before-sentences elicited an enhanced subsequent positive ERPs. The temporal term “before” itself elicited more negative ERPs at central electrode channels than “after.” These patterns of results show that, irrespective of ultimate sentence truth value judgments, semantic retrieval of concepts is momentarily facilitated when they are consistent with the known event outcome compared to when they are not. However, this inappropriate facilitation incurs later processing costs as reflected in the subsequent positive ERP deflections. The results suggest that automatic activation of event knowledge can impede the incremental semantic processes required to establish sentence truth value.

Young Children's Comprehension of Temporal Relations in Complex Sentences: The Influence of Memory on Performance

The present study investigated 3‐ to 7‐year‐olds' (N = 91) comprehension of two‐clause sentences containing the temporal connectives before or after. The youngest children used an order of mention strategy to interpret the relation between clauses: They were more accurate when the presentation order matched the chronological order of events: “He ate his lunch, before he played in the garden” (chronological) versus “Before he played in the garden, he ate his lunch” (reverse). Between 4 and 6 years, performance was influenced by a combination of factors that influenced processing load: connective type and presentation order. An independent measure of working memory was predictive of performance. The study concludes that the memory demands of some sentence structures limits young children's comprehension of sentences containing temporal connectives.

Language Comprehension in Parkinson’s Disease: The Case of Temporal Connectives

Language dysfunction is not normally considered to be a typical symptom of Parkinson’s disease (PD). Previous studies, however, have shown that PD might lead to comprehension deficits whenever a language task taxes verbal working memory. A case in point are sentences starting with temporal connectives (before or after). While “After A, B” sentences state the events in the same order as they occurred in real life, the event-order is reversed in “Before B, A”. Neuroimaging studies have revealed that the caudate nucleus is important for the additional computations necessitated by the processing of ‘before’-initial sentences, suggesting that such sentences should be particularly difficult for patients suffering from basal ganglia diseases such as PD. In the present investigation, we compared a group of PD patients with normal control participants. A further group of patients with restless legs syndrome (RLS) treated with dopaminergic medication was also tested. Replicating earlier studies, PD patients were disproportionately impaired in comprehending ‘before’-initial sentences. Importantly, this deficit was also observed in unmedicated de novo patients, suggesting that these difficulties occur relatively early in the disease. RLS patients also had increased error rates compared to healthy controls. This latter finding should be confirmed in further studies.

Neural Basis of Linearization in Speech Production

An initial stage of speech production is conceptual planning, where a speaker determines which information to convey first (the linearization problem). This fMRI study investigated the linearization process during the production of “before” and “after” sentences. In “after” sentences, a series of events is expressed in the order of event occurrence. In “before” sentences, however, the order of event mention is achieved by reversing the chronological order. We suggested that the linearization process may be supported by a neural network connecting the left middle temporal gyrus (MTG) with the medial superior frontal gyrus, left middle frontal gyrus, and left angular gyrus/inferior parietal gyrus. Within this network, regions were more activated and interregional interactions were strongly enhanced for producing “before” than “after” sentences. The left MTG was also functionally connected with the left orbital inferior frontal gyrus, contributing to the retrieval of necessary world knowledge and linguistic knowledge. Connectivity between these two regions was not different between conditions.