Cross-Modal Conflict Increases With Time-on-Task in a Temporal Discrimination Task

Musical experience enhances time discrimination: Evidence from cortical responses

Time discrimination, a critical aspect of auditory perception, is influenced by numerous factors. Previous research has suggested that musical experience can restructure the brain, thereby enhancing time discrimination. However, this phenomenon remains underexplored. In this study, we seek to elucidate the enhancing effect of musical experience on time discrimination, utilizing both behavioral and electroencephalogram methodologies. Additionally, we aim to explore, through brain connectivity analysis, the role of increased connectivity in brain regions associated with auditory perception as a potential contributory factor to time discrimination induced by musical experience. The results show that the music-experienced group demonstrated higher behavioral accuracy, shorter reaction time, and shorter P3 and mismatch response latencies as compared to the control group. Furthermore, the music-experienced group had higher connectivity in the left temporal lobe. In summary, our research underscores the positive impact of musical experience on time discrimination and suggests that enhanced connectivity in brain regions linked to auditory perception may be responsible for this enhancement.

Engagement of mental effort in response to mental fatigue: A psychophysiological analysis

Acute mental fatigue, characterized by a transient decline in cognitive efficiency during or following prolonged cognitive tasks, can be managed through adaptive effort deployment. In response to mental fatigue, individuals can employ two main behavioral patterns: engaging a compensatory effort to limit performance decrements, or disengaging effort, leading to performance deterioration. This study investigated the behavioral pattern used by participants in mental fatigue conditions. Fifty participants underwent a sequential-task protocol with counterbalanced sessions who took place in two separate sessions: a 30-min incongruent Stroop task (fatiguing session) or a 30-min documentary viewing task (control session), followed by a time-to-exhaustion (TTE) handgrip task at 13 % of maximal voluntary contraction. Psychophysiological measures included the preejection period, heart rate variability, blood pressure, and respiration. Behavioral results showed deteriorated TTE handgrip performance after the Stroop task compared to after the documentary viewing task. During the Stroop task participants were more conservative and prioritized accuracy over speed. Self-reported fatigue was greater after the Stroop task. Psychophysiological data revealed a gradual decrease in sympathetic activity over time in both tasks, with the Stroop task showing a more pronounced decrease. Taken together, these findings suggest a disengagement of effort for a large proportion of participants (49 %) that could be partly attributed to a habituation to the demands of the Stroop task. This study illustrates the interplay of behavioral patterns of effort investment in the context of mental fatigue and underscores the role of disengagement as a dominant response to this phenomenon among healthy participants.

Visual perceptual processing is unaffected by cognitive fatigue

Cognitive fatigue (CF) can lead to an increase in the latency of simple reaction time, although the processes involved in this delay are unknown. One potential explanation is that a longer time may be required for sensory processing of relevant stimuli. To investigate this possibility, the current study used a visual inspection time task to measure perceptual processing speed before and after a CF (math and memory) or non-fatiguing (documentary film) intervention. Subjective fatigue and simple reaction time significantly increased following the CF, but not the non-fatiguing intervention, confirming that CF was induced. Conversely, there was no effect of CF on inspection time task performance. It was therefore concluded that the speed of perceptual processing is not significantly impacted by CF, and thus is unlikely to underlie CF-related reaction time increases. Instead, increases in simple reaction time latency in CF may be due to delays in response preparation or initiation.

The interference of negative emotional stimuli on semantic vigilance performance in a dual-task setting

A large body of previous research has shown that emotional stimuli have an advantage in a wide variety of cognitive processes. This was mainly observed in visual search and working memory tasks. Emotionally charged objects draw and hold attention, are remembered better, and interfere more with the completion of the primary task than neutral ones. Therefore, it seems reasonable to assume that emotional stimuli also greatly affect sustained attention and vigilance decrement. In the present research, we investigated whether emotional stimuli demand more attentional resources than neutral ones in a dual-task paradigm. We adopted the abbreviated semantic discrimination vigilance task and measured participants' (N = 49) performance in a single-task and two dual-task settings. In the dual-task conditions, the visual semantic vigilance paradigm was combined with an auditory word recall task (with neutral or emotional stimuli). We found reduced vigilance and improved word recall performance in the emotional dual-task condition compared to the neutral dual-task and single-task conditions. The reduced performance was apparent throughout the task, while in the neutral conditions, participants' performance first increased and then dropped as time progressed. To conclude, our results indicate that emotional stimuli not only have an advantage in cognitive processing but also demand more attentional resources continuously while it is present compared to neutral stimuli. These results are consistent with the emotionality effect theory and evolutionary accounts of the neural circuits underlying motivated behaviors associated with critical survival needs.

Structural neural correlates of mental fatigue and reward-induced improvement in performance

Neuroimaging studies investigating the association between mental fatigue (henceforth fatigue) and brain physiology have identified many brain regions that may underly the cognitive changes induced by fatigue. These studies focused on the functional changes and functional connectivity of the brain relating to fatigue. The structural correlates of fatigue, however, have received little attention. To fill this gap, this study explored the associations of fatigue with cortical thickness of frontal and parietal regions. In addition, we aimed to explore the associations between reward-induced improvement in performance and neuroanatomical markers in fatigued individuals. Thirty-nine healthy volunteers performed the psychomotor vigilance task for 15 min (i.e., 3 time-on-task blocks of 5 min) out of scanner; followed by an additional rewarded block of the task lasting 5 min. Baseline high-resolution T1-weigthed MR images were obtained. Reaction time increased with time-on-task but got faster again in the rewarded block. Participants' subjective fatigue increased during task performance. In addition, we found that higher increase in subjective mental fatigue was associated with the cortical thickness of the following areas: bilateral precuneus, right precentral gyrus; right pars triangularis and left superior frontal gyrus. Our results suggest that individual differences in subjective mental fatigue may be explained by differences in the degree of cortical thickness of areas that are associated with motor processes, executive functions, intrinsic alertness and are parts of the default mode network.

Change in heart rate variability with increasing time-on-task as a marker for mental fatigue: A systematic review

Fatigue-specific changes in the autonomic nervous system are often assumed to underlie the development of mental fatigue caused by prolonged cognitive tasks (i.e. Time-on-Task). Therefore, several previous studies have chosen to investigate the Time-on-Task related changes in heart rate variability (HRV). However, previous studies have used many different HRV indices, and their results often show inconsistencies. The present study, therefore, systematically reviewed previous empirical HRV studies with healthy individuals and in which mental fatigue is induced by prolonged cognitive tasks. Articles relevant to the objectives were systematically searched and selected by applying the PRISMA guidelines. We screened 360 records found on 4 databases and found that 19 studies were eligible for full review in accordance with the inclusion criteria. In general, all studies reviewed (with the exception of two studies) found significant changes in HRV with increasing Time-on-Task, suggesting that HRV is a reliable autonomic marker for Time-on-Task induced fatigue. The most conclusive HRV indices that showed a consistent Time-on-Task effect were the low frequency component of HRV and the time domain indices, particularly the root mean square of successive differences. Time-on-Task typically induced an increasing trend in both type of measures.

The neural correlates of mental fatigue and reward processing: A task-based fMRI study

Increasing time spent on the task (i.e., the time-on-task (ToT) effect) often results in mental fatigue. Typical effects of ToT are decreasing levels of task-related motivation and the deterioration of cognitive performance. However, a massive body of research indicates that the detrimental effects can be reversed by extrinsic motivators, for example, providing rewards to fatigued participants. Although several attempts have been made to identify brain areas involved in mental fatigue and related reward processing, the neural correlates are still less understood. In this study, we used the psychomotor vigilance task to induce mental fatigue and blood oxygen-level-dependent functional magnetic resonance imaging to investigate the neural correlates of the ToT effect and the reward effect (i.e., providing extra monetary reward after fatigue induction) in a healthy young sample. Our results were interpreted in a recently proposed neurocognitive framework. The activation of the right middle frontal gyrus, right insula and right anterior cingulate gyrus decreased as fatigue emerged and the cognitive performance dropped. However, after providing an extra reward, the cognitive performance, as well as activation of these areas, increased. Moreover, the activation levels of all of the mentioned areas were negatively associated with reaction times. Our results confirm that the middle frontal gyrus, insula and anterior cingulate cortex play crucial roles in cost-benefit evaluations, a potential background mechanism underlying fatigue, as suggested by the neurocognitive framework.

Effects of total sleep deprivation on execution lapses during vigilance tasks

Total sleep deprivation (TSD) results in reduced efficiency of cognitive resources. Moreover, when the available cognitive resources are less than required, individuals exhibit lapses in responsiveness. Accordingly, this study explored the effects of TSD on executive function and the characteristics of execution lapses. Functional near-infrared spectroscopy was used to monitor the prefrontal cortex's functional connections in resting and tasking states for various sleep deprivation durations. Data from participants' attentional performance test and self-reported fatigue were collected over 30 hours of wakefulness. Task performance was compared based on time of day, time on task, and reaction time. The results show that participants' arousal level significantly decreased post 14 hours (P < .05), while sleepiness increased. The prefrontal cortex connection and attentional performance dropped at the Window of Circadian Low (3:00 ~ 6:00). The number of execution lapses was higher during the initiation, inhibition, and fatigue phases and rose markedly post 14 hours of wakefulness. We conclude that maintaining better inhibition control requires a reasonable extension of the reaction time. Moreover, subjective perception is significantly correlated with task performance and right prefrontal connection strength. This study presents the scientific evidence for measures to address consistently long working hours and disrupted circadian rhythms.

Generalisable machine learning models trained on heart rate variability data to predict mental fatigue

A prolonged period of cognitive performance often leads to mental fatigue, a psychobiological state that increases the risk of injury and accidents. Previous studies have trained machine learning algorithms on Heart Rate Variability (HRV) data to detect fatigue in order to prevent its consequences. However, the results of these studies cannot be generalised because of various methodological issues including the use of only one type of cognitive task to induce fatigue which makes any predictions task-specific. In this study, we combined the datasets of three experiments each of which applied different cognitive tasks for fatigue induction and trained algorithms that detect fatigue and predict its severity. We also tested different time window lengths and compared algorithms trained on resting and task related data. We found that classification performance was best when the support vector classifier was trained on task related HRV calculated for a 5-min time window (AUC = 0.843, accuracy = 0.761). For the prediction of fatigue severity, CatBoost regression showed the best performance when trained on 3-min HRV data and self-reported measures (R² = 0.248, RMSE = 17.058). These results indicate that both the detection and prediction of fatigue based on HRV are effective when machine learning models are trained on heterogeneous, multi-task datasets.

Auditory perception dominates in motor rhythm reproduction

It is commonly agreed that vision is more sensitive to spatial information, while audition is more sensitive to temporal information. When both visual and auditory information are available simultaneously, the modality appropriateness hypothesis predicts that, depending on the task, the most appropriate (i.e., reliable) modality dominates perception. While previous research mainly focused on discrepant information from different sensory inputs to scrutinize the modality appropriateness hypothesis, the current study aimed at investigating the modality appropriateness hypothesis when multimodal information was provided in a nondiscrepant and simultaneous manner. To this end, participants performed a temporal rhythm reproduction task for which the auditory modality is known to be the most appropriate. The experiment comprised an auditory (i.e., beeps), a visual (i.e., flashing dots), and an audiovisual condition (i.e., beeps and dots simultaneously). Moreover, constant as well as variable interstimulus intervals were implemented. Results revealed higher accuracy and lower variability in the auditory condition for both interstimulus interval types when compared to the visual condition. More importantly, there were no differences between the auditory and the audiovisual condition across both interstimulus interval types. This indicates that the auditory modality dominated multimodal perception in the task, whereas the visual modality was disregarded and hence did not add to reproduction performance.

Age and Hearing Ability Influence Selective Attention During Childhood

OBJECTIVES

The purpose of the present study was to determine whether age and hearing ability influence selective attention during childhood. Specifically, we hypothesized that immaturity and disrupted auditory experience impede selective attention during childhood.

DESIGN

Seventy-seven school-age children (5 to 12 years of age) participated in this study: 61 children with normal hearing and 16 children with bilateral hearing loss who use hearing aids and/or cochlear implants. Children performed selective attention-based behavioral change detection tasks comprised of target and distractor streams in the auditory and visual modalities. In the auditory modality, children were presented with two streams of single-syllable words spoken by a male and female talker. In the visual modality, children were presented with two streams of grayscale images. In each task, children were instructed to selectively attend to the target stream, inhibit attention to the distractor stream, and press a key as quickly as possible when they detected a frequency (auditory modality) or color (visual modality) deviant stimulus in the target, but not distractor, stream. Performance on the auditory and visual change detection tasks was quantified by response sensitivity, which reflects children's ability to selectively attend to deviants in the target stream and inhibit attention to those in the distractor stream. Children also completed a standardized measure of attention and inhibitory control.

RESULTS

Younger children and children with hearing loss demonstrated lower response sensitivity, and therefore poorer selective attention, than older children and children with normal hearing, respectively. The effect of hearing ability on selective attention was observed across the auditory and visual modalities, although the extent of this group difference was greater in the auditory modality than the visual modality due to differences in children's response patterns. Additionally, children's performance on a standardized measure of attention and inhibitory control related to their performance during the auditory and visual change detection tasks.

CONCLUSIONS

Overall, the findings from the present study suggest that age and hearing ability influence children's ability to selectively attend to a target stream in both the auditory and visual modalities. The observed differences in response patterns across modalities, however, reveal a complex interplay between hearing ability, task modality, and selective attention during childhood. While the effect of age on selective attention is expected to reflect the immaturity of cognitive and linguistic processes, the effect of hearing ability may reflect altered development of selective attention due to disrupted auditory experience early in life and/or a differential allocation of attentional resources to meet task demands.

Physical Activity and Music to Counteract Mental Fatigue

Mental fatigue impairs both cognitive and physical performance. Bioactive substances (e.g., caffeine) have been used to counteract mental fatigue but could have side effects. The present study aimed to test two non-bioactive strategies to counteract mental fatigue: physical activity and listening to music. The participants first performed an arm-pointing task, then carried out a 32-min cognitively demanding task to induce mental fatigue (TLDB task), followed by another arm-pointing task at the end of the experiment. Between the end of the cognitively demanding task and the last arm-pointing task, 20 min went during which participants performed either 15 min of physical activity, of listening to music or of discussion (control). The subjective feeling of mental fatigue was assessed before each arm-pointing task and after the cognitively demanding task. For "physical activity" and "listening to music" groups, EEG was recorded at rest after each evaluation of subjective feeling of mental fatigue and during the cognitively demanding task. An increase in alpha power during the cognitively demanding task evidenced the presence of mental fatigue, without recovery during the following 20-min period. In the control condition, the arm-pointing task performance was deteriorated 20-min after the cognitively demanding task, while it remained stable after both physical activity and listening to music. Furthermore, recovery on the subjective feeling of mental fatigue was similar for both groups. The present results suggested that practicing physical activity and listening to music could be efficient strategies to counteract the negative effects of mental fatigue on motor performances.

Enhanced cardiac vagal tone in mental fatigue: Analysis of heart rate variability in Time-on-Task, recovery, and reactivity

Heart Rate Variability (HRV) has been suggested as a useful tool to assess fatigue-sensitive psychological operations. The present study uses a between and within-subject design with a cognitively demanding task and a documentary viewing condition, to examine the temporal profile of HRV during reactivity, Time-on-Task (ToT), and recovery. In the cognitive task group, participants worked on a bimodal 2-back task with a game-like character (the Gatekeeper task) for about 1.5 hours, followed by a 12-minute break, and a post-break block of performance (about 18 min). In the other group, participants watched documentaries. We hypothesized an increasing vagal-mediated HRV as a function of Time spent on the Gatekeeper task and no HRV change in the documentary viewing group. We also analyzed the trial-based post-response cardiac activity as a physiological associate of task-related motivation. Relative to the documentary-viewing, ToT was associated with an elevated level of subjective fatigue, decreased heart rate, and increased HRV, particularly in the vagal-mediated components. Based on fatigued participants' post-error cardiac slowing, and post-error reaction time analyses, we found no evidence for motivation deficits. The present findings suggest that the parasympathetic branch of the autonomous nervous system functioning as a relaxation system tends to be activated under increasing mental fatigue. In addition, the study shows that many HRV indices also seem to change when individuals are engaged in a prolonged, less fatiguing activity (e.g. documentary viewing). This finding emphasizes the relevance of comparisons/control conditions in ToT experiments.