A methodological note on evaluating performance in a sustained-attention-to-response task

Effects of cholinesterase inhibition on attention and working memory in Lewy body dementias

Cholinesterase inhibitors are frequently used to treat cognitive symptoms in Lewy body dementias (Parkinson's disease dementia and dementia with Lewy bodies). However, the selectivity of their effects remains unclear. In a novel rivastigmine withdrawal design, Parkinson's disease dementia and dementia with Lewy bodies patients were tested twice: once when taking rivastigmine as usual and once when they had missed one dose. In each session, they performed a suite of tasks (sustained attention, simple short-term recall, distractor resistance and manipulating the focus of attention) that allowed us to investigate the cognitive mechanisms through which rivastigmine affects attentional control. Consistent with previous literature, rivastigmine withdrawal significantly impaired attentional efficacy (quicker response latencies without a change in accuracy). However, it had no effects on cognitive control as assessed by the ability to withhold a response (inhibitory control). Worse short-term memory performance was also observed when patients were OFF rivastigmine, but these effects were delay and load independent, likely due to impaired visual attention. In contrast to previous studies that have examined the effects of dopamine withdrawal, cognitively complex tasks requiring control over the contents of working memory (ignoring, updating or shifting the focus of attention) were not significantly impaired by rivastigmine withdrawal. Cumulatively, these data support that the conclusion that cholinesterase inhibition has relatively specific and circumscribed-rather than global-effects on attention that may also affect performance on simple short-term memory tasks, but not when cognitive control over working memory is required. The results also indicate that the withdrawal of a single dose of rivastigmine is sufficient to reveal these impairments, demonstrating that cholinergic withdrawal can be an informative clinical as well as an investigative tool.

On doing multi-act arithmetic: A multitrait-multimethod approach of performance dimensions in integrated multitasking

Here we present a systematic plan to the experimental study of test–retest reliability in the multitasking domain, adopting the multitrait-multimethod (MTMM) approach to evaluate the psychometric properties of performance in Düker-type speeded multiple-act mental arithmetic. These form of tasks capacitate the experimental analysis of integrated multi-step processing by combining multiple mental operations in flexible ways in the service of the overarching goal of completing the task. A particular focus was on scoring methodology, particularly measures of response speed variability. To this end, we present data of two experiments with regard to (a) test–retest reliability, (b) between-measures correlational structure, (c) and stability (test–retest practice effects). Finally, we compared participants with high versus low performance variability to assess ability-related differences in measurement precision (typically used as proxy to “simulate” patient populations), which is especially relevant in the applied fields of clinical neuropsychology. The participants performed two classic integrated multi-act arithmetic tasks, combining addition and verification (Exp. 1) and addition and comparison (Exp. 2). The results revealed excellent test–retest reliability for the standard and the variability measures. The analysis of between-measures correlational structure revealed the typical pattern of convergent and discriminant relationships, and also, that absolute response speed variability was highly correlated with average speed (r > 0.85), indicating that these measures mainly deliver redundant information. In contrast, speed-adjusted (relativized) variability revealed discriminant validity being correlated to a much lesser degree with average speed, indicating that this measure delivers additional information not already provided by the speed measure. Furthermore, speed-adjusted variability was virtually unaffected by test–retest practice, which makes this measure interesting in situations with repeated testing.

Virtual Reality Greenspaces: Does Level of Immersion Affect Directed Attention Restoration in VR Environments?

Research on attention restoration theory has provided consistent results over the years, and exposure to nature has been found to significantly improve and restore directed attention fatigue. However, rapid urbanisation has made it increasingly difficult for human beings to interact with unpolluted nature. Countries such as Singapore began to integrate nature into city planning and into the designs of buildings to help resident satisfaction and well-being. Local studies have had contradictory outcomes; residents report significantly higher restoration and affect towards vertical integrated greeneries, but many would still prefer traditional on-the-ground foliage. Interest in outdoor greenspaces is variable because Singapore’s high heat and humid climate make it uncomfortable to interact with outside nature for prolonged periods. The current study tested alternative modalities that can provide residents with on-the-ground foliage interactions, without the discomfort of being outdoors. Virtual exposures with different levels of immersion (high and low) and types of scenes (nature and urban) were tested for effects on perceived presence, perceived restoration and objective restoration. A total of 120 adult participants completed the study, which revealed that a virtual reality-nature condition provided significantly superior directed attention restoration and higher presence ratings. Immersive tendency did not affect perceived presence; neither did it moderate the relationship between perceived presence and its corresponding perceived restoration.

Restoration of Attention by Rest in a Multitasking World: Theory, Methodology, and Empirical Evidence

In this work, we evaluate the status of both theory and empirical evidence in the field of experimental rest-break research based on a framework that combines mental-chronometry and psychometric-measurement theory. To this end, we (1) provide a taxonomy of rest breaks according to which empirical studies can be classified (e.g., by differentiating between long, short, and micro-rest breaks based on context and temporal properties). Then, we (2) evaluate the theorizing in both the basic and applied fields of research and explain how popular concepts (e.g., ego depletion model, opportunity cost theory, attention restoration theory, action readiness, etc.) relate to each other in contemporary theoretical debates. Here, we highlight differences between all these models in the light of two symbolic categories, termed the resource-based and satiation-based model, including aspects related to the dynamics and the control (strategic or non-strategic) mechanisms at work. Based on a critical assessment of existing methodological and theoretical approaches, we finally (3) provide a set of guidelines for both theory building and future empirical approaches to the experimental study of rest breaks. We conclude that a psychometrically advanced and theoretically focused research of rest and recovery has the potential to finally provide a sound scientific basis to eventually mitigate the adverse effects of ever increasing task demands on performance and well-being in a multitasking world at work and leisure.

The effects of real-time performance feedback and performance emphasis on the sustained attention to response task (SART)

The sustained attention to response task (SART) has been used for over 20 years to assess participants' response times and inability to withhold to No-Go stimuli (commission errors). While there is debate in the literature regarding what causes commissions errors in the SART, there is agreement the SART is subject to a speed-accuracy trade-off (SATO). Researchers have demonstrated that performance on the SART can be influenced by directive instructions to participants to prioritize either speed or accuracy during the task. In the present study, we investigated whether real-time performance feedback and whether feedback emphasis (emphasizing speed or accuracy) affected participants' response times and accuracy. We found performance feedback per se had no impact on performance, but performance emphasis did affect performance, apparently shifting the SATO. This finding provides further evidence that the commission errors in the SART are not indicative of sustained attention or vigilance as those terms are commonly used in the literature, but more likely assess response strategy and motor control (or lack of motor control). These findings have implications for the psychological assessment literature, as well as applied areas where SART findings have been utilized such as shoot/no-shoot decision making.

The metronome response task for measuring mind wandering: Replication attempt and extension of three studies by Seli et al

Science requires replicable tools to measure its intended constructs. Attention research has developed tools that have been used in mind-wandering research, but mind-wandering measures often rely on response-inhibition, which introduces speed-accuracy trade-offs that may conflate errors for mind-wandering. We sought to replicate three studies that used an improved mind-wandering measure: the Metronome Response Task (MRT). In a large (N=300) multisite sample, the primary MRT finding was replicated, showing that continuous rhythmic response time variability reliably predicted self-reported mind-wandering. Our findings also show previously undetected differences between intentional and unintentional mind-wandering. While previously reported mediators (motivation) and moderators (confidence) did not replicate, additional covariates add predictive value and additional constructs (e.g., boredom, effort) demonstrate convergent validity. The MRT is useful for inducing and measuring mind-wandering and provides an especially replicable tool. The MRT's measurement of attention could support future models of the complete cycle of sustained attention.

The quick and the dead: A paradigm for studying friendly fire

The Sustained Attention to Response Task (SART) is a computer based Go-No-Go response task. Participants respond to frequently occurring neutral stimuli and withhold responses to rare target stimuli. Researchers have suggested the inhibition demands of the SART may mirror those which occur in some firearm accidents. Participants in the present experiment used a simulated nonlethal weapon to subdue threats (images of people holding guns) on large screens. Participants completed a target rich task (high Go low No-Go, like a SART), a target sparse task (low Go/high No-Go), a verbal recall task, and dual versions of the target rich and target sparse tasks with the verbal recall task as the secondary task. Results provided further evidence that some accidental shootings may result from failures of response inhibition and that additional cognitive load is detrimental to overall performance. Future studies should explore the role of response inhibition in realistic firearm scenarios.

Validating a visual version of the metronome response task

The metronome response task (MRT)-a sustained-attention task that requires participants to produce a response in synchrony with an audible metronome-was recently developed to index response variability in the context of studies on mind wandering. In the present studies, we report on the development and validation of a visual version of the MRT (the visual metronome response task; vMRT), which uses the rhythmic presentation of visual, rather than auditory, stimuli. Participants completed the vMRT (Studies 1 and 2) and the original (auditory-based) MRT (Study 2) while also responding to intermittent thought probes asking them to report the depth of their mind wandering. The results showed that (1) individual differences in response variability during the vMRT are highly reliable; (2) prior to thought probes, response variability increases with increasing depth of mind wandering; (3) response variability is highly consistent between the vMRT and the original MRT; and (4) both response variability and depth of mind wandering increase with increasing time on task. Our results indicate that the original MRT findings are consistent across the visual and auditory modalities, and that the response variability measured in both tasks indexes a non-modality-specific tendency toward behavioral variability. The vMRT will be useful in the place of the MRT in experimental contexts in which researchers' designs require a visual-based primary task.

Prolonging the response movement inhibits the feed-forward motor program in the sustained attention to response task

Despite widespread use in clinical and experimental contexts, debate continues over whether or not the Sustained Attention to Response Task (SART) successfully measures sustained attention. Altering physical aspects of the response movement required to SART stimuli may help identify whether performance is a better measure of perceptual decoupling, or response strategies and motor inhibition. Participants completed a SART where they had to manually move a mouse cursor to respond to stimuli, and another SART where this extra movement was not required, as in a typical SART. Additionally, stimuli were located at either a close or a far distance away. Commission errors were inversely related to distance in the manual movement condition, as the farther distance led to longer response times which gave participants more time to inhibit prepotent responses and thus prevent commission errors. Self-reported measures of mental demand and fatigue suggested there were no differences in mental demands between the manual and automatic condition; instead the differences were primarily in physical demands. No differences were found for task-unrelated thoughts between the manual and automatic condition. The movement effect combined with participants' subjective reports are evidence for time dependent action stopping, not greater cognitive engagement. These findings support a response strategy perspective as opposed to a perceptual decoupling perspective, and have implications for authors considering using the SART. Applied implications of this research are also discussed.

Inhibiting the Physiological Stress Effects of a Sustained Attention Task on Shoulder Muscle Activity

Objective: The objective of this study was to investigate if a breathing technique could counteract the effects of hyperventilation due to a sustained attention task on shoulder muscle activity. Background: The trend towards higher levels of automation in industry is increasing. Consequently, manufacturing operators often monitor automated process for long periods of their work shift. Prolonged monitoring work requires sustained attention, which is a cognitive process that humans are typically poor at and find stressful. As sustained attention becomes an increasing requirement of manufacturing operators’ job content, the resulting stress experienced could contribute to the onset of many health problems, including work related musculoskeletal disorders (WRMSDs). Methods: The SART attention test was completed by a group of participants before and after a breathing intervention exercise. The effects of the abdominal breathing intervention on breathing rate, upper trapezius muscle activity and end-tidal CO₂ were evaluated. Results: The breathing intervention reduced the moderation effect of end-tidal CO₂ on upper trapezius muscle activity. Conclusions: Abdominal breathing could be a useful technique in reducing the effects of sustained attention work on muscular activity. Application: This research can be applied to highly-automated manufacturing industries, where prolonged monitoring of work is widespread and could, in its role as a stressor, be a potential contributor to WRMSDs.

Mind-wandering in healthy aging and early stage Alzheimer's disease

OBJECTIVE

The frequency of mind-wandering (MW) decreases as a function of age in healthy individuals. One possible explanation is that MW is a resource-dependent process, and cognitive resources decline with age. The present study provides the first investigation of MW in the earliest stages of Alzheimer's disease (AD) to further examine the resource model and discontinuities between healthy aging and AD.

METHOD

Three large cohorts completed the Sustained Attention to Response Task (SART): a healthy middle-aged group (mean age = 61.79 ± 5.84 years; N = 270), a healthy older adult group (mean age = 76.58 ± 5.27 years; N = 282), and a group with early stage AD (mean age = 76.08 ± 7.17; N = 77), comparable in age to the second group.

RESULTS

Self-reports of MW during the SART decreased as a function of age, and there was a further decrease in the AD group. All 3 groups produced faster responses on trials before No-Go errors, suggesting MW occurred in all cohorts. After No-Go errors, healthy older adults slowed disproportionately compared with middle-aged adults. This was not evident in AD individuals who showed posterror slowing comparable with that in the middle-aged group.

CONCLUSIONS

The decreased self-reported MW in older adults and the further decline in AD are consistent with the cognitive resource account of MW. Behavioral indices suggest that AD is on a continuum with healthy aging, with the exception of posterror slowing that may suggest performance monitoring deficits in early AD individuals (e.g., lack of error awareness). (PsycINFO Database Record

Action slips during whole-body vibration

Helicopter aircrew members engage in highly demanding cognitive tasks in an environment subject to whole-body vibration (WBV). Sometimes their actions may not be according to plan (e.g. action slips and lapses). This study used a Sustained Attention to Response Task (SART) to examine whether action slips were more frequent during exposure to WBV. Nineteen participants performed the SART in two blocks. In the WBV block participants were exposed to 17 Hz vertical WBV, which is typical of larger helicopter working environments. In the No-WBV block there was no WBV. There were more responses to the rare no-go digit 3 (i.e. action slips) in the WBV block, and participants responded faster in the WBV block. These results suggest that WBV influences response inhibition, and can induce impulsive responding. WBV may increase the likelihood of action slips, mainly due to failure of response inhibition.

"You're on ten, where can you go from there?" Tufnel problems in repeated experiential judgments

We describe a set of Tufnel problems that arise when repeated use of a fixed-point scale precipitates failures to assess a full range of subjective experiences. As empirical evidence, participants in Study 1 periodically reported their depth of mind wandering on either 5- or 7-point Likert scales during a sustained attention task. The proportion of participants providing maximum scale ratings increased quickly over time-on-task and did so more quickly for the 5-point than for the 7-point group. Participants in Study 2 completed the same task using a 10-point scale before indicating whether and where they could have used a scale extended to "11" during the task. Slightly more than 20% of participants reported needing a scale extension. This Need for 11 was associated with differences in both reports of mind wandering depth and task performance. We conclude that Tufnel problems warrant methodological consideration and reflect interesting constraints on human judgment.

Nicotine restores functional connectivity of the ventral attention network in schizophrenia

While previous work has suggested that nicotine may transiently improve attention deficits in schizophrenia, the neuronal mechanisms are poorly understood. This study is the first to examine the effects of nicotine on connectivity within the ventral attention network (VAN) during a selective attention task in schizophrenia. Using a crossover design, 17 nonsmoking patients with schizophrenia and 20 age/gender-matched nonsmoking healthy controls performed a go/no-go task with environmental noise distractors during application of a 7 mg nicotine or placebo patch. Psychophysiological interaction analysis was performed to analyze task-associated changes in connectivity between a ventral parietal cortex (VPC) seed and the inferior frontal gyrus (IFG), key components of the human VAN. Effects of nicotine on resting state VAN connectivity were also examined. A significant diagnosis × drug interaction was observed on task-associated connectivity between the VPC seed and the left IFG (F(1,35) = 8.03, p < 0.01). This effect was driven by decreased connectivity after placebo in patients and greater connectivity after nicotine. Resting state connectivity analysis showed a significant main effect of diagnosis between the seed and right IFG (F = 4.25, p = 0.023) due to increased connectivity in patients during placebo, but no drug × diagnosis interactions or main effects of drug. This study is the first to demonstrate that 1) the VAN is disconnected in schizophrenia during selective attention, and 2) nicotine may normalize this pathological state.

Neuronal effects of nicotine during auditory selective attention in schizophrenia

Although nicotine has been shown to improve attention deficits in schizophrenia, the neurobiological mechanisms underlying this effect are poorly understood. We hypothesized that nicotine would modulate attention-associated neuronal response in schizophrenia patients in the ventral parietal cortex (VPC), hippocampus, and anterior cingulate based on previous findings in control subjects. To test this hypothesis, the present study examined response in these regions in a cohort of nonsmoking patients and healthy control subjects using an auditory selective attention task with environmental noise distractors during placebo and nicotine administration. In agreement with our hypothesis, significant diagnosis (Control vs. Patient) X drug (Placebo vs. Nicotine) interactions were observed in the VPC and hippocampus. The interaction was driven by task-associated hyperactivity in patients (relative to healthy controls) during placebo administration, and decreased hyperactivity in patients after nicotine administration (relative to placebo). No significant interaction was observed in the anterior cingulate. Task-associated hyperactivity of the VPC predicted poor task performance in patients during placebo. Poor task performance also predicted symptoms in patients as measured by the Brief Psychiatric Rating Scale. These results are the first to suggest that nicotine may modulate brain activity in a selective attention-dependent manner in schizophrenia.

Attending at a Low Intensity Increases Impulsivity in an Auditory Sustained Attention to Response Task

Why attention lapses during prolonged tasks is debated, specifically whether errors are a consequence of under-arousal or exerted effort. To explore this, we investigated whether increased impulsivity is associated with effortful processing by modifying the demand of a task by presenting it at a quiet intensity. Here, we consider whether attending at low but detectable levels affects impulsivity in a population with intact hearing. A modification of the Sustained Attention to Response Task was used with auditory stimuli at two levels: the participants’ personal “lowest detectable” level and a “normal speaking” level. At the quiet intensity, we found that more impulsive responses were made compared with listening at a normal speaking level. These errors were not due to a failure in discrimination. The findings suggest an increase in processing time for auditory stimuli at low levels that exceeds the time needed to interrupt a planned habitual motor response. This leads to a more impulsive and erroneous response style. These findings have important implications for understanding the nature of impulsivity in relation to effortful processing. They may explain why a high proportion of individuals with hearing loss are also diagnosed with Attention Deficit Hyperactivity Disorder.

Sustained attention failures are primarily due to sustained cognitive load not task monotony

We conducted two studies using a modified sustained attention to response task (SART) to investigate the developmental process of SART performance and the role of cognitive load on performance when the speed-accuracy trade-off is controlled experimentally. In study 1, 23 participants completed the modified SART (target stimuli location was not predictable) and a subjective thought content questionnaire 4 times over the span of 4 weeks. As predicted, the influence of speed-accuracy trade-off was significantly mitigated on the modified SART by having target stimuli occur in unpredictable locations. In study 2, 21 of the 23 participants completed an abridged version of the modified SART with a verbal free-recall memory task. Participants performed significantly worse when completing the verbal memory task and SART concurrently. Overall, the results support a resource theory perspective with concern to errors being a result of limited mental resources and not simply mindlessness per se.

Absent without leave; a neuroenergetic theory of mind wandering

Absent minded people are not under the control of task-relevant stimuli. According to the Neuroenergetics Theory of attention (NeT), this lack of control is often due to fatigue of the relevant processing units in the brain caused by insufficient resupply of the neuron's preferred fuel, lactate, from nearby astrocytes. A simple drift model of information processing accounts for response-time statistics in a paradigm often used to study inattention, the Sustained Attention to Response Task (SART). It is suggested that errors and slowing in this fast-paced, response-engaging task may have little to due with inattention. Slower-paced and less response-demanding tasks give greater license for inattention-aka absent-mindedness, mind-wandering. The basic NeT is therefore extended with an ancillary model of attentional drift and recapture. This Markov model, called NEMA, assumes probability λ of lapses of attention from 1 s to the next, and probability α of drifting back to the attentional state. These parameters measure the strength of attraction back to the task (α), or away to competing mental states or action patterns (λ); their proportion determines the probability of the individual being inattentive at any point in time over the long run. Their values are affected by the fatigue of the brain units they traffic between. The deployment of the model is demonstrated with a data set involving paced responding.

Enhancing SART Validity by Statistically Controlling Speed-Accuracy Trade-Offs

Numerous studies focused on elucidating the correlates, causes, and consequences of inattention/attention-lapses employ the Sustained Attention to Response Task (SART), a GO-NOGO task with infrequent withholds. Although the SART has become popular among inattention researchers, recent work has demonstrated its susceptibility to speed-accuracy trade-offs (SATOs), rendering its assessment of inattention problematic. Here, we propose and illustrate methods to statistically control for the occurrence of SATOs during SART performance. The statistical solutions presented here can be used to correct standard SART-error scores, including those of already-published data, thereby allowing researchers to re-examine existing data, and to more sensitively evaluate the validity of earlier conclusions.