Crowdsourcing in Cognitive and Systems Neuroscience

Ouvrai opens access to remote virtual reality studies of human behavioural neuroscience

Modern virtual reality (VR) devices record six-degree-of-freedom kinematic data with high spatial and temporal resolution and display high-resolution stereoscopic three-dimensional graphics. These capabilities make VR a powerful tool for many types of behavioural research, including studies of sensorimotor, perceptual and cognitive functions. Here we introduce Ouvrai, an open-source solution that facilitates the design and execution of remote VR studies, capitalizing on the surge in VR headset ownership. This tool allows researchers to develop sophisticated experiments using cutting-edge web technologies such as WebXR to enable browser-based VR, without compromising on experimental design. Ouvrai's features include easy installation, intuitive JavaScript templates, a component library managing front- and backend processes and a streamlined workflow. It integrates with Firebase, Prolific and Amazon Mechanical Turk and provides data processing utilities for analysis. Unlike other tools, Ouvrai remains free, with researchers managing their web hosting and cloud database via personal Firebase accounts. Ouvrai is not limited to VR studies; researchers can also develop and run desktop or touchscreen studies using the same streamlined workflow. Through three distinct motor learning experiments, we confirm Ouvrai's efficiency and viability for conducting remote VR studies.

Procedural Motor Memory Deficits in Patients With Long-COVID

BACKGROUND AND OBJECTIVES

At least 15% of patients who recover from acute severe acute respiratory syndrome coronavirus 2 infection experience lasting symptoms ("Long-COVID") including "brain fog" and deficits in declarative memory. It is not known if Long-COVID affects patients' ability to form and retain procedural motor skill memories. The objective was to determine the ability of patients with Long-COVID to acquire and consolidate a new procedural motor skill over 2 training days. The primary outcome was to determine difference in early learning, measured as the increase in correct sequence typing speed over the initial 11 practice trials of a new skill. The secondary outcomes were initial and final typing speed on days 1 and 2, learning rate, overnight consolidation, and typing accuracy.

METHODS

In this prospective, cross-sectional, online, case-control study, participants learned a sequential motor skill over 2 consecutive days (NCT05746624). Patients with Long-COVID (reporting persistent post-coronavirus disease 2019 [COVID-19] symptoms for more than 4 weeks) were recruited at the NIH. Patients were matched one-to-one by age and sex to controls recruited during the pandemic using a crowd-sourcing platform. Selection criteria included age 18-90 years, English speaking, right-handed, able to type with the left hand, denied active fever or respiratory infection, and no previous task exposure. Data were also compared with an age-matched and sex-matched control group who performed the task online before the COVID-19 pandemic (prepandemic controls).

RESULTS

In total, 105 of 236 patients contacted agreed to participate and completed the experiment (mean ± SD age 46 ± 12.8 years, 82% female). Both healthy control groups had 105 participants (mean age 46 ± 13.1 and 46 ± 11.9 years, 82% female). Early learning was comparable across groups (Long-COVID: 0.36 ± 0.24 correct sequences/second, pandemic controls: 0.36 ± 0.53 prepandemic controls: 0.38 ± 0.57, patients vs pandemic controls [CI -0.068 to 0.067], vs prepandemic controls [CI -0.084 to 0.052], and between controls [CI -0.083 to 0.053], p = 0.82). Initial and final typing speeds on days 1 and 2 were slower in patients than controls. Patients with Long-COVID showed a significantly reduced overnight consolidation and a nonsignificant trend to reduced learning rates.

DISCUSSION

Early learning was comparable in patients with Long-COVID and controls. Anomalous initial performance is consistent with executive dysfunction. Reduction in overnight consolidation may relate to deficits in procedural memory formation.

Discourse coherence modulates use of predictive processing during sentence comprehension

Context has been shown to be vitally important for comprehension. Lexical processing is facilitated when words are highly predictable given their local sentence context, suggesting that people pre-activate likely upcoming words to aid comprehension. However, this facilitation is affected by knowledge about the global context in which comprehension takes place: people predict less when in an environment where expectations are frequently violated. The current study investigated whether discourse coherence is an additional cue that comprehenders use to modulate lexical prediction. In a series of online, self-paced reading experiments, participants read target sentences preceded by short contextual preambles. Local facilitation effects were manipulated through the cloze probability of a critical word within the target sentence and discourse coherence was manipulated by varying the degree to which the target sentence was consistent with the information presented in the preamble. In the first two experiments, target sentences were read more slowly when they occurred in less coherent discourses, but no local facilitation effects were observed. In the third experiment, we strengthened the predictability manipulation by using semantically anomalous critical words. In this experiment, predictable words were processed more quickly and anomalous words more slowly when they occurred in highly coherent discourse. Our results suggest that comprehenders are sensitive to shifts in the topic of discourse and that they downregulate predictive processing when they encounter incoherence in the discourse. This is consistent with recent theoretical accounts suggesting that comprehenders flexibly engage in predictive processing, pre-activating semantic and lexical information less when their expectations are less likely to be reliable.

Neurocognitive Artificial Neural Network Models Are Superior to Linear Models at Accounting for Dimensional Psychopathology

In recent years, there has been debate about the optimal conceptualisation of psychopathology. Structural models of psychopathology have been developed to counter issues, including comorbidity and poor diagnostic stability prevalent within the traditional nosological approach. Regardless of the conceptualisation of psychological dysfunction, deficits in neurocognitive abilities have been claimed to be an aetiological feature of psychopathology. Explorations of the association between neurocognition and psychopathology have typically taken a linear approach, overlooking the potential interactive dynamics of neurocognitive abilities. Previously, we proposed a multidimensional hypothesis, where within-person interactions between neurocognitive domains are fundamental to understanding the role of neurocognition within psychopathology. In this study, we used previously collected psychopathology data for 400 participants on psychopathological symptoms, substance use, and performance on eight neurocognitive tasks and compared the predictive accuracy of linear models to artificial neural network models. The artificial neural network models were significantly more accurate than the traditional linear models at predicting actual (a) lower-level and (b) high-level dimensional psychopathology. These results provide support for the multidimensional hypothesis: that the study of non-linear interactions and compensatory neurocognitive profiles are integral to understanding the functional associations between neurocognition and of psychopathology.

ReActLab: A Custom Framework for Sensorimotor Experiments “in-the-wild”

Over the last few years online platforms for running psychology experiments beyond simple questionnaires and surveys have become increasingly popular. This trend has especially increased after many laboratory facilities had to temporarily avoid in-person data collection following COVID-19-related lockdown regulations. Yet, while offering a valid alternative to in-person experiments in many cases, platforms for online experiments are still not a viable solution for a large part of human-based behavioral research. Two situations in particular pose challenges: First, when the research question requires design features or participant interaction which exceed the customization capability provided by the online platform; and second, when variation among hardware characteristics between participants results in an inadmissible confounding factor. To mitigate the effects of these limitations, we developed ReActLab (Remote Action Laboratory), a framework for programming remote, browser-based experiments using freely available and open-source JavaScript libraries. Since the experiment is run entirely within the browser, our framework allows for portability to any operating system and many devices. In our case, we tested our approach by running experiments using only a specific model of Android tablet. Using ReActLab with this standardized hardware allowed us to optimize our experimental design for our research questions, as well as collect data outside of laboratory facilities without introducing setup variation among participants. In this paper, we describe our framework and show examples of two different experiments carried out with it: one consisting of a visuomotor adaptation task, the other of a visual localization task. Through comparison with results obtained from similar tasks in in-person laboratory settings, we discuss the advantages and limitations for developing browser-based experiments using our framework.

What Accounts for the Factors of Psychopathology? An Investigation of the Neurocognitive Correlates of Internalising, Externalising, and the p-Factor

Neurocognitive deficits have been consistently associated with a wide range of psychopathology and are proposed to not only be a consequence of the development of psychopathology but also directly involved in its aetiology. However, there is no clear understanding of what neurocognitive processes are particularly important to mental health. In this paper, we explored the association between neurocognitive abilities and the factors derived from structural models of psychopathology. Four hundred participants from a representative community sample completed measures of symptomology and substance use, as well as 8 neurocognitive tasks. We found a correlated-factors model, with internalising and externalising as the higher-order factors, and a single-factor model with only the p-factor, to be good fits for the data. Tasks that measured the speed of processing were significantly associated with internalising, externalising, and the p-factor, and accounted for significant amounts of unique variance in the factors after accounting for the common variance of the other tasks. Tasks that measured working memory, shifting, and inhibition were not significantly associated with psychopathology factors. Our findings suggest that neurocognitive abilities may not be differentially associated with psychopathology factors, but that speed of processing is a common correlate of the factors. We emphasise the importance of examining neurocognitive abilities and psychopathology on the individual level.

Long-Term Motor Learning in the "Wild" With High Volume Video Game Data

Motor learning occurs over long periods of practice during which motor acuity, the ability to execute actions more accurately, precisely, and in less time, improves. Laboratory-based studies of motor learning are typically limited to a small number of participants and a time frame of minutes to several hours per participant. There is a need to assess the generalizability of theories and findings from lab-based motor learning studies on larger samples and time scales. In addition, laboratory-based studies of motor learning use relatively simple motor tasks which participants are unlikely to be intrinsically motivated to learn, limiting the interpretation of their findings in more ecologically valid settings ("in the wild"). We studied the acquisition and longitudinal refinement of a complex sensorimotor skill embodied in a first-person shooter video game scenario, with a large sample size (N = 7174, 682,564 repeats of the 60 s game) over a period of months. Participants voluntarily practiced the gaming scenario for up to several hours per day up to 100 days. We found improvement in performance accuracy (quantified as hit rate) was modest over time but motor acuity (quantified as hits per second) improved considerably, with 40-60% retention from 1 day to the next. We observed steady improvements in motor acuity across multiple days of video game practice, unlike most motor learning tasks studied in the lab that hit a performance ceiling rather quickly. Learning rate was a non-linear function of baseline performance level, amount of daily practice, and to a lesser extent, number of days between practice sessions. In addition, we found that the benefit of additional practice on any given day was non-monotonic; the greatest improvements in motor acuity were evident with about an hour of practice and 90% of the learning benefit was achieved by practicing 30 min per day. Taken together, these results provide a proof-of-concept in studying motor skill acquisition outside the confines of the traditional laboratory, in the presence of unmeasured confounds, and provide new insights into how a complex motor skill is acquired in an ecologically valid setting and refined across much longer time scales than typically explored.