1
|
Cesanek E, Shivkumar S, Ingram JN, Wolpert DM. Ouvrai opens access to remote virtual reality studies of human behavioural neuroscience. Nat Hum Behav 2024; 8:1209-1224. [PMID: 38671286 PMCID: PMC11199109 DOI: 10.1038/s41562-024-01834-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Accepted: 01/18/2024] [Indexed: 04/28/2024]
Abstract
Modern virtual reality (VR) devices record six-degree-of-freedom kinematic data with high spatial and temporal resolution and display high-resolution stereoscopic three-dimensional graphics. These capabilities make VR a powerful tool for many types of behavioural research, including studies of sensorimotor, perceptual and cognitive functions. Here we introduce Ouvrai, an open-source solution that facilitates the design and execution of remote VR studies, capitalizing on the surge in VR headset ownership. This tool allows researchers to develop sophisticated experiments using cutting-edge web technologies such as WebXR to enable browser-based VR, without compromising on experimental design. Ouvrai's features include easy installation, intuitive JavaScript templates, a component library managing front- and backend processes and a streamlined workflow. It integrates with Firebase, Prolific and Amazon Mechanical Turk and provides data processing utilities for analysis. Unlike other tools, Ouvrai remains free, with researchers managing their web hosting and cloud database via personal Firebase accounts. Ouvrai is not limited to VR studies; researchers can also develop and run desktop or touchscreen studies using the same streamlined workflow. Through three distinct motor learning experiments, we confirm Ouvrai's efficiency and viability for conducting remote VR studies.
Collapse
Affiliation(s)
- Evan Cesanek
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY, USA.
| | - Sabyasachi Shivkumar
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY, USA
| | - James N Ingram
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY, USA
| | - Daniel M Wolpert
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY, USA
| |
Collapse
|
2
|
Hayward W, Buch ER, Norato G, Iwane F, Dash D, Salamanca-Girón RF, Bartrum E, Walitt B, Nath A, Cohen LG. Procedural Motor Memory Deficits in Patients With Long-COVID. Neurology 2024; 102:e208073. [PMID: 38237090 PMCID: PMC11097756 DOI: 10.1212/wnl.0000000000208073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Accepted: 10/26/2023] [Indexed: 01/23/2024] Open
Abstract
BACKGROUND AND OBJECTIVES At least 15% of patients who recover from acute severe acute respiratory syndrome coronavirus 2 infection experience lasting symptoms ("Long-COVID") including "brain fog" and deficits in declarative memory. It is not known if Long-COVID affects patients' ability to form and retain procedural motor skill memories. The objective was to determine the ability of patients with Long-COVID to acquire and consolidate a new procedural motor skill over 2 training days. The primary outcome was to determine difference in early learning, measured as the increase in correct sequence typing speed over the initial 11 practice trials of a new skill. The secondary outcomes were initial and final typing speed on days 1 and 2, learning rate, overnight consolidation, and typing accuracy. METHODS In this prospective, cross-sectional, online, case-control study, participants learned a sequential motor skill over 2 consecutive days (NCT05746624). Patients with Long-COVID (reporting persistent post-coronavirus disease 2019 [COVID-19] symptoms for more than 4 weeks) were recruited at the NIH. Patients were matched one-to-one by age and sex to controls recruited during the pandemic using a crowd-sourcing platform. Selection criteria included age 18-90 years, English speaking, right-handed, able to type with the left hand, denied active fever or respiratory infection, and no previous task exposure. Data were also compared with an age-matched and sex-matched control group who performed the task online before the COVID-19 pandemic (prepandemic controls). RESULTS In total, 105 of 236 patients contacted agreed to participate and completed the experiment (mean ± SD age 46 ± 12.8 years, 82% female). Both healthy control groups had 105 participants (mean age 46 ± 13.1 and 46 ± 11.9 years, 82% female). Early learning was comparable across groups (Long-COVID: 0.36 ± 0.24 correct sequences/second, pandemic controls: 0.36 ± 0.53 prepandemic controls: 0.38 ± 0.57, patients vs pandemic controls [CI -0.068 to 0.067], vs prepandemic controls [CI -0.084 to 0.052], and between controls [CI -0.083 to 0.053], p = 0.82). Initial and final typing speeds on days 1 and 2 were slower in patients than controls. Patients with Long-COVID showed a significantly reduced overnight consolidation and a nonsignificant trend to reduced learning rates. DISCUSSION Early learning was comparable in patients with Long-COVID and controls. Anomalous initial performance is consistent with executive dysfunction. Reduction in overnight consolidation may relate to deficits in procedural memory formation.
Collapse
Affiliation(s)
- William Hayward
- From the Human Cortical Physiology and Neurorehabilitation Section (W.H., E.R.B., F.I., D.D., R.F.S.-G., L.G.C.), Clinical Trials Unit (G.N.), Office of the Clinical Director, and Section of Infections of the Nervous System (E.B., B.W., A.N.), National Institute of Neurological Disorders and Stroke, NIH, Bethesda, MD
| | - Ethan R Buch
- From the Human Cortical Physiology and Neurorehabilitation Section (W.H., E.R.B., F.I., D.D., R.F.S.-G., L.G.C.), Clinical Trials Unit (G.N.), Office of the Clinical Director, and Section of Infections of the Nervous System (E.B., B.W., A.N.), National Institute of Neurological Disorders and Stroke, NIH, Bethesda, MD
| | - Gina Norato
- From the Human Cortical Physiology and Neurorehabilitation Section (W.H., E.R.B., F.I., D.D., R.F.S.-G., L.G.C.), Clinical Trials Unit (G.N.), Office of the Clinical Director, and Section of Infections of the Nervous System (E.B., B.W., A.N.), National Institute of Neurological Disorders and Stroke, NIH, Bethesda, MD
| | - Fumiaki Iwane
- From the Human Cortical Physiology and Neurorehabilitation Section (W.H., E.R.B., F.I., D.D., R.F.S.-G., L.G.C.), Clinical Trials Unit (G.N.), Office of the Clinical Director, and Section of Infections of the Nervous System (E.B., B.W., A.N.), National Institute of Neurological Disorders and Stroke, NIH, Bethesda, MD
| | - Dabedatta Dash
- From the Human Cortical Physiology and Neurorehabilitation Section (W.H., E.R.B., F.I., D.D., R.F.S.-G., L.G.C.), Clinical Trials Unit (G.N.), Office of the Clinical Director, and Section of Infections of the Nervous System (E.B., B.W., A.N.), National Institute of Neurological Disorders and Stroke, NIH, Bethesda, MD
| | - Roberto F Salamanca-Girón
- From the Human Cortical Physiology and Neurorehabilitation Section (W.H., E.R.B., F.I., D.D., R.F.S.-G., L.G.C.), Clinical Trials Unit (G.N.), Office of the Clinical Director, and Section of Infections of the Nervous System (E.B., B.W., A.N.), National Institute of Neurological Disorders and Stroke, NIH, Bethesda, MD
| | - Elizabeth Bartrum
- From the Human Cortical Physiology and Neurorehabilitation Section (W.H., E.R.B., F.I., D.D., R.F.S.-G., L.G.C.), Clinical Trials Unit (G.N.), Office of the Clinical Director, and Section of Infections of the Nervous System (E.B., B.W., A.N.), National Institute of Neurological Disorders and Stroke, NIH, Bethesda, MD
| | - Brian Walitt
- From the Human Cortical Physiology and Neurorehabilitation Section (W.H., E.R.B., F.I., D.D., R.F.S.-G., L.G.C.), Clinical Trials Unit (G.N.), Office of the Clinical Director, and Section of Infections of the Nervous System (E.B., B.W., A.N.), National Institute of Neurological Disorders and Stroke, NIH, Bethesda, MD
| | - Avindra Nath
- From the Human Cortical Physiology and Neurorehabilitation Section (W.H., E.R.B., F.I., D.D., R.F.S.-G., L.G.C.), Clinical Trials Unit (G.N.), Office of the Clinical Director, and Section of Infections of the Nervous System (E.B., B.W., A.N.), National Institute of Neurological Disorders and Stroke, NIH, Bethesda, MD
| | - Leonardo G Cohen
- From the Human Cortical Physiology and Neurorehabilitation Section (W.H., E.R.B., F.I., D.D., R.F.S.-G., L.G.C.), Clinical Trials Unit (G.N.), Office of the Clinical Director, and Section of Infections of the Nervous System (E.B., B.W., A.N.), National Institute of Neurological Disorders and Stroke, NIH, Bethesda, MD
| |
Collapse
|
3
|
Carter GA, Hoffman P. Discourse coherence modulates use of predictive processing during sentence comprehension. Cognition 2024; 242:105637. [PMID: 37857052 DOI: 10.1016/j.cognition.2023.105637] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Revised: 04/13/2023] [Accepted: 10/05/2023] [Indexed: 10/21/2023]
Abstract
Context has been shown to be vitally important for comprehension. Lexical processing is facilitated when words are highly predictable given their local sentence context, suggesting that people pre-activate likely upcoming words to aid comprehension. However, this facilitation is affected by knowledge about the global context in which comprehension takes place: people predict less when in an environment where expectations are frequently violated. The current study investigated whether discourse coherence is an additional cue that comprehenders use to modulate lexical prediction. In a series of online, self-paced reading experiments, participants read target sentences preceded by short contextual preambles. Local facilitation effects were manipulated through the cloze probability of a critical word within the target sentence and discourse coherence was manipulated by varying the degree to which the target sentence was consistent with the information presented in the preamble. In the first two experiments, target sentences were read more slowly when they occurred in less coherent discourses, but no local facilitation effects were observed. In the third experiment, we strengthened the predictability manipulation by using semantically anomalous critical words. In this experiment, predictable words were processed more quickly and anomalous words more slowly when they occurred in highly coherent discourse. Our results suggest that comprehenders are sensitive to shifts in the topic of discourse and that they downregulate predictive processing when they encounter incoherence in the discourse. This is consistent with recent theoretical accounts suggesting that comprehenders flexibly engage in predictive processing, pre-activating semantic and lexical information less when their expectations are less likely to be reliable.
Collapse
Affiliation(s)
- Georgia-Ann Carter
- Institute for Language, Cognition and Computation, School of Informatics; University of Edinburgh, UK.
| | - Paul Hoffman
- School of Philosophy, Psychology and Language Sciences; University of Edinburgh, UK
| |
Collapse
|
4
|
Haywood D, Baughman FD, Mullan BA, Heslop KR. Neurocognitive Artificial Neural Network Models Are Superior to Linear Models at Accounting for Dimensional Psychopathology. Brain Sci 2022; 12:1060. [PMID: 36009123 PMCID: PMC9405994 DOI: 10.3390/brainsci12081060] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Revised: 08/03/2022] [Accepted: 08/09/2022] [Indexed: 11/16/2022] Open
Abstract
In recent years, there has been debate about the optimal conceptualisation of psychopathology. Structural models of psychopathology have been developed to counter issues, including comorbidity and poor diagnostic stability prevalent within the traditional nosological approach. Regardless of the conceptualisation of psychological dysfunction, deficits in neurocognitive abilities have been claimed to be an aetiological feature of psychopathology. Explorations of the association between neurocognition and psychopathology have typically taken a linear approach, overlooking the potential interactive dynamics of neurocognitive abilities. Previously, we proposed a multidimensional hypothesis, where within-person interactions between neurocognitive domains are fundamental to understanding the role of neurocognition within psychopathology. In this study, we used previously collected psychopathology data for 400 participants on psychopathological symptoms, substance use, and performance on eight neurocognitive tasks and compared the predictive accuracy of linear models to artificial neural network models. The artificial neural network models were significantly more accurate than the traditional linear models at predicting actual (a) lower-level and (b) high-level dimensional psychopathology. These results provide support for the multidimensional hypothesis: that the study of non-linear interactions and compensatory neurocognitive profiles are integral to understanding the functional associations between neurocognition and of psychopathology.
Collapse
Affiliation(s)
- Darren Haywood
- St. Vincent’s Hospital Melbourne, Mental Health, Fitzroy, VIC 3065, Australia
- School of Population Health, Curtin University, Bentley, WA 6102, Australia
- EnAble Institute, Curtin University, Bentley, WA 6102, Australia
| | - Frank D. Baughman
- School of Population Health, Curtin University, Bentley, WA 6102, Australia
| | - Barbara A. Mullan
- School of Population Health, Curtin University, Bentley, WA 6102, Australia
- EnAble Institute, Curtin University, Bentley, WA 6102, Australia
| | - Karen R. Heslop
- Curtin School of Nursing, Curtin University, Bentley, WA 6102, Australia
| |
Collapse
|
5
|
Balestrucci P, Wiebusch D, Ernst MO. ReActLab: A Custom Framework for Sensorimotor Experiments “in-the-wild”. Front Psychol 2022; 13:906643. [PMID: 35800945 PMCID: PMC9254679 DOI: 10.3389/fpsyg.2022.906643] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Accepted: 05/26/2022] [Indexed: 11/16/2022] Open
Abstract
Over the last few years online platforms for running psychology experiments beyond simple questionnaires and surveys have become increasingly popular. This trend has especially increased after many laboratory facilities had to temporarily avoid in-person data collection following COVID-19-related lockdown regulations. Yet, while offering a valid alternative to in-person experiments in many cases, platforms for online experiments are still not a viable solution for a large part of human-based behavioral research. Two situations in particular pose challenges: First, when the research question requires design features or participant interaction which exceed the customization capability provided by the online platform; and second, when variation among hardware characteristics between participants results in an inadmissible confounding factor. To mitigate the effects of these limitations, we developed ReActLab (Remote Action Laboratory), a framework for programming remote, browser-based experiments using freely available and open-source JavaScript libraries. Since the experiment is run entirely within the browser, our framework allows for portability to any operating system and many devices. In our case, we tested our approach by running experiments using only a specific model of Android tablet. Using ReActLab with this standardized hardware allowed us to optimize our experimental design for our research questions, as well as collect data outside of laboratory facilities without introducing setup variation among participants. In this paper, we describe our framework and show examples of two different experiments carried out with it: one consisting of a visuomotor adaptation task, the other of a visual localization task. Through comparison with results obtained from similar tasks in in-person laboratory settings, we discuss the advantages and limitations for developing browser-based experiments using our framework.
Collapse
|
6
|
Haywood D, Baughman FD, Mullan BA, Heslop KR. What Accounts for the Factors of Psychopathology? An Investigation of the Neurocognitive Correlates of Internalising, Externalising, and the p-Factor. Brain Sci 2022; 12:brainsci12040421. [PMID: 35447951 PMCID: PMC9030002 DOI: 10.3390/brainsci12040421] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2022] [Revised: 03/11/2022] [Accepted: 03/20/2022] [Indexed: 11/16/2022] Open
Abstract
Neurocognitive deficits have been consistently associated with a wide range of psychopathology and are proposed to not only be a consequence of the development of psychopathology but also directly involved in its aetiology. However, there is no clear understanding of what neurocognitive processes are particularly important to mental health. In this paper, we explored the association between neurocognitive abilities and the factors derived from structural models of psychopathology. Four hundred participants from a representative community sample completed measures of symptomology and substance use, as well as 8 neurocognitive tasks. We found a correlated-factors model, with internalising and externalising as the higher-order factors, and a single-factor model with only the p-factor, to be good fits for the data. Tasks that measured the speed of processing were significantly associated with internalising, externalising, and the p-factor, and accounted for significant amounts of unique variance in the factors after accounting for the common variance of the other tasks. Tasks that measured working memory, shifting, and inhibition were not significantly associated with psychopathology factors. Our findings suggest that neurocognitive abilities may not be differentially associated with psychopathology factors, but that speed of processing is a common correlate of the factors. We emphasise the importance of examining neurocognitive abilities and psychopathology on the individual level.
Collapse
Affiliation(s)
- Darren Haywood
- Discipline of Psychology, School of Population Health, Curtin University, Perth 6845, Australia or (D.H.); (F.D.B.)
- Mental Health, St. Vincent’s Hospital, Melbourne 3065, Australia
| | - Frank D. Baughman
- Discipline of Psychology, School of Population Health, Curtin University, Perth 6845, Australia or (D.H.); (F.D.B.)
| | - Barbara A. Mullan
- Discipline of Psychology, School of Population Health, Curtin University, Perth 6845, Australia or (D.H.); (F.D.B.)
- Correspondence:
| | - Karen R. Heslop
- Curtin School of Nursing, Curtin University, Perth 6845, Australia;
| |
Collapse
|
7
|
Listman JB, Tsay JS, Kim HE, Mackey WE, Heeger DJ. Long-Term Motor Learning in the "Wild" With High Volume Video Game Data. Front Hum Neurosci 2021; 15:777779. [PMID: 34987368 PMCID: PMC8720934 DOI: 10.3389/fnhum.2021.777779] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Accepted: 11/25/2021] [Indexed: 01/12/2023] Open
Abstract
Motor learning occurs over long periods of practice during which motor acuity, the ability to execute actions more accurately, precisely, and in less time, improves. Laboratory-based studies of motor learning are typically limited to a small number of participants and a time frame of minutes to several hours per participant. There is a need to assess the generalizability of theories and findings from lab-based motor learning studies on larger samples and time scales. In addition, laboratory-based studies of motor learning use relatively simple motor tasks which participants are unlikely to be intrinsically motivated to learn, limiting the interpretation of their findings in more ecologically valid settings ("in the wild"). We studied the acquisition and longitudinal refinement of a complex sensorimotor skill embodied in a first-person shooter video game scenario, with a large sample size (N = 7174, 682,564 repeats of the 60 s game) over a period of months. Participants voluntarily practiced the gaming scenario for up to several hours per day up to 100 days. We found improvement in performance accuracy (quantified as hit rate) was modest over time but motor acuity (quantified as hits per second) improved considerably, with 40-60% retention from 1 day to the next. We observed steady improvements in motor acuity across multiple days of video game practice, unlike most motor learning tasks studied in the lab that hit a performance ceiling rather quickly. Learning rate was a non-linear function of baseline performance level, amount of daily practice, and to a lesser extent, number of days between practice sessions. In addition, we found that the benefit of additional practice on any given day was non-monotonic; the greatest improvements in motor acuity were evident with about an hour of practice and 90% of the learning benefit was achieved by practicing 30 min per day. Taken together, these results provide a proof-of-concept in studying motor skill acquisition outside the confines of the traditional laboratory, in the presence of unmeasured confounds, and provide new insights into how a complex motor skill is acquired in an ecologically valid setting and refined across much longer time scales than typically explored.
Collapse
Affiliation(s)
| | - Jonathan S. Tsay
- Department of Psychology, University of California, Berkeley, Berkeley, CA, United States
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, United States
| | - Hyosub E. Kim
- Department of Physical Therapy, University of Delaware, Newark, DE, United States
- Department of Psychological and Brain Sciences, University of Delaware, Newark, DE, United States
| | | | | |
Collapse
|