1
|
Zhou T, Ye Y, Zhu Q, Vann W, Du J. Neural dynamics of delayed feedback in robot teleoperation: insights from fNIRS analysis. Front Hum Neurosci 2024; 18:1338453. [PMID: 38952645 PMCID: PMC11215083 DOI: 10.3389/fnhum.2024.1338453] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Accepted: 05/31/2024] [Indexed: 07/03/2024] Open
Abstract
Introduction As robot teleoperation increasingly becomes integral in executing tasks in distant, hazardous, or inaccessible environments, operational delays remain a significant obstacle. These delays, inherent in signal transmission and processing, adversely affect operator performance, particularly in tasks requiring precision and timeliness. While current research has made strides in mitigating these delays through advanced control strategies and training methods, a crucial gap persists in understanding the neurofunctional impacts of these delays and the efficacy of countermeasures from a cognitive perspective. Methods This study addresses the gap by leveraging functional Near-Infrared Spectroscopy (fNIRS) to examine the neurofunctional implications of simulated haptic feedback on cognitive activity and motor coordination under delayed conditions. In a human-subject experiment (N = 41), sensory feedback was manipulated to observe its influences on various brain regions of interest (ROIs) during teleoperation tasks. The fNIRS data provided a detailed assessment of cerebral activity, particularly in ROIs implicated in time perception and the execution of precise movements. Results Our results reveal that the anchoring condition, which provided immediate simulated haptic feedback with a delayed visual cue, significantly optimized neural functions related to time perception and motor coordination. This condition also improved motor performance compared to the asynchronous condition, where visual and haptic feedback were misaligned. Discussion These findings provide empirical evidence about the neurofunctional basis of the enhanced motor performance with simulated synthetic force feedback in the presence of teleoperation delays. The study highlights the potential for immediate haptic feedback to mitigate the adverse effects of operational delays, thereby improving the efficacy of teleoperation in critical applications.
Collapse
Affiliation(s)
- Tianyu Zhou
- The Informatics, Cobots and Intelligent Construction (ICIC) Lab, Department of Civil and Coastal Engineering, University of Florida, Gainesville, FL, United States
| | - Yang Ye
- The Informatics, Cobots and Intelligent Construction (ICIC) Lab, Department of Civil and Coastal Engineering, University of Florida, Gainesville, FL, United States
| | - Qi Zhu
- Communications Technology Laboratory, Public Safety Communications Research Division, Advanced Communications Research Group, National Institute of Standards and Technology, Boulder, CO, United States
| | - William Vann
- The Informatics, Cobots and Intelligent Construction (ICIC) Lab, Department of Civil and Coastal Engineering, University of Florida, Gainesville, FL, United States
| | - Jing Du
- The Informatics, Cobots and Intelligent Construction (ICIC) Lab, Department of Civil and Coastal Engineering, University of Florida, Gainesville, FL, United States
| |
Collapse
|
2
|
Krystecka K, Stanczyk M, Magnuski M, Szelag E, Szymaszek A. Aperiodic activity differences in individuals with high and low temporal processing efficiency. Brain Res Bull 2024:111010. [PMID: 38871258 DOI: 10.1016/j.brainresbull.2024.111010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Revised: 05/24/2024] [Accepted: 06/10/2024] [Indexed: 06/15/2024]
Abstract
It is known that Temporal Information Processing (TIP) underpins our cognitive functioning. Previous research has focused on the relationship between TIP efficiency and oscillatory brain activity, especially the gamma rhythm; however, non-oscillatory (aperiodic or 1/f) brain activity has often been missed. Recent studies have identified the 1/f component as being important for the functioning of the brain. Therefore, the current study aimed to verify whether TIP efficiency is associated with specific EEG resting state cortical activity patterns, including oscillatory and non-oscillatory (aperiodic) brain activities. To measure individual TIP efficiency, we used two behavioral tasks in which the participant judges the order of two sounds separated by millisecond intervals. Based on the above procedure, participants were classified into two groups with high and low TIP efficiency. Using cluster-based permutation analyses, we examined between-group differences in oscillatory and non-oscillatory (aperiodic) components across the 1-90Hz range. The results revealed that the groups differed in the aperiodic component across the 30-80Hz range in fronto-central topography. In other words, participants with low TIP efficiency exhibited higher levels of aperiodic activity, and thus a flatter frequency spectrum compared to those with high TIP efficiency. We conclude that participants with low TIP efficiency display higher levels of 'neural noise', which is associated with poorer quality and speed of neural processing.
Collapse
Affiliation(s)
- Klaudia Krystecka
- Nencki Institute of Experimental Biology, Polish Academy of Sciences, Warsaw, Poland
| | - Magdalena Stanczyk
- Nencki Institute of Experimental Biology, Polish Academy of Sciences, Warsaw, Poland
| | - Mikolaj Magnuski
- Nencki Institute of Experimental Biology, Polish Academy of Sciences, Warsaw, Poland
| | - Elzbieta Szelag
- Nencki Institute of Experimental Biology, Polish Academy of Sciences, Warsaw, Poland
| | - Aneta Szymaszek
- Nencki Institute of Experimental Biology, Polish Academy of Sciences, Warsaw, Poland.
| |
Collapse
|
3
|
Lane JM, Merced-Nieves FM, Midya V, Liu SH, Martinez-Medina S, Wright RJ, Téllez-Rojo MM, Wright RO. Prenatal exposure to metal mixtures and childhood temporal processing in the PROGRESS Birth Cohort Study: Modification by childhood obesity. THE SCIENCE OF THE TOTAL ENVIRONMENT 2024; 917:170576. [PMID: 38309331 PMCID: PMC10922956 DOI: 10.1016/j.scitotenv.2024.170576] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 01/27/2024] [Accepted: 01/28/2024] [Indexed: 02/05/2024]
Abstract
Children are frequently exposed to various biological trace metals, some essential for their development, while others can be potent neurotoxicants. Furthermore, the inflammatory and metabolic conditions associated with obesity may interact with and amplify the impact of metal exposure on neurodevelopment. However, few studies have assessed the potential modification effect of body mass index (BMI). As a result, we investigated the role of child BMI phenotype on the relationship between prenatal exposure to metal mixtures and temporal processing. Leveraging the PROGRESS birth cohort in Mexico City, children (N = 563) aged 6-9 years completed a Temporal Response Differentiation (TRD) task where they had to hold a lever down for 10-14 s. Blood and urinary metal (As, Pb, Cd, and Mn) measurements were collected from mothers in the 2nd and 3rd trimesters. Child BMI z-scores were dichotomized to normal (between -2 and +0.99) and high (≥1.00). Covariate-adjusted weighted quantile sum (WQS) regression models were used to estimate and examine the combined effect of metal biomarkers (i.e., blood and urine) on TRD measures. Effect modification by the child's BMI was evaluated using 2-way interaction terms. Children with a high BMI and greater exposure to the metal mixture during prenatal development exhibited significant temporal processing deficits compared to children with a normal BMI. Notably, children with increased exposure to the metal mixture and higher BMI had a decrease in the percent of tasks completed (β = -10.13; 95 % CI: -19.84, -0.42), number of average holds (β = -2.15; 95 % CI: -3.88, -0.41), longer latency (β = 0.78; 95 % CI: 0.13, 1.44), and greater variability in the standard deviation of the total hold time (β = 2.08; 95 % CI: 0.34, 3.82) compared to normal BMI children. These findings implicate that high BMI may amplify the effect of metals on children's temporal processing. Understanding the relationship between metal exposures, temporal processing, and childhood obesity can provide valuable insights for developing targeted environmental interventions.
Collapse
Affiliation(s)
- Jamil M Lane
- Department of Environmental Medicine and Public Health, Icahn School of Medicine at Mount Sinai, New York, NY, USA.
| | - Francheska M Merced-Nieves
- Department of Environmental Medicine and Public Health, Icahn School of Medicine at Mount Sinai, New York, NY, USA; Department of Pediatrics, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Vishal Midya
- Department of Environmental Medicine and Public Health, Icahn School of Medicine at Mount Sinai, New York, NY, USA; Institute for Exposomic Research, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Shelley H Liu
- Department of Population Health Science and Policy, Icahn School of Medicine at Mount Sinai, USA
| | - Sandra Martinez-Medina
- Division of Community Interventions Research, National Institute of Perinatology, Mexico City, Mexico
| | - Rosalind J Wright
- Department of Environmental Medicine and Public Health, Icahn School of Medicine at Mount Sinai, New York, NY, USA; Department of Pediatrics, Icahn School of Medicine at Mount Sinai, New York, NY, USA; Institute for Exposomic Research, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Martha M Téllez-Rojo
- Center for Nutrition and Health Research, National Institute of Public Health, Cuernavaca, Morelos, Mexico
| | - Robert O Wright
- Department of Environmental Medicine and Public Health, Icahn School of Medicine at Mount Sinai, New York, NY, USA; Institute for Exposomic Research, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| |
Collapse
|
4
|
Wiener M. Coordinate-Based Meta-Analyses of the Time Perception Network. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2024; 1455:215-226. [PMID: 38918354 DOI: 10.1007/978-3-031-60183-5_12] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/27/2024]
Abstract
The study of time perception has advanced over the past three decades to include numerous neuroimaging studies, most notably including the use of functional Magnetic Resonance Imaging (fMRI). Yet, with this increase in studies, there comes the desire to draw broader conclusions across datasets about the nature and instantiation of time in the human brain. In the absence of collating individual studies together, the field has employed the use of Coordinate-Based Meta-Analyses (CBMA), in which foci from individual studies are modeled as probability distributions within the brain, from which common areas of activation-likelihood are determined. This chapter provides an overview of these CBMA studies, the methods they employ, the conclusions drawn by them, and where future areas of inquiry lie. The result of this survey suggests the existence of a domain-general "timing network" that can be used both as a guide for individual neuroimaging studies and as a template for future meta-analyses.
Collapse
|
5
|
Stanczyk M, Szelag E, Krystecka K, Szymaszek A. A common timing mechanism across different millisecond domains: evidence from perceptual and motor tasks. Sci Rep 2023; 13:21052. [PMID: 38030683 PMCID: PMC10687244 DOI: 10.1038/s41598-023-48238-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Accepted: 11/23/2023] [Indexed: 12/01/2023] Open
Abstract
Temporal information processing (TIP) constitutes a complex construct that underlies many cognitive functions and operates in a few hierarchically ordered time domains. This study aimed to verify the relationship between the tens of milliseconds and hundreds of milliseconds domains, referring to perceptual and motor timing, respectively. Sixty four young healthy individuals participated in this study. They underwent two auditory temporal order judgement tasks to assess their performance in the tens of milliseconds domain; on this basis, groups of high-level performers (HLP) and low-level performers (LLP) were identified. Then, a maximum tapping task was used to evaluate performance in the hundreds of milliseconds domain. The most remarkable result was that HLP achieved a faster tapping rate and synchronised quicker with their "internal clock" during the tapping task than did LLP. This result shows that there is a relationship between accuracy in judging temporally asynchronous stimuli and ability to achieve and maintain the pace of a movement adequate to one's internal pacemaker. This could indicate the strong contribution of a common timing mechanism, responsible for temporal organisation and coordination of behaviours across different millisecond domains.
Collapse
Affiliation(s)
- Magdalena Stanczyk
- Nencki Institute of Experimental Biology, Polish Academy of Sciences, Warsaw, Poland
| | - Elzbieta Szelag
- Nencki Institute of Experimental Biology, Polish Academy of Sciences, Warsaw, Poland
| | - Klaudia Krystecka
- Nencki Institute of Experimental Biology, Polish Academy of Sciences, Warsaw, Poland
| | - Aneta Szymaszek
- Nencki Institute of Experimental Biology, Polish Academy of Sciences, Warsaw, Poland.
| |
Collapse
|
6
|
Hinault T, D'Argembeau A, Bowler DM, La Corte V, Desaunay P, Provasi J, Platel H, Tran The J, Charretier L, Giersch A, Droit-Volet S. Time processing in neurological and psychiatric conditions. Neurosci Biobehav Rev 2023; 154:105430. [PMID: 37871780 DOI: 10.1016/j.neubiorev.2023.105430] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Revised: 10/18/2023] [Accepted: 10/19/2023] [Indexed: 10/25/2023]
Abstract
A central question in understanding cognition and pathology-related cognitive changes is how we process time. However, time processing difficulties across several neurological and psychiatric conditions remain seldom investigated. The aim of this review is to develop a unifying taxonomy of time processing, and a neuropsychological perspective on temporal difficulties. Four main temporal judgments are discussed: duration processing, simultaneity and synchrony, passage of time, and mental time travel. We present an integrated theoretical framework of timing difficulties across psychiatric and neurological conditions based on selected patient populations. This framework provides new mechanistic insights on both (a) the processes involved in each temporal judgement, and (b) temporal difficulties across pathologies. By identifying underlying transdiagnostic time-processing mechanisms, this framework opens fruitful avenues for future research.
Collapse
Affiliation(s)
- Thomas Hinault
- Normandie Univ, UNICAEN, PSL Research University, EPHE, INSERM, U1077, CHU de Caen, GIP Cyceron, Neuropsychologie et Imagerie de la Mémoire Humaine, 14032 Caen, France.
| | - Arnaud D'Argembeau
- Psychology and Neuroscience of Cognition Research Unit, University of Liège, F.R.S-FNRS, 4000 Liège, Belgium
| | - Dermot M Bowler
- Autism Research Group, City, University of London, EC1V 0HB London, United Kingdom
| | - Valentina La Corte
- Laboratoire Mémoire, Cerveau et Cognition (MC2Lab), UR 7536, Université de Paris cité, 92774 Boulogne-Billancourt, France; Institut Universitaire de France, 75231 Paris, France
| | - Pierre Desaunay
- Normandie Univ, UNICAEN, PSL Research University, EPHE, INSERM, U1077, CHU de Caen, GIP Cyceron, Neuropsychologie et Imagerie de la Mémoire Humaine, 14032 Caen, France; Service de Psychiatrie de l'enfant et de l'adolescent, CHU de Caen, 14000 Caen, France
| | - Joelle Provasi
- CHArt laboratory (Human and Artificial Cognition), EPHE-PSL, 75014 Paris, France
| | - Hervé Platel
- Normandie Univ, UNICAEN, PSL Research University, EPHE, INSERM, U1077, CHU de Caen, GIP Cyceron, Neuropsychologie et Imagerie de la Mémoire Humaine, 14032 Caen, France
| | - Jessica Tran The
- Normandie Univ, UNICAEN, PSL Research University, EPHE, INSERM, U1077, CHU de Caen, GIP Cyceron, Neuropsychologie et Imagerie de la Mémoire Humaine, 14032 Caen, France
| | - Laura Charretier
- Normandie Univ, UNICAEN, PSL Research University, EPHE, INSERM, U1077, CHU de Caen, GIP Cyceron, Neuropsychologie et Imagerie de la Mémoire Humaine, 14032 Caen, France
| | - Anne Giersch
- Cognitive Neuropsychology and Pathophysiology of Schizophrenia Laboratory, National Institute of Health and Medical Research, University of Strasbourg, 67081 Strasbourg, France
| | - Sylvie Droit-Volet
- Université Clermont Auvergne, LAPSCO, CNRS, UMR 6024, 60032 Clermont-Ferrand, France
| |
Collapse
|