1
|
Papoutselou E, Harrison S, Mai G, Buck B, Patil N, Wiggins I, Hartley D. Investigating mother-child inter-brain synchrony in a naturalistic paradigm: A functional near infrared spectroscopy (fNIRS) hyperscanning study. Eur J Neurosci 2024; 59:1386-1403. [PMID: 38155106 DOI: 10.1111/ejn.16233] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 11/27/2023] [Accepted: 12/01/2023] [Indexed: 12/30/2023]
Abstract
Successful social interactions between mothers and children are hypothesised to play a significant role in a child's social, cognitive and language development. Earlier research has confirmed, through structured experimental paradigms, that these interactions could be underpinned by coordinated neural activity. Nevertheless, the extent of neural synchrony during real-life, ecologically valid interactions between mothers and their children remains largely unexplored. In this study, we investigated mother-child inter-brain synchrony using a naturalistic free-play paradigm. We also examined the relationship between neural synchrony, verbal communication patterns and personality traits to further understand the underpinnings of brain synchrony. Twelve children aged between 3 and 5 years old and their mothers participated in this study. Neural synchrony in mother-child dyads were measured bilaterally over frontal and temporal areas using functional Near Infra-red Spectroscopy (fNIRS) whilst the dyads were asked to play with child-friendly toys together (interactive condition) and separately (independent condition). Communication patterns were captured via video recordings and conversational turns were coded. Compared to the independent condition, mother-child dyads showed increased neural synchrony in the interactive condition across the prefrontal cortex and temporo-parietal junction. There was no significant relationship found between neural synchrony and turn-taking and between neural synchrony and the personality traits of each member of the dyad. Overall, we demonstrate the feasibility of measuring inter-brain synchrony between mothers and children in a naturalistic environment. These findings can inform future study designs to assess inter-brain synchrony between parents and pre-lingual children and/or children with communication needs.
Collapse
Affiliation(s)
- Efstratia Papoutselou
- Hearing Sciences, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Nottingham, UK
- Nottingham Biomedical Research Centre (BRC), National Institute for Health Research (NIHR), Nottingham, UK
| | - Samantha Harrison
- Hearing Sciences, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Nottingham, UK
- Nottingham Biomedical Research Centre (BRC), National Institute for Health Research (NIHR), Nottingham, UK
| | - Guangting Mai
- Hearing Sciences, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Nottingham, UK
- Nottingham Biomedical Research Centre (BRC), National Institute for Health Research (NIHR), Nottingham, UK
| | - Bryony Buck
- Hearing Sciences - Scottish Section, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Nottingham, UK
| | - Nikita Patil
- Nottingham Biomedical Research Centre (BRC), National Institute for Health Research (NIHR), Nottingham, UK
- School of Medicine, University of Nottingham, Nottingham, UK
| | - Ian Wiggins
- Hearing Sciences, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Nottingham, UK
- Nottingham Biomedical Research Centre (BRC), National Institute for Health Research (NIHR), Nottingham, UK
| | - Douglas Hartley
- Hearing Sciences, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Nottingham, UK
- Nottingham Biomedical Research Centre (BRC), National Institute for Health Research (NIHR), Nottingham, UK
- Nottingham University Hospitals NHS Trust, Queen's Medical Centre, Nottingham, UK
| |
Collapse
|
2
|
Zhao Q, Zhao W, Lu C, Du H, Chi P. Interpersonal neural synchronization during social interactions in close relationships: A systematic review and meta-analysis of fNIRS hyperscanning studies. Neurosci Biobehav Rev 2024; 158:105565. [PMID: 38295965 DOI: 10.1016/j.neubiorev.2024.105565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Revised: 01/21/2024] [Accepted: 01/25/2024] [Indexed: 02/09/2024]
Abstract
In recent years, researchers have used hyperscanning techniques to explore how brains interact during various human activities. These studies have revealed a phenomenon called interpersonal neural synchronization (INS), but little research has focused on the overall effect of INS in close relationships. To address this gap, this study aims to synthesize and analyze the existing literature on INS during social interactions in close relationships. We conducted a meta-analysis of 17 functional near-infrared spectroscopy (fNIRS) hyperscanning studies involving 1149 dyads participants, including romantic couples and parent-child dyads. The results revealed robust and consistent INS in the frontal, temporal, and parietal regions of the brain and found similar INS patterns in couples and parent-child studies, providing solid empirical evidence for the attachment theory. Moreover, the age of children and brain areas were significant predictors of the effect size in parent-child research. The developmental stage of children and the mismatched development of brain structures might be the crucial factors for the difference in neural performance in social and cognitive behaviors in parent-child dyads.
Collapse
Affiliation(s)
- Qi Zhao
- Department of Psychology, Faculty of Social Sciences, University of Macau, Macau 999078, Macau Special Administrative Region of China; Center for Cognitive and Brain Sciences, University of Macau, Macau 999078, Macau Special Administrative Region of China
| | - Wan Zhao
- School of Psychology, Nanjing Normal University, Nanjing 210097, Jiangsu, China
| | - Chunming Lu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| | - Hongfei Du
- Department of Psychology, Beijing Normal University at Zhuhai, Zhuhai 519087, Guangdong, China; Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, China.
| | - Peilian Chi
- Department of Psychology, Faculty of Social Sciences, University of Macau, Macau 999078, Macau Special Administrative Region of China; Center for Cognitive and Brain Sciences, University of Macau, Macau 999078, Macau Special Administrative Region of China.
| |
Collapse
|
3
|
Liu Q, Zhu S, Zhou X, Liu F, Becker B, Kendrick KM, Zhao W. Mothers and fathers show different neural synchrony with their children during shared experiences. Neuroimage 2024; 288:120529. [PMID: 38301879 DOI: 10.1016/j.neuroimage.2024.120529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 01/09/2024] [Accepted: 01/29/2024] [Indexed: 02/03/2024] Open
Abstract
Parent-child shared experiences has an important influence on social development in children although contributions of mothers and fathers may differ. Neural synchronicity occurs between mothers and fathers and their children during social interactions but it is unclear whether they differ in this respect. We used data from simultaneous fNIRS hyperscanning in mothers (n = 33) and fathers (n = 29) and their children (3-4 years) to determine different patterns and strengths of neural synchronization in the frontal cortex during co-viewing of videos or free-play. Mothers showed greater synchrony with child than fathers during passive viewing of videos and the synchronization was positively associated with video complexity and negatively associated with parental stress. During play interactions, mothers showed more controlling behaviors over their child and greater evidence for joint gaze and joint imitation play with child whereas fathers spent more time gazing at other things. In addition, different aspects of child communication promoted neural synchrony between mothers and fathers and child during active play interactions. Overall, our findings indicate greater neural and behavioral synchrony between mothers than fathers and young children during passive or active shared experiences, although for both it was weakened by parental distress and child difficulty.
Collapse
Affiliation(s)
- Qi Liu
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, 611731, PR China
| | - Siyu Zhu
- School of Sport Training, Chengdu Sport University, Chengdu, 610041, PR China
| | - Xinqi Zhou
- Institute of Brain and Psychological Sciences, Sichuan Normal University, Chengdu, 610066, PR China
| | - Fang Liu
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for NeuroInformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 611731, PR China
| | - Benjamin Becker
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, 611731, PR China; The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for NeuroInformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 611731, PR China; The State Key Laboratory of Brain and Cognitive Sciences, The University of Hong Kong, Hong Kong, 999077, PR China
| | - Keith M Kendrick
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for NeuroInformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 611731, PR China.
| | - Weihua Zhao
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, 611731, PR China; The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for NeuroInformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 611731, PR China; Institute of Electronic and Information Engineering of UESTC in Guangdong, Dongguan, 523808, PR China.
| |
Collapse
|
4
|
Bornstein MH, Esposito G. Coregulation: A Multilevel Approach via Biology and Behavior. CHILDREN (BASEL, SWITZERLAND) 2023; 10:1323. [PMID: 37628322 PMCID: PMC10453544 DOI: 10.3390/children10081323] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/18/2023] [Revised: 07/23/2023] [Accepted: 07/28/2023] [Indexed: 08/27/2023]
Abstract
In this article, we explore the concept of coregulation, which encompasses the mutual adaptation between partners in response to one another's biology and behavior. Coregulation operates at both biological (hormonal and nervous system) and behavioral (affective and cognitive) levels and plays a crucial role in the development of self-regulation. Coregulation extends beyond the actions of individuals in a dyad and involves interactive contributions of both partners. We use as an example parent-child coregulation, which is pervasive and expected, as it emerges from shared genetic relatedness, cohabitation, continuous interaction, and the influence of common factors like culture, which facilitate interpersonal coregulation. We also highlight the emerging field of neural attunement, which investigates the coordination of brain-based neural activities between individuals, particularly in social interactions. Understanding the mechanisms and significance of neural attunement adds a new dimension to our understanding of coregulation and its implications for parent-child relationships and child development.
Collapse
Affiliation(s)
- Marc H. Bornstein
- Child and Family Research, Eunice Kennedy Shriver National Institute of Child Health and Human Development, National Institutes of Health, Bethesda, MD 20892, USA
| | - Gianluca Esposito
- Department of Psychology and Cognitive Science, University of Trento, 38068 Trento, Italy;
| |
Collapse
|
5
|
Abstract
This introduction aims to set out the potential as well as some of the pitfalls of the newly emerging area of the Social Neuroscience of Human Attachment (SoNeAt). To organize and interconnect the burgeoning empirical studies in this line of research, including those in this special issue, we outline a programmatic framework including an extension of our conceptual proposals NAMA and NAMDA to guide future research. We hope that this special issue will act as a stimulus for redoubling our efforts advancing the newly emerging SoNeAt area bridging attachment theory and social neuroscience.
Collapse
Affiliation(s)
- Lars White
- Department of Child and Adolescent Psychiatry, University of Leipzig, Leipzig, Germany
| | - Melanie Kungl
- Department of Psychology, Friedrich-Alexander-University, Erlangen-Nuremberg, Germany
| | - Pascal Vrticka
- Department of Psychology, University of Essex, Colchester, UK
| |
Collapse
|
6
|
Liu Y, Li J, Wang Q, Li Y. The specificity, situational modulations, and behavioral correlates of parent-child neural synchrony. Front Hum Neurosci 2022; 16:1000826. [PMID: 36438636 PMCID: PMC9682019 DOI: 10.3389/fnhum.2022.1000826] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Accepted: 10/19/2022] [Indexed: 11/03/2023] Open
Abstract
In recent years, aiming to uncover the neural mechanism of parent-child interaction and link it to the children's social development, a newly developed index, namely, parent-child inter-brain neural synchronization (INS) has attracted growing interest. Existing studies have mainly focused on three aspects of the INS; these are the specificity of the INS (i.e., stronger INS for parent-child dyads than stranger-child dyads), the situational modulations of the INS (i.e., how the valence of the situation or the types of interaction modulate INS), and the associations between the INS and the state-like behavioral tendencies or trait-like individual features of the parents and children. This review summarizes the existing findings in line with these three topics and provides preliminary suggestions to promote parent-child INS. In the meanwhile, the inconsistent findings and unstudied questions were discussed, opening new avenues for future studies.
Collapse
|
7
|
Bin Eid W, Lim M, Gabrieli G, Kölbel M, Halstead E, Esposito G, Dimitriou D. Habilitation of sleep problems among mothers and their children with autism spectrum disorder: Insights from multi-level exploratory dyadic analyses. FRONTIERS IN REHABILITATION SCIENCES 2022; 3:915060. [PMID: 36211831 PMCID: PMC9533106 DOI: 10.3389/fresc.2022.915060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Accepted: 08/29/2022] [Indexed: 11/13/2022]
Abstract
Few habilitation strategies for children with autism spectrum disorder (ASD) consider their sleep-related problems. Together with the fact that caregivers of children with ASD also face issues with sleep, there may be yet-to-be uncovered relationships between caregiver-child sleep patterns and sleep quality, offering a key opportunity for clinicians to consider the needs of both child and caregiver in terms of sleep. 29 dyads of mothers and their children with ASD were recruited for this cohort study and both subjective (self-report questionnaires and sleep diaries) and objective (cortisol samples and actigraphy) measures of sleep were collected to investigate significant predictors of sleep quality. Comparative, correlational, and hierarchical analyses were conducted. Findings indicated that both mother and child experience sleep deprivation in terms of shorter sleep duration and poor sleep quality in terms of longer sleep onset latencies and a higher frequency of wake bouts. Exploratory hierarchical analyses also found that child-related sleep difficulties such as sleep disordered breathing and night waking significantly predict mothers' sleep quality, which may point to the bi-directional influence of mother-child sleep. Based on these findings, it is recommended that clinicians adopt a family systems perspective and consider the sleep environment of the household, particularly that of the caregiver and child, when designing interventions for sleep-related problems in ASD. Finally, there is a need for additional support to promote good quality sleep among caregivers of children with ASD to bolster out-of-clinic care.
Collapse
Affiliation(s)
- Wasmiah Bin Eid
- Sleep Education and Research Laboratory, UCL Institute of Education, London, UK
| | - Mengyu Lim
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore
| | - Giulio Gabrieli
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore
| | - Melanie Kölbel
- Sleep Education and Research Laboratory, UCL Institute of Education, London, UK
- Department of Developmental Neurosciences Unit, UCL Great Ormond Street Institute of Child Health, London, UK
| | - Elizabeth Halstead
- Sleep Education and Research Laboratory, UCL Institute of Education, London, UK
| | - Gianluca Esposito
- Affiliative Behaviour and Physiology Lab, Department of Psychology and Cognitive Science, University of Trento, Italy
| | - Dagmara Dimitriou
- Sleep Education and Research Laboratory, UCL Institute of Education, London, UK
| |
Collapse
|
8
|
Andrea B, Atiqah A, Gianluca E. Reproducible Inter-Personal Brain Coupling Measurements in Hyperscanning Settings With functional Near Infra-Red Spectroscopy. Neuroinformatics 2022; 20:665-675. [PMID: 34716564 DOI: 10.1007/s12021-021-09551-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/21/2021] [Indexed: 12/31/2022]
Abstract
Despite a huge advancement in neuroimaging techniques and growing importance of inter-personal brain research, few studies assess the most appropriate computational methods to measure brain-brain coupling. Here, we focus on the signal processing methods to detect brain-coupling in dyads. From a public dataset of functional Near Infra-Red Spectroscopy signals (N=24 dyads), we derived a synthetic control condition by randomization, we investigated the effectiveness of four most used signal similarity metrics: Cross Correlation, Mutual Information, Wavelet Coherence and Dynamic Time Warping. We also accounted for temporal variations between signals by allowing for misalignments up to a maximum lag. Starting from the observed effect sizes, computed in terms of Cohen's d, the power analysis indicated that a high sample size ([Formula: see text]) would be required to detect significant brain-coupling. We therefore discuss the need for specialized statistical approaches and propose bootstrap as an alternative method to avoid over-penalizing the results. In our settings, and based on bootstrap analyses, Cross Correlation and Dynamic Time Warping outperform Mutual Information and Wavelet Coherence for all considered maximum lags, with reproducible results. These results highlight the need to set specific guidelines as the high degree of customization of the signal processing procedures prevents the comparability between studies, their reproducibility and, ultimately, undermines the possibility of extracting new knowledge.
Collapse
Affiliation(s)
- Bizzego Andrea
- Department of Psychology and Cognitive Science, University of Trento, Trento, Italy
| | - Azhari Atiqah
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore, Singapore
| | - Esposito Gianluca
- Department of Psychology and Cognitive Science, University of Trento, Trento, Italy. .,Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore, Singapore. .,Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore.
| |
Collapse
|
9
|
Asymmetric Prefrontal Cortex Activation Associated with Mutual Gaze of Mothers and Children during Shared Play. Symmetry (Basel) 2022. [DOI: 10.3390/sym14050998] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023] Open
Abstract
Mother–child shared play provides rich opportunities for mutual symmetrical interactions that serve to foster bond formation in dyads. Mutual gaze, a symmetrical behaviour that occurs during direct eye contact between two partners, conveys important cues of social engagement, affect and attention. However, it is not known whether the prefrontal cortical areas responsible for higher-order social cognition of mothers and children likewise exhibit neural symmetry; that is, similarity in direction of neural activation in mothers and children. This study used functional Near-infrared Spectroscopy (fNIRS) hyperscanning on 22 pairs of mothers and their preschool-aged children as they engaged in a 10-min free-play session together. The play interaction was video recorded and instances of mutual gaze were coded for after the experiment. Multivariate linear regression analyses revealed that neural asymmetry occurred during mother–child mutual gaze, where mothers showed a deactivation of prefrontal activity whereas children showed an activation instead. Findings suggest that mothers and children may employ divergent prefrontal mechanisms when engaged in symmetrical behaviours such as mutual gaze. Future studies could ascertain whether the asymmetric nature of a parent–child relationship, or potential neurodevelopmental differences in social processing between adults and children, significantly contribute to this observation.
Collapse
|
10
|
Bizzego A, Azhari A, Esposito G. Assessing Computational Methods to Quantify Mother-Child Brain Synchrony in Naturalistic Settings Based on fNIRS Signals. Neuroinformatics 2021; 20:427-436. [PMID: 34845593 DOI: 10.1007/s12021-021-09558-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/18/2021] [Indexed: 11/29/2022]
Abstract
Mother-child brain-to-brain synchrony captures the temporal similarities in brain signals between dyadic partners, and has been shown to emerge during the display of joint behaviours. Despite the rise in the number of studies that investigate synchrony in naturalistic contexts, the use of varying methodological approaches to compute synchrony remains a central problem. When dyads engage in unstructured social interactions, the wide range of behavioural cues they display contribute to the use of varying lengths of signals to compute synchrony. The present functional Near-infrared Spectroscopy (fNIRS) study investigates how different methods to quantify brain signals during joint and non-joint portions of dyadic play affect the outcome of brain-to-brain synchrony. Three strategies to cope with unstructured data are tested and different signal lengths of 15, 20, 25, 30, 35, 40, 45s were used to determine the optimal method to sensitively capture synchrony. Results showed that using all available portions of the signals generated a greater number of less conservative results compared to the other two strategies, which were to compute the average synchrony for the joint and non-joint signals portions and to compute the difference between the average synchrony of joint and non-joint portions. From the different signal durations, only length portions of 25s to 35s generated significant results. These findings demonstrate that differences in computational approaches and signal lengths affect synchrony measurements and should be considered in naturalistic synchrony studies.
Collapse
Affiliation(s)
- Andrea Bizzego
- Department of Psychology and Cognitive Science, University of Trento, Rovereto, 38068, TN, Italy
| | - Atiqah Azhari
- Psychology Program, Nanyang Technological University, Singapore, 639818, Singapore
| | - Gianluca Esposito
- Department of Psychology and Cognitive Science, University of Trento, Rovereto, 38068, TN, Italy. .,Psychology Program, Nanyang Technological University, Singapore, 639818, Singapore. .,Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, 308232, Singapore.
| |
Collapse
|
11
|
Carollo A, Lim M, Aryadoust V, Esposito G. Interpersonal Synchrony in the Context of Caregiver-Child Interactions: A Document Co-citation Analysis. Front Psychol 2021; 12:701824. [PMID: 34393940 PMCID: PMC8355520 DOI: 10.3389/fpsyg.2021.701824] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Accepted: 06/24/2021] [Indexed: 11/13/2022] Open
Abstract
Social interactions accompany individuals throughout their whole lives. When examining the underlying mechanisms of social processes, dynamics of synchrony, coordination or attunement emerge between individuals at multiple levels. To identify the impactful publications that studied such mechanisms and establishing the trends that dynamically originated the available literature, the current study adopted a scientometric approach. A sample of 543 documents dated from 1971 to 2021 was derived from Scopus. Subsequently, a document co-citation analysis was conducted on 29,183 cited references to examine the patterns of co-citation among the documents. The resulting network consisted of 1,759 documents connected to each other by 5,011 links. Within the network, five major clusters were identified. The analysis of the content of the three major clusters-namely, "Behavioral synchrony," "Towards bio-behavioral synchrony," and "Neural attunement"-suggests an interest in studying attunement in social interactions at multiple levels of analysis, from behavioral to neural, by passing through the level of physiological coordination. Furthermore, although initial studies on synchrony focused mostly on parent-child interactions, new hyperscanning paradigms are allowing researchers to explore the role of biobehavioral synchrony in all social processes in a real-time and ecological fashion. Future potential pathways of research were also discussed.
Collapse
Affiliation(s)
- Alessandro Carollo
- Department of Psychology and Cognitive Science, University of Trento, Rovereto, Italy
| | - Mengyu Lim
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore, Singapore
| | - Vahid Aryadoust
- National Institute of Education, Nanyang Technological University, Singapore, Singapore
| | - Gianluca Esposito
- Department of Psychology and Cognitive Science, University of Trento, Rovereto, Italy
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore, Singapore
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
| |
Collapse
|
12
|
Bizzego A, Gabrieli G, Esposito G. Deep Neural Networks and Transfer Learning on a Multivariate Physiological Signal Dataset. Bioengineering (Basel) 2021; 8:35. [PMID: 33800842 PMCID: PMC8058952 DOI: 10.3390/bioengineering8030035] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2021] [Revised: 02/25/2021] [Accepted: 03/03/2021] [Indexed: 11/16/2022] Open
Abstract
While Deep Neural Networks (DNNs) and Transfer Learning (TL) have greatly contributed to several medical and clinical disciplines, the application to multivariate physiological datasets is still limited. Current examples mainly focus on one physiological signal and can only utilise applications that are customised for that specific measure, thus it limits the possibility of transferring the trained DNN to other domains. In this study, we composed a dataset (n=813) of six different types of physiological signals (Electrocardiogram, Electrodermal activity, Electromyogram, Photoplethysmogram, Respiration and Acceleration). Signals were collected from 232 subjects using four different acquisition devices. We used a DNN to classify the type of physiological signal and to demonstrate how the TL approach allows the exploitation of the efficiency of DNNs in other domains. After the DNN was trained to optimally classify the type of signal, the features that were automatically extracted by the DNN were used to classify the type of device used for the acquisition using a Support Vector Machine. The dataset, the code and the trained parameters of the DNN are made publicly available to encourage the adoption of DNN and TL in applications with multivariate physiological signals.
Collapse
Affiliation(s)
- Andrea Bizzego
- Department of Psychology and Cognitive Science, University of Trento, 38068 Rovereto (Trento), Italy;
| | - Giulio Gabrieli
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore 639798, Singapore;
| | - Gianluca Esposito
- Department of Psychology and Cognitive Science, University of Trento, 38068 Rovereto (Trento), Italy;
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore 639798, Singapore;
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore 639798, Singapore
| |
Collapse
|