1
|
Kim Y, Han I, Jung J, Yang S, Lee S, Koo B, Ahn S, Nam Y, Song SH. Measurements of Electrodermal Activity, Tissue Oxygen Saturation, and Visual Analog Scale for Different Cuff Pressures. Sensors (Basel) 2024; 24:917. [PMID: 38339639 PMCID: PMC10857413 DOI: 10.3390/s24030917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Revised: 01/29/2024] [Accepted: 01/30/2024] [Indexed: 02/12/2024]
Abstract
The quantification of comfort in binding parts, essential human-machine interfaces (HMI) for the functioning of rehabilitation robots, is necessary to reduce physical strain on the user despite great achievements in their structure and control. This study aims to investigate the physiological impacts of binding parts by measuring electrodermal activity (EDA) and tissue oxygen saturation (StO2). In Experiment 1, EDA was measured from 13 healthy subjects under three different pressure conditions (10, 20, and 30 kPa) for 1 min using a pneumatic cuff on the right thigh. In Experiment 2, EDA and StO2 were measured from 10 healthy subjects for 5 min. To analyze the correlation between EDA parameters and the decrease in StO2, a survey using the visual analog scale (VAS) was conducted to assess the level of discomfort at each pressure. The EDA signal was decomposed into phasic and tonic components, and the EDA parameters were extracted from these two components. RM ANOVA and a post hoc paired t-test were used to determine significant differences in parameters as the pressure increased. The results showed that EDA parameters and the decrease in StO2 significantly increased with the pressure increase. Among the extracted parameters, the decrease in StO2 and the mean SCL proved to be effective indicators. Such analysis outcomes would be highly beneficial for studies focusing on the comfort assessment of the binding parts of rehabilitation robots.
Collapse
Affiliation(s)
- Youngho Kim
- Department of Biomedical Engineering, Yonsei University, Wonju 26493, Republic of Korea; (I.H.); (J.J.); (S.Y.); (S.L.); (B.K.)
| | - Incheol Han
- Department of Biomedical Engineering, Yonsei University, Wonju 26493, Republic of Korea; (I.H.); (J.J.); (S.Y.); (S.L.); (B.K.)
| | - Jeyong Jung
- Department of Biomedical Engineering, Yonsei University, Wonju 26493, Republic of Korea; (I.H.); (J.J.); (S.Y.); (S.L.); (B.K.)
| | - Sumin Yang
- Department of Biomedical Engineering, Yonsei University, Wonju 26493, Republic of Korea; (I.H.); (J.J.); (S.Y.); (S.L.); (B.K.)
| | - Seunghee Lee
- Department of Biomedical Engineering, Yonsei University, Wonju 26493, Republic of Korea; (I.H.); (J.J.); (S.Y.); (S.L.); (B.K.)
| | - Bummo Koo
- Department of Biomedical Engineering, Yonsei University, Wonju 26493, Republic of Korea; (I.H.); (J.J.); (S.Y.); (S.L.); (B.K.)
| | - Soonjae Ahn
- Institute of Smart Rehabilitation Engineering and Assistive Technology, Dong-Eui University, Busan 47340, Republic of Korea;
| | - Yejin Nam
- Department of Clinical Development, Angel Robotics, Seoul 04798, Republic of Korea;
| | - Sung-Hyuk Song
- Department of Robotics & Mechatronics, Korea Institute of Machinery & Materials, Daejeon 34103, Republic of Korea;
| |
Collapse
|
2
|
Arabian H, Abdulbaki Alshirbaji T, Schmid R, Wagner-Hartl V, Chase JG, Moeller K. Harnessing Wearable Devices for Emotional Intelligence: Therapeutic Applications in Digital Health. Sensors (Basel) 2023; 23:8092. [PMID: 37836923 PMCID: PMC10575398 DOI: 10.3390/s23198092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/10/2023] [Revised: 09/25/2023] [Accepted: 09/26/2023] [Indexed: 10/15/2023]
Abstract
Emotional intelligence strives to bridge the gap between human and machine interactions. The application of such systems varies and is becoming more prominent as healthcare services seek to provide more efficient care by utilizing smart digital health apps. One application in digital health is the incorporation of emotion recognition systems as a tool for therapeutic interventions. To this end, a system is designed to collect and analyze physiological signal data, such as electrodermal activity (EDA) and electrocardiogram (ECG), from smart wearable devices. The data are collected from different subjects of varying ages taking part in a study on emotion induction methods. The obtained signals are processed to identify stimulus trigger instances and classify the different reaction stages, as well as arousal strength, using signal processing and machine learning techniques. The reaction stages are identified using a support vector machine algorithm, while the arousal strength is classified using the ResNet50 network architecture. The findings indicate that the EDA signal effectively identifies the emotional trigger, registering a root mean squared error (RMSE) of 0.9871. The features collected from the ECG signal show efficient emotion detection with 94.19% accuracy. However, arousal strength classification is only able to reach 60.37% accuracy on the given dataset. The proposed system effectively detects emotional reactions and can categorize their arousal strength in response to specific stimuli. Such a system could be integrated into therapeutic settings to monitor patients' emotional responses during therapy sessions. This real-time feedback can guide therapists in adjusting their strategies or interventions.
Collapse
Affiliation(s)
- Herag Arabian
- Institute of Technical Medicine (ITeM), Furtwangen University, 78054 Villingen-Schwenningen, Germany
| | - Tamer Abdulbaki Alshirbaji
- Institute of Technical Medicine (ITeM), Furtwangen University, 78054 Villingen-Schwenningen, Germany
- Innovation Center Computer Assisted Surgery (ICCAS), University of Leipzig, 04103 Leipzig, Germany
| | - Ramona Schmid
- Department of Industrial Technologies, Campus Tuttlingen Furtwangen University, 78532 Tuttlingen, Germany
| | - Verena Wagner-Hartl
- Institute of Technical Medicine (ITeM), Furtwangen University, 78054 Villingen-Schwenningen, Germany
- Department of Industrial Technologies, Campus Tuttlingen Furtwangen University, 78532 Tuttlingen, Germany
| | - J Geoffrey Chase
- Department of Mechanical Engineering, University of Canterbury, Christchurch 8041, New Zealand
| | - Knut Moeller
- Institute of Technical Medicine (ITeM), Furtwangen University, 78054 Villingen-Schwenningen, Germany
- Department of Mechanical Engineering, University of Canterbury, Christchurch 8041, New Zealand
| |
Collapse
|
3
|
Randjelovic V. Interactive slide selection algorithm and machine learning in psychophysiological memory testing. Physiol Meas 2023; 44. [PMID: 36716504 DOI: 10.1088/1361-6579/acb756] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Accepted: 01/30/2023] [Indexed: 01/31/2023]
Abstract
Objective. To present a new type of concealed information test (CIT) that implements the interactive slide selection (ISS) algorithm and compare its effectiveness with a standard CIT (sCIT).Approach. The ISS algorithm presents slides interactively, based on the analysis of electrodermal activity, while sCIT presents slides in a predefined, sequential order. The algorithm automatically selects irrelevant, relevant, and control slides and presents them at the moment which is physiologically most suitable for electrodermal response detection. To compare the ISS-based CIT (issCIT) and sCIT, two objects, a bag, and a wallet, were presented to 64 participants, 32 of whomwere analyzed with sCIT, and another 32 with issCIT.Main results. The results show that ISS had significantly better true/false predictions (Fisher's exact test,p< 0.01). Also, the number of false positives (FPs) was significantly lower in the issCIT group in comparison with sCIT (Fisher's exact test,p< 0.001). Machine learning (ML) classifiers improved precision from 49% to 79% in the sCIT group (McNemar's test,p< 0.05), and from 85% to 100% in the issCIT group (McNemar's test,p< 0.05). The testing time in the issCIT group ranged between 42 and 107 s, while the average was 53 s. In the sCIT group, the testing time was always 330 s.Significance. Under the presented experimental settings, the ISS algorithm obtained significantly better classification results compared to sCIT, while the application of the ML algorithms managed to improve the classification results in both groups reaching a precision of 100%. The ISS algorithm allowed for a much shorter testing time compared to sCIT.
Collapse
|
4
|
Markiewicz R, Markiewicz-Gospodarek A, Dobrowolska B. Galvanic Skin Response Features in Psychiatry and Mental Disorders: A Narrative Review. Int J Environ Res Public Health 2022; 19:13428. [PMID: 36294009 PMCID: PMC9603244 DOI: 10.3390/ijerph192013428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Revised: 10/05/2022] [Accepted: 10/14/2022] [Indexed: 06/16/2023]
Abstract
This narrative review is aimed at presenting the galvanic skin response (GSR) Biofeedback method and possibilities for its application in persons with mental disorders as a modern form of neurorehabilitation. In the treatment of mental disorders of various backgrounds and courses, attention is focused on methods that would combine pharmacological treatment with therapies improving functioning. Currently, the focus is on neuronal mechanisms which, being physiological markers, offer opportunities for correction of existing deficits. One such indicator is electrodermal activity (EDA), providing information about emotions, cognitive processes, and behavior, and thus, about the function of various brain regions. Measurement of the galvanic skin response (GSR), both skin conductance level (SCL) and skin conductance responses (SCR), is used in diagnostics and treatment of mental disorders, and the training method itself, based on GSR Biofeedback, allows for modulation of the emotional state depending on needs occurring. Summary: It is relatively probable that neurorehabilitation based on GSR-BF is a method worth noticing, which-in the future-can represent an interesting area of rehabilitation supplementing a comprehensive treatment for people with mental disorders.
Collapse
Affiliation(s)
- Renata Markiewicz
- Department of Neurology, Neurological and Psychiatric Nursing, Medical University of Lublin, 20-093 Lublin, Poland
| | | | - Beata Dobrowolska
- Department of Holistic Care and Management in Nursing, Medical University of Lublin, 20-081 Lublin, Poland
| |
Collapse
|
5
|
Tourunen A, Nyman-Salonen P, Muotka J, Penttonen M, Seikkula J, Kykyri VL. Associations Between Sympathetic Nervous System Synchrony, Movement Synchrony, and Speech in Couple Therapy. Front Psychol 2022; 13:818356. [PMID: 35360617 PMCID: PMC8961511 DOI: 10.3389/fpsyg.2022.818356] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Accepted: 02/03/2022] [Indexed: 11/13/2022] Open
Abstract
Background Research on interpersonal synchrony has mostly focused on a single modality, and hence little is known about the connections between different types of social attunement. In this study, the relationship between sympathetic nervous system synchrony, movement synchrony, and the amount of speech were studied in couple therapy. Methods Data comprised 12 couple therapy cases (24 clients and 10 therapists working in pairs as co-therapists). Synchrony in electrodermal activity, head and body movement, and the amount of speech and simultaneous speech during the sessions were analyzed in 12 sessions at the start of couple therapy (all 72 dyads) and eight sessions at the end of therapy (48 dyads). Synchrony was calculated from cross-correlations using time lags and compared to segment-shuffled pseudo synchrony. The associations between the synchrony modalities and speech were analyzed using complex modeling (Mplus). Findings Couple therapy participants' synchrony mostly occurred in-phase (positive synchrony). Anti-phase (negative) synchrony was more common in movement than in sympathetic nervous system activity. Synchrony in sympathetic nervous system activity only correlated with movement synchrony between the client-therapist dyads (r = 0.66 body synchrony, r = 0.59 head synchrony). Movement synchrony and the amount of speech correlated negatively between spouses (r = -0.62 body synchrony, r = -0.47 head synchrony) and co-therapists (r = -0.39 body synchrony, r = -0.28 head synchrony), meaning that the more time the dyad members talked during the session, the less bodily synchrony they exhibited. Conclusion The different roles and relationships in couple therapy were associated with the extent to which synchrony modalities were linked with each other. In the relationship between clients and therapists, synchrony in arousal levels and movement "walked hand in hand", whereas in the other relationships (spouse or colleague) they were not linked. Generally, more talk time by the therapy participants was associated with anti-phase movement synchrony. If, as suggested, emotions prepare us for motor action, an important finding of this study is that sympathetic nervous system activity can also synchronize with that of others independently of motor action.
Collapse
Affiliation(s)
- Anu Tourunen
- Department of Psychology, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, Finland
| | - Petra Nyman-Salonen
- Department of Psychology, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, Finland
- Department of Social Sciences and Philosophy, Faculty of Humanities and Social Sciences, University of Jyväskylä, Jyväskylä, Finland
| | - Joona Muotka
- Department of Psychology, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, Finland
| | - Markku Penttonen
- Department of Psychology, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, Finland
| | - Jaakko Seikkula
- Department of Psychology, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, Finland
- Faculty of Health and Sport Sciences, University of Agder, Kristiansand, Norway
| | - Virpi-Liisa Kykyri
- Department of Psychology, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, Finland
- Faculty of Social Sciences, Tampere University, Tampere, Finland
| |
Collapse
|
6
|
Fu D, Incio-Serra N, Motta-Ochoa R, Blain-Moraes S. Interpersonal Physiological Synchrony for Detecting Moments of Connection in Persons With Dementia: A Pilot Study. Front Psychol 2021; 12:749710. [PMID: 34966322 PMCID: PMC8711588 DOI: 10.3389/fpsyg.2021.749710] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Accepted: 11/17/2021] [Indexed: 11/13/2022] Open
Abstract
Interpersonal physiological synchrony has been successfully used to characterize social interactions and social processes during a variety of interpersonal interactions. There are a handful of measures of interpersonal physiological synchrony, but those that exist have only been validated on able-bodied adults. Here, we present a novel information-theory based measure of interpersonal physiological synchrony-normalized Symbolic Transfer Entropy (NSTE)-and compare its performance with a popular physiological synchrony measure-physiological concordance and single session index (SSI). Using wearable sensors, we measured the electrodermal activity (EDA) of five individuals with dementia and six able-bodied individuals as they participated in a movement activity that aimed to foster connection in persons with dementia. We calculated time-resolved NSTE and SSI measures for case studies of three dyads and compared them against moments of observed interpersonal connection in video recordings of the activity. Our findings suggest that NSTE-based measures of interpersonal physiological synchrony may provide additional advantages over SSI, including resolving moments of ambiguous SSI and providing information about the direction of information flow between participants. This study also investigated the feasibility of using interpersonal synchrony to gain insight into moments of connection experienced by individuals with dementia and further encourages exploration of these measures in other populations with reduced communicative abilities.
Collapse
Affiliation(s)
- Dannie Fu
- Biosignal Interaction and Personhood Technology (BIAPT) Lab, McGill University, Montreal, QC, Canada
- Department of Biomedical Engineering, McGill University, Faculty of Medicine, Montreal, QC, Canada
| | - Natalia Incio-Serra
- Biosignal Interaction and Personhood Technology (BIAPT) Lab, McGill University, Montreal, QC, Canada
| | - Rossio Motta-Ochoa
- Biosignal Interaction and Personhood Technology (BIAPT) Lab, McGill University, Montreal, QC, Canada
| | - Stefanie Blain-Moraes
- Biosignal Interaction and Personhood Technology (BIAPT) Lab, McGill University, Montreal, QC, Canada
- School of Physical and Occupational Therapy, Faculty of Medicine and Health Sciences, Montreal, QC, Canada
| |
Collapse
|
7
|
Mourtakos S, Vassiliou G, Kontoangelos K, Papageorgiou C, Philippou A, Bersimis F, Geladas N, Koutsilieris M, Sidossis LS, Tsirmpas C, Papageorgiou C, Yiannopoulou KG. Assessment of Resilience of the Hellenic Navy Seals by Electrodermal Activity during Cognitive Tasks. Int J Environ Res Public Health 2021; 18:4384. [PMID: 33924253 DOI: 10.3390/ijerph18084384] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 03/17/2021] [Revised: 04/07/2021] [Accepted: 04/16/2021] [Indexed: 11/17/2022]
Abstract
Stress resilience plays a key role in task performance during emergencies, especially in occupations like military special forces, with a routine consisting of unexpected events. Nevertheless, reliable and applicable measurements of resilience in predicting task performance in stressful conditions are still researched. This study aimed to explore the stress response in the Hellenic Navy SEALs (HN-SEALs), using a cognitive–physiological approach. Eighteen candidates under intense preparation for their enlistment in the HN-SEALs and 16 healthy controls (HCs) underwent Stroop tests, along with mental-state and personality examination. Simultaneously, electrodermal activity (EDA) was assessed during each one of cognitive testing procedures. Compared to healthy control values, multiple components of EDA values were found decreased (p < 0.05) in the HN-SEALs group. These results were associated with an increase in resilience level in the HN-SEALs group, since a restricted sympathetic reactivity according to the reduced EDA values was observed during the stressful cognitive testing. This is the first report providing physiological measurements of the sympathetic response of HN-SEALs to a stressful situation and suggests that EDA turns out to be a simple and objective tool of sympathetic activation and it may be used as a complementary index of resilience in HN-SEALs candidates.
Collapse
|
8
|
Carli V, Hadlaczky G, Petros NG, Iosue M, Zeppegno P, Gramaglia C, Amore M, Baca-Garcia E, Batra A, Cosman D, Courtet P, Di Sciascio G, Ekstrand J, Galfalvy H, Gusmão R, Jesus C, Heitor MJ, Constante M, Rad PM, Saiz PA, Wojnar M, Sarchiapone M. A Naturalistic, European Multi-Center Clinical Study of Electrodermal Reactivity and Suicide Risk Among Patients With Depression. Front Psychiatry 2021; 12:765128. [PMID: 35069276 PMCID: PMC8766803 DOI: 10.3389/fpsyt.2021.765128] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/26/2021] [Accepted: 11/11/2021] [Indexed: 11/26/2022] Open
Abstract
Background: Electrodermal hyporeactivity has been proposed as a marker of suicidal risk. The EUDOR-A study investigated the prevalence of electrodermal hyporeactivity among patients with depression and its association with attempted and completed suicide. Methods: Between August 2014 and March 2016, 1,573 in- and outpatients with a primary diagnosis of depression (active or remission phase) were recruited at 15 European psychiatric centers. Each patient was followed-up for 1 year. Electrodermal activity was assessed at baseline with the ElectroDermal Orienting Reactivity Test. Data on the sociodemographic characteristics, clinical diagnoses, and treatment of the subjects were also collected. The severity of the depressive symptoms was assessed through the Montgomery-Asberg Depression Rating Scale. Information regarding number, time, and method of suicide attempts was gathered at baseline and at the end of the 1-year follow-up. The same data were collected in case of completed suicide. Results: Hyporeactive patients were shown to be significantly more at risk of suicide attempt compared to reactive patients, both at baseline and follow-up. A sensitivity of 29.86% and a positive predictive value (PPV) of 46.77% were found for attempted suicide at baseline, while a sensitivity of 35.36% and a PPV of 8.92% were found for attempted suicide at follow-up. The sensitivity and PPV for completed suicide were 25.00 and 0.61%, respectively. However, when controlled for suicide attempt at baseline, the association between hyporeactivity and follow-up suicide attempt was no longer significant. The low number of completed suicides did not allow any analysis.
Collapse
Affiliation(s)
- Vladimir Carli
- National Centre for Suicide Research and Prevention of Mental Ill-Health (NASP), Karolinska Institute, Stockholm, Sweden
| | - Gergo Hadlaczky
- National Centre for Suicide Research and Prevention of Mental Ill-Health (NASP), Karolinska Institute, Stockholm, Sweden
| | - Nuhamin Gebrewold Petros
- National Centre for Suicide Research and Prevention of Mental Ill-Health (NASP), Karolinska Institute, Stockholm, Sweden
| | - Miriam Iosue
- National Centre for Suicide Research and Prevention of Mental Ill-Health (NASP), Karolinska Institute, Stockholm, Sweden
| | - Patrizia Zeppegno
- Department of Translational Medicine, Azienda Ospedaliero Universitaria Maggiore della Carità, University of Piemonte Orientale, Novara, Italy
| | - Carla Gramaglia
- Department of Translational Medicine, Azienda Ospedaliero Universitaria Maggiore della Carità, University of Piemonte Orientale, Novara, Italy
| | - Mario Amore
- Clinica Psichiatrica, DINOGMI, University of Genoa, Genoa, Italy
| | - Enrique Baca-Garcia
- Department of Psychiatry, Fundacion Jimenez Diaz University Hospital, Autonomous University of Madrid, Madrid, Spain
| | - Anil Batra
- Department of Psychiatry and Psychotherapy, University Hospital of Tuebingen, Tuebingen, Germany
| | - Doina Cosman
- Clinical Psychology and Mental Health Department, Iuliu Hatieganu University of Medicine and Pharmacy, Cluj-Napoca, Romania
| | - Philippe Courtet
- Department of Emergency Psychiatry and Acute Care, University Hospital of Montpellier, Montpellier, France
| | | | - Joakim Ekstrand
- Department of Psychiatry, Institute of Clinical Sciences, Lund University, Lund, Sweden
| | - Hanga Galfalvy
- Department of Psychiatry, Columbia University Medical Center, New York, NY, United States
| | - Ricardo Gusmão
- Department of Psychiatry, Hospital Egas Moniz, Centro Hospitalar de Lisboa Ocidental (CHLO), Lisbon, Portugal.,Instituto de Saúde Pública, Universidade Do Porto (ISPUP), Porto, Portugal
| | - Catarina Jesus
- Department of Psychiatry, Hospital Egas Moniz, Centro Hospitalar de Lisboa Ocidental (CHLO), Lisbon, Portugal
| | | | - Miguel Constante
- Psychiatry Service, Hospital Beatriz Ângelo (HBA), Loures, Portugal
| | - Pouya Movahed Rad
- Department of Psychiatry, Institute of Clinical Sciences, Lund University, Lund, Sweden
| | - Pilar A Saiz
- Department of Psychiatry, Biomedical Research Networking Centre in Mental Health (CIBERSAM), Instituto de Investigación Sanitaria del Principado de Asturias (ISPA), Mental Health Services of Principado de Asturias (SESPA), University of Oviedo, Oviedo, Spain
| | - Marcin Wojnar
- Department of Psychiatry, Medical University of Warsaw, Warsaw, Poland
| | - Marco Sarchiapone
- Department of Medicine and Health Sciences, University of Molise, Campobasso, Italy
| |
Collapse
|
9
|
Sargent A, Watson J, Ye H, Suri R, Ayaz H. Neuroergonomic Assessment of Hot Beverage Preparation and Consumption: An EEG and EDA Study. Front Hum Neurosci 2020; 14:175. [PMID: 32499688 PMCID: PMC7242644 DOI: 10.3389/fnhum.2020.00175] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2019] [Accepted: 04/20/2020] [Indexed: 12/22/2022] Open
Abstract
Neuroergonomics is an emerging field that investigates the human brain about behavioral performance in natural environments and everyday settings. This study investigated the body and brain activity correlates of a typical daily activity, hot beverage preparation, and consumption in a realistic office environment where participants performed natural daily tasks. Using wearable, battery operated and wireless Electroencephalogram (EEG) and Electrodermal activity (EDA) sensors, neural and physiological responses were measured in untethered, freely moving participants who prepared hot beverages using two different machines (a market leader and follower as determined by annual US sales). They later consumed the drinks they had prepared in three blocks. Emotional valence was estimated using frontal asymmetry in EEG alpha band power and emotional arousal was estimated from EDA tonic and phasic activity. Results from 26 participants showed that the market-leading coffee machine was more efficient to use based on self-reports, behavioral performance measures, and there were significant within-subject differences in valence between the two machine use. Moreover, the market leader user interface led to greater self-reported product preference, which was further supported by significant differences in measured arousal and valence (EDA and EEG, respectively) during coffee production and consumption. This is the first study that uses a multimodal and comprehensive assessment of coffee machine use and beverage consumption in a naturalistic work environment. Approaches described in this study can be adapted in the future to other task-specific machine usability and consumer neuroscience studies.
Collapse
Affiliation(s)
- Amanda Sargent
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA, United States
| | - Jan Watson
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA, United States
| | - Hongjun Ye
- Lebow College of Business, Drexel University, Philadelphia, PA, United States
| | - Rajneesh Suri
- Lebow College of Business, Drexel University, Philadelphia, PA, United States.,Drexel Solutions Institute, Drexel University, Philadelphia, PA, United States
| | - Hasan Ayaz
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA, United States.,Drexel Solutions Institute, Drexel University, Philadelphia, PA, United States.,Department of Psychology, College of Arts and Sciences, Drexel University, Philadelphia, PA, United States.,Department of Family and Community Health, University of Pennsylvania, Philadelphia, PA, United States.,Center for Injury Research and Prevention, Children's Hospital of Philadelphia, Philadelphia, PA, United States
| |
Collapse
|
10
|
Al Machot F, Elmachot A, Ali M, Al Machot E, Kyamakya K. A Deep-Learning Model for Subject-Independent Human Emotion Recognition Using Electrodermal Activity Sensors. Sensors (Basel) 2019; 19:E1659. [PMID: 30959956 DOI: 10.3390/s19071659] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/14/2019] [Revised: 03/31/2019] [Accepted: 04/03/2019] [Indexed: 11/16/2022]
Abstract
One of the main objectives of Active and Assisted Living (AAL) environments is to ensure that elderly and/or disabled people perform/live well in their immediate environments; this can be monitored by among others the recognition of emotions based on non-highly intrusive sensors such as Electrodermal Activity (EDA) sensors. However, designing a learning system or building a machine-learning model to recognize human emotions while training the system on a specific group of persons and testing the system on a totally a new group of persons is still a serious challenge in the field, as it is possible that the second testing group of persons may have different emotion patterns. Accordingly, the purpose of this paper is to contribute to the field of human emotion recognition by proposing a Convolutional Neural Network (CNN) architecture which ensures promising robustness-related results for both subject-dependent and subject-independent human emotion recognition. The CNN model has been trained using a grid search technique which is a model hyperparameter optimization technique to fine-tune the parameters of the proposed CNN architecture. The overall concept’s performance is validated and stress-tested by using MAHNOB and DEAP datasets. The results demonstrate a promising robustness improvement regarding various evaluation metrics. We could increase the accuracy for subject-independent classification to 78% and 82% for MAHNOB and DEAP respectively and to 81% and 85% subject-dependent classification for MAHNOB and DEAP respectively (4 classes/labels). The work shows clearly that while using solely the non-intrusive EDA sensors a robust classification of human emotion is possible even without involving additional/other physiological signals.
Collapse
|
11
|
Ferguson BJ, Hamlin T, Lantz JF, Villavicencio T, Coles J, Beversdorf DQ. Examining the Association Between Electrodermal Activity and Problem Behavior in Severe Autism Spectrum Disorder: A Feasibility Study. Front Psychiatry 2019; 10:654. [PMID: 31572238 PMCID: PMC6749070 DOI: 10.3389/fpsyt.2019.00654] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/01/2019] [Accepted: 08/14/2019] [Indexed: 12/28/2022] Open
Abstract
Background: Many individuals with autism spectrum disorder (ASD) engage in problem behavior, presenting significant challenges for those providing care and services for this population. Psychophysiological measures of arousal, such as electrodermal activity (EDA), may provide an early indication of subsequent problem behavior. However, variability in EDA patterns associated with behaviors may limit this predictive ability. Methods: EDA data was sampled from eight individuals with severe ASD in a naturalistic setting, while participating in educational programming in a school setting at a residential facility for severely affected individuals with developmental disabilities, to examine variability in EDA patterns. Results: An anticipatory rise in EDA only occurred 60% of the time prior to the problem behavior. Additionally, EDA after a problem behavior returned to median baseline levels only 45% of the time. Conclusions: Heterogeneity of EDA responses in those with the most severe forms of ASD will be an important consideration in future studies utilizing psychophysiological tools such as EDA to anticipate problem behavior, including the need for monitoring of return to baseline after problem behaviors. Incorporation of this consideration may lead to greater reliability of these approaches to help anticipate and manage problem behaviors.
Collapse
Affiliation(s)
- Bradley J Ferguson
- Department of Health Psychology, University of Missouri School of Health Professions, Columbia, MO, United States.,Thompson Center for Autism & Neurodevelopmental Disorders, University of Missouri, Columbia, MO, United States.,Department of Radiology, University of Missouri School of Medicine, Columbia, MO, United States
| | | | | | | | - John Coles
- The Center for Discovery, Harris, NY, United States.,CUBRC, Inc. Information Exploitation Sector, Buffalo, NY, United States.,Department of Industrial and Systems Engineering, University at Buffalo, Buffalo, NY, United States
| | - David Q Beversdorf
- Thompson Center for Autism & Neurodevelopmental Disorders, University of Missouri, Columbia, MO, United States.,Department of Radiology, University of Missouri School of Medicine, Columbia, MO, United States.,University of Missouri Departments of Neurology & Psychological Sciences, Columbia, MO, United States
| |
Collapse
|
12
|
Nabian M, Yin Y, Wormwood J, Quigley KS, Barrett LF, Ostadabbas S. An Open-Source Feature Extraction Tool for the Analysis of Peripheral Physiological Data. IEEE J Transl Eng Health Med 2018; 6:2800711. [PMID: 30443441 PMCID: PMC6231905 DOI: 10.1109/jtehm.2018.2878000] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/20/2018] [Revised: 09/05/2018] [Accepted: 10/22/2018] [Indexed: 11/09/2022]
Abstract
Electrocardiogram, electrodermal activity, electromyogram, continuous blood pressure, and impedance cardiography are among the most commonly used peripheral physiological signals (biosignals) in psychological studies and healthcare applications, including health tracking, sleep quality assessment, disease early-detection/diagnosis, and understanding human emotional and affective phenomena. This paper presents the development of a biosignal-specific processing toolbox (Bio-SP tool) for preprocessing and feature extraction of these physiological signals according to the state-of-the-art studies reported in the scientific literature and feedback received from the field experts. Our open-source Bio-SP tool is intended to assist researchers in affective computing, digital and mobile health, and telemedicine to extract relevant physiological patterns (i.e., features) from these biosignals semi-automatically and reliably. In this paper, we describe the successful algorithms used for signal-specific quality checking, artifact/noise filtering, and segmentation along with introducing features shown to be highly relevant to category discrimination in several healthcare applications (e.g., discriminating patterns associated with disease versus non-disease). Further, the Bio-SP tool is a publicly-available software written in MATLAB with a user-friendly graphical user interface (GUI), enabling future crowd-sourced modification to these tools. The GUI is compatible with MathWorks Classification Learner app for inference model development, such as model training, cross-validation scheme farming, and classification result computation.
Collapse
Affiliation(s)
- Mohsen Nabian
- Augmented Cognition LabElectrical and Computer Engineering DepartmentNortheastern UniversityBostonMA02115USA
- Harvard Medical SchoolBostonMA02115USA
| | - Yu Yin
- Augmented Cognition LabElectrical and Computer Engineering DepartmentNortheastern UniversityBostonMA02115USA
| | | | | | - Lisa F. Barrett
- Department of PsychologyNortheastern UniversityBostonMA02115USA
| | - Sarah Ostadabbas
- Augmented Cognition LabElectrical and Computer Engineering DepartmentNortheastern UniversityBostonMA02115USA
| |
Collapse
|
13
|
Reinsberger C, Sarkis R, Papadelis C, Doshi C, Perez DL, Baslet G, Loddenkemper T, Dworetzky BA. Autonomic changes in psychogenic nonepileptic seizures: toward a potential diagnostic biomarker? Clin EEG Neurosci 2015; 46:16-25. [PMID: 25780264 DOI: 10.1177/1550059414567739] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Disturbances of the autonomic nervous system (ANS) are common in neuropsychiatric disorders. Disease specific alterations of both sympathetic and parasympathetic activity can be assessed by heart rate variability (HRV), whereas electrodermal activity (EDA) can assess sympathetic activity. In posttraumatic stress disorder (PTSD), parasympathetic HRV parameters are typically decreased and EDA is increased, whereas in major depressive disorder (MDD) and dissociation, both parasympathetic and sympathetic markers are decreased. ANS abnormalities have also been identified in psychogenic nonepileptic seizures (PNES) by using HRV, indicating lower parasympathetic activity at baseline. In addition to reviewing the current literature on ANS abnormalities in PTSD, MDD, and disorders with prominent dissociation, including borderline personality disorder (BPD), this article also presents data from a pilot study on EDA in patients with PNES. Eleven patients with PNES, during an admission to our epilepsy monitoring unit (EMU), were compared with 9 with generalized tonic-clonic seizures (GTCS). The area under the EDA curve, the number of EDA responses lasting longer than 2 seconds, and the number of EDA surges during sleep (sympathetic sleep storms) were calculated on ictal and interictal days by an automated algorithm. EDA changes in PNES patients did not follow a systematic pattern of sympathetic hyperarousal (like EDA after GTCS) but were more variable. How specific PNES semiologies, and/or underlying neuropsychiatric disorders, may influence ictal and interictal EDA patterns, and lead to a novel diagnostic biomarker remains to be evaluated in future larger studies.
Collapse
Affiliation(s)
- Claus Reinsberger
- Edward B. Bromfield Epilepsy Center, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA Institute of Sports Medicine, University of Paderborn, Paderborn, Germany
| | - Rani Sarkis
- Edward B. Bromfield Epilepsy Center, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Christos Papadelis
- Division of Epilepsy and Clinical Neurophysiology, Department of Neurology, Boston Children's Hospital, Harvard Medical School, Boston, MA, USA
| | - Chiran Doshi
- Division of Epilepsy and Clinical Neurophysiology, Department of Neurology, Boston Children's Hospital, Harvard Medical School, Boston, MA, USA
| | - David L Perez
- Department of Psychiatry, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Gaston Baslet
- Edward B. Bromfield Epilepsy Center, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA Department of Psychiatry, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Tobias Loddenkemper
- Division of Epilepsy and Clinical Neurophysiology, Department of Neurology, Boston Children's Hospital, Harvard Medical School, Boston, MA, USA
| | - Barbara A Dworetzky
- Edward B. Bromfield Epilepsy Center, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|