1
|
Tang H, Lee BG, Towey D, Pike M. The Impact of Various Cockpit Display Interfaces on Novice Pilots' Mental Workload and Situational Awareness: A Comparative Study. Sensors (Basel) 2024; 24:2835. [PMID: 38732940 DOI: 10.3390/s24092835] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Revised: 04/21/2024] [Accepted: 04/26/2024] [Indexed: 05/13/2024]
Abstract
Future airspace is expected to become more congested with additional in-service cargo and commercial flights. Pilots will face additional burdens in such an environment, given the increasing number of factors that they must simultaneously consider while completing their work activities. Therefore, care and attention must be paid to the mental workload (MWL) experienced by operating pilots. If left unaddressed, a state of mental overload could affect the pilot's ability to complete his or her work activities in a safe and correct manner. This study examines the impact of two different cockpit display interfaces (CDIs), the Steam Gauge panel and the G1000 Glass panel, on novice pilots' MWL and situational awareness (SA) in a flight simulator-based setting. A combination of objective (EEG and HRV) and subjective (NASA-TLX) assessments is used to assess novice pilots' cognitive states during this study. Our results indicate that the gauge design of the CDI affects novice pilots' SA and MWL, with the G1000 Glass panel being more effective in reducing the MWL and improving SA compared with the Steam Gauge panel. The results of this study have implications for the design of future flight deck interfaces and the training of future pilots.
Collapse
Affiliation(s)
- Huimin Tang
- School of Computer Science, University of Nottingham Ningbo China, 199 Taikang East Road, Ningbo 315100, China
| | - Boon Giin Lee
- School of Computer Science, University of Nottingham Ningbo China, 199 Taikang East Road, Ningbo 315100, China
- Nottingham Ningbo China Beacons of Excellence Research and Innovation Institute, Ningbo 315101, China
| | - Dave Towey
- School of Computer Science, University of Nottingham Ningbo China, 199 Taikang East Road, Ningbo 315100, China
| | - Matthew Pike
- School of Computer Science, University of Nottingham Ningbo China, 199 Taikang East Road, Ningbo 315100, China
| |
Collapse
|
2
|
Korivand S, Galvani G, Ajoudani A, Gong J, Jalili N. Optimizing Human-Robot Teaming Performance through Q-Learning-Based Task Load Adjustment and Physiological Data Analysis. Sensors (Basel) 2024; 24:2817. [PMID: 38732923 DOI: 10.3390/s24092817] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Revised: 04/23/2024] [Accepted: 04/25/2024] [Indexed: 05/13/2024]
Abstract
The transition to Industry 4.0 and 5.0 underscores the need for integrating humans into manufacturing processes, shifting the focus towards customization and personalization rather than traditional mass production. However, human performance during task execution may vary. To ensure high human-robot teaming (HRT) performance, it is crucial to predict performance without negatively affecting task execution. Therefore, to predict performance indirectly, significant factors affecting human performance, such as engagement and task load (i.e., amount of cognitive, physical, and/or sensory resources required to perform a particular task), must be considered. Hence, we propose a framework to predict and maximize the HRT performance. For the prediction of task performance during the development phase, our methodology employs features extracted from physiological data as inputs. The labels for these predictions-categorized as accurate performance or inaccurate performance due to high/low task load-are meticulously crafted using a combination of the NASA TLX questionnaire, records of human performance in quality control tasks, and the application of Q-Learning to derive task-specific weights for the task load indices. This structured approach enables the deployment of our model to exclusively rely on physiological data for predicting performance, thereby achieving an accuracy rate of 95.45% in forecasting HRT performance. To maintain optimized HRT performance, this study further introduces a method of dynamically adjusting the robot's speed in the case of low performance. This strategic adjustment is designed to effectively balance the task load, thereby enhancing the efficiency of human-robot collaboration.
Collapse
Affiliation(s)
- Soroush Korivand
- Department of Mechanical Engineering, Southern Methodist University, Dallas, TX 75205, USA
| | - Gustavo Galvani
- Department of Mechanical Engineering, The University of Alabama, Tuscaloosa, AL 35487, USA
| | - Arash Ajoudani
- Human-Robot Interfaces and Physical Interaction Laboratory (HRI2), Istituto Italiano di Tecnologia, 16163 Genoa, Italy
| | - Jiaqi Gong
- Department of Computer Science, The University of Alabama, Tuscaloosa, AL 35487, USA
| | - Nader Jalili
- Department of Mechanical Engineering, Southern Methodist University, Dallas, TX 75205, USA
| |
Collapse
|
3
|
Li A, Li H, Yuan G. Continual Learning with Deep Neural Networks in Physiological Signal Data: A Survey. Healthcare (Basel) 2024; 12:155. [PMID: 38255045 PMCID: PMC10815736 DOI: 10.3390/healthcare12020155] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Revised: 12/30/2023] [Accepted: 01/07/2024] [Indexed: 01/24/2024] Open
Abstract
Deep-learning algorithms hold promise in processing physiological signal data, including electrocardiograms (ECGs) and electroencephalograms (EEGs). However, healthcare often requires long-term monitoring, posing a challenge to traditional deep-learning models. These models are generally trained once and then deployed, which limits their ability to adapt to the dynamic and evolving nature of healthcare scenarios. Continual learning-known for its adaptive learning capabilities over time-offers a promising solution to these challenges. However, there remains an absence of consolidated literature, which reviews the techniques, applications, and challenges of continual learning specific to physiological signal analysis, as well as its future directions. Bridging this gap, our review seeks to provide an overview of the prevailing techniques and their implications for smart healthcare. We delineate the evolution from traditional approaches to the paradigms of continual learning. We aim to offer insights into the challenges faced and outline potential paths forward. Our discussion emphasizes the need for benchmarks, adaptability, computational efficiency, and user-centric design in the development of future healthcare systems.
Collapse
Affiliation(s)
- Ao Li
- Electrical and Computer Engineering, The University of Arizona, Tucson, AZ 85721, USA;
- BIO5 Institute, The University of Arizona, Tucson, AZ 85721, USA
| | - Huayu Li
- Electrical and Computer Engineering, The University of Arizona, Tucson, AZ 85721, USA;
| | - Geng Yuan
- School of Computing, University of Georgia, Athens, GA 30602, USA;
| |
Collapse
|
4
|
Marocolo M, Mota GR, Rodrigues AB, Leite RCDM, Hohl R, Paixão RCD, Souza HLR, Meireles A, Arriel R. Unveiling Bias: Examining the Influence of Positive Results on Ergogenic Aids in Published Sports Science Studies. Sports Med Int Open 2024; 8:a21816798. [PMID: 38312926 PMCID: PMC10832574 DOI: 10.1055/a-2181-6798] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Accepted: 09/15/2023] [Indexed: 02/06/2024] Open
Abstract
We investigated the potential for publication bias in the field of sports science regarding studies on ergogenic aids and their effects on exercise performance. We found evidence to suggest that journals tend to prioritize studies with positive results (76%) while neglecting those with negative outcomes (2.7%). Worryingly, this could lead to a discrepancy between reported conclusions and actual study outcomes. We also identified inconsistencies between reported outcomes and actual performance variable outcomes. Taken together, these data highlight the need for future research to reduce bias and encourage the publication of studies with both positive and negative results to improve the reliability of scientific evidence in this field.
Collapse
Affiliation(s)
- Moacir Marocolo
- Department of Physiology, Institute of Biological Sciences, Federal
University of Juiz de Fora, Juiz de Fora, Brazil
| | - Gustavo R. Mota
- Department of Sports Science, Institute of Health Sciences, Federal
University of Triângulo Mineiro, Uberaba, Brazil
| | - Alex Batista Rodrigues
- Department of Physical Education and Sports, Federal University of Juiz
de Fora, Juiz de Fora, Brazil
| | - Roberto C. de Matos Leite
- Department of Physical Education and Sports, Federal University of Juiz
de Fora, Juiz de Fora, Brazil
| | - Rodrigo Hohl
- Department of Physiology, Institute of Biological Sciences, Federal
University of Juiz de Fora, Juiz de Fora, Brazil
| | - Rodney Coelho da Paixão
- Department of Physiology, Institute of Biological Sciences, Federal
University of Juiz de Fora, Juiz de Fora, Brazil
- Department of Physical Education and Physiotherapy, Federal University
of Uberlândia, Uberlândia, Brazil
| | - Hiago L. R. Souza
- Department of Physiology, Institute of Biological Sciences, Federal
University of Juiz de Fora, Juiz de Fora, Brazil
| | - Anderson Meireles
- Department of Physiology, Institute of Biological Sciences, Federal
University of Juiz de Fora, Juiz de Fora, Brazil
| | - Rhai Arriel
- Department of Physiology, Institute of Biological Sciences, Federal
University of Juiz de Fora, Juiz de Fora, Brazil
| |
Collapse
|
5
|
Zhang Y, Cao Y, Proctor RW, Liu Y. Emotional experiences of service robots' anthropomorphic appearance: a multimodal measurement method. Ergonomics 2023; 66:2039-2057. [PMID: 36803343 DOI: 10.1080/00140139.2023.2182751] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/03/2022] [Accepted: 02/14/2023] [Indexed: 06/18/2023]
Abstract
Anthropomorphic appearance is a key factor to affect users' attitudes and emotions. This research aimed to measure emotional experience caused by robots' anthropomorphic appearance with three levels - high, moderate, and low - using multimodal measurement. Fifty participants' physiological and eye-tracker data were recorded synchronously while they observed robot images that were displayed in random order. Afterward, the participants reported subjective emotional experiences and attitudes towards those robots. The results showed that the images of the moderately anthropomorphic service robots induced higher pleasure and arousal ratings, and yielded significantly larger pupil diameter and faster saccade velocity, than did the low or high robots. Moreover, participants' facial electromyography, skin conductance, and heart-rate responses were higher when observing moderately anthropomorphic service robots. An implication of the research is that service robots' appearance should be designed to be moderately anthropomorphic; too many human-like features or machine-like features may disturb users' positive emotions and attitudes.Practitioner Summary: This research aimed to measure emotional experience caused by three types of anthropomorphic service robots using a multimodal measurement experiment. The results showed that moderately anthropomorphic service robots evoked more positive emotion than high and low anthropomorphic robots. Too many human-like features or machine-like features may disturb users' positive emotions.
Collapse
Affiliation(s)
- Yun Zhang
- School of Economics and Management, Anhui Polytechnic University, Wuhu, P. R. China
| | - Yaqin Cao
- School of Economics and Management, Anhui Polytechnic University, Wuhu, P. R. China
| | - Robert W Proctor
- Department of Psychological Sciences, Purdue University, West Lafayette, USA
| | - Yu Liu
- School of Economics and Management, Anhui Polytechnic University, Wuhu, P. R. China
| |
Collapse
|
6
|
Yaseen A, Robertson C, Cruz Navarro J, Chen J, Heckler B, DeSantis SM, Temkin N, Barber J, Foreman B, Diaz-Arrastia R, Chesnut R, Manley GT, Wright DW, Vassar M, Ferguson AR, Markowitz AJ, Yamal JM. Integrating, Harmonizing, and Curating Studies With High-Frequency and Hourly Physiological Data: Proof of Concept from Seven Traumatic Brain Injury Data Sets. J Neurotrauma 2023; 40:2362-2375. [PMID: 37341031 DOI: 10.1089/neu.2023.0023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/22/2023] Open
Abstract
Research in severe traumatic brain injury (TBI) has historically been limited by studies with relatively small sample sizes that result in low power to detect small, yet clinically meaningful outcomes. Data sharing and integration from existing sources hold promise to yield larger more robust sample sizes that improve the potential signal and generalizability of important research questions. However, curation and harmonization of data of different types and of disparate provenance is challenging. We report our approach and experience integrating multiple TBI data sets containing collected physiological data, including both expected and unexpected challenges encountered in the integration process. Our harmonized data set included data on 1536 patients from the Citicoline Brain Injury Treatment Trial (COBRIT), Effect of erythropoietin and transfusion threshold on neurological recovery after traumatic brain injury: a randomized clinical trial (EPO Severe TBI), BEST-TRIP, Progesterone for the Treatment of Traumatic Brain Injury III Clinical Trial (ProTECT III), Transforming Research and Clinical Knowledge in Traumatic brain Injury (TRACK-TBI), Brain Oxygen Optimization in Severe Traumatic Brain Injury Phase-II (BOOST-2), and Ben Taub General Hospital (BTGH) Research Database studies. We conclude with process recommendations for data acquisition for future prospective studies to aid integration of these data with existing studies. These recommendations include using common data elements whenever possible, a standardized recording system for labeling and timing of high-frequency physiological data, and secondary use of studies in systems such as Federal Interagency Traumatic Brain Injury Research Informatics System (FITBIR), to engage investigators who collected the original data.
Collapse
Affiliation(s)
- Ashraf Yaseen
- Department of Biostatistics and Data Science, University of Texas Health Science Center at Houston School of Public Health, Houston, Texas, USA
| | - Claudia Robertson
- Department of Neurosurgery, and University of Washington, Seattle, Washington, USA
| | - Jovany Cruz Navarro
- Department of Anesthesiology Baylor College of Medicine, University of Washington, Seattle, Washington, USA
| | - Jingxiao Chen
- Department of Biostatistics and Data Science, University of Texas Health Science Center at Houston School of Public Health, Houston, Texas, USA
| | - Brian Heckler
- Department of Biostatistics and Data Science, University of Texas Health Science Center at Houston School of Public Health, Houston, Texas, USA
| | - Stacia M DeSantis
- Department of Biostatistics and Data Science, University of Texas Health Science Center at Houston School of Public Health, Houston, Texas, USA
| | - Nancy Temkin
- Department of Department of Neurological Surgery and Biostatistics, University of Washington, Seattle, Washington, USA
| | - Jason Barber
- Department of Neurological Surgery, Harborview Medical Center, University of Washington, Seattle, Washington, USA
| | - Brandon Foreman
- Department of Neurology and Rehabilitation Medicine, University of Cincinnati, Cincinnati, Ohio, USA
| | - Ramon Diaz-Arrastia
- Department of Neurology, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Randall Chesnut
- Department of Neurological Surgery, Harborview Medical Center, University of Washington, Seattle, Washington, USA
| | - Geoffrey T Manley
- Brain and Spinal Injury Center, University of California, San Francisco, San Francisco, Emory University School of Medicine, Atlanta, Georgia, USA
| | - David W Wright
- Department of Emergency Medicine, Emory University School of Medicine, Atlanta, Georgia, USA
| | - Mary Vassar
- Brain and Spinal Injury Center, University of California, San Francisco, San Francisco, Emory University School of Medicine, Atlanta, Georgia, USA
| | - Adam R Ferguson
- Brain and Spinal Injury Center, University of California, San Francisco, San Francisco, Emory University School of Medicine, Atlanta, Georgia, USA
| | - Amy J Markowitz
- Brain and Spinal Injury Center, University of California, San Francisco, San Francisco, Emory University School of Medicine, Atlanta, Georgia, USA
| | - Jose-Miguel Yamal
- Department of Biostatistics and Data Science, University of Texas Health Science Center at Houston School of Public Health, Houston, Texas, USA
| |
Collapse
|
7
|
Aguiló J, Moussaoui D, Chon K, Bailón R. Editorial: Robust, reliable, and continuous assessment in health: the challenge of wearable and remote technologies. Front Physiol 2023; 14:1281426. [PMID: 37772057 PMCID: PMC10523319 DOI: 10.3389/fphys.2023.1281426] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Accepted: 09/04/2023] [Indexed: 09/30/2023] Open
Affiliation(s)
- Jordi Aguiló
- Centro de Investigación Biomédica en Red, Madrid, Spain
- Universitat Autònoma de Barcelona, Barcelona, Spain
| | - Driss Moussaoui
- Ibn Rushd University Psychiatric Centre, Casablanca, Morocco
| | - Ki Chon
- University of Connecticut, Storrs, CT, United States
| | - Raquel Bailón
- Centro de Investigación Biomédica en Red, Madrid, Spain
- Universidad de Zaragoza, Zaragoza, Spain
| |
Collapse
|
8
|
Weale V, Love J, Clays E, Oakman J. Using EMA and Physiological Data to Explore the Relationship between Day-to-Day Occupational Stress, Musculoskeletal Pain and Mental Health among University Staff: A Study Protocol. Int J Environ Res Public Health 2023; 20:3526. [PMID: 36834221 PMCID: PMC9966642 DOI: 10.3390/ijerph20043526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Revised: 02/14/2023] [Accepted: 02/15/2023] [Indexed: 06/18/2023]
Abstract
Exposure to work-related stressors is associated with poor physical and mental health outcomes for workers. The role of chronic stressors on health outcomes has been explored, but less is known about the potential role of exposure to day-to-day stressors on health. This paper describes the protocol for a study that aims to collect and analyze day-to-day data on work-related stressors and health outcomes. Participants will be workers engaged in predominantly sedentary work at a university. Self-report data on work-related stressors, musculoskeletal pain, and mental health will be collected three times per day for 10 work days through ecological momentary assessment via online questionnaires. These data will be combined with physiological data collected continuously via a wristband throughout the working day. The feasibility and acceptability of the protocol will be assessed via semi-structured interviews with participants and adherence to the study protocol. These data will inform the feasibility of using the protocol in a larger study to investigate the relationship between exposure to work-related stressors and health outcomes.
Collapse
Affiliation(s)
- Victoria Weale
- Centre for Ergonomics and Human Factors, Department of Public Health, La Trobe University, Bundoora, VIC 3086, Australia
| | - Jasmine Love
- Centre for Ergonomics and Human Factors, Department of Public Health, La Trobe University, Bundoora, VIC 3086, Australia
- Judith Lumley Centre, School of Nursing and Midwifery, La Trobe University, Bundoora, VIC 3086, Australia
| | - Els Clays
- Department of Public Health and Primary Care, Ghent University, C. Heymanslaan 10, 9000 Ghent, Belgium
| | - Jodi Oakman
- Centre for Ergonomics and Human Factors, Department of Public Health, La Trobe University, Bundoora, VIC 3086, Australia
| |
Collapse
|
9
|
Isaieva K, Fauvel M, Weber N, Vuissoz PA, Felblinger J, Oster J, Odille F. A hardware and software system for MRI applications requiring external device data. Magn Reson Med 2022; 88:1406-1418. [PMID: 35506503 DOI: 10.1002/mrm.29280] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Revised: 04/07/2022] [Accepted: 04/07/2022] [Indexed: 01/22/2023]
Abstract
PURPOSE Numerous MRI applications require data from external devices. Such devices are often independent of the MRI system, so synchronizing these data with the MRI data is often tedious and limited to offline use. In this work, a hardware and software system is proposed for acquiring data from external devices during MR imaging, for use online (in real-time) or offline. METHODS The hardware includes a set of external devices - electrocardiography (ECG) devices, respiration sensors, microphone, electronics of the MR system etc. - using various channels for data transmission (analog, digital, optical fibers), all connected to a server through a universal serial bus (USB) hub. The software is based on a flexible client-server architecture, allowing real-time processing pipelines to be configured and executed. Communication protocols and data formats are proposed, in particular for transferring the external device data to an open-source reconstruction software (Gadgetron), for online image reconstruction using external physiological data. The system performance is evaluated in terms of accuracy of the recorded signals and delays involved in the real-time processing tasks. Its flexibility is shown with various applications. RESULTS The real-time system had low delays and jitters (on the order of 1 ms). Example MRI applications using external devices included: prospectively gated cardiac cine imaging, multi-modal acquisition of the vocal tract (image, sound, and respiration) and online image reconstruction with nonrigid motion correction. CONCLUSION The performance of the system and its versatile architecture make it suitable for a wide range of MRI applications requiring online or offline use of external device data.
Collapse
Affiliation(s)
- Karyna Isaieva
- IADI, Université de Lorraine, INSERM U1254, Nancy, France
| | - Marc Fauvel
- CIC-IT 1433, Université de Lorraine, INSERM, CHRU de Nancy, Nancy, France
| | - Nicolas Weber
- IADI, Université de Lorraine, INSERM U1254, Nancy, France
| | | | - Jacques Felblinger
- IADI, Université de Lorraine, INSERM U1254, Nancy, France.,CIC-IT 1433, Université de Lorraine, INSERM, CHRU de Nancy, Nancy, France
| | - Julien Oster
- IADI, Université de Lorraine, INSERM U1254, Nancy, France
| | - Freddy Odille
- IADI, Université de Lorraine, INSERM U1254, Nancy, France.,CIC-IT 1433, Université de Lorraine, INSERM, CHRU de Nancy, Nancy, France
| |
Collapse
|
10
|
Li X, Pinsky MR, Dubrawski A. Automated Assessment of Cardiovascular Sufficiency Using Non-Invasive Physiological Data. Sensors (Basel) 2022; 22:s22031024. [PMID: 35161770 PMCID: PMC8839064 DOI: 10.3390/s22031024] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Revised: 01/26/2022] [Accepted: 01/26/2022] [Indexed: 06/02/2023]
Abstract
For fluid resuscitation of critically ill individuals to be effective, it must be well calibrated in terms of timing and dosages of treatments. In current practice, the cardiovascular sufficiency of patients during fluid resuscitation is determined using primarily invasively measured vital signs, including Arterial Pressure and Mixed Venous Oxygen Saturation (SvO2), which may not be available in outside-of-hospital settings, particularly in the field when treating subjects injured in traffic accidents or wounded in combat where only non-invasive monitoring is available to drive care. In this paper, we propose (1) a Machine Learning (ML) approach to estimate the sufficiency utilizing features extracted from non-invasive vital signs and (2) a novel framework to address the detrimental impact of inter-patient diversity on the ability of ML models to generalize well to unseen subjects. Through comprehensive evaluation on the physiological data collected in laboratory animal experiments, we demonstrate that the proposed approaches can achieve competitive performance on new patients using only non-invasive measurements. These characteristics enable effective monitoring of fluid resuscitation in real-world acute settings with limited monitoring resources and can help facilitate broader adoption of ML in this important subfield of healthcare.
Collapse
Affiliation(s)
- Xinyu Li
- Auton Lab, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA;
| | - Michael R. Pinsky
- Department of Critical Care Medicine, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15213, USA;
| | - Artur Dubrawski
- Auton Lab, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA;
| |
Collapse
|
11
|
Liao YJ, Wang WC, Ruan SJ, Lee YH, Chen SC. A Music Playback Algorithm Based on Residual-Inception Blocks for Music Emotion Classification and Physiological Information. Sensors (Basel) 2022; 22:777. [PMID: 35161525 PMCID: PMC8839467 DOI: 10.3390/s22030777] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/13/2021] [Revised: 12/23/2021] [Accepted: 01/17/2022] [Indexed: 06/14/2023]
Abstract
Music can generate a positive effect in runners' performance and motivation. However, the practical implementation of music intervention during exercise is mostly absent from the literature. Therefore, this paper designs a playback sequence system for joggers by considering music emotion and physiological signals. This playback sequence is implemented by a music selection module that combines artificial intelligence techniques with physiological data and emotional music. In order to make the system operate for a long time, this paper improves the model and selection music module to achieve lower energy consumption. The proposed model obtains fewer FLOPs and parameters by using logarithm scaled Mel-spectrogram as input features. The accuracy, computational complexity, trainable parameters, and inference time are evaluated on the Bi-modal, 4Q emotion, and Soundtrack datasets. The experimental results show that the proposed model is better than that of Sarkar et al. and achieves competitive performance on Bi-modal (84.91%), 4Q emotion (92.04%), and Soundtrack (87.24%) datasets. More specifically, the proposed model reduces the computational complexity and inference time while maintaining the classification accuracy, compared to other models. Moreover, the size of the proposed model for network training is small, which can be applied to mobiles and other devices with limited computing resources. This study designed the overall playback sequence system by considering the relationship between music emotion and physiological situation during exercise. The playback sequence system can be adopted directly during exercise to improve users' exercise efficiency.
Collapse
Affiliation(s)
- Yi-Jr Liao
- Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan; (Y.-J.L.); (S.-J.R.)
| | - Wei-Chun Wang
- Department of Humanities and Social Sciences, National Taiwan University of Science and Technology, Taipei 106, Taiwan;
| | - Shanq-Jang Ruan
- Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan; (Y.-J.L.); (S.-J.R.)
| | - Yu-Hao Lee
- Department of Physical Medicine and Rehabilitation, Shuang Ho Hospital, Taipei Medical University, Taipei 106, Taiwan;
| | - Shih-Ching Chen
- Department of Physical Medicine and Rehabilitation, Taipei Medical University Hospital, Taipei 106, Taiwan
- School of Medicine, College of Medicine, Taipei Medical University, Taipei 106, Taiwan
| |
Collapse
|
12
|
Costescu C, Șogor M, Thill S, Roșan A. Emotional Dysregulation in Preschoolers with Autism Spectrum Disorder-A Sample of Romanian Children. Int J Environ Res Public Health 2021; 18:ijerph182010683. [PMID: 34682429 PMCID: PMC8535493 DOI: 10.3390/ijerph182010683] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/02/2021] [Revised: 09/29/2021] [Accepted: 10/02/2021] [Indexed: 11/23/2022]
Abstract
Emotional dysregulation problems seem to affect more than 80% of people with autism spectrum disorder (ASD) and may include irritability, aggressive behaviors, self-injury, and anxiety. Even though these types of problems are very common and affect the well-being of individuals with ASD, there are no objective assessment tools developed for this population and there are only a few intervention techniques meant to address these symptoms. This study investigates the feasibility of using off-the-shelf wearable devices to accurately measure heart rate, which has been associated with emotional dysregulation, and to test the effectiveness of functional communication training in reducing the emotional outburst in preschoolers with ASD. We used a single-case experiment design with three preschoolers with ASD to test if the duration of the emotional outburst and the elevated heart rate levels can be reduced by using functional communication training. Our results show that for two of the participants, the intervention was effective in reducing the duration of behaviors associated with emotional outburst, and that there were significant differences between baseline and intervention phase in terms of heart rate levels. However, our results are inconclusive regarding the association between elevated heart rates and the occurrence of the emotional outburst. Nevertheless, more research is needed to investigate the use of off-the-shelf wearable devices in predicting challenging behaviors in children with ASD.
Collapse
Affiliation(s)
- Cristina Costescu
- Special Education Department, Faculty of Psychology and Educational Sciences, Babes-Bolyai University, 400029 Cluj-Napoca, Romania; (M.Ș.); (A.R.)
- Correspondence:
| | - Mălina Șogor
- Special Education Department, Faculty of Psychology and Educational Sciences, Babes-Bolyai University, 400029 Cluj-Napoca, Romania; (M.Ș.); (A.R.)
| | - Serge Thill
- Donders Institute for Brain, Cognition, and Behaviour, Radboud University Nijmegen, 6525 GD Nijmegen, The Netherlands;
| | - Adrian Roșan
- Special Education Department, Faculty of Psychology and Educational Sciences, Babes-Bolyai University, 400029 Cluj-Napoca, Romania; (M.Ș.); (A.R.)
| |
Collapse
|
13
|
Hollenstein N, Renggli C, Glaus B, Barrett M, Troendle M, Langer N, Zhang C. Decoding EEG Brain Activity for Multi-Modal Natural Language Processing. Front Hum Neurosci 2021; 15:659410. [PMID: 34326723 PMCID: PMC8314009 DOI: 10.3389/fnhum.2021.659410] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Accepted: 06/14/2021] [Indexed: 11/13/2022] Open
Abstract
Until recently, human behavioral data from reading has mainly been of interest to researchers to understand human cognition. However, these human language processing signals can also be beneficial in machine learning-based natural language processing tasks. Using EEG brain activity for this purpose is largely unexplored as of yet. In this paper, we present the first large-scale study of systematically analyzing the potential of EEG brain activity data for improving natural language processing tasks, with a special focus on which features of the signal are most beneficial. We present a multi-modal machine learning architecture that learns jointly from textual input as well as from EEG features. We find that filtering the EEG signals into frequency bands is more beneficial than using the broadband signal. Moreover, for a range of word embedding types, EEG data improves binary and ternary sentiment classification and outperforms multiple baselines. For more complex tasks such as relation detection, only the contextualized BERT embeddings outperform the baselines in our experiments, which raises the need for further research. Finally, EEG data shows to be particularly promising when limited training data is available.
Collapse
Affiliation(s)
- Nora Hollenstein
- Department of Nordic Studies and Linguistics, University of Copenhagen, Copenhagen, Denmark
| | - Cedric Renggli
- Department of Computer Science, Swiss Federal Institute of Technology, ETH Zurich, Zurich, Switzerland
| | - Benjamin Glaus
- Department of Computer Science, Swiss Federal Institute of Technology, ETH Zurich, Zurich, Switzerland
| | - Maria Barrett
- Department of Computer Science, IT University of Copenhagen, Copenhagen, Denmark
| | - Marius Troendle
- Department of Psychology, University of Zurich, Zurich, Switzerland
| | - Nicolas Langer
- Department of Psychology, University of Zurich, Zurich, Switzerland
| | - Ce Zhang
- Department of Computer Science, Swiss Federal Institute of Technology, ETH Zurich, Zurich, Switzerland
| |
Collapse
|
14
|
Bañuelos-Lozoya E, González-Serna G, González-Franco N, Fragoso-Diaz O, Castro-Sánchez N. A Systematic Review for Cognitive State-Based QoE/UX Evaluation. Sensors (Basel) 2021; 21:s21103439. [PMID: 34069310 PMCID: PMC8156405 DOI: 10.3390/s21103439] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/15/2021] [Revised: 05/03/2021] [Accepted: 05/06/2021] [Indexed: 11/16/2022]
Abstract
Traditional evaluation of user experience is subjective by nature, for what is sought is to use data from physiological and behavioral sensors to interpret the relationship that the user's cognitive states have with the elements of a graphical interface and interaction mechanisms. This study presents the systematic review that was developed to determine the cognitive states that are being investigated in the context of Quality of Experience (QoE)/User Experience (UX) evaluation, as well as the signals and characteristics obtained, machine learning models used, evaluation architectures proposed, and the results achieved. Twenty-nine papers published in 2014-2019 were selected from eight online sources of information, of which 24% were related to the classification of cognitive states, 17% described evaluation architectures, and 41% presented correlations between different signals, cognitive states, and QoE/UX metrics, among others. The amount of identified studies was low in comparison with cognitive state research in other contexts, such as driving or other critical activities; however, this provides a starting point to analyze and interpret states such as mental workload, confusion, and mental stress from various human signals and propose more robust QoE/UX evaluation architectures.
Collapse
|
15
|
Sebastião R, Sorte S, Fernandes JM, Miranda AI. Classification of Critical Levels of CO Exposure of Firefigthers through Monitored Heart Rate. Sensors (Basel) 2021; 21:1561. [PMID: 33668116 DOI: 10.3390/s21051561] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/06/2021] [Revised: 02/15/2021] [Accepted: 02/18/2021] [Indexed: 12/20/2022]
Abstract
Smoke inhalation poses a serious health threat to firefighters (FFs), with potential effects including respiratory and cardiac disorders. In this work, environmental and physiological data were collected from FFs, during experimental fires performed in 2015 and 2019. Extending a previous work, which allowed us to conclude that changes in heart rate (HR) were associated with alterations in the inhalation of carbon monoxide (CO), we performed a HR analysis according to different levels of CO exposure during firefighting based on data collected from three FFs. Based on HR collected and on CO occupational exposure standards (OES), we propose a classifier to identify CO exposure levels through the HR measured values. An ensemble of 100 bagged classification trees was used and the classification of CO levels obtained an overall accuracy of 91.9%. The classification can be performed in real-time and can be embedded in a decision fire-fighting support system. This classification of FF’ exposure to critical CO levels, through minimally-invasive monitored HR, opens the possibility to identify hazardous situations, preventing and avoiding possible severe problems in FF’ health due to inhaled pollutants. The obtained results also show the importance of future studies on the relevance and influence of the exposure and inhalation of pollutants on the FF’ health, especially in what refers to hazardous levels of toxic air pollutants.
Collapse
|
16
|
L'Hermette M, Castres I, Coquart J, Tabben M, Ghoul N, Andrieu B, Tourny C. Cold Water Immersion After a Handball Training Session: The Relationship Between Physical Data and Sensorial Experience. Front Sports Act Living 2020; 2:581705. [PMID: 33345150 PMCID: PMC7739586 DOI: 10.3389/fspor.2020.581705] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2020] [Accepted: 09/11/2020] [Indexed: 11/26/2022] Open
Abstract
The aim of this study was to examine the relationship between the physiological data from subjects and their reported sensory experiences during two types of recovery methods following a handball training session. Female handball players (average age: 21.4 ± 1.3 years; weight: 59.2 ± 3.3 kg; height: 158 ± 3 cm; body mass index, 23.4 ± 2.0 kg.m−2) carried out an athletic training session (rating of perceived exertion RPE: 14.70 ± 0.89) with either a passive recovery (PR) period or cold water immersion (CWI) for 14 min) (cross-over design). Physiological data were collected during the recovery period: CWI had a greater effect than PR on heart rate (HR; bpm), the higher frequencies (HF) of heart rate variability (HRV: 46.44 ± 21.50 vs. 24.12 ± 17.62), delayed onset muscle soreness (DOMS: 1.37 ± 0.51 vs. 2.12 ± 1.25), and various reported emotional sensations. Spectrum HRV analysis showed a significant increase in HF during CWI. Sensorial experiences during the recovery periods were gathered from verbatim reports 24 h later. Players' comments about CWI revealed a congruence between the physiological data and sensorial reports. They used words such as: “thermal shock,” “regeneration,” “resourcefulness,” “dynamism,” and “disappearance of pain” to describe their sensations. In conclusion, this study demonstrated the link between physiological and experiential data during CWI and we propose that action of the parasympathetic system on the autonomic nervous system can, at least in part, explain the observed correlations between the corporeal data measured and the sensorial experiences reported.
Collapse
Affiliation(s)
| | | | | | | | - Nihel Ghoul
- University of Rouen UFR STAPS, Cetaps EA, Rouen, France
| | | | - Claire Tourny
- University of Rouen UFR STAPS, Cetaps EA, Rouen, France
| |
Collapse
|
17
|
Bolliger L, Lukan J, Luštrek M, De Bacquer D, Clays E. Protocol of the STRess at Work (STRAW) Project: How to Disentangle Day-to-Day Occupational Stress among Academics Based on EMA, Physiological Data, and Smartphone Sensor and Usage Data. Int J Environ Res Public Health 2020; 17:8835. [PMID: 33561061 DOI: 10.3390/ijerph17238835] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Revised: 11/20/2020] [Accepted: 11/25/2020] [Indexed: 11/16/2022]
Abstract
Several studies have reported on increasing psychosocial stress in academia due to work environment risk factors like job insecurity, work-family conflict, research grant applications, and high workload. The STRAW project adds novel aspects to occupational stress research among academic staff by measuring day-to-day stress in their real-world work environments over 15 working days. Work environment risk factors, stress outcomes, health-related behaviors, and work activities were measured repeatedly via an ecological momentary assessment (EMA), specially developed for this project. These results were combined with continuously tracked physiological stress responses using wearable devices and smartphone sensor and usage data. These data provide information on workplace context using our self-developed Android smartphone app. The data were analyzed using two approaches: 1) multilevel statistical modelling for repeated data to analyze relations between work environment risk factors and stress outcomes on a within- and between-person level, based on EMA results and a baseline screening, and 2) machine-learning focusing on building prediction models to develop and evaluate acute stress detection models, based on physiological data and smartphone sensor and usage data. Linking these data collection and analysis approaches enabled us to disentangle and model sources, outcomes, and contexts of occupational stress in academia.
Collapse
|
18
|
Kim JH, Jo BW, Jo JH, Kim DK. Development of an IoT-Based Construction Worker Physiological Data Monitoring Platform at High Temperatures. Sensors (Basel) 2020; 20:s20195682. [PMID: 33027999 PMCID: PMC7582578 DOI: 10.3390/s20195682] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2020] [Revised: 09/24/2020] [Accepted: 10/01/2020] [Indexed: 11/16/2022]
Abstract
This study presents an IoT-based construction worker physiological data monitoring platform using an off-the-shelf wearable smart band. The developed platform is designed for construction workers performing under high temperatures, and the platform is composed of two parts: an overall heat assessment (OHS) and a personal management system (PMS). OHS manages the breaktimes for groups of workers based using a thermal comfort index (TCI), as provided by the Korea Meteorological Administration (KMA), while PMS assesses the individual health risk level based on fuzzy theory using data acquired from a commercially available smart band. The device contains three sensors (PPG, Acc, and skin temperature), two modules (LoRa and GPS), and a power supply, which are embedded into a microcontroller (MCU). Thus, approved personnel can monitor the status as well as the current position of a construction worker via a PC or smartphone, and can make necessary decisions remotely. The platform was tested in both indoor and outdoor environment for reliability, achieved less than 1% of error, and received satisfactory feedback from on-site users.
Collapse
Affiliation(s)
- Jung Hoon Kim
- Department of Civil and Environmental Engineering, Hanyang University, Seoul 04763, Korea; (J.H.K.); (J.H.J.)
| | - Byung Wan Jo
- Department of Civil and Environmental Engineering, Hanyang University, Seoul 04763, Korea; (J.H.K.); (J.H.J.)
- Correspondence: ; Tel.: +82-2-2220-0327
| | - Jun Ho Jo
- Department of Civil and Environmental Engineering, Hanyang University, Seoul 04763, Korea; (J.H.K.); (J.H.J.)
| | - Do Keun Kim
- Research and Development Centre, Youngshine D&C, Gyeonggi-do 13487, Korea;
| |
Collapse
|
19
|
Dovgan K, Clay CJ, Tate SA. Dog Phobia Intervention: A Case Study in Improvement of Physiological and Behavioral Symptoms in A Child with Intellectual Disability. Dev Neurorehabil 2020; 23:121-132. [PMID: 31682551 DOI: 10.1080/17518423.2019.1683909] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
Background: Children with intellectual disability are at risk for anxiety disorders involving intense physiological reactions and risky behavioral responses. Interventions have been identified in this field; however, assessment of underlying anxiety is limited and flawed.Method: We implemented a single-subject case study using differential reinforcement to treat dog phobia in a boy with intellectual disability. We recorded elopement and compliance with goals and measured physiological expressions of stress: galvanic skin response, heart rate variability, temperature, and latency to calm down.Results: After fifteen therapy sessions, the boy decreased elopement and noncompliance considerably and showed dramatic improvements in emotional self-regulation.Conclusions: Future research should examine the utility of including biosensing measures in clinical applications and the relationship between physiological measures of anxiety and traditional questionnaires. Children with intellectual disability at risk for anxiety disorders should be tracked longitudinally to examine the effect of interventions on social-emotional well-being and self-regulation.
Collapse
|
20
|
Choi GY, Han CH, Jung YJ, Hwang HJ. A multi-day and multi-band dataset for a steady-state visual-evoked potential-based brain-computer interface. Gigascience 2019; 8:giz133. [PMID: 31765472 PMCID: PMC6876666 DOI: 10.1093/gigascience/giz133] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2019] [Revised: 08/26/2019] [Accepted: 10/16/2019] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND A steady-state visual-evoked potential (SSVEP) is a brain response to visual stimuli modulated at certain frequencies; it has been widely used in electroencephalography (EEG)-based brain-computer interface research. However, there are few published SSVEP datasets for brain-computer interface. In this study, we obtained a new SSVEP dataset based on measurements from 30 participants, performed on 2 days; our dataset complements existing SSVEP datasets: (i) multi-band SSVEP datasets are provided, and all 3 possible frequency bands (low, middle, and high) were used for SSVEP stimulation; (ii) multi-day datasets are included; and (iii) the EEG datasets include simultaneously obtained physiological measurements, such as respiration, electrocardiography, electromyography, and head motion (accelerator). FINDINGS To validate our dataset, we estimated the spectral powers and classification performance for the EEG (SSVEP) datasets and created an example plot to visualize the physiological time-series data. Strong SSVEP responses were observed at stimulation frequencies, and the mean classification performance of the middle frequency band was significantly higher than the low- and high-frequency bands. Other physiological data also showed reasonable results. CONCLUSIONS Our multi-band, multi-day SSVEP datasets can be used to optimize stimulation frequencies because they enable simultaneous investigation of the characteristics of the SSVEPs evoked in each of the 3 frequency bands, and solve session-to-session (day-to-day) transfer problems by enabling investigation of the non-stationarity of SSVEPs measured on different days. Additionally, auxiliary physiological data can be used to explore the relationship between SSVEP characteristics and physiological conditions, providing useful information for optimizing experimental paradigms to achieve high performance.
Collapse
Affiliation(s)
- Ga-Young Choi
- Department of Medical IT Convergence Engineering, Kumoh National Institute of Technology, Daehak-ro 61, Gumi 39177, Republic of Korea
| | - Chang-Hee Han
- Machine Learning Group, Berlin Institute of Technology (TU Berlin), Marchstrasse 23, Berlin 10587, Germany
| | - Young-Jin Jung
- Department of Radiological Science, Dongseo University, Jurye-ro 47, Busan 47011, Republic of Korea
| | - Han-Jeong Hwang
- Department of Medical IT Convergence Engineering, Kumoh National Institute of Technology, Daehak-ro 61, Gumi 39177, Republic of Korea
| |
Collapse
|
21
|
Dong X, Chen C, Geng Q, Cao Z, Chen X, Lin J, Jin Y, Zhang Z, Shi Y, Zhang XD. An Improved Method of Handling Missing Values in the Analysis of Sample Entropy for Continuous Monitoring of Physiological Signals. Entropy (Basel) 2019; 21:e21030274. [PMID: 33266989 PMCID: PMC7514754 DOI: 10.3390/e21030274] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/11/2019] [Revised: 03/08/2019] [Accepted: 03/09/2019] [Indexed: 11/17/2022]
Abstract
Medical devices generate huge amounts of continuous time series data. However, missing values commonly found in these data can prevent us from directly using analytic methods such as sample entropy to reveal the information contained in these data. To minimize the influence of missing points on the calculation of sample entropy, we propose a new method to handle missing values in continuous time series data. We use both experimental and simulated datasets to compare the performance (in percentage error) of our proposed method with three currently used methods: skipping the missing values, linear interpolation, and bootstrapping. Unlike the methods that involve modifying the input data, our method modifies the calculation process. This keeps the data unchanged which is less intrusive to the structure of the data. The results demonstrate that our method has a consistent lower average percentage error than other three commonly used methods in multiple common physiological signals. For missing values in common physiological signal type, different data size and generating mechanism, our method can more accurately extract the information contained in continuously monitored data than traditional methods. So it may serve as an effective tool for handling missing values and may have broad utility in analyzing sample entropy for common physiological signals. This could help develop new tools for disease diagnosis and evaluation of treatment effects.
Collapse
Affiliation(s)
- Xinzheng Dong
- School of Software Engineering, South China University of Technology, Guangzhou 510006, China;
- Zhuhai Laboratory of Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Zhuhai College of Jilin University, Zhuhai 519041, China
| | - Chang Chen
- Faculty of Health Sciences, University of Macau, Taipa, Macau 999078, China; (C.C.); (Y.J.)
| | - Qingshan Geng
- Guangdong General Hospital, Guangdong Academy of Medical Science, Guangzhou 510080, China;
| | - Zhixin Cao
- Beijing Engineering Research Center of Diagnosis and Treatment of Respiratory and Critical Care Medicine, Beijing Chaoyang Hospital, Beijing 100043, China; (Z.C.); (Y.S.)
| | - Xiaoyan Chen
- Department of Endocrinology, First Affiliated Hospital of Guangzhou Medical University, Guangzhou 510120, China; (X.C.); (J.L.)
| | - Jinxiang Lin
- Department of Endocrinology, First Affiliated Hospital of Guangzhou Medical University, Guangzhou 510120, China; (X.C.); (J.L.)
| | - Yu Jin
- Faculty of Health Sciences, University of Macau, Taipa, Macau 999078, China; (C.C.); (Y.J.)
| | - Zhaozhi Zhang
- School of Law, Washington University, St. Louis, MO 63130, USA;
| | - Yan Shi
- Beijing Engineering Research Center of Diagnosis and Treatment of Respiratory and Critical Care Medicine, Beijing Chaoyang Hospital, Beijing 100043, China; (Z.C.); (Y.S.)
- Department of Mechanical and Electronic Engineering, Beihang University, Beijing 100191, China
| | - Xiaohua Douglas Zhang
- Faculty of Health Sciences, University of Macau, Taipa, Macau 999078, China; (C.C.); (Y.J.)
- Correspondence: ; Tel: +853-8822-4813
| |
Collapse
|
22
|
Chu VC, Lucas GM, Lei S, Mozgai S, Khooshabeh P, Gratch J. Emotion Regulation in the Prisoner's Dilemma: Effects of Reappraisal on Behavioral Measures and Cardiovascular Measures of Challenge and Threat. Front Hum Neurosci 2019; 13:50. [PMID: 30837855 PMCID: PMC6382736 DOI: 10.3389/fnhum.2019.00050] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2018] [Accepted: 01/30/2019] [Indexed: 11/19/2022] Open
Abstract
The current study examines cooperation and cardiovascular responses in individuals that were defected on by their opponent in the first round of an iterated Prisoner’s Dilemma. In this scenario, participants were either primed with the emotion regulation strategy of reappraisal or no emotion regulation strategy, and their opponent either expressed an amused smile or a polite smile after the results were presented. We found that cooperation behavior decreased in the no emotion regulation group when the opponent expressed an amused smile compared to a polite smile. In the cardiovascular measures, we found significant differences between the emotion regulation conditions using the biopsychosocial (BPS) model of challenge and threat. However, the cardiovascular measures of participants instructed with the reappraisal strategy were only weakly comparable with a threat state of the BPS model, which involves decreased blood flow and perception of greater task demands than resources to cope with those demands. Conversely, the cardiovascular measures of participants without an emotion regulation were only weakly comparable with a challenge state of the BPS model, which involves increased blood flow and perception of having enough or more resources to cope with task demands.
Collapse
Affiliation(s)
- Veronica C Chu
- Department of Cognitive Sciences, University of California, Irvine, Irvine, CA, United States
| | - Gale M Lucas
- Institute for Creative Technologies, University of Southern California, Playa Vista, CA, United States
| | - Su Lei
- Institute for Creative Technologies, University of Southern California, Playa Vista, CA, United States
| | - Sharon Mozgai
- Institute for Creative Technologies, University of Southern California, Playa Vista, CA, United States
| | | | - Jonathan Gratch
- Institute for Creative Technologies, University of Southern California, Playa Vista, CA, United States
| |
Collapse
|
23
|
Villagrasa F, Baladron J, Vitay J, Schroll H, Antzoulatos EG, Miller EK, Hamker FH. On the Role of Cortex-Basal Ganglia Interactions for Category Learning: A Neurocomputational Approach. J Neurosci 2018; 38:9551-62. [PMID: 30228231 DOI: 10.1523/JNEUROSCI.0874-18.2018] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2018] [Revised: 08/07/2018] [Accepted: 08/28/2018] [Indexed: 12/29/2022] Open
Abstract
In addition to the prefrontal cortex (PFC), the basal ganglia (BG) have been increasingly often reported to play a fundamental role in category learning, but the circuit mechanisms mediating their interaction remain to be explored. We developed a novel neurocomputational model of category learning that particularly addresses the BG-PFC interplay. We propose that the BG bias PFC activity by removing the inhibition of cortico-thalamo-cortical loop and thereby provide a teaching signal to guide the acquisition of category representations in the corticocortical associations to the PFC. Our model replicates key behavioral and physiological data of macaque monkey learning a prototype distortion task from Antzoulatos and Miller (2011) Our simulations allowed us to gain a deeper insight into the observed drop of category selectivity in striatal neurons seen in the experimental data and in the model. The simulation results and a new analysis of the experimental data based on the model's predictions show that the drop in category selectivity of the striatum emerges as the variability of responses in the striatum rises when confronting the BG with an increasingly larger number of stimuli to be classified. The neurocomputational model therefore provides new testable insights of systems-level brain circuits involved in category learning that may also be generalized to better understand other cortico-BG-cortical loops.SIGNIFICANCE STATEMENT Inspired by the idea that basal ganglia (BG) teach the prefrontal cortex (PFC) to acquire category representations, we developed a novel neurocomputational model and tested it on a task that was recently applied in monkey experiments. As an advantage over previous models of category learning, our model allows to compare simulation data with single-cell recordings in PFC and BG. We not only derived model predictions, but already verified a prediction to explain the observed drop in striatal category selectivity. When testing our model with a simple, real-world face categorization task, we observed that the fast striatal learning with a performance of 85% correct responses can teach the slower PFC learning to push the model performance up to almost 100%.
Collapse
|
24
|
Khazaei H, McGregor C, Eklund JM, El-Khatib K. Real-Time and Retrospective Health-Analytics-as-a-Service: A Novel Framework. JMIR Med Inform 2015; 3:e36. [PMID: 26582268 PMCID: PMC4704962 DOI: 10.2196/medinform.4640] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2015] [Revised: 09/04/2015] [Accepted: 09/30/2015] [Indexed: 01/06/2023] Open
Abstract
BACKGROUND Analytics-as-a-service (AaaS) is one of the latest provisions emerging from the cloud services family. Utilizing this paradigm of computing in health informatics will benefit patients, care providers, and governments significantly. This work is a novel approach to realize health analytics as services in critical care units in particular. OBJECTIVE To design, implement, evaluate, and deploy an extendable big-data compatible framework for health-analytics-as-a-service that offers both real-time and retrospective analysis. METHODS We present a novel framework that can realize health data analytics-as-a-service. The framework is flexible and configurable for different scenarios by utilizing the latest technologies and best practices for data acquisition, transformation, storage, analytics, knowledge extraction, and visualization. We have instantiated the proposed method, through the Artemis project, that is, a customization of the framework for live monitoring and retrospective research on premature babies and ill term infants in neonatal intensive care units (NICUs). RESULTS We demonstrated the proposed framework in this paper for monitoring NICUs and refer to it as the Artemis-In-Cloud (Artemis-IC) project. A pilot of Artemis has been deployed in the SickKids hospital NICU. By infusing the output of this pilot set up to an analytical model, we predict important performance measures for the final deployment of Artemis-IC. This process can be carried out for other hospitals following the same steps with minimal effort. SickKids' NICU has 36 beds and can classify the patients generally into 5 different types including surgical and premature babies. The arrival rate is estimated as 4.5 patients per day, and the average length of stay was calculated as 16 days. Mean number of medical monitoring algorithms per patient is 9, which renders 311 live algorithms for the whole NICU running on the framework. The memory and computation power required for Artemis-IC to handle the SickKids NICU will be 32 GB and 16 CPU cores, respectively. The required amount of storage was estimated as 8.6 TB per year. There will always be 34.9 patients in SickKids NICU on average. Currently, 46% of patients cannot get admitted to SickKids NICU due to lack of resources. By increasing the capacity to 90 beds, all patients can be accommodated. For such a provisioning, Artemis-IC will need 16 TB of storage per year, 55 GB of memory, and 28 CPU cores. CONCLUSIONS Our contributions in this work relate to a cloud architecture for the analysis of physiological data for clinical decisions support for tertiary care use. We demonstrate how to size the equipment needed in the cloud for that architecture based on a very realistic assessment of the patient characteristics and the associated clinical decision support algorithms that would be required to run for those patients. We show the principle of how this could be performed and furthermore that it can be replicated for any critical care setting within a tertiary institution.
Collapse
Affiliation(s)
- Hamzeh Khazaei
- IBM, Canada Research and Development Center, Markham, Toronto, ON, Canada.
| | | | | | | |
Collapse
|