Predicting the severity of mood and neuropsychiatric symptoms from digital biomarkers using wearable physiological data and deep learning

Neuropsychiatric symptoms (NPS) and mood disorders are common in individuals with mild cognitive impairment (MCI) and increase the risk of progression to dementia. Wearable devices collecting physiological and behavioral data can help in remote, passive, and continuous monitoring of moods and NPS, overcoming limitations and inconveniences of current assessment methods. In this longitudinal study, we examined the predictive ability of digital biomarkers based on sensor data from a wrist-worn wearable to determine the severity of NPS and mood disorders on a daily basis in older adults with predominant MCI. In addition to conventional physiological biomarkers, such as heart rate variability and skin conductance levels, we leveraged deep-learning features derived from physiological data using a self-supervised convolutional autoencoder. Models combining common digital biomarkers and deep features predicted depression severity scores with a correlation of r = 0.73 on average, total severity of mood disorder symptoms with r = 0.67, and mild behavioral impairment scores with r = 0.69 in the study population. Our findings demonstrated the potential of physiological biomarkers collected from wearables and deep learning methods to be used for the continuous and unobtrusive assessments of mental health symptoms in older adults, including those with MCI. TRIAL REGISTRATION: This trial was registered with ClinicalTrials.gov (NCT05059353) on September 28, 2021, titled "Effectiveness and Safety of a Digitally Based Multidomain Intervention for Mild Cognitive Impairment".

Assessment of symptom severity in psychotic disorder patients based on heart rate variability and accelerometer mobility data

BACKGROUND

Advancement in mental health care requires easily accessible, efficient diagnostic and treatment assessment tools. Viable biomarkers could enable objectification and automation of the diagnostic and treatment process, currently dependent on a psychiatric interview. Available wearable technology and computational methods make it possible to incorporate heart rate variability (HRV), an indicator of autonomic nervous system (ANS) activity, into potential diagnostic and treatment assessment frameworks as a biomarker of disease severity in mental disorders, including schizophrenia and bipolar disorder (BD).

METHOD

We used a commercially available electrocardiography (ECG) chest strap with a built-in accelerometer, i.e. Polar H10, to record R-R intervals and physical activity of 30 hospitalized schizophrenia or BD patients and 30 control participants through ca. 1.5-2 h time periods. We validated a novel approach to data acquisition based on a flexible, patient-friendly and cost-effective setting. We analyzed the relationship between HRV and the Positive and Negative Syndrome Scale (PANSS) test scores, as well as the HRV and mobility coefficient. We also proposed a method of rest period selection based on R-R intervals and mobility data. The source code for reproducing all experiments is available on GitHub, while the dataset is published on Zenodo.

RESULTS

Mean HRV values were lower in the patient compared to the control group and negatively correlated with the results of the PANSS general subcategory. For the control group, we also discovered the inversely proportional dependency between the mobility coefficient, based on accelerometer data, and HRV. This relationship was less pronounced for the treatment group.

CONCLUSIONS

HRV value itself, as well as the relationship between HRV and mobility, may be promising biomarkers in disease diagnostics. These findings can be used to develop a flexible monitoring system for symptom severity assessment.

Heart Rate Variability in Psychiatric Disorders: A Systematic Review

Introduction

Heart rate variability (HRV) is a measure of the fluctuation in time interval between consecutive heart beats. Decreased heart rate variability has been shown to have associations with autonomic dysfunction in psychiatric conditions such as depression, substance abuse, anxiety, and schizophrenia, although its use as a prognostic tool remains highly debated. This study aims to review the current literature on heart rate variability as a diagnostic and prognostic tool in psychiatric populations.

Methods

A literature search was conducted using the MEDLINE, EMBASE, Cochrane, and PsycINFO libraries to identify full-text studies involving adult psychiatric populations that reported HRV measurements. From 1647 originally identified, 31 studies were narrowed down through an abstract and full-text screen. Studies were excluded if they enrolled adolescents or children, used animal models, enrolled patients with another primary diagnosis other than psychiatric as outlined by the diagnostic and statistical manual of mental disorders (DSM) V, or if they assessed HRV in the context of treatment rather than diagnosis. Study quality assessment was conducted using a modified Downs and Blacks quality assessment tool for observational rather than interventional studies. Data were reported in four tables: 1) summarizing study characteristics, 2) methods of HRV detection, 3) key findings and statistics, and 4) quality assessment.

Results

There is significant variability between studies in their methodology of recording as well as reporting HRV, which makes it difficult to meaningfully interpret data that is clinically applicable due to the presence of significant bias in existing studies. The presence of an association between HRV and the severity of various psychiatric disorders, however, remains promising.

Conclusion

Future studies should be done to further explore how HRV parameters may be used to enhance the diagnosis and prognosis of several psychiatric disorders.

Digital Phenotyping: Data-Driven Psychiatry to Redefine Mental Health

The term "digital phenotype" refers to the digital footprint left by patient-environment interactions. It has potential for both research and clinical applications but challenges our conception of health care by opposing 2 distinct approaches to medicine: one centered on illness with the aim of classifying and curing disease, and the other centered on patients, their personal distress, and their lived experiences. In the context of mental health and psychiatry, the potential benefits of digital phenotyping include creating new avenues for treatment and enabling patients to take control of their own well-being. However, this comes at the cost of sacrificing the fundamental human element of psychotherapy, which is crucial to addressing patients' distress. In this viewpoint paper, we discuss the advances rendered possible by digital phenotyping and highlight the risk that this technology may pose by partially excluding health care professionals from the diagnosis and therapeutic process, thereby foregoing an essential dimension of care. We conclude by setting out concrete recommendations on how to improve current digital phenotyping technology so that it can be harnessed to redefine mental health by empowering patients without alienating them.

Internet of Things-Based ECG and Vitals Healthcare Monitoring System

Health monitoring and its associated technologies have gained enormous importance over the past few years. The electrocardiogram (ECG) has long been a popular tool for assessing and diagnosing cardiovascular diseases (CVDs). Since the literature on ECG monitoring devices is growing at an exponential rate, it is becoming difficult for researchers and healthcare professionals to select, compare, and assess the systems that meet their demands while also meeting the monitoring standards. This emphasizes the necessity for a reliable reference to guide the design, categorization, and analysis of ECG monitoring systems, which will benefit both academics and practitioners. We present a complete ECG monitoring system in this work, describing the design stages and implementation of an end-to-end solution for capturing and displaying the patient's heart signals, heart rate, blood oxygen levels, and body temperature. The data will be presented on an OLED display, a developed Android application as well as in MATLAB via serial communication. The Internet of Things (IoT) approaches have a clear advantage in tackling the problem of heart disease patient care as they can transform the service mode into a widespread one and alert the healthcare services based on the patient's physical condition. Keeping this in mind, there is also the addition of a web server for monitoring the patient's status via WiFi. The prototype, which is compliant with the electrical safety regulations and medical equipment design, was further benchmarked against a commercially available off-the-shelf device, and showed an excellent accuracy of 99.56%.

Mental Health Prediction Using Machine Learning: Taxonomy, Applications, and Challenges

The increase of mental health problems and the need for effective medical health care have led to an investigation of machine learning that can be applied in mental health problems. This paper presents a recent systematic review of machine learning approaches in predicting mental health problems. Furthermore, we will discuss the challenges, limitations, and future directions for the application of machine learning in the mental health field. We collect research articles and studies that are related to the machine learning approaches in predicting mental health problems by searching reliable databases. Moreover, we adhere to the PRISMA methodology in conducting this systematic review. We include a total of 30 research articles in this review after the screening and identification processes. Then, we categorize the collected research articles based on the mental health problems such as schizophrenia, bipolar disorder, anxiety and depression, posttraumatic stress disorder, and mental health problems among children. Discussing the findings, we reflect on the challenges and limitations faced by the researchers on machine learning in mental health problems. Additionally, we provide concrete recommendations on the potential future research and development of applying machine learning in the mental health field.

Portable technologies for digital phenotyping of bipolar disorder: A systematic review

BACKGROUND

Bias-prone psychiatric interviews remain the mainstay of bipolar disorder (BD) assessment. The development of digital phenotyping promises to improve BD management. We present a systematic review of the evidence about the use of portable digital devices for the identification of BD, BD types and BD mood states and for symptom assessment.

METHODS

We searched Web of Knowledge^SM, Scopus ®, IEEE Xplore, and ACM Digital Library databases (until 5/1/2021) for articles evaluating the use of portable/wearable digital devices, such as smartphone apps, wearable sensors, audio and/or visual recordings, and multimodal tools. The protocol is registered in PROSPERO (CRD42020200086).

RESULTS

We included 62 studies (2325 BD; 724 healthy controls, HC): 27 using smartphone apps, either for recording self-assessments (n = 10) or for passively gathering metadata (n = 7) or both (n = 10); 15 using wearable sensors for physiological parameters; 17 analysing audio and/or video recordings; 3 using multiple technologies. Two thirds of the included studies applied artificial intelligence (AI)-based approaches. They achieved fair to excellent classification performances.

LIMITATIONS

The included studies had small sample sizes and marked heterogeneity. Evidence of overfitting emerged, limiting generalizability. The absence of clear guidelines about reporting classification performances, with no shared standard metrics, makes results hardly interpretable and comparable.

CONCLUSIONS

New technologies offer a noteworthy opportunity to BD digital phenotyping with objectivity and high granularity. AI-based models could deliver important support in clinical decision-making. Further research and cooperation between different stakeholders are needed for addressing methodological, ethical and socio-economic considerations.

The role of electroencephalography electrical reference in the assessment of functional brain-heart interplay: From methodology to user guidelines

BACKGROUND

The choice of EEG reference has been widely studied. However, the choice of the most appropriate re-referencing for EEG data is still debated. Moreover, the role of EEG reference in the estimation of functional Brain-Heart Interplay (BHI), together with different multivariate modelling strategies, has not been investigated yet.

METHODS

This study identifies the best methodology combining a proper EEG electrical reference and signal processing methods for an effective functional BHI assessment. The effects of the EEG reference among common average, mastoids average, Laplacian reference, Cz reference, and the reference electrode standardization technique (REST) were explored throughout different BHI methods including synthetic data generation (SDG) model, heartbeat-evoked potentials, heartbeat-evoked oscillations, and maximal information coefficient.

RESULTS

The SDG model exhibited high robustness between EEG references, whereas the maximal information coefficient method exhibited a high sensitivity. The common average and REST references for EEG showed a good consistency in the between-method comparisons. Laplacian, and Cz references significantly bias a BHI measurement.

COMPARISON WITH EXISTING METHODS

The use of EEG reference based on a common average outperforms on the use of other references for consistency in estimating directed functional BHI. We do not recommend the use of EEG references based on analytical derivations as the experimental conditions may not meet the requirements of their optimal estimation, particularly in clinical settings.

CONCLUSION

The use of a common average for EEG electrical reference is concluded to be the most appropriate choice for a quantitative, functional BHI assessment.

Non-linear analysis of the heart rate variability in characterization of manic and euthymic phases of bipolar disorder

BACKGROUND

- Bipolar Disorder (BD) has been associated with autonomic nervous system (ANS) dysregulation, with a consequent increase in mortality. Recent work highlights the non-linear analysis of ANS function. Our objective was to compare ANS modulation using recurrence plots (RP) and symbolic analysis (SA) in manic and euthymic phases of BD to controls.

METHODS

- Eighteen male patients (33.1 ± 12.0 years) were assessed during mania and at discharge in the euthymic phase compared and to a healthy group matched by age (33.9 ± 10.8 years). Electrocardiographic series (1000 RR intervals, at rest, in supine position) were captured using Polar Advantage RS800CX equipment and Heart Rate Variability (HRV) was analysed using RP and SA. Statistical analysis was performed using ANOVA with Tukey's post-test. The threshold for statistical significance was set at P < 0.05 and Cohen's d effect size was also quantified considering d > 0.8 as an important effect. The study was registered into the Clinical Trials Registration (ClinicalTrials.gov: NCT01272518).

RESULTS

Manic group presented significantly higher linearity before treatment (P<0.05) compared to controls considering RP variables. Cohen's d values had a large effect size ranging from 0.888 to 1.227. In the manic phase, SA showed predominance of the sympathetic component (OV%) with reduction of the parasympathetic component (2LV% and 2UV%) with reversion post treatment including higher Shannon Entropy (SE) indicating higher complexity.

LIMITATIONS

- short follow-up (1 month) and small number of patients.

CONCLUSIONS

- Non-linear analyzes may be used as supplementary tools for understanding autonomic function in BD during mania and after drug treatment.

Smart Shirts for Monitoring Physiological Parameters: Scoping Review

BACKGROUND

The recent trends of technological innovation and widescale digitization as potential solutions to challenges in health care, sports, and emergency service operations have led to the conception of smart textile technology. In health care, these smart textile systems present the potential to aid preventative medicine and early diagnosis through continuous, noninvasive tracking of physical and mental health while promoting proactive involvement of patients in their medical management. In areas such as sports and emergency response, the potential to provide comprehensive and simultaneous physiological insights across multiple body systems is promising. However, it is currently unclear what type of evidence exists surrounding the use of smart textiles for the monitoring of physiological outcome measures across different settings.

OBJECTIVE

This scoping review aimed to systematically survey the existing body of scientific literature surrounding smart textiles in their most prevalent form, the smart shirt, for monitoring physiological outcome measures.

METHODS

A total of 5 electronic bibliographic databases were systematically searched (Ovid Medical Literature Analysis and Retrieval System Online, Excerpta Medica database, Scopus, Cumulative Index to Nursing and Allied Health Literature, and SPORTDiscus). Publications from the inception of the database to June 24, 2019 were reviewed. Nonindexed literature relevant to this review was also systematically searched. The results were then collated, summarized, and reported.

RESULTS

Following the removal of duplicates, 7871 citations were identified. On the basis of title and abstract screening, 7632 citations were excluded, whereas 239 were retrieved and assessed for eligibility. Of these, 101 citations were included in the final analysis. Included studies were categorized into four themes: (1) prototype design, (2) validation, (3) observational, and (4) reviews. Among the 101 analyzed studies, prototype design was the most prevalent theme (50/101, 49.5%), followed by validation (29/101, 28.7%), observational studies (21/101, 20.8%), and reviews (1/101, 0.1%). Presented prototype designs ranged from those capable of monitoring one physiological metric to those capable of monitoring several simultaneously. In 29 validation studies, 16 distinct smart shirts were validated against reference technology under various conditions and work rates, including rest, submaximal exercise, and maximal exercise. The identified observational studies used smart shirts in clinical, healthy, and occupational populations for aims such as early diagnosis and stress detection. One scoping review was identified, investigating the use of smart shirts for electrocardiograph signal monitoring in cardiac patients.

CONCLUSIONS

Although smart shirts have been found to be valid and reliable in the monitoring of specific physiological metrics, results were variable for others, demonstrating the need for further systematic validation. Analysis of the results has also demonstrated gaps in knowledge, such as a considerable lag of validation and observational studies in comparison with prototype design and limited investigation using smart shirts in pediatric, elite sports, and emergency service populations.

El Kassabi H, Ismail H, Nujum Navaz A. ECG Monitoring Systems: Review, Architecture, Processes, and Key Challenges

Health monitoring and its related technologies is an attractive research area. The electrocardiogram (ECG) has always been a popular measurement scheme to assess and diagnose cardiovascular diseases (CVDs). The number of ECG monitoring systems in the literature is expanding exponentially. Hence, it is very hard for researchers and healthcare experts to choose, compare, and evaluate systems that serve their needs and fulfill the monitoring requirements. This accentuates the need for a verified reference guiding the design, classification, and analysis of ECG monitoring systems, serving both researchers and professionals in the field. In this paper, we propose a comprehensive, expert-verified taxonomy of ECG monitoring systems and conduct an extensive, systematic review of the literature. This provides evidence-based support for critically understanding ECG monitoring systems' components, contexts, features, and challenges. Hence, a generic architectural model for ECG monitoring systems is proposed, an extensive analysis of ECG monitoring systems' value chain is conducted, and a thorough review of the relevant literature, classified against the experts' taxonomy, is presented, highlighting challenges and current trends. Finally, we identify key challenges and emphasize the importance of smart monitoring systems that leverage new technologies, including deep learning, artificial intelligence (AI), Big Data and Internet of Things (IoT), to provide efficient, cost-aware, and fully connected monitoring systems.

Quantifying the lagged Poincaré plot geometry of ultrashort heart rate variability series: automatic recognition of odor hedonic tone

The application of Poincaré plot analysis to characterize inter-beat interval dynamics has been successfully proposed in the scientific literature for the assessment of humans' physiological states and related aberrations. In this study, we proposed novel descriptors to trace the evolution of Poincaré plot shape over the lags. Their reliability in ultra-short cardiovascular series analysis was validated on synthetic inter-beat series generated through a physiologically plausible integral pulse frequency modulation model. Furthermore, we used the proposed approach for the investigation of the direct relationship between autonomic nervous system (ANS) dynamics and hedonic olfactory elicitation, in a group of 30 healthy subjects. Participants with a similar olfactory threshold were selected, and were asked to score 5-s stimuli in terms of arousal and valence levels according to the Russell's circumflex model of affect. Their ANS response was investigated in 35-s windows after the elicitation. Experimental results showed a gender-specific, high discriminant power of the proposed approach, discerning between pleasant and unpleasant odorants with an accuracy of 83.33% and 73.33% for men and for women, respectively. Graphical Abstract Olfaction plays a crucial role in our life and is strictly related to the Autonomic Nervous System (ANS) activity, which can be monitored studying Heart Rate Variability. We used the Lagged Poincare Plot approach to recognize gender-specific ANS response in 35-second windows after the elicitation through pleasant/unpleasant odorants.

Entropy analysis of heart rate variability and its application to recognize major depressive disorder: A pilot study

BACKGROUND

The current method to evaluate major depressive disorder (MDD) relies on subjective clinical interviews and self-questionnaires.

OBJECTIVE

Autonomic imbalance in MDD patients is characterized using entropy measures of heart rate variability (HRV). A machine learning approach for screening depression based on the entropy is demonstrated.

METHODS

The participants experience five experimental phases: baseline (BASE), stress task (MAT), stress task recovery (REC1), relaxation task (RLX), and relaxation task recovery (REC2). The four entropy indices, approximate entropy, sample entropy, fuzzy entropy, and Shannon entropy, are extracted for each phase, and a total of 20 features are used. A support vector machine classifier and recursive feature elimination are employed for classification.

RESULTS

The entropy features are lower in the MDD group; however, the disease does not have a significant effect. Experimental tasks significantly affect the features. The entropy did not recover during REC1. The differences in the entropy features between the two groups increased after MAT and showed the largest gap in REC2. We achieved 70% accuracy, 64% sensitivity, and 76% specificity with three optimal features during RLX and REC2.

CONCLUSION

Monitoring of HRV complexity changes when a subject experiences autonomic arousal and recovery can potentially facilitate objective depression recognition.

Peripheral blood metabolome predicts mood change-related activity in mouse model of bipolar disorder

Bipolar disorder is a major mental illness characterized by severe swings in mood and activity levels which occur with variable amplitude and frequency. Attempts have been made to identify mood states and biological features associated with mood changes to compensate for current clinical diagnosis, which is mainly based on patients' subjective reports. Here, we used infradian (a cycle > 24 h) cyclic locomotor activity in a mouse model useful for the study of bipolar disorder as a proxy for mood changes. We show that metabolome patterns in peripheral blood could retrospectively predict the locomotor activity levels. We longitudinally monitored locomotor activity in the home cage, and subsequently collected peripheral blood and performed metabolomic analyses. We then constructed cross-validated linear regression models based on blood metabolome patterns to predict locomotor activity levels of individual mice. Our analysis revealed a significant correlation between actual and predicted activity levels, indicative of successful predictions. Pathway analysis of metabolites used for successful predictions showed enrichment in mitochondria metabolism-related terms, such as "Warburg effect" and "citric acid cycle." In addition, we found that peripheral blood metabolome patterns predicted expression levels of genes implicated in bipolar disorder in the hippocampus, a brain region responsible for mood regulation, suggesting that the brain-periphery axis is related to mood-change-associated behaviors. Our results may serve as a basis for predicting individual mood states through blood metabolomics in bipolar disorder and other mood disorders and may provide potential insight into systemic metabolic activity in relation to mood changes.

Accuracy of a Chatbot (Ada) in the Diagnosis of Mental Disorders: Comparative Case Study With Lay and Expert Users

Background

Health apps for the screening and diagnosis of mental disorders have emerged in recent years on various levels (eg, patients, practitioners, and public health system). However, the diagnostic quality of these apps has not been (sufficiently) tested so far.

Objective

The objective of this pilot study was to investigate the diagnostic quality of a health app for a broad spectrum of mental disorders and its dependency on expert knowledge.

Methods

Two psychotherapists, two psychology students, and two laypersons each read 20 case vignettes with a broad spectrum of mental disorders. They used a health app (Ada—Your Health Guide) to get a diagnosis by entering the symptoms. Interrater reliabilities were computed between the diagnoses of the case vignettes and the results of the app for each user group.

Results

Overall, there was a moderate diagnostic agreement (kappa=0.64) between the results of the app and the case vignettes for mental disorders in adulthood and a low diagnostic agreement (kappa=0.40) for mental disorders in childhood and adolescence. When psychotherapists applied the app, there was a good diagnostic agreement (kappa=0.78) regarding mental disorders in adulthood. The diagnostic agreement was moderate (kappa=0.55/0.60) for students and laypersons. For mental disorders in childhood and adolescence, a moderate diagnostic quality was found when psychotherapists (kappa=0.53) and students (kappa=0.41) used the app, whereas the quality was low for laypersons (kappa=0.29). On average, the app required 34 questions to be answered and 7 min to complete.

Conclusions

The health app investigated here can represent an efficient diagnostic screening or help function for mental disorders in adulthood and has the potential to support especially diagnosticians in their work in various ways. The results of this pilot study provide a first indication that the diagnostic accuracy is user dependent and improvements in the app are needed especially for mental disorders in childhood and adolescence.

The Relationship Between Perinatal Mental Health and Stress: a Review of the Microbiome

PURPOSE OF REVIEW

Our current understanding of the underlying mechanisms and etiologies of perinatal mood and anxiety disorders (PMADs) is not clearly identified. The relationship of stress-induced adaptations (i.e., the hypothalamic-pituitary-adrenal (HPA) axis, the autonomic nervous system (ANS), the immune system) and the microbiota are potential contributors to psychopathology exhibited in women during pregnancy and postpartum and should be investigated.

RECENT FINDINGS

The stress response activates the HPA axis and dysregulates the ANS, leading to the inhibition of the parasympathetic system. Sustained high levels of cortisol, reduced heart variability, and modulated immune responses increase the vulnerability to PMAD. Bidirectional communication between the nervous system and the microbiota is an important factor to alter host homeostasis and development of PMAD. Future research in the relationship between the psychoneuroimmune system, the gut microbiota, and PMAD has the potential to be integrated in clinical practice to improve screening, diagnosis, and treatment.

Automatic detection of major depressive disorder using electrodermal activity

Major depressive disorder (MDD) is a common psychiatric disorder and the leading cause of disability worldwide. However, current methods used to diagnose depression mainly rely on clinical interviews and self-reported scales of depressive symptoms, which lack objectivity and efficiency. To address this challenge, we present a machine learning approach to screen for MDD using electrodermal activity (EDA). Participants included 30 patients with MDD and 37 healthy controls. Their EDA was measured during five experimental phases consisted of baseline, mental arithmetic task, recovery from the stress task, relaxation task, and recovery from the relaxation task, which elicited multiple alterations in autonomic activity. Selected EDA features were extracted from each phase, and differential EDA features between two distinct phases were evaluated. By using these features as input data and performing feature selection with SVM-RFE, 74% accuracy, 74% sensitivity, and 71% specificity could be achieved by our decision tree classifier. The most relevant features selected by SVM-RFE included differential EDA features and features from the stress and relaxation tasks. These findings suggest that automatic detection of depression based on EDA features is feasible and that monitoring changes in physiological signal when a subject is experiencing autonomic arousal and recovery may enhance discrimination power.

Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensors

Affective Computing has emerged as an important field of study that aims to develop systems that can automatically recognize emotions. Up to the present, elicitation has been carried out with non-immersive stimuli. This study, on the other hand, aims to develop an emotion recognition system for affective states evoked through Immersive Virtual Environments. Four alternative virtual rooms were designed to elicit four possible arousal-valence combinations, as described in each quadrant of the Circumplex Model of Affects. An experiment involving the recording of the electroencephalography (EEG) and electrocardiography (ECG) of sixty participants was carried out. A set of features was extracted from these signals using various state-of-the-art metrics that quantify brain and cardiovascular linear and nonlinear dynamics, which were input into a Support Vector Machine classifier to predict the subject’s arousal and valence perception. The model’s accuracy was 75.00% along the arousal dimension and 71.21% along the valence dimension. Our findings validate the use of Immersive Virtual Environments to elicit and automatically recognize different emotional states from neural and cardiac dynamics; this development could have novel applications in fields as diverse as Architecture, Health, Education and Videogames.

Identifying the Causes of Drivers' Hazardous States Using Driver Characteristics, Vehicle Kinematics, and Physiological Measurements

Drivers’ hazardous physical and mental states (e.g., distraction, fatigue, stress, and high workload) have a major effect on driving performance and strongly contribute to 25–50% of all traffic accidents. They are caused by numerous factors, such as cell phone use or lack of sleep. However, while significant research has been done on detecting hazardous states, most studies have not tried to identify the causes of the hazardous states. Such information would be very useful, as it would allow intelligent vehicles to better respond to a detected hazardous state. Thus, this study examined whether the cause of a driver’s hazardous state can be automatically identified using a combination of driver characteristics, vehicle kinematics, and physiological measures. Twenty-one healthy participants took part in four 45-min sessions of simulated driving, of which they were mildly sleep-deprived for two sessions. Within each session, there were eight different scenarios with different weather (sunny or snowy), traffic density and cell phone usage (with or without cell phone). During each scenario, four physiological (respiration, electrocardiogram, skin conductance, and body temperature) and eight vehicle kinematics measures were monitored. Additionally, three self-reported driver characteristics were obtained: personality, stress level, and mood. Three feature sets were formed based on driver characteristics, vehicle kinematics, and physiological signals. All possible combinations of the three feature sets were used to classify sleep deprivation (drowsy vs. alert), traffic density (low vs. high), cell phone use, and weather conditions (foggy/snowy vs. sunny) with highest accuracies of 98.8%, 91.4%, 82.3%, and 71.5%, respectively. Vehicle kinematics were most useful for classification of weather and traffic density while physiology and driver characteristics were useful for classification of sleep deprivation and cell phone use. Furthermore, a second classification scheme was tested that also incorporates information about whether or not other causes of hazardous states are present, though this did not result in higher classification accuracy. In the future, these classifiers could be used to identify both the presence and cause of a driver’s hazardous state, which could serve as the basis for more intelligent intervention systems.

Correlations Between Objective Behavioral Features Collected From Mobile and Wearable Devices and Depressive Mood Symptoms in Patients With Affective Disorders: Systematic Review

Background

Several studies have recently reported on the correlation between objective behavioral features collected via mobile and wearable devices and depressive mood symptoms in patients with affective disorders (unipolar and bipolar disorders). However, individual studies have reported on different and sometimes contradicting results, and no quantitative systematic review of the correlation between objective behavioral features and depressive mood symptoms has been published.

Objective

The objectives of this systematic review were to (1) provide an overview of the correlations between objective behavioral features and depressive mood symptoms reported in the literature and (2) investigate the strength and statistical significance of these correlations across studies. The answers to these questions could potentially help identify which objective features have shown most promising results across studies.

Methods

We conducted a systematic review of the scientific literature, reported according to the preferred reporting items for systematic reviews and meta-analyses guidelines. IEEE Xplore, ACM Digital Library, Web of Sciences, PsychINFO, PubMed, DBLP computer science bibliography, HTA, DARE, Scopus, and Science Direct were searched and supplemented by hand examination of reference lists. The search ended on April 27, 2017, and was limited to studies published between 2007 and 2017.

Results

A total of 46 studies were eligible for the review. These studies identified and investigated 85 unique objective behavioral features, covering 17 various sensor data inputs. These features were divided into 7 categories. Several features were found to have statistically significant and consistent correlation directionality with mood assessment (eg, the amount of home stay, sleep duration, and vigorous activity), while others showed directionality discrepancies across the studies (eg, amount of text messages [short message service] sent, time spent between locations, and frequency of mobile phone screen activity).

Conclusions

Several studies showed consistent and statistically significant correlations between objective behavioral features collected via mobile and wearable devices and depressive mood symptoms. Hence, continuous and everyday monitoring of behavioral aspects in affective disorders could be a promising supplementary objective measure for estimating depressive mood symptoms. However, the evidence is limited by methodological issues in individual studies and by a lack of standardization of (1) the collected objective features, (2) the mood assessment methodology, and (3) the statistical methods applied. Therefore, consistency in data collection and analysis in future studies is needed, making replication studies as well as meta-analyses possible.

Investigation of Lagged Poincaré Plot reliability in ultra-short synthetic and experimental Heart Rate Variability series

This study reports on the reliability of Lagged Poincaré Plot (LPP) parameters calculated from ultra-short cardiovascular time series (from 30 to 180 seconds). ity (HRV) signals, whereas a few studies have studied nonlinear approaches. Particularly, methods derived from the phase-space theory, especially the ones employing multi-lag analyses, are usually considered to be inaccurate with a low number of samples. Here we propose a comprehensive study about LPP, using both synthetic and real RR series. Specifically, we considered 109 5-minutes HRV series: 60 synthetic series generated through the Integral Pulse Frequency Modulation (IPFM) model and 49 experimental series acquired from healthy subjects during resting-state. Three parameters have been extracted through the ellipse-fitting method, SD1, SD2 and S, using ten values of lag. All LPP parameters were estimated by averaging estimates gathered from segments of 30, 120 and 180 seconds, and compared with the once from 5-minute series. Results showed Spearman's correlation coefficients higher than 0.9 in both synthetic and real series. In conclusion, SD1 gave promising results in terms of percentage absolute error, when it was extracted from series with a duration less than three minutes.

Self-reported well-being score modelling and prediction: Proof-of-concept of an approach based on linear dynamic systems

Assessment and recognition of perceived well-being has wide applications in the development of assistive healthcare systems for people with physical and mental disorders. In practical data collection, these systems need to be less intrusive, and respect users' autonomy and willingness as much as possible. As a result, self-reported data are not necessarily available at all times. Conventional classifiers, which usually require feature vectors of a prefixed dimension, are not well suited for this problem. To address the issue of non-uniformly sampled measurements, in this study we propose a method for the modelling and prediction of self-reported well-being scores based on a linear dynamic system. Within the model, we formulate different features as observations, making predictions even in the presence of inconsistent and irregular data. We evaluate the proposed method with synthetic data, as well as real data from two patients diagnosed with cancer. In the latter, self-reported scores from three well-being-related scales were collected over a period of approximately 60 days. Prompted each day, the patients had the choice whether to respond or not. Results show that the proposed model is able to track and predict the patients' perceived well-being dynamics despite the irregularly sampled data.

Heartbeat Complexity Modulation in Bipolar Disorder during Daytime and Nighttime

This study reports on the complexity modulation of heartbeat dynamics in patients affected by bipolar disorder. In particular, a multiscale entropy analysis was applied to the R-R interval series, that were derived from electrocardiographic (ECG) signals for a group of nineteen subjects comprised of eight patients and eleven healthy control subjects. They were monitored using a textile-based sensorized t-shirt during the day and overnight for a total of 47 diurnal and 27 nocturnal recordings. Patients showed three different mood states: depression, hypomania and euthymia. Results show a clear loss of complexity during depressive and hypomanic states as compared to euthymic and healthy control states. In addition, we observed that a more significant complexity modulation among healthy and pathological mood states occurs during the night. These findings suggest that bipolar disorder is associated with an enhanced sleep-related dysregulation of the Autonomic Nervous System (ANS) activity, and that heartbeat complex dynamics may serve as a viable marker of pathological conditions in mental health.

Assessing mood symptoms through heartbeat dynamics: An HRV study on cardiosurgical patients

BACKGROUND

Heart Rate Variability (HRV) is reduced both in depression and in coronary heart disease (CHD) suggesting common pathophysiological mechanisms for the two disorders. Within CHD, cardiac surgery patients (CSP) with postoperative depression are at greater risk of adverse cardiac events. Therefore, CSP would especially benefit from depression early diagnosis. Here we tested whether HRV-multi-feature analysis discriminates CSP with or without depression and provides an effective estimation of symptoms severity.

METHODS

Thirty-one patients admitted to cardiac rehabilitation after first-time cardiac surgery were recruited. Depressive symptoms were assessed with the Center for Epidemiologic Studies Depression Scale (CES-D). HRV features in time, frequency, and nonlinear domains were extracted from 5-min-ECG recordings at rest and used as predictors of "least absolute shrinkage and selection" (LASSO) operator regression model to estimate patients' CES-D score and to predict depressive state.

RESULTS

The model significantly predicted the CES-D score in all subjects (the total explained variance of CES-D score was 89.93%). Also it discriminated depressed and non-depressed CSP with 86.75% accuracy. Seven of the ten most informative metrics belonged to non-linear-domain.

LIMITATIONS

A higher number of patients evaluated also with a structured clinical interview would help to generalize the present findings.

DISCUSSION

To our knowledge this is the first study using a multi-feature approach to evaluate depression in CSP. The high informative power of HRV-nonlinear metrics suggests their possible pathophysiological role both in depression and in CHD. The high-accuracy of the algorithm at single-subject level opens to its translational use as screening tool in clinical practice.

Nonlinear analysis of heart rate variability for the assessment of Dysphoria

Dysphoric patients show symptoms associated with Major Depression, although within a narrowed symptomatology spectrum. In prevailing practice, clinicians assess Dysphoria through psychological scores and questionnaires exclusively, therefore without taking into account objective biomarkers. In this study, we investigated heartbeat linear and nonlinear dynamics aiming to an objective assessment of Dysphoria. To this end, we derived standard and nonlinear measures from heart rate variability (HRV) series gathered from dysphoric (n=14) and nondysphoric (n=17) undergraduate students during 5 minutes of resting state. We performed both statistical and pattern recognition analyses in order to discern the two groups. Results showed significant group-wise differences in HRV nonlinear metrics exclusively, suggesting a crucial role of nonlinear sympatho-vagal dynamics in Dysphoria. Furthermore, we achieved a classification accuracy of 77.52% for the automatic identification of Dysphoria at a single-subject level.

Smartphone-Based Monitoring of Objective and Subjective Data in Affective Disorders: Where Are We and Where Are We Going? Systematic Review

Background

Electronic mental health interventions for mood disorders have increased rapidly over the past decade, most recently in the form of various systems and apps that are delivered via smartphones.

Objective

We aim to provide an overview of studies on smartphone-based systems that combine subjective ratings with objectively measured data for longitudinal monitoring of patients with affective disorders. Specifically, we aim to examine current knowledge on: (1) the feasibility of, and adherence to, such systems; (2) the association of monitored data with mood status; and (3) the effects of monitoring on clinical outcomes.

Methods

We systematically searched PubMed, Web of Science, PsycINFO, and the Cochrane Central Register of Controlled Trials for relevant articles published in the last ten years (2007-2017) by applying Boolean search operators with an iterative combination of search terms, which was conducted in February 2017. Additional articles were identified via pearling, author correspondence, selected reference lists, and trial protocols.

Results

A total of 3463 unique records were identified. Twenty-nine studies met the inclusion criteria and were included in the review. The majority of articles represented feasibility studies (n=27); two articles reported results from one randomized controlled trial (RCT). In total, six different self-monitoring systems for affective disorders that used subjective mood ratings and objective measurements were included. These objective parameters included physiological data (heart rate variability), behavioral data (phone usage, physical activity, voice features), and context/environmental information (light exposure and location). The included articles contained results regarding feasibility of such systems in affective disorders, showed reasonable accuracy in predicting mood status and mood fluctuations based on the objectively monitored data, and reported observations about the impact of monitoring on clinical state and adherence of patients to the system usage.

Conclusions

The included observational studies and RCT substantiate the value of smartphone-based approaches for gathering long-term objective data (aside from self-ratings to monitor clinical symptoms) to predict changes in clinical states, and to investigate causal inferences about state changes in patients with affective disorders. Although promising, a much larger evidence-base is necessary to fully assess the potential and the risks of these approaches. Methodological limitations of the available studies (eg, small sample sizes, variations in the number of observations or monitoring duration, lack of RCT, and heterogeneity of methods) restrict the interpretability of the results. However, a number of study protocols stated ambitions to expand and intensify research in this emerging and promising field.

Longitudinal monitoring of heartbeat dynamics predicts mood changes in bipolar patients: A pilot study

OBJECTIVES

Recent research indicates that Heart Rate Variability (HRV) is affected in Bipolar Disorders (BD) patients. To determine whether such alterations are a mere expression of the current mood state or rather contain longitudinal information on BD course, we examined the potential influence of states adjacent in time upon HRV features measured in a target mood state.

METHODS

Longitudinal evaluation of HRV was obtained in eight BD patients by using a wearable monitoring system developed within the PSYCHE project. We extracted time-domain, frequency-domain and non-linear HRV-features and trained a Support Vector Machine (SVM) to classify HRV-features according to mood state. To evaluate the influence of adjacent mood states, we trained SVM with different HRV-feature sets: 1) belonging to each mood state considered alone; 2) belonging to each mood state and normalized using information from the preceding mood state; 3) belonging to each mood state and normalized using information from the preceding and subsequent mood states; 4) belonging to each mood state and normalized using information from two randomly chosen states.

RESULTS

SVM classification accuracy within a target state was significantly greater when HRV-features from the previous and subsequent mood states were considered.

CONCLUSIONS

Although preliminary and in need of replications our results suggest for the first time that psychophysiological states in BD contain information related to the subsequent ones. Such characteristic may be used to improve clinical management and to develop algorithms to predict clinical course and mood switches in individual patients.