1
|
Hu X, Sgherza TR, Nothrup JB, Fresco DM, Naragon-Gainey K, Bylsma LM. From lab to life: Evaluating the reliability and validity of psychophysiological data from wearable devices in laboratory and ambulatory settings. Behav Res Methods 2024:10.3758/s13428-024-02387-3. [PMID: 38528248 DOI: 10.3758/s13428-024-02387-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/02/2024] [Indexed: 03/27/2024]
Abstract
Despite the increasing popularity of ambulatory assessment, the reliability and validity of psychophysiological signals from wearable devices is unproven in daily life settings. We evaluated the reliability and validity of physiological signals (electrocardiogram, ECG; photoplethysmography, PPG; electrodermal activity, EDA) collected from two wearable devices (Movisens EcgMove4 and Empatica E4) in the lab (N = 67) and daily life (N = 20) among adults aged 18-64 with Mindware as the laboratory gold standard. Results revealed that both wearable devices' valid data rates in daily life were lower than in the laboratory (Movisens ECG 82.94 vs. 93.10%, Empatica PPG 8.79 vs. 26.14%, and Empatica EDA 41.16 vs. 42.67%, respectively). The poor valid data rates of Empatica PPG signals in the laboratory could be partially attributed to participants' hand movements (r = - .27, p = .03). In laboratory settings, heart rate (HR) derived from both wearable devices exhibited higher concurrent validity than heart rate variability (HRV) metrics (ICCs 0.98-1.00 vs. 0.75-0.97). The number of skin conductance responses (SCRs) derived from Empatica showed higher concurrent validity than skin conductance level (SCL, ICCs 0.38 vs. 0.09). Movisens EcgMove4 provided more reliable and valid HRV measurements than Empatica E4 in both laboratory (split-half reliability: 0.95-0.99 vs. 0.85-0.98; concurrent validity: 0.95-1.00 vs. 0.75-0.98; valid data rate: 93.10 vs. 26.14%) and ambulatory settings (split-half reliability: 0.99-1.00 vs. 0.89-0.98; valid data rate: 82.94 vs. 8.79%). Although the reliability and validity of wearable devices are improving, findings suggest researchers should select devices that yield consistently robust and valid data for their measures of interest.
Collapse
Affiliation(s)
- Xin Hu
- Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Tanika R Sgherza
- School of Psychological Science, University of Western Australia, Perth, Australia
| | - Jessie B Nothrup
- Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - David M Fresco
- Department of Psychiatry, University of Michigan, Ann Arbor, MI, USA
| | | | - Lauren M Bylsma
- Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA.
- Department of Psychology, University of Pittsburgh, Pittsburgh, PA, USA.
| |
Collapse
|
2
|
Vitazkova D, Foltan E, Kosnacova H, Micjan M, Donoval M, Kuzma A, Kopani M, Vavrinsky E. Advances in Respiratory Monitoring: A Comprehensive Review of Wearable and Remote Technologies. BIOSENSORS 2024; 14:90. [PMID: 38392009 PMCID: PMC10886711 DOI: 10.3390/bios14020090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 01/28/2024] [Accepted: 02/03/2024] [Indexed: 02/24/2024]
Abstract
This article explores the importance of wearable and remote technologies in healthcare. The focus highlights its potential in continuous monitoring, examines the specificity of the issue, and offers a view of proactive healthcare. Our research describes a wide range of device types and scientific methodologies, starting from traditional chest belts to their modern alternatives and cutting-edge bioamplifiers that distinguish breathing from chest impedance variations. We also investigated innovative technologies such as the monitoring of thorax micromovements based on the principles of seismocardiography, ballistocardiography, remote camera recordings, deployment of integrated optical fibers, or extraction of respiration from cardiovascular variables. Our review is extended to include acoustic methods and breath and blood gas analysis, providing a comprehensive overview of different approaches to respiratory monitoring. The topic of monitoring respiration with wearable and remote electronics is currently the center of attention of researchers, which is also reflected by the growing number of publications. In our manuscript, we offer an overview of the most interesting ones.
Collapse
Affiliation(s)
- Diana Vitazkova
- Institute of Electronics and Photonics, Faculty of Electrical Engineering and Information Technology, Slovak University of Technology, Ilkovicova 3, 81219 Bratislava, Slovakia; (E.F.); (H.K.); (M.M.); (M.D.); (A.K.)
| | - Erik Foltan
- Institute of Electronics and Photonics, Faculty of Electrical Engineering and Information Technology, Slovak University of Technology, Ilkovicova 3, 81219 Bratislava, Slovakia; (E.F.); (H.K.); (M.M.); (M.D.); (A.K.)
| | - Helena Kosnacova
- Institute of Electronics and Photonics, Faculty of Electrical Engineering and Information Technology, Slovak University of Technology, Ilkovicova 3, 81219 Bratislava, Slovakia; (E.F.); (H.K.); (M.M.); (M.D.); (A.K.)
- Department of Simulation and Virtual Medical Education, Faculty of Medicine, Comenius University, Sasinkova 4, 81272 Bratislava, Slovakia
| | - Michal Micjan
- Institute of Electronics and Photonics, Faculty of Electrical Engineering and Information Technology, Slovak University of Technology, Ilkovicova 3, 81219 Bratislava, Slovakia; (E.F.); (H.K.); (M.M.); (M.D.); (A.K.)
| | - Martin Donoval
- Institute of Electronics and Photonics, Faculty of Electrical Engineering and Information Technology, Slovak University of Technology, Ilkovicova 3, 81219 Bratislava, Slovakia; (E.F.); (H.K.); (M.M.); (M.D.); (A.K.)
| | - Anton Kuzma
- Institute of Electronics and Photonics, Faculty of Electrical Engineering and Information Technology, Slovak University of Technology, Ilkovicova 3, 81219 Bratislava, Slovakia; (E.F.); (H.K.); (M.M.); (M.D.); (A.K.)
| | - Martin Kopani
- Institute of Medical Physics, Biophysics, Informatics and Telemedicine, Faculty of Medicine, Comenius University, Sasinkova 2, 81272 Bratislava, Slovakia;
| | - Erik Vavrinsky
- Institute of Electronics and Photonics, Faculty of Electrical Engineering and Information Technology, Slovak University of Technology, Ilkovicova 3, 81219 Bratislava, Slovakia; (E.F.); (H.K.); (M.M.); (M.D.); (A.K.)
- Institute of Medical Physics, Biophysics, Informatics and Telemedicine, Faculty of Medicine, Comenius University, Sasinkova 2, 81272 Bratislava, Slovakia;
| |
Collapse
|
3
|
王 渝, 王 佳, 张 健, 罗 泽, 郭 应, 张 政, 喻 鹏. [A wearable six-minute walk-based system to predict postoperative pulmonary complications after cardiac valve surgery: an exploratory study]. SHENG WU YI XUE GONG CHENG XUE ZA ZHI = JOURNAL OF BIOMEDICAL ENGINEERING = SHENGWU YIXUE GONGCHENGXUE ZAZHI 2023; 40:1117-1125. [PMID: 38151934 PMCID: PMC10753314 DOI: 10.7507/1001-5515.202305007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 05/07/2023] [Revised: 10/30/2023] [Indexed: 12/29/2023]
Abstract
In recent years, wearable devices have seen a booming development, and the integration of wearable devices with clinical settings is an important direction in the development of wearable devices. The purpose of this study is to establish a prediction model for postoperative pulmonary complications (PPCs) by continuously monitoring respiratory physiological parameters of cardiac valve surgery patients during the preoperative 6-Minute Walk Test (6MWT) with a wearable device. By enrolling 53 patients with cardiac valve diseases in the Department of Cardiovascular Surgery, West China Hospital, Sichuan University, the grouping was based on the presence or absence of PPCs in the postoperative period. The 6MWT continuous respiratory physiological parameters collected by the SensEcho wearable device were analyzed, and the group differences in respiratory parameters and oxygen saturation parameters were calculated, and a prediction model was constructed. The results showed that continuous monitoring of respiratory physiological parameters in 6MWT using a wearable device had a better predictive trend for PPCs in cardiac valve surgery patients, providing a novel reference model for integrating wearable devices with the clinic.
Collapse
Affiliation(s)
- 渝强 王
- 四川大学华西医院 心脏大血管外科(成都 610041)Department of Cardiovascular Surgery, West China Hospital, Sichuan University, Chengdu 610041, P. R. China
| | - 佳晨 王
- 四川大学华西医院 心脏大血管外科(成都 610041)Department of Cardiovascular Surgery, West China Hospital, Sichuan University, Chengdu 610041, P. R. China
| | - 健 张
- 四川大学华西医院 心脏大血管外科(成都 610041)Department of Cardiovascular Surgery, West China Hospital, Sichuan University, Chengdu 610041, P. R. China
| | - 泽汝心 罗
- 四川大学华西医院 心脏大血管外科(成都 610041)Department of Cardiovascular Surgery, West China Hospital, Sichuan University, Chengdu 610041, P. R. China
| | - 应强 郭
- 四川大学华西医院 心脏大血管外科(成都 610041)Department of Cardiovascular Surgery, West China Hospital, Sichuan University, Chengdu 610041, P. R. China
| | - 政波 张
- 四川大学华西医院 心脏大血管外科(成都 610041)Department of Cardiovascular Surgery, West China Hospital, Sichuan University, Chengdu 610041, P. R. China
| | - 鹏铭 喻
- 四川大学华西医院 心脏大血管外科(成都 610041)Department of Cardiovascular Surgery, West China Hospital, Sichuan University, Chengdu 610041, P. R. China
| |
Collapse
|
4
|
Ghomrawi HMK, O'Brien MK, Carter M, Macaluso R, Khazanchi R, Fanton M, DeBoer C, Linton SC, Zeineddin S, Pitt JB, Bouchard M, Figueroa A, Kwon S, Holl JL, Jayaraman A, Abdullah F. Applying machine learning to consumer wearable data for the early detection of complications after pediatric appendectomy. NPJ Digit Med 2023; 6:148. [PMID: 37587211 PMCID: PMC10432429 DOI: 10.1038/s41746-023-00890-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Accepted: 08/01/2023] [Indexed: 08/18/2023] Open
Abstract
When children are discharged from the hospital after surgery, their caregivers often rely on subjective assessments (e.g., appetite, fatigue) to monitor postoperative recovery as objective assessment tools are scarce at home. Such imprecise and one-dimensional evaluations can result in unwarranted emergency department visits or delayed care. To address this gap in postoperative monitoring, we evaluated the ability of a consumer-grade wearable device, Fitbit, which records multimodal data about daily physical activity, heart rate, and sleep, in detecting abnormal recovery early in children recovering after appendectomy. One hundred and sixty-two children, ages 3-17 years old, who underwent an appendectomy (86 complicated and 76 simple cases of appendicitis) wore a Fitbit device on their wrist for 21 days postoperatively. Abnormal recovery events (i.e., abnormal symptoms or confirmed postoperative complications) that arose during this period were gathered from medical records and patient reports. Fitbit-derived measures, as well as demographic and clinical characteristics, were used to train machine learning models to retrospectively detect abnormal recovery in the two days leading up to the event for patients with complicated and simple appendicitis. A balanced random forest classifier accurately detected 83% of these abnormal recovery days in complicated appendicitis and 70% of abnormal recovery days in simple appendicitis prior to the true report of a symptom/complication. These results support the development of machine learning algorithms to predict onset of abnormal symptoms and complications in children undergoing surgery, and the use of consumer wearables as monitoring tools for early detection of postoperative events.
Collapse
Affiliation(s)
- Hassan M K Ghomrawi
- Department of Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
- Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
- Center for Health Services and Outcomes Research, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
- Center for Global Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
- Department of Medicine (Rheumatology), Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | | | - Michela Carter
- Department of Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
- Division of Pediatric Surgery, Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| | | | - Rushmin Khazanchi
- Shirley Ryan AbilityLab, Chicago, IL, USA
- Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | | | - Christopher DeBoer
- Department of Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
- Division of Pediatric Surgery, Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| | - Samuel C Linton
- Department of Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
- Division of Pediatric Surgery, Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| | - Suhail Zeineddin
- Department of Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
- Division of Pediatric Surgery, Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| | - J Benjamin Pitt
- Department of Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
- Division of Pediatric Surgery, Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| | - Megan Bouchard
- Department of Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
- Division of Pediatric Surgery, Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| | - Angie Figueroa
- Division of Pediatric Surgery, Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| | - Soyang Kwon
- Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
- Department of Pediatrics, Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| | - Jane L Holl
- Department of Neurology and Center for Healthcare Delivery Science and Innovation, Biological Sciences Division, University of Chicago, Chicago, IL, USA
| | - Arun Jayaraman
- Shirley Ryan AbilityLab, Chicago, IL, USA
- Department of Physical Medicine and Rehabilitation, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
- Department of Physical Therapy and Human Movement Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Fizan Abdullah
- Department of Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
- Center for Global Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
- Division of Pediatric Surgery, Ann and Robert H. Lurie Children's Hospital of Chicago, 225 East Chicago Avenue, Box 63, Chicago, IL, 60611, USA.
| |
Collapse
|