1
|
Krbec BA, Zhang X, Chityat I, Brady-Mine A, Linton E, Copeland D, Anthony BW, Edelman ER, Davis JM. Emerging innovations in neonatal monitoring: a comprehensive review of progress and potential for non-contact technologies. Front Pediatr 2024; 12:1442753. [PMID: 39494377 PMCID: PMC11528303 DOI: 10.3389/fped.2024.1442753] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/02/2024] [Accepted: 09/11/2024] [Indexed: 11/05/2024] Open
Abstract
Continuous monitoring of high-risk neonates is essential for the timely management of medical conditions. However, the current reliance on wearable or contact sensor technologies for vital sign monitoring often leads to complications including discomfort, skin damage, and infections which can impede medical management, nursing care, and parental bonding. Moreover, the dependence on multiple devices is problematic since they are not interconnected or time-synchronized, use a variety of different wires and probes/sensors, and are designed based on adult specifications. Therefore, there is an urgent unmet need to enable development of wireless, non- or minimal-contact, and non-adhesive technologies capable of integrating multiple signals into a single platform, specifically designed for neonates. This paper summarizes the limitations of existing wearable devices for neonates, discusses advancements in non-contact sensor technologies, and proposes directions for future research and development.
Collapse
Affiliation(s)
- Brooke A. Krbec
- Division of Newborn Medicine, Tufts Medical Center, Boston, MA, United States
| | - Xiang Zhang
- Institute for Medical Engineering and Science, Department of Mechanical Engineering, Center for Clinical and Translational Research, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Inbar Chityat
- Institute for Medical Engineering and Science, Department of Mechanical Engineering, Center for Clinical and Translational Research, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Alexandria Brady-Mine
- Institute for Medical Engineering and Science, Department of Mechanical Engineering, Center for Clinical and Translational Research, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Evan Linton
- Institute for Medical Engineering and Science, Department of Mechanical Engineering, Center for Clinical and Translational Research, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Daniel Copeland
- Institute for Medical Engineering and Science, Department of Mechanical Engineering, Center for Clinical and Translational Research, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Brian W. Anthony
- Institute for Medical Engineering and Science, Department of Mechanical Engineering, Center for Clinical and Translational Research, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Elazer R. Edelman
- Institute for Medical Engineering and Science, Department of Mechanical Engineering, Center for Clinical and Translational Research, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Jonathan M. Davis
- Division of Newborn Medicine, Tufts Medical Center, Boston, MA, United States
- Tufts Clinical and Translational Science Institute, Tufts University School of Medicine, Boston, MA, United States
| |
Collapse
|
2
|
van der Linden M, Veldhoen ES, Arasteh E, Long X, Alderliesten T, de Goederen R, Dudink J. Noncontact respiration monitoring techniques in young children: A scoping review. Pediatr Pulmonol 2024; 59:1871-1884. [PMID: 38661255 DOI: 10.1002/ppul.27028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 03/22/2024] [Accepted: 04/14/2024] [Indexed: 04/26/2024]
Abstract
Pediatric sleep-related breathing disorders, or sleep-disordered breathing (SDB), cover a range of conditions, including obstructive sleep apnea, central sleep apnea, sleep-related hypoventilation disorders, and sleep-related hypoxemia disorder. Pediatric SDB is often underdiagnosed, potentially due to difficulties associated with performing the gold standard polysomnography in children. This scoping review aims to: (1) provide an overview of the studies reporting on safe, noncontact monitoring of respiration in young children, (2) describe the accuracy of these techniques, and (3) highlight their respective advantages and limitations. PubMed and EMBASE were searched for studies researching techniques in children <12 years old. Both quantitative data and the quality of the studies were analyzed. The evaluation of study quality was conducted using the QUADAS-2 tool. A total of 19 studies were included. Techniques could be grouped into bed-based methods, microwave radar, video, infrared (IR) cameras, and garment-embedded sensors. Most studies either measured respiratory rate (RR) or detected apneas; n = 2 aimed to do both. At present, bed-based approaches are at the forefront of research in noncontact RR monitoring in children, boasting the most sophisticated algorithms in this field. Yet, despite extensive studies, there remains no consensus on a definitive method that outperforms the rest. The accuracies reported by these studies tend to cluster within a similar range, indicating that no single technique has emerged as markedly superior. Notably, all identified methods demonstrate capability in detecting body movements and RR, with reported safety for use in children across the board. Further research into contactless alternatives should focus on cost-effectiveness, ease-of-use, and widespread availability.
Collapse
Affiliation(s)
- Marjolein van der Linden
- Department of Neonatology, Wilhelmina Children's Hospital, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Esther S Veldhoen
- Department of Pediatric Intensive Care, Wilhelmina Children's Hospital, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
- Center of Home Mechanical Ventilation, Wilhelmina Children's Hospital, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Emad Arasteh
- Department of Neonatology, Wilhelmina Children's Hospital, University Medical Center Utrecht, Utrecht, The Netherlands
- Department of Electrical Engineering (ESAT), STADIUS Center for Dynamical Systems, Signal Processing and Data Analytics, KU Leuven, Leuven, Belgium
| | - Xi Long
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Thomas Alderliesten
- Department of Pediatric Intensive Care, Wilhelmina Children's Hospital, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Robbin de Goederen
- Department of Neonatology, Wilhelmina Children's Hospital, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Jeroen Dudink
- Department of Neonatology, Wilhelmina Children's Hospital, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
3
|
Huang B, Hu S, Liu Z, Lin CL, Su J, Zhao C, Wang L, Wang W. Challenges and prospects of visual contactless physiological monitoring in clinical study. NPJ Digit Med 2023; 6:231. [PMID: 38097771 PMCID: PMC10721846 DOI: 10.1038/s41746-023-00973-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2023] [Accepted: 11/21/2023] [Indexed: 12/17/2023] Open
Abstract
The monitoring of physiological parameters is a crucial topic in promoting human health and an indispensable approach for assessing physiological status and diagnosing diseases. Particularly, it holds significant value for patients who require long-term monitoring or with underlying cardiovascular disease. To this end, Visual Contactless Physiological Monitoring (VCPM) is capable of using videos recorded by a consumer camera to monitor blood volume pulse (BVP) signal, heart rate (HR), respiratory rate (RR), oxygen saturation (SpO2) and blood pressure (BP). Recently, deep learning-based pipelines have attracted numerous scholars and achieved unprecedented development. Although VCPM is still an emerging digital medical technology and presents many challenges and opportunities, it has the potential to revolutionize clinical medicine, digital health, telemedicine as well as other areas. The VCPM technology presents a viable solution that can be integrated into these systems for measuring vital parameters during video consultation, owing to its merits of contactless measurement, cost-effectiveness, user-friendly passive monitoring and the sole requirement of an off-the-shelf camera. In fact, the studies of VCPM technologies have been rocketing recently, particularly AI-based approaches, but few are employed in clinical settings. Here we provide a comprehensive overview of the applications, challenges, and prospects of VCPM from the perspective of clinical settings and AI technologies for the first time. The thorough exploration and analysis of clinical scenarios will provide profound guidance for the research and development of VCPM technologies in clinical settings.
Collapse
Affiliation(s)
- Bin Huang
- AI Research Center, Hangzhou Innovation Institute, Beihang University, 99 Juhang Rd., Binjiang Dist., Hangzhou, Zhejiang, China.
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, China.
| | - Shen Hu
- Department of Obstetrics, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, Zhejiang, China
- Department of Epidemiology, The Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Zimeng Liu
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, China
| | - Chun-Liang Lin
- College of Electrical Engineering and Computer Science, National Chung Hsing University, 145 Xingda Rd., South Dist., Taichung, Taiwan.
| | - Junfeng Su
- Department of General Intensive Care Unit, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, Zhejiang, China
- Key Laboratory of Early Warning and Intervention of Multiple Organ Failure, China National Ministry of Education, Hangzhou, Zhejiang, China
| | - Changchen Zhao
- AI Research Center, Hangzhou Innovation Institute, Beihang University, 99 Juhang Rd., Binjiang Dist., Hangzhou, Zhejiang, China
| | - Li Wang
- Department of Rehabilitation Medicine, The First Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, Zhejiang, China
| | - Wenjin Wang
- Department of Biomedical Engineering, Southern University of Science and Technology, 1088 Xueyuan Ave, Nanshan Dist., Shenzhen, Guangdong, China.
| |
Collapse
|
4
|
Arasteh E, Veldhoen ES, Long X, van Poppel M, van der Linden M, Alderliesten T, Nijman J, de Goederen R, Dudink J. Ultra-Wideband Radar for Simultaneous and Unobtrusive Monitoring of Respiratory and Heart Rates in Early Childhood: A Deep Transfer Learning Approach. SENSORS (BASEL, SWITZERLAND) 2023; 23:7665. [PMID: 37765721 PMCID: PMC10535330 DOI: 10.3390/s23187665] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Revised: 08/31/2023] [Accepted: 09/02/2023] [Indexed: 09/29/2023]
Abstract
Unobtrusive monitoring of children's heart rate (HR) and respiratory rate (RR) can be valuable for promoting the early detection of potential health issues, improving communication with healthcare providers and reducing unnecessary hospital visits. A promising solution for wireless vital sign monitoring is radar technology. This paper presents a novel approach for the simultaneous estimation of children's RR and HR utilizing ultra-wideband (UWB) radar using a deep transfer learning algorithm in a cohort of 55 children. The HR and RR are calculated by processing radar signals via spectrogram from time epochs of 10 s (25 sample length of hamming window with 90% overlap) and then transforming the resultant representation into 2-dimensional images. These images were fed into a pre-trained Visual Geometry Group-16 (VGG-16) model (trained on ImageNet dataset), with weights of five added layers fine-tuned using the proposed data. The prediction on the test data achieved a mean absolute error (MAE) of 7.3 beats per minute (BPM < 6.5% of average HR) and 2.63 breaths per minute (BPM < 7% of average RR). We also achieved a significant Pearson's correlation of 77% and 81% between true and extracted for HR and RR, respectively. HR and RR samples are extracted every 10 s.
Collapse
Affiliation(s)
- Emad Arasteh
- Department of Neonatology, University Medical Center Utrecht, Wilhelmina Children’s Hospital, 3508 EA Utrecht, The Netherlands; (E.A.); (M.v.d.L.); (T.A.); (R.d.G.)
- Department of Electrical Engineering (ESAT), STADIUS Center for Dynamical Systems, Signal Processing and Data Analytics, KU Leuven, 3001 Leuven, Belgium
| | - Esther S. Veldhoen
- Pediatric Intensive Care Unit and Center of Home Mechanical Ventilation, University Medical Center Utrecht, Wilhelmina Children’s Hospital, 3508 EA Utrecht, The Netherlands; (E.S.V.); (M.v.P.); (J.N.)
| | - Xi Long
- Department of Electrical Engineering, Eindhoven University of Technology, 5612 AE Eindhoven, The Netherlands;
| | - Maartje van Poppel
- Pediatric Intensive Care Unit and Center of Home Mechanical Ventilation, University Medical Center Utrecht, Wilhelmina Children’s Hospital, 3508 EA Utrecht, The Netherlands; (E.S.V.); (M.v.P.); (J.N.)
| | - Marjolein van der Linden
- Department of Neonatology, University Medical Center Utrecht, Wilhelmina Children’s Hospital, 3508 EA Utrecht, The Netherlands; (E.A.); (M.v.d.L.); (T.A.); (R.d.G.)
| | - Thomas Alderliesten
- Department of Neonatology, University Medical Center Utrecht, Wilhelmina Children’s Hospital, 3508 EA Utrecht, The Netherlands; (E.A.); (M.v.d.L.); (T.A.); (R.d.G.)
| | - Joppe Nijman
- Pediatric Intensive Care Unit and Center of Home Mechanical Ventilation, University Medical Center Utrecht, Wilhelmina Children’s Hospital, 3508 EA Utrecht, The Netherlands; (E.S.V.); (M.v.P.); (J.N.)
| | - Robbin de Goederen
- Department of Neonatology, University Medical Center Utrecht, Wilhelmina Children’s Hospital, 3508 EA Utrecht, The Netherlands; (E.A.); (M.v.d.L.); (T.A.); (R.d.G.)
| | - Jeroen Dudink
- Department of Neonatology, University Medical Center Utrecht, Wilhelmina Children’s Hospital, 3508 EA Utrecht, The Netherlands; (E.A.); (M.v.d.L.); (T.A.); (R.d.G.)
| |
Collapse
|
5
|
Peng Z, Kommers D, Liang RH, Long X, Cottaar W, Niemarkt H, Andriessen P, van Pul C. Continuous sensing and quantification of body motion in infants: A systematic review. Heliyon 2023; 9:e18234. [PMID: 37501976 PMCID: PMC10368857 DOI: 10.1016/j.heliyon.2023.e18234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 06/26/2023] [Accepted: 07/12/2023] [Indexed: 07/29/2023] Open
Abstract
Abnormal body motion in infants may be associated with neurodevelopmental delay or critical illness. In contrast to continuous patient monitoring of the basic vitals, the body motion of infants is only determined by discrete periodic clinical observations of caregivers, leaving the infants unattended for observation for a longer time. One step to fill this gap is to introduce and compare different sensing technologies that are suitable for continuous infant body motion quantification. Therefore, we conducted this systematic review for infant body motion quantification based on the PRISMA method (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). In this systematic review, we introduce and compare several sensing technologies with motion quantification in different clinical applications. We discuss the pros and cons of each sensing technology for motion quantification. Additionally, we highlight the clinical value and prospects of infant motion monitoring. Finally, we provide suggestions with specific needs in clinical practice, which can be referred by clinical users for their implementation. Our findings suggest that motion quantification can improve the performance of vital sign monitoring, and can provide clinical value to the diagnosis of complications in infants.
Collapse
Affiliation(s)
- Zheng Peng
- Department of Applied Physics, Eindhoven University of Technology, Eindhoven, the Netherlands
- Department of Clinical Physics, Máxima Medical Centre, Veldhoven, the Netherlands
| | - Deedee Kommers
- Department of Applied Physics, Eindhoven University of Technology, Eindhoven, the Netherlands
- Department of Neonatology, Máxima Medical Centre, Veldhoven, the Netherlands
| | - Rong-Hao Liang
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
- Department of Industrial Design, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Xi Long
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
- Philips Research, Eindhoven, the Netherlands
| | - Ward Cottaar
- Department of Applied Physics, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Hendrik Niemarkt
- Department of Applied Physics, Eindhoven University of Technology, Eindhoven, the Netherlands
- Department of Neonatology, Máxima Medical Centre, Veldhoven, the Netherlands
| | - Peter Andriessen
- Department of Applied Physics, Eindhoven University of Technology, Eindhoven, the Netherlands
- Department of Neonatology, Máxima Medical Centre, Veldhoven, the Netherlands
| | - Carola van Pul
- Department of Applied Physics, Eindhoven University of Technology, Eindhoven, the Netherlands
- Department of Clinical Physics, Máxima Medical Centre, Veldhoven, the Netherlands
| |
Collapse
|
6
|
Grech N, Agius JC, Sciberras S, Micallef N, Camilleri K, Falzon O. Non-contact Vital Signs Monitoring in Paediatric Anaesthesia - Current Challenges and Future Direction. ACTA MEDICA (HRADEC KRALOVE) 2023; 66:39-46. [PMID: 37930092 DOI: 10.14712/18059694.2023.14] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2023]
Abstract
Non-contact vital sign monitoring is an area of increasing interest in the clinical scenario since it offers advantages over traditional monitoring using leads and wires. These advantages include reduction in transmission of infection and more freedom of movement. Yet there is a paucity of studies available in the clinical setting particularly in paediatric anaesthesia. This scoping review aims to investigate why contactless monitoring, specifically with red-green-blue cameras, is not implemented in mainstream practise. The challenges, drawbacks and limitations of non-contact vital sign monitoring, will be outlined, together with future direction on how it can potentially be implemented in the setting of paediatric anaesthesia, and in the critical care scenario.
Collapse
Affiliation(s)
- Nicole Grech
- Department of Anaesthesia and Intensive Care Medicine, Mater Dei Hospital, Malta.
| | - Jean Calleja Agius
- Department of Anatomy, Faculty of Medicine and Surgery, University of Malta
| | - Stephen Sciberras
- Department of Anaesthesia and Intensive Care Medicine, Mater Dei Hospital, Malta
| | - Neil Micallef
- Centre for Biomedical Cybernetics, Faculty of Engineering, University of Malta
| | - Kenneth Camilleri
- Centre for Biomedical Cybernetics, Faculty of Engineering, University of Malta
| | - Owen Falzon
- Centre for Biomedical Cybernetics, Faculty of Engineering, University of Malta
| |
Collapse
|
7
|
Edanami K, Kurosawa M, Yen HT, Kanazawa T, Abe Y, Kirimoto T, Yao Y, Matsui T, Sun G. Remote sensing of vital signs by medical radar time-series signal using cardiac peak extraction and adaptive peak detection algorithm: Performance validation on healthy adults and application to neonatal monitoring at an NICU. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 226:107163. [PMID: 36191355 DOI: 10.1016/j.cmpb.2022.107163] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 09/24/2022] [Accepted: 09/26/2022] [Indexed: 06/16/2023]
Abstract
BACKGROUND AND OBJECTIVE Continuous monitoring of vital signs plays a pivotal role in neonatal intensive care units (NICUs). In this paper, we present a system for monitoring fully non-contact medical radar-based vital signs to measure the respiratory rate (RR), heart rate (HR), I:E ratio, and heart rate variability (HRV). In addition, we evaluated its performance in a physiological laboratory and examined its adaptability in an NICU. METHODS A non-contact medical radar-based vital sign monitoring system that includes 24 GHz radar installed in an incubator was developed. To enable reliable monitoring, an advanced signal processing algorithm (i.e., a nonlinear filter to separate respiration and heartbeat signals from the output of radar), template matching to extract cardiac peaks, and an adaptive peak detection algorithm to estimate cardiac peaks in time-series were proposed and implemented in the system. Nine healthy subjects comprising five males and four females (24 ± 5 years) participated in the laboratory test. To evaluate the adaptability of the system in an NICU setting, we tested it with three hospitalized infants, including two neonates. RESULTS The results indicate strong agreement in healthy subjects between the non-contact system and reference contact devices for RR, HR, and inter-beat interval (IBI) measurement, with correlation coefficients of 0.83, 0.96, and 0.94, respectively. As anticipated, the template matching and adaptive peak detection algorithms outperformed the conventional approach. These showed a more accurate IBI close to the reference Bland-Altman analysis (proposed: bias of -3 ms, and 95% limits of agreement ranging from -73 to 67 ms; conventional: bias of -11 ms, and 95% limits of agreement ranging from -229 to 207 ms). Moreover, in the NICU clinical setting, the IBI correlation coefficient and 95% limit of agreement in the conventional method are 0.31 and 91 ms. The corresponding values obtained using the proposed method are 0.93 and 21 ms. CONCLUSION The proposed system introduces a novel approach for NICU monitoring using a non-contact medical radar sensor. The signal processing method combining cardiac peak extraction algorithm with the adaptive peak detection algorithm shows high adaptability in detecting IBI the time series in various application settings.
Collapse
Affiliation(s)
- Keisuke Edanami
- Graduate School of Informatics and Engineering, The University of Electro-Communications, Denki Tsushin Daigaku, 1-5-1 Chofugaoka, Chofu, Tokyo 182-8585, Japan
| | - Masaki Kurosawa
- Graduate School of Informatics and Engineering, The University of Electro-Communications, Denki Tsushin Daigaku, 1-5-1 Chofugaoka, Chofu, Tokyo 182-8585, Japan
| | - Hoang Thi Yen
- Graduate School of Informatics and Engineering, The University of Electro-Communications, Denki Tsushin Daigaku, 1-5-1 Chofugaoka, Chofu, Tokyo 182-8585, Japan
| | - Takeru Kanazawa
- Children's Medical Center, Showa University Koto Toyosu Hospital, Tokyo, Japan
| | - Yoshifusa Abe
- Children's Medical Center, Showa University Koto Toyosu Hospital, Tokyo, Japan
| | - Tetsuo Kirimoto
- Graduate School of Informatics and Engineering, The University of Electro-Communications, Denki Tsushin Daigaku, 1-5-1 Chofugaoka, Chofu, Tokyo 182-8585, Japan
| | - Yu Yao
- Bosch Center for Artificial Intelligence, Renningen, Germany
| | - Takemi Matsui
- Graduate School of System Design, Tokyo Metropolitan University, Tokyo, Japan
| | - Guanghao Sun
- Graduate School of Informatics and Engineering, The University of Electro-Communications, Denki Tsushin Daigaku, 1-5-1 Chofugaoka, Chofu, Tokyo 182-8585, Japan.
| |
Collapse
|
8
|
Rong G, Zheng Y, Yang X, Bao K, Xia F, Ren H, Bian S, Li L, Zhu B, Sawan M. A Closed-Loop Approach to Fight Coronavirus: Early Detection and Subsequent Treatment. BIOSENSORS 2022; 12:900. [PMID: 36291037 PMCID: PMC9599914 DOI: 10.3390/bios12100900] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/21/2022] [Revised: 10/12/2022] [Accepted: 10/14/2022] [Indexed: 06/16/2023]
Abstract
The recent COVID-19 pandemic has caused tremendous damage to the social economy and people's health. Some major issues fighting COVID-19 include early and accurate diagnosis and the shortage of ventilator machines for critical patients. In this manuscript, we describe a novel solution to deal with COVID-19: portable biosensing and wearable photoacoustic imaging for early and accurate diagnosis of infection and magnetic neuromodulation or minimally invasive electrical stimulation to replace traditional ventilation. The solution is a closed-loop system in that the three modules are integrated together and form a loop to cover all-phase strategies for fighting COVID-19. The proposed technique can guarantee ubiquitous and onsite detection, and an electrical hypoglossal stimulator can be more effective in helping severe patients and reducing complications caused by ventilators.
Collapse
Affiliation(s)
- Guoguang Rong
- CenBRAIN Neurotech, School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- Institute of Advanced Study, Westlake Institute for Advanced Study, Hangzhou 310024, China
| | - Yuqiao Zheng
- CenBRAIN Neurotech, School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- Institute of Advanced Study, Westlake Institute for Advanced Study, Hangzhou 310024, China
| | - Xi Yang
- CenBRAIN Neurotech, School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- Institute of Advanced Study, Westlake Institute for Advanced Study, Hangzhou 310024, China
| | - Kangjian Bao
- School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- Institute of Advanced Study, Westlake Institute for Advanced Study, Hangzhou 310024, China
| | - Fen Xia
- CenBRAIN Neurotech, School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- Institute of Advanced Study, Westlake Institute for Advanced Study, Hangzhou 310024, China
| | - Huihui Ren
- School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- Institute of Advanced Study, Westlake Institute for Advanced Study, Hangzhou 310024, China
| | - Sumin Bian
- CenBRAIN Neurotech, School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- Institute of Advanced Study, Westlake Institute for Advanced Study, Hangzhou 310024, China
| | - Lan Li
- School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- Institute of Advanced Study, Westlake Institute for Advanced Study, Hangzhou 310024, China
| | - Bowen Zhu
- School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- Institute of Advanced Study, Westlake Institute for Advanced Study, Hangzhou 310024, China
| | - Mohamad Sawan
- CenBRAIN Neurotech, School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- School of Engineering, Westlake University, 600 Dunyu Road, Xihu District, Hangzhou 310030, China
- Institute of Advanced Study, Westlake Institute for Advanced Study, Hangzhou 310024, China
| |
Collapse
|
9
|
Selvaraju V, Spicher N, Wang J, Ganapathy N, Warnecke JM, Leonhardt S, Swaminathan R, Deserno TM. Continuous Monitoring of Vital Signs Using Cameras: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2022; 22:4097. [PMID: 35684717 PMCID: PMC9185528 DOI: 10.3390/s22114097] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Revised: 05/18/2022] [Accepted: 05/18/2022] [Indexed: 02/04/2023]
Abstract
In recent years, noncontact measurements of vital signs using cameras received a great amount of interest. However, some questions are unanswered: (i) Which vital sign is monitored using what type of camera? (ii) What is the performance and which factors affect it? (iii) Which health issues are addressed by camera-based techniques? Following the preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement, we conduct a systematic review of continuous camera-based vital sign monitoring using Scopus, PubMed, and the Association for Computing Machinery (ACM) databases. We consider articles that were published between January 2018 and April 2021 in the English language. We include five vital signs: heart rate (HR), respiratory rate (RR), blood pressure (BP), body skin temperature (BST), and oxygen saturation (SpO2). In total, we retrieve 905 articles and screened them regarding title, abstract, and full text. One hundred and four articles remained: 60, 20, 6, 2, and 1 of the articles focus on HR, RR, BP, BST, and SpO2, respectively, and 15 on multiple vital signs. HR and RR can be measured using red, green, and blue (RGB) and near-infrared (NIR) as well as far-infrared (FIR) cameras. So far, BP and SpO2 are monitored with RGB cameras only, whereas BST is derived from FIR cameras only. Under ideal conditions, the root mean squared error is around 2.60 bpm, 2.22 cpm, 6.91 mm Hg, 4.88 mm Hg, and 0.86 °C for HR, RR, systolic BP, diastolic BP, and BST, respectively. The estimated error for SpO2 is less than 1%, but it increases with movements of the subject and the camera-subject distance. Camera-based remote monitoring mainly explores intensive care, post-anaesthesia care, and sleep monitoring, but also explores special diseases such as heart failure. The monitored targets are newborn and pediatric patients, geriatric patients, athletes (e.g., exercising, cycling), and vehicle drivers. Camera-based techniques monitor HR, RR, and BST in static conditions within acceptable ranges for certain applications. The research gaps are large and heterogeneous populations, real-time scenarios, moving subjects, and accuracy of BP and SpO2 monitoring.
Collapse
Affiliation(s)
- Vinothini Selvaraju
- Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School, D-38106 Braunschweig, Germany; (V.S.); (N.S.); (J.W.); (N.G.); (J.M.W.)
- Non-Invasive Imaging and Diagnostic Laboratory, Biomedical Engineering, Department of Applied Mechanics, Indian Institute of Technology Madras, Chennai 600036, India;
| | - Nicolai Spicher
- Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School, D-38106 Braunschweig, Germany; (V.S.); (N.S.); (J.W.); (N.G.); (J.M.W.)
| | - Ju Wang
- Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School, D-38106 Braunschweig, Germany; (V.S.); (N.S.); (J.W.); (N.G.); (J.M.W.)
| | - Nagarajan Ganapathy
- Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School, D-38106 Braunschweig, Germany; (V.S.); (N.S.); (J.W.); (N.G.); (J.M.W.)
| | - Joana M. Warnecke
- Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School, D-38106 Braunschweig, Germany; (V.S.); (N.S.); (J.W.); (N.G.); (J.M.W.)
| | - Steffen Leonhardt
- Chair for Medical Information Technology, Helmholtz-Institute for Biomedical Engineering, RWTH Aachen University, D-52074 Aachen, Germany;
| | - Ramakrishnan Swaminathan
- Non-Invasive Imaging and Diagnostic Laboratory, Biomedical Engineering, Department of Applied Mechanics, Indian Institute of Technology Madras, Chennai 600036, India;
| | - Thomas M. Deserno
- Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School, D-38106 Braunschweig, Germany; (V.S.); (N.S.); (J.W.); (N.G.); (J.M.W.)
| |
Collapse
|
10
|
Khanam FTZ, Al-Naji A, Perera AG, Gibson K, Chahl J. Non-contact automatic vital signs monitoring of neonates in NICU using video camera imaging. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING: IMAGING & VISUALIZATION 2022. [DOI: 10.1080/21681163.2022.2069598] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
| | - Ali Al-Naji
- UniSA STEM, University of South Australia, Adelaide, Australia
- Electrical Engineering Technical College, Middle Technical University, Baghdad, Iraq
| | | | - Kim Gibson
- Clinical and Health Sciences, Rosemary Bryant AO Research Centre, University of South Australia, Adelaide, Australia
| | - Javaan Chahl
- UniSA STEM, University of South Australia, Adelaide, Australia
- Joint and Operations Analysis Division, Defence Science and Technology Group, Melbourne, Australia
| |
Collapse
|
11
|
Cubík J, Kepak S, Wiedermannova H, Vrtkova A, Burckova H, Zarubova P, Fernandez C, Pavlicek J, Jargus J, Vasinek V. Measuring respiratory and heart rate using a fiber optic interferometer: A pilot study in a neonate model. Front Pediatr 2022; 10:957835. [PMID: 36545663 PMCID: PMC9760927 DOI: 10.3389/fped.2022.957835] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Accepted: 11/07/2022] [Indexed: 12/12/2022] Open
Abstract
INTRODUCTION The study aim was to test the safety and efficacy of a pad with optic fibers developed for monitoring newborn respiratory rate (RR) and heart rate (HR). METHODS Thirty New Zealand White rabbits were included, divided by weight into three groups. RR and HR were measured using two methods for each rabbit: ECG electrodes as the reference method and a newly developed pad with an experimental fiber optic system (EFOS) as the experimental method. RESULTS Analysis was performed on data for 29 rabbits (10 female, 34%; 19 male, 66%). EFOS performed better at measuring RR compared with HR. RR values did not differ significantly between the methods for the whole group (p = 0.151) or within each sex (female: p > 0.999; male: p = 0.075). Values for HR, however, did differ between methods for the whole group of animals (p < 0.001) and also within groups by sex (female: p < 0.001; male: p = 0.006). CONCLUSION The results of this preclinical study demonstrate the potential of this non-invasive method using a fiber optic pad to measure HR and RR.
Collapse
Affiliation(s)
- Jakub Cubík
- Department of Telecommunications, Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, Ostrava, Czech Republic
| | - Stanislav Kepak
- Department of Telecommunications, Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, Ostrava, Czech Republic
| | - Hana Wiedermannova
- Department of Neonatology, University Hospital Ostrava, Ostrava, Czech Republic.,Faculty of Medicine, University of Ostrava, Ostrava, Czech Republic
| | - Adela Vrtkova
- Department of Applied Mathematics, Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, Ostrava, Czech Republic.,Department of the Deputy Director for Science, Research, and Education, University Hospital Ostrava, Ostrava, Czech Republic
| | - Hana Burckova
- Department of Neonatology, University Hospital Ostrava, Ostrava, Czech Republic
| | - Pavla Zarubova
- Department of Neonatology, University Hospital Ostrava, Ostrava, Czech Republic
| | - Carlos Fernandez
- Centre for Cardiovascular Research and Development, American Heart Poland Inc, Kostkowice, Poland
| | - Jan Pavlicek
- Faculty of Medicine, University of Ostrava, Ostrava, Czech Republic.,Department of Pediatrics and Prenatal Cardiology, University Hospital Ostrava, Ostrava, Czech Republic.,Biomedical Research Center, University Hospital Hradec Kralove, Hradec Kralove, Czech Republic
| | - Jan Jargus
- Department of Telecommunications, Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, Ostrava, Czech Republic
| | - Vladimir Vasinek
- Department of Telecommunications, Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, Ostrava, Czech Republic
| |
Collapse
|
12
|
Cheng CH, Wong KL, Chin JW, Chan TT, So RHY. Deep Learning Methods for Remote Heart Rate Measurement: A Review and Future Research Agenda. SENSORS (BASEL, SWITZERLAND) 2021; 21:6296. [PMID: 34577503 PMCID: PMC8473186 DOI: 10.3390/s21186296] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Revised: 09/13/2021] [Accepted: 09/16/2021] [Indexed: 01/05/2023]
Abstract
Heart rate (HR) is one of the essential vital signs used to indicate the physiological health of the human body. While traditional HR monitors usually require contact with skin, remote photoplethysmography (rPPG) enables contactless HR monitoring by capturing subtle light changes of skin through a video camera. Given the vast potential of this technology in the future of digital healthcare, remote monitoring of physiological signals has gained significant traction in the research community. In recent years, the success of deep learning (DL) methods for image and video analysis has inspired researchers to apply such techniques to various parts of the remote physiological signal extraction pipeline. In this paper, we discuss several recent advances of DL-based methods specifically for remote HR measurement, categorizing them based on model architecture and application. We further detail relevant real-world applications of remote physiological monitoring and summarize various common resources used to accelerate related research progress. Lastly, we analyze the implications of research findings and discuss research gaps to guide future explorations.
Collapse
Affiliation(s)
- Chun-Hong Cheng
- Department of Computer Science, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China;
- PanopticAI, Hong Kong Science and Technology Parks, New Territories, Hong Kong, China; (J.-W.C.); (T.-T.C.); (R.H.Y.S.)
| | - Kwan-Long Wong
- PanopticAI, Hong Kong Science and Technology Parks, New Territories, Hong Kong, China; (J.-W.C.); (T.-T.C.); (R.H.Y.S.)
- Department of Bioengineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| | - Jing-Wei Chin
- PanopticAI, Hong Kong Science and Technology Parks, New Territories, Hong Kong, China; (J.-W.C.); (T.-T.C.); (R.H.Y.S.)
- Department of Industrial Engineering and Decision Analytics, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| | - Tsz-Tai Chan
- PanopticAI, Hong Kong Science and Technology Parks, New Territories, Hong Kong, China; (J.-W.C.); (T.-T.C.); (R.H.Y.S.)
- Department of Industrial Engineering and Decision Analytics, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| | - Richard H. Y. So
- PanopticAI, Hong Kong Science and Technology Parks, New Territories, Hong Kong, China; (J.-W.C.); (T.-T.C.); (R.H.Y.S.)
- Department of Industrial Engineering and Decision Analytics, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| |
Collapse
|