1
|
Chowdhury FA, Hosain MK, Bin Islam MS, Hossain MS, Basak P, Mahmud S, Murugappan M, Chowdhury MEH. ECG waveform generation from radar signals: A deep learning perspective. Comput Biol Med 2024; 176:108555. [PMID: 38749323 DOI: 10.1016/j.compbiomed.2024.108555] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2024] [Revised: 05/01/2024] [Accepted: 05/05/2024] [Indexed: 05/31/2024]
Abstract
Cardiovascular diagnostics relies heavily on the ECG (ECG), which reveals significant information about heart rhythm and function. Despite their significance, traditional ECG measures employing electrodes have limitations. As a result of extended electrode attachments, patients may experience skin irritation or pain, and motion artifacts may interfere with signal accuracy. Additionally, ECG monitoring usually requires highly trained professionals and specialized equipment, which increases the treatment's complexity and cost. In critical care scenarios, such as continuous monitoring of hospitalized patients, wearable sensors for collecting ECG data may be difficult to use. Although there are issues with ECG, it remains a valuable tool for diagnosing and monitoring cardiac disorders due to its non-invasive nature and the detailed information it provides about the heart. The goal of this study is to present an innovative method for generating continuous ECG waveforms from non-contact radar data by using Deep Learning. The method can eliminate the need for invasive or wearable biosensors and expensive equipment to collect ECGs. In this paper, we propose the MultiResLinkNet, a one-dimensional convolutional neural network (1D CNN) model for generating ECG signals from radar waveforms. With the help of a publicly accessible radar benchmark dataset, an end-to-end DL architecture is trained and assessed. There are six ports of raw radar data in this dataset, along with ground truth physiological signals collected from 30 participants in five distinct scenarios: Resting, Valsalva, Apnea, Tilt-up, and Tilt-down. By using strong temporal and spectral measurements, we assessed our proposed framework's ability to convert ECG data from Radar signals in three distinct scenarios, namely Resting, Valsalva, and Apnea (RVA). ECG segmentation performed better by MultiResLinkNet than by state-of-the-art networks in both combined and individual cases. As a result of the simulations, the resting, valsalva, and RVA scenarios showed the highest average temporal values, respectively: 66.09523 ± 19.33, 60.13625 ± 21.92, and 61.86265 ± 21.37. In addition, it exhibited the highest spectral correlation values (82.4388 ± 18.42 (Resting), 77.05186 ± 23.26 (Valsalva), 74.65785 ± 23.17 (Apnea), and 79.96201 ± 20.82 (RVA)), along with minimal temporal and spectral errors in almost every case. The qualitative evaluation revealed strong similarities between generated and actual ECG waveforms. As a result of our method of forecasting ECG patterns from remote radar data, we can monitor high-risk patients, especially those undergoing surgery.
Collapse
Affiliation(s)
- Farhana Ahmed Chowdhury
- Department of Electronics and Telecommunication Engineering, Rajshahi University of Engineering and Technology, Rajshahi, 6204, Bangladesh
| | - Md Kamal Hosain
- Department of Electronics and Telecommunication Engineering, Rajshahi University of Engineering and Technology, Rajshahi, 6204, Bangladesh
| | - Md Sakib Bin Islam
- Department of Biomedical Engineering, Military Institute of Science and Technology, Dhaka, Bangladesh
| | - Md Shafayet Hossain
- Department of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi, Selangor, 43600, Malaysia
| | - Promit Basak
- Department of Electrical and Electronic Engineering, University of Dhaka, Dhaka, 1000, Bangladesh
| | - Sakib Mahmud
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar
| | - M Murugappan
- Intelligent Signal Processing (ISP) Research Lab, Department of Electronics and Communication Engineering, Kuwait College of Science and Technology, Block 4, Doha, Kuwait; Department of Electronics and Communication Engineering, Vels Institute of Sciences, Technology, and Advanced Studies, Chennai, Tamilnadu, India.
| | | |
Collapse
|
2
|
Guo CY, Hsieh TL, Chang CC, Perng JW. A novel smart photoelectric lock system: Speech transmitted by laser and speech to text. Heliyon 2023; 9:e14510. [PMID: 36967961 PMCID: PMC10036661 DOI: 10.1016/j.heliyon.2023.e14510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Revised: 03/05/2023] [Accepted: 03/08/2023] [Indexed: 03/17/2023] Open
Abstract
We propose a circuit that modulates a speech signal to a laser, using which the speech signal can be transmitted using the laser. Also, it shows the use of a platform based on embedded ARM (Advanced RISC Machine), running a small deep learning model based on TDNN (Time delay neural network) and LSTM (Long short-term memory), and converting speech to text, and use the text cipher for unlocking. This research implements a smart lock system that can set a pre-record speech cipher and verify the similarity through a laser transmission speech cipher to unlock it. In our experiment result, the English speech of laser transmission can reach a WER (Word error rate) of 14.06% through the deep learning model to recognize the content of the speech cipher. We also design a similarity comparison algorithm based on LCS (Longest common subsequence) to compare the character set of the laser transmission speech compare and the prerecord speech cipher to calculate the similarity rate. Through the similarity comparison algorithm, when the WER is 27.27%, the male speech samples used in this study still have a 95% unlocking success rate, while the female speech samples have a 100% unlocking success rate. Compared with only using automatic speech recognition (ASR) to unlock, the method we propose is to compare the similarity of the content of speech cipher. The method significantly improves the unlocking fault tolerance of using lasers to transmit audio. Therefore, by using the laser to transmit the speech cipher, the usability of the photoelectric smart lock system has been significantly improved. At the same time, the characteristics of the laser are not easy to eavesdrop on the cipher, which can also improve security.
Collapse
Affiliation(s)
- Cheng-Yan Guo
- Accurate Meditech Inc, New Taipei, 241406, Taiwan, ROC
| | - Tung-Li Hsieh
- Department of Electronic Engineering, National Kaohsiung University of Science and Technology, No.415, Jiangong Rd., Sanmin Dist., Kaohsiung, 807618, Taiwan, ROC
- Corresponding author.
| | | | - Jau-Woei Perng
- Department of Mechanical and Electromechanical Engineering, National Sun Yat-sen University, Kaohsiung, 80424, Taiwan
- Corresponding author.
| |
Collapse
|
3
|
Anton O, Dore H, Rendon-Morales E, Aviles-Espinosa R, Seddon P, Wertheim D, Fernandez R, Rabe H. Non-invasive sensor methods used in monitoring newborn babies after birth, a clinical perspective. Matern Health Neonatol Perinatol 2022; 8:9. [DOI: 10.1186/s40748-022-00144-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Accepted: 10/25/2022] [Indexed: 11/24/2022] Open
Abstract
Abstract
Background
Reducing the global new-born mortality is a paramount challenge for humanity. There are approximately 786,323 live births in the UK each year according to the office for National Statistics; around 10% of these newborn infants require assistance during this transition after birth. Each year around, globally around 2.5 million newborns die within their first month. The main causes are complications due to prematurity and during delivery. To act in a timely manner and prevent further damage, health professionals should rely on accurate monitoring of the main vital signs heart rate and respiratory rate.
Aims
To present a clinical perspective on innovative, non-invasive methods to monitor heart rate and respiratory rate in babies highlighting their advantages and limitations in comparison with well-established methods.
Methods
Using the data collected in our recently published systematic review we highlight the barriers and facilitators for the novel sensor devices in obtaining reliable heart rate measurements. Details about difficulties related to the application of sensors and interfaces, time to display, and user feedback are explored. We also provide a unique overview of using a non-invasive respiratory rate monitoring method by extracting RR from the pulse oximetry trace of newborn babies.
Results
Novel sensors to monitor heart rate offer the advantages of minimally obtrusive technologies but have limitations due to movement artefact, bad sensor coupling, intermittent measurement, and poor-quality recordings compared to gold standard well established methods. Respiratory rate can be derived accurately from pleth recordings in infants.
Conclusion
Some limitations have been identified in current methods to monitor heart rate and respiratory rate in newborn babies. Novel minimally invasive sensors have advantages that may help clinical practice. Further research studies are needed to assess whether they are sufficiently accurate, practical, and reliable to be suitable for clinical use.
Collapse
|
4
|
Pereira TMC, Conceição RC, Sebastião R. Initial Study Using Electrocardiogram for Authentication and Identification. SENSORS 2022; 22:s22062202. [PMID: 35336371 PMCID: PMC8954774 DOI: 10.3390/s22062202] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Revised: 03/05/2022] [Accepted: 03/07/2022] [Indexed: 11/16/2022]
Abstract
Recently, several studies have demonstrated the potential of electrocardiogram (ECG) to be used as a physiological signature for biometric systems (BS). We investigated the potential of ECG as a biometric trait for the identification and authentication of individuals. We used data from a public database, CYBHi, containing two off-the-person records from 63 subjects, separated by 3 months. For the BS, two templates were generated: (1) cardiac cycles (CC) and (2) scalograms. The identification with CC was performed with LDA, kNN, DT, and SVM, whereas a convolutional neural network (CNN) and a distance-based algorithm were used for scalograms. The authentication was performed with a distance-based algorithm, with a leave-one-out cross validation, for impostors evaluation. The identification system yielded accuracies of 79.37% and 69.84% for CC with LDA and scalograms with CNN, respectively. The authentication yielded an accuracy of 90.48% and an impostor score of 13.06% for CC, and it had an accuracy of 98.42% and an impostor score of 14.34% for scalograms. The obtained results support the claim that ECG can be successfully used for personal recognition. To the best of our knowledge, our study is the first to thoroughly compare templates and methodologies to optimize the performance of an ECG-based biometric system.
Collapse
Affiliation(s)
- Teresa M. C. Pereira
- Departamento de Física, Faculdade de Ciências, Universidade de Lisboa, Campo Grande, 1749-016 Lisboa, Portugal;
| | - Raquel C. Conceição
- Instituto de Biofísica e Engenharia Biomédica, Faculdade de Ciências, Universidade de Lisboa, Campo Grande, 1749-016 Lisboa, Portugal
- Correspondence:
| | - Raquel Sebastião
- Departamento de Electrónica, Instituto de Engenharia Electrónica e Informática de Aveiro, Telecomunicações e Informática, Universidade de Aveiro, 3810-193 Aveiro, Portugal;
| |
Collapse
|
5
|
Molinaro N, Schena E, Silvestri S, Bonotti F, Aguzzi D, Viola E, Buccolini F, Massaroni C. Contactless Vital Signs Monitoring From Videos Recorded With Digital Cameras: An Overview. Front Physiol 2022; 13:801709. [PMID: 35250612 PMCID: PMC8895203 DOI: 10.3389/fphys.2022.801709] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Accepted: 01/20/2022] [Indexed: 01/26/2023] Open
Abstract
The measurement of physiological parameters is fundamental to assess the health status of an individual. The contactless monitoring of vital signs may provide benefits in various fields of application, from healthcare and clinical setting to occupational and sports scenarios. Recent research has been focused on the potentiality of camera-based systems working in the visible range (380-750 nm) for estimating vital signs by capturing subtle color changes or motions caused by physiological activities but invisible to human eyes. These quantities are typically extracted from videos framing some exposed body areas (e.g., face, torso, and hands) with adequate post-processing algorithms. In this review, we provided an overview of the physiological and technical aspects behind the estimation of vital signs like respiratory rate, heart rate, blood oxygen saturation, and blood pressure from digital images as well as the potential fields of application of these technologies. Per each vital sign, we provided the rationale for the measurement, a classification of the different techniques implemented for post-processing the original videos, and the main results obtained during various applications or in validation studies. The available evidence supports the premise of digital cameras as an unobtrusive and easy-to-use technology for physiological signs monitoring. Further research is needed to promote the advancements of the technology, allowing its application in a wide range of population and everyday life, fostering a biometrical holistic of the human body (BHOHB) approach.
Collapse
Affiliation(s)
- Nunzia Molinaro
- Unit of Measurements and Biomedical Instrumentation, Departmental Faculty of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Emiliano Schena
- Unit of Measurements and Biomedical Instrumentation, Departmental Faculty of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Sergio Silvestri
- Unit of Measurements and Biomedical Instrumentation, Departmental Faculty of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy
| | | | - Damiano Aguzzi
- BHOHB – Biometrical Holistic of Human Body S.r.l., Rome, Italy
| | - Erika Viola
- BHOHB – Biometrical Holistic of Human Body S.r.l., Rome, Italy
| | - Fabio Buccolini
- BHOHB – Biometrical Holistic of Human Body S.r.l., Rome, Italy
| | - Carlo Massaroni
- Unit of Measurements and Biomedical Instrumentation, Departmental Faculty of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy
| |
Collapse
|
6
|
Luo J, Yan Z, Guo S, Chen W. Recent Advances in Atherosclerotic Disease Screening Using Pervasive Healthcare. IEEE Rev Biomed Eng 2021; 15:293-308. [PMID: 34003754 DOI: 10.1109/rbme.2021.3081180] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
Atherosclerosis screening helps the medical model transform from therapeutic medicine to preventive medicine by assessing degree of atherosclerosis prior to the occurrence of fatal vascular events. Pervasive screening emphasizes atherosclerotic monitoring with easy access, quick process, and advanced computing. In this work, we introduced five cutting-edge pervasive technologies including imaging photoplethysmography (iPPG), laser Doppler, radio frequency (RF), thermal imaging (TI), optical fiber sensing and piezoelectric sensor. IPPG measures physiological parameters by using video images that record the subtle skin color changes consistent with cardiac-synchronous blood volume changes in subcutaneous arteries and capillaries. Laser Doppler obtained the information on blood flow by analyzing the spectral components of backscattered light from the illuminated tissues surface. RF is based on Doppler shift caused by the periodic movement of the chest wall induced by respiration and heartbeat. TI measures vital signs by detecting electromagnetic radiation emitted by blood flow. The working principle of optical fiber sensor is to detect the change of light properties caused by the interaction between the measured physiological parameter and the entering light. Piezoelectric sensors are based on the piezoelectric effect of dielectrics. All these pervasive technologies are noninvasive, mobile, and can detect physiological parameters related to atherosclerosis screening.
Collapse
|
7
|
Chen S, Jiang K, Hu H, Kuang H, Yang J, Luo J, Chen X, Li Y. Emotion Recognition Based on Skin Potential Signals with a Portable Wireless Device. SENSORS 2021; 21:s21031018. [PMID: 33540831 PMCID: PMC7867357 DOI: 10.3390/s21031018] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/11/2021] [Revised: 01/25/2021] [Accepted: 01/29/2021] [Indexed: 11/20/2022]
Abstract
Emotion recognition is of great importance for artificial intelligence, robots, and medicine etc. Although many techniques have been developed for emotion recognition, with certain successes, they rely heavily on complicated and expensive equipment. Skin potential (SP) has been recognized to be correlated with human emotions for a long time, but has been largely ignored due to the lack of systematic research. In this paper, we propose a single SP-signal-based method for emotion recognition. Firstly, we developed a portable wireless device to measure the SP signal between the middle finger and left wrist. Then, a video induction experiment was designed to stimulate four kinds of typical emotion (happiness, sadness, anger, fear) in 26 subjects. Based on the device and video induction, we obtained a dataset consisting of 397 emotion samples. We extracted 29 features from each of the emotion samples and used eight well-established algorithms to classify the four emotions based on these features. Experimental results show that the gradient-boosting decision tree (GBDT), logistic regression (LR) and random forest (RF) algorithms achieved the highest accuracy of 75%. The obtained accuracy is similar to, or even better than, that of other methods using multiple physiological signals. Our research demonstrates the feasibility of the SP signal’s integration into existing physiological signals for emotion recognition.
Collapse
Affiliation(s)
- Shuhao Chen
- College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China; (S.C.); (K.J.); (H.H.); (H.K.); (J.Y.); (J.L.)
| | - Ke Jiang
- College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China; (S.C.); (K.J.); (H.H.); (H.K.); (J.Y.); (J.L.)
| | - Haoji Hu
- College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China; (S.C.); (K.J.); (H.H.); (H.K.); (J.Y.); (J.L.)
| | - Haoze Kuang
- College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China; (S.C.); (K.J.); (H.H.); (H.K.); (J.Y.); (J.L.)
| | - Jianyi Yang
- College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China; (S.C.); (K.J.); (H.H.); (H.K.); (J.Y.); (J.L.)
| | - Jikui Luo
- College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China; (S.C.); (K.J.); (H.H.); (H.K.); (J.Y.); (J.L.)
| | - Xinhua Chen
- Zhejiang Key Laboratory for Pulsed Power Tanslational Medicine, Hangzhou Ruidi Biotech Ltd., Hangzhou 310000, China;
| | - Yubo Li
- College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China; (S.C.); (K.J.); (H.H.); (H.K.); (J.Y.); (J.L.)
- Correspondence:
| |
Collapse
|
8
|
Shang J, He Y, Wang Q, Li Y, Ren L. Development of a High-Resolution All-Fiber Homodyne Laser Doppler Vibrometer. SENSORS (BASEL, SWITZERLAND) 2020; 20:s20205801. [PMID: 33066344 PMCID: PMC7602043 DOI: 10.3390/s20205801] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/17/2020] [Revised: 10/08/2020] [Accepted: 10/12/2020] [Indexed: 06/11/2023]
Abstract
Based on the homodyne detection, a compact and cost-effective all-fiber laser Doppler vibrometer (LDV) with high resolution is presented. For the signal processing, the discrimination algorithm combined with the nonorthogonal correction is applied. The algorithm corrects the quadrature imbalance and other nonlinearity. In the calibration experiment, with the glass pasted on a piezoceramic transducer (PZT), the velocity resolution of 62 nm/s at 4 kHz and displacement resolution of 2.468 pm are achieved. For the LDV-based acousto-optic communication, the minimum detectable sound pressure level (SPL) reached 0.12 Pa under the hydrostatic air-water surface. The results demonstrate that the designed homodyne LDV has a low system background noise and can offer high precision in the vibration measurement.
Collapse
Affiliation(s)
- Jianhua Shang
- Shanghai Collaborative Innovation Center for High Performance Fiber Composites, School of Information Science and Technology, Donghua University, Shanghai 201620, China; (Q.W.); (Y.L.); (L.R.)
| | - Yan He
- Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai 201800, China;
| | - Qi Wang
- Shanghai Collaborative Innovation Center for High Performance Fiber Composites, School of Information Science and Technology, Donghua University, Shanghai 201620, China; (Q.W.); (Y.L.); (L.R.)
| | - Yilun Li
- Shanghai Collaborative Innovation Center for High Performance Fiber Composites, School of Information Science and Technology, Donghua University, Shanghai 201620, China; (Q.W.); (Y.L.); (L.R.)
| | - Lihong Ren
- Shanghai Collaborative Innovation Center for High Performance Fiber Composites, School of Information Science and Technology, Donghua University, Shanghai 201620, China; (Q.W.); (Y.L.); (L.R.)
| |
Collapse
|