1
|
Wang Y, Ren Y, Wang T, Li D, Cai H, Ji B. High-accuracy heart rate detection using multispectral IPPG technology combined with a deep learning algorithm. JOURNAL OF BIOPHOTONICS 2024:e202400119. [PMID: 38932695 DOI: 10.1002/jbio.202400119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/23/2024] [Revised: 05/07/2024] [Accepted: 06/06/2024] [Indexed: 06/28/2024]
Abstract
Image Photoplethysmography (IPPG) technology is a noncontact physiological parameter detection technology, which has been widely used in heart rate (HR) detection. However, traditional imaging devices still have issues such as narrower receiving spectral range and inferior motion detection performance. In this paper, we propose a HR detection method based on multi-spectral video. Our method combining multispectral imaging with IPPG technology provides more accurate physiological information. To realize real-time evaluation of HR directly from facial multispectral videos, we propose a new end-to-end neural network, namely IPPGResNet18. The IPPGResNet18 model was trained on the multispectral video dataset from which better results were achieved: MAE = 2.793, RMSE = 3.695, SD = 3.707, p = 0.304. The experimental results demonstrate a high accuracy of HR detection under motion state using this detection method. In respect of real-time monitoring of HR during movement, our method is obviously superior to the conventional technical solutions.
Collapse
Affiliation(s)
- Yu Wang
- School of Physics, Changchun University of Science and Technology, Changchun, China
- Key Laboratory of Jilin Province for Spectral Detection Science and Technology, Changchun University of Science and Technology, Changchun, China
| | - Yu Ren
- School of Physics, Changchun University of Science and Technology, Changchun, China
- Key Laboratory of Jilin Province for Spectral Detection Science and Technology, Changchun University of Science and Technology, Changchun, China
| | - Tingting Wang
- School of Physics, Changchun University of Science and Technology, Changchun, China
- Key Laboratory of Jilin Province for Spectral Detection Science and Technology, Changchun University of Science and Technology, Changchun, China
| | - Dongliang Li
- School of Physics, Changchun University of Science and Technology, Changchun, China
- Key Laboratory of Jilin Province for Spectral Detection Science and Technology, Changchun University of Science and Technology, Changchun, China
| | - Hongxing Cai
- School of Physics, Changchun University of Science and Technology, Changchun, China
- Key Laboratory of Jilin Province for Spectral Detection Science and Technology, Changchun University of Science and Technology, Changchun, China
| | - Boyu Ji
- School of Physics, Changchun University of Science and Technology, Changchun, China
- School of Physics, Zhongshan Institute of Changchun University of Science and Technology, Zhongshan, China
| |
Collapse
|
2
|
Sebastian A, Elharrouss O, Al-Maadeed S, Almaadeed N. GAN-Based Approach for Diabetic Retinopathy Retinal Vasculature Segmentation. Bioengineering (Basel) 2023; 11:4. [PMID: 38275572 PMCID: PMC10812988 DOI: 10.3390/bioengineering11010004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Revised: 12/05/2023] [Accepted: 12/14/2023] [Indexed: 01/27/2024] Open
Abstract
Most diabetes patients develop a condition known as diabetic retinopathy after having diabetes for a prolonged period. Due to this ailment, damaged blood vessels may occur behind the retina, which can even progress to a stage of losing vision. Hence, doctors advise diabetes patients to screen their retinas regularly. Examining the fundus for this requires a long time and there are few ophthalmologists available to check the ever-increasing number of diabetes patients. To address this issue, several computer-aided automated systems are being developed with the help of many techniques like deep learning. Extracting the retinal vasculature is a significant step that aids in developing such systems. This paper presents a GAN-based model to perform retinal vasculature segmentation. The model achieves good results on the ARIA, DRIVE, and HRF datasets.
Collapse
Affiliation(s)
- Anila Sebastian
- Computer Science and Engineering Department, Qatar University, Doha P.O. Box 2713, Qatar; (O.E.); (S.A.-M.); (N.A.)
| | | | | | | |
Collapse
|
3
|
Khattab R, Abdelmaksoud IR, Abdelrazek S. Deep Convolutional Neural Networks for Detecting COVID-19 Using Medical Images: A Survey. NEW GENERATION COMPUTING 2023; 41:343-400. [PMID: 37229176 PMCID: PMC10071474 DOI: 10.1007/s00354-023-00213-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Accepted: 02/23/2023] [Indexed: 05/27/2023]
Abstract
Coronavirus Disease 2019 (COVID-19), which is caused by Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-COV-2), surprised the world in December 2019 and has threatened the lives of millions of people. Countries all over the world closed worship places and shops, prevented gatherings, and implemented curfews to stand against the spread of COVID-19. Deep Learning (DL) and Artificial Intelligence (AI) can have a great role in detecting and fighting this disease. Deep learning can be used to detect COVID-19 symptoms and signs from different imaging modalities, such as X-Ray, Computed Tomography (CT), and Ultrasound Images (US). This could help in identifying COVID-19 cases as a first step to curing them. In this paper, we reviewed the research studies conducted from January 2020 to September 2022 about deep learning models that were used in COVID-19 detection. This paper clarified the three most common imaging modalities (X-Ray, CT, and US) in addition to the DL approaches that are used in this detection and compared these approaches. This paper also provided the future directions of this field to fight COVID-19 disease.
Collapse
Affiliation(s)
- Rana Khattab
- Information Systems Department, Faculty of Computers and Information, Mansoura University, Mansoura, Egypt
| | - Islam R. Abdelmaksoud
- Information Systems Department, Faculty of Computers and Information, Mansoura University, Mansoura, Egypt
| | - Samir Abdelrazek
- Information Systems Department, Faculty of Computers and Information, Mansoura University, Mansoura, Egypt
| |
Collapse
|
4
|
Ashwini C, Sellam V. EOS-3D-DCNN: Ebola optimization search-based 3D-dense convolutional neural network for corn leaf disease prediction. Neural Comput Appl 2023; 35:11125-11139. [PMID: 37155463 PMCID: PMC10043543 DOI: 10.1007/s00521-023-08289-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Accepted: 01/06/2023] [Indexed: 03/30/2023]
Abstract
Corn disease prediction is an essential part of agricultural productivity. This paper presents a novel 3D-dense convolutional neural network (3D-DCNN) optimized using the Ebola optimization search (EOS) algorithm to predict corn disease targeting the increased prediction accuracy than the conventional AI methods. Since the dataset samples are generally insufficient, the paper uses some preliminary pre-processing approaches to increase the sample set and improve the samples for corn disease. The Ebola optimization search (EOS) technique is used to reduce the classification errors of the 3D-CNN approach. As an outcome, the corn disease is predicted and classified accurately and more effectually. The accuracy of the proposed 3D-DCNN-EOS model is improved, and some necessary baseline tests are performed to project the efficacy of the anticipated model. The simulation is performed in the MATLAB 2020a environment, and the outcomes specify the significance of the proposed model over other approaches. The feature representation of the input data is learned effectually to trigger the model's performance. When the proposed method is compared to other existing techniques, it outperforms them in terms of precision, the area under receiver operating characteristics (AUC), f1 score, Kappa statistic error (KSE), accuracy, root mean square error value (RMSE), and recall.
Collapse
Affiliation(s)
- C. Ashwini
- grid.412742.60000 0004 0635 5080Department of Computer Science and Engineering, SRM Institute of Science and Technology, Chennai, Tamil Nadu India
| | - V. Sellam
- grid.412742.60000 0004 0635 5080Department of Computer Science and Engineering, SRM Institute of Science and Technology, Chennai, Tamil Nadu India
| |
Collapse
|
5
|
Sebastian A, Elharrouss O, Al-Maadeed S, Almaadeed N. A Survey on Deep-Learning-Based Diabetic Retinopathy Classification. Diagnostics (Basel) 2023; 13:diagnostics13030345. [PMID: 36766451 PMCID: PMC9914068 DOI: 10.3390/diagnostics13030345] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Revised: 12/21/2022] [Accepted: 12/22/2022] [Indexed: 01/19/2023] Open
Abstract
The number of people who suffer from diabetes in the world has been considerably increasing recently. It affects people of all ages. People who have had diabetes for a long time are affected by a condition called Diabetic Retinopathy (DR), which damages the eyes. Automatic detection using new technologies for early detection can help avoid complications such as the loss of vision. Currently, with the development of Artificial Intelligence (AI) techniques, especially Deep Learning (DL), DL-based methods are widely preferred for developing DR detection systems. For this purpose, this study surveyed the existing literature on diabetic retinopathy diagnoses from fundus images using deep learning and provides a brief description of the current DL techniques that are used by researchers in this field. After that, this study lists some of the commonly used datasets. This is followed by a performance comparison of these reviewed methods with respect to some commonly used metrics in computer vision tasks.
Collapse
|
6
|
Ottakath N, Elharrouss O, Almaadeed N, Al-Maadeed S, Mohamed A, Khattab T, Abualsaud K. ViDMASK dataset for face mask detection with social distance measurement. DISPLAYS 2022; 73:102235. [PMID: 35574253 PMCID: PMC9085388 DOI: 10.1016/j.displa.2022.102235] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/25/2021] [Revised: 04/24/2022] [Accepted: 05/02/2022] [Indexed: 06/15/2023]
Abstract
The COVID-19 outbreak has extenuated the need for a monitoring system that can monitor face mask adherence and social distancing with the use of AI. With the existing video surveillance systems as base, a deep learning model is proposed for mask detection and social distance measurement. State-of-the-art object detection and recognition models such as Mask RCNN, YOLOv4, YOLOv5, and YOLOR were trained for mask detection and evaluated on the existing datasets and on a newly proposed video mask detection dataset the ViDMASK. The obtained results achieved a comparatively high mean average precision of 92.4% for YOLOR. After mask detection, the distance between people's faces is measured for high risk and low risk distance. Furthermore, the new large-scale mask dataset from videos named ViDMASK diversifies the subjects in terms of pose, environment, quality of image, and versatile subject characteristics, producing a challenging dataset. The tested models succeed in detecting the face masks with high performance on the existing dataset, MOXA. However, with the VIDMASK dataset, the performance of most models are less accurate because of the complexity of the dataset and the number of people in each scene. The link to ViDMask dataset and the base codes are available at https://github.com/ViDMask/VidMask-code.git.
Collapse
Affiliation(s)
- Najmath Ottakath
- Qatar University, College of Engineering, Department of Computer Science and Engineering, Qatar
| | - Omar Elharrouss
- Qatar University, College of Engineering, Department of Computer Science and Engineering, Qatar
| | - Noor Almaadeed
- Qatar University, College of Engineering, Department of Computer Science and Engineering, Qatar
| | - Somaya Al-Maadeed
- Qatar University, College of Engineering, Department of Computer Science and Engineering, Qatar
| | - Amr Mohamed
- Qatar University, College of Engineering, Department of Computer Science and Engineering, Qatar
| | - Tamer Khattab
- Qatar University, College of Engineering, Department of Electrical Engineering, Qatar
| | - Khalid Abualsaud
- Qatar University, College of Engineering, Department of Computer Science and Engineering, Qatar
| |
Collapse
|