1
|
Choi HS, Yoon S, Kim J, Seo H, Choi JK. Calibrating Low-Cost Smart Insole Sensors with Recurrent Neural Networks for Accurate Prediction of Center of Pressure. SENSORS (BASEL, SWITZERLAND) 2024; 24:4765. [PMID: 39123811 PMCID: PMC11314829 DOI: 10.3390/s24154765] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/28/2024] [Revised: 06/21/2024] [Accepted: 06/26/2024] [Indexed: 08/12/2024]
Abstract
This paper proposes a scheme for predicting ground reaction force (GRF) and center of pressure (CoP) using low-cost FSR sensors. GRF and CoP data are commonly collected from smart insoles to analyze the wearer's gait and diagnose balance issues. This approach can be utilized to improve a user's rehabilitation process and enable customized treatment plans for patients with specific diseases, making it a useful technology in many fields. However, the conventional measuring equipment for directly monitoring GRF and CoP values, such as F-Scan, is expensive, posing a challenge to commercialization in the industry. To solve this problem, this paper proposes a technology to predict relevant indicators using only low-cost Force Sensing Resistor (FSR) sensors instead of expensive equipment. In this study, data were collected from subjects simultaneously wearing a low-cost FSR Sensor and an F-Scan device, and the relationship between the collected data sets was analyzed using supervised learning techniques. Using the proposed technique, an artificial neural network was constructed that can derive a predicted value close to the actual F-Scan values using only the data from the FSR Sensor. In this process, GRF and CoP were calculated using six virtual forces instead of the pressure value of the entire sole. It was verified through various simulations that it is possible to achieve an improved prediction accuracy of more than 30% when using the proposed technique compared to conventional prediction techniques.
Collapse
Affiliation(s)
- Ho Seon Choi
- Department of Artificial Intelligence and Robotics, Sejong University, Seoul 05006, Republic of Korea;
| | - Seokjin Yoon
- Department of Software, Sejong University, Seoul 05006, Republic of Korea;
| | - Jangkyum Kim
- Department of Artificial Intelligence and Data Science, Sejong University, Seoul 05006, Republic of Korea
| | - Hyeonseok Seo
- School of Electrical Engineering, Korea Advanced Institute of Science & Technology, Daejeon 34141, Republic of Korea;
| | - Jun Kyun Choi
- School of Electrical Engineering, Korea Advanced Institute of Science & Technology, Daejeon 34141, Republic of Korea;
| |
Collapse
|
2
|
Günaydın B, İkizoğlu S. Multifractal detrended fluctuation analysis of insole pressure sensor data to diagnose vestibular system disorders. Biomed Eng Lett 2023; 13:637-648. [PMID: 37872983 PMCID: PMC10590336 DOI: 10.1007/s13534-023-00285-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2022] [Revised: 03/20/2023] [Accepted: 05/14/2023] [Indexed: 10/25/2023] Open
Abstract
The vestibular system (VS) is a sensory system that has a vital function in human life by serving to maintain balance. In this study, multifractal detrended fluctuation analysis (MFDFA) is applied to insole pressure sensor data collected from subjects in order to extract features to identify diseases related to VS dysfunction. We use the multifractal spectrum width as the feature to distinguish between healthy and diseased people. It is observed that multifractal behavior is more dominant and thus the spectrum is wider for healthy subjects, where we explain the reason as the long-range correlations of the small and large fluctuations of the time series for this group. We directly process the instantaneous pressure values to extract features in contrast to studies in the literature where gait analysis is based on investigation of gait dynamics (stride time, stance time, etc.) requiring long walking time. Thus, as the main innovation of this work, we detrend the data to give meaningful information even for a relatively short walk. Extracted feature set was input to fundamental classification algorithms where the Support-Vector-Machine (SVM) performed best with an average accuracy of 98.2% for the binary classification as healthy or suffering. This study is a substantial part of a big project where we finally aim to identify the specific VS disease that causes balance disorder and also determine the stage of the disease, if any. Within this scope, the achieved performance gives high motivation to work more deeply on the issue.
Collapse
Affiliation(s)
- Batuhan Günaydın
- Department of Control and Automation Engineering, Faculty of Electric and Electronics, Istanbul Technical University (ITU), 34469 Maslak-Istanbul, Turkey
- Present Address: Calibration Engineer at AVL Research and Engineering TR, Abdurrahmangazi Mah., Atatürk Cad. No: 22 /11-12, 34885 Istanbul, Turkey
| | - Serhat İkizoğlu
- Department of Control and Automation Engineering, Faculty of Electric and Electronics, Istanbul Technical University (ITU), 34469 Maslak-Istanbul, Turkey
| |
Collapse
|
3
|
Zhang M, Sun F, Wen Y, Zheng Q, Xie Z, Liu B, Mao Y. A self-powered intelligent integrated sensing system for sports skill monitoring. NANOTECHNOLOGY 2023; 35:035501. [PMID: 37832528 DOI: 10.1088/1361-6528/ad0302] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Accepted: 10/12/2023] [Indexed: 10/15/2023]
Abstract
The use of green intelligent sensing systems which are based on triboelectric nanogenerators have sparked a surge of research in recent years. The development has made significant contributions to the field of promoting human health. However, the integration of an intelligent sensing system with multi-directional triboelectric nanogenerators (TENGs) remains challenges in the field of motion monitoring. To solve this research issue, this study designed a self-powered multifunctional fitness blanket (SF-MFB) which incorporates four TENGs, features multi-sensors and wireless motion monitoring capabilities. It presents a self-powered integrated sensing system which utilizes four TENG sensing units to monitor human motion. Each TENG sensing unit collects the mechanical energy generated during motion. The system is composed of SF-MFB, Bluetooth transmission terminal, and upper computer analysis terminal. Its main purpose is to wirelessly monitor and diagnose human sports skills and enables real-time human-computer interaction. The TENG integrated self-powered sensing system demonstrates practicality in sports skills monitoring, diagnosis, human-computer interaction and entertainment. This research introduces a novel approach for the application of TENG self-powered intelligent integrated sensing system in health promotion.
Collapse
Affiliation(s)
- Mengqi Zhang
- Physical Education Department, Northeastern University, Shenyang 110819, People's Republic of China
| | - Fengxin Sun
- Physical Education Department, Northeastern University, Shenyang 110819, People's Republic of China
| | - Yuzhang Wen
- Physical Education Department, Northeastern University, Shenyang 110819, People's Republic of China
| | - Qinglan Zheng
- Physical Education Department, Northeastern University, Shenyang 110819, People's Republic of China
| | - Zhenning Xie
- Physical Education Department, Northeastern University, Shenyang 110819, People's Republic of China
| | - Bing Liu
- School of Martial Arts and Dance, Shenyang Sport University, Shenyang 110102, People's Republic of China
| | - Yupeng Mao
- Physical Education Department, Northeastern University, Shenyang 110819, People's Republic of China
- School of Strength and Conditioning Training, Beijing Sport University, Beijing 100084, People's Republic of China
| |
Collapse
|
4
|
Köse HY, İkizoğlu S. Nonadditive Entropy Application to Detrended Force Sensor Data to Indicate Balance Disorder of Patients with Vestibular System Dysfunction. ENTROPY (BASEL, SWITZERLAND) 2023; 25:1385. [PMID: 37895507 PMCID: PMC10606935 DOI: 10.3390/e25101385] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Revised: 09/22/2023] [Accepted: 09/25/2023] [Indexed: 10/29/2023]
Abstract
The healthy function of the vestibular system (VS) is of vital importance for individuals to carry out their daily activities independently and safely. This study carries out Tsallis entropy (TE)-based analysis on insole force sensor data in order to extract features to differentiate between healthy and VS-diseased individuals. Using a specifically developed algorithm, we detrend the acquired data to examine the fluctuation around the trend curve in order to consider the individual's walking habit and thus increase the accuracy in diagnosis. It is observed that the TE value increases for diseased people as an indicator of the problem of maintaining balance. As one of the main contributions of this study, in contrast to studies in the literature that focus on gait dynamics requiring extensive walking time, we directly process the instantaneous pressure values, enabling a significant reduction in the data acquisition period. The extracted feature set is then inputted into fundamental classification algorithms, with support vector machine (SVM) demonstrating the highest performance, achieving an average accuracy of 95%. This study constitutes a significant step in a larger project aiming to identify the specific VS disease together with its stage. The performance achieved in this study provides a strong motivation to further explore this topic.
Collapse
Affiliation(s)
- Harun Yaşar Köse
- Department of Mechatronics Engineering, Faculty of Electric and Electronics, Istanbul Technical University (ITU), 34469 Istanbul, Türkiye;
| | - Serhat İkizoğlu
- Department of Control and Automation Engineering, Faculty of Electric and Electronics, Istanbul Technical University (ITU), 34469 Istanbul, Türkiye
| |
Collapse
|
5
|
Manupibul U, Tanthuwapathom R, Jarumethitanont W, Kaimuk P, Limroongreungrat W, Charoensuk W. Integration of force and IMU sensors for developing low-cost portable gait measurement system in lower extremities. Sci Rep 2023; 13:10653. [PMID: 37391570 PMCID: PMC10313649 DOI: 10.1038/s41598-023-37761-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Accepted: 06/27/2023] [Indexed: 07/02/2023] Open
Abstract
Gait analysis is the method to accumulate walking data. It is useful in diagnosing diseases, follow-up of symptoms, and rehabilitation post-treatment. Several techniques have been developed to assess human gait. In the laboratory, gait parameters are analyzed by using a camera capture and a force plate. However, there are several limitations, such as high operating costs, the need for a laboratory and a specialist to operate the system, and long preparation time. This paper presents the development of a low-cost portable gait measurement system by using the integration of flexible force sensors and IMU sensors in outdoor applications for early detection of abnormal gait in daily living. The developed device is designed to measure ground reaction force, acceleration, angular velocity, and joint angles of the lower extremities. The commercialized device, including the motion capture system (Motive-OptiTrack) and force platform (MatScan), is used as the reference system to validate the performance of the developed system. The results of the system show that it has high accuracy in measuring gait parameters such as ground reaction force and joint angles in lower limbs. The developed device has a strong correlation coefficient compared with the commercialized system. The percent error of the motion sensor is below 8%, and the force sensor is lower than 3%. The low-cost portable device with a user interface was successfully developed to measure gait parameters for non-laboratory applications to support healthcare applications.
Collapse
Affiliation(s)
- Udomporn Manupibul
- Department of Biomedical Engineering, Faculty of Engineering, Mahidol University, Phuttamonthon, Nakhon Pathom, Thailand
| | - Ratikanlaya Tanthuwapathom
- Department of Biomedical Engineering, Faculty of Engineering, Mahidol University, Phuttamonthon, Nakhon Pathom, Thailand
| | - Wimonrat Jarumethitanont
- Department of Biomedical Engineering, Faculty of Engineering, Mahidol University, Phuttamonthon, Nakhon Pathom, Thailand
- Faculty of Physical Therapy, Mahidol University, Phuttamonthon, Nakhon Pathom, Thailand
| | - Panya Kaimuk
- Department of Biomedical Engineering, Faculty of Engineering, Mahidol University, Phuttamonthon, Nakhon Pathom, Thailand
| | - Weerawat Limroongreungrat
- College of Sports Science and Technology, Mahidol University, Phuttamonthon, Nakhon Pathom, Thailand
| | - Warakorn Charoensuk
- Department of Biomedical Engineering, Faculty of Engineering, Mahidol University, Phuttamonthon, Nakhon Pathom, Thailand.
| |
Collapse
|
6
|
Belli I, Sorrentino I, Dussoni S, Milani G, Rapetti L, Tirupachuri Y, Valli E, Vanteddu PR, Maggiali M, Pucci D. Modeling and Calibration of Pressure-Sensing Insoles via a New Plenum-Based Chamber. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23094501. [PMID: 37177708 PMCID: PMC10181679 DOI: 10.3390/s23094501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 10/27/2022] [Accepted: 10/27/2022] [Indexed: 05/15/2023]
Abstract
This paper proposes a novel method to reliably calibrate a pair of sensorized insoles utilizing an array of capacitive tactile pixels (taxels). A new calibration setup is introduced that is scalable and suitable for multiple kinds of wearable sensors and a procedure for the simultaneous calibration of each of the sensors in the insoles is presented. The calibration relies on a two-step optimization algorithm that, firstly, enables determination of a relevant set of mathematical models based on the instantaneous measurement of the taxels alone, and, then, expands these models to include the relevant portion of the time history of the system. By comparing the resulting models with our previous work on the same hardware, we demonstrate the effectiveness of the novel method both in terms of increased ability to cope with the non-linear characteristics of the sensors and increased pressure ranges achieved during the experiments performed.
Collapse
Affiliation(s)
- Italo Belli
- Artificial and Mechanical Intelligence Research Line, Istituto Italiano di Tecnologia (IIT), Center for Robotics and Intelligent Systems, 16163 Genova, Italy
| | - Ines Sorrentino
- Artificial and Mechanical Intelligence Research Line, Istituto Italiano di Tecnologia (IIT), Center for Robotics and Intelligent Systems, 16163 Genova, Italy
- Machine Learning and Optimisation, The University of Manchester, Manchester M13 9PL, UK
| | - Simeone Dussoni
- iCub Tech Facility, Italiano di Tecnologia (IIT), Center for Robotics and Intelligent Systems, 16163 Genova, Italy
| | - Gianluca Milani
- Artificial and Mechanical Intelligence Research Line, Istituto Italiano di Tecnologia (IIT), Center for Robotics and Intelligent Systems, 16163 Genova, Italy
| | - Lorenzo Rapetti
- Artificial and Mechanical Intelligence Research Line, Istituto Italiano di Tecnologia (IIT), Center for Robotics and Intelligent Systems, 16163 Genova, Italy
- Machine Learning and Optimisation, The University of Manchester, Manchester M13 9PL, UK
| | - Yeshasvi Tirupachuri
- Artificial and Mechanical Intelligence Research Line, Istituto Italiano di Tecnologia (IIT), Center for Robotics and Intelligent Systems, 16163 Genova, Italy
| | - Enrico Valli
- Artificial and Mechanical Intelligence Research Line, Istituto Italiano di Tecnologia (IIT), Center for Robotics and Intelligent Systems, 16163 Genova, Italy
| | - Punith Reddy Vanteddu
- Artificial and Mechanical Intelligence Research Line, Istituto Italiano di Tecnologia (IIT), Center for Robotics and Intelligent Systems, 16163 Genova, Italy
| | - Marco Maggiali
- iCub Tech Facility, Italiano di Tecnologia (IIT), Center for Robotics and Intelligent Systems, 16163 Genova, Italy
| | - Daniele Pucci
- Artificial and Mechanical Intelligence Research Line, Istituto Italiano di Tecnologia (IIT), Center for Robotics and Intelligent Systems, 16163 Genova, Italy
| |
Collapse
|
7
|
Manna SK, Hannan Bin Azhar M, Greace A. Optimal locations and computational frameworks of FSR and IMU sensors for measuring gait abnormalities. Heliyon 2023; 9:e15210. [PMID: 37089328 PMCID: PMC10113840 DOI: 10.1016/j.heliyon.2023.e15210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Revised: 02/05/2023] [Accepted: 03/29/2023] [Indexed: 04/07/2023] Open
Abstract
Neuromuscular diseases cause abnormal joint movements and drastically alter gait patterns in patients. The analysis of abnormal gait patterns can provide clinicians with an in-depth insight into implementing appropriate rehabilitation therapies. Wearable sensors are used to measure the gait patterns of neuromuscular patients due to their non-invasive and cost-efficient characteristics. FSR and IMU sensors are the most popular and efficient options. When assessing abnormal gait patterns, it is important to determine the optimal locations of FSRs and IMUs on the human body, along with their computational framework. The gait abnormalities of different types and the gait analysis systems based on IMUs and FSRs have therefore been investigated. After studying a variety of research articles, the optimal locations of the FSR and IMU sensors were determined by analysing the main pressure points under the feet and prime anatomical locations on the human body. A total of seven locations (the big toe, heel, first, third, and fifth metatarsals, as well as two close to the medial arch) can be used to measure gate cycles for normal and flat feet. It has been found that IMU sensors can be placed in four standard anatomical locations (the feet, shank, thigh, and pelvis). A section on computational analysis is included to illustrate how data from the FSR and IMU sensors are processed. Sensor data is typically sampled at 100 Hz, and wireless systems use a range of microcontrollers to capture and transmit the signals. The findings reported in this article are expected to help develop efficient and cost-effective gait analysis systems by using an optimal number of FSRs and IMUs.
Collapse
|
8
|
Qiao Y, Luo J, Cui T, Liu H, Tang H, Zeng Y, Liu C, Li Y, Jian J, Wu J, Tian H, Yang Y, Ren TL, Zhou J. Soft Electronics for Health Monitoring Assisted by Machine Learning. NANO-MICRO LETTERS 2023; 15:66. [PMID: 36918452 PMCID: PMC10014415 DOI: 10.1007/s40820-023-01029-1] [Citation(s) in RCA: 14] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Accepted: 01/05/2023] [Indexed: 06/18/2023]
Abstract
Due to the development of the novel materials, the past two decades have witnessed the rapid advances of soft electronics. The soft electronics have huge potential in the physical sign monitoring and health care. One of the important advantages of soft electronics is forming good interface with skin, which can increase the user scale and improve the signal quality. Therefore, it is easy to build the specific dataset, which is important to improve the performance of machine learning algorithm. At the same time, with the assistance of machine learning algorithm, the soft electronics have become more and more intelligent to realize real-time analysis and diagnosis. The soft electronics and machining learning algorithms complement each other very well. It is indubitable that the soft electronics will bring us to a healthier and more intelligent world in the near future. Therefore, in this review, we will give a careful introduction about the new soft material, physiological signal detected by soft devices, and the soft devices assisted by machine learning algorithm. Some soft materials will be discussed such as two-dimensional material, carbon nanotube, nanowire, nanomesh, and hydrogel. Then, soft sensors will be discussed according to the physiological signal types (pulse, respiration, human motion, intraocular pressure, phonation, etc.). After that, the soft electronics assisted by various algorithms will be reviewed, including some classical algorithms and powerful neural network algorithms. Especially, the soft device assisted by neural network will be introduced carefully. Finally, the outlook, challenge, and conclusion of soft system powered by machine learning algorithm will be discussed.
Collapse
Affiliation(s)
- Yancong Qiao
- School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University, No. 66, Gongchang Road, Guangming District, Shenzhen, 518107, People's Republic of China.
- Key Laboratory of Sensing Technology and Biomedical Instruments of Guangdong Province, School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, 510275, People's Republic of China.
| | - Jinan Luo
- School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University, No. 66, Gongchang Road, Guangming District, Shenzhen, 518107, People's Republic of China
- Key Laboratory of Sensing Technology and Biomedical Instruments of Guangdong Province, School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, 510275, People's Republic of China
| | - Tianrui Cui
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, People's Republic of China
| | - Haidong Liu
- School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University, No. 66, Gongchang Road, Guangming District, Shenzhen, 518107, People's Republic of China
- Key Laboratory of Sensing Technology and Biomedical Instruments of Guangdong Province, School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, 510275, People's Republic of China
| | - Hao Tang
- School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University, No. 66, Gongchang Road, Guangming District, Shenzhen, 518107, People's Republic of China
- Key Laboratory of Sensing Technology and Biomedical Instruments of Guangdong Province, School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, 510275, People's Republic of China
| | - Yingfen Zeng
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, People's Republic of China
| | - Chang Liu
- School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University, No. 66, Gongchang Road, Guangming District, Shenzhen, 518107, People's Republic of China
- Key Laboratory of Sensing Technology and Biomedical Instruments of Guangdong Province, School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, 510275, People's Republic of China
| | - Yuanfang Li
- School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University, No. 66, Gongchang Road, Guangming District, Shenzhen, 518107, People's Republic of China
- Key Laboratory of Sensing Technology and Biomedical Instruments of Guangdong Province, School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, 510275, People's Republic of China
| | - Jinming Jian
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, People's Republic of China
| | - Jingzhi Wu
- School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University, No. 66, Gongchang Road, Guangming District, Shenzhen, 518107, People's Republic of China
- Key Laboratory of Sensing Technology and Biomedical Instruments of Guangdong Province, School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, 510275, People's Republic of China
| | - He Tian
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, People's Republic of China
| | - Yi Yang
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, People's Republic of China
| | - Tian-Ling Ren
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, People's Republic of China.
| | - Jianhua Zhou
- School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University, No. 66, Gongchang Road, Guangming District, Shenzhen, 518107, People's Republic of China.
- Key Laboratory of Sensing Technology and Biomedical Instruments of Guangdong Province, School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, 510275, People's Republic of China.
| |
Collapse
|
9
|
Blades S, Jensen M, Stellingwerff T, Hundza S, Klimstra M. Characterization of the Kinetyx SI Wireless Pressure-Measuring Insole during Benchtop Testing and Running Gait. SENSORS (BASEL, SWITZERLAND) 2023; 23:2352. [PMID: 36850951 PMCID: PMC9963688 DOI: 10.3390/s23042352] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/14/2023] [Revised: 02/16/2023] [Accepted: 02/16/2023] [Indexed: 06/18/2023]
Abstract
This study characterized the absolute pressure measurement error and reliability of a new fully integrated (Kinetyx, SI) plantar-pressure measurement system (PPMS) versus an industry-standard PPMS (F-Scan, Tekscan) during an established benchtop testing protocol as well as via a research-grade, instrumented treadmill (Bertec) during a running protocol. Benchtop testing results showed that both SI and F-Scan had strong positive linearity (Pearson's correlation coefficient, PCC = 0.86-0.97, PCC = 0.87-0.92; RMSE = 15.96 ± 9.49) and mean root mean squared error RMSE (9.17 ± 2.02) compared to the F-Scan on a progressive loading step test. The SI and F-Scan had comparable results for linearity and hysteresis on a sinusoidal loading test (PCC = 0.92-0.99; 5.04 ± 1.41; PCC = 0.94-0.99; 6.15 ± 1.39, respectively). SI had less mean RMSE (6.19 ± 1.38) than the F-Scan (8.66 ±2.31) on the sinusoidal test and less absolute error (4.08 ± 3.26) than the F-Scan (16.38 ± 12.43) on a static test. Both the SI and F-Scan had near-perfect between-day reliability interclass correlation coefficient, ICC = 0.97-1.00) to the F-Scan (ICC = 0.96-1.00). During running, the SI pressure output had a near-perfect linearity and low RMSE compared to the force measurement from the Bertec treadmill. However, the SI pressure output had a mean hysteresis of 7.67% with a 28.47% maximum hysteresis, which may have implications for the accurate quantification of kinetic gait measures during running.
Collapse
Affiliation(s)
- Samuel Blades
- School of Exercise Science, Physical & Health Education, University of Victoria, Victoria, BC V8W 2Y2, Canada
| | - Matt Jensen
- Canadian Sport Institute Pacific, Victoria, BC V9E 2C5, Canada
| | - Trent Stellingwerff
- School of Exercise Science, Physical & Health Education, University of Victoria, Victoria, BC V8W 2Y2, Canada
- Canadian Sport Institute Pacific, Victoria, BC V9E 2C5, Canada
| | - Sandra Hundza
- School of Exercise Science, Physical & Health Education, University of Victoria, Victoria, BC V8W 2Y2, Canada
| | - Marc Klimstra
- School of Exercise Science, Physical & Health Education, University of Victoria, Victoria, BC V8W 2Y2, Canada
- Canadian Sport Institute Pacific, Victoria, BC V9E 2C5, Canada
| |
Collapse
|
10
|
Jeong BO, Jeong SJ, Park K, Kim BH, Yim SV, Kim S. Effects of three-dimensional image based insole for healthy volunteers: a pilot clinical trial. Transl Clin Pharmacol 2023; 31:49-58. [PMID: 37034127 PMCID: PMC10079510 DOI: 10.12793/tcp.2023.31.e5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Revised: 03/17/2023] [Accepted: 03/23/2023] [Indexed: 04/03/2023] Open
Abstract
Insoles are used to treat various foot diseases, including plantar foot, diabetic foot ulcers, and refractory plantar fasciitis. In this study, we investigated the effects of 3-dimensional image-based (3-D) insole in healthy volunteers with no foot diseases. Additionally, the comfort of the 3-D insole was compared with that of a custom-molded insole. A single-center, randomized, open clinical trial was conducted to address the effectiveness of insole use in a healthy population with no foot or knee disease. Two types of arch support insoles were evaluated for their effectiveness: a 3-D insole and a custom-molded insole. Fifty Korean volunteers participated in the study and were randomly allocated into the "3-D insole" (n = 40) or "custom-molding insole" (n = 10) groups. All subjects wore 3-D insoles or custom-molded insoles for 2 weeks. The sense of wearing shoes (Visual Analog Scale [VAS] and score) and fatigue of the foot were used to assess the insole effects at the end of the 2-week study period. The 3-D insole groups showed significantly improved sense of wearing shoes (VAS, p = 0.0001; score, p = 0.0002) and foot fatigue (p = 0.0005) throughout the study period. Although the number of subjects was different, the custom-molding insole group showed no significant changes in the sense of wearing shoes (VAS, 0.1188; score, p = 0.1483). Foot fatigue in the 3-D insole group improved significantly (p = 0.0005), which shows that a 3-D insole might have favorable effects on foot health in a healthy population. Trial Registration Clinical Research Information Service Identifier: KCT0008100.
Collapse
Affiliation(s)
- Bi O Jeong
- Department of Orthopedic Surgery, Kyung Hee University Medical Center, Seoul 02447, Korea
| | - Su Jin Jeong
- Medical Science Research Institute, Kyung Hee University Medical Center, Seoul 02447, Korea
| | | | - Bo-Hyung Kim
- Department of Clinical Pharmacology and Therapeutics, Kyung Hee University Medical Center, Seoul 02447, Korea
- East-West Medical Research Institute, Kyung Hee University, Seoul 02447, Korea
| | - Sung-Vin Yim
- Department of Clinical Pharmacology and Therapeutics, Kyung Hee University Medical Center, Seoul 02447, Korea
| | - Sehyun Kim
- Graduate School of Dankook University, Yongin 16890, Korea
| |
Collapse
|
11
|
Samarentsis AG, Makris G, Spinthaki S, Christodoulakis G, Tsiknakis M, Pantazis AK. A 3D-Printed Capacitive Smart Insole for Plantar Pressure Monitoring. SENSORS (BASEL, SWITZERLAND) 2022; 22:9725. [PMID: 36560095 PMCID: PMC9782173 DOI: 10.3390/s22249725] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Revised: 11/24/2022] [Accepted: 11/28/2022] [Indexed: 06/17/2023]
Abstract
Gait analysis refers to the systematic study of human locomotion and finds numerous applications in the fields of clinical monitoring, rehabilitation, sports science and robotics. Wearable sensors for real-time gait monitoring have emerged as an attractive alternative to the traditional clinical-based techniques, owing to their low cost and portability. In addition, 3D printing technology has recently drawn increased interest for the manufacturing of sensors, considering the advantages of diminished fabrication cost and time. In this study, we report the development of a 3D-printed capacitive smart insole for the measurement of plantar pressure. Initially, a novel 3D-printed capacitive pressure sensor was fabricated and its sensing performance was evaluated. The sensor exhibited a sensitivity of 1.19 MPa−1, a wide working pressure range (<872.4 kPa), excellent stability and durability (at least 2.280 cycles), great linearity (R2=0.993), fast response/recovery time (142−160 ms), low hysteresis (DH<10%) and the ability to support a broad spectrum of gait speeds (30−70 steps/min). Subsequently, 16 pressure sensors were integrated into a 3D-printed smart insole that was successfully applied for dynamic plantar pressure mapping and proven able to distinguish the various gait phases. We consider that the smart insole presented here is a simple, easy to manufacture and cost-effective solution with the potential for real-world applications.
Collapse
Affiliation(s)
- Anastasios G. Samarentsis
- Institute of Electronic Structure and Laser, Foundation for Research and Technology Hellas, 70013 Heraklion, Greece
| | - Georgios Makris
- Institute of Electronic Structure and Laser, Foundation for Research and Technology Hellas, 70013 Heraklion, Greece
| | - Sofia Spinthaki
- Department of Physics, University of Crete, 70013 Heraklion, Greece
| | - Georgios Christodoulakis
- Department of Electrical and Computer Engineering, Hellenic Mediterranean University, 71410 Heraklion, Greece
| | - Manolis Tsiknakis
- Department of Electrical and Computer Engineering, Hellenic Mediterranean University, 71410 Heraklion, Greece
| | - Alexandros K. Pantazis
- Institute of Electronic Structure and Laser, Foundation for Research and Technology Hellas, 70013 Heraklion, Greece
| |
Collapse
|
12
|
Gait Improvement by Alerted Push-Off via Heating of Insole Tip. Healthcare (Basel) 2022; 10:healthcare10122461. [PMID: 36553985 PMCID: PMC9777980 DOI: 10.3390/healthcare10122461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Revised: 12/03/2022] [Accepted: 12/05/2022] [Indexed: 12/12/2022] Open
Abstract
This study investigated the change in the joint angles of the lower limb during gait by heating the tip of the insole to make a conscious push-off with the warm part. Fifteen healthy males performed treadmill walking under three different conditions: CONTROL walked as usual, INST was instructed to extend the stride with a push-off from the ball of foot to the toe, and HEAT was asked to walk while attempting to push off the warm area, which was attached to the disposable warmer to the area from the ball of foot to the toe of the insole. A 3D-motion capture system with infrared cameras was used to analyze the gait. The hip joint angle increased significantly under the INST and HEAT. Although the ankle dorsi-flexion at heel strike did not differ significantly for these conditions, ankle plantar-flexion significantly increased at toe-off under the INST and HEAT. Especially, effect size (d) in increased plantar-flexion was large in HEAT (=1.50), whereas it was moderate in INST (=0.68). These results suggest that a heated stimulus during gait enhanced the consciousness of push-off and increased leg swing and ankle plantar-flexion during the terminal stance phase, which may increase the stride length.
Collapse
|
13
|
Khandakar A, Mahmud S, Chowdhury MEH, Reaz MBI, Kiranyaz S, Mahbub ZB, Md Ali SH, Bakar AAA, Ayari MA, Alhatou M, Abdul-Moniem M, Faisal MAA. Design and Implementation of a Smart Insole System to Measure Plantar Pressure and Temperature. SENSORS (BASEL, SWITZERLAND) 2022; 22:7599. [PMID: 36236697 PMCID: PMC9572216 DOI: 10.3390/s22197599] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Revised: 10/01/2022] [Accepted: 10/02/2022] [Indexed: 06/16/2023]
Abstract
An intelligent insole system may monitor the individual's foot pressure and temperature in real-time from the comfort of their home, which can help capture foot problems in their earliest stages. Constant monitoring for foot complications is essential to avoid potentially devastating outcomes from common diseases such as diabetes mellitus. Inspired by those goals, the authors of this work propose a full design for a wearable insole that can detect both plantar pressure and temperature using off-the-shelf sensors. The design provides details of specific temperature and pressure sensors, circuit configuration for characterizing the sensors, and design considerations for creating a small system with suitable electronics. The procedure also details how, using a low-power communication protocol, data about the individuals' foot pressure and temperatures may be sent wirelessly to a centralized device for storage. This research may aid in the creation of an affordable, practical, and portable foot monitoring system for patients. The solution can be used for continuous, at-home monitoring of foot problems through pressure patterns and temperature differences between the two feet. The generated maps can be used for early detection of diabetic foot complication with the help of artificial intelligence.
Collapse
Affiliation(s)
- Amith Khandakar
- Department of Electrical Engineering, Qatar University, Doha 2713, Qatar
- Department of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia
| | - Sakib Mahmud
- Department of Electrical Engineering, Qatar University, Doha 2713, Qatar
| | | | - Mamun Bin Ibne Reaz
- Department of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia
| | - Serkan Kiranyaz
- Department of Electrical Engineering, Qatar University, Doha 2713, Qatar
| | - Zaid Bin Mahbub
- Department of Physics and Mathematics, North South University, Dhaka 1229, Bangladesh
| | - Sawal Hamid Md Ali
- Department of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia
| | - Ahmad Ashrif A. Bakar
- Department of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia
| | - Mohamed Arselene Ayari
- Department of Civil and Architectural Engineering, College of Engineering, Qatar University, Doha 2713, Qatar
- Technology Innovation and Engineering Education, College of Engineering, Qatar University, Doha 2713, Qatar
| | - Mohammed Alhatou
- Neuromuscular Division, Hamad General Hospital and Department of Neurology; Al Khor Hospital, Doha 3050, Qatar
| | | | | |
Collapse
|
14
|
Guo Y, Yang J, Liu Y, Chen X, Yang GZ. Detection and assessment of Parkinson's disease based on gait analysis: A survey. Front Aging Neurosci 2022; 14:916971. [PMID: 35992585 PMCID: PMC9382193 DOI: 10.3389/fnagi.2022.916971] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Accepted: 07/08/2022] [Indexed: 11/13/2022] Open
Abstract
Neurological disorders represent one of the leading causes of disability and mortality in the world. Parkinson's Disease (PD), for example, affecting millions of people worldwide is often manifested as impaired posture and gait. These impairments have been used as a clinical sign for the early detection of PD, as well as an objective index for pervasive monitoring of the PD patients in daily life. This review presents the evidence that demonstrates the relationship between human gait and PD, and illustrates the role of different gait analysis systems based on vision or wearable sensors. It also provides a comprehensive overview of the available automatic recognition systems for the detection and management of PD. The intervening measures for improving gait performance are summarized, in which the smart devices for gait intervention are emphasized. Finally, this review highlights some of the new opportunities in detecting, monitoring, and treating of PD based on gait, which could facilitate the development of objective gait-based biomarkers for personalized support and treatment of PD.
Collapse
Affiliation(s)
- Yao Guo
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| | - Jianxin Yang
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| | - Yuxuan Liu
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| | - Xun Chen
- Department of Electronic Engineering and Information Science, University of Science and Technology of China, Hefei, China
| | - Guang-Zhong Yang
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
15
|
Machine Learning Strategies for Low-Cost Insole-Based Prediction of Center of Gravity during Gait in Healthy Males. SENSORS 2022; 22:s22093499. [PMID: 35591188 PMCID: PMC9100257 DOI: 10.3390/s22093499] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 04/28/2022] [Accepted: 04/28/2022] [Indexed: 02/04/2023]
Abstract
Whole-body center of gravity (CG) movements in relation to the center of pressure (COP) offer insights into the balance control strategies of the human body. Existing CG measurement methods using expensive measurement equipment fixed in a laboratory environment are not intended for continuous monitoring. The development of wireless sensing technology makes it possible to expand the measurement in daily life. The insole system is a wearable device that can evaluate human balance ability by measuring pressure distribution on the ground. In this study, a novel protocol (data preparation and model training) for estimating the 3-axis CG trajectory from vertical plantar pressures was proposed and its performance was evaluated. Input and target data were obtained through gait experiments conducted on 15 adult and 15 elderly males using a self-made insole prototype and optical motion capture system. One gait cycle was divided into four semantic phases. Features specified for each phase were extracted and the CG trajectory was predicted using a bi-directional long short-term memory (Bi-LSTM) network. The performance of the proposed CG prediction model was evaluated by a comparative study with four prediction models having no gait phase segmentation. The CG trajectory calculated with the optoelectronic system was used as a golden standard. The relative root mean square error of the proposed model on the 3-axis of anterior/posterior, medial/lateral, and proximal/distal showed the best prediction performance, with 2.12%, 12.97%, and 12.47%. Biomechanical analysis of two healthy male groups was conducted. A statistically significant difference between CG trajectories of the two groups was shown in the proposed model. Large CG sway of the medial/lateral axis trajectory and CG fall of the proximal/distal axis trajectory is shown in the old group. The protocol proposed in this study is a basic step to have gait analysis in daily life. It is expected to be utilized as a key element for clinical applications.
Collapse
|
16
|
Hwang YT, Lee SH, Lin BS. Assessment System for Predicting Maximal Safe Range for Heel Height by Using Force-Sensing Resistor Sensors and Regression Models. SENSORS 2022; 22:s22093442. [PMID: 35591131 PMCID: PMC9103558 DOI: 10.3390/s22093442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/06/2022] [Revised: 04/19/2022] [Accepted: 04/28/2022] [Indexed: 02/01/2023]
Abstract
Women often wear high-heeled shoes for professional or esthetic reasons. However, high-heeled shoes can cause discomfort and injury and can change the body’s center of gravity when maintaining balance. This study developed an assessment system for predicting the maximal safe range for heel height by recording the plantar pressure of participants’ feet by using force-sensing resistor (FSR) sensors and conducting analyses using regression models. Specifically, 100 young healthy women stood on an adjustable platform while physicians estimated the maximal safe height of high-heeled shoes. The collected FSR data combined with and without personal features were analyzed using regression models. The experimental results showed that the regression model based on the pressure data for the right foot had better predictive power than that based on data for the left foot, regardless of the module. The model with two heights had higher predictive power than that with a single height. Furthermore, adding personal features under the condition of two heights afforded the best predictive effect. These results can help wearers choose maximal safe high-heeled shoes to reduce injuries to the bones and lower limbs.
Collapse
Affiliation(s)
- Yi-Ting Hwang
- Department of Statistics, National Taipei University, New Taipei City 237303, Taiwan;
| | - Si-Huei Lee
- Department of Physical Medicine and Rehabilitation, Taipei Veterans General Hospital, Taipei 112, Taiwan
- Faculty of Medicine, National Yang Ming Chiao Tung University, Taipei 112, Taiwan
- Correspondence: (S.-H.L.); (B.-S.L.)
| | - Bor-Shing Lin
- Department of Computer Science and Information Engineering, National Taipei University, New Taipei City 237303, Taiwan
- Correspondence: (S.-H.L.); (B.-S.L.)
| |
Collapse
|
17
|
Das R, Paul S, Mourya GK, Kumar N, Hussain M. Recent Trends and Practices Toward Assessment and Rehabilitation of Neurodegenerative Disorders: Insights From Human Gait. Front Neurosci 2022; 16:859298. [PMID: 35495059 PMCID: PMC9051393 DOI: 10.3389/fnins.2022.859298] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2022] [Accepted: 03/01/2022] [Indexed: 12/06/2022] Open
Abstract
The study of human movement and biomechanics forms an integral part of various clinical assessments and provides valuable information toward diagnosing neurodegenerative disorders where the motor symptoms predominate. Conventional gait and postural balance analysis techniques like force platforms, motion cameras, etc., are complex, expensive equipment requiring specialist operators, thereby posing a significant challenge toward translation to the clinics. The current manuscript presents an overview and relevant literature summarizing the umbrella of factors associated with neurodegenerative disorder management: from the pathogenesis and motor symptoms of commonly occurring disorders to current alternate practices toward its quantification and mitigation. This article reviews recent advances in technologies and methodologies for managing important neurodegenerative gait and balance disorders, emphasizing assessment and rehabilitation/assistance. The review predominantly focuses on the application of inertial sensors toward various facets of gait analysis, including event detection, spatiotemporal gait parameter measurement, estimation of joint kinematics, and postural balance analysis. In addition, the use of other sensing principles such as foot-force interaction measurement, electromyography techniques, electrogoniometers, force-myography, ultrasonic, piezoelectric, and microphone sensors has also been explored. The review also examined the commercially available wearable gait analysis systems. Additionally, a summary of recent progress in therapeutic approaches, viz., wearables, virtual reality (VR), and phytochemical compounds, has also been presented, explicitly targeting the neuro-motor and functional impairments associated with these disorders. Efforts toward therapeutic and functional rehabilitation through VR, wearables, and different phytochemical compounds are presented using recent examples of research across the commonly occurring neurodegenerative conditions [viz., Parkinson's disease (PD), Alzheimer's disease (AD), multiple sclerosis, Huntington's disease (HD), and amyotrophic lateral sclerosis (ALS)]. Studies exploring the potential role of Phyto compounds in mitigating commonly associated neurodegenerative pathologies such as mitochondrial dysfunction, α-synuclein accumulation, imbalance of free radicals, etc., are also discussed in breadth. Parameters such as joint angles, plantar pressure, and muscle force can be measured using portable and wearable sensors like accelerometers, gyroscopes, footswitches, force sensors, etc. Kinetic foot insoles and inertial measurement tools are widely explored for studying kinematic and kinetic parameters associated with gait. With advanced correlation algorithms and extensive RCTs, such measurement techniques can be an effective clinical and home-based monitoring and rehabilitation tool for neuro-impaired gait. As evident from the present literature, although the vast majority of works reported are not clinically and extensively validated to derive a firm conclusion about the effectiveness of such techniques, wearable sensors present a promising impact toward dealing with neurodegenerative motor disorders.
Collapse
Affiliation(s)
- Ratan Das
- Department of Biomedical Engineering, North-Eastern Hill University, Shillong, India
| | - Sudip Paul
- Department of Biomedical Engineering, North-Eastern Hill University, Shillong, India
| | - Gajendra Kumar Mourya
- Department of Biomedical Engineering, North-Eastern Hill University, Shillong, India
| | - Neelesh Kumar
- Biomedical Applications Unit, Central Scientific Instruments Organisation, Chandigarh, India
| | - Masaraf Hussain
- Department of Neurology, North Eastern Indira Gandhi Regional Institute of Health and Medical Sciences, Shillong, India
| |
Collapse
|
18
|
Development of a Three-Axis Monolithic Flexure-Based Ground Reaction Force Sensor for Various Gait Analysis. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3146921] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
19
|
Shoaib MR, Emara HM, Elwekeil M, El-Shafai W, Taha TE, El-Fishawy AS, El-Rabaie ESM, El-Samie FEA. Hybrid classification structures for automatic COVID-19 detection. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING 2022; 13:4477-4492. [PMID: 35280854 PMCID: PMC8898749 DOI: 10.1007/s12652-021-03686-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Accepted: 12/21/2021] [Indexed: 06/14/2023]
Abstract
This paper explores the issue of COVID-19 detection from X-ray images. X-ray images, in general, suffer from low quality and low resolution. That is why the detection of different diseases from X-ray images requires sophisticated algorithms. First of all, machine learning (ML) is adopted on the features extracted manually from the X-ray images. Twelve classifiers are compared for this task. Simulation results reveal the superiority of Gaussian process (GP) and random forest (RF) classifiers. To extend the feasibility of this study, we have modified the feature extraction strategy to give deep features. Four pre-trained models, namely ResNet50, ResNet101, Inception-v3 and InceptionResnet-v2 are adopted in this study. Simulation results prove that InceptionResnet-v2 and ResNet101 with GP classifier achieve the best performance. Moreover, transfer learning (TL) is also introduced in this paper to enhance the COVID-19 detection process. The selected classification hierarchy is also compared with a convolutional neural network (CNN) model built from scratch to prove its quality of classification. Simulation results prove that deep features and TL methods provide the best performance that reached 100% for accuracy.
Collapse
Affiliation(s)
- Mohamed R. Shoaib
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf, 32952 Egypt
| | - Heba M. Emara
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf, 32952 Egypt
| | - Mohamed Elwekeil
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf, 32952 Egypt
- Department of Electrical and Information Engineering, University of Cassino and Southern Lazio, Cassino, Italy
| | - Walid El-Shafai
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf, 32952 Egypt
- Security Engineering Lab, Computer Science Department, Prince Sultan University, Riyadh, 11586 Saudi Arabia
| | - Taha E. Taha
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf, 32952 Egypt
| | - Adel S. El-Fishawy
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf, 32952 Egypt
| | - El-Sayed M. El-Rabaie
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf, 32952 Egypt
| | - Fathi E. Abd El-Samie
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf, 32952 Egypt
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, Riyadh, Saudi Arabia
| |
Collapse
|
20
|
Panahi A, Askari Moghadam R, Akrami M, Madani K. Deep Residual Neural Network for COVID-19 Detection from Chest X-ray Images. SN COMPUTER SCIENCE 2022; 3:169. [PMID: 35224513 PMCID: PMC8860458 DOI: 10.1007/s42979-022-01067-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/17/2021] [Accepted: 11/27/2021] [Indexed: 12/22/2022]
Abstract
The COVID-19 diffused quickly throughout the world and converted as a pandemic. It has caused a destructive effect on both regular lives, common health and global business. It is crucial to identify positive patients as shortly as desirable to limit this epidemic’s further diffusion and to manage immediately affected cases. The demand for quick assistant distinguishing devices has developed. Recent findings achieved utilizing radiology imaging systems propose that such images include salient data about the COVID-19. The utilization of progressive artificial intelligence (AI) methods linked by radiological imaging can help the reliable diagnosis of COVID-19. As radiography images can recognize pneumonia infections, this research brings an accurate and automatic technique based on a deep residual network to analyze chest X-ray images to monitor COVID-19 and diagnose verified patients. The physician states that it is significantly challenging to separate COVID-19 from common viral and bacterial pneumonia, while COVID-19 is additionally a variety of viruses. The proposed network is expanded to perform detailed diagnostics for two multi-class classification (COVID-19, Normal, Viral Pneumonia) and (COVID-19, Normal, Viral Pneumonia, Bacterial Pneumonia) and binary classification. By comparing the proposed network with the popular methods on public databases, the results show that the proposed algorithm can provide an accuracy of 92.1% in classifying multi-classes of COVID-19, normal, viral pneumonia, and bacterial pneumonia cases. It can be applied to support radiologists in verifying their first viewpoint.
Collapse
Affiliation(s)
- Amirhossein Panahi
- Faculty of New Sciences and Technologies, University of Tehran, Tehran, Iran
| | | | - Mohammadreza Akrami
- Faculty of New Sciences and Technologies, University of Tehran, Tehran, Iran
| | - Kurosh Madani
- LISSI Lab, Senart-FB Institute of Technology, University Paris Est-Creteil (UPEC), Lieusaint, France
| |
Collapse
|
21
|
Sourab SY, Kabir MA. A comparison of hybrid deep learning models for pneumonia diagnosis from chest radiograms. SENSORS INTERNATIONAL 2022. [DOI: 10.1016/j.sintl.2022.100167] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
|
22
|
Faisal MAA, Chowdhury MEH, Khandakar A, Hossain MS, Alhatou M, Mahmud S, Ara I, Sheikh SI, Ahmed MU. An investigation to study the effects of Tai Chi on human gait dynamics using classical machine learning. Comput Biol Med 2022; 142:105184. [PMID: 35016098 DOI: 10.1016/j.compbiomed.2021.105184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2021] [Revised: 12/16/2021] [Accepted: 12/26/2021] [Indexed: 11/03/2022]
Abstract
Tai Chi has been proven effective in preventing falls in older adults, improving the joint function of knee osteoarthritis patients, and improving the balance of stroke survivors. However, the effect of Tai Chi on human gait dynamics is still less understood. Studies conducted in this domain only relied on statistical and clinical measurements on the time-series gait data. In recent years machine learning has proven its ability in recognizing complex patterns from time-series data. In this research work, we have evaluated the performance of several machine learning algorithms in classifying the walking gait of Tai Chi masters (people expert on Tai Chi) from the normal subjects. The study is designed in a longitudinal manner where the Tai Chi naive subjects received 6 months of Tai Chi training and the data was recorded during the initial and follow-up sessions. A total of 57 subjects participated in the experiment among which 27 were Tai Chi masters. We have introduced a gender, BMI-based scaling of the features to mitigate their effects from the gait parameters. A hybrid feature ranking technique has also been proposed for selecting the best features for classification. The research reports 88.17% accuracy and 93.10% ROC AUC values from subject-wise 5-fold cross-validation for the Tai Chi masters' vs normal subjects' walking gait classification for the "Single-task" walking scenarios. We have also got fairly good accuracy for the "Dual-task" walking scenarios (82.62% accuracy and 84.11% ROC AUC values). The results indicate that Tai Chi clearly has an effect on the walking gait dynamics. The findings and methodology of this study could provide preliminary guidance for applying machine learning-based approaches to similar gait kinematics analyses.
Collapse
Affiliation(s)
- Md Ahasan Atick Faisal
- Department of Electrical and Electronic Engineering, University of Dhaka, Dhaka, 1000, Bangladesh
| | | | - Amith Khandakar
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar
| | - Md Shafayet Hossain
- Department of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi, Selangor, 43600, Malaysia
| | - Mohammed Alhatou
- Neuromuscular Division, Hamad General Hospital and Department of Neurology, Alkhor Hospital, Doha, 3050, Qatar
| | - Sakib Mahmud
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar
| | - Iffat Ara
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar
| | - Shah Imran Sheikh
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar
| | - Mosabber Uddin Ahmed
- Department of Electrical and Electronic Engineering, University of Dhaka, Dhaka, 1000, Bangladesh.
| |
Collapse
|
23
|
HU QUAN, CAI PING. INSOLE-BASED ESTIMATION OF COMPLETE GROUND REACTION FORCE WITH GAUSSIAN KERNEL REGRESSION AND DATA EXPANSION. J MECH MED BIOL 2021. [DOI: 10.1142/s0219519422500014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
A method for estimating ground reaction force (GRF) with plantar pressure was proposed in this paper. The estimation model was constructed to approximate the nonlinear relationships between GRF and the plantar pressure according to the linear combinations of Gaussian kernel functions. Partial least squares regression (PLSR) was adopted to obtain model parameters and eliminate multicollinearity among the pressure components. The general model and subject-specific models were constructed for 12 male and 4 female subjects. Moreover, a data expansion method was introduced for the establishment of subject-specific model, which is implemented by searching and adopting the data with consistent statistical characteristics in a pre-established database. That approach is particularly meaningful for the group whose walking ability is limited or clinic where the force platform is not available. The NRMSEs (%) for general model were 5.27–7.85% (GRF_V), 7.35–8.53% (GRF_ML), and 8.82–10.54% (GRF_AP). The maximum NRMSEs (%) for subject-specific models were 5.02% (GRF_V), 9.91% (GRF_ML), and 10.23% (GRF_AP). Results showed that both general and subject-specific models achieved higher accuracy than existing methods such as linear regression and neural network methods.
Collapse
Affiliation(s)
- QUAN HU
- Department of Instrument Science and Engineering, Shanghai Jiao Tong University, Shanghai 202400, P. R. China
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 202400, P. R. China
| | - PING CAI
- Department of Instrument Science and Engineering, Shanghai Jiao Tong University, Shanghai 202400, P. R. China
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 202400, P. R. China
| |
Collapse
|
24
|
Song Y, Bernard L, Jorgensen C, Dusfour G, Pers YM. The Challenges of Telemedicine in Rheumatology. Front Med (Lausanne) 2021; 8:746219. [PMID: 34722584 PMCID: PMC8548429 DOI: 10.3389/fmed.2021.746219] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2021] [Accepted: 09/20/2021] [Indexed: 12/14/2022] Open
Abstract
During the past 20 years, the development of telemedicine has accelerated due to the rapid advancement and implementation of more sophisticated connected technologies. In rheumatology, e-health interventions in the diagnosis, monitoring and mentoring of rheumatic diseases are applied in different forms: teleconsultation and telecommunications, mobile applications, mobile devices, digital therapy, and artificial intelligence or machine learning. Telemedicine offers several advantages, in particular by facilitating access to healthcare and providing personalized and continuous patient monitoring. However, some limitations remain to be solved, such as data security, legal problems, reimbursement method, accessibility, as well as the application of recommendations in the development of the tools.
Collapse
Affiliation(s)
- Yujie Song
- IRMB, University of Montpellier, INSERM, CHU Montpellier, Montpellier, France
| | - Laurène Bernard
- Clinical Immunology and Osteoarticular Diseases Therapeutic Unit, Department of Rheumatology, Lapeyronie University Hospital, Montpellier, France
| | - Christian Jorgensen
- IRMB, University of Montpellier, INSERM, CHU Montpellier, Montpellier, France.,Clinical Immunology and Osteoarticular Diseases Therapeutic Unit, Department of Rheumatology, Lapeyronie University Hospital, Montpellier, France
| | - Gilles Dusfour
- IRMB, University of Montpellier, CARTIGEN, CHU de Montpellier, Montpellier, France
| | - Yves-Marie Pers
- IRMB, University of Montpellier, INSERM, CHU Montpellier, Montpellier, France.,Clinical Immunology and Osteoarticular Diseases Therapeutic Unit, Department of Rheumatology, Lapeyronie University Hospital, Montpellier, France
| |
Collapse
|
25
|
Oubre B, Lane S, Holmes S, Boyer K, Lee SI. Estimating Ground Reaction Force and Center of Pressure using Low-Cost Wearable Devices. IEEE Trans Biomed Eng 2021; 69:1461-1468. [PMID: 34648428 DOI: 10.1109/tbme.2021.3120346] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Ambulatory monitoring of ground reaction force (GRF) and center of pressure (CoP) could improve management of health conditions that impair mobility. Insoles instrumented with force-sensitive resistors (FSRs) are an unobtrusive, low-cost, and low-power technology for sampling GRF and CoP in real-world environments. However, FSRs have variable response characteristics that complicate estimation of GRF and CoP. This study introduces a unique data analytic pipeline that enables accurate estimation of GRF and CoP despite relatively inaccurate FSR responses. This paper also investigates whether inclusion of a complementary knee angle sensor improves estimation accuracy. METHODS Seventeen healthy subjects were equipped with an insole instrumented with six FSRs and a string-based knee angle sensor. Subjects walked in a straight line at self-selected slow, preferred, and fast speeds over an in-ground force platform. Twenty repetitions were performed for each speed. Supervised machine learning models estimated weight-normalized GRF and shoe size-normalized CoP, which were re-scaled to obtain GRF and CoP. RESULTS Anteroposterior GRF, Vertical GRF, and Anteroposterior CoP were estimated with a normalized root mean square error (NRMSE) of less than 5%. Mediolateral GRF and CoP were estimated with an NRMSE of 8.1% and 6.4%$ respectively. Knee angle-related features slightly improved GRF estimates. CONCLUSION Normalized models accurately estimated GRF and CoP despite deficiencies in FSR data. SIGNIFICANCE Ambulatory use of the proposed system could enable objective, longitudinal monitoring of severity and progression for a variety of health conditions.
Collapse
|
26
|
Ison C, Neilsen C, DeBerardinis J, Trabia MB, Dufek JS. Use of Pressure-Measuring Insoles to Characterize Gait Parameters in Simulated Reduced-Gravity Conditions. SENSORS 2021; 21:s21186244. [PMID: 34577451 PMCID: PMC8473299 DOI: 10.3390/s21186244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 08/28/2021] [Accepted: 09/14/2021] [Indexed: 11/16/2022]
Abstract
Prior researchers have observed the effect of simulated reduced-gravity exercise. However, the extent to which lower-body positive-pressure treadmill (LBPPT) walking alters kinematic gait characteristics is not well understood. The purpose of the study was to investigate the effect of LBPPT walking on selected gait parameters in simulated reduced-gravity conditions. Twenty-nine college-aged volunteers participated in this cross-sectional study. Participants wore pressure-measuring insoles (Medilogic GmBH, Schönefeld, Germany) and completed three 3.5-min walking trials on the LBPPT (AlterG, Inc., Fremont, CA, USA) at 100% (normal gravity) as well as reduced-gravity conditions of 40% and 20% body weight (BW). The resulting insole data were analyzed to calculate center of pressure (COP) variables: COP path length and width and stance time. The results showed that 100% BW condition was significantly different from both the 40% and 20% BW conditions, p < 0.05. There were no significant differences observed between the 40% and 20% BW conditions for COP path length and width. Conversely, stance time significantly differed between the 40% and 20% BW conditions. The findings of this study may prove beneficial for clinicians as they develop rehabilitation strategies to effectively unload the individual's body weight to perform safe exercises.
Collapse
Affiliation(s)
- Christian Ison
- Department of Kinesiology and Nutrition Sciences, University of Nevada, Las Vegas, NV 89154, USA;
- Correspondence: ; Tel.: +1-626-824-4007
| | - Connor Neilsen
- Department of Mechanical Engineering, University of Nevada, Las Vegas, NV 89154, USA; (C.N.); (J.D.); (M.B.T.)
| | - Jessica DeBerardinis
- Department of Mechanical Engineering, University of Nevada, Las Vegas, NV 89154, USA; (C.N.); (J.D.); (M.B.T.)
| | - Mohamed B. Trabia
- Department of Mechanical Engineering, University of Nevada, Las Vegas, NV 89154, USA; (C.N.); (J.D.); (M.B.T.)
| | - Janet S. Dufek
- Department of Kinesiology and Nutrition Sciences, University of Nevada, Las Vegas, NV 89154, USA;
| |
Collapse
|
27
|
Singh A, Sharma A, Ahmed A, Sundramoorthy AK, Furukawa H, Arya S, Khosla A. Recent Advances in Electrochemical Biosensors: Applications, Challenges, and Future Scope. BIOSENSORS 2021; 11:336. [PMID: 34562926 PMCID: PMC8472208 DOI: 10.3390/bios11090336] [Citation(s) in RCA: 117] [Impact Index Per Article: 39.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/24/2021] [Revised: 08/25/2021] [Accepted: 08/31/2021] [Indexed: 05/11/2023]
Abstract
The electrochemical biosensors are a class of biosensors which convert biological information such as analyte concentration that is a biological recognition element (biochemical receptor) into current or voltage. Electrochemical biosensors depict propitious diagnostic technology which can detect biomarkers in body fluids such as sweat, blood, feces, or urine. Combinations of suitable immobilization techniques with effective transducers give rise to an efficient biosensor. They have been employed in the food industry, medical sciences, defense, studying plant biology, etc. While sensing complex structures and entities, a large data is obtained, and it becomes difficult to manually interpret all the data. Machine learning helps in interpreting large sensing data. In the case of biosensors, the presence of impurity affects the performance of the sensor and machine learning helps in removing signals obtained from the contaminants to obtain a high sensitivity. In this review, we discuss different types of biosensors along with their applications and the benefits of machine learning. This is followed by a discussion on the challenges, missing gaps in the knowledge, and solutions in the field of electrochemical biosensors. This review aims to serve as a valuable resource for scientists and engineers entering the interdisciplinary field of electrochemical biosensors. Furthermore, this review provides insight into the type of electrochemical biosensors, their applications, the importance of machine learning (ML) in biosensing, and challenges and future outlook.
Collapse
Affiliation(s)
- Anoop Singh
- Department of Physics, University of Jammu, Jammu 180006, India; (A.S.); (A.S.); (A.A.)
| | - Asha Sharma
- Department of Physics, University of Jammu, Jammu 180006, India; (A.S.); (A.S.); (A.A.)
| | - Aamir Ahmed
- Department of Physics, University of Jammu, Jammu 180006, India; (A.S.); (A.S.); (A.A.)
| | - Ashok K. Sundramoorthy
- Department of Chemistry, SRM Institute of Science and Technology, Kattankulathur 603203, India;
| | - Hidemitsu Furukawa
- Department of Mechanical System Engineering, Graduate School of Science and Engineering, Yamagata University, Yamagata 992-8510, Japan;
| | - Sandeep Arya
- Department of Physics, University of Jammu, Jammu 180006, India; (A.S.); (A.S.); (A.A.)
| | - Ajit Khosla
- Department of Mechanical System Engineering, Graduate School of Science and Engineering, Yamagata University, Yamagata 992-8510, Japan;
| |
Collapse
|
28
|
Rajendran D, Ramalingame R, Palaniyappan S, Wagner G, Kanoun O. Flexible Ultra-Thin Nanocomposite Based Piezoresistive Pressure Sensors for Foot Pressure Distribution Measurement. SENSORS (BASEL, SWITZERLAND) 2021; 21:6082. [PMID: 34577285 PMCID: PMC8471841 DOI: 10.3390/s21186082] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Revised: 09/02/2021] [Accepted: 09/07/2021] [Indexed: 11/16/2022]
Abstract
Foot pressure measurement plays an essential role in healthcare applications, clinical rehabilitation, sports training and pedestrian navigation. Among various foot pressure measurement techniques, in-shoe sensors are flexible and can measure the pressure distribution accurately. In this paper, we describe the design and characterization of flexible and low-cost multi-walled carbon nanotubes (MWCNT)/Polydimethylsiloxane (PDMS) based pressure sensors for foot pressure monitoring. The sensors have excellent electrical and mechanical properties an show a stable response at constant pressure loadings for over 5000 cycles. They have a high sensitivity of 4.4 kΩ/kPa and the hysteresis effect corresponds to an energy loss of less than 1.7%. The measurement deviation is of maximally 0.13% relative to the maximal relative resistance. The sensors have a measurement range of up to 330 kPa. The experimental investigations show that the sensors have repeatable responses at different pressure loading rates (5 N/s to 50 N/s). In this paper, we focus on the demonstration of the functionality of an in-sole based on MWCNT/PDMS nanocomposite pressure sensors, weighing approx. 9.46 g, by investigating the foot pressure distribution while walking and standing. The foot pressure distribution was investigated by measuring the resistance changes of the pressure sensors for a person while walking and standing. The results show that pressure distribution is higher in the forefoot and the heel while standing in a normal position. The foot pressure distribution is transferred from the heel to the entire foot and further transferred to the forefoot during the first instance of the gait cycle.
Collapse
Affiliation(s)
- Dhivakar Rajendran
- Measurement and Sensor Technology, Technische Universität Chemnitz, Reichenhainer Straße 70, 09126 Chemnitz, Germany
| | - Rajarajan Ramalingame
- Measurement and Sensor Technology, Technische Universität Chemnitz, Reichenhainer Straße 70, 09126 Chemnitz, Germany
| | - Saravanan Palaniyappan
- Composites and Material Compounds, Institute of Material Science and Engineering (IWW), Technische Universität Chemnitz, Erfenschlager Straße 73, 09125 Chemnitz, Germany
| | - Guntram Wagner
- Composites and Material Compounds, Institute of Material Science and Engineering (IWW), Technische Universität Chemnitz, Erfenschlager Straße 73, 09125 Chemnitz, Germany
| | - Olfa Kanoun
- Measurement and Sensor Technology, Technische Universität Chemnitz, Reichenhainer Straße 70, 09126 Chemnitz, Germany
| |
Collapse
|
29
|
Development of a Self-Powered Piezo-Resistive Smart Insole Equipped with Low-Power BLE Connectivity for Remote Gait Monitoring. SENSORS 2021; 21:s21134539. [PMID: 34283073 PMCID: PMC8272025 DOI: 10.3390/s21134539] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Revised: 06/11/2021] [Accepted: 06/24/2021] [Indexed: 11/17/2022]
Abstract
The evolution of low power electronics and the availability of new smart materials are opening new frontiers to develop wearable systems for medical applications, lifestyle monitoring, and performance detection. This paper presents the development and realization of a novel smart insole for monitoring the plantar pressure distribution and gait parameters; indeed, it includes a piezoresistive sensing matrix based on a Velostat layer for transducing applied pressure into an electric signal. At first, an accurate and complete characterization of Velostat-based pressure sensors is reported as a function of sizes, support material, and pressure trend. The realization and testing of a low-cost and reliable piezoresistive sensing matrix based on a sandwich structure are discussed. This last is interfaced with a low power conditioning and processing section based on an Arduino Lilypad board and an analog multiplexer for acquiring the pressure data. The insole includes a 3-axis capacitive accelerometer for detecting the gait parameters (swing time and stance phase time) featuring the walking. A Bluetooth Low Energy (BLE) 5.0 module is included for transmitting in real-time the acquired data toward a PC, tablet or smartphone, for displaying and processing them using a custom Processing® application. Moreover, the smart insole is equipped with a piezoelectric harvesting section for scavenging energy from walking. The onfield tests indicate that for a walking speed higher than 1 ms-1, the device's power requirements (i.e., P¯=5.84 mW) was fulfilled. However, more than 9 days of autonomy are guaranteed by the integrated 380-mAh Lipo battery in the total absence of energy contributions from the harvesting section.
Collapse
|
30
|
El Asnaoui K, Chawki Y. Using X-ray images and deep learning for automated detection of coronavirus disease. J Biomol Struct Dyn 2021; 39:3615-3626. [PMID: 32397844 DOI: 10.1109/access.2020.3010287] [Citation(s) in RCA: 474] [Impact Index Per Article: 158.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Coronavirus is still the leading cause of death worldwide. There are a set number of COVID-19 test units accessible in emergency clinics because of the expanding cases daily. Therefore, it is important to implement an automatic detection and classification system as a speedy elective finding choice to forestall COVID-19 spreading among individuals. Medical images analysis is one of the most promising research areas, it provides facilities for diagnosis and making decisions of a number of diseases such as Coronavirus. This paper conducts a comparative study of the use of the recent deep learning models (VGG16, VGG19, DenseNet201, Inception_ResNet_V2, Inception_V3, Resnet50, and MobileNet_V2) to deal with detection and classification of coronavirus pneumonia. The experiments were conducted using chest X-ray & CT dataset of 6087 images (2780 images of bacterial pneumonia, 1493 of coronavirus, 231 of Covid19, and 1583 normal) and confusion matrices are used to evaluate model performances. Results found out that the use of inception_Resnet_V2 and Densnet201 provide better results compared to other models used in this work (92.18% accuracy for Inception-ResNetV2 and 88.09% accuracy for Densnet201).Communicated by Ramaswamy H. Sarma.
Collapse
Affiliation(s)
- Khalid El Asnaoui
- Complex System Engineering and Human System, Mohammed VI Polytechnic University, Benguerir, Morocco
| | - Youness Chawki
- Faculty of Sciences and Techniques, Moulay Ismail University, Errachidia, Morocco
| |
Collapse
|
31
|
Emara HM, Shoaib MR, Elwekeil M, El‐Shafai W, Taha TE, El‐Fishawy AS, El‐Rabaie EM, Alshebeili SA, Dessouky MI, Abd El‐Samie FE. Deep convolutional neural networks for COVID-19 automatic diagnosis. Microsc Res Tech 2021; 84:2504-2516. [PMID: 34121273 PMCID: PMC8420362 DOI: 10.1002/jemt.23713] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2020] [Revised: 12/29/2020] [Accepted: 01/06/2021] [Indexed: 11/16/2022]
Abstract
This article is mainly concerned with COVID‐19 diagnosis from X‐ray images. The number of cases infected with COVID‐19 is increasing daily, and there is a limitation in the number of test kits needed in hospitals. Therefore, there is an imperative need to implement an efficient automatic diagnosis system to alleviate COVID‐19 spreading among people. This article presents a discussion of the utilization of convolutional neural network (CNN) models with different learning strategies for automatic COVID‐19 diagnosis. First, we consider the CNN‐based transfer learning approach for automatic diagnosis of COVID‐19 from X‐ray images with different training and testing ratios. Different pre‐trained deep learning models in addition to a transfer learning model are considered and compared for the task of COVID‐19 detection from X‐ray images. Confusion matrices of these studied models are presented and analyzed. Considering the performance results obtained, ResNet models (ResNet18, ResNet50, and ResNet101) provide the highest classification accuracy on the two considered datasets with different training and testing ratios, namely 80/20, 70/30, 60/40, and 50/50. The accuracies obtained using the first dataset with 70/30 training and testing ratio are 97.67%, 98.81%, and 100% for ResNet18, ResNet50, and ResNet101, respectively. For the second dataset, the reported accuracies are 99%, 99.12%, and 99.29% for ResNet18, ResNet50, and ResNet101, respectively. The second approach is the training of a proposed CNN model from scratch. The results confirm that training of the CNN from scratch can lead to the identification of the signs of COVID‐19 disease.
Collapse
Affiliation(s)
- Heba M. Emara
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
| | - Mohamed R. Shoaib
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
| | - Mohamed Elwekeil
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
| | - Walid El‐Shafai
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
- Security Engineering LabComputer Science Department, Prince Sultan UniversityRiyadhSaudi Arabia
| | - Taha E. Taha
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
| | - Adel S. El‐Fishawy
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
| | - El‐Sayed M. El‐Rabaie
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
| | - Saleh A. Alshebeili
- Electrical Engineering DepartmentKACST‐TIC in Radio Frequency and Photonics for the e‐Society (RFTONICS), King Saud UniversityRiyadhSaudi Arabia
- Department of Electrical EngineeringKing Saud UniversityRiyadhSaudi Arabia
| | - Moawad I. Dessouky
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
| | - Fathi E. Abd El‐Samie
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
- Department of Information TechnologyCollege of Computer and Information Sciences, Princess Nourah Bint Abdulrahman UniversityRiyadhSaudi Arabia
| |
Collapse
|
32
|
Panetta K, Sanghavi F, Agaian S, Madan N. Automated Detection of COVID-19 Cases on Radiographs using Shape-Dependent Fibonacci-p Patterns. IEEE J Biomed Health Inform 2021; 25:1852-1863. [PMID: 33788696 PMCID: PMC8768975 DOI: 10.1109/jbhi.2021.3069798] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
The coronavirus (COVID-19) pandemic has been adversely affecting people's health globally. To diminish the effect of this widespread pandemic, it is essential to detect COVID-19 cases as quickly as possible. Chest radiographs are less expensive and are a widely available imaging modality for detecting chest pathology compared with CT images. They play a vital role in early prediction and developing treatment plans for suspected or confirmed COVID-19 chest infection patients. In this paper, a novel shape-dependent Fibonacci-p patterns-based feature descriptor using a machine learning approach is proposed. Computer simulations show that the presented system (1) increases the effectiveness of differentiating COVID-19, viral pneumonia, and normal conditions, (2) is effective on small datasets, and (3) has faster inference time compared to deep learning methods with comparable performance. Computer simulations are performed on two publicly available datasets; (a) the Kaggle dataset, and (b) the COVIDGR dataset. To assess the performance of the presented system, various evaluation parameters, such as accuracy, recall, specificity, precision, and f1-score are used. Nearly 100% differentiation between normal and COVID-19 radiographs is observed for the three-class classification scheme using the lung area-specific Kaggle radiographs. While Recall of 72.65 ± 6.83 and specificity of 77.72 ± 8.06 is observed for the COVIDGR dataset.
Collapse
|
33
|
Ren B, Liu J. Design of a Plantar Pressure Insole Measuring System Based on Modular Photoelectric Pressure Sensor Unit. SENSORS 2021; 21:s21113780. [PMID: 34072553 PMCID: PMC8199404 DOI: 10.3390/s21113780] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 05/26/2021] [Accepted: 05/27/2021] [Indexed: 11/16/2022]
Abstract
Accurately perceiving and predicting the parameters related to human walking is very important for man-machine coupled cooperative control systems such as exoskeletons and power prostheses. Plantar pressure data is rich in human gait and posture information and is an essential source of reference information as the input of the exoskeleton control system. Therefore, the proper design of the pressure sensing insole and validation is a big challenge considering the requirements such as convenience, reliability, no interference and so on. In this research, we developed a low-cost modular sensing unit based on the principle of photoelectric sensing and designed a plantar pressure sensing insole to achieve the purpose of sensing human walking gait and posture information. On the one hand, the sensor unit is made of economy-friendly commercial flexible circuits and elastic silicone, and the mechanical and electrical characteristics of the modular sensor unit are evaluated by a self-developed pressure-related calibration system. The calibration results show that the modular sensor based on the photoelectric sensing principle has fast response and negligible hysteresis. On the other hand, we analyzed the area where the plantar pressure is densely distributed. One benefit of the modular sensing unit design is that it is rather convenient to fabricate different insole solutions, so we fabricated and compared several pressure-sensitive insole solutions in this preliminary study. During the dynamic locomotion experiments of wearing the pressure-sensing insole, the time series signal of each sensor unit was collected and analyzed. The results show that the pressure sensing insole based on the photoelectric effect can sense the distribution of the plantar pressure by capturing the deformation of the insole caused by the foot contact during locomotion, and provide reliable gait information for wearable applications.
Collapse
|
34
|
Liu X, Zhao C, Zheng B, Guo Q, Duan X, Wulamu A, Zhang D. Wearable Devices for Gait Analysis in Intelligent Healthcare. FRONTIERS IN COMPUTER SCIENCE 2021. [DOI: 10.3389/fcomp.2021.661676] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
In this study, we review the role of wearable devices in tracking our daily locomotion. We discuss types of wearable devices that can be used, methods for gait analyses, and multiple healthcare-related applications aided by artificial intelligence. Impaired walking and locomotion are common resulting from injuries, degenerative pathologies, musculoskeletal disorders, and various neurological damages. Daily tracking and gait analysis are convenient and efficient approaches for monitoring human walking, where concreate and rich data can be obtained for examining our posture control mechanism during body movement and providing enhanced clinical pieces of evidence for diagnoses and treatments. Many sensors in wearable devices can help to record data of walking and running; spatiotemporal and kinematic variables can be further calculated in gait analysis. We report our previous works in gait analysis, discussing applications of wearable devices for detecting foot and ankle lesions, supporting surgeons in early diagnosis, and helping physicians with rehabilitation.
Collapse
|
35
|
Ghaderzadeh M, Asadi F. Deep Learning in the Detection and Diagnosis of COVID-19 Using Radiology Modalities: A Systematic Review. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:6677314. [PMID: 33747419 PMCID: PMC7958142 DOI: 10.1155/2021/6677314] [Citation(s) in RCA: 37] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 01/08/2021] [Accepted: 02/11/2021] [Indexed: 12/17/2022]
Abstract
Introduction The early detection and diagnosis of COVID-19 and the accurate separation of non-COVID-19 cases at the lowest cost and in the early stages of the disease are among the main challenges in the current COVID-19 pandemic. Concerning the novelty of the disease, diagnostic methods based on radiological images suffer from shortcomings despite their many applications in diagnostic centers. Accordingly, medical and computer researchers tend to use machine-learning models to analyze radiology images. Material and Methods. The present systematic review was conducted by searching the three databases of PubMed, Scopus, and Web of Science from November 1, 2019, to July 20, 2020, based on a search strategy. A total of 168 articles were extracted and, by applying the inclusion and exclusion criteria, 37 articles were selected as the research population. Result This review study provides an overview of the current state of all models for the detection and diagnosis of COVID-19 through radiology modalities and their processing based on deep learning. According to the findings, deep learning-based models have an extraordinary capacity to offer an accurate and efficient system for the detection and diagnosis of COVID-19, the use of which in the processing of modalities would lead to a significant increase in sensitivity and specificity values. Conclusion The application of deep learning in the field of COVID-19 radiologic image processing reduces false-positive and negative errors in the detection and diagnosis of this disease and offers a unique opportunity to provide fast, cheap, and safe diagnostic services to patients.
Collapse
Affiliation(s)
- Mustafa Ghaderzadeh
- Student Research Committee, Department and Faculty of Health Information Technology and Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Farkhondeh Asadi
- Department of Health Information Technology and Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| |
Collapse
|
36
|
Low-Cost Sensors and Biological Signals. SENSORS 2021; 21:s21041482. [PMID: 33672660 PMCID: PMC7924169 DOI: 10.3390/s21041482] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 02/02/2021] [Accepted: 02/17/2021] [Indexed: 11/23/2022]
|
37
|
Elshennawy NM, Ibrahim DM. Deep-Pneumonia Framework Using Deep Learning Models Based on Chest X-Ray Images. Diagnostics (Basel) 2020; 10:diagnostics10090649. [PMID: 32872384 PMCID: PMC7554804 DOI: 10.3390/diagnostics10090649] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Revised: 08/25/2020] [Accepted: 08/26/2020] [Indexed: 12/12/2022] Open
Abstract
Pneumonia is a contagious disease that causes ulcers of the lungs, and is one of the main reasons for death among children and the elderly in the world. Several deep learning models for detecting pneumonia from chest X-ray images have been proposed. One of the extreme challenges has been to find an appropriate and efficient model that meets all performance metrics. Proposing efficient and powerful deep learning models for detecting and classifying pneumonia is the main purpose of this work. In this paper, four different models are developed by changing the used deep learning method; two pre-trained models, ResNet152V2 and MobileNetV2, a Convolutional Neural Network (CNN), and a Long Short-Term Memory (LSTM). The proposed models are implemented and evaluated using Python and compared with recent similar research. The results demonstrate that our proposed deep learning framework improves accuracy, precision, F1-score, recall, and Area Under the Curve (AUC) by 99.22%, 99.43%, 99.44%, 99.44%, and 99.77%, respectively. As clearly illustrated from the results, the ResNet152V2 model outperforms other recently proposed works. Moreover, the other proposed models—MobileNetV2, CNN, and LSTM-CNN—achieved results with more than 91% in accuracy, recall, F1-score, precision, and AUC, and exceed the recently introduced models in the literature.
Collapse
Affiliation(s)
- Nada M. Elshennawy
- Computers and Control Engineering Department, Faculty of Engineering, Tanta University, Tanta 31733, Egypt;
| | - Dina M. Ibrahim
- Computers and Control Engineering Department, Faculty of Engineering, Tanta University, Tanta 31733, Egypt;
- Department of Information Technology, College of Computer, Qassim University, Buraydah, Saudi Arabia
- Correspondence:
| |
Collapse
|
38
|
Hashmi MF, Katiyar S, Keskar AG, Bokde ND, Geem ZW. Efficient Pneumonia Detection in Chest Xray Images Using Deep Transfer Learning. Diagnostics (Basel) 2020; 10:E417. [PMID: 32575475 PMCID: PMC7345724 DOI: 10.3390/diagnostics10060417] [Citation(s) in RCA: 53] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2020] [Revised: 06/13/2020] [Accepted: 06/16/2020] [Indexed: 12/27/2022] Open
Abstract
Pneumonia causes the death of around 700,000 children every year and affects 7% of the global population. Chest X-rays are primarily used for the diagnosis of this disease. However, even for a trained radiologist, it is a challenging task to examine chest X-rays. There is a need to improve the diagnosis accuracy. In this work, an efficient model for the detection of pneumonia trained on digital chest X-ray images is proposed, which could aid the radiologists in their decision making process. A novel approach based on a weighted classifier is introduced, which combines the weighted predictions from the state-of-the-art deep learning models such as ResNet18, Xception, InceptionV3, DenseNet121, and MobileNetV3 in an optimal way. This approach is a supervised learning approach in which the network predicts the result based on the quality of the dataset used. Transfer learning is used to fine-tune the deep learning models to obtain higher training and validation accuracy. Partial data augmentation techniques are employed to increase the training dataset in a balanced way. The proposed weighted classifier is able to outperform all the individual models. Finally, the model is evaluated, not only in terms of test accuracy, but also in the AUC score. The final proposed weighted classifier model is able to achieve a test accuracy of 98.43% and an AUC score of 99.76 on the unseen data from the Guangzhou Women and Children's Medical Center pneumonia dataset. Hence, the proposed model can be used for a quick diagnosis of pneumonia and can aid the radiologists in the diagnosis process.
Collapse
Affiliation(s)
- Mohammad Farukh Hashmi
- Department of Electronics and Communication Engineering, National Institute of Technology, Warangal 506004, India;
| | - Satyarth Katiyar
- Department of Electronics and Communication Engineering, Harcourt Butler Technical University, Kanpur 208002, India;
| | - Avinash G Keskar
- Department of Electronics and Communication Engineering, Visvesvaraya National Institute of Technology, Nagpur 440010, India;
| | - Neeraj Dhanraj Bokde
- Department of Engineering-Renewable Energy and Thermodynamics, Aarhus University, 8000 Aarhus, Denmark;
| | - Zong Woo Geem
- Department of Energy IT, Gachon University, Seongnam 13120, Korea
| |
Collapse
|
39
|
Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection Using Chest X-ray. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10093233] [Citation(s) in RCA: 105] [Impact Index Per Article: 26.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
Pneumonia is a life-threatening disease, which occurs in the lungs caused by either bacterial or viral infection. It can be life-endangering if not acted upon at the right time and thus the early diagnosis of pneumonia is vital. The paper aims to automatically detect bacterial and viral pneumonia using digital x-ray images. It provides a detailed report on advances in accurate detection of pneumonia and then presents the methodology adopted by the authors. Four different pre-trained deep Convolutional Neural Network (CNN): AlexNet, ResNet18, DenseNet201, and SqueezeNet were used for transfer learning. A total of 5247 chest X-ray images consisting of bacterial, viral, and normal chest x-rays images were preprocessed and trained for the transfer learning-based classification task. In this study, the authors have reported three schemes of classifications: normal vs. pneumonia, bacterial vs. viral pneumonia, and normal, bacterial, and viral pneumonia. The classification accuracy of normal and pneumonia images, bacterial and viral pneumonia images, and normal, bacterial, and viral pneumonia were 98%, 95%, and 93.3%, respectively. This is the highest accuracy, in any scheme, of the accuracies reported in the literature. Therefore, the proposed study can be useful in more quickly diagnosing pneumonia by the radiologist and can help in the fast airport screening of pneumonia patients.
Collapse
|