1
|
Cruz J, Gonçalves SB, Neves MC, Silva HP, Silva MT. Intraoperative Angle Measurement of Anatomical Structures: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2024; 24:1613. [PMID: 38475148 PMCID: PMC10934548 DOI: 10.3390/s24051613] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/30/2024] [Revised: 02/22/2024] [Accepted: 02/28/2024] [Indexed: 03/14/2024]
Abstract
Ensuring precise angle measurement during surgical correction of orientation-related deformities is crucial for optimal postoperative outcomes, yet there is a lack of an ideal commercial solution. Current measurement sensors and instrumentation have limitations that make their use context-specific, demanding a methodical evaluation of the field. A systematic review was carried out in March 2023. Studies reporting technologies and validation methods for intraoperative angular measurement of anatomical structures were analyzed. A total of 32 studies were included, 17 focused on image-based technologies (6 fluoroscopy, 4 camera-based tracking, and 7 CT-based), while 15 explored non-image-based technologies (6 manual instruments and 9 inertial sensor-based instruments). Image-based technologies offer better accuracy and 3D capabilities but pose challenges like additional equipment, increased radiation exposure, time, and cost. Non-image-based technologies are cost-effective but may be influenced by the surgeon's perception and require careful calibration. Nevertheless, the choice of the proper technology should take into consideration the influence of the expected error in the surgery, surgery type, and radiation dose limit. This comprehensive review serves as a valuable guide for surgeons seeking precise angle measurements intraoperatively. It not only explores the performance and application of existing technologies but also aids in the future development of innovative solutions.
Collapse
Affiliation(s)
- João Cruz
- IDMEC, Instituto Superior Técnico, Universidade de Lisboa, Av. Rovisco Pais 1, 1049-001 Lisboa, Portugal; (J.C.); (S.B.G.)
| | - Sérgio B. Gonçalves
- IDMEC, Instituto Superior Técnico, Universidade de Lisboa, Av. Rovisco Pais 1, 1049-001 Lisboa, Portugal; (J.C.); (S.B.G.)
| | | | - Hugo Plácido Silva
- IT—Instituto de Telecomunicações, Instituto Superior Técnico, Universidade de Lisboa, Av. Rovisco Pais 1, 1049-001 Lisboa, Portugal;
| | - Miguel Tavares Silva
- IDMEC, Instituto Superior Técnico, Universidade de Lisboa, Av. Rovisco Pais 1, 1049-001 Lisboa, Portugal; (J.C.); (S.B.G.)
| |
Collapse
|
2
|
Li R, Agu E, Sarwar A, Grimone K, Herman D, Abrantes AM, Stein MD. Fine-Grained Intoxicated Gait Classification Using a Bilinear CNN. IEEE SENSORS JOURNAL 2023; 23:29733-29748. [PMID: 38186565 PMCID: PMC10769125 DOI: 10.1109/jsen.2023.3248868] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/09/2024]
Abstract
Consuming excessive amounts of alcohol causes impaired mobility and judgment and driving accidents, resulting in more than 800 injuries and fatalities each day. Passive methods to detect intoxicated drivers beyond the safe driving limit can facilitate Just-In-Time alerts and reduce Driving Under the Influence (DUI) incidents. Popularly-owned smartphones are not only equipped with motion sensors (accelerometer and gyroscope) that can be employed for passively collecting gait (walk) data but also have the processing power to run computationally expensive machine learning models. In this paper, we advance the state-of-the-art by proposing a novel method that utilizes a Bi-linear Convolution Neural Network (BiCNN) for analyzing smartphone accelerometer and gyroscope data to determine whether a smartphone user is over the legal driving limit (0.08) from their gait. After segmenting the gait data into steps, we converted the smartphone motion sensor data to a Gramian Angular Field (GAF) image and then leveraged the BiCNN architecture for intoxication classification. Distinguishing GAF-encoded images of the gait of intoxicated vs. sober users is challenging as the differences between the classes (intoxicated vs. sober) are subtle, also known as a fine-grained image classification problem. The BiCNN neural network has previously produced state-of-the-art results on fine-grained image classification of natural images. To the best of our knowledge, our work is the first to innovatively utilize the BiCNN to classify GAF encoded images of smartphone gait data in order to detect intoxication. Prior work had explored using the BiCNN to classify natural images or explored other gait-related tasks but not intoxication Our complete intoxication classification pipeline consists of several important pre-processing steps carefully adapted to the BAC classification task, including step detection and segmentation, data normalization to account for inter-subject variability, data fusion, GAF image generation from time-series data, and a BiCNN classification model. In rigorous evaluation, our BiCNN model achieves an accuracy of 83.5%, outperforming the previous state-of-the-art and demonstrating the feasibility of our approach.
Collapse
Affiliation(s)
- Ruojun Li
- Department of Optical Information, Huazhong University of Science and Technology, Wuhan, China
- Department of Electrical and Computer Engineering, Worcester Polytechnic Institute(WPI), Worcester, MA, USA
| | - Emmanuel Agu
- Computer Science Department, Worcester Polytechnic Institute, Worcester, MA, USA
| | | | | | - Debra Herman
- Department of Psychiatry and Human Behavior and a Research Psychologist in the Behavioral Medicine and Addictions Research group at Butler Hospital
| | - Ana M Abrantes
- Behavioral Medicine and Addictions Research at Butler Hospital and a Professor in the Department of Psychiatry and Human Behavior at the Alpert Medical School of Brown University
| | - Michael D Stein
- Chair of Health Law, Policy & Management at Boston University
| |
Collapse
|
3
|
Li KJ, Wong NLY, Law MC, Lam FMH, Wong HC, Chan TO, Wong KN, Zheng YP, Huang QY, Wong AYL, Kwok TCY, Ma CZH. Reliability, Validity, and Identification Ability of a Commercialized Waist-Attached Inertial Measurement Unit (IMU) Sensor-Based System in Fall Risk Assessment of Older People. BIOSENSORS 2023; 13:998. [PMID: 38131758 PMCID: PMC10742152 DOI: 10.3390/bios13120998] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Revised: 10/31/2023] [Accepted: 11/08/2023] [Indexed: 12/23/2023]
Abstract
Falls are a prevalent cause of injury among older people. While some wearable inertial measurement unit (IMU) sensor-based systems have been widely investigated for fall risk assessment, their reliability, validity, and identification ability in community-dwelling older people remain unclear. Therefore, this study evaluated the performance of a commercially available IMU sensor-based fall risk assessment system among 20 community-dwelling older recurrent fallers (with a history of ≥2 falls in the past 12 months) and 20 community-dwelling older non-fallers (no history of falls in the past 12 months), together with applying the clinical scale of the Mini-Balance Evaluation Systems Test (Mini-BESTest). The results show that the IMU sensor-based system exhibited a significant moderate to excellent test-retest reliability (ICC = 0.838, p < 0.001), an acceptable level of internal consistency reliability (Spearman's rho = 0.471, p = 0.002), an acceptable convergent validity (Cronbach's α = 0.712), and an area under the curve (AUC) value of 0.590 for the IMU sensor-based receiver-operating characteristic (ROC) curve. The findings suggest that while the evaluated IMU sensor-based system exhibited good reliability and acceptable validity, it might not be able to fully identify the recurrent fallers and non-fallers in a community-dwelling older population. Further system optimization is still needed.
Collapse
Affiliation(s)
- Ke-Jing Li
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China; (K.-J.L.); (N.L.-Y.W.); (M.-C.L.); (H.-C.W.); (T.-O.C.); (K.-N.W.); (Y.-P.Z.)
| | - Nicky Lok-Yi Wong
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China; (K.-J.L.); (N.L.-Y.W.); (M.-C.L.); (H.-C.W.); (T.-O.C.); (K.-N.W.); (Y.-P.Z.)
| | - Man-Ching Law
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China; (K.-J.L.); (N.L.-Y.W.); (M.-C.L.); (H.-C.W.); (T.-O.C.); (K.-N.W.); (Y.-P.Z.)
- Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong SAR, China;
- Jockey Club Smart Ageing Hub, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Freddy Man-Hin Lam
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong SAR, China;
| | - Hoi-Ching Wong
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China; (K.-J.L.); (N.L.-Y.W.); (M.-C.L.); (H.-C.W.); (T.-O.C.); (K.-N.W.); (Y.-P.Z.)
- Jockey Club Smart Ageing Hub, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Tsz-On Chan
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China; (K.-J.L.); (N.L.-Y.W.); (M.-C.L.); (H.-C.W.); (T.-O.C.); (K.-N.W.); (Y.-P.Z.)
- Jockey Club Smart Ageing Hub, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Kit-Naam Wong
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China; (K.-J.L.); (N.L.-Y.W.); (M.-C.L.); (H.-C.W.); (T.-O.C.); (K.-N.W.); (Y.-P.Z.)
- Jockey Club Smart Ageing Hub, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Yong-Ping Zheng
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China; (K.-J.L.); (N.L.-Y.W.); (M.-C.L.); (H.-C.W.); (T.-O.C.); (K.-N.W.); (Y.-P.Z.)
- Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong SAR, China;
- Jockey Club Smart Ageing Hub, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Qi-Yao Huang
- School of Fashion and Textiles, The Hong Kong Polytechnic University, Hong Kong SAR, China;
| | - Arnold Yu-Lok Wong
- Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong SAR, China;
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong SAR, China;
| | - Timothy Chi-Yui Kwok
- Department of Medicine & Therapeutics, The Chinese University of Hong Kong, Hong Kong SAR, China;
| | - Christina Zong-Hao Ma
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China; (K.-J.L.); (N.L.-Y.W.); (M.-C.L.); (H.-C.W.); (T.-O.C.); (K.-N.W.); (Y.-P.Z.)
- Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong SAR, China;
| |
Collapse
|
4
|
Deng Z, Xiang N, Pan J. State of the Art in Immersive Interactive Technologies for Surgery Simulation: A Review and Prospective. Bioengineering (Basel) 2023; 10:1346. [PMID: 38135937 PMCID: PMC10740891 DOI: 10.3390/bioengineering10121346] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2023] [Revised: 11/08/2023] [Accepted: 11/21/2023] [Indexed: 12/24/2023] Open
Abstract
Immersive technologies have thrived on a strong foundation of software and hardware, injecting vitality into medical training. This surge has witnessed numerous endeavors incorporating immersive technologies into surgery simulation for surgical skills training, with a growing number of researchers delving into this domain. Relevant experiences and patterns need to be summarized urgently to enable researchers to establish a comprehensive understanding of this field, thus promoting its continuous growth. This study provides a forward-looking perspective by reviewing the latest development of immersive interactive technologies for surgery simulation. The investigation commences from a technological standpoint, delving into the core aspects of virtual reality (VR), augmented reality (AR) and mixed reality (MR) technologies, namely, haptic rendering and tracking. Subsequently, we summarize recent work based on the categorization of minimally invasive surgery (MIS) and open surgery simulations. Finally, the study showcases the impressive performance and expansive potential of immersive technologies in surgical simulation while also discussing the current limitations. We find that the design of interaction and the choice of immersive technology in virtual surgery development should be closely related to the corresponding interactive operations in the real surgical speciality. This alignment facilitates targeted technological adaptations in the direction of greater applicability and fidelity of simulation.
Collapse
Affiliation(s)
- Zihan Deng
- Department of Computing, School of Advanced Technology, Xi’an Jiaotong-Liverpool Uiversity, Suzhou 215123, China;
| | - Nan Xiang
- Department of Computing, School of Advanced Technology, Xi’an Jiaotong-Liverpool Uiversity, Suzhou 215123, China;
| | - Junjun Pan
- State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, China;
| |
Collapse
|
5
|
Riglet L, Nicol F, Leonard A, Eby N, Claquesin L, Orliac B, Ornetti P, Laroche D, Gueugnon M. The Use of Embedded IMU Insoles to Assess Gait Parameters: A Validation and Test-Retest Reliability Study. SENSORS (BASEL, SWITZERLAND) 2023; 23:8155. [PMID: 37836986 PMCID: PMC10575241 DOI: 10.3390/s23198155] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 09/20/2023] [Accepted: 09/22/2023] [Indexed: 10/15/2023]
Abstract
Wireless wearable insoles are interesting tools to collect gait parameters during daily life activities. However, studies have to be performed specifically for each type of insoles on a big data set to validate the measurement in ecological situations. This study aims to assess the criterion validity and test-retest reliability of gait parameters from wearable insoles compared to motion capture system. Gait of 30 healthy participants was recorded using DSPro® insoles and a motion capture system during overground and treadmill walking at three different speeds. Criterion validity and test-retest reliability of spatio-temporal parameters were estimated with an intraclass correlation coefficient (ICC). For both systems, reliability was found higher than 0.70 for all variables (p < 0.001) except for minimum toe clearance (ICC < 0.50) with motion capture system during overground walking. Regardless of speed and condition of walking, Speed, Cadence, Stride Length, Stride Time and Stance Time variables were validated (ICC > 0.90; p < 0.001). During walking on treadmill, loading time was not validated during slow speed (ICC < 0.70). This study highlights good criterion validity and test-retest reliability of spatiotemporal gait parameters measurement using wearable insoles and opens a new possibility to improve care management of patients using clinical gait analysis in daily life activities.
Collapse
Affiliation(s)
- Louis Riglet
- CHU Dijon-Bourgogne, Centre d’Investigation Clinique, Module Plurithématique, Plateforme d’Investigation Technologique, 21000 Dijon, France
- INSERM, CIC 1432, Module Plurithématique, Plateforme d’Investigation Technologique, 21000 Dijon, France
| | | | | | | | - Lauranne Claquesin
- CHU Dijon-Bourgogne, Centre d’Investigation Clinique, Module Plurithématique, Plateforme d’Investigation Technologique, 21000 Dijon, France
- INSERM, CIC 1432, Module Plurithématique, Plateforme d’Investigation Technologique, 21000 Dijon, France
| | - Baptiste Orliac
- CHU Dijon-Bourgogne, Centre d’Investigation Clinique, Module Plurithématique, Plateforme d’Investigation Technologique, 21000 Dijon, France
- INSERM, CIC 1432, Module Plurithématique, Plateforme d’Investigation Technologique, 21000 Dijon, France
| | - Paul Ornetti
- CHU Dijon-Bourgogne, Centre d’Investigation Clinique, Module Plurithématique, Plateforme d’Investigation Technologique, 21000 Dijon, France
- INSERM, CIC 1432, Module Plurithématique, Plateforme d’Investigation Technologique, 21000 Dijon, France
- INSERM, UMR1093-CAPS, Université Bourgogne Franche-Comté, UFR des Sciences du Sport, 21000 Dijon, France
- Rheumatology Department, CHU Dijon-Bourgogne, 21000 Dijon, France
| | - Davy Laroche
- CHU Dijon-Bourgogne, Centre d’Investigation Clinique, Module Plurithématique, Plateforme d’Investigation Technologique, 21000 Dijon, France
- INSERM, CIC 1432, Module Plurithématique, Plateforme d’Investigation Technologique, 21000 Dijon, France
- INSERM, UMR1093-CAPS, Université Bourgogne Franche-Comté, UFR des Sciences du Sport, 21000 Dijon, France
| | - Mathieu Gueugnon
- CHU Dijon-Bourgogne, Centre d’Investigation Clinique, Module Plurithématique, Plateforme d’Investigation Technologique, 21000 Dijon, France
- INSERM, CIC 1432, Module Plurithématique, Plateforme d’Investigation Technologique, 21000 Dijon, France
- INSERM, UMR1093-CAPS, Université Bourgogne Franche-Comté, UFR des Sciences du Sport, 21000 Dijon, France
| |
Collapse
|
6
|
Lazar RG, Pauca O, Maxim A, Caruntu CF. Control Architecture for Connected Vehicle Platoons: From Sensor Data to Controller Design Using Vehicle-to-Everything Communication. SENSORS (BASEL, SWITZERLAND) 2023; 23:7576. [PMID: 37688028 PMCID: PMC10490767 DOI: 10.3390/s23177576] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Revised: 08/24/2023] [Accepted: 08/29/2023] [Indexed: 09/10/2023]
Abstract
A suitable control architecture for connected vehicle platoons may be seen as a promising solution for today's traffic problems, by improving road safety and traffic flow, reducing emissions and fuel consumption, and increasing driver comfort. This paper provides a comprehensive overview concerning the defining levels of a general control architecture for connected vehicle platoons, intending to illustrate the options available in terms of sensor technologies, in-vehicle networks, vehicular communication, and control solutions. Moreover, starting from the proposed control architecture, a solution that implements a Cooperative Adaptive Cruise Control (CACC) functionality for a vehicle platoon is designed. Also, two control algorithms based on the distributed model-based predictive control (DMPC) strategy and the feedback gain matrix method for the control level of the CACC functionality are proposed. The designed architecture was tested in a simulation scenario, and the obtained results show the control performances achieved using the proposed solutions suitable for the longitudinal dynamics of vehicle platoons.
Collapse
Affiliation(s)
| | | | | | - Constantin-Florin Caruntu
- Department of Automatic Control and Applied Informatics, “Gheorghe Asachi” Technical University of Iasi, 700050 Iasi, Romania; (R.-G.L.); (O.P.); (A.M.)
| |
Collapse
|
7
|
Lee R, Akhundov R, James C, Edwards S, Snodgrass SJ. Variations in Concurrent Validity of Two Independent Inertial Measurement Units Compared to Gold Standard for Upper Body Posture during Computerised Device Use. SENSORS (BASEL, SWITZERLAND) 2023; 23:6761. [PMID: 37571544 PMCID: PMC10422555 DOI: 10.3390/s23156761] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/21/2023] [Revised: 07/11/2023] [Accepted: 07/24/2023] [Indexed: 08/13/2023]
Abstract
Inertial measurement units (IMUs) may provide an objective method for measuring posture during computer use, but research is needed to validate IMUs' accuracy. We examine the concurrent validity of two different IMU systems in measuring three-dimensional (3D) upper body posture relative to a motion capture system (Mocap) as a potential device to assess postures outside a laboratory environment. We used 3D Mocap and two IMU systems (Wi-Fi and Bluetooth) to capture the upper body posture of twenty-six individuals during three physical computer working conditions (monitor correct, monitor raised, and laptop). Coefficient of determination (R2) and root-mean-square error (RMSE) compared IMUs to Mocap. Head/neck segment [HN], upper trunk segment [UTS], and joint angle [HN-UTS] were the primary variables. Wi-Fi IMUs demonstrated high validity for HN and UTS (sagittal plane) and HN-UTS (frontal plane) for all conditions, and for HN rotation movements (both for the monitor correct and monitor raised conditions), others moderate to poor. Bluetooth IMUs for HN, and UTS (sagittal plane) for the monitor correct, laptop, and monitor raised conditions were moderate. Frontal plane movements except UTS (monitor correct and laptop) and all rotation had poor validity. Both IMU systems were affected by gyroscopic drift with sporadic data loss in Bluetooth IMUs. Wi-Fi IMUs had more acceptable accuracy when measuring upper body posture during computer use compared to Mocap, except for trunk rotations. Variation in IMU systems' performance suggests validation in the task-specific movement(s) is essential.
Collapse
Affiliation(s)
- Roger Lee
- School of Health Sciences, College of Health, Medicine and Wellbeing, The University of Newcastle, Callaghan, NSW 2308, Australia
- Active Living Research Program, Hunter Medical Research Institute, New Lambton Heights, NSW 2305, Australia
| | - Riad Akhundov
- School of Health Sciences, College of Health, Medicine and Wellbeing, The University of Newcastle, Callaghan, NSW 2308, Australia
- Griffith Centre for Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland, Griffith University, Gold Coast, QLD 4222, Australia
- School of Health Sciences and Social Work, Griffith University, Gold Coast, QLD 4222, Australia
| | - Carole James
- Sydney School of Health Sciences, Discipline of Occupational Therapy, Faculty of Medicine and Health, University of Sydney, Newcastle, NSW 2308, Australia
| | - Suzi Edwards
- Active Living Research Program, Hunter Medical Research Institute, New Lambton Heights, NSW 2305, Australia
- School of Health Sciences, Discipline of Exercise & Sport Science, Faculty of Medicine & Health, Sydney University, Sydney, NSW 2006, Australia
| | - Suzanne J. Snodgrass
- School of Health Sciences, College of Health, Medicine and Wellbeing, The University of Newcastle, Callaghan, NSW 2308, Australia
- Active Living Research Program, Hunter Medical Research Institute, New Lambton Heights, NSW 2305, Australia
| |
Collapse
|
8
|
Su D, Hu Z, Wu J, Shang P, Luo Z. Review of adaptive control for stroke lower limb exoskeleton rehabilitation robot based on motion intention recognition. Front Neurorobot 2023; 17:1186175. [PMID: 37465413 PMCID: PMC10350518 DOI: 10.3389/fnbot.2023.1186175] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Accepted: 06/13/2023] [Indexed: 07/20/2023] Open
Abstract
Stroke is a significant cause of disability worldwide, and stroke survivors often experience severe motor impairments. Lower limb rehabilitation exoskeleton robots provide support and balance for stroke survivors and assist them in performing rehabilitation training tasks, which can effectively improve their quality of life during the later stages of stroke recovery. Lower limb rehabilitation exoskeleton robots have become a hot topic in rehabilitation therapy research. This review introduces traditional rehabilitation assessment methods, explores the possibility of lower limb exoskeleton robots combining sensors and electrophysiological signals to assess stroke survivors' rehabilitation objectively, summarizes standard human-robot coupling models of lower limb rehabilitation exoskeleton robots in recent years, and critically introduces adaptive control models based on motion intent recognition for lower limb exoskeleton robots. This provides new design ideas for the future combination of lower limb rehabilitation exoskeleton robots with rehabilitation assessment, motion assistance, rehabilitation treatment, and adaptive control, making the rehabilitation assessment process more objective and addressing the shortage of rehabilitation therapists to some extent. Finally, the article discusses the current limitations of adaptive control of lower limb rehabilitation exoskeleton robots for stroke survivors and proposes new research directions.
Collapse
Affiliation(s)
- Dongnan Su
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Zhigang Hu
- School of Medical Technology and Engineering, Henan University of Science and Technology, Luoyang, China
- Henan Intelligent Rehabilitation Medical Robot Engineering Research Center, Henan University of Science and Technology, Luoyang, China
| | - Jipeng Wu
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Peng Shang
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Zhaohui Luo
- State-Owned Changhong Machinery Factory, Guilin, China
| |
Collapse
|
9
|
Topham LK, Khan W, Al-Jumeily D, Waraich A, Hussain AJ. A diverse and multi-modal gait dataset of indoor and outdoor walks acquired using multiple cameras and sensors. Sci Data 2023; 10:320. [PMID: 37237014 DOI: 10.1038/s41597-023-02161-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Accepted: 04/18/2023] [Indexed: 05/28/2023] Open
Abstract
Gait datasets are often limited by a lack of diversity in terms of the participants, appearance, viewing angle, environments, annotations, and availability. We present a primary gait dataset comprising 1,560 annotated casual walks from 64 participants, in both indoor and outdoor real-world environments. We used two digital cameras and a wearable digital goniometer to capture visual as well as motion signal gait-data respectively. Traditional methods of gait identification are often affected by the viewing angle and appearance of the participant therefore, this dataset mainly considers the diversity in various aspects (e.g., participants' attributes, background variations, and view angles). The dataset is captured from 8 viewing angles in 45° increments along-with alternative appearances for each participant, for example, via a change of clothing. The dataset provides 3,120 videos, containing approximately 748,800 image frames with detailed annotations including approximately 56,160,000 bodily keypoint annotations, identifying 75 keypoints per video frame, and approximately 1,026,480 motion data points captured from a digital goniometer for three limb segments (thigh, upper arm, and head).
Collapse
Affiliation(s)
| | - Wasiq Khan
- Liverpool John Moores University, Liverpool, UK.
| | | | | | | |
Collapse
|
10
|
Young F, Mason R, Morris RE, Stuart S, Godfrey A. IoT-Enabled Gait Assessment: The Next Step for Habitual Monitoring. SENSORS (BASEL, SWITZERLAND) 2023; 23:4100. [PMID: 37112441 PMCID: PMC10144082 DOI: 10.3390/s23084100] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Revised: 04/13/2023] [Accepted: 04/17/2023] [Indexed: 06/19/2023]
Abstract
Walking/gait quality is a useful clinical tool to assess general health and is now broadly described as the sixth vital sign. This has been mediated by advances in sensing technology, including instrumented walkways and three-dimensional motion capture. However, it is wearable technology innovation that has spawned the highest growth in instrumented gait assessment due to the capabilities for monitoring within and beyond the laboratory. Specifically, instrumented gait assessment with wearable inertial measurement units (IMUs) has provided more readily deployable devices for use in any environment. Contemporary IMU-based gait assessment research has shown evidence of the robust quantifying of important clinical gait outcomes in, e.g., neurological disorders to gather more insightful habitual data in the home and community, given the relatively low cost and portability of IMUs. The aim of this narrative review is to describe the ongoing research regarding the need to move gait assessment out of bespoke settings into habitual environments and to consider the shortcomings and inefficiencies that are common within the field. Accordingly, we broadly explore how the Internet of Things (IoT) could better enable routine gait assessment beyond bespoke settings. As IMU-based wearables and algorithms mature in their corroboration with alternate technologies, such as computer vision, edge computing, and pose estimation, the role of IoT communication will enable new opportunities for remote gait assessment.
Collapse
Affiliation(s)
- Fraser Young
- Department of Computer and Information Sciences, Northumbria University, Newcastle-upon-Tyne NE1 8ST, UK
| | - Rachel Mason
- Department of Health and Life Sciences, Northumbria University, Newcastle-upon-Tyne NE1 8ST, UK
| | - Rosie E. Morris
- Department of Health and Life Sciences, Northumbria University, Newcastle-upon-Tyne NE1 8ST, UK
| | - Samuel Stuart
- Department of Health and Life Sciences, Northumbria University, Newcastle-upon-Tyne NE1 8ST, UK
| | - Alan Godfrey
- Department of Computer and Information Sciences, Northumbria University, Newcastle-upon-Tyne NE1 8ST, UK
| |
Collapse
|
11
|
Zhao S, Hwang SH. ROS-Based Autonomous Navigation Robot Platform with Stepping Motor. SENSORS (BASEL, SWITZERLAND) 2023; 23:3648. [PMID: 37050707 PMCID: PMC10098625 DOI: 10.3390/s23073648] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/05/2023] [Revised: 03/15/2023] [Accepted: 03/21/2023] [Indexed: 06/19/2023]
Abstract
Indoor navigation robots, which have been developed using a robot operating system, typically use a direct current motor as a motion actuator. Their control algorithm is generally complex and requires the cooperation of sensors such as wheel encoders to correct errors. For this study, an autonomous navigation robot platform named Owlbot was designed, which is equipped with a stepping motor as a mobile actuator. In addition, a stepping motor control algorithm was developed using polynomial equations, which can effectively convert speed instructions to generate control signals for accurately operating the motor. Using 2D LiDAR and an inertial measurement unit as the primary sensors, simultaneous localization, mapping, and autonomous navigation are realised based on the particle filtering mapping algorithm. The experimental results show that Owlbot can effectively map the unknown environment and realise autonomous navigation through the proposed control algorithm, with a maximum movement error being smaller than 0.015 m.
Collapse
|
12
|
Din H, Iqbal F, Park J, Lee B. Bias-Repeatability Analysis of Vacuum-Packaged 3-Axis MEMS Gyroscope Using Oven-Controlled System. SENSORS (BASEL, SWITZERLAND) 2022; 23:256. [PMID: 36616854 PMCID: PMC9824465 DOI: 10.3390/s23010256] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/07/2022] [Revised: 12/21/2022] [Accepted: 12/23/2022] [Indexed: 06/17/2023]
Abstract
The performance of microelectromechanical system (MEMS) inertial measurement units (IMUs) is susceptible to many environmental factors. Among different factors, temperature is one of the most challenging issues. This report reveals the bias stability analysis of an ovenized MEMS gyroscope. A micro-heater and a control system exploiting PID/PWM were used to compensate for the bias stability variations of a commercial MEMS IMU from BOSCH "BMI 088". A micro-heater made of gold (Au) thin film is integrated with the commercial MEMS IMU chip. A custom-designed micro-machined glass platform thermally isolates the MEMS IMU from the ambient environment and is vacuum sealed in the leadless chip carrier (LCC) package. The BMI 088 built-in temperature sensor is used for temperature sensing of the device and the locally integrated heater. The experimental results reveal that the bias repeatability of the devices has been improved significantly to achieve the target specifications, making the commercial devices suitable for navigation. Furthermore, the effect of vacuum-packaged and non-vacuum-packaged devices was compared. It was found that the bias repeatability of vacuum-packaged devices was improved by more than 60%.
Collapse
|
13
|
Beswick E, Fawcett T, Hassan Z, Forbes D, Dakin R, Newton J, Abrahams S, Carson A, Chandran S, Perry D, Pal S. A systematic review of digital technology to evaluate motor function and disease progression in motor neuron disease. J Neurol 2022; 269:6254-6268. [PMID: 35945397 PMCID: PMC9363141 DOI: 10.1007/s00415-022-11312-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Revised: 07/22/2022] [Accepted: 07/25/2022] [Indexed: 11/17/2022]
Abstract
Amyotrophic lateral sclerosis (ALS) is the most common subtype of motor neuron disease (MND). The current gold-standard measure of progression is the ALS Functional Rating Scale-Revised (ALS-FRS(R)), a clinician-administered questionnaire providing a composite score on physical functioning. Technology offers a potential alternative for assessing motor progression in both a clinical and research capacity that is more sensitive to detecting smaller changes in function. We reviewed studies evaluating the utility and suitability of these devices to evaluate motor function and disease progression in people with MND (pwMND). We systematically searched Google Scholar, PubMed and EMBASE applying no language or date restrictions. We extracted information on devices used and additional assessments undertaken. Twenty studies, involving 1275 (median 28 and ranging 6-584) pwMND, were included. Sensor type included accelerometers (n = 9), activity monitors (n = 4), smartphone apps (n = 4), gait (n = 3), kinetic sensors (n = 3), electrical impedance myography (n = 1) and dynamometers (n = 2). Seventeen (85%) of studies used the ALS-FRS(R) to evaluate concurrent validity. Participant feedback on device utility was generally positive, where evaluated in 25% of studies. All studies showed initial feasibility, warranting larger longitudinal studies to compare device sensitivity and validity beyond ALS-FRS(R). Risk of bias in the included studies was high, with a large amount of information to determine study quality unclear. Measurement of motor pathology and progression using technology is an emerging, and promising, area of MND research. Further well-powered longitudinal validation studies are needed.
Collapse
Affiliation(s)
- Emily Beswick
- Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, Scotland, UK
- Anne Rowling Regenerative Neurology Clinic, The University of Edinburgh, 49 Little France Crescent, Edinburgh, EH16 4SB, Scotland, UK
- Euan MacDonald Centre for MND Research, The University of Edinburgh, Edinburgh, Scotland, UK
| | - Thomas Fawcett
- The School of Medicine and Veterinary Medicine, The University of Edinburgh, Edinburgh, Scotland, UK
| | - Zack Hassan
- Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, Scotland, UK
- Anne Rowling Regenerative Neurology Clinic, The University of Edinburgh, 49 Little France Crescent, Edinburgh, EH16 4SB, Scotland, UK
- Euan MacDonald Centre for MND Research, The University of Edinburgh, Edinburgh, Scotland, UK
| | - Deborah Forbes
- Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, Scotland, UK
- Anne Rowling Regenerative Neurology Clinic, The University of Edinburgh, 49 Little France Crescent, Edinburgh, EH16 4SB, Scotland, UK
- Euan MacDonald Centre for MND Research, The University of Edinburgh, Edinburgh, Scotland, UK
| | - Rachel Dakin
- Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, Scotland, UK
- Anne Rowling Regenerative Neurology Clinic, The University of Edinburgh, 49 Little France Crescent, Edinburgh, EH16 4SB, Scotland, UK
- Euan MacDonald Centre for MND Research, The University of Edinburgh, Edinburgh, Scotland, UK
| | - Judith Newton
- Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, Scotland, UK
- Anne Rowling Regenerative Neurology Clinic, The University of Edinburgh, 49 Little France Crescent, Edinburgh, EH16 4SB, Scotland, UK
- Euan MacDonald Centre for MND Research, The University of Edinburgh, Edinburgh, Scotland, UK
| | - Sharon Abrahams
- Euan MacDonald Centre for MND Research, The University of Edinburgh, Edinburgh, Scotland, UK
- Human Cognitive Neurosciences, Psychology, School of Philosophy, Psychology and Language Sciences, The University of Edinburgh, Edinburgh, Scotland, UK
| | - Alan Carson
- Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, Scotland, UK
| | - Siddharthan Chandran
- Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, Scotland, UK
- Anne Rowling Regenerative Neurology Clinic, The University of Edinburgh, 49 Little France Crescent, Edinburgh, EH16 4SB, Scotland, UK
- Euan MacDonald Centre for MND Research, The University of Edinburgh, Edinburgh, Scotland, UK
- UK Dementia Research Institute, The University of Edinburgh, Edinburgh, Scotland, UK
| | - David Perry
- Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, Scotland, UK
- Anne Rowling Regenerative Neurology Clinic, The University of Edinburgh, 49 Little France Crescent, Edinburgh, EH16 4SB, Scotland, UK
| | - Suvankar Pal
- Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, Scotland, UK.
- Anne Rowling Regenerative Neurology Clinic, The University of Edinburgh, 49 Little France Crescent, Edinburgh, EH16 4SB, Scotland, UK.
- Euan MacDonald Centre for MND Research, The University of Edinburgh, Edinburgh, Scotland, UK.
| |
Collapse
|
14
|
Vu HTT, Cao HL, Dong D, Verstraten T, Geeroms J, Vanderborght B. Comparison of machine learning and deep learning-based methods for locomotion mode recognition using a single inertial measurement unit. Front Neurorobot 2022; 16:923164. [PMID: 36524219 PMCID: PMC9745042 DOI: 10.3389/fnbot.2022.923164] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Accepted: 09/06/2022] [Indexed: 09/09/2023] Open
Abstract
Locomotion mode recognition provides the prosthesis control with the information on when to switch between different walking modes, whereas the gait phase detection indicates where we are in the gait cycle. But powered prostheses often implement a different control strategy for each locomotion mode to improve the functionality of the prosthesis. Existing studies employed several classical machine learning methods for locomotion mode recognition. However, these methods were less effective for data with complex decision boundaries and resulted in misclassifications of motion recognition. Deep learning-based methods potentially resolve these limitations as it is a special type of machine learning method with more sophistication. Therefore, this study evaluated three deep learning-based models for locomotion mode recognition, namely recurrent neural network (RNN), long short-term memory (LSTM) neural network, and convolutional neural network (CNN), and compared the recognition performance of deep learning models to the machine learning model with random forest classifier (RFC). The models are trained from data of one inertial measurement unit (IMU) placed on the lower shanks of four able-bodied subjects to perform four walking modes, including level ground walking (LW), standing (ST), and stair ascent/stair descent (SA/SD). The results indicated that CNN and LSTM models outperformed other models, and these models were promising for applying locomotion mode recognition in real-time for robotic prostheses.
Collapse
Affiliation(s)
- Huong Thi Thu Vu
- Brubotics, Vrije Universiteit Brussel and imec, Brussels, Belgium
- Faculty of Electronics Engineering Technology, Hanoi University of Industry, Hanoi, Vietnam
| | - Hoang-Long Cao
- Brubotics, Vrije Universiteit Brussel and Flanders Make, Brussels, Belgium
- College of Engineering Technology, Can Tho University, Can Tho, Vietnam
| | - Dianbiao Dong
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi'an, China
| | - Tom Verstraten
- Brubotics, Vrije Universiteit Brussel and Flanders Make, Brussels, Belgium
| | - Joost Geeroms
- Brubotics, Vrije Universiteit Brussel and Flanders Make, Brussels, Belgium
| | | |
Collapse
|
15
|
Neťuková S, Bejtic M, Malá C, Horáková L, Kutílek P, Kauler J, Krupička R. Lower Limb Exoskeleton Sensors: State-of-the-Art. SENSORS (BASEL, SWITZERLAND) 2022; 22:9091. [PMID: 36501804 PMCID: PMC9738474 DOI: 10.3390/s22239091] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/02/2022] [Revised: 11/08/2022] [Accepted: 11/17/2022] [Indexed: 06/17/2023]
Abstract
Due to the ever-increasing proportion of older people in the total population and the growing awareness of the importance of protecting workers against physical overload during long-time hard work, the idea of supporting exoskeletons progressed from high-tech fiction to almost commercialized products within the last six decades. Sensors, as part of the perception layer, play a crucial role in enhancing the functionality of exoskeletons by providing as accurate real-time data as possible to generate reliable input data for the control layer. The result of the processed sensor data is the information about current limb position, movement intension, and needed support. With the help of this review article, we want to clarify which criteria for sensors used in exoskeletons are important and how standard sensor types, such as kinematic and kinetic sensors, are used in lower limb exoskeletons. We also want to outline the possibilities and limitations of special medical signal sensors detecting, e.g., brain or muscle signals to improve data perception at the human-machine interface. A topic-based literature and product research was done to gain the best possible overview of the newest developments, research results, and products in the field. The paper provides an extensive overview of sensor criteria that need to be considered for the use of sensors in exoskeletons, as well as a collection of sensors and their placement used in current exoskeleton products. Additionally, the article points out several types of sensors detecting physiological or environmental signals that might be beneficial for future exoskeleton developments.
Collapse
|
16
|
Mapping Welfare: Location Determining Techniques and Their Potential for Managing Cattle Welfare—A Review. DAIRY 2022. [DOI: 10.3390/dairy3040053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/12/2023] Open
Abstract
Several studies have suggested that precision livestock farming (PLF) is a useful tool for animal welfare management and assessment. Location, posture and movement of an individual are key elements in identifying the animal and recording its behaviour. Currently, multiple technologies are available for automated monitoring of the location of individual animals, ranging from Global Navigation Satellite Systems (GNSS) to ultra-wideband (UWB), RFID, wireless sensor networks (WSN) and even computer vision. These techniques and developments all yield potential to manage and assess animal welfare, but also have their constraints, such as range and accuracy. Combining sensors such as accelerometers with any location determining technique into a sensor fusion system can give more detailed information on the individual cow, achieving an even more reliable and accurate indication of animal welfare. We conclude that location systems are a promising approach to determining animal welfare, especially when applied in conjunction with additional sensors, but additional research focused on the use of technology in animal welfare monitoring is needed.
Collapse
|
17
|
Flores-Vázquez C, Angulo C, Vallejo-Ramírez D, Icaza D, Pulla Galindo S. Technical Development of the CeCi Social Robot. SENSORS (BASEL, SWITZERLAND) 2022; 22:7619. [PMID: 36236716 PMCID: PMC9573430 DOI: 10.3390/s22197619] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Revised: 09/24/2022] [Accepted: 09/30/2022] [Indexed: 06/16/2023]
Abstract
This research presents the technical considerations for implementing the CeCi (Computer Electronic Communication Interface) social robot. In this case, this robot responds to the need to achieve technological development in an emerging country with the aim of social impact and social interaction. There are two problems with the social robots currently on the market, which are the main focus of this research. First, their costs are not affordable for companies, universities, or individuals in emerging countries. The second is that their design is exclusively oriented to the functional part with a vision inherent to the engineers who create them without considering the vision, preferences, or requirements of the end users, especially for their social interaction. This last reason ends causing an aversion to the use of this type of robot. In response to the issues raised, a low-cost prototype is proposed, starting from a commercial platform for research development and using open source code. The robot design presented here is centered on the criteria and preferences of the end user, prioritizing acceptability for social interaction. This article details the selection process and hardware capabilities of the robot. Moreover, a programming section is provided to introduce the different software packages used and adapted for the social interaction, the main functions implemented, as well as the new and original part of the proposal. Finally, a list of applications currently developed with the robot and possible applications for future research are discussed.
Collapse
Affiliation(s)
- Carlos Flores-Vázquez
- Electrical Engineering Career, Research Group in Visible Radiation and Prototyping GIRVyP, The Center For Research, Innovation, and Technology Transfer CIITT, Universidad Católica de Cuenca, Cuenca 010107, Ecuador
- Intelligent Data Science and Artificial Intelligence Research Center, Universitat Politècnica de Catalunya UPC BarcelonaTECH, Pau Gargallo 14, 08034 Barcelona, Spain
- Laboratory of Luminotechnics, The Center For Research, Innovation, and Technology Transfer CIITT, Universidad Católica de Cuenca, Cuenca 010107, Ecuador
| | - Cecilio Angulo
- Intelligent Data Science and Artificial Intelligence Research Center, Universitat Politècnica de Catalunya UPC BarcelonaTECH, Pau Gargallo 14, 08034 Barcelona, Spain
| | - David Vallejo-Ramírez
- Electrical Engineering Career, Research Group in Visible Radiation and Prototyping GIRVyP, The Center For Research, Innovation, and Technology Transfer CIITT, Universidad Católica de Cuenca, Cuenca 010107, Ecuador
- Laboratory of Luminotechnics, The Center For Research, Innovation, and Technology Transfer CIITT, Universidad Católica de Cuenca, Cuenca 010107, Ecuador
| | - Daniel Icaza
- Electrical Engineering Career, Research Group in Visible Radiation and Prototyping GIRVyP, The Center For Research, Innovation, and Technology Transfer CIITT, Universidad Católica de Cuenca, Cuenca 010107, Ecuador
| | - Santiago Pulla Galindo
- Electrical Engineering Career, Research Group in Visible Radiation and Prototyping GIRVyP, The Center For Research, Innovation, and Technology Transfer CIITT, Universidad Católica de Cuenca, Cuenca 010107, Ecuador
| |
Collapse
|
18
|
Bento N, Rebelo J, Barandas M, Carreiro AV, Campagner A, Cabitza F, Gamboa H. Comparing Handcrafted Features and Deep Neural Representations for Domain Generalization in Human Activity Recognition. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22197324. [PMID: 36236427 PMCID: PMC9572241 DOI: 10.3390/s22197324] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/04/2022] [Revised: 09/21/2022] [Accepted: 09/23/2022] [Indexed: 06/02/2023]
Abstract
Human Activity Recognition (HAR) has been studied extensively, yet current approaches are not capable of generalizing across different domains (i.e., subjects, devices, or datasets) with acceptable performance. This lack of generalization hinders the applicability of these models in real-world environments. As deep neural networks are becoming increasingly popular in recent work, there is a need for an explicit comparison between handcrafted and deep representations in Out-of-Distribution (OOD) settings. This paper compares both approaches in multiple domains using homogenized public datasets. First, we compare several metrics to validate three different OOD settings. In our main experiments, we then verify that even though deep learning initially outperforms models with handcrafted features, the situation is reversed as the distance from the training distribution increases. These findings support the hypothesis that handcrafted features may generalize better across specific domains.
Collapse
Affiliation(s)
- Nuno Bento
- Associação Fraunhofer Portugal Research, Rua Alfredo Allen 455/461, 4200-135 Porto, Portugal
| | - Joana Rebelo
- Associação Fraunhofer Portugal Research, Rua Alfredo Allen 455/461, 4200-135 Porto, Portugal
| | - Marília Barandas
- Associação Fraunhofer Portugal Research, Rua Alfredo Allen 455/461, 4200-135 Porto, Portugal
- Laboratório de Instrumentação, Engenharia Biomédica e Física da Radiação (LIBPhys–UNL), Departamento de Física, Faculdade de Ciências e Tecnologia (FCT), Universidade Nova de Lisboa, 2829-516 Caparica, Portugal
| | - André V. Carreiro
- Associação Fraunhofer Portugal Research, Rua Alfredo Allen 455/461, 4200-135 Porto, Portugal
| | - Andrea Campagner
- Dipartimento di Informatica, Sistemistica e Comunicazione, Università degli Studi di Milano-Bicocca, 20126 Milan, Italy
| | - Federico Cabitza
- Dipartimento di Informatica, Sistemistica e Comunicazione, Università degli Studi di Milano-Bicocca, 20126 Milan, Italy
- IRCCS Istituto Ortopedico Galeazzi, 20161 Milan, Italy
| | - Hugo Gamboa
- Associação Fraunhofer Portugal Research, Rua Alfredo Allen 455/461, 4200-135 Porto, Portugal
- Laboratório de Instrumentação, Engenharia Biomédica e Física da Radiação (LIBPhys–UNL), Departamento de Física, Faculdade de Ciências e Tecnologia (FCT), Universidade Nova de Lisboa, 2829-516 Caparica, Portugal
| |
Collapse
|
19
|
Young F, Mason R, Wall C, Morris R, Stuart S, Godfrey A. Examination of a foot mounted IMU-based methodology for a running gait assessment. Front Sports Act Living 2022; 4:956889. [PMID: 36147582 PMCID: PMC9485551 DOI: 10.3389/fspor.2022.956889] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Accepted: 08/10/2022] [Indexed: 11/13/2022] Open
Abstract
Gait assessment is essential to understand injury prevention mechanisms during running, where high-impact forces can lead to a range of injuries in the lower extremities. Information regarding the running style to increase efficiency and/or selection of the correct running equipment, such as shoe type, can minimize the risk of injury, e.g., matching a runner's gait to a particular set of cushioning technologies found in modern shoes (neutral/support cushioning). Awareness of training or selection of the correct equipment requires an understanding of a runner's biomechanics, such as determining foot orientation when it strikes the ground. Previous work involved a low-cost approach with a foot-mounted inertial measurement unit (IMU) and an associated zero-crossing-based methodology to objectively understand a runner's biomechanics (in any setting) to learn about shoe selection. Here, an investigation of the previously presented ZC-based methodology is presented only to determine general validity for running gait assessment in a range of running abilities from novice (8 km/h) to experienced (16 km/h+). In comparison to Vicon 3D motion tracking data, the presented approach can extract pronation, foot strike location, and ground contact time with good [ICC(2,1) > 0.750] to excellent [ICC(2,1) > 0.900] agreement between 8-12 km/h runs. However, at higher speeds (14 km/h+), the ZC-based approach begins to deteriorate in performance, suggesting that other features and approaches may be more suitable for faster running and sprinting tasks.
Collapse
Affiliation(s)
- Fraser Young
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Rachel Mason
- Department of Sport, Exercise and Rehabilitation, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Conor Wall
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Rosie Morris
- Department of Sport, Exercise and Rehabilitation, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Samuel Stuart
- Department of Sport, Exercise and Rehabilitation, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Alan Godfrey
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne, United Kingdom
| |
Collapse
|
20
|
Mikaeili M, Bilge HŞ. Trajectory estimation of ultrasound images based on convolutional neural network. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103965] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
21
|
Hollaus B, Volmer JC, Fleischmann T. Cadence Detection in Road Cycling Using Saddle Tube Motion and Machine Learning. SENSORS (BASEL, SWITZERLAND) 2022; 22:6140. [PMID: 36015900 PMCID: PMC9413850 DOI: 10.3390/s22166140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 08/11/2022] [Accepted: 08/15/2022] [Indexed: 06/15/2023]
Abstract
Most commercial cadence-measurement systems in road cycling are strictly limited in their function to the measurement of cadence. Other relevant signals, such as roll angle, inclination or a round kick evaluation, cannot be measured with them. This work proposes an alternative cadence-measurement system with less of the mentioned restrictions, without the need for distinct cadence-measurement apparatus attached to the pedal and shaft of the road bicycle. The proposed design applies an inertial measurement unit (IMU) to the seating pole of the bike. In an experiment, the motion data were gathered. A total of four different road cyclists participated in this study to collect different datasets for neural network training and evaluation. In total, over 10 h of road cycling data were recorded and used to train the neural network. The network's aim was to detect each revolution of the crank within the data. The evaluation of the data has shown that using pure accelerometer data from all three axes led to the best result in combination with the proposed network architecture. A working proof of concept was achieved with an accuracy of approximately 95% on test data. As the proof of concept can also be seen as a new method for measuring cadence, the method was compared with the ground truth. Comparing the ground truth and the predicted cadence, it can be stated that for the relevant range of 50 rpm and above, the prediction over-predicts the cadence with approximately 0.9 rpm with a standard deviation of 2.05 rpm. The results indicate that the proposed design is fully functioning and can be seen as an alternative method to detect the cadence of a road cyclist.
Collapse
Affiliation(s)
- Bernhard Hollaus
- Department of Medical, Health & Sports Engineering, Management Center Innsbruck, 6020 Innsbruck, Austria
| | - Jasper C. Volmer
- Department of Mechatronics, Management Center Innsbruck, 6020 Innsbruck, Austria
| | - Thomas Fleischmann
- Department of Medical, Health & Sports Engineering, Management Center Innsbruck, 6020 Innsbruck, Austria
| |
Collapse
|
22
|
Development of a Protocol for Biomechanical Gait Analysis in Asian Elephants Using the Triaxial Inertial Measurement Unit (IMU). Vet Sci 2022; 9:vetsci9080432. [PMID: 36006347 PMCID: PMC9413814 DOI: 10.3390/vetsci9080432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2022] [Revised: 07/21/2022] [Accepted: 08/10/2022] [Indexed: 12/04/2022] Open
Abstract
Simple Summary In general practice, the veterinarian and caregiver usually detect lameness in elephants from observation of any discomforting characteristics when walking. Currently, motion analysis can offer an objective method to evaluate normal and abnormal gait accurately, thus identifying changes in some characteristics when walking. This report aimed to introduce a recent technology utilizing wireless sensors for quantitative analysis of joint angles during the gait cycle in Asian elephants. To enable three-dimensional limb segment motion, a triaxial inertial measurement unit (IMU) is equipped with three sensor types: an accelerometer, a gyroscope, and a magnetometer. Therefore, we hope that this portable sensor-based system can help clinicians in diagnosis, especially in the early stages of lameness. Moreover, with wireless signal transmission, the system is clinically applicable for use in all areas where electricity is available. Abstract Gait analysis is a method of gathering quantitative information to assist in determining the cause of abnormal gait for the purpose of making treatment decisions in veterinary medicine. Recent technology has offered the wearable wireless sensor of an inertial measurement unit (IMU) for determining gait parameters. This study proposed the use of a triaxial IMU, comprising an accelerometer, a gyroscope, and a magnetometer, for detecting three-dimensional limb segment motion (XYZ axis) during the gait cycle in Asian elephants. A new algorithm was developed to estimate the kinematic parameter that represents each limb segment of the forelimbs and hindlimbs while walking at a comfortable speed. For future use, this study aimed to create a new prototype of the IMU with a configuration that is tailored to the elephant and apply machine learning in an effort to achieve greater precision.
Collapse
|
23
|
Almassri AMM, Shirasawa N, Purev A, Uehara K, Oshiumi W, Mishima S, Wagatsuma H. Artificial Neural Network Approach to Guarantee the Positioning Accuracy of Moving Robots by Using the Integration of IMU/UWB with Motion Capture System Data Fusion. SENSORS (BASEL, SWITZERLAND) 2022; 22:5737. [PMID: 35957295 PMCID: PMC9371076 DOI: 10.3390/s22155737] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/24/2022] [Revised: 07/26/2022] [Accepted: 07/29/2022] [Indexed: 06/15/2023]
Abstract
This study presents an effective artificial neural network (ANN) approach to combine measurements from inertial measurement units (IMUs) and time-of-flight (TOF) measurements from an ultra-wideband (UWB) system with OptiTrack Motion Capture System (OptiT-MCS) data to guarantee the positioning accuracy of motion tracking in indoor environments. The proposed fusion approach unifies the following advantages of both technologies: high data rates from the MCS, and global translational precision from the inertial measurement unit (IMU)/UWB localization system. Consequently, it leads to accurate position estimates when compared with data from the IMU/UWB system relative to the OptiT-MCS reference system. The calibrations of the positioning IMU/UWB and MCS systems are utilized in real-time movement with a diverse set of motion recordings using a mobile robot. The proposed neural network (NN) approach experimentally revealed accurate position estimates, giving an enhancement average mean absolute percentage error (MAPE) of 17.56% and 7.48% in the X and Y coordinates, respectively, and the coefficient of correlation R greater than 99%. Moreover, the experimental results prove that the proposed NN fusion is capable of maintaining high accuracy in position estimates while preventing drift errors from increasing in an unbounded manner, implying that the proposed approach is more effective than the compared approaches.
Collapse
Affiliation(s)
- Ahmed M. M. Almassri
- Graduate School of Life Science and Systems Engineering, Kyushu Institute of Technology (Kyutech), 2-4 Hibikino, Wakamatsu-ku, Kitakyushu 808-0196, Japan; (N.S.); (A.P.); (K.U.); (W.O.); (S.M.); (H.W.)
- Robotic Innovation Research Center (RIRC), Israa University, Gaza P860, Palestine
| | - Natsuki Shirasawa
- Graduate School of Life Science and Systems Engineering, Kyushu Institute of Technology (Kyutech), 2-4 Hibikino, Wakamatsu-ku, Kitakyushu 808-0196, Japan; (N.S.); (A.P.); (K.U.); (W.O.); (S.M.); (H.W.)
| | - Amarbold Purev
- Graduate School of Life Science and Systems Engineering, Kyushu Institute of Technology (Kyutech), 2-4 Hibikino, Wakamatsu-ku, Kitakyushu 808-0196, Japan; (N.S.); (A.P.); (K.U.); (W.O.); (S.M.); (H.W.)
| | - Kaito Uehara
- Graduate School of Life Science and Systems Engineering, Kyushu Institute of Technology (Kyutech), 2-4 Hibikino, Wakamatsu-ku, Kitakyushu 808-0196, Japan; (N.S.); (A.P.); (K.U.); (W.O.); (S.M.); (H.W.)
| | - Wataru Oshiumi
- Graduate School of Life Science and Systems Engineering, Kyushu Institute of Technology (Kyutech), 2-4 Hibikino, Wakamatsu-ku, Kitakyushu 808-0196, Japan; (N.S.); (A.P.); (K.U.); (W.O.); (S.M.); (H.W.)
| | - Satoru Mishima
- Graduate School of Life Science and Systems Engineering, Kyushu Institute of Technology (Kyutech), 2-4 Hibikino, Wakamatsu-ku, Kitakyushu 808-0196, Japan; (N.S.); (A.P.); (K.U.); (W.O.); (S.M.); (H.W.)
| | - Hiroaki Wagatsuma
- Graduate School of Life Science and Systems Engineering, Kyushu Institute of Technology (Kyutech), 2-4 Hibikino, Wakamatsu-ku, Kitakyushu 808-0196, Japan; (N.S.); (A.P.); (K.U.); (W.O.); (S.M.); (H.W.)
| |
Collapse
|
24
|
Morais JE, Oliveira JP, Sampaio T, Barbosa TM. Wearables in Swimming for Real-Time Feedback: A Systematic Review. SENSORS 2022; 22:s22103677. [PMID: 35632086 PMCID: PMC9147718 DOI: 10.3390/s22103677] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Revised: 05/06/2022] [Accepted: 05/09/2022] [Indexed: 01/17/2023]
Abstract
Nowadays, wearables are a must-have tool for athletes and coaches. Wearables can provide real-time feedback to athletes on their athletic performance and other training details as training load, for example. The aim of this study was to systematically review studies that assessed the accuracy of wearables providing real-time feedback in swimming. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were selected to identify relevant studies. After screening, 283 articles were analyzed and 18 related to the assessment of the accuracy of wearables providing real-time feedback in swimming were retained for qualitative synthesis. The quality index was 12.44 ± 2.71 in a range from 0 (lowest quality) to 16 (highest quality). Most articles assessed in-house built (n = 15; 83.3%) wearables in front-crawl stroke (n = 8; 44.4%), eleven articles (61.1%) analyzed the accuracy of measuring swimming kinematics, eight (44.4%) were placed on the lower back, and seven were placed on the head (38.9%). A limited number of studies analyzed wearables that are commercially available (n = 3, 16.7%). Eleven articles (61.1%) reported on the accuracy, measurement error, or consistency. From those eleven, nine (81.8%) noted that wearables are accurate.
Collapse
Affiliation(s)
- Jorge E. Morais
- Department of Sport Sciences, Instituto Politécnico de Bragança, 5300-252 Bragança, Portugal; (J.E.M.); (J.P.O.); (T.S.)
- Research Centre in Sports, Health, and Human Development (CIDESD), University of Beira Interior, 6201-001 Covilhã, Portugal
| | - João P. Oliveira
- Department of Sport Sciences, Instituto Politécnico de Bragança, 5300-252 Bragança, Portugal; (J.E.M.); (J.P.O.); (T.S.)
- Research Centre in Sports, Health, and Human Development (CIDESD), University of Beira Interior, 6201-001 Covilhã, Portugal
| | - Tatiana Sampaio
- Department of Sport Sciences, Instituto Politécnico de Bragança, 5300-252 Bragança, Portugal; (J.E.M.); (J.P.O.); (T.S.)
| | - Tiago M. Barbosa
- Department of Sport Sciences, Instituto Politécnico de Bragança, 5300-252 Bragança, Portugal; (J.E.M.); (J.P.O.); (T.S.)
- Research Centre in Sports, Health, and Human Development (CIDESD), University of Beira Interior, 6201-001 Covilhã, Portugal
- Correspondence:
| |
Collapse
|
25
|
Harnett K, Plint B, Chan KY, Clark B, Netto K, Davey P, Müller S, Rosalie S. Validating an inertial measurement unit for cricket fast bowling: a first step in assessing the feasibility of diagnosing back injury risk in cricket fast bowlers during a tele-sport-and-exercise medicine consultation. PeerJ 2022; 10:e13228. [PMID: 35415020 PMCID: PMC8995020 DOI: 10.7717/peerj.13228] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Accepted: 03/15/2022] [Indexed: 01/12/2023] Open
Abstract
This study aimed to validate an array-based inertial measurement unit to measure cricket fast bowling kinematics as a first step in assessing feasibility for tele-sport-and-exercise medicine. We concurrently captured shoulder girdle relative to the pelvis, trunk lateral flexion, and knee flexion angles at front foot contact of eight cricket medium-fast bowlers using inertial measurement unit and optical motion capture. We used one sample t-tests and 95% limits of agreement (LOA) to determine the mean difference between the two systems and Smallest Worth-while Change statistic to determine whether any differences were meaningful. A statistically significant (p < 0.001) but small mean difference of -4.7° ± 8.6° (95% Confidence Interval (CI) [-3.1° to -6.4°], LOA [-22.2 to 12.7], SWC 3.9°) in shoulder girdle relative to the pelvis angle was found between the systems. There were no statistically significant differences between the two systems in trunk lateral flexion and knee flexion with the mean differences being 0.1° ± 10.8° (95% CI [-1.9° to 2.2°], LOA [-22.5 to 22.7], SWC 1.2°) and 1.6° ± 10.1° (95% CI [-0.2° to 3.3°], LOA [-19.2 to 22.3], SWC 1.9°) respectively. The inertial measurement unit-based system tested allows for accurate measurement of specific cricket fast bowling kinematics and could be used in determining injury risk in the context of tele-sport-and-exercise-medicine.
Collapse
Affiliation(s)
- Keegan Harnett
- Curtin School of Allied Health, Curtin University, Perth, Western Australia, Australia
| | - Brenda Plint
- Curtin School of Allied Health, Curtin University, Perth, Western Australia, Australia
| | - Ka Yan Chan
- Curtin School of Allied Health, Curtin University, Perth, Western Australia, Australia
| | - Benjamin Clark
- Curtin School of Allied Health, Curtin University, Perth, Western Australia, Australia
| | - Kevin Netto
- Curtin School of Allied Health, Curtin University, Perth, Western Australia, Australia,Curtin enAble Institute, Curtin University, Perth, Western Australia, Australia
| | - Paul Davey
- Curtin School of Nursing, Curtin University, Perth, Western Australia, Australia
| | - Sean Müller
- School of Science, Psychology and Sport, Federation University, Ballarat, Victoria, Australia
| | - Simon Rosalie
- Curtin School of Allied Health, Curtin University, Perth, Western Australia, Australia
| |
Collapse
|
26
|
Body-Worn IMU-Based Human Hip and Knee Kinematics Estimation during Treadmill Walking. SENSORS 2022; 22:s22072544. [PMID: 35408159 PMCID: PMC9003309 DOI: 10.3390/s22072544] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Revised: 03/14/2022] [Accepted: 03/16/2022] [Indexed: 12/22/2022]
Abstract
Traditionally, inertial measurement unit (IMU)-based human joint angle estimation techniques are evaluated for general human motion where human joints explore all of their degrees of freedom. Pure human walking, in contrast, limits the motion of human joints and may lead to unobservability conditions that confound magnetometer-free IMU-based methods. This work explores the unobservability conditions emergent during human walking and expands upon a previous IMU-based method for the human knee to also estimate human hip angles relative to an assumed vertical datum. The proposed method is evaluated (N=12) in a human subject study and compared against an optical motion capture system. Accuracy of human knee flexion/extension angle (7.87∘ absolute root mean square error (RMSE)), hip flexion/extension angle (3.70∘ relative RMSE), and hip abduction/adduction angle (4.56∘ relative RMSE) during walking are similar to current state-of-the-art self-calibrating IMU methods that use magnetometers. Larger errors of hip internal/external rotation angle (6.27∘ relative RMSE) are driven by IMU heading drift characteristic of magnetometer-free approaches and non-hinge kinematics of the hip during gait, amongst other error sources. One of these sources of error, soft tissue perturbations during gait, is explored further in the context of knee angle estimation and it was observed that the IMU method may overestimate the angle during stance and underestimate the angle during swing. The presented method and results provide a novel combination of observability considerations, heuristic correction methods, and validation techniques to magnetic-blind, kinematic-only IMU-based skeletal pose estimation during human tasks with degenerate kinematics (e.g., straight line walking).
Collapse
|
27
|
Long-Term In-Situ Monitoring and Analysis of Terrain in Gas Hydrate Trial Harvesting Area. SENSORS 2022; 22:s22041351. [PMID: 35214250 PMCID: PMC8963085 DOI: 10.3390/s22041351] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Revised: 02/06/2022] [Accepted: 02/07/2022] [Indexed: 02/01/2023]
Abstract
With the increase in global energy demand, the exploration and development of natural gas hydrate in sea has become a research hotspot in recent years. However, the environmental problems that may be brought about by large-scale harvesting are still concerns. The terrain monitoring of the trial harvesting area can effectively prevent the geological disasters that may be caused by the development of hydrates. Therefore, we have developed a new terrain monitoring device, which can work in the deep sea for a long time. Firstly, the structure of the sensor arrays and bus-type control system of the device are introduced. Secondly, an arc model with an interpolation method is used for reconstruction of the monitored terrain. Thirdly, after the accuracy of the sensing arrays are verified in laboratory, the device was placed in the Shenhu area of the South China Sea for more than 6 months of in-situ monitoring. Finally, we analyzed the data and concluded that the terrain of the monitored area was relatively flat, where the maximum subsidence was 12.3 cm and the maximum uplift was 2.75 cm.
Collapse
|
28
|
Li R, Fu C, Yi W, Yi X. Calib-Net: Calibrating the Low-Cost IMU via Deep Convolutional Neural Network. Front Robot AI 2022; 8:772583. [PMID: 35047565 PMCID: PMC8762311 DOI: 10.3389/frobt.2021.772583] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2021] [Accepted: 11/15/2021] [Indexed: 11/23/2022] Open
Abstract
The low-cost Inertial Measurement Unit (IMU) can provide orientation information and is widely used in our daily life. However, IMUs with bad calibration will provide inaccurate angular velocity and lead to rapid drift of integral orientation in a short time. In this paper, we present the Calib-Net which can achieve the accurate calibration of low-cost IMU via a simple deep convolutional neural network. Following a carefully designed mathematical calibration model, Calib-Net can output compensation components for gyroscope measurements dynamically. Dilation convolution is adopted in Calib-Net for spatio-temporal feature extraction of IMU measurements. We evaluate our proposed system on public datasets quantitively and qualitatively. The experimental results demonstrate that our Calib-Net achieves better calibration performance than other methods, what is more, and the estimated orientation with our Calib-Net is even comparable with the results from visual inertial odometry (VIO) systems.
Collapse
Affiliation(s)
- Ruihao Li
- Artificial Intelligence Research Center (AIRC), Defense Innovation Institute, Beijing, China
| | - Chunlian Fu
- Tianjin Artificial Intelligence Innovation Center (TAIIC), Tianjin, China
| | - Wei Yi
- Artificial Intelligence Research Center (AIRC), Defense Innovation Institute, Beijing, China
| | - Xiaodong Yi
- Artificial Intelligence Research Center (AIRC), Defense Innovation Institute, Beijing, China
| |
Collapse
|
29
|
Wearable sensors and machine learning in post-stroke rehabilitation assessment: A systematic review. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103197] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
|
30
|
Steijlen A, Burgers B, Wilmes E, Bastemeijer J, Bastiaansen B, French P, Bossche A, Jansen K. Smart sensor tights: Movement tracking of the lower limbs in football. WEARABLE TECHNOLOGIES 2021; 2:e17. [PMID: 38486627 PMCID: PMC10936253 DOI: 10.1017/wtc.2021.16] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Revised: 10/07/2021] [Accepted: 11/02/2021] [Indexed: 03/17/2024]
Abstract
This article presents a novel smart sensor garment with integrated miniaturized inertial measurements units (IMUs) that can be used to monitor lower body kinematics during daily training activities, without the need of extensive technical assistance throughout the measurements. The smart sensor tights enclose five ultra-light sensor modules that measure linear accelerations, angular velocities, and the earth magnetic field in three directions. The modules are located at the pelvis, thighs, and shanks. The garment enables continuous measurement in the field at high sample rates (250 Hz) and the sensors have a large measurement range (32 g, 4,000°/s). They are read out by a central processing unit through an SPI bus, and connected to a centralized battery in the waistband. A fully functioning prototype was built to perform validation studies in a lab setting and in a field setting. In the lab validation study, the IMU data (converted to limb orientation data) were compared with the kinematic data of an optoelectronic measurement system and good validity (CMCs >0.8) was shown. In the field tests, participants experienced the tights as comfortable to wear and they did not feel restricted in their movements. These results show the potential of using the smart sensor tights on a regular base to derive lower limb kinematics in the field.
Collapse
Affiliation(s)
- Annemarijn Steijlen
- Faculty of Electrical Engineering, Mathematics and Computer Science, Delft University of Technology, Delft, The Netherlands
| | - Bastiaan Burgers
- Faculty of Electrical Engineering, Mathematics and Computer Science, Delft University of Technology, Delft, The Netherlands
| | - Erik Wilmes
- Faculty of Behavioral and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Jeroen Bastemeijer
- Faculty of Electrical Engineering, Mathematics and Computer Science, Delft University of Technology, Delft, The Netherlands
| | - Bram Bastiaansen
- Centre for Human Movement Sciences, University Medical Centre Groningen & University of Groningen, Groningen, The Netherlands
| | - Patrick French
- Faculty of Electrical Engineering, Mathematics and Computer Science, Delft University of Technology, Delft, The Netherlands
| | - Andre Bossche
- Faculty of Electrical Engineering, Mathematics and Computer Science, Delft University of Technology, Delft, The Netherlands
| | - Kaspar Jansen
- Faculty of Industrial Design Engineering, Delft University of Technology, Delft, The Netherlands
| |
Collapse
|
31
|
Review of Underwater Sensing Technologies and Applications. SENSORS 2021; 21:s21237849. [PMID: 34883851 PMCID: PMC8659509 DOI: 10.3390/s21237849] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/22/2021] [Revised: 11/08/2021] [Accepted: 11/15/2021] [Indexed: 12/17/2022]
Abstract
As the ocean development process speeds up, the technical means of ocean exploration are being upgraded. Due to the characteristics of seawater and the complex underwater environment, conventional measurement and sensing methods used for land are difficult to apply in the underwater environment directly. Especially for the seabed topography, it is impossible to carry out long-distance and accurate detection via electromagnetic waves. Therefore, various types of acoustic and even optical sensing devices for underwater applications have come into use. Equipped by submersibles, those underwater sensors can sense underwater wide-range and accurately. Moreover, the development of sensor technology will be modified and optimized according to the needs of ocean exploitation. This paper has made a summary of the ocean sensing technologies applied in some critical underwater scenarios, including geological surveys, navigation and communication, marine environmental parameters, and underwater inspections. In order to contain as many submersible-based sensors as possible, we have to make a trade-off on breadth and depth. In the end, the authors predict the development trend of underwater sensor technology based on the future ocean exploration requirements.
Collapse
|
32
|
Gupta U, Lau JL, Ahmed A, Chia PZ, Song Soh G, Low HY. Soft Wearable Knee Brace with Embedded Sensors for Knee Motion Monitoring. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:7348-7351. [PMID: 34892795 DOI: 10.1109/embc46164.2021.9630023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
E-textiles have shown great potential for development of soft sensors in applications such as rehabilitation and soft robotics. However, existing approaches require the textile sensors to be attached externally onto a substrate or the garment surface. This paper seeks to address the issue by embedding the sensor directly into the wearable using a computer numerical control (CNC) knitting machine. First, we proposed a design of the wearable knee brace. Next, we demonstrated the capability to knit a sensor with the stretchable surrounding fabric. Subsequently, we characterized the sensor and developed a model for the sensor's electromechanical property. Lastly, the fully knitted knee brace with embedded sensor is tested, by performing three different activities: a simple Flexion-extension exercise, walking, and jogging activity with a single test subject. Results show that the knitted knee brace sensor can track the subject's knee motion well, with a Spearman's coefficient (rs) value of 0.87 when compared to the reference standard.
Collapse
|
33
|
Tsakanikas VD, Gatsios D, Dimopoulos D, Pardalis A, Pavlou M, Liston MB, Fotiadis DI. Evaluating the Performance of Balance Physiotherapy Exercises Using a Sensory Platform: The Basis for a Persuasive Balance Rehabilitation Virtual Coaching System. Front Digit Health 2021; 2:545885. [PMID: 34713032 PMCID: PMC8521876 DOI: 10.3389/fdgth.2020.545885] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2020] [Accepted: 08/28/2020] [Indexed: 11/23/2022] Open
Abstract
Rehabilitation programs play an important role in improving the quality of life of patients with balance disorders. Such programs are usually executed in a home environment, due to lack of resources. This procedure usually results in poorly performed exercises or even complete drop outs from the programs, as the patients lack guidance and motivation. This paper introduces a novel system for managing balance disorders in a home environment using a virtual coach for guidance, instruction, and inducement. The proposed system comprises sensing devices, augmented reality technology, and intelligent inference agents, which capture, recognize, and evaluate a patient's performance during the execution of exercises. More specifically, this work presents a home-based motion capture and assessment module, which utilizes a sensory platform to recognize an exercise performed by a patient and assess it. The sensory platform comprises IMU sensors (Mbientlab MMR© 9axis), pressure insoles (Moticon©), and a depth RGB camera (Intel D415©). This module is designed to deliver messages both during the performance of the exercise, delivering personalized notifications and alerts to the patient, and after the end of the exercise, scoring the overall performance of the patient. A set of proof of concept validation studies has been deployed, aiming to assess the accuracy of the different components for the sub-modules of the motion capture and assessment module. More specifically, Euler angle calculation algorithm in 2D (R2 = 0.99) and in 3D (R2 = 0.82 in yaw plane and R2 = 0.91 for the pitch plane), as well as head turns speed (R2 = 0.96), showed good correlation between the calculated and ground truth values provided by experts' annotations. The posture assessment algorithm resulted to accuracy = 0.83, while the gait metrics were validated against two well-established gait analysis systems (R2 = 0.78 for double support, R2 = 0.71 for single support, R2 = 0.80 for step time, R2 = 0.75 for stride time (WinTrack©), R2 = 0.82 for cadence, and R2 = 0.79 for stride time (RehaGait©). Validation results provided evidence that the proposed system can accurately capture and assess a physiotherapy exercise within the balance disorders context, thus providing a robust basis for the virtual coaching ecosystem and thereby improve a patient's commitment to rehabilitation programs while enhancing the quality of the performed exercises. In summary, virtual coaching can improve the quality of the home-based rehabilitation programs as long as it is combined with accurate motion capture and assessment modules, which provides to the virtual coach the capacity to tailor the interaction with the patient and deliver personalized experience.
Collapse
Affiliation(s)
- Vassilios D Tsakanikas
- Unit of Medical Technology and Intelligent Information Systems, Department of Materials Science and Engineering, University of Ioannina, Ioannina, Greece
| | - Dimitrios Gatsios
- Unit of Medical Technology and Intelligent Information Systems, Department of Materials Science and Engineering, University of Ioannina, Ioannina, Greece
| | - Dimitrios Dimopoulos
- Unit of Medical Technology and Intelligent Information Systems, Department of Materials Science and Engineering, University of Ioannina, Ioannina, Greece
| | - Athanasios Pardalis
- Unit of Medical Technology and Intelligent Information Systems, Department of Materials Science and Engineering, University of Ioannina, Ioannina, Greece
| | - Marousa Pavlou
- Centre for Human and Applied Physiological Sciences, King's College London, London, United Kingdom
| | - Matthew B Liston
- Centre for Human and Applied Physiological Sciences, King's College London, London, United Kingdom
| | - Dimitrios I Fotiadis
- Unit of Medical Technology and Intelligent Information Systems, Department of Materials Science and Engineering, University of Ioannina, Ioannina, Greece
| |
Collapse
|
34
|
Pagnon D, Domalain M, Reveret L. Pose2Sim: An End-to-End Workflow for 3D Markerless Sports Kinematics-Part 1: Robustness. SENSORS (BASEL, SWITZERLAND) 2021; 21:6530. [PMID: 34640862 PMCID: PMC8512754 DOI: 10.3390/s21196530] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Revised: 09/20/2021] [Accepted: 09/21/2021] [Indexed: 11/16/2022]
Abstract
Being able to capture relevant information about elite athletes' movement "in the wild" is challenging, especially because reference marker-based approaches hinder natural movement and are highly sensitive to environmental conditions. We propose Pose2Sim, a markerless kinematics workflow that uses OpenPose 2D pose detections from multiple views as inputs, identifies the person of interest, robustly triangulates joint coordinates from calibrated cameras, and feeds those to a 3D inverse kinematic full-body OpenSim model in order to compute biomechanically congruent joint angles. We assessed the robustness of this workflow when facing simulated challenging conditions: (Im) degrades image quality (11-pixel Gaussian blur and 0.5 gamma compression); (4c) uses few cameras (4 vs. 8); and (Cal) introduces calibration errors (1 cm vs. perfect calibration). Three physical activities were investigated: walking, running, and cycling. When averaged over all joint angles, stride-to-stride standard deviations lay between 1.7° and 3.2° for all conditions and tasks, and mean absolute errors (compared to the reference condition-Ref) ranged between 0.35° and 1.6°. For walking, errors in the sagittal plane were: 1.5°, 0.90°, 0.19° for (Im), (4c), and (Cal), respectively. In conclusion, Pose2Sim provides a simple and robust markerless kinematics analysis from a network of calibrated cameras.
Collapse
Affiliation(s)
- David Pagnon
- Laboratoire Jean Kuntzmann, Université Grenoble Alpes, UMR CNRS 5224, 38330 Montbonnot-Saint-Martin, France;
| | - Mathieu Domalain
- Institut Pprime, Université de Poitiers, CNRS UPR 3346, 86360 Chasseneuil-du-Poitou, France;
| | - Lionel Reveret
- Laboratoire Jean Kuntzmann, Université Grenoble Alpes, UMR CNRS 5224, 38330 Montbonnot-Saint-Martin, France;
- INRIA Grenoble Rhône-Alpes, 38330 Montbonnot-Saint-Martin, France
| |
Collapse
|
35
|
Lee R, James C, Edwards S, Skinner G, Young JL, Snodgrass SJ. Evidence for the Effectiveness of Feedback from Wearable Inertial Sensors during Work-Related Activities: A Scoping Review. SENSORS (BASEL, SWITZERLAND) 2021; 21:6377. [PMID: 34640695 PMCID: PMC8512480 DOI: 10.3390/s21196377] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/22/2021] [Revised: 09/16/2021] [Accepted: 09/18/2021] [Indexed: 01/03/2023]
Abstract
Background: Wearable inertial sensor technology (WIST) systems provide feedback, aiming to modify aberrant postures and movements. The literature on the effects of feedback from WIST during work or work-related activities has not been previously summarised. This review examines the effectiveness of feedback on upper body kinematics during work or work-related activities, along with the wearability and a quantification of the kinematics of the related device. Methods: The Cinahl, Cochrane, Embase, Medline, Scopus, Sportdiscus and Google Scholar databases were searched, including reports from January 2005 to July 2021. The included studies were summarised descriptively and the evidence was assessed. Results: Fourteen included studies demonstrated a 'limited' level of evidence supporting posture and/or movement behaviour improvements using WIST feedback, with no improvements in pain. One study assessed wearability and another two investigated comfort. Studies used tri-axial accelerometers or IMU integration (n = 5 studies). Visual and/or vibrotactile feedback was mostly used. Most studies had a risk of bias, lacked detail for methodological reproducibility and displayed inconsistent reporting of sensor technology, with validation provided only in one study. Thus, we have proposed a minimum 'Technology and Design Checklist' for reporting. Conclusions: Our findings suggest that WIST may improve posture, though not pain; however, the quality of the studies limits the strength of this conclusion. Wearability evaluations are needed for the translation of WIST outcomes. Minimum reporting standards for WIST should be followed to ensure methodological reproducibility.
Collapse
Affiliation(s)
- Roger Lee
- School of Health Sciences, The University of Newcastle, Newcastle 2308, Australia; (C.J.); (S.J.S.)
- Centre for Brain and Mental Health Research, The University of Newcastle, Newcastle 2308, Australia
| | - Carole James
- School of Health Sciences, The University of Newcastle, Newcastle 2308, Australia; (C.J.); (S.J.S.)
- Centre for Resources Health and Safety, The University of Newcastle, Newcastle 2308, Australia
| | - Suzi Edwards
- School of Health Sciences, The University of Sydney, Sydney 2006, Australia;
| | - Geoff Skinner
- School of Information and Physical Sciences, The University of Newcastle, Newcastle 2308, Australia;
| | - Jodi L. Young
- Department of Physical Therapy, Bellin College, Green Bay, WI 54311, USA;
| | - Suzanne J. Snodgrass
- School of Health Sciences, The University of Newcastle, Newcastle 2308, Australia; (C.J.); (S.J.S.)
- Centre for Brain and Mental Health Research, The University of Newcastle, Newcastle 2308, Australia
| |
Collapse
|
36
|
Morales J, Martínez JL, García-Cerezo AJ. A Redundant Configuration of Four Low-Cost GNSS-RTK Receivers for Reliable Estimation of Vehicular Position and Posture. SENSORS (BASEL, SWITZERLAND) 2021; 21:5853. [PMID: 34502744 PMCID: PMC8434592 DOI: 10.3390/s21175853] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 08/20/2021] [Accepted: 08/25/2021] [Indexed: 11/17/2022]
Abstract
This paper proposes a low-cost sensor system composed of four GNSS-RTK receivers to obtain accurate position and posture estimations for a vehicle in real-time. The four antennas of the receivers are placed so that every three-antennas combination is optimal to get the most precise 3D coordinates with respect to a global reference system. The redundancy provided by the fourth receiver allows to improve estimations even more and to maintain accuracy when one of the receivers fails. A mini computer with the Robotic Operating System is responsible for merging all the available measurements reliably. Successful experiments have been carried out with a ground rover on irregular terrain. Angular estimates similar to those of a high-performance IMU have been achieved in dynamic tests.
Collapse
Affiliation(s)
- Jesús Morales
- Robotics and Mechatronic Lab, Andalucía Tech, Universidad de Málaga, 29071 Málaga, Spain; (J.L.M.); (A.J.G.-C.)
| | | | | |
Collapse
|
37
|
Vyšata O, Ťupa O, Procházka A, Doležal R, Cejnar P, Bhorkar AM, Dostál O, Vališ M. Classification of Ataxic Gait. SENSORS 2021; 21:s21165576. [PMID: 34451018 PMCID: PMC8402252 DOI: 10.3390/s21165576] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Revised: 08/08/2021] [Accepted: 08/12/2021] [Indexed: 12/17/2022]
Abstract
Gait disorders accompany a number of neurological and musculoskeletal disorders that significantly reduce the quality of life. Motion sensors enable high-quality modelling of gait stereotypes. However, they produce large volumes of data, the evaluation of which is a challenge. In this publication, we compare different data reduction methods and classification of reduced data for use in clinical practice. The best accuracy achieved between a group of healthy individuals and patients with ataxic gait extracted from the records of 43 participants (23 ataxic, 20 healthy), forming 418 segments of straight gait pattern, is 98% by random forest classifier preprocessed by t-distributed stochastic neighbour embedding.
Collapse
Affiliation(s)
- Oldřich Vyšata
- Department of Neurology, Faculty of Medicine in Hradec Králové, Charles University, 500 03 Hradec Králové, Czech Republic; (A.M.B.); (O.D.); (M.V.)
- Correspondence:
| | - Ondřej Ťupa
- Department of Computing and Control Engineering, University of Chemistry and Technology in Prague, 166 28 Praha 6, Czech Republic; (O.Ť.); (A.P.); (P.C.)
| | - Aleš Procházka
- Department of Computing and Control Engineering, University of Chemistry and Technology in Prague, 166 28 Praha 6, Czech Republic; (O.Ť.); (A.P.); (P.C.)
- Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague, 160 00 Prague 6, Czech Republic
| | - Rafael Doležal
- Department of Chemistry, Faculty of Science, University of Hradec Králové, 500 03 Hradec Králové, Czech Republic;
| | - Pavel Cejnar
- Department of Computing and Control Engineering, University of Chemistry and Technology in Prague, 166 28 Praha 6, Czech Republic; (O.Ť.); (A.P.); (P.C.)
| | - Aprajita Milind Bhorkar
- Department of Neurology, Faculty of Medicine in Hradec Králové, Charles University, 500 03 Hradec Králové, Czech Republic; (A.M.B.); (O.D.); (M.V.)
| | - Ondřej Dostál
- Department of Neurology, Faculty of Medicine in Hradec Králové, Charles University, 500 03 Hradec Králové, Czech Republic; (A.M.B.); (O.D.); (M.V.)
| | - Martin Vališ
- Department of Neurology, Faculty of Medicine in Hradec Králové, Charles University, 500 03 Hradec Králové, Czech Republic; (A.M.B.); (O.D.); (M.V.)
| |
Collapse
|
38
|
Design Approach for Reducing Cross-Axis Sensitivity in a Single-Drive Multi-Axis MEMS Gyroscope. MICROMACHINES 2021; 12:mi12080902. [PMID: 34442524 PMCID: PMC8401296 DOI: 10.3390/mi12080902] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Revised: 07/26/2021] [Accepted: 07/27/2021] [Indexed: 12/03/2022]
Abstract
In this paper, a new design technique is presented to estimate and reduce the cross-axis sensitivity (CAS) in a single-drive multi-axis microelectromechanical systems (MEMS) gyroscope. A simplified single-drive multi-axis MEMS gyroscope, based on a mode-split approach, was analyzed for cross-axis sensitivity using COMSOL Multiphysics. A design technique named the “ratio-matching method” of drive displacement amplitudes and sense frequency differences ratios was proposed to reduce the cross-axis sensitivity. Initially, the cross-axis sensitivities in the designed gyroscope for x and y-axis were calculated to be 0.482%
and 0.120%, respectively, having an average CAS of 0.301%. Using the proposed ratio-matching method and design technique, the individual cross-axis sensitivities in the designed gyroscope for x and y-axis were reduced to 0.018% and 0.073%, respectively. While the average CAS was reduced to 0.045%, showing a reduction rate of 85.1%. Moreover, the proposed ratio-matching method for cross-axis sensitivity reduction was successfully validated through simulations by varying the coupling spring position and sense frequency difference variation analyses. Furthermore, the proposed methodology was verified experimentally using fabricated single-drive multi-axis gyroscope.
Collapse
|
39
|
Chang BC, Zhang H, Long S, Obayemi A, Troob SH, Agrawal SK. A novel neck brace to characterize neck mobility impairments following neck dissection in head and neck cancer patients. WEARABLE TECHNOLOGIES 2021; 2:e8. [PMID: 38486630 PMCID: PMC10936248 DOI: 10.1017/wtc.2021.8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/13/2020] [Revised: 05/11/2021] [Accepted: 06/01/2021] [Indexed: 03/17/2024]
Abstract
Objective This article introduces a dynamic neck brace to measure the full range of motion (RoM) of the head-neck. This easy-to-wear brace was used, along with surface electromyography (EMG), to study changes in movement characteristics after neck dissection (ND) in a clinical setting. Methods The brace was inspired by the head-neck anatomy and was designed based on the head-neck movement of 10 healthy individuals. A 6 degrees-of-freedom open-chain structure was adopted to allow full RoM of the head-neck with respect to the shoulders. The physical model was realized by 3D printed materials and inexpensive sensors. Five subjects, who underwent unilateral selective ND, were assessed preoperative and postoperative using this prototype during the head-neck motions. Concurrent EMG measurements of their sternocleidomastoid, splenius capitis, and trapezius muscles were made. Results Reduced RoM during lateral bending on both sides of the neck was observed after surgery, with a mean angle change of 8.03° on the dissected side (95% confidence intervals [CI], 3.11-12.94) and 9.29° on the nondissected side (95% CI, 4.88-13.69), where CI denotes the confidence interval. Axial rotation showed a reduction in the RoM by 5.37° (95% CI, 2.34-8.39) on the nondissection side. Neck extension showed a slight increase in the RoM by 3.15° (95% CI, 0.81-5.49) postoperatively. Conclusions This brace may serve as a simple but useful tool in the clinic to document head-neck RoM changes in patients undergoing ND. Such a characterization may help clinicians evaluate the surgical procedure and guide the recovery of patients.
Collapse
Affiliation(s)
- Biing-Chwen Chang
- Department of Mechanical Engineering, School of Engineering and Applied Sciences, Columbia University, New York, New York, USA
| | - Haohan Zhang
- Department of Mechanical Engineering, School of Engineering and Applied Sciences, Columbia University, New York, New York, USA
| | - Sallie Long
- Department of Otolaryngology—Head and Neck Surgery, Columbia University Irving Medical Center, New York, New York, USA
| | - Adetokunbo Obayemi
- Department of Otolaryngology—Head and Neck Surgery, Columbia University Irving Medical Center, New York, New York, USA
| | - Scott H. Troob
- Department of Otolaryngology—Head and Neck Surgery, Columbia University Irving Medical Center, New York, New York, USA
- College of Physicians and Surgeons, Columbia University, New York, New York, USA
- New York Presbyterian-Columbia University Irving Medical Center, New York, New York, USA
| | - Sunil K. Agrawal
- Department of Mechanical Engineering, School of Engineering and Applied Sciences, Columbia University, New York, New York, USA
- Department of Rehabilitative and Regenerative Medicine, College of Physicians and Surgeons, Columbia University, New York, New York, USA
| |
Collapse
|
40
|
Xu D, Wang Q. Noninvasive Human-Prosthesis Interfaces for Locomotion Intent Recognition: A Review. CYBORG AND BIONIC SYSTEMS 2021; 2021:9863761. [PMID: 36285130 PMCID: PMC9494705 DOI: 10.34133/2021/9863761] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2020] [Accepted: 03/22/2021] [Indexed: 12/02/2022] Open
Abstract
The lower-limb robotic prostheses can provide assistance for amputees' daily activities by restoring the biomechanical functions of missing limb(s). To set proper control strategies and develop the corresponding controller for robotic prosthesis, a prosthesis user's intent must be acquired in time, which is still a major challenge and has attracted intensive attentions. This work focuses on the robotic prosthesis user's locomotion intent recognition based on the noninvasive sensing methods from the recognition task perspective (locomotion mode recognition, gait event detection, and continuous gait phase estimation) and reviews the state-of-the-art intent recognition techniques in a lower-limb prosthesis scope. The current research status, including recognition approach, progress, challenges, and future prospects in the human's intent recognition, has been reviewed. In particular for the recognition approach, the paper analyzes the recent studies and discusses the role of each element in locomotion intent recognition. This work summarizes the existing research results and problems and contributes a general framework for the intent recognition based on lower-limb prosthesis.
Collapse
Affiliation(s)
- Dongfang Xu
- Robotics Research Group, College of Engineering, Peking University, China
- Beijing Engineering Research Center of Intelligent Rehabilitation Engineering, China
| | - Qining Wang
- Robotics Research Group, College of Engineering, Peking University, China
- Beijing Engineering Research Center of Intelligent Rehabilitation Engineering, China
- The Beijing Innovation Center for Engineering Science and Advanced Technology (BIC-ESAT), Peking University, China
| |
Collapse
|
41
|
Liang H, Guo Y, Zhao X. Fault Detection and Isolation of the Multi-Sensor Inertial System. MICROMACHINES 2021; 12:mi12060593. [PMID: 34064020 PMCID: PMC8224025 DOI: 10.3390/mi12060593] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Revised: 05/18/2021] [Accepted: 05/18/2021] [Indexed: 11/26/2022]
Abstract
In order to solve the problem that the generalized likelihood test method cannot isolate the single fault of the four-gyro system and the double faults of the six-gyro system, a fault detection and isolation method combining the generalized likelihood test method with the residual error of the metabolism grey model is presented. The problem of isolating the single fault of the four-gyro system and the double faults of the six-gyro system using the generalized likelihood test method is analyzed. The method and process of fault detection and isolation are designed. The validity of the method presented in this paper is verified by simulation tests of the single fault of the four-gyro system and the double faults of the six-gyro system. By comparing the isolation performance with the generalized likelihood test method, it is proved that the isolation performance of the method proposed in this paper is better than that of the generalized likelihood test method. The method mentioned in this paper can effectively realize fault detection and isolation of the multi-gyro system and improve the inertial system’s reliability.
Collapse
Affiliation(s)
- Hao Liang
- School of Automation, Nanjing University of Science and Technology, Nanjing 210094, China;
- Beijing Aerospace Times Laser Inertial Technology Company, Ltd., Beijing 100094, China;
| | - Yu Guo
- School of Automation, Nanjing University of Science and Technology, Nanjing 210094, China;
- Correspondence:
| | - Xingfa Zhao
- Beijing Aerospace Times Laser Inertial Technology Company, Ltd., Beijing 100094, China;
| |
Collapse
|
42
|
Vibrotactile biofeedback devices in Parkinson's disease: a narrative review. Med Biol Eng Comput 2021; 59:1185-1199. [PMID: 33969461 DOI: 10.1007/s11517-021-02365-3] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Accepted: 04/25/2021] [Indexed: 10/21/2022]
Abstract
Parkinson's disease (PD) is often associated with a vast list of gait-associated disabilities, for which there is still a limited pharmacological/surgical treatment efficacy. Therefore, alternative approaches have emerged as vibrotactile biofeedback systems (VBS). This review aims to focus on the technologies supporting VBS and identify their effects on improving gait-associated disabilities by verifying how VBS were applied and validated with end-users. It is expected to furnish guidance to researchers looking to enhance the effectiveness of future vibrotactile cueing systems. The use of vibrotactile cues has proved to be relevant and attractive, as positive results have been obtained in patients' gait performance, suitability in any environment, and easy adherence. There seems to be a preference in developing VBS to mitigate freezing of gait, to improve balance, to overcome the risk of fall, and a prevalent use to apply miniaturized wearable actuators and sensors. Most studies implemented a biofeedback loop able to provide rescue strategies during or after the detection of a gait-associated disability. However, there is a need of more clinical evidence and inclusion of experimental sessions to evaluate if the biofeedback was effectively integrated into the patients' motor system.
Collapse
|
43
|
Clemente FM, Akyildiz Z, Pino-Ortega J, Rico-González M. Validity and Reliability of the Inertial Measurement Unit for Barbell Velocity Assessments: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2021; 21:2511. [PMID: 33916801 PMCID: PMC8038306 DOI: 10.3390/s21072511] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/20/2021] [Revised: 03/29/2021] [Accepted: 04/01/2021] [Indexed: 12/14/2022]
Abstract
The use of inertial measurement unit (IMU) has become popular in sports assessment. In the case of velocity-based training (VBT), there is a need to measure barbell velocity in each repetition. The use of IMUs may make the monitoring process easier; however, its validity and reliability should be established. Thus, this systematic review aimed to (1) identify and summarize studies that have examined the validity of wearable wireless IMUs for measuring barbell velocity and (2) identify and summarize studies that have examined the reliability of IMUs for measuring barbell velocity. A systematic review of Cochrane Library, EBSCO, PubMed, Scielo, Scopus, SPORTDiscus, and Web of Science databases was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. From the 161 studies initially identified, 22 were fully reviewed, and their outcome measures were extracted and analyzed. Among the eight different IMU models, seven can be considered valid and reliable for measuring barbell velocity. The great majority of IMUs used for measuring barbell velocity in linear trajectories are valid and reliable, and thus can be used by coaches for external load monitoring.
Collapse
Affiliation(s)
- Filipe Manuel Clemente
- Instituto Politécnico de Viana do Castelo, Escola Superior Desporto e Lazer, Rua Escola Industrial e Comercial de Nun’Álvares, 4900-347 Viana do Castelo, Portugal
- Instituto de Telecomunicações, Delegação da Covilhã, 1049-001 Lisboa, Portugal
| | - Zeki Akyildiz
- Sports Science Department, Gazi University, Teknikokullar, Ankara 06500, Turkey;
| | - José Pino-Ortega
- Faculty of Sports Sciences, University of Murcia, San Javier, 30100 Murcia, Spain;
- BIOVETMED & SPORTSCI Research Group, Department of Physical Activity and Sport, Faculty of Sport Sciences, University of Murcia, San Javier, 30100 Murcia, Spain;
| | - Markel Rico-González
- BIOVETMED & SPORTSCI Research Group, Department of Physical Activity and Sport, Faculty of Sport Sciences, University of Murcia, San Javier, 30100 Murcia, Spain;
- Department of Physical Education and Sport, University of the Basque Country, UPV-EHU, Lasarte 71, 01007 Vitoria-Gasteiz, Spain
| |
Collapse
|
44
|
Eggleston JD, Olivas AN, Vanderhoof HR, Chavez EA, Alvarado C, Boyle JB. Children With Autism Exhibit More Individualized Responses to Live Animation Biofeedback Than Do Typically Developing Children. Percept Mot Skills 2021; 128:1037-1058. [PMID: 33663275 DOI: 10.1177/0031512521998280] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Children with autism have displayed imbalances in responding to feedback and feedforward learning information and they have shown difficulty imitating movements. Previous research has focused on motor learning and coordination problems for these children, but little is known about their motoric responses to visual live animation feedback. Thus, we compared motor output responses to live animation biofeedback training in both 15 children with autism and 15 age- and sex-matched typically developing children (age range: 8-17 years). We collected kinematic data via Inertial Measurement Unit devices while participants performed a series of body weight squats at a pre-test, during live animation biofeedback training, and at post-test. Dependent t-tests (α = 0.05), were used to test for statistical significance between pre- and post-test values within groups, and repeated measures analyses of variance (α = 0.05) were used to test for differences among the training blocks, within each group. The Model Statistic technique (α = 0.05) was used to test for pre- and post-test differences on a single-subject level for every participant. Grouped data revealed little to no significant findings in the children with autism, as these participants showed highly individualized responses. However, typically developing children, when grouped, exhibited significant differences in their left hip position (p = 0.03) and ascent velocity (p = 0.004). Single-subject analyses showed more individualistic live animation responses of children with autism than typically developing children on every variable of interest except descent velocity. Thus, to teach children with autism new movements in optimal fashion, it is particularly important to understand their individualistic motor learning characteristics.
Collapse
Affiliation(s)
- Jeffrey D Eggleston
- Interdisciplinary Health Sciences Doctoral Program, The University of Texas at El Paso, El Paso, United States.,Department of Kinesiology, The University of Texas at El Paso, El Paso, United States
| | - Alyssa N Olivas
- Department of Biomedical Engineering, The University of Texas at El Paso, El Paso, United States
| | - Heather R Vanderhoof
- Interdisciplinary Health Sciences Doctoral Program, The University of Texas at El Paso, El Paso, United States
| | - Emily A Chavez
- Interdisciplinary Health Sciences Doctoral Program, The University of Texas at El Paso, El Paso, United States
| | - Carla Alvarado
- Department of Psychiatry, Paul L. Foster School of Medicine, Texas Tech Health Sciences Center El Paso, El Paso, United States
| | - Jason B Boyle
- Department of Kinesiology, The University of Texas at El Paso, El Paso, United States
| |
Collapse
|
45
|
A New Perspective on Low-Cost MEMS-Based AHRS Determination. SENSORS 2021; 21:s21041383. [PMID: 33669466 PMCID: PMC7920449 DOI: 10.3390/s21041383] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/13/2020] [Revised: 01/25/2021] [Accepted: 02/06/2021] [Indexed: 11/17/2022]
Abstract
Attitude and heading reference system (AHRS) is the term used to describe a rigid body’s angular orientation in three-dimensional space. This paper describes an AHRS determination and control system developed for navigation systems by integrating gyroscopes, accelerometers, and magnetometers signals from low-cost MEMS-based sensors in a complementary adaptive Kalman filter. AHRS estimation based on the iterative Kalman filtering process is required to be initialized first. A new method for AHRS initialization is proposed to improve the accuracy of the initial attitude estimates. Attitude estimates derived from the initialization and iterative adaptive filtering processes are compared with the orientation obtained from a high-end reference system. The improvement in the accuracy of the initial orientation as significant as 45% is obtained from the proposed method as compared with other selected techniques. Additionally, the computational process is reduced by 96%.
Collapse
|
46
|
McGrath T, Stirling L. Body-Worn IMU Human Skeletal Pose Estimation Using a Factor Graph-Based Optimization Framework. SENSORS (BASEL, SWITZERLAND) 2020; 20:E6887. [PMID: 33276492 PMCID: PMC7729748 DOI: 10.3390/s20236887] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Revised: 11/17/2020] [Accepted: 11/28/2020] [Indexed: 11/17/2022]
Abstract
Traditionally, inertial measurement units- (IMU) based human joint angle estimation requires a priori knowledge about sensor alignment or specific calibration motions. Furthermore, magnetometer measurements can become unreliable indoors. Without magnetometers, however, IMUs lack a heading reference, which leads to unobservability issues. This paper proposes a magnetometer-free estimation method, which provides desirable observability qualities under joint kinematics that sufficiently excite the lower body degrees of freedom. The proposed lower body model expands on the current self-calibrating human-IMU estimation literature and demonstrates a novel knee hinge model, the inclusion of segment length anthropometry, segment cross-leg length discrepancy, and the relationship between the knee axis and femur/tibia segment. The maximum a posteriori problem is formulated as a factor graph and inference is performed via post-hoc, on-manifold global optimization. The method is evaluated (N = 12) for a prescribed human motion profile task. Accuracy of derived knee flexion/extension angle (4.34∘ root mean square error (RMSE)) without magnetometers is similar to current state-of-the-art with magnetometer use. The developed framework can be expanded for modeling additional joints and constraints.
Collapse
Affiliation(s)
- Timothy McGrath
- Department of Aeronautics and Astronautics, Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139, USA
| | - Leia Stirling
- Industrial and Operations Engineering, Robotics Institute, University of Michigan, 1205 Beal Avenue, Ann Arbor, MI 48109, USA;
| |
Collapse
|
47
|
Din H, Iqbal F, Lee B. Sensitivity Analysis of Single-Drive, 3-axis MEMS Gyroscope Using COMSOL Multiphysics. MICROMACHINES 2020; 11:E1030. [PMID: 33255312 PMCID: PMC7759875 DOI: 10.3390/mi11121030] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Revised: 11/18/2020] [Accepted: 11/22/2020] [Indexed: 06/12/2023]
Abstract
In this paper, a COMSOL Multiphysics-based methodology is presented for evaluation of the microelectromechanical systems (MEMS) gyroscope. The established finite element analysis (FEA) model was successfully validated through a comparison with analytical and Matlab/Simulink analysis results. A simplified single-drive, 3-axis MEMS gyroscope was analyzed using a mode split approach, having a drive resonant frequency of 24,918 Hz, with the x-sense, y-sense, and z-sense being 25,625, 25,886, and 25,806 Hz, respectively. Drive-mode analysis was carried out and a maximum drive-displacement of 4.0 μm was computed for a 0.378 μN harmonic drive force. Mechanical sensitivity was computed at 2000 degrees per second (dps) input angular rate while the scale factor for roll, pitch, and yaw was computed to be 0.014, 0.011, and 0.013 nm/dps, respectively.
Collapse
Affiliation(s)
| | | | - Byeungleul Lee
- School of Mechatronics Engineering, Korea University of Technology and Education, Cheonan 31253, Korea; (H.D.); (F.I.)
| |
Collapse
|
48
|
Full Real-Time Positioning and Attitude System Based on GNSS-RTK Technology. SUSTAINABILITY 2020. [DOI: 10.3390/su12239796] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
An accurate positioning and attitude computation of vehicles, robots, or even persons is of the utmost importance and critical for the success of many operations in multiple commercial, industrial, and research areas. However, most of these positioning and attitude systems rely on inertial measurement units that must be periodically recalibrated and have a high cost. In the present work, the design of a real-time positioning and attitude system using three positioning sensors based on the GNSS-RTK technology is presented. This kind of system does not need recalibration, and it allows one to define the attitude of a solid by only computing the position of the system in the global reference system and the three angles that the relative positions of the GNSS antennas define with respect to the principal axes of the solid. The position and attitude can be computed in real time for both static and dynamic scenarios. The only limitation of the system is that the antennas need to be in open air to work at full performance and accuracy. All the design phases are covered in the prototype construction: requirement definition, hardware selection, software design, assembly, and validation. The feasibility and performance of the system were tested in both static and dynamic real scenarios.
Collapse
|
49
|
Xu D, Wang Q. On-board Training Strategy for IMU-Based Real-Time Locomotion Recognition of Transtibial Amputees With Robotic Prostheses. Front Neurorobot 2020; 14:47. [PMID: 33192430 PMCID: PMC7642451 DOI: 10.3389/fnbot.2020.00047] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2019] [Accepted: 06/12/2020] [Indexed: 11/13/2022] Open
Abstract
The paper puts forward an on-board strategy for a training model and develops a real-time human locomotion mode recognition study based on a trained model utilizing two inertial measurement units (IMUs) of robotic transtibial prosthesis. Three transtibial amputees were recruited as subjects in this study to finish five locomotion modes (level ground walking, stair ascending, stair descending, ramp ascending, and ramp descending) with robotic prostheses. An interaction interface was designed to collect sensors' data and instruct to train model and recognition. In this study, the analysis of variance ratio (no more than 0.05) reflects the good repeatability of gait. The on-board training time for SVM (Support Vector Machines), QDA (Quadratic Discriminant Analysis), and LDA (Linear discriminant analysis) are 89, 25, and 10 s based on a 10,000 × 80 training data set, respectively. It costs about 13.4, 5.36, and 0.067 ms for SVM, QDA, and LDA for each recognition process. Taking the recognition accuracy of some previous studies and time consumption into consideration, we choose QDA for real-time recognition study. The real-time recognition accuracies are 97.19 ± 0.36% based on QDA, and we can achieve more than 95% recognition accuracy for each locomotion mode. The receiver operating characteristic also shows the good quality of QDA classifiers. This study provides a preliminary interaction design for human-machine prosthetics in future clinical application. This study just adopts two IMUs not multi-type sensors fusion to improve the integration and wearing convenience, and it maintains comparable recognition accuracy with multi-type sensors fusion at the same time.
Collapse
Affiliation(s)
- Dongfang Xu
- The Robotics Research Group, College of Engineering, Peking University, Beijing, China
- Beijing Engineering Research Center of Intelligent Rehabilitation Engineering, Beijing, China
| | - Qining Wang
- The Robotics Research Group, College of Engineering, Peking University, Beijing, China
- Beijing Engineering Research Center of Intelligent Rehabilitation Engineering, Beijing, China
- Beijing Innovation Center for Engineering Science and Advanced Technology, Peking University, Beijing, China
| |
Collapse
|
50
|
Chiasson D, Xu J, Shull P. Lossless Compression of Human Movement IMU Signals. SENSORS (BASEL, SWITZERLAND) 2020; 20:s20205926. [PMID: 33092285 PMCID: PMC7590134 DOI: 10.3390/s20205926] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/16/2020] [Revised: 10/14/2020] [Accepted: 10/18/2020] [Indexed: 06/11/2023]
Abstract
Real-time human movement inertial measurement unit (IMU) signals are central to many emerging medical and technological applications, yet few techniques have been proposed to process and represent this information modality in an efficient manner. In this paper, we explore methods for the lossless compression of human movement IMU data and compute compression ratios as compared with traditional representation formats on a public corpus of human movement IMU signals for walking, running, sitting, standing, and biking human movement activities. Delta coding was the highest performing compression method which compressed walking, running, and biking data by a factor of 10 and compressed sitting and standing data by a factor of 18 relative to the original CSV formats. Furthermore, delta encoding was shown to approach the a posteriori optimal linear compression level. All methods were implemented and released as open source C code using fixed point computation which can be integrated into a variety of computational platforms. These results could serve to inform and enable human movement data compression in a variety of emerging medical and technological applications.
Collapse
|