1
|
Micó-Amigo ME, Bonci T, Paraschiv-Ionescu A, Ullrich M, Kirk C, Soltani A, Küderle A, Gazit E, Salis F, Alcock L, Aminian K, Becker C, Bertuletti S, Brown P, Buckley E, Cantu A, Carsin AE, Caruso M, Caulfield B, Cereatti A, Chiari L, D'Ascanio I, Eskofier B, Fernstad S, Froehlich M, Garcia-Aymerich J, Hansen C, Hausdorff JM, Hiden H, Hume E, Keogh A, Kluge F, Koch S, Maetzler W, Megaritis D, Mueller A, Niessen M, Palmerini L, Schwickert L, Scott K, Sharrack B, Sillén H, Singleton D, Vereijken B, Vogiatzis I, Yarnall AJ, Rochester L, Mazzà C, Del Din S. Assessing real-world gait with digital technology? Validation, insights and recommendations from the Mobilise-D consortium. J Neuroeng Rehabil 2023; 20:78. [PMID: 37316858 PMCID: PMC10265910 DOI: 10.1186/s12984-023-01198-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Accepted: 05/26/2023] [Indexed: 06/16/2023] Open
Abstract
BACKGROUND Although digital mobility outcomes (DMOs) can be readily calculated from real-world data collected with wearable devices and ad-hoc algorithms, technical validation is still required. The aim of this paper is to comparatively assess and validate DMOs estimated using real-world gait data from six different cohorts, focusing on gait sequence detection, foot initial contact detection (ICD), cadence (CAD) and stride length (SL) estimates. METHODS Twenty healthy older adults, 20 people with Parkinson's disease, 20 with multiple sclerosis, 19 with proximal femoral fracture, 17 with chronic obstructive pulmonary disease and 12 with congestive heart failure were monitored for 2.5 h in the real-world, using a single wearable device worn on the lower back. A reference system combining inertial modules with distance sensors and pressure insoles was used for comparison of DMOs from the single wearable device. We assessed and validated three algorithms for gait sequence detection, four for ICD, three for CAD and four for SL by concurrently comparing their performances (e.g., accuracy, specificity, sensitivity, absolute and relative errors). Additionally, the effects of walking bout (WB) speed and duration on algorithm performance were investigated. RESULTS We identified two cohort-specific top performing algorithms for gait sequence detection and CAD, and a single best for ICD and SL. Best gait sequence detection algorithms showed good performances (sensitivity > 0.73, positive predictive values > 0.75, specificity > 0.95, accuracy > 0.94). ICD and CAD algorithms presented excellent results, with sensitivity > 0.79, positive predictive values > 0.89 and relative errors < 11% for ICD and < 8.5% for CAD. The best identified SL algorithm showed lower performances than other DMOs (absolute error < 0.21 m). Lower performances across all DMOs were found for the cohort with most severe gait impairments (proximal femoral fracture). Algorithms' performances were lower for short walking bouts; slower gait speeds (< 0.5 m/s) resulted in reduced performance of the CAD and SL algorithms. CONCLUSIONS Overall, the identified algorithms enabled a robust estimation of key DMOs. Our findings showed that the choice of algorithm for estimation of gait sequence detection and CAD should be cohort-specific (e.g., slow walkers and with gait impairments). Short walking bout length and slow walking speed worsened algorithms' performances. Trial registration ISRCTN - 12246987.
Collapse
Affiliation(s)
- M Encarna Micó-Amigo
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Tecla Bonci
- Department of Mechanical Engineering and Insigneo Institute for in Silico Medicine, The University of Sheffield, Sheffield, UK
| | - Anisoara Paraschiv-Ionescu
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Martin Ullrich
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Cameron Kirk
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Abolfazl Soltani
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Arne Küderle
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Eran Gazit
- Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Francesca Salis
- Department of Biomedical Sciences, University of Sassari, Sassari, Italy
- Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Lisa Alcock
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - Kamiar Aminian
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Clemens Becker
- Robert Bosch Gesellschaft für Medizinische Forschung, Stuttgart, Germany
| | - Stefano Bertuletti
- Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Philip Brown
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - Ellen Buckley
- Department of Mechanical Engineering and Insigneo Institute for in Silico Medicine, The University of Sheffield, Sheffield, UK
| | - Alma Cantu
- School of Computing, Newcastle University, Newcastle upon Tyne, UK
| | - Anne-Elie Carsin
- Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Universitat Pompeu Fabra, Barcelona, Catalonia, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
| | - Marco Caruso
- Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Brian Caulfield
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
- School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Andrea Cereatti
- Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Lorenzo Chiari
- Department of Electrical, Electronic and Information Engineering «Guglielmo Marconi», University of Bologna, Bologna, Italy
- Health Sciences and Technologies-Interdepartmental Center for Industrial Research (CIRI-SDV), University of Bologna, Bologna, Italy
| | - Ilaria D'Ascanio
- Department of Electrical, Electronic and Information Engineering «Guglielmo Marconi», University of Bologna, Bologna, Italy
| | - Bjoern Eskofier
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Sara Fernstad
- School of Computing, Newcastle University, Newcastle upon Tyne, UK
| | | | - Judith Garcia-Aymerich
- Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Universitat Pompeu Fabra, Barcelona, Catalonia, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
| | - Clint Hansen
- Department of Neurology, University Medical Center Schleswig-Holstein Campus Kiel, Kiel, Germany
| | - Jeffrey M Hausdorff
- Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
- Sagol School of Neuroscience and Department of Physical Therapy, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
- Rush Alzheimer's Disease Center and Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, IL, USA
| | - Hugo Hiden
- School of Computing, Newcastle University, Newcastle upon Tyne, UK
| | - Emily Hume
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle upon Tyne, UK
| | - Alison Keogh
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
- School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Felix Kluge
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
- Novartis Institutes of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| | - Sarah Koch
- Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Universitat Pompeu Fabra, Barcelona, Catalonia, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
| | - Walter Maetzler
- Department of Neurology, University Medical Center Schleswig-Holstein Campus Kiel, Kiel, Germany
| | - Dimitrios Megaritis
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle upon Tyne, UK
| | - Arne Mueller
- Novartis Institutes of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| | | | - Luca Palmerini
- Department of Electrical, Electronic and Information Engineering «Guglielmo Marconi», University of Bologna, Bologna, Italy
- Health Sciences and Technologies-Interdepartmental Center for Industrial Research (CIRI-SDV), University of Bologna, Bologna, Italy
| | - Lars Schwickert
- Robert Bosch Gesellschaft für Medizinische Forschung, Stuttgart, Germany
| | - Kirsty Scott
- Department of Mechanical Engineering and Insigneo Institute for in Silico Medicine, The University of Sheffield, Sheffield, UK
| | - Basil Sharrack
- Department of Neuroscience and Sheffield NIHR Translational Neuroscience BRC, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK
| | | | - David Singleton
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
- School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Beatrix Vereijken
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Ioannis Vogiatzis
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle upon Tyne, UK
| | - Alison J Yarnall
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - Lynn Rochester
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - Claudia Mazzà
- Department of Mechanical Engineering and Insigneo Institute for in Silico Medicine, The University of Sheffield, Sheffield, UK
| | - Silvia Del Din
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK.
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK.
| |
Collapse
|