Concurrent assessment of gait kinematics using marker-based and markerless motion capture

Fusion of video and inertial sensing data via dynamic optimization of a biomechanical model

Inertial sensing and computer vision are promising alternatives to traditional optical motion tracking, but until now these data sources have been explored either in isolation or fused via unconstrained optimization, which may not take full advantage of their complementary strengths. By adding physiological plausibility and dynamical robustness to a proposed solution, biomechanical modeling may enable better fusion than unconstrained optimization. To test this hypothesis, we fused video and inertial sensing data via dynamic optimization with a nine degree-of-freedom model and investigated when this approach outperforms video-only, inertial-sensing-only, and unconstrained-fusion methods. We used both experimental and synthetic data that mimicked different ranges of video and inertial measurement unit (IMU) data noise. Fusion with a dynamically constrained model significantly improved estimation of lower-extremity kinematics over the video-only approach and estimation of joint centers over the IMU-only approach. It consistently outperformed single-modality approaches across different noise profiles. When the quality of video data was high and that of inertial data was low, dynamically constrained fusion improved estimation of joint kinematics and joint centers over unconstrained fusion, while unconstrained fusion was advantageous in the opposite scenario. These findings indicate that complementary modalities and techniques can improve motion tracking by clinically meaningful margins and that data quality and computational complexity must be considered when selecting the most appropriate method for a particular application.

Principal Component Analysis of Whole-Body Kinematics Using Markerless Motion Capture During Static Balance Tasks

Balance tests have clinical utility in identifying balance deficits and supporting recommendations for appropriate treatments. Motion capture technology can be used to measure whole-body kinematics during balance tasks, but to date the high technical and financial costs have limited uptake of traditional marker-based motion capture systems for clinical applications. Markerless motion capture technology using standard video cameras has the potential to provide whole-body kinematic assessments with clinically accessible technology. Our aim was to quantify poses and movement strategies during static balance tasks (tandem stance, single limb stance, standing hip abduction, and quiet standing on foam with eyes closed) using video-based markerless motion capture software (Theia3D) and principal component analysis to examine the associations with age, body mass index (BMI) and sex. In 30 healthy adults, the mean poses for all balance tasks had at least one principal component (PC) that differed significantly by sex. Age was significantly associated with the PC describing leg height for the hip abduction task and erect posture for the quiet standing task. BMI was significantly associated with the PC capturing knee flexion in the single leg stance task. The movement strategies used to maintain balance showed significant differences by sex for the tandem stance pose. BMI was correlated with PCs for movement strategies for hip abduction and quiet standing tasks. Results from this study demonstrate how markerless motion capture technology could be used to augment analyses of balance both in the clinic and in the field.

Markerless motion capture estimates of lower extremity kinematics and kinetics are comparable to marker-based across 8 movements

Motion analysis is essential for assessing in-vivo human biomechanics. Marker-based motion capture is the standard to analyze human motion, but the inherent inaccuracy and practical challenges limit its utility in large-scale and real-world applications. Markerless motion capture has shown promise to overcome these practical barriers. However, its fidelity in quantifying joint kinematics and kinetics has not been verified across multiple common human movements. In this study, we concurrently captured marker-based and markerless motion data on 10 healthy subjects performing 8 daily living and exercise movements. We calculated the correlation (R xy ) and root-mean-square difference (RMSD) between markerless and marker-based estimates of ankle dorsi-plantarflexion, knee flexion, and three-dimensional hip kinematics (angles) and kinetics (moments) during each movement. Estimates from markerless motion capture matched closely with marker-based in ankle and knee joint angles (R xy ≥ 0.877, RMSD ≤ 5.9°) and moments (R xy ≥ 0.934, RMSD ≤ 2.66 % height × weight). High outcome comparability means the practical benefits of markerless motion capture can simplify experiments and facilitate large-scale analyses. Hip angles and moments demonstrated more differences between the two systems (RMSD: 6.7° - 15.9° and up to 7.15 % height × weight), especially during rapid movements such as running. Markerless motion capture appears to improve the accuracy of hip-related measures, yet more research is needed for validation. We encourage the biomechanics community to continue verifying, validating, and establishing best practices for markerless motion capture, which holds exciting potential to advance collaborative biomechanical research and expand real-world assessments needed for clinical translation.

Validation of 3D Knee Kinematics during Gait on Treadmill with an Instrumented Knee Brace

To test a novel instrumented knee brace intended for use as a rehabilitation system, based on inertial measurement units (IMU) to monitor home-based exercises, the device was compared to the gold standard of motion analysis. The purpose was to validate a new calibration method through functional tasks and assessed the value of adding magnetometers for motion analysis. Thirteen healthy young adults performed a 60-second gait test at a comfortable walking speed on a treadmill. Knee kinematics were captured simultaneously, using the instrumented knee brace and an optoelectronic camera system (OCS). The intraclass correlation coefficient (ICC) showed excellent reliability for the three axes of rotation with and without magnetometers, with values ranging between 0.900 and 0.972. Pearson's r coefficient showed good to excellent correlation for the three axes, with the root mean square error (RMSE) under 3° with the IMUs and slightly higher with the magnetometers. The instrumented knee brace obtained certain clinical parameters, as did the OCS. The instrumented knee brace seems to be a valid tool to assess ambulatory knee kinematics, with an RMSE of <3°, which is sufficient for clinical interpretations. Indeed, this portable system can obtain certain clinical parameters just as well as the gold standard of motion analysis. However, the addition of magnetometers showed no significant advantage in terms of enhancing accuracy.

Ergonomic human-robot collaboration in industry: A review

In the current industrial context, the importance of assessing and improving workers' health conditions is widely recognised. Both physical and psycho-social factors contribute to jeopardising the underlying comfort and well-being, boosting the occurrence of diseases and injuries, and affecting their quality of life. Human-robot interaction and collaboration frameworks stand out among the possible solutions to prevent and mitigate workplace risk factors. The increasingly advanced control strategies and planning schemes featured by collaborative robots have the potential to foster fruitful and efficient coordination during the execution of hybrid tasks, by meeting their human counterparts' needs and limits. To this end, a thorough and comprehensive evaluation of an individual's ergonomics, i.e. direct effect of workload on the human psycho-physical state, must be taken into account. In this review article, we provide an overview of the existing ergonomics assessment tools as well as the available monitoring technologies to drive and adapt a collaborative robot's behaviour. Preliminary attempts of ergonomic human-robot collaboration frameworks are presented next, discussing state-of-the-art limitations and challenges. Future trends and promising themes are finally highlighted, aiming to promote safety, health, and equality in worldwide workplaces.

Biomechanics beyond the lab: Remote technology for osteoarthritis patient data-A scoping review

The objective of this project is to produce a review of available and validated technologies suitable for gathering biomechanical and functional research data in patients with osteoarthritis (OA), outside of a traditionally fixed laboratory setting. A scoping review was conducted using defined search terms across three databases (Scopus, Ovid MEDLINE, and PEDro), and additional sources of information from grey literature were added. One author carried out an initial title and abstract review, and two authors independently completed full-text screenings. Out of the total 5,164 articles screened, 75 were included based on inclusion criteria covering a range of technologies in articles published from 2015. These were subsequently categorised by technology type, parameters measured, level of remoteness, and a separate table of commercially available systems. The results concluded that from the growing number of available and emerging technologies, there is a well-established range in use and further in development. Of particular note are the wide-ranging available inertial measurement unit systems and the breadth of technology available to record basic gait spatiotemporal measures with highly beneficial and informative functional outputs. With the majority of technologies categorised as suitable for part-remote use, the number of technologies that are usable and fully remote is rare and they usually employ smartphone software to enable this. With many systems being developed for camera-based technology, such technology is likely to increase in usability and availability as computational models are being developed with increased sensitivities to recognise patterns of movement, enabling data collection in the wider environment and reducing costs and creating a better understanding of OA patient biomechanical and functional movement data.

Ubiquitous Computing in Sports and Physical Activity-Recent Trends and Developments

The use of small, interconnected and intelligent tools within the broad framework of pervasive computing for analysis and assessments in sport and physical activity is not a trend in itself but defines a way for information to be handled, processed and utilised: everywhere, at any time. The demand for objective data to support decision making prompted the adoption of wearables that evolve to fulfil the aims of assessing athletes and practitioners as closely as possible with their performance environments. In the present paper, we mention and discuss the advancements in ubiquitous computing in sports and physical activity in the past 5 years. Thus, recent developments in wearable sensors, cloud computing and artificial intelligence tools have been the pillars for a major change in the ways sport-related analyses are performed. The focus of our analysis is wearable technology, computer vision solutions for markerless tracking and their major contribution to the process of acquiring more representative data from uninhibited actions in realistic ecological conditions. We selected relevant literature on the applications of such approaches in various areas of sports and physical activity while outlining some limitations of the present-day data acquisition and data processing practices and the resulting sensors' functionalities, as well as the limitations to the data-driven informed decision making in the current technological and scientific framework. Finally, we hypothesise that a continuous merger of measurement, processing and analysis will lead to the development of more reliable models utilising the advantages of open computing and unrestricted data access and allow for the development of personalised-medicine-type approaches to sport training and performance.

Verification of gait analysis method fusing camera-based pose estimation and an IMU sensor in various gait conditions

A markerless gait analysis system can measure useful gait metrics to determine effective clinical treatment. Although this gait analysis system does not require a large space, several markers, or time constraints, it inaccurately measure lower limb joint kinematics during gait. In particular, it has a substantial ankle joint angle error. In this study, we investigated the markerless gait analysis method capability using single RGB camera-based pose estimation by OpenPose (OP) and an inertial measurement unit (IMU) sensor on the foot segment to measure ankle joint kinematics under various gait conditions. Sixteen healthy young adult males participated in the study. We compared temporo-spatial parameters and lower limb joint angles during four gait conditions with varying gait speeds and foot progression angles. These were measured by optoelectronic motion capture, markerless gait analysis method using OP, and proposed method using OP and IMU. We found that the proposed method using OP and an IMU significantly decreased the mean absolute errors of peak ankle joint angles compared with OP in the four gait conditions. The proposed method has the potential to measure temporo-spatial gait parameters and lower limb joint angles, including ankle angles, in various gait conditions as a clinical settings gait assessment tool.

Comparison of Lower Extremity Joint Moment and Power Estimated by Markerless and Marker-Based Systems during Treadmill Running

Background: Markerless (ML) motion capture systems have recently become available for biomechanics applications. Evidence has indicated the potential feasibility of using an ML system to analyze lower extremity kinematics. However, no research has examined ML systems’ estimation of the lower extremity joint moments and powers. This study aimed to compare lower extremity joint moments and powers estimated by marker-based (MB) and ML motion capture systems. Methods: Sixteen volunteers ran on a treadmill for 120 s at 3.58 m/s. The kinematic data were simultaneously recorded by 8 infrared cameras and 8 high-resolution video cameras. The force data were recorded via an instrumented treadmill. Results: Greater peak magnitudes for hip extension and flexion moments, knee flexion moment, and ankle plantarflexion moment, along with their joint powers, were observed in the ML system compared to an MB system (p < 0.0001). For example, greater hip extension (MB: 1.42 ± 0.29 vs. ML: 2.27 ± 0.45) and knee flexion (MB: −0.74 vs. ML: −1.17 nm/kg) moments were observed in the late swing phase. Additionally, the ML system’s estimations resulted in significantly smaller peak magnitudes for knee extension moment, along with the knee production power (p < 0.0001). Conclusions: These observations indicate that inconsistent estimates of joint center position and segment center of mass between the two systems may cause differences in the lower extremity joint moments and powers. However, with the progression of pose estimation in the markerless system, future applications can be promising.

Markerless motion capture: What clinician-scientists need to know right now

Markerless motion capture (mocap) could be the future of motion analysis. The purpose of this report was to describe our team of clinicians and scientists' exploration of markerless mocap (Theia 3D) and share data for others to explore (link: https://osf.io/6vh7z/?view_only=c0e00984e94a48f28c8d987a2127339d). Simultaneous mocap was performed using markerless and marker-based systems for walking, squatting, and forward hopping. Segment lengths were more variable between trials using markerless mocap compared to marker-based mocap. Sagittal plane angles were most comparable between systems at the knee joint followed by the ankle and hip. Frontal and transverse plane angles were not comparable between systems. The data collection experience using markerless mocap was simpler, faster, and user friendly. The ease of collection was in part offset by the added data transfer and processing times, and the lack of troubleshooting flexibility. If used selectively with proper understanding of limitations, markerless mocap can be exciting technology to advance the field of motion analysis.

Accuracy of a 3D temporal scanning system for gait analysis: Comparative with a marker-based photogrammetry system

BACKGROUND

Combining the accuracy of marker-based stereophotogrammetry and the usability and comfort of markerless human movement analysis is a difficult challenge. 3D temporal scanners are a promising solution, since they provide moving meshes with thousands of vertices that can be used to analyze human movements.

RESEARCH QUESTION

Can a 3D temporal scanner be used as a markerless system for gait analysis with the same accuracy as traditional, marker-based stereophotogrammetry systems?

METHODS

A comparative study was carried out using a 3D temporal scanner synchronized with a marker-based stereophotogrammetry system. Two gait cycles of twelve healthy adults were measured simultaneously, extracting the positions of key anatomical points from both systems, and using them to analyze the 3D kinematics of the pelvis, right hip and knee joints. Measurement differences of marker positions and joint angles were described by their root mean square. A t-test was performed to rule out instrumental errors, and an F-test to evaluate the amplifications of marker position errors in dynamic conditions.

RESULTS

The differences in 3D landmark positions were between 1.9 and 2.4 mm in the reference pose. Marker position errors were significantly increased during motion in the medial-lateral and vertical directions. The angle relative errors were between 3% and 43% of the range of motion, with the greatest difference being observed in hip axial rotation.

SIGNIFICANCE

The differences in the results obtained between the 3D temporal scanner and the marker-based system were smaller than the usual errors due to lack of accuracy in the manual positioning of markers on anatomical landmarks and to soft-tissue artefacts. That level of accuracy is greater than other markerless systems, and proves that such technology is a good alternative to traditional, marker-based motion capture.

Assessing Time-Varying Lumbar Flexion-Extension Kinematics Using Automated Pose Estimation

The purpose of this research was to evaluate the algorithm DeepLabCut (DLC) against a 3D motion capture system (Vicon Motion Systems Ltd) in the analysis of lumbar and elbow flexion-extension movements. Data were acquired concurrently and tracked using DLC and Vicon. A novel DLC model was trained using video data derived from a subset of participants (training group). Accuracy and precision were assessed using data derived from the training group as well as in a new set of participants (testing group). Two-way analysis of variance were used to detect significant differences between the training and testing sets, capture methods (Vicon vs DLC), as well as potential higher order interaction effect between these independent variables in the estimation of flexion-extension angles and variability. No significant differences were observed in any planar angles, nor were any higher order interactions observed between each motion capture modality with the training versus testing data sets. Bland-Altman plots were used to depict the mean bias and level of agreement between DLC and Vicon for both training and testing data sets. This research suggests that DLC-derived planar kinematics of both the elbow and lumbar spine are of acceptable accuracy and precision when compared with conventional laboratory gold standards (Vicon).

Accuracy of a markerless motion capture system in estimating upper extremity kinematics during boxing

Kinematic analysis of the upper extremity can be useful to assess the performance and skill levels of athletes during combat sports such as boxing. Although marker-based approach is widely used to obtain kinematic data, it is not suitable for “in the field” activities, i.e., when performed outside the laboratory environment. Markerless video-based systems along with deep learning-based pose estimation algorithms show great potential for estimating skeletal kinematics. However, applicability of these systems in assessing upper-limb kinematics remains unexplored in highly dynamic activities. This study aimed to assess kinematics of the upper limb estimated with a markerless motion capture system (2D video cameras along with commercially available pose estimation software Theia3D) compared to those measured with marker-based system during “in the field” boxing. A total of three elite boxers equipped with retroreflective markers were instructed to perform specific sequences of shadow boxing trials. Their movements were simultaneously recorded with 12 optoelectronic and 10 video cameras, providing synchronized data to be processed further for comparison. Comparative assessment showed higher differences in 3D joint center positions at the elbow (more than 3 cm) compared to the shoulder and wrist (&lt;2.5 cm). In the case of joint angles, relatively weaker agreement was observed along internal/external rotation. The shoulder joint revealed better performance across all the joints. Segment velocities displayed good-to-excellent agreement across all the segments. Overall, segment velocities exhibited better performance compared to joint angles. The findings indicate that, given the practicality of markerless motion capture system, it can be a promising alternative to analyze sports-performance.

Smart Phone-Based Motion Capture and Analysis: Importance of Operating Envelope Definition and Application to Clinical Use

Human movement is vital for life, with active engagement affording function, limiting disease, and improving quality; with loss resulting in disability; and the treatment and training leading to restoration and enhancement. To foster these endeavors a need exists for a simple and reliable method for the quantitation of movement, favorable for widespread user availability. We developed a Mobile Motion Capture system (MO2CA) employing a smart-phone and colored markers (2, 5, 10 mm) and here define its operating envelope in terms of: (1) the functional distance of marker detection (range), (2) the inter-target resolution and discrimination, (3) the mobile target detection, and (4) the impact of ambient illumination intensity. MO2CA was able to detect and discriminate: (1) single targets over a range of 1 to 18 ft, (2) multiple targets from 1 ft to 11 ft, with inter-target discrimination improving with an increasing target size, (3) moving targets, with minimal errors from 2 ft to 8 ft, and (4) targets within 1 to 18 ft, with an illumination of 100–300 lux. We then evaluated the utility of motion capture in quantitating regional-finger abduction/adduction and whole body–lateral flex motion, demonstrating a quantitative discrimination between normal and abnormal motion. Overall, our results demonstrate that MO2CA has a wide operating envelope with utility for the detection of human movements large and small, encompassing the whole body, body region, and extremity and digit movements. The definition of the effective operating envelope and utility of smart phone-based motion capture as described herein will afford accuracy and appropriate use for future application studies and serve as a general approach for defining the operational bounds of future video capture technologies that arise for potential clinical use.

Absolute Reliability of Gait Parameters Acquired With Markerless Motion Capture in Living Domains

Purpose: To examine the between-day absolute reliability of gait parameters acquired with Theia3D markerless motion capture for use in biomechanical and clinical settings. Methods: Twenty-one (7 M,14 F) participants aged between 18 and 73 years were recruited in community locations to perform two walking tasks: self-selected and fastest-comfortable walking speed. Participants walked along a designated walkway on two separate days.Joint angle kinematics for the hip, knee, and ankle, for all planes of motion, and spatiotemporal parameters were extracted to determine absolute reliability between-days. For kinematics, absolute reliability was examined using: full curve analysis [root mean square difference (RMSD)] and discrete point analysis at defined gait events using standard error of measurement (SEM). The absolute reliability of spatiotemporal parameters was also examined using SEM and SEM%. Results: Markerless motion capture produced low measurement error for kinematic full curve analysis with RMSDs ranging between 0.96° and 3.71° across all joints and planes for both walking tasks. Similarly, discrete point analysis within the gait cycle produced SEM values ranging between 0.91° and 3.25° for both sagittal and frontal plane angles of the hip, knee, and ankle. The highest measurement errors were observed in the transverse plane, with SEM >5° for ankle and knee range of motion. For the majority of spatiotemporal parameters, markerless motion capture produced low SEM values and SEM% below 10%. Conclusion: Markerless motion capture using Theia3D offers reliable gait analysis suitable for biomechanical and clinical use.

Clothing condition does not affect meaningful clinical interpretation in markerless motion capture

Markerless motion capture allows whole-body movements to be captured without the need for physical markers to be placed on the body. This enables motion capture analyses to be conducted in more ecologically valid environments. However, the influences of varied clothing on video-based markerless motion capture assessments remain largely unexplored. This study investigated two types of clothing conditions, "Sport" (gym shirt and shorts) and "Street" (unrestricted casual clothing), on gait parameters during overground walking by 29 participants at self-selected speeds using markerless motion capture. Segment lengths, gait spatiotemporal parameters, and lower-limb kinematics were compared between the two clothing conditions. Mean differences in segment length for the forearm, upper arm, thigh, and shank between clothing conditions ranged from 0.2 cm for the forearm to 0.9 cm for the thigh (p < 0.05 for thigh and shank) but below typical marker placement errors (1 - 2 cm). Seven out of 9 gait spatiotemporal parameters demonstrated statistically significant differences between clothing conditions (p < 0.05), however, these differences were approximately ten times smaller than minimal detectable changes in movement-related pathologies including multiple sclerosis and cerebral palsy. Hip, knee, and ankle joint angle root-mean-square deviation values averaged 2.6° and were comparable to previously reported average inter-session variability for this markerless system (2.8°). The results indicate that clothing, a potential limiting factor in markerless motion capture performance, would negligibly alter meaningful clinical interpretations under the conditions investigated.

Feasibility of Markerless Motion Capture for Three-Dimensional Gait Assessment in Community Settings

Three-dimensional (3D) kinematic analysis of gait holds potential as a digital biomarker to identify neuropathologies, monitor disease progression, and provide a high-resolution outcome measure to monitor neurorehabilitation efficacy by characterizing the mechanisms underlying gait impairments. There is a need for 3D motion capture technologies accessible to community, clinical, and rehabilitation settings. Image-based markerless motion capture (MLMC) using neural network-based deep learning algorithms shows promise as an accessible technology in these settings. In this study, we assessed the feasibility of implementing 3D MLMC technology outside the traditional laboratory environment to evaluate its potential as a tool for outcomes assessment in neurorehabilitation. A sample population of 166 individuals aged 9-87 years (mean 43.7, S.D. 20.4) of varied health history were evaluated at six different locations in the community over a 3-month period. Participants walked overground at self-selected (SS) and fastest comfortable (FC) speeds. Feasibility measures considered the expansion, implementation, and practicality of this MLMC system. A subset of the sample population (46 individuals) walked over a pressure-sensitive walkway (PSW) concurrently with MLMC to assess agreement of the spatiotemporal gait parameters measured between the two systems. Twelve spatiotemporal parameters were compared using mean differences, Bland-Altman analysis, and intraclass correlation coefficients for agreement (ICC2,1) and consistency (ICC3,1). All measures showed good to excellent agreement between MLMC and the PSW system with cadence, speed, step length, step time, stride length, and stride time showing strong similarity. Furthermore, this information can inform the development of rehabilitation strategies targeting gait dysfunction. These first experiments provide evidence for feasibility of using MLMC in community and clinical practice environments to acquire robust 3D kinematic data from a diverse population. This foundational work enables future investigation with MLMC especially its use as a digital biomarker of disease progression and rehabilitation outcome.

Healthcare applications of single camera markerless motion capture: a scoping review

Background

Single camera markerless motion capture has the potential to facilitate at home movement assessment due to the ease of setup, portability, and affordable cost of the technology. However, it is not clear what the current healthcare applications of single camera markerless motion capture are and what information is being collected that may be used to inform clinical decision making. This review aims to map the available literature to highlight potential use cases and identify the limitations of the technology for clinicians and researchers interested in the collection of movement data.

Survey Methodology

Studies were collected up to 14 January 2022 using Pubmed, CINAHL and SPORTDiscus using a systematic search. Data recorded included the description of the markerless system, clinical outcome measures, and biomechanical data mapped to the International Classification of Functioning, Disability and Health Framework (ICF). Studies were grouped by patient population.

Results

A total of 50 studies were included for data collection. Use cases for single camera markerless motion capture technology were identified for Neurological Injury in Children and Adults; Hereditary/Genetic Neuromuscular Disorders; Frailty; and Orthopaedic or Musculoskeletal groups. Single camera markerless systems were found to perform well in studies involving single plane measurements, such as in the analysis of infant general movements or spatiotemporal parameters of gait, when evaluated against 3D marker-based systems and a variety of clinical outcome measures. However, they were less capable than marker-based systems in studies requiring the tracking of detailed 3D kinematics or fine movements such as finger tracking.

Conclusions

Single camera markerless motion capture offers great potential for extending the scope of movement analysis outside of laboratory settings in a practical way, but currently suffers from a lack of accuracy where detailed 3D kinematics are required for clinical decision making. Future work should therefore focus on improving tracking accuracy of movements that are out of plane relative to the camera orientation or affected by occlusion, such as supination and pronation of the forearm.

Comparison of marker-less and marker-based motion capture for baseball pitching kinematics

The purpose of this study was to compare baseball pitching kinematics measured with marker-less and marker-based motion capture. Two hundred and seventy-five fastball pitches were captured at 240 Hz simultaneously with a 9-camera marker-less system and a 12-camera marker system. The pitches were thrown by 30 baseball pitchers (age 17.1 ± 3.1 years). Data for each trial were time-synchronised between the two systems using the instant of ball release. Coefficients of Multiple Correlations (CMC) were computed to assess the similarity of waveforms between the two systems. Discrete measurements at foot contact, during arm cocking, and at ball release were compared between the systems using Bland-Altman plots and descriptive statistics. CMC values for the five time series analysed ranged from 0.88 to 0.97, indicating consistency in movement patterns between systems. Biases for discrete measurements ranged in magnitude from 0 to 16 degrees. Standard deviations of the differences between systems ranged from 0 to 14 degrees, while intraclass correlations ranged from 0.64 to 0.92. Thus, the marker-based and marker-less motion capture systems produced similar patterns for baseball pitching kinematics. However, based on the variations between the systems, it is recommended that a database of normative ranges be established for each system.

Assessment of a novel deep learning-based marker-less motion capture system for gait study

BACKGROUND

Marker-less systems based on digital video cameras and deep learning for gait analysis could have a deep impact in clinical routine. A recently developed system has shown promising results in terms of joint center position but has not been yet evaluated in terms of gait outcomes.

RESEARCH QUESTION

How does this novel marker-less system compare to a marker-based reference system in terms of clinically relevant gait parameters?

METHODS

The deep learning method behind the developed marker-less system was trained on a dedicated dataset consisting of forty-one asymptomatic and pathological subjects each performing ten walking trials. The system could estimate the three-dimensional position of seventeen joint centers or keypoints (e.g., neck, shoulders, hip, knee, and ankles). We evaluated the marker-less system against a marker-based system in terms of differences in joint position (Euclidean distance), detection of gait events (e.g., heel strike and toe-off), spatiotemporal parameters (e.g., step length, time), kinematic parameters (e.g., hip and knee extension-flexion), and inter-trial reliability for kinematic parameters.

RESULTS

The marker-less system was able to estimate the three-dimensional position of joint centers with a mean difference of 13.1 mm (SD = 10.2 mm). 99% of the estimated gait events were estimated within 10 ms of the corresponding reference values. Estimated spatiotemporal parameters showed zero bias. The mean and standard deviation of the differences of the estimated kinematic parameters varied by parameter (for example, the mean and standard deviation for knee extension flexion angle were -3.0° and 2.7°). Inter-trial reliability of the measured parameters was similar to that of the marker-based references.

SIGNIFICANCE

The developed marker-less system can measure the spatiotemporal parameters within the range of the minimum detectable changes obtained using the marker-based reference system. Moreover, except for hip extension flexion, the system showed promising results in terms of several kinematic parameters.

Pose2Sim: An End-to-End Workflow for 3D Markerless Sports Kinematics—Part 2: Accuracy

Two-dimensional deep-learning pose estimation algorithms can suffer from biases in joint pose localizations, which are reflected in triangulated coordinates, and then in 3D joint angle estimation. Pose2Sim, our robust markerless kinematics workflow, comes with a physically consistent OpenSim skeletal model, meant to mitigate these errors. Its accuracy was concurrently validated against a reference marker-based method. Lower-limb joint angles were estimated over three tasks (walking, running, and cycling) performed multiple times by one participant. When averaged over all joint angles, the coefficient of multiple correlation (CMC) remained above 0.9 in the sagittal plane, except for the hip in running, which suffered from a systematic 15° offset (CMC = 0.65), and for the ankle in cycling, which was partially occluded (CMC = 0.75). When averaged over all joint angles and all degrees of freedom, mean errors were 3.0°, 4.1°, and 4.0°, in walking, running, and cycling, respectively; and range of motion errors were 2.7°, 2.3°, and 4.3°, respectively. Given the magnitude of error traditionally reported in joint angles computed from a marker-based optoelectronic system, Pose2Sim is deemed accurate enough for the analysis of lower-body kinematics in walking, cycling, and running.

Agreement Between Sagittal Foot and Tibia Angles During Running Derived From an Open-Source Markerless Motion Capture Platform and Manual Digitization

Several open-source platforms for markerless motion capture offer the ability to track 2-dimensional (2D) kinematics using simple digital video cameras. We sought to establish the performance of one of these platforms, DeepLabCut. Eighty-four runners who had sagittal plane videos recorded of their left lower leg were included in the study. Data from 50 participants were used to train a deep neural network for 2D pose estimation of the foot and tibia segments. The trained model was used to process novel videos from 34 participants for continuous 2D coordinate data. Overall network accuracy was assessed using the train/test errors. Foot and tibia angles were calculated for 7 strides using manual digitization and markerless methods. Agreement was assessed with mean absolute differences and intraclass correlation coefficients. Bland-Altman plots and paired t tests were used to assess systematic bias. The train/test errors for the trained network were 2.87/7.79 pixels, respectively (0.5/1.2 cm). Compared to manual digitization, the markerless method was found to systematically overestimate foot angles and underestimate tibial angles (P < .01, d = 0.06-0.26). However, excellent agreement was found between the segment calculation methods, with mean differences ≤1° and intraclass correlation coefficients ≥.90. Overall, these results demonstrate that open-source, markerless methods are a promising new tool for analyzing human motion.

Applications and limitations of current markerless motion capture methods for clinical gait biomechanics

BACKGROUND

Markerless motion capture has the potential to perform movement analysis with reduced data collection and processing time compared to marker-based methods. This technology is now starting to be applied for clinical and rehabilitation applications and therefore it is crucial that users of these systems understand both their potential and limitations. This literature review aims to provide a comprehensive overview of the current state of markerless motion capture for both single camera and multi-camera systems. Additionally, this review explores how practical applications of markerless technology are being used in clinical and rehabilitation settings, and examines the future challenges and directions markerless research must explore to facilitate full integration of this technology within clinical biomechanics.

METHODOLOGY

A scoping review is needed to examine this emerging broad body of literature and determine where gaps in knowledge exist, this is key to developing motion capture methods that are cost effective and practically relevant to clinicians, coaches and researchers around the world. Literature searches were performed to examine studies that report accuracy of markerless motion capture methods, explore current practical applications of markerless motion capture methods in clinical biomechanics and identify gaps in our knowledge that are relevant to future developments in this area.

RESULTS

Markerless methods increase motion capture data versatility, enabling datasets to be re-analyzed using updated pose estimation algorithms and may even provide clinicians with the capability to collect data while patients are wearing normal clothing. While markerless temporospatial measures generally appear to be equivalent to marker-based motion capture, joint center locations and joint angles are not yet sufficiently accurate for clinical applications. Pose estimation algorithms are approaching similar error rates of marker-based motion capture, however, without comparison to a gold standard, such as bi-planar videoradiography, the true accuracy of markerless systems remains unknown.

CONCLUSIONS

Current open-source pose estimation algorithms were never designed for biomechanical applications, therefore, datasets on which they have been trained are inconsistently and inaccurately labelled. Improvements to labelling of open-source training data, as well as assessment of markerless accuracy against gold standard methods will be vital next steps in the development of this technology.

A SWOT Analysis of Portable and Low-Cost Markerless Motion Capture Systems to Assess Lower-Limb Musculoskeletal Kinematics in Sport

Markerless motion capture systems are promising for the assessment of movement in more real world research and clinical settings. While the technology has come a long way in the last 20 years, it is important for researchers and clinicians to understand the capacities and considerations for implementing these types of systems. The current review provides a SWOT (Strengths, Weaknesses, Opportunities, and Threats) analysis related to the successful adoption of markerless motion capture technology for the assessment of lower-limb musculoskeletal kinematics in sport medicine and performance settings. 31 articles met the a priori inclusion criteria of this analysis. Findings from the analysis indicate that the improving accuracy of these systems via the refinement of machine learning algorithms, combined with their cost efficacy and the enhanced ecological validity outweighs the current weaknesses and threats. Further, the analysis makes clear that there is a need for multidisciplinary collaboration between sport scientists and computer vision scientists to develop accurate clinical and research applications that are specific to sport. While work remains to be done for broad application, markerless motion capture technology is currently on a positive trajectory and the data from this analysis provide an efficient roadmap toward widespread adoption.

Biomechanical Analysis of the Throwing Athlete and Its Impact on Return to Sport

Throwing sports remain a popular pastime and frequent source of musculoskeletal injuries, particularly those involving the shoulder and elbow. Biomechanical analyses of throwing athletes have identified pathomechanic factors that predispose throwers to injury or poor performance. These factors, or key performance indicators, are an ongoing topic of research, with the goals of improved injury prediction, prevention, and rehabilitation. Important key performance indicators in the literature to date include shoulder and elbow torque, shoulder rotation, kinetic chain function (as measured by trunk rotation timing and hip-shoulder separation), and lower-extremity mechanics (including stride characteristics). The current gold standard for biomechanical analysis of the throwing athlete involves marker-based 3-dimensional) video motion capture. Emerging technologies such as marker-less motion capture, wearable technology, and machine learning have the potential to further refine our understanding. This review will discuss the biomechanics of throwing, with particular attention to baseball pitching, while also delineating methods of modern throwing analysis, implications for clinical orthopaedic practice, and future areas of research interest.

Level of Evidence

V, expert opinion.

Modified Functional Reach Test: Upper-Body Kinematics and Muscular Activity in Chronic Stroke Survivors

Effective control of trunk muscles is fundamental to perform most daily activities. Stroke affects this ability also when sitting, and the Modified Functional Reach Test is a simple clinical method to evaluate sitting balance. We characterize the upper body kinematics and muscular activity during this test. Fifteen chronic stroke survivors performed twice, in separate sessions, three repetitions of the test in forward and lateral directions with their ipsilesional arm. We focused our analysis on muscles of the trunk and of the contralesional, not moving, arm. The bilateral activations of latissimi dorsi, trapezii transversalis and oblique externus abdominis were left/right asymmetric, for both test directions, except for the obliquus externus abdominis in the frontal reaching. Stroke survivors had difficulty deactivating the contralesional muscles at the end of each trial, especially the trapezii trasversalis in the lateral direction. The contralesional, non-moving arm had muscular activations modulated according to the movement phases of the moving arm. Repeating the task led to better performance in terms of reaching distance, supported by an increased activation of the trunk muscles. The reaching distance correlated negatively with the time-up-and-go test score.

A Quality Control Check to Ensure Comparability of Stereophotogrammetric Data between Sessions and Systems

Optoelectronic stereophotogrammetric (SP) systems are widely used in human movement research for clinical diagnostics, interventional applications, and as a reference system for validating alternative technologies. Regardless of the application, SP systems exhibit different random and systematic errors depending on camera specifications, system setup and laboratory environment, which hinders comparing SP data between sessions and across different systems. While many methods have been proposed to quantify and report the errors of SP systems, they are rarely utilized due to their complexity and need for additional equipment. In response, an easy-to-use quality control (QC) check has been designed that can be completed immediately prior to a data collection. This QC check requires minimal training for the operator and no additional equipment. In addition, a custom graphical user interface ensures automatic processing of the errors in an easy-to-read format for immediate interpretation. On initial deployment in a multicentric study, the check (i) proved to be feasible to perform in a short timeframe with minimal burden to the operator, and (ii) quantified the level of random and systematic errors between sessions and systems, ensuring comparability of data in a variety of protocol setups, including repeated measures, longitudinal studies and multicentric studies.

Pose2Sim: An End-to-End Workflow for 3D Markerless Sports Kinematics-Part 1: Robustness

Being able to capture relevant information about elite athletes' movement "in the wild" is challenging, especially because reference marker-based approaches hinder natural movement and are highly sensitive to environmental conditions. We propose Pose2Sim, a markerless kinematics workflow that uses OpenPose 2D pose detections from multiple views as inputs, identifies the person of interest, robustly triangulates joint coordinates from calibrated cameras, and feeds those to a 3D inverse kinematic full-body OpenSim model in order to compute biomechanically congruent joint angles. We assessed the robustness of this workflow when facing simulated challenging conditions: (Im) degrades image quality (11-pixel Gaussian blur and 0.5 gamma compression); (4c) uses few cameras (4 vs. 8); and (Cal) introduces calibration errors (1 cm vs. perfect calibration). Three physical activities were investigated: walking, running, and cycling. When averaged over all joint angles, stride-to-stride standard deviations lay between 1.7° and 3.2° for all conditions and tasks, and mean absolute errors (compared to the reference condition-Ref) ranged between 0.35° and 1.6°. For walking, errors in the sagittal plane were: 1.5°, 0.90°, 0.19° for (Im), (4c), and (Cal), respectively. In conclusion, Pose2Sim provides a simple and robust markerless kinematics analysis from a network of calibrated cameras.