Can Machine Learning Enhance Computer Vision-Predicted Wrist Kinematics Determined from a Low-Cost Motion Capture System?

Joel Carriere, Michele L. Oliver, Andrew Hamilton-Wright, Calvin Young, Karen D. Gordon

Wrist kinematics can provide insight into the development of repetitive strain injuries, which is important particularly in workplace environments. The emergence of markerless motion capture is beginning to revolutionize kinematic assessment such that it can be conducted outside of the laboratory. The purpose of this work was to apply open-source software (OSS) and machine learning (ML) by using DeepLabCut (OSS) to determine anatomical landmark locations and a variety of regression algorithms and neural networks to predict wrist angles. Sixteen participants completed a series of flexion–extension (FE) and radial–ulnar (RUD) range-of-motion (ROM) trials that were captured using a 13-camera VICON optical motion capture system (i.e., the gold standard), as well as 4 GoPro video cameras. DeepLabCut (version 2.3.3) was used to generate a 2D dataset of anatomical landmark coordinates from video obtained from one obliquely oriented GoPro video camera. Anipose (version 1.0.1) was used to generate a 3D dataset from video obtained from four GoPro cameras. Anipose and various ML algorithms were used to determine RUD and FE wrist angles. The algorithms were trained and tested using a 75%:25% data split with four folds for the 2D and 3D datasets. Of the seven ML techniques applied, deep neural networks resulted in the highest prediction accuracy (5.5) for both the 2D and 3D datasets. This was substantially higher than the wrist angle prediction accuracy provided by Anipose (FE−99; RUD−25.2). We found that, excluding cubic regression, all other studied algorithms exhibited reasonable performance that was similar to that reported by previous authors, showing that it is indeed possible to predict wrist kinematics using a low-cost motion capture system. In agreement with past research, the increased MAE for FE is thought to be due to a larger ROM.