Validity and acceptability of wearable devices for monitoring step-count and activity minutes among people with multiple sclerosis

Abstract

Multiple wearable devices that purport to measure physical activity are widely available to consumers. While they may support increases in physical activity among people with multiple sclerosis (MS) by providing feedback on their performance, there is little information about the validity and acceptability of these devices. Providing devices that are perceived as inaccurate and difficult to use may have negative consequences for people with MS, rather than supporting participation in physical activity. The aim of this study was, therefore, to assess the validity and acceptability of commercially available devices for monitoring step-count and activity time among people with MS. Nineteen ambulatory adults with MS [mean (SD) age 52.1 (11.9) years] participated in the study. Step-count was assessed using five commercially available devices (Fitbit Alta, Fitbit Zip, Garmin Vivofit 4, Yamax Digi Walker SW200, and Letscom monitor) and an activPAL3μ while completing nine everyday activities. Step-count was also manually counted. Time in light activity, moderate-to-vigorous activity, and total activity were measured during activities using an Actigraph GT3X accelerometer. Of the 19 participants who completed the validity study, fifteen of these people also wore the five commercially available devices for three consecutive days each, and participated in a semi-structured interview regarding their perception of the acceptability of the monitors. Mean percentage error for step-count ranged from 12.1% for the Yamax SW200 to −112.3% for the Letscom. Mean step-count as manually determined differed to mean step-count measured by the Fitbit Alta (p = 0.002), Garmin vivofit 4 (p < 0.001), Letscom (p < 0.001) and the research standard device, the activPAL3μ (p < 0.001). However, 95% limits of agreement were smallest for the activPAL3μ and largest for the Fitbit Alta. Median percentage error for activity minutes was 52.9% for the Letscom and 100% for the Garmin Vivofit 4 and Fitbit Alta compared to minutes in total activity. Three inductive themes were generated from participant accounts: Interaction with device; The way the device looks and feels; Functionality. In conclusion, commercially available devices demonstrated poor criterion validity when measuring step-count and activity time in people with MS. This negatively affected the acceptability of devices, with perceived inaccuracies causing distrust and frustration. Additional considerations when designing devices for people with MS include an appropriately sized and lit display and ease of attaching and charging devices.