Share this article on:

Accuracy and Reliability of 10 Pedometers for Measuring Steps over a 400-m Walk

SCHNEIDER, PATRICK L.; CROUTER, SCOTT E.; LUKAJIC, OLIVERA; BASSETT, DAVID R. JR.

Medicine & Science in Sports & Exercise: October 2003 - Volume 35 - Issue 10 - p 1779-1784
doi: 10.1249/01.MSS.0000089342.96098.C4
APPLIED SCIENCES: Physical Fitness and Performance

SCHNEIDER, P. L., S. E. CROUTER, O. LUKAJIC, and D. R. BASSETT, JR. Accuracy and Reliability of 10 Pedometers for Measuring Steps over a 400-m Walk. Med. Sci. Sports Exerc., Vol. 35, No. 10, pp. 1779–1784, 2003.

Purpose The purpose of this study was to determine the accuracy and reliability of the following electronic pedometers for measuring steps: Freestyle Pacer Pro (FR), Kenz Lifecorder (KZ), New Lifestyles NL-2000 (NL), Omron HJ-105 (OM), Oregon Scientific PE316CA (OR), Sportline 330 (SL330) and 345 (SL345), Walk4Life LS 2525 (WL), Yamax Skeletone EM-180 (SK), and the Yamax Digi-Walker SW-701 (DW).

Methods Ten males (34.7 ± 12.6 yr) (mean ± SD) and 10 females (43.1 ± 19.9 yr) ranging in BMI from 19.8 to 33.6 kg·m−2 walked 400-m around an outdoor track while wearing two pedometers of the same model (one on the right and left sides of the body) for each of 10 models. Four pedometers of each model were assessed in this fashion. The actual steps taken were tallied by a researcher.

Results The KZ, NL, and DW were the most accurate in counting steps, displaying values that were within ±3% of the actual steps taken, 95% of the time. The SL330 and OM were the least accurate, displaying values that were within ±37% of the actual steps, 95% of the time. The reliability within a single model (Cronbach’s alpha) was >0.80 for all pedometers with the exception of the SL330. The intramodel reliability was exceptionally high (>0.99) in the KZ, OM, NL, and the DW.

Conclusion Due to the variation that exists among models in regard to the internal mechanism and sensitivity, not all pedometers count steps accurately. Thus, it is important for researchers who use pedometers to assess physical activity to be aware of their accuracy and reliability.

Department of Health and Exercise Science, University of Tennessee, Knoxville, TN

Address for correspondence: Patrick L. Schneider, Department of Health and Exercise Science, The University of Tennessee, 1914 Andy Holt Avenue, Knoxville, TN 37996; E-mail: pschnei1@utk.edu.

Submitted for publication February 2003.

Accepted for publication May 2003.

Prospective epidemiological studies support the belief that a physically active lifestyle can lower the risk of developing various chronic diseases such as coronary artery disease, Type 2 diabetes mellitus, hypertension, and obesity (1). With an emphasis on promoting a physically active lifestyle, numerous studies have examined the practicality and feasibility of using the pedometer as a tool for measuring physical activity levels (10,11,17,22,23,28,29). Pedometers are devices that are typically worn at the waist and are capable of counting steps. Some models also calculate distance and estimate energy expenditure. Pedometers are a means of objectively measuring ubiquitous, ambulatory activity as well as many types of structured physical activities (24).

The three main areas in which pedometer models may differ are cost, mechanism, and sensitivity of the device. There is considerable variation in the cost of a pedometer, which can range anywhere from $10 to $200. Given the wide range of costs of various pedometers, a less expensive pedometer becomes an attractive option for those wanting to do large-scale studies. Thus, it would be of interest to determine whether some of the less expensive pedometers are as accurate as some of the more costly versions. The internal mechanism is also a distinguishing point among the various brands and models of pedometers. There are three primary mechanisms by which pedometers function. The first type uses a spring-suspended horizontal lever arm that moves up and down in response to the hip’s vertical accelerations. This movement opens and closes an electrical circuit; the lever arm makes an electrical contact (metal-on-metal contact) and a step is registered. The second type of mechanism is a magnetic reed proximity switch. With this mechanism, a magnet connected to a spring-suspended horizontal lever arm within the pedometer moves up and down with each vertical acceleration of the hip. The magnetic field triggers a proximity switch encased in a glass cylinder and a step is counted. The third type uses an accelerometer-type mechanism consisting of a horizontal beam and a piezoelectric crystal. Pedometers using this particular mechanism can distinguish between differing intensities of exercise when estimating caloric expenditure. Finally, pedometers may also differ in their sensitivity, which is a function of the vertical acceleration “threshold” needed to trigger a step. Although this issue is related to the mechanism, the sensitivity of the internal mechanisms of different pedometers can vary as can the quality of the mechanism itself.

In general, pedometers are most accurate in counting steps, less accurate in calculating distance, and even less accurate at estimating energy expenditure (2,4). Because steps are the most direct expression of what the pedometer actually measures (25), most researchers recommend reporting pedometer data as steps (4,25). A previous study conducted by Bassett et al. (2) assessed the accuracy of five electronic pedometers in measuring distance walked and steps taken on a sidewalk course and found that pedometers varied significantly in the pedometer-calculated distance over 4.88 km. Due to the potential for such inaccuracies between pedometer models, it is essential that pedometers be tested for accuracy.

In addition to the variation that exists between models, it is possible for discrepancies to exist within a particular pedometer model (intramodel reliability). Given the potential for differences in manufacturing tolerances and design specifications, it is conceivable for devices of the same model to differ significantly in steps counted. Thus, it is evident that the reliability of pedometers within a particular model should be assessed.

Considering the fact that a great number of pedometer models have been introduced in recent years and that variability exists not only in the cost but also in the mechanism and sensitivity among pedometers, it would be beneficial to determine the accuracy of a variety of pedometers. In addition, the only multibrand comparison was carried out in 1996 (2), and none of the pedometers that were assessed at that time are currently available. Therefore, the purpose of this study was to determine the accuracy and reliability of 10 electronic pedometers for counting steps.

Back to Top | Article Outline

METHODS

Pedometers.

Ten models of commercially available electronic pedometers were assessed in this study: Freestyle Pacer Pro (FR), Kenz Lifecorder (KZ), New Lifestyles NL-2000 (NL), Omron HJ-105 (OM), Oregon Scientific PE316CA (OR), Sportline 330 (SL330) and 345 (SL345), Walk4Life LS 2525 (WL), Yamax Skeletone EM-180 (SK), and the Yamax Digi-Walker SW-701 (DW). Pedometer characteristics are presented in Table 1.

TABLE 1

TABLE 1

Back to Top | Article Outline

Subjects.

Ten male and 10 female adults (22–69 yr of age) volunteered to participate in the study. The procedures were reviewed and approved by the Institutional Review Board at the University of Tennessee. Each subject completed a Physical Activity Readiness Questionnaire (PAR-Q) and signed a written informed consent before participating in the study. Height was measured without shoes using a stadiometer and weight was also assessed without shoes in light clothing using a calibrated physician’s scale. In addition, each subject’s stride length was determined before participation in the study. To determine stride length, subjects were asked to take 20 strides at their normal walking pace on an outdoor track. The total distance was divided by 20, to calculate average stride length. Physical characteristics of the subjects are presented in Table 2.

TABLE 2

TABLE 2

The subjects then took part in a series of walks around a 400-m outdoor track. Pedometer placement was standardized by placing it on the belt or waistband, in the mid-line of the thigh, consistent with the manufacturers’ recommendations. Pedometers with a variable sensitivity switch (OM, OR) were always placed in the middle setting. Devices of the same model were worn on both the right and left sides of the body while the subject walked a lap around the 400-m track. Then, two other devices of the same model were tested during a subsequent lap around the track to determine intramodel reliability. This procedure was repeated until four pedometers representing each of the 10 models were tested. The actual steps taken were determined by a researcher using a hand-tally counter. The researcher walked behind the subject to avoid influencing the subject’s pace. Each subject walked at his/her own normal walking speed, and the amount of time it took to complete the lap was measured to calculate walking speed. The testing took place over the course of 1–4 d, and the subjects wore the same pair of shoes for all trials.

Back to Top | Article Outline

Statistical analyses.

All analyses were performed using SPSS 11.0.1 for Windows (SPSS Inc., Chicago IL). For all analyses, an alpha of 0.05 was used to denote statistical significance. A two-way repeated measures ANOVA (model × side) was used to assess differences between pedometers worn on the right and left sides of the body and to determine whether significant differences existed between pedometer models. Paired t-tests were used to determine whether the pedometer-estimated steps were significantly different from the actual steps taken. Cronbach’s alpha was used to assess the intramodel reliability among pedometers of the same model. An alpha value of 0.80 was used to denote statistically significant intramodel reliability (12).

Bland-Altman (5) plots were constructed to show the dispersion of the individual pedometer error scores around zero. This is a widely accepted technique to show the accuracy of biomedical devices (27). In this manner, the mean error score can be illustrated, and the 95% prediction interval (i.e., 95% confidence interval for the individual observations) can also be shown. Individual error scores that have a tight prediction interval around zero signify a more accurate device.

Back to Top | Article Outline

RESULTS

The average self-selected walking speed was 96.5 m·min−1 and ranged from 77.3 to 114.9 m·min−1. There was no significant difference (P > 0.05) between pedometers worn on the right and left sides of the body. However, there was a significant difference (P < 0.05) among the 10 pedometer models. To determine accuracy, an error score (actual steps minus pedometer steps) was computed and compared with zero. Individual error scores of zero would indicate that there was no difference between the estimated and actual steps taken, whereas negative scores represent overestimations and positive scores represent underestimations. Figure 1 displays the mean error scores between the actual steps taken and the pedometer-measured steps. The OR significantly overestimated the actual number of steps taken (P < 0.05). The SL330 significantly underestimated the actual number of steps (P < 0.05). The remaining pedometers had mean values that neither over- nor underestimated the true number of steps taken. However, as we will show, three models (NL, DW, and KZ) were clearly more accurate than the other models.

FIGURE 1

FIGURE 1

Table 3 displays the mean error scores and the 95% prediction intervals. Figure 2 shows the Bland-Altman plots for various pedometer models. For convenience, the y-axes are standardized to highlight the differences in accuracy between pedometers. The NL, DW, and KZ models were exceptionally accurate, having 95% prediction intervals that were within ±17 steps (of an average of 513) from zero. The WL, SK, SL345, FR, and OR were moderately accurate, having 95% prediction intervals that were within ±100 steps from zero. Finally, the OM and SL330 were the least accurate, having 95% prediction intervals that were within ±188 steps from zero.

TABLE 3

TABLE 3

FIGURE 2

FIGURE 2

As shown in Table 4, the intramodel reliability (among four pedometers of a single model) was >0.80 in all pedometers with the exception of the SL330. The intramodel reliability was exceptionally high (>0.99) in the KZ, OM, NL, and the DW. However, despite high reliability, the OM had poor accuracy.

TABLE 4

TABLE 4

Table 5 displays the mean difference in actual distance walked and the pedometer-calculated distance. Negative scores represent overestimations and positive scores indicate underestimations by the pedometer. There were significant differences (P < 0.05) in five of the six pedometers that calculated distance, with the SL345 approximating distance more closely than all other models. To determine accuracy in calculating distance, the estimated distance from the pedometer was subtracted from the actual distance walked, and this difference score was compared with zero.

TABLE 5

TABLE 5

Back to Top | Article Outline

DISCUSSION

In the current study, 8 of the 10 pedometers tested yielded mean values that were not significantly different from the actual steps taken at self-selected walking speeds. However, the KZ, NL, and DW were the only pedometers accurate to within ±3% of the actual steps taken, 95% of the time. These three pedometers differed from the actual steps taken by less than 17 steps during a 400-m walk (totaling about 513 steps). Interestingly, these pedometers are all made in Japan, and they all met the Japanese Industrial Standard set by the Ministry of Industry and Trading regulations (7), which requires less than a 3% margin of error (3 steps of 100). The intramodel reliability for the KZ, NL, and DW was also very high (>0.99), suggesting adequate quality control and tight manufacturing tolerances. These pedometers would appear to be suitable for use in research studies.

Four of the other pedometers (WL, SK, SL345, and FR) had moderate accuracy. They displayed values that were within ±20% of the actual steps taken, 95% of the time. These four models predicted the actual steps to within ±100 steps during a 400-m walk.

Three pedometer models were judged to be unacceptable under the conditions in which they were tested. The OR consistently tended to overestimate the actual number of steps, possibly due to a high sensitivity for recording steps. As a result, the OR significantly overestimated the mean number of steps (P < 0.05). The SL330 and OM were the least accurate pedometers; they displayed values that were within ±37% of the actual steps taken, 95% of the time. These two models predicted the actual steps to within ±188 steps during a 400-m walk. Only the SL330 significantly underestimated the mean number of steps taken. However, in both of these pedometers, there was a tendency to grossly underestimate steps, particularly in obese subjects (BMI ≥ 30 kg·m−2). Thus, these pedometers would be poor choices for use with obese individuals.

There have been conflicting results regarding pedometer accuracy in obese individuals (BMI ≥ 30 kg·m−2). Shephard et al. (18) reported that the Sportline pedometer was less accurate in obese subjects compared with nonobese subjects as evidenced by greater mean absolute error scores in the obese. However, Swartz et al. (19) demonstrated that the Yamax SW-200 pedometer was accurate in lean, overweight, and obese subjects. Their results are consistent with those in the current study in showing that the Yamax SW-701 was accurate over a wide range of BMI (18.6–33.6 kg·m−2). (These two models use the same internal mechanism for recording steps; they differ only in the functions that are displayed.) Some other pedometers (OM and SL330) grossly underestimated steps taken by obese subjects. It should be noted, however, that the OM was accurate in individuals with both normal BMI (18–24.9 kg·m−2) and those classified as overweight (25–29.9 kg·m−2). It is possible that in obese individuals, especially those with a significant amount of abdominal fat, the angle of the pedometer when clipped to the belt or waistband compromises its ability to count steps accurately.

Although the accuracy of pedometers for assessing distance was also examined, the results should be interpreted with caution. To calculate distance, the following formula is used:EQUATION

Pedometer models differ in the precision with which stride length can be entered. For example, some pedometers allow the operator to input stride length to the nearest inch, whereas others only allow stride length to be input to the nearest 0.25 ft. Furthermore, only one stride length can be programmed into a pedometer, so if a subject changes his/her stride length after the calibration procedure, the distance estimated will be inaccurate. For most pedometers, distance was underestimated because the subjects had longer strides (and thus took fewer steps) during the 400-m track walk than in the 20-step calibration procedure. The SL345 was the only pedometer that did not significantly underestimate distance. However, this is because the SL345 overestimated the number of steps taken. Because most researchers choose to report pedometer data as steps, it would be inappropriate to conclude that the SL345 is the most accurate pedometer.

Recent U.S. physical activity recommendations have encouraged Americans to accumulate at least 30 min of moderate physical activity on most, preferably all, days of the week (14,26). Dr. Hatano of Japan has proposed an alternative recommendation. He believes that taking 10,000 step·d−1 would be effective for cardiovascular disease prevention (7). Hatano (8) has found that increased ambulatory activity is associated with lower levels of blood pressure and subcutaneous fat. Hatano also estimated that a 60-kg Japanese male would expend at least 333 kcal·d−1 in walking 10,000 step·d−1. Previous research indicates that this amount (>2000 kcal·wk−1) appears to be protective against heart attacks (13). In addition, longitudinal studies have demonstrated that walking 10,000 step·d−1 results in improvements in cardiovascular disease risk factors in sedentary, at-risk populations (11,20).

Electronic pedometers have gained widespread acceptance among physical activity researchers over the past decade (4), and the use of pedometers has become increasingly popular with the continued publicity of the 10,000 step·d−1 recommendation (9,15). Thus, it is essential that the pedometer display accurate results. Wilde et al. (28) showed that by adding a 30-min walk to their daily routine, subjects increased their step counts from 7,220 to 10,030 step·d−1. This study indicates that for sedentary women including a daily 30-min walk in their schedule will generally allow them to meet both physical activity recommendations, suggesting that the two are roughly equivalent. However, pedometer accuracy can have a significant impact on the number of steps counted over the course of a day. A study conducted by Tudor-Locke et al. (21) compared the Yamax SW-200 with the CSA model 7164 Actigraph (a research grade accelerometer) and showed an 1800 step·d−1difference between the two types of step counters. It was suggested that this difference is due to variations in the sensitivity of the two devices. Thus, because 1800 steps may represent a relatively large portion of a person’s daily step count and because it is possible for two step-counters to differ by this amount, it is essential that the pedometer accurately report steps taken.

The electronic pedometer has limitations as a research tool (6) including its inability to provide information related to nonambulatory activity (i.e., cycling, weight training, and swimming). Nevertheless, it does have some distinguishing characteristics that make it useful as a motivational tool for promoting physical activity. First, the pedometer continuously monitors physical activity whether it is incidental or intentional. Studies have shown recall of ubiquitous, moderate activities (e.g., walking) is less accurate than recall of structured, vigorous activities (3,16). Thus, a device that is capable of continuously monitoring ambulatory activity would be beneficial for those interested in the assessment of physical activity. Second, the pedometer can serve as a feedback tool, providing immediate information on accumulated ambulatory activity and serving as a reminder to be physically active. Although earlier criticisms of pedometers included their inability to store data (6), two of the pedometers assessed in this study, the NL and KZ pedometers are capable of storing up to 7 and 42 d worth of data, respectively, in 1-d epochs. This makes these pedometers an appealing option for researchers who want to eliminate the potential bias of subjects recording their own data.

This study is in agreement with the study conducted by Bassett et al. (2) in demonstrating that considerable variation in accuracy exists among pedometers. Likewise, both studies indicated that a Yamax brand pedometer (DW-500 or SW-701) was one of the best in regard to its accuracy and reliability. However, other pedometers that were unavailable at the time of the previous study have been shown to very accurate and reliable as well (NL and KZ). An ideal objective instrument is one that is low in cost, easy to administer to large groups, unobtrusive to the subject, and accurate (6). Although most pedometers displayed mean step scores that were not significantly different from the actual steps taken at self-selected walking speeds, some were distinctly better than others as indicated by individual error scores that had a tight prediction interval around zero. Due to the variation that exists among pedometers in regard to the manufacturing specifications, mechanism and sensitivity of each device, not all pedometers count steps accurately. Thus, it is important for researchers who use pedometers to assess physical activity to know the accuracy and reliability of their instruments.

The authors would like to thank Cary Springer of the UT statistical consulting services for performing the data analyses in this study.

No financial support was received from the pedometer manufacturers, importers, or retailers.

Back to Top | Article Outline

REFERENCES

1. American College of Sports Medicine. ACSM’s Guidelines for Exercise Testing and Prescription, 6th Ed. Philadelphia: Lippincott Williams & Wilkins, 2000, pp. 5, 7.
2. Bassett, D. R., B. E. Ainsworth, S. R. Leggett, et al. Accuracy of five electronic pedometers for measuring distance walked. Med. Sci. Sports Exerc. 28: 1071–1077, 1996.
3. Bassett, D. R., A. L. Cureton, and B. E. Ainsworth. Measurement of daily walking distance-questionnaire versus pedometer. Med. Sci. Sports Exerc. 32: 1018–1023, 2000.
4. Bassett, D. R., and S. J. Strath. Use of pedometers to assess physical activity. In: Physical Activity Assessments for Health-Related Research, G. J. Welk (Ed.). Champaign, IL: Human Kinetics, 2002, pp. 166–170.
5. Bland, J. M., and D. G. Altman. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1: 301–310, 1986.
6. Freedson, P. S., and K. Miller. Objective monitoring of physical activity using motion sensors. Res. Q. Exerc. Sport 71: 21–29, 2000.
7. Hatano, Y. Use of the pedometer for promoting daily walking exercise. ICHPER J. 29: 4–8, 1993.
8. Hatano, Y. Prevalence and use of pedometer. Res. J. Walking 1: 45–54, 1997.
9. Hellmich, N. Journey to better fitness starts with 10,000 steps. USA Today June 29:1B, 1999.
10. Iwane, M., M. Arita, S. Tomimoto, et al. Walking 10,000 steps/day or more reduces blood pressure and sympathetic nerve activity in mild essential hypertension. Hypertens. Res. 23: 573–580, 2000.
11. Moreau, K. L., R. Degarmo, J. Langley, et al. Increasing daily walking lowers blood pressure in postmenopausal women with borderline to stage 1 hypertension. Med. Sci. Sports Exerc. 33: 1825–1831, 2001.
12. Nunnally, J. C. Assessment of reliability. In:Psychometric Theory. New York: McGraw-Hill, 1978, p. 245.
13. Paffenbarger, R. S., A. L. Wing, and R. T. Hyde. Physical activity as an index of heart attack risk in college alumni. Am. J. Epidemiol. 108: 161–175, 1978.
14. Pate, R. R., M. Pratt, S. M. Blair, et al. Physical activity and public health: a recommendation from the Centers for Disease Control and Prevention and the American College of Sports Medicine. JAMA 273: 402–407, 1995.
15. Quittner, J. High-tech walking. Time July 24, 2000, p. 77.
16. Richardson, M. T., A. S. Leon, D. R. Jacobs, B. E. Ainsworth, and R. Serfass. Comprehensive evaluation of the Minnesota Leisure-Time Physical Activity Questionnaire. J. Clin. Epidemiol. 47: 271–281, 1994.
17. Sequeira, M. M., M. Rickenbach, V. Wietlisbach, B. Tullen, and Y. Schutz. Physical activity assessment using a pedometer and its comparison with a questionnaire in a large population survey. Am. J. Epidemiol. 142: 989–999, 1995.
18. Shepherd, E. F., E. Toloza, C. D. Mcclung, and T. P. Schalzried. Step activity monitor: increased accuracy in quantifying ambulatory activity. J. Orthop. Res. 17: 703–708, 1999.
19. Swartz, A. M., D. R. Bassett, B. Moore, D. L. Thompson, and S. J. Strath. Accuracy of the electronic pedometer in obese, overweight and normal weight adults. Int. J. Sports Med. (in press).
20. S wartz, A. M., and D. L. T hompson. Increasing daily walking improves glucose tolerance in overweight women. Prev. Med. (in press).
21. Tudor-Locke, C., B. E. Ainsworth, R. W. Thompson, and C. E. Matthews. Comparison of pedometer and accelerometer measures of free-living physical activity. Med. Sci. Sports Exerc. 34: 2045–2051, 2002.
22. Tudor-Locke, C., B. E. Ainsworth, M. C. Whitt, R. W. Thompson, C. L. Addy, and D. A. Jones. The relationship between pedometer-determined ambulatory activity and body composition variables. Int. J. Obes. Relat. Metab. Disord. 25: 1571–1578, 2001.
23. Tudor-Locke, C., R. C. Bell, A. M. Myers, S. B. Harris, N. Lauzon, and N. W. Rodger. Pedometer-determined ambulatory activity in individuals with type 2 diabetes. Diabetes Res. Clin. Pract. 55: 191–199, 2002.
24. Tudor-Locke, C., and A. M. Myers. Challenges and opportunities for measuring physical activity in sedentary adults. Res. Q. Exerc. Sport 31: 91–100, 2001.
25. Tudor-Locke, C. E., and A. M. Myers. Methodological considerations for researchers and practitioners using pedometers to measure physical (ambulatory) activity. Res. Q. Exerc. Sport 72: 1–12, 2001.
26. U.S. Department of Health and Human Services. Physical Activity and Health: A Report of the Surgeon General. Atlanta, GA: U S Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, 1996, p. 37.
27. White, W. B., P. Lund-Johansen, and P. Omvik. Assessment of four ambulatory blood pressure monitors and measurements by clinicians versus intraarterial blood pressure at rest and during exercise. Am. J. Cardiol. 65: 60–66, 1990.
28. Wilde, B. E., C. L. Sidman, and C. B. Corbin. A 10,000-step count as a physical activity target for sedentary women. Res. Q. Exerc. Sport 72: 411–414, 2001.
29. Yamanouchi, K., T. Shinozaki, K. Chikada, et al. Daily walking combined with diet therapy is a useful means for obese NIDDM patients not only to reduce body weight but also to improve insulin sensitivity. Diabetes Care 18: 775–778, 1995.
Keywords:

STEP COUNTER; PHYSICAL ACTIVITY; MOTION SENSOR; WALKING

©2003The American College of Sports Medicine