Study Design. Prospective cohort study.
Objective. To determine if a job-specific pre-employment functional assessment (PEFA) predicts musculoskeletal injury risk in healthy mineworkers.
Summary of Background Data. Traditional methods of pre-employment screening, including radiography and medical screenings, are not valid predictors of occupational musculoskeletal injury risk. Short-form job-specific functional capacity evaluations are increasing in popularity, despite limited evidence of their ability to predict injury risk in healthy workers.
Methods. Participants were recruited from an Australian coal mine between 2002 and 2009 as part of the hiring process. At baseline, participants were screened with the JobFit System PEFA, and classified as PEFA 1 if they met job demands and PEFA>1, if not. Males who completed the PEFA and were employed were included. Injury data from company records were coded for body part, mechanism, and severity. The relationship between PEFA classification and time to first injury was analyzed using Cox proportional hazards regression with adjustments for department and post hoc stratification for time (0–1.3 yr, 1.3–6 yr).
Results. Of the 600 participants (median age, 37 yr, range, 17.0–62.6 yr), 427 scored PEFA 1. One hundred ninety-six sprain/strain injuries were reported by 121 workers, including 35 back injuries from manual handling. Significant differences between PEFA groups were found in time to first injury for all injury types during the long term (any injury: adjusted hazard ratio [HR] = 2.3, 95% confidence interval [CI] = 1.4–3.9; manual handling injury: HR = 3.3, CI = 1.6–7.2; any back injury: HR = 3.3, CI = 1.6–6.6; back injuries from manual handling HR = 5.8, CI = 2.0–16.7), but not during the short term. An area under the receiver operator curve value of 0.73 (CI = 0.61–0.86) demonstrated acceptable predictive ability for back injuries from manual handling during the long term.
Conclusion. JobFit System PEFAs predict musculoskeletal injury risk in healthy mineworkers after 1.3 years of employment. Future research should assess whether use of these assessments as part of a holistic risk management program can decrease workplace musculoskeletal injuries.
Level of Evidence: 2
The use of functional capacity evaluations in pre-employment is increasing in popularity despite limited evidence of their validity predicting injury in healthy workers. This study indicates that job-specific JobFit System pre-employment functional assessments predict workplace musculoskeletal injury risk after 1.3 years of employment, particularly for back injuries from manual handling.
*School of Human Movement Studies
†Minerals Industry Safety and Health Centre, and
‡Schools of Human Movement Studies and Population Health, The University of Queensland, Brisbane, Australia.
Address correspondence and reprint requests to Jennifer Legge, PhD, MErg, BPhty, PO Box 8740, Mt Pleasant Q 4740, Australia; E-mail: firstname.lastname@example.org
Acknowledgement date: March 5, 2013. First revision date: June 23, 2013. Second revision date: August 28, 2013. Acceptance date: August 29, 2013.
The manuscript submitted does not contain information about medical device(s)/drug(s).
Australian Coal Association Research Program (No. C14045) grant funds were received in support of this work.
Relevant financial activities outside the submitted work: board membership, employment.
This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivitives 3.0 License, where it is permissible to download and share the work provided it is properly cited. The work cannot be changed in any way or used commercially.
Musculoskeletal injuries in the workplace continue to be a significant economic and social problem in industrial nations worldwide.1–4 For the Australian mining industry, for example, musculoskeletal injuries account for the largest proportion of workplace injury claims (44%), with body stressing (manual handling) being the most common mechanism of injury (42%) and the back being the most common body part involved (19%).5 Pre-employment screening that endeavors to identify individuals who are at greater risk of sustaining an injury is one method used in an attempt to reduce workplace injuries. Traditional methods of screening, such as back radiography and medical screenings including strength, flexibility, endurance, and body composition testing have not been shown to predict subsequent injury risk.6–9 Many researchers in the field of workplace injury prevention have highlighted the need for job-specific assessments.10–13 It is also a requirement of antidiscrimination legislation in many jurisdictions that work-related assessments test against the inherent requirements of the job.14–19
Functional capacity evaluation (FCE) testing has traditionally been used in rehabilitation and medicolegal assessments, but generally not in the pre-employment phase because of time and cost restraints. A short-form FCE, comprising only a core selection of functional activities, is more practical with the development of injury or job-specific FCEs now recently adopted in the rehabilitation arena.20–22 Although more validity research is needed, recent evidence for the predictability of return to work of injured workers using short-form FCEs is promising.23–24 However, very limited published evidence is available to justify their use as a predictor of injury in healthy workers. Even with traditional long-form FCE methods, a recent Cochrane Review25 concluded that there is minimal quality evidence for functional testing in pre-employment screening, despite their increasing use for this purpose. The aim of this research is to evaluate the validity of a job-specific pre-employment functional assessment in terms of its ability to predict musculoskeletal injury risk in healthy mine workers in the Australian coal mining industry.
MATERIALS AND METHODS
This prospective cohort study investigates the relationship between participants’ performance in a job-specific JobFit System PEFA and their subsequent workplace musculoskeletal injury history. Participant PEFA performance and demographic information were collected at the time of the assessment. Employment data and injury statistics were collected during and at the conclusion of the study period. This project was cleared in accordance with the ethical review guidelines at The University of Queensland by the School of Human Movement Studies Ethics Committee.
A coal mine with underground and open cut operations, employing more than 1000 workers, participated in the study from 2002 to 2009. As part of the hiring process, all prospective employees were required to participate in a job-specific PEFA. Prospective employees from all operational areas and all occupation types were eligible to participate.
Exclusion criteria included:
* Current injury or injury requiring medical treatment, time off work or restricted duties in the previous 6 weeks.
* Current Worker's Compensation Medical Certificate.
* Blood pressure higher than 145 mmHg (systolic) or 95 mmHg (diastolic).
* Current or past history of a cardiac condition.
* Surgery, fractures, or dislocations within the previous 6 months.
All participants (n = 1019) signed an informed consent outlining assessment components, risk, and expectations of submaximal physical testing and the precautions that would be taken, the purpose of the assessment, the use and disclosure of the collected information, and the opportunity to discontinue testing at any time.
Female employees (n = 95) were excluded, as were participants who were not successful in their job application. The reason for unsuccessful employment was not disclosed to the researcher by the employer, and it is not known what influence the PEFA score had on this decision. Male participants who completed the assessment, were hired and employed in the job related to their PEFA assessment were included, resulting in data from 600 participants for analysis (Figure 1).
Outcome Measures and Data Collection
Pre-employment Functional Assessment
The JobFit System PEFA was used to conduct the job-specific functional assessments. The test components and criteria for the PEFAs were specific for the job for which the participant was applying. The functional demands of the tasks had been previously assessed by a physiotherapist using observation and interview techniques and were broken down into 42 postural tolerances measures and 21 manual handling measures. Task demands were collated using the JobFit System software to produce job demands. Postural job demands that were used for the PEFA criteria in this study included: reaching forward, reaching above shoulder, stooping, squatting, and stair climbing. These were selected on the basis of the job requirements and injury history at the workplace. Manual handling job demands included floor, bench, shoulder and above shoulder lifts, and bilateral carry. The maximum weight requirement for each manual handling measure for each job was used as the assessment criteria.
Each PEFA contained the following test components and was delivered in the same sequence: musculoskeletal screen, aerobic fitness test, postural and dynamic tolerances (job specific), and manual handling tasks (job specific). The job-specific PEFAs could have any combination, and any number, of the postural tolerances and manual handling listed earlier, however, components were always delivered in the same sequence. A functional lifting approach was used. In general, the PEFA is completed within a 1-hour timeframe. Testing procedures were fully explained to the participant prior to commencement and were consistent with those outlined in the JobFit System Training Program.26
PEFAs were conducted by a physiotherapist, occupational therapist, or exercise physiologist. Performance on the postural and dynamic tolerances tasks and the manual handling tasks were compared with the job demands to determine the JobFit System PEFA score. The reliability of the JobFit System PEFA has been evaluated and reported previously,27 and was considered suitable with excellent intrarater reliability (intraclass coefficient [ICC], 0.94; CI, 0.90–0.96) and good inter-rater reliability (ICC, 0.84; CI, 0.75–0.90).
JobFit System PEFA Score
The JobFit System PEFA score (range, 1–4) is the overall score of the worker's performance in comparison with the physical demands of the job for which they are applying:
* Score 1: Has demonstrated the functional capacity to perform the proposed position as described with no restrictions.
* Score 2: Has demonstrated the functional capacity to perform the proposed position as described with minimal restrictions.
* Score 3: Has demonstrated the functional capacity to perform the proposed position as described with moderate restrictions.
* Score 4: Has not demonstrated the functional capacity to meet the inherent requirements of the proposed position as described.
Prior to statistical analysis, raw PEFA data collection sheets from workers who had been injured at work since the time of their PEFA, were reviewed and scored by a blinded independent third party. Of the 121 records reviewed, disagreement was found between the original scoring and the reviewer's scoring for 15 participants. Agreement on the scoring was reached through discussion between the researcher and the auditor.
Sociodemographic characteristics including age, job, and department were collected. Employment records including start and finish dates and the job in which the applicant was employed were provided by the company's human resources department.
Injury reports for study participants were retrieved from the company's accident and incident database. The injury database used in the study is the central repository for all accidents and incidents that occur at the company. Employees are legally obligated to report all incidents to their supervisor for entry into the database. The company maintains clear definitions for the coding of the injury data. This database captures injuries that may not progress to a workers’ compensation claim and was therefore more complete than Workers’ Compensation data. Injury severity was in the range from no treatment required through to lost time from work. All severity classifications were considered an injury. The aim of the functional assessment was to identify musculoskeletal injury risks arising from overexertion and consequently the analysis was restricted to injuries coded as “sprain/strain.”
Each narrative record was individually reviewed and coded by the researcher in 3 categories: (1) body part, (2) mechanism of injury, and (3) severity of injury. Injury codes were reviewed by a blinded independent third party for all injured participant records (n = 196). Differences occurred for 31 records before agreement was reached by discussion between the researcher and auditor.
Time from commencement of employment to date of injury was also recorded. In the event that a participant recorded more than one injury during the study period, data from all injuries was captured, and data regarding the first injury of its type was included in the analysis. Neither prior medical history nor workers’ compensation data at the time of the PEFA, nor that reported by the participant during the medical clearance process were permitted to be captured.
Relative risk was calculated for PEFA score and each injury type. The relationship between PEFA score and time to first injury was studied using Cox proportional hazards regression. PEFA scores were dichotomized to PEFA 1 (met job demands) and PEFA>1 (did not meet job demands) groups for the analysis. The models were analyzed unadjusted and with adjustment for confounders. Potential confounders (i.e., age, job, and department) were added to the model one-by-one, and if it changed the regression coefficient by more than 10%, the variable was included in the adjusted model. Using this selection method, only department was included as a confounder. The Cox proportional hazards model assumes that the hazard ratio (HR) is constant over time. This assumption was checked and the log-minus-log curves and models with time-dependent covariates showed an interaction with time consistently for all outcomes. Therefore, further post hoc analyses were stratified for time with the cutoff for time set at 1.3 years based on the log-minus-log curves. HRs were presented for 0 to 1.3 years (shorter term) and 1.3 to 6 years (longer term) separately. To estimate the predictive ability of the PEFA to discriminate between participants with and without injury, the area under the receiver operator curve (AUC) was calculated with 95% confidence intervals. An AUC of 1 indicates perfect discriminative ability, whereas an AUC of 0.50 indicates that the discriminative ability is equal to chance. All analyses were done using IBM SPSS Statistics version 20 for Windows. P values were based on 2-sided tests and were considered statistically significant at P < 0.05.
Of the 600 participants, 427 met the job demands and scored PEFA 1 (71%) (Table 1). Of the remaining 173 workers, 107 scored PEFA 2 (18%), and 66 (11%) scored PEFA 3. No workers scored PEFA 4. Because of the small numbers, participants with scores 2 and 3 were collapsed into one group: PEFA>1 (n = 173) for subsequent analysis. Of the 295 workers who were not employed, 69.2% scored PEFA 1 (n = 204).
The median age at time of PEFA was 37.0 (IQR, 29.0–45.0; range, 17.0–62.6) years. There was no significant association between age at time of PEFA and PEFA score (P = 0.08). The mean duration of employment during the study period was 2.7 years (SD, 2.1). The PEFA groups differed in department of employment (P ≤ 0.001) and occupation type (P ≤ 0.001) (Table 1).
During the study period from December 2002 to December 2009, a total of 196 sprain/strain injuries were reported by 121 workers. Injury rates per person year for each body location and mechanism of injury are reported in Table 2.
The highest injury rate by body location was injuries to the back/trunk (43 per 1000 person years). Manual handling had the highest injury rate by mechanism of injury at 46 per 1000 person years. Back and trunk injuries associated with manual handling were the largest subgroup (22 per 1000 person years).
PEFA Score and Injury Risk
A significant increase in relative risk exists for workers who score PEFA>1 for any injury type with the greatest relative risk being for any back injury from manual handling (RR, 3.0; 95% CI, 1.4–6.1) (Table 3).
Statistically significant differences were found between PEFA groups in time to first injury during the longer term, but not the short term, for all injury types (Table 3). These relationships remained significant after adjustment for confounders. The interaction between PEFA and department was not significant with results presented for the total group only. During the long term, risk of injury was 2.3 times greater in the PEFA>1 group than the PEFA 1 group (CI, 1.4–3.9) but was not significant in the shorter term. Significant group differences were also found for injuries resulting from manual handling (HR, 3.3; CI 1.6–7.2) and for back injuries (HR, 3.3; CI, 1.6–6.6). The greatest difference in injury risk was observed for back injuries resulting from manual handling during the longer term, with the likelihood of sustaining an injury being 5.8 times greater in the PEFA>1 group than in the PEFA 1 group (CI, 2.0–16.7) (Figure 2). Although acknowledging that the study was underpowered to analyze the predictive value of the individual PEFA scores, an explorative analyses was done, which showed that the HRs were higher for PEFA 2 (HR = 8.8; CI, 2.9–26.3) than PEFA 3 (HR = 3.6; CI, 0.9–15.1), suggesting no linear dose-response relationship. However, confidence intervals were wide and results should be interpreted with care.
The AUC as a measure of the predictive ability of the PEFA for each injury type in the short and long term is presented in Table 3. Moderate levels were demonstrated during the longer term, with an acceptable predictive ability of the PEFA for back injuries from manual handling confirmed with an AUC value of 0.73 (CI, 0.61–0.86).
Performance in a job-specific PEFA predicted risk of any injury, any back injury, any manual handling injury, and any back injury from manual handling in a group of 600 Australian coal mine workers during the longer term, but not in the short term. The association between the JobFit System PEFA and injury risk was strongest for the risk of back injuries associated with manual handling. This is the first study to demonstrate the validity of job-specific PEFAs in healthy coal miners, and also the first to identify a change in musculoskeletal injury risk profile over time and for different injury types.
The research has a number of limitations, including restricted access to information such as previous injury history, chronic diseases, and educational background that have previously been reported as confounding factors in musculoskeletal injuries.6,23,28 The assumption of the accuracy of the company's injury records may be a study limitation; however, there is no reason to predict any reporting bias as a function of PEFA score. The potential positive influence of concurrent risk management strategies employed at the workplace (e.g., equipment and task redesign, use of personal protective equipment, and risk management training), as well as potential negative influencers (e.g., productivity demands, variable mining conditions, and shift work including 12-hour shifts), could also not be controlled, however both participant groups were exposed to the same influencers. Further research at additional workplaces and in different industries is required to demonstrate the generalizability of the findings.
A notable difference between this and other studies investigating the validity of pre-employment functional testing was the identification of a change in injury risk profile over time. The longer duration of this study and mean employment time of the participants in comparison with others13,29–31 enabled this trend to be investigated. This study identified what could be described as an initial “honeymoon period” after which time the participant's risk of first injury increased dramatically. Further research is needed to attempt to determine the reason why this increased risk occurs; however, possible hypotheses include increased rate of musculoskeletal deterioration as a result of working at maximum capacity for an extended period; decreased worker and/or employer awareness of, or compliance with, restrictions advised at the time of testing or commencement of employment; further deconditioning from inactivity or other factors; or, behavioral change of the worker toward more risk-taking activities on the assumption that “they had ‘survived’ thus far and therefore the predictions were wrong.” Until such evidence is identified, health professionals, workers, and employers can maximize the opportunity of the “honeymoon period” as a time for physical conditioning, behavioral safety programs, and workplace modifications in an attempt to reduce the worker's risk of injury proactively rather than the negative option of not hiring.
A second distinguishing feature of this study was the measurement and identification of variable risk profiles for different injury types. Although the PEFA was predictive of 4 different categories of musculoskeletal injuries, it was most predictive of manual handling injuries, and possibly had the strongest prediction for back injuries associated with manual handling because of the number of included activities that tested back function. However, numbers of this last type of injury were low and validation of the current results in a different sample is needed to confirm these findings. Further research into the predictive ability of components of the PEFA, rather than just the overall score, on different injury types and body locations in healthy workers may give insight into which items are the most predictive and how the PEFA may be shortened or improved.
As discussed by Serra et al,32 the implementation of pre-employment testing programs is a balancing act between protecting a worker and their colleagues from harm, and against protecting them from discrimination. Assessments that are job-specific, objective, and validated play a large role in maintaining that balance, especially when they are part of a holistic risk management program including ergonomic redesign, behavioral safety, and individual health improvement programs.
These results indicate that the JobFit System PEFA may be a valid predictor of time to first injury risk in healthy workers and could be used by employers as part of a holistic injury prevention program. More research is needed to determine the mitigating factors during, or the attenuating factors after, the initial honeymoon period during which the workers’ injury risk was lowest. Likewise additional research is needed to identify which components of the JobFit System PEFA are more predictive of different injury types and body locations than others.
* There is limited evidence regarding the validity of functional testing in healthy workers as a predictor of workplace injury.
* This study indicates that the job-specific JobFit System PEFA is a long-term predictor of workplace musculoskeletal injury risk.
* The association between the JobFit System PEFA and injury risk was strongest for the risk of back injuries associated with manual handling during the longer term.
The authors thank the contribution of the health and safety and human resources personnel from the test site for their assistance in data collection, and Ms. Janet Cawte for her assistance as a third-party reviewer of test data. The authors also thank the participants in the study, the mine owner, and management team for allowing them to conduct the study at their workplace.
3. U.S. Department of Labor: Bureau of Labor Statistics. News Release: Nonfatal Occupational Injuries and Illnesses Requiring Days Away from Work, 2010. Available at: http://www.bls.gov/news.release/pdf/osh2.pdf
. Accessed August 2012.
6. Bigos SJ, Battié MC, Fisher LD, et al. A prospective evaluation of preemployment screening methods for acute industrial back pain. Spine 1992;17:922–6.
7. Bigos SJ, Hansson T, Castillo RN, et al. The value of preemployment roentgenographs for predicting acute back injury claims and chronic back pain disability. Clin Orthop Relat Res 1992;283:124–9.
8. Kujala UM, Taimela S, Viljanen T, et al. Physical loading and performance as predictors of back pain in healthy adults: a 5-year prospective study. Eur J Appl Physiol 1996;73:452–8.
9. Reimer DS, Halbrook BD, Dreyfuss PH, et al. A novel approach to preemployment worker fitness evaluations in a material-handling industry. Spine 1994;19:2026–32.
10. Bos J, Kuijer PPF, Frings-Dresen MHW. Definition and assessment of specific occupational demands concerning lifting, pushing, and pulling based on a systematic literature search. Occup Environ Med 2002;59:800–6.
11. Gouttebarge V, Kuijer PPF, Wind H, et al. Criterion-related validity of functional capacity evaluation lifting tests on future work disability risk and return to work in the construction industry. Occup Environ Med 2009;66:657–63.
12. Pransky GS, Dempsey PG. Practical aspects of functional capacity evaluations. J Occup Rehabil 2004;14:217–29.
13. Rosenblum KE, Shankar A. A study of the effects of isokinetic pre-employment physical capability screening in the reduction of musculoskeletal disorders in a labor intensive work environment. Work 2006;26:215–28.
20. Frings-Dresen MHW, Sluiter JK. Development of a job-specific FCE protocol: the work demands of hospital nurses as an example. J Occup Rehabil 2003;13:233–48.
21. Gouttebarge V, Wind H, Paul P, et al. How to assess physical work-ability with functional capacity evaluation methods in a more specific and efficient way? [sounding board]. Work 2010;37:111–5.
22. Gross DP, Battie MC, Asante A. Development and validation of a short-form functional capacity evaluation for use in claimants with low back disorders. J Occup Rehabil 2006;16:53–62.
23. Gross DP, Battie MC, Asante AK. Evaluation of a short-form functional capacity evaluation: less may be best. J Occup Rehabil 2007;17:422–35.
24. Kuijer PPFM, Gouttebarge V, Brouwer S, et al. Are performance-based measures predictive of work participation in patients with musculoskeletal disorders? A systematic review. Int Arch Occup Environ Health 2011;85:109–23.
25. Mahmud N, Schonstein E, Schaafsma F, et al. Pre-employment examinations for preventing occupational injury and disease in workers (Review). In: The Cochrane Library. Issue 5. Oxford: Cochrane Collaboration; 2011.
26. JobFit Systems International. JobFit System Training Program Module Four: JobFit System PEFA, 2005.
27. Legge J, Burgess-Limerick R. Reliability of the JobFit system pre-employment functional assessment tool. Work 2007;28:299–312.
28. Smith P, Bielecky A, Mustard C. The relationship between chronic conditions and work-related injuries and repetitive strain injuries in Canada. J Occup Environ Med 2012;54:841–6.
29. Takala E, Viikari-Juntura E. Do functional tests predict low back pain? Spine 2000;25:2126–32.
30. Kuijer W, Brouwer S, Reneman MF, et al. Matching FCE activities and work demands: an explorative study. J Occup Rehabil 2006;16:469–83.
31. Gassoway J, Flory V. Prework screen: Is it helpful in reducing injuries and costs? Work 2000;15:101–6.
32. Serra C, Rodriguez MC, Delclos GL, et al. Criteria and methods used for the assessment of fitness for work: a systematic review. Occup Environ Med 2007;64:304–12.
musculoskeletal diseases; functional capacity evaluation; occupational injuries; physical fitness; back injuries; pre-employment screening; manual handling; risk management