Share this article on:

Are We Too Quick to Alter Our Practice Patterns Because of the Results of a Randomized Controlled Trial?

Jupiter, Jesse, MD

Techniques in Hand & Upper Extremity Surgery: March 2018 - Volume 22 - Issue 1 - p 1–2
doi: 10.1097/BTH.0000000000000187
Editorial

Techniques In Hand & Upper Extremity Surgery, Weston, MA

Conflicts of Interest and Source of Funding: The author reports no conflicts of interest and no source of funding.

Address correspondence and reprint requests to Jesse Jupiter, MD, Techniques In Hand & Upper Extremity Surgery, Weston, MA 02493. E-mail: jjupiter1@partners.org.

Several large surveys of Orthopedic Surgeons have suggested that practice patterns can be influenced in response to new evidence of treatment.1,2 This may well explain the enthusiasm toward the surgical management of clavicular fractures following the randomized controlled study conducted by the Canadian Orthopaedic Trauma Society published in the Journal of Bone and Joint Surgery Am in 2006.3 The results of this study identified that the surgically treated patients showed a significant improvement in both patient-rated and surgeon-rated outcomes, an earlier return to function, and a lower rate of nonunion and malunion. It was not surprising that implant manufacturers followed this trend, offering a variety of anatomically shaped plates as well as intramedullary devices. Over the succeeding decade, however, the results of additional randomized controlled trials were less enthusiastic, documenting little evidence that the long-term functional outcomes were superior to nonoperative treatment.4–7

A closer scrutiny of the methodology and validity of many level 1 randomized controlled trials may dampen the rush to adopt new technologies without additional evidence. Dr John Ioannidis is Professor of Medicine and Health Research and Policy at Stanford University School of Medicine. His publication in 2005, “Why most published research findings are false,” is one of the most cited publications in the field.8 He demonstrated convincingly that 80% of nonrandomized studies turn out to be in error, 25% of randomized controlled trials are also flawed, and flaws were found in 10% of large clinical trials. In randomized controlled trials, he found that it was easy to manipulate results at every step, make a stronger claim, or select what is going to be concluded. A range of errors can often be found, including what questions researchers asked, how they set up the study, which patients were included, which measurements to use, how the data were analyzed, and how the results were presented. In another publication, he studied 49 of the most highly regarded findings in medicine over the prior 13 years, with 45 having claimed to have uncovered effective interventions. Thirty-four of these were retested, with 14% or 41% shown to be wrong or substantially exaggerated.9

Are we not seeing a similar situation with widespread enthusiasm for the surgical management of fractures of the distal end of the radius in older age patients with anatomically shaped volar plates. In this case, there were not even randomized control trials supporting this approach but rather level IV case series. Mirroring the experience with the clavicle fracture, subsequent randomized controlled trials comparing the surgical treatment with closed reduction and cast application have not supported significantly better patient-rated nor surgeon-rated outcomes with surgery.10–12

Our specialty and our patients will continue to benefit from the adoption of new technologies; however, careful scrutiny of published results even at level 1 may well help to avoid unexpected complications.13

Back to Top | Article Outline

REFERENCES

1. Khan H, Hussain N, Bhandari M. The influence of large clinical trials in orthopedic trauma: do they change practices? J Orthop Trauma. 2013;27:e268–e274.
2. Dijkman BG, Kooistra BW, Pemberton J, et al. Can orthopedic trials change practice? Acta Orthop. 2010;81:122–125.
3. Canadian Orthopedic Trauma Society. Nonoperative treatment compared with plate fixation of displaced midshaft clavicular fractures. J Bone Joint Surg Am. 2006;88:35–40.
4. McKee RC, Whelan DB, Schemitsch EH, et al. Operative versus nonoperative care of displaced midshaft clavicular fractures: a meta-analysis of randomized controlled trials. J Bone Joint Surg Am. 2012;94:879–884.
5. Wolz S, Stegerman S, Krijnen F, et al. Plate fixation compared with nonoperative treatment for displaced midshaft clavicle fractures. J Bone Joint Surg. 2017;99:106–112.
6. Leroux T, Wassertein D, Henry P, et al. Rate of and risk factors for reoperation after open reduction and internal fixation of midshaft clavicle fractures. J Bone Joint Surg. 2014;96:1119–1125.
7. Ban L, Nowak J, Virtanen K, et al. Overtreatment of displaced midshaft clavicle fractures. Acta Orthop. 2016;87:541–545.
8. Ioannidis JPA. Why most published research findings are false. PloS Med. 2005;2:e124.
9. Ioannidis JPA. Contradicted and initially stronger effects in highly cited clinical research. JAMA. 2005;294:218–228.
10. Arora R, Lutz M, Deml C, et al. Prospective randomized trial comparing nonoperative treatment with volar locking plate fixation for displaced and unstable distal radial fractures in patients 65 years and older. J Bone Joint Surg Am. 2011;93:2146–2153.
11. Karantana A, Downing ND, Forward NP, et al. Surgical treatment of distal radius fractures with a volar locking plate versus conventional percutaneous methods. J Bone Joint Surg Am. 2013;95:1737–1744.
12. Nelson GN, Stepan JG, Osei DA, et al. The impact of patient activity level on wrist disability after distal radius fracture. J Orthop Trauma. 2015;29:195–200.
13. Jupiter JB, Burke D. Scott’s parabola and the rise of the medical-industrial complex. Hand. 2013;8:335–342.
Copyright © 2018 Wolters Kluwer Health, Inc. All rights reserved