The Writing Panel reviewed these scenarios and treatments to ensure that they were representative of patients and scenarios clinicians are likely to encounter. Each independent panel member was given the opportunity to suggest potential modifications to the content or structure of the Writing Panel materials. The Writing Panel provided final determination of modifications to the indications, scenarios, assumptions, and literature review.
The Voting Panel participated in 3 rounds of voting. During the first round, the Voting Panel was given approximately 2 months to independently rate the appropriateness of the provided treatments for each of the relevant patient scenarios as “Appropriate,” “May Be Appropriate,” or “Rarely Appropriate” via an electronic ballot (Table III). After the first round of appropriateness ratings were submitted, AAOS staff calculated the median appropriateness ratings for each treatment and patient scenario as well as the level of disagreement between the panel members. The Voting Panel then met at an in-person meeting in Rosemont, Illinois, on Friday, August 5, 2016, to discuss any scenarios/treatments that had resulted in disagreement during the first round of voting. The Voting Panel members discussed the list of assumptions, patient indications, and treatments to identify areas that needed to be clarified and/or edited. Following the discussion and subsequent changes, members of the Voting Panel had the option to change any of their appropriateness ratings during the second round of electronic voting. After the completion of a second round of voting, the Voting Panel opted to revisit the scenarios about which there was still disagreement and opened the electronic ballot for a third round of voting. There was no attempt to obtain consensus regarding appropriateness.
With use of the median value of the second-round ratings from the members of the Voting Panel, the final levels of appropriateness were determined. Disagreement among raters can affect the final rating. Agreement and disagreement were determined with use of the BIOMED definitions of Agreement and Disagreement as reported in the RAND/UCLA Appropriate Method User’s Manual2 for a panel of 11 to 13 voting members. For this panel size, agreement was defined as when ≤3 panelists rated outside of the 3-point range containing the median and disagreement was defined as when ≥4 members’ appropriateness ratings fell within the “Appropriate” (7 to 9) and “Rarely Appropriate” (1 to 3) ranges for any scenario. If there was still disagreement in the Voting Panel ratings after the second round of voting, that voting item was labeled as “5” regardless of the median score. In the final tally, 1,410 (54%) of the 2,592 total voting items were rated as “Rarely Appropriate,” 645 (25%) were rated as “May Be Appropriate,” and 537 (21%) were rated as “Appropriate” (Fig. 1). Additionally, the voting panel members were in statistical agreement on 1,413 voting items (55%) and were in disagreement on 0 voting items.
Refer to the AUC app (http://www.orthoguidelines.org/auc) to see which treatment(s) were rated as Rarely Appropriate, May Be Appropriate, or Appropriate for a specific patient scenario.
* Authors: All members of the Writing and Voting Panels of the AUC on Surgical Management of Osteoarthritis of the Knee, as well as the involved AAOS staff, are listed starting on page ii of the online version of the AUC document.
Disclosure: The complete Disclosures of Potential Conflicts of Interest submitted by the authors of this AUC are provided in Appendix B of the online version of the AUC document.
Disclaimer: Volunteer physicians from multiple medical specialties created and categorized these Appropriate Use Criteria. These Appropriate Use Criteria are not intended to be comprehensive or a fixed protocol, as some patients may require more or less treatment or different means of diagnosis. These Appropriate Use Criteria represent patients and situations that clinicians treating or diagnosing musculoskeletal conditions are most likely to encounter. The clinician’s independent medical judgment, given the individual patient’s clinical circumstances, should always determine patient care and treatment.
Copyright 2017 by The Journal of Bone and Joint Surgery, Incorporated
1. American Academy of Orthopaedic Surgeons. Appropriate use criteria for surgical management of osteoarthritis of the knee. 2016 December 9. http://www.aaos.org/smoakauc
. Accessed 2016 Dec 28.