Background: Several instruments commonly are used to assess the quality of medication prescribing. However, little is known about the relationship between these instruments or the concordance of their quality assessments when applied to the same group of patients.
Methods: We assessed 3 indicators of prescribing quality in a cohort of 196 veterans age 65 and older who were taking 5 or more medications. These 3 indicators assessed whether each patient was (1) taking any medication from the drugs-to-avoid criteria of Beers et al, (2) taking any medication with a score of 3 or more on the Medication Appropriateness Index (MAI), and/or (3) taking 9 or more medications (polypharmacy). Kappa statistics were used to assess agreement between measures.
Results: Mean age was 74.6 years, and patients used a mean of 8.1 medications. Six percent of drugs were rated inappropriate by the Beers drugs-to-avoid criteria, whereas 23% of drugs received an MAI score of 3 or more. Overall agreement between these metrics was 78%, little more than expected by chance (kappa statistic 0.14, P < 0.01). At the level of the patient, the proportion of subjects taking one or more inappropriate drugs was 37% by drugs-to-avoid criteria and 82% by MAI, whereas 37% had polypharmacy of ≥9 drugs. Prescribing was classified as inappropriate by all 3 metrics in 18% of patients and as appropriate by all 3 metrics in 13%. Together, this level of agreement was slightly better than chance (3-way kappa statistic 0.08, P = 0.03). Agreement remained low in sensitivity analyses using different cutoffs for the Beers criteria, a range of thresholds for MAI scores, and different definitions of polypharmacy, with kappa statistics ≤0.30 for all comparisons.
Conclusions: Commonly used measures of drug prescribing quality yield widely discordant results. Because the overall quality of prescribing may not be readily inferred from a single measure, multidimensional approaches will likely be necessary for robust assessment of prescribing quality.
From the *Division of Geriatrics, San Francisco VA Medical Center and UCSF, San Franciso, California; †the Health Services Research Enhancement Award Program at the San Francisco VA Medical Center, San Francisco, California; ‡the Center for Research in the Implementation of Innovative Strategies in Practice (CRIISP) at the Iowa City VA Healthcare System, Iowa City, Iowa; and §Division of General Internal Medicine, Department of Internal Medicine, University of Iowa, Roy A. and Lucille J. Carver College of Medicine, Iowa City, Iowa.
Supported by the Health Services Research and Development Service, Department of Veterans Affairs through an investigator-initiated research award (SAF98-152; Dr. Rosenthal); Research Career Development awards to Dr. Steinman and to Dr. Kaboli (RCD 03-033-1); and support from the HSR&D Research Enhancement Award Program at the San Francisco VA Medical Center (Mr. Bertenthal and Dr. Sen). Additional support was provided by grants from the National Institute on Aging (AG 00912, AG 10418) and the John A. Hartford Foundation, Inc. (Dr. Landefeld). Drs. Landefeld and Rosenthal are Senior Scholars in the VA National Quality Scholars Program. None of these sponsors had any role in the study design, methods, analyses, and interpretation, or in preparation of the manuscript and the decision to submit it for publication.
Presented at the 2005 annual meeting of the Society of General Internal Medicine (New Orleans, LA).
The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs.
Reprints: Michael Steinman, MD, San Francisco VA Medical Center, 4150 Clement St, Box 181-G, San Francisco, CA 94121. E-mail: firstname.lastname@example.org.