Urgent Need for Coordination in Adopting Standardized Antiretroviral Adherence Performance Indicators

Chalker, John MBChB, MSc, PhD*; Wagner, Anita PharmD, MPH, DrPH†; Tomson, Goran MD, PhD‡§; Laing, Richard MD¶; Johnson, Keith MSc*; Wahlström, Rolf MD, PhD‡; Ross-Degnan, Dennis ScD†; on behalf of INRUD-IAA

JAIDS Journal of Acquired Immune Deficiency Syndromes:
doi: 10.1097/QAI.0b013e3181befa12
Author Information

From the *Center for Pharmaceutical Management, Management Sciences for Health, Arlington, VA; †Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, MA; ‡Division of Global Health IHCAR; §Medical Management Centre, Karolinska Institutet, Stockholm, Sweden; ¶Department of Essential Medicines and Pharmaceutical Policies, World Health Organization, Geneva, Switzerland; and ‖The International Network for the Rational Use of Drugs Initiative on Adherence to Antiretroviral Therapy.

Supported by a grant provided by the Swedish International Development Cooperation Agency, under the terms of contribution 72300310. Additional funding for specific tasks was provided by the World Health Organization under an Agreement for Performance of Work: OD-AP-07-00516 and by the Rational Pharmaceutical Management Plus Program, which was funded by the U.S. Agency for International Development, under the terms of Cooperative Agreement number HRN-A-00-00-00016-00.

Some of the core data was presented at the 36th Annual Conference on Global Health, May 26-30, 2009, Washington, DC.

The opinions expressed herein are those of the author(s) and do not necessarily reflect the views of the Swedish International Development Cooperation Agency, the World Health Organization, or the U.S. Agency for International Development.

Correspondence to: John Chalker, MBChB, MSc, PhD, Center for Pharmaceutical Management, Management Sciences for Health, Arlington, VA (e-mail: jchalker@msh.org).

Article Outline

In recent years, global health initiatives have greatly increased the number of patients in low-income countries started on antiretroviral therapy (ART). This creates an urgent need to know how well HIV/AIDS programs maintain patients on therapy. This was emphasized in a recent comment with reference to the President's Emergency Plan for AIDS Relief program.1 Consensus, however, is lacking on practical, reliable, and valid indicators to monitor program performance on adherence.

The World Health Organization (WHO) in 20062 stated, “The March 2004 patient monitoring meeting was unable to reach consensus on internationally standardized guidelines for measuring patient adherence, although there was full agreement on the importance of supporting and monitoring adherence.” The 2008 Joint United Nations Programme on HIV/AIDS (UNAIDS) progress report3 said that “optimal strategies for measuring and improving treatment adherence have yet to be characterized.”

The recognized need for monitoring has stimulated donors to craft indicators and guidelines to monitor their own ART programs.4-8 To track the abundance of indicators for monitoring HIV/AIDS programs, UNAIDS maintains an indicator registry,9 which on July 10, 2009 listed 251 indicators. Surprisingly, not a single indicator in this registry referred to adherence.

Different data sources have been used to construct adherence indicators, most frequently to monitor individual patient performance rather than to summarize adherence in patient populations in facilities or programs. Because of its relative simplicity and low cost of data collection, the most common adherence monitoring method is through patient self-report,10 a measure that has been shown to predict clinical outcomes,12 a finding confirmed in resource-poor settings.11 However, self-report tends to overestimate adherence,12 and very high self-reported adherence rates make it an insensitive indicator for comparing facilities or evaluating changes in performance over time. Nevertheless, self-reporting remains an efficient way to identify individual patients at risk because any patient reporting less than perfect adherence is likely to need further support.

Pill counts are associated with viral load and CD4 counts;12 however, they also overestimate adherence compared with electronic medication monitoring, which records whenever a pill box has been opened. Pill counts also require an additional recording process. In a series of recent surveys, only 15% of more than 8000 pharmacy or clinical records examined in four sub-Saharan African countries had any record of pill counts (unpublished data). Introducing pill counts in these settings would add considerably to the clinic workload.

Pharmacy refill records are commonly used to calculate adherence indicators for other chronic diseases in settings with electronic pharmacy data systems,13 either as the percentage of days within a defined period covered by medicines dispensed or as the occurrence of gaps in medication supply between refills. For the patient, time without dispensed medicine is by definition a time of nonadherence. Dispensing-based adherence measurement has now been shown to be feasible using the types of manual pharmacy record systems common in resource-poor settings in Africa.14

In resource-rich environments, poor clinic attendance has been correlated with mortality.13 Failure to attend clinic when expected is objective information and easy to ascertain in most record systems, even in resource-poor settings,14,15 and inconsistent attendance may identify patients in need of outreach or adherence counseling.

At least two groups have responded to the pressing need to develop practical and reliable indicators to monitor adherence and retention: The International Network for the Rational Use of Drugs Initiative on Adherence to ART (INRUD-IAA)16 and the WHO HIV Drug Resistance Team.17 In 2006 and 2007, INRUD-IAA country teams tested the feasibility of collecting data on patient appointment keeping and pharmacy refills and calculating indicators in 80 diverse facilities in Kenya, Rwanda, Uganda, and Ethiopia.14 These indicators were shown to predict weight gain and increased CD4 counts in newly treated patients (unpublished data). The WHO HIV Drug Resistance Team has developed a series of indicators to provide an early warning about possible development of resistance to ART, including indicators addressing adherence based on pharmacy refill and appointment keeping.17 The suggested adherence indicators from these two teams are listed in Table 1. Enough evidence now exists to show that it is feasible for facilities at all levels to collect dispensing and attendance data and calculate adherence and retention indicators.

Recently, the Global Fund became the first funding organization to recommend an adherence indicator to monitor program performance.5 This is a welcome beginning. International organizations and national AIDS control programs have a clear and urgent need to finalize agreement about standard indicators to monitor patient adherence and retention and to begin to make such data publicly available. UNAIDS and the WHO Department of HIV/AIDS should take the lead in coordinating donor and country collaboration in this important endeavor.

Back to Top | Article Outline


The authors acknowledge the other members of the INRUD Initiative on Adherence to Antiretroviral Therapy, which include staff at the national AIDS control programs, local INRUD groups, and local Management Sciences for Health offices in Ethiopia, Kenya, Rwanda, Tanzania, and Uganda, as well as staff in partner organizations: Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, MA; Division of Global Health IHCAR, the Karolinska Institutet, Stockholm, Sweden; Center for Pharmaceutical Management, Management Sciences for Health, Arlington, USA; and Department of Essential Medicines and Pharmaceutical Policies, World Health Organization, Geneva, Switzerland. The authors thank all patients and staff in the respective health facilities. They also thank the colleagues who met in Entebbe in April 2006 to discuss results from a survey of program adherence indicators, plan a way forward, and form the INRUD Initiative on Adherence to Antiretrovirals.

Back to Top | Article Outline


1. Navario P. PEPFAR's biggest success is also it's largest liability. Lancet. 2009;374:184-185.
2. WHO (World Health Organization). Patient monitoring guidelines for HIV care and antiretroviral therapy (ART). Geneva: WHO, 2006.
3. UNAIDS. Report on the global HIV/AIDS epidemic. Geneva: UNAIDS, 2008.
4. WHO. National AIDS programmes: a guide to indicators for monitoring and evaluating national antiretroviral programmes. Geneva: WHO, 2005.
5. Global Fund to Fight AIDS. Tuberculosis and Malaria: Monitoring and Evaluation Toolkit: HIV/AIDS, Tuberculosis and Malaria. 3rd ed. Geneva: GFATM, 2009.
6. World Bank. The Africa Multi-Country AIDS Program 2000-2006. Chapter 6. Measuring and reporting on future bank-financed HIV/AIDS programs. Washington, DC: World Bank, 2007.
7. CDC. CDC HIV Prevention Strategic Plan Performance Indicators: Extended Through 2010. Atlanta, GA: CDC, 2007.
8. PEPFAR. The President's Emergency Plan for AIDS Relief: Planning and Reporting: The Next Generation Indicators Reference Guide. Version 1.0. Washington, DC: PEPFAR, 2009.
9. UNAIDS Indicator Registry. A central repository of information on indicators used to track the HIV and AIDS epidemic and the response [database online]. Geneva: UNAIDS. Available at: http://www.indicatorregistry.org/Main.aspx. Accessed July 10, 2009.
10. Nieuwkerk PT, Oort FJ. Self-reported adherence to antiretroviral therapy for HIV-1 infection and virologic treatment response: a meta-analysis. J Acquir Immune Defic Syndr. 2005;38:445-448.
11. Oyugi JH, Byakika-Tusiime J, Charlebois ED, et al. Multiple validated measures of adherence indicate high levels of adherence to generic HIV antiretroviral therapy in a resource-limited setting. J Acquir Immune Defic Syndr. 2004;36:1100-1102.
12. Liu H, Golin CE, Miller LG, et al. A comparison study of multiple measures of adherence to HIV protease inhibitors. Ann Intern Med. 2001;134:968-977.
13. Osterberg L, Blaschke T. Adherence to medication. N Engl J Med. 2005;353:487-497.
14. Chalker J, Andualem T, Gitau L, et al. Adherence rates in Africa: how are we doing? Presented at the 36th Annual Conference on Global Health, 2009, Washington DC. Available at: http://www.globalhealth.org/conference_2009/presentations/b7_ross_degnan.pdf. Accessed August 5, 2009.
15. Farley J, Hines S, Musk A, et al. Assessment of adherence to antiviral therapy in HIV-infected children. J Acquir Immune Defic Syndr. 2003;33:211-218.
16. Chalker J, Andualem T, Minzi O, et al. Monitoring adherence and defaulting for antiretroviral therapy in five East African countries: an urgent need for standards. JIAPAC. 2008;7:193-199.
17. WHO HIV Drug Resistance Team. HIV Drug Resistance, Early Warning Indicators. Geneva: WHO, 2008. Available at: http://www.who.int/hiv/topics/drugresistance/hiv_dr_early_warning_indicators.pdf. Accessed July 10, 2009.
© 2010 Lippincott Williams & Wilkins, Inc.