JAIDS Journal of Acquired Immune Deficiency Syndromes:
Brief Report: Clinical Science
Performance of Immunologic Responses in Predicting Viral Load Suppression: Implications for Monitoring Patients in Resource-Limited Settings
Moore, David M MDCM, MHSc, FRCP(C)*†‡; Mermin, Jonathan MD, MPH‡; Awor, Anna MSc‡; Yip, Benita BSc (Pharm)*; Hogg, Robert S PhD*†; Montaner, Julio S. G MD, FRCP(C)*†
From the *British Columbia Centre for Excellence in HIV/AIDS, Vancouver, British Columbia, Canada; †Department of Medicine, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada; and ‡Global AIDS Program, US Centers for Disease Control and Prevention, Entebbe, Uganda.
Received for publication March 27, 2006; accepted July 31, 2006.
This work was supported by the Michael Smith Foundation for Health Research through a Senior Scholar Award to R. S. Hogg and through peer-reviewed grants.
Reprints: David M. Moore, MDCM, MHSc, FRCP(C), CDC-Uganda, Uganda Virus Research Institute, PO Box 49, Entebbe, Uganda (e-mail:firstname.lastname@example.org).
Background: World Health Organization (WHO) guidelines for the use of antiretroviral therapy (ART) in resource-limited settings state that CD4 cell counts may be used to indicate when ART regimens should be changed because of treatment failure. The performance of immunologic monitoring for this purpose has not been evaluated, however.
Methods: Participants aged ≥18 years from the British Columbia HIV/AIDS Drug Treatment Program who had CD4 cell counts ≤200 cells/μL or an AIDS diagnosis at baseline had CD4 cell counts measured at 6 and 12 months after treatment initiation. Logistic regression analysis was used to calculate sensitivity, specificity, and positive and negative predictive values for immunologic responses in terms of predicting failure to achieve 2 viral load measurements <500 copies/mL within 1 year.
Results: Viral load suppression occurred in 674 (60%) of 1125 subjects. Using no increase in CD4 cell counts at 6 months as a definition of treatment failure had a sensitivity of 34%, specificity of 94%, positive predictive value of 75%, and negative predictive value of 71% for predicting failure to achieve virologic suppression. Using 12-month CD4 cell count values, the measurements were 35%, 95%, 79%, and 73%, respectively.
Conclusion: Immunologic criteria to predict which patients have not achieved virologic suppression results in significant misclassification of therapeutic responses.
Treatment guidelines from the World Health Organization (WHO) for the use of antiretroviral therapy (ART) in resource-limited settings state that CD4 cell counts may be used to monitor clinical response to therapy in programs in which viral load testing is not available.1 The return of CD4 cell counts to pretherapy levels, declines in the absence of coexistent infections, or a >50% decrease in CD4 cell counts from peak levels without coexistent infections are proposed as definitions of treatment failure whereby a change in an ART regimen may be warranted.1
In industrialized countries, however, viral load has been the primary tool that clinicians and researchers have used to monitor patients on ART to indicate when therapy should be changed.2,3 Immunologic parameters in isolation from viral load measurements are not used to indicate treatment failure. The clinical performance of immunologic responses to ART, without concomitant virologic monitoring, in terms of predicting response to therapy has not been previously evaluated. Therefore, we designed a study to evaluate the clinical utility of changes in CD4 cell count parameters at 6 and 12 months after treatment initiation in terms of their ability to identify subjects who have not achieved virologic suppression on their primary ART regimen using data from the British Columbia HIV/AIDS Drug Treatment Program (BCDTP). Such subjects would be recommended to change their initial ART regimen, based on the current WHO guidelines for resource-limited settings.
The BCDTP has been previously described.4 Participants in the present study were, aged >18 years, were ART naive, and had CD4 cell counts ≤200 cells/μL or an AIDS-defining illness at baseline and started ART between August 1, 1996 and September 30, 2003. Subjects also needed to have CD4 cell counts and CD4 percentage (CD4%) measured 3 to 9 months after treatment initiation or CD4 cell counts at 9 to 15 months after treatment initiation. Included subjects must also have had at least 2 viral load measurements during follow-up. Plasma HIV-1 RNA levels were determined using the Roche Amplicor Monitor sensitive assay before the year 2000 and the ultra-sensitive assay thereafter (Roche Diagnostics, Laval, Quebec, Canada). CD4 cell counts were measured by flow cytometry, followed by fluorescent monoclonal antibody analysis (Beckman Coulter, Inc., Mississauga, Ontario, Canada).
Logistic regression analysis was used to define receiver-operator characteristic (ROC) curves for each of the following measures in terms of their performance in predicting failure to achieve 2 consecutive viral load measurements <500 copies/mL within the first year on the primary ART regimen: change in CD4 cell counts from baseline at 6 months and at 12 months; change in CD4 cell counts from 6 months to 12 months; absolute CD4 cell counts at 6 and 12 months; change in CD4 cell counts as a percentage of baseline CD4 cell counts; and absolute CD4% and change in CD4% at 6 months. The ROC curves were then used to identify the thresholds that maximized the diagnostic accuracy (true-positive results + true-negative results/all subjects) for each measure of immunologic response. In addition, these parameters were examined using current WHO criteria for immunologic monitoring. Data from a subgroup of patients who initiated therapy after January 1, 2000 were used to develop ROC curves for immunologic parameters using a viral load measurement of ≥50 copies/mL at 6 and 12 months after treatment initiation as evidence of treatment failure.
A total of 1125 subjects (325 with AIDS-defining illnesses at baseline and 800 with baseline CD4 counts <200 cells/μL) had available viral load measurements on 2 occasions within 1 year of treatment initiation. The median baseline CD4 cell count was 90 cells/μL (interquartile range [IQR]: 30-150), and the median baseline CD4% was 9% (IQR: 5-14). Viral load suppression (defined as the first episode of achieving a viral load <500 copies/mL on 2 consecutive measurements) occurred in 674 (60%) of subjects in a median of 2.4 months (IQR: 1.4-3.7).
Follow-up CD4 cell counts at 6 months were available for 905 subjects. The median CD4 cell count at 6 months was 180 cells/μL (IQR: 110-300), reflecting a median CD4 cell count increase of 100 cells (IQR: 30-170) from baseline. The CD4% at 6 months was available for 835 subjects. The median CD4% was 14% (IQR: 8-21) at 6 months after treatment initiation, with median increases of 5% (IQR: 2-8). Twelve-month CD4 cell counts were available for 855 subjects with median counts of 220 cells (IQR: 130-340), reflecting median increases of 130 cells (IQR: 50-220) from baseline.
ROC curves for 3 measures of immunologic response for predicting virologic suppression are shown in Figure 1. Of all the measures examined, CD4 cell count changes from 0 to 12 months had the largest area under the curve (0.76), and were thus the best predictor of virologic suppression. ROC curves were also developed for changes in CD4 cell counts at 6 months as a percentage of baseline CD4 counts and for all immunologic measures using 6- and 12-month viral load measurements <50 copies/mL as the outcome measure for 450 and 452 subjects, respectively. All these analyses produced ROCs with much lower accuracy than those presented (data not shown).
Table 1 shows the clinical performance of failure to achieve CD4 cell count increases at 6 and 12 months (WHO criteria) in terms of predicting virologic suppression and derived thresholds for each other measure of immunologic response that corresponds to the best clinical performance in terms of accuracy. Using no increase in CD4 cell counts at 6 months as a definition of treatment failure had an accuracy of 0.71, with a sensitivity of 0.34, specificity of 0.94, positive predictive value of 0.75, and negative predictive value of 0.71. Using no increase in CD4 cell counts at 12 months, the measures were 0.75, 0.35, 0.95, 0.79, and 0.73, respectively. Of the other measures of immunologic response examined, only raising the threshold of CD4 cell count changes at 12 months to ≥40 cells/μL had slightly greater accuracy (0.76) than using no change in CD4 cell counts at 12 months.
This analysis has shown that using immunologic criteria to predict which patients have not achieved virologic suppression results in significant misclassification of therapeutic responses. Health professionals with only CD4 cell count monitoring available to assess ART treatment failure should interpret these values and the WHO monitoring guidelines quite cautiously. The WHO guidelines state that subjects who experience a return of CD4 cell counts to pretherapy levels or declines in CD4 cell counts from baseline, in the absence of coexistent infections, should be considered for ART regimen changes to a second-line regimen. If failure to achieve any increase from baseline CD4 cell counts at 6 months or 12 months were used to define treatment failure in this population, approximately 21% to 25% of subjects would be improperly labeled as failing treatment. Clearly, this would have negative consequences for such patients because they would be prematurely switched off a regimen that was effectively controlling viral replication.
Furthermore, only 34% to 35% of true treatment failures were identified using these criteria. This poor sensitivity may be less of a concern, because subjects with CD4 cell count increases in the absence of virologic suppression may experience CD4 cell count declines later in their course of treatment that would allow them to be identified, albeit at a later date. The clinical consequences of the late identification of these treatment failures are unknown but would allow greater time for viruses in these patients to accumulate multiple drug resistance mutations.5 This may be less of an immediate concern for patients in African countries, where second-line regimens commonly use 3 completely new drugs to which the client has not previously been exposed. Such prolonged exposure to partially suppressive therapy may limit the effectiveness of third- and fourth-line regimens later on, however.
We cannot conclude that immunologic monitoring in resource-limited settings does not have value. We have shown that it poorly predicts those who have not achieved virologic suppression, and thus should not be used in isolation to identify those who are failing treatment. Virologic and immunologic responses are associated with disease progression on ART.6,7 Nevertheless, it is not clear that changing ART regimens in the face of a poor immunologic response is a safe or effective strategy to improve patient outcomes. Failure to achieve 6-month immunologic thresholds in the presence of virologic suppression is associated with poor adherence to therapy.8 Therefore, switching therapy for such patients without addressing possible adherence problems may lead to earlier failure on second- and third-line regimens.
Previous studies have shown that CD4 cell count measurements have significant intraindividual variability.9 Therefore, serial measurements may have more prognostic value than assessments based on single measurements. Alternatively, CD4 cell counts may be better used as a screening tool to define which patients require viral load testing.10 Such a scenario is predicated on viral load testing being accessible to all ART programs, however, which is a situation that currently does not exist. It is possible that additional clinical information such as weight gain, improved physical activity levels, or resolution of specific opportunistic infections could be used in addition to CD4 cell count monitoring improve the positive predictive value. Further research in such settings is needed to determine if immunologic monitoring can be enhanced through such measures.
The criteria used to define treatment failure (not achieving 2 consecutive viral load measurements <500 copies/mL) were relatively conservative, given that current ART guidelines in industrialized countries use failure to achieve viral load measurements of <50 copies mL as evidence of treatment failure.2,3 All immunologic measures assessed against this more stringent definition of failure performed much worse than using 500 copies/mL, however.
The generalizability of this study to resource-limited settings may be limited, because hematologic parameters in African countries can differ markedly from those in Europe or North America.11 In addition, the proportion of study subjects who failed to achieve virologic suppression was higher (40%) than that reported from several recent cohort studies in Africa,12,13 which may affect the clinical performance of these parameters. Clearly, more research is needed in African and other developing country settings to inform ART programs better about how best to monitor clients and what interventions can improve patient outcomes.
The authors thank Jennifer Adachi, Bonnie Devlin, Elizabeth Ferris, Nada Gataric, Kelly Hsu, Myrna Reginaldo, and Peter Vann for their research and administrative assistance.
1. World Health Organization. Scaling up Antiretroviral Therapy in Resource Limited Settings: Guidelines for a Public Health Approach
. Geneva: WHO; 2003.
2. Yeni PG, Hammer SM, Hirsch MS, et al. Treatment for adult HIV infection: 2004 recommendations of the International AIDS Society-USA Panel. JAMA
4. Hogg RS, Yip B, Chan KJ, et al. Rates of disease progression by baseline CD4 cell count and viral load after initiating triple-drug therapy. JAMA
5. Lafeuillade A, Hittinger G, Delbeke E, et al. Resistance selection in patients with stable low levels of HIV-1 viremia. Presented at: XV International AIDS Conference; 2004; Bangkok.
6. Moore DM, Hogg RS, Yip B, et al. Discordant immunologic and virologic responses to highly active antiretroviral therapy are associated with increased mortality and poor adherence to therapy. J Acquir Immune Defic Syndr
7. Chene G, Sterne JA, May M, et al. Prognostic importance of initial response in HIV-1 infected patients starting potent antiretroviral therapy: analysis of prospective studies. Lancet
8. Moore DM, Hogg RS, Chan K, et al. Disease progression in patients with virological suppression in response to HAART is associated with the degree of immunological response. AIDS
9. Raboud JM, Haley L, Montaner JS, et al. Quantification of the variation due to laboratory and physiologic sources in CD4 lymphocyte counts of clinically stable HIV-infected individuals. J Acquir Immune Defic Syndr Hum Retrovirol
. 1995;10(Suppl 2):S67-S73.
10. Bisson G, Gross R, Gaolathe T, et al. Diagnostic characteristics of CD4 cell count response in predicting virologic response in HIV-infected patients initiating HAART in Botswana. Presented at: 13th Conference on Retroviruses and Opportunistic Infections; 2006; Denver.
11. Lugada ES, Mermin J, Kaharuza F, et al. Population-based hematologic and immunologic reference values for a healthy Ugandan population. Clin Diagn Lab Immunol
12. Coetzee D, Hildebrand K, Boulle A, et al. Outcomes after two years of providing antiretroviral treatment in Khayelitsha, South Africa. AIDS
13. Laurent C, Diakhate N, Gueye NF, et al. The Senegalese government's highly active antiretroviral therapy initiative: an 18-month follow-up study. AIDS
This article has been cited 31 time(s).
Bulletin of the World Health OrganizationViral suppression after 12 months of antiretroviral therapy in low- and middle-income countries :a systematic reviewBulletin of the World Health Organization
AIDS Research and Human RetrovirusesPerformance of Immunological Response in Predicting Virological FailureAIDS Research and Human Retroviruses
Plos OneEvaluation of Clinical and Immunological Markers for Predicting Virological Failure in a HIV/AIDS Treatment Cohort in Busia, KenyaPlos One
Journal of the International AIDS SocietyEvaluation of WHO immunologic criteria for treatment failure: implications for detection of virologic failure, evolution of drug resistance and choice of second-line therapy in IndiaJournal of the International AIDS Society
AIDS Research and Human RetrovirusesHIV Type 1 Virological Response and Prevalence of HIV Type 1 Drug Resistance Among Patients Receiving Antiretroviral Therapy, Shandong, ChinaAIDS Research and Human Retroviruses
Early virological response of zidovudine/larnivudine/abacavir for patients co-infected with HIV and tuberculosis in Uganda
Tropical Medicine & International HealthMortality after failure of antiretroviral therapy in sub-Saharan AfricaTropical Medicine & International Health
Plos OneA Randomized, Controlled, Trial of Short Cycle Intermittent Compared to Continuous Antiretroviral Therapy for the Treatment of HIV Infection in UgandaPlos One
Tropical Medicine & International HealthAccuracy of WHO CD4 cell count criteria for virological failure of antiretroviral therapyTropical Medicine & International Health
Clinical Infectious DiseasesMisclassification of First-Line Antiretroviral Treatment Failure Based on Immunological Monitoring of HIV Infection in Resource-Limited SettingsClinical Infectious Diseases
Clinical Infectious DiseasesSetting the Stage: Current State of Affairs and Major ChallengesClinical Infectious Diseases
Plos MedicinePharmacy refill adherence compared with CD4 count changes for monitoring HIV-infected adults on antiretroviral therapyPlos Medicine
Plos OneMonitoring Virologic Responses to Antiretroviral Therapy in HIV-Infected Adults in Kenya: Evaluation of a Low-Cost Viral Load AssayPlos One
AIDS Research and Human RetrovirusesMedium-Term Probability of Success of Antiretroviral Treatment after Early Warning Signs of Treatment Failure in West African AdultsAIDS Research and Human Retroviruses
Bulletin of the World Health OrganizationAnthropometric and immunological success of antiretroviral therapy and prediction of virological success in west African adultsBulletin of the World Health Organization
Annals of Internal Medicine
Five-Year Outcomes of the China National Free Antiretroviral Treatment Program
Annals of Internal Medicine, 151(4):
Revue De Medecine InterneGlobal AIDS epidemic: From epidemiology to universal treatmentRevue De Medecine Interne
Resistance profiles after different periods of exposure to a first-line antiretroviral regimen in a Cameroonian cohort of HIV type-1-infected patients
Antiviral Therapy, 14(3):
Monitoring antiretroviral failure in resource-poor settings
Bmc Infectious DiseasesMean CD4 cell count changes in patients failing a first-line antiretroviral therapy in resource-limited settingsBmc Infectious Diseases
JAIDS Journal of Acquired Immune Deficiency SyndromesPooled Nucleic Acid Testing to Identify Antiretroviral Treatment Failure During HIV InfectionJAIDS Journal of Acquired Immune Deficiency Syndromes
JAIDS Journal of Acquired Immune Deficiency SyndromesCD4+ T-Cell Count Monitoring Does Not Accurately Identify HIV-Infected Adults With Virologic Failure Receiving Antiretroviral TherapyJAIDS Journal of Acquired Immune Deficiency Syndromes
antiretroviral therapy; developing countries; immunologic monitoring; virologic responses
© 2006 Lippincott Williams & Wilkins, Inc.
Highlight selected keywords in the article text.