Of the roughly 1.2 million people living with HIV in the United States, it is estimated that only 325,000 have an undetectable viral load (VL) as a result of successful antiretroviral therapy (ART).1 Achieving viral suppression requires several steps: (1) diagnosis; (2) linkage to care; (3) engagement in care; and (4) viral suppression on ART. Failure at any one of these stages represents overall failure, ie, a failure to achieve viral suppression. This sequence of steps is commonly referred to as the HIV care continuum (HIV CC). The HIV CC has become a widely used framework to describe HIV treatment success at national, state, and local levels.2
In the United States, the Centers for Disease Control and Prevention (CDC) estimates the HIV CC using a prevalence approach, in which the percentages of individuals in each stage of care are calculated using the consistent denominator of the total estimated number of people infected with HIV.1 Other approaches to estimating the HIV CC include using data submitted to the National HIV Surveillance System (NHSS) to estimate those tested for HIV, and reported CD4+ T-lymphocyte (CD4) and/or VL tests as proxy measures to estimate linkage to care and engagement in care, and reported VL tests <200 copies/mL to estimate successful viral suppression. To estimate those linked to care, CDC calculated the number of persons with HIV diagnosed within a given year who have at least one CD4 or VL test within 3 months after their HIV diagnosis.3 Engagement in care has been defined by 2 or more CD4 or VL tests at least 3 months apart during a calendar year.3 Finally, in the context of clinical care data, the continuum is typically represented in bar graphs that present the percentage of HIV+ individuals in or beyond each stage of care, conditional on the previous stage, eg, among those who know their serostatus who are in care.4
There are several limitations to these approaches used to estimate the HIV CC. These include the incompleteness of data collected by state and local health departments and compiled by the CDC, the limited sensitivity and specificity of laboratory tests as a proxy for linkage and engagement in care, and the movement of HIV+ individuals between jurisdictions.5,6 Another deficiency is the cross-sectional representation of the HIV CC, for this static picture is only a snapshot of the distribution of patients across the continuum.7 Finally, and perhaps most importantly, these approaches do not capture how people living with HIV move through the HIV CC. The path from an HIV diagnosis to successful viral suppression can be thought of as a series of waits in a series of lines. We do not simply want to know how many individuals are in each stage of the treatment cascade; we also want to know long people spend in and how many people are lost after each stage. Given that the overwhelming majority of new HIV infections are transmitted by individuals not in care, understanding the flow of patients through the continuum, and bottlenecks along their path, is critical for developing intervention strategies that will most effectively increase the number of HIV-infected persons who are in care and virally suppressed.8
In this article, we describe the development of a queueing model of the care continuum. The model parameters are estimated using continuum data from CDC, additional data from the North American AIDS Cohort Collaboration on Research and Design (NA-ACCORD) and the existing literature. Although more complex versions of the HIV CC exist where patients can cyclically engage, disengage, and reengage in HIV care, processes alternately called “churn” or accessing the continuum through a “side door,” our model captures the essential features of patients' passage through the HIV CC by estimating patients' delay in transit from one care stage to the next along with the probability of dropping out after each stage of care.9,10 Estimating the parameters of the HIV CC in this serial manner (without “churn”) means that our model will underestimate the true fraction of infected persons who eventually achieve viral suppression.
The basic features of our queueing model are based on Little's Law, which states that the average number of individuals in a system is the product of the arrival rate and the average waiting time in the system, or in epidemiological terms, prevalence equals incidence times duration.11,12 The individuals in our model are HIV-infected individuals, and waiting times correspond to the time spent in different stages of care. Our model consists of adjacent queues linked in series to denote transit from the infected but undiagnosed state to diagnosis, linkage to care, engagement in care, and successful viral suppression (Fig. 1A). The initial input into the HIV+ but undiagnosed state is represented by λ, the aggregate rate of new HIV infections. The expected number of individuals residing in the ith stage [E(Xi), Fig. 1B] is the new infection rate (λ) times the product of the progression rates out of all preceding states in the continuum ( where pj is the probability of dropping out after stage j) multiplied by the expected time resident in stage i [E(Ti)]. In other words, presence in one stage of the HIV CC is conditional upon progressing through the previous stages.
To estimate parameters in the model, we used data from the CDC and 17 longitudinal cohorts of patients with HIV infection associated with NA-ACCORD. The data from CDC included persons aged ≥13 years with HIV infection diagnosed in 2009. Individuals were followed for their CD4 or VL tests from the diagnosis date until December 31, 2012, which was the administrative censoring date. The CDC data were not a comprehensive national sample but represent a census of individuals with HIV from California (Los Angeles County and San Francisco only), the District of Columbia, HI, IL, IN, IA, LA, MI, MO, NH, NY, ND, SC, WV and WY. The CDC supplied data on the time from diagnosis to first CD4 or VL test; time from first CD4 or VL test to the second CD4 or VL test; and time from the second CD4 or VL test until a VL test below 200 copies/mL. These data were used as proxies for time to linkage to care, engagement in care, and initiation of ART, respectively, after the CDC guidance on using surveillance data to monitor national care and prevention objectives.
To estimate the mean time individuals are virally suppressed in the last stage of the model, we used data from NA-ACCORD to determine time from first undetectable VL test to virologic failure (ie, the first detectable VL test on therapy). This basic model does not account for those individuals who may initially fail first-line ART, but are suppressed on a second-line regimen. Those who initially fail first-line ART and have experienced a first detectable VL were counted as failing viral suppression—and therefore, regardless of rapidity of initiating second-line ART, these individuals were considered unsuppressed. To model the time virally suppressed, we obtained data on 8845 individuals, aged >18 years, pooled from the longitudinal studies that are part of NA-ACCORD. These data provide a count of the NA-ACCORD subjects who initiated ART any time between January 1, 2009 and December 31, 2011, and sums all those who were virally suppressed in any given month until the end of 2011.
Finally, to estimate the probability that an HIV-infected individual drops out of the continuum before diagnosis, and the mean time from infection until either HIV diagnosis or dropout (whichever comes first), we used figures from the literature. Karon et al13 reported that the proportion of previously untested HIV-infected persons with a concurrent first HIV test and AIDS diagnosis was 0.23. We used this proportion as our estimate of the probability that a newly infected individual will drop out of the continuum before HIV diagnosis (in the absence of AIDS). The analysis in Karon et al also implies that newly infected persons remain undiagnosed for 2.8 years on average before either developing AIDS or testing positive for HIV before developing AIDS. Comparable estimates have been obtained in more recent studies.13,14 We therefore estimate the mean residency time from infection until either HIV diagnosis or dropout as 2.8 years.
Survival Models and Likelihood Functions
We used 2 survival models to estimate likelihood functions for the time individuals spent in each stage and whether or not individuals progressed to the next stage in the HIV CC, with censoring either due to dropout or failure to progress within the observation periods of the data. The first survival model was based on exponential distributions, thus the hazard rates for progression into the next stage or dropout were assumed to be constant over time. This leads to a simple competing risks model with constant stage-specific probabilities of dropping out of the HIV CC. The second model was a proportional hazards model based on Weibull distributions, thus the hazard rates for progression to the next stage or dropping out were power functions assumed proportional to each other. This also resulted in constant stage-specific probabilities of dropout. For each stage, the parameters of these models were estimated by maximum likelihood (Supplemental Digital Content, http://links.lww.com/QAI/B18). SDs for each parameter were calculated using the Delta method.15 We compared the likelihood ratios for the exponential and Weibull models for each stage.
We report the results from the Weibull model, which provided a significantly better fit to the data than the simpler exponential model (results for the exponential model are included in the Supplemental Digital Content, Table S1, http://links.lww.com/QAI/B18). The expected time from diagnosis to the first CD4/VL test or dropout (whichever occurs first) in the Weibull model, indicating how long an individual was diagnosed but not yet linked to care, was 3.1 months [95% confidence interval (CI): 3.0 to 3.2]. The time to the second CD4/VL test (a proxy for being engaged in care) or dropout was 3.6 months (95% CI: 3.6 to 3.7). In the subsequent stage, the expected time from the second CD4/VL test to the first suppressed VL test (indicating someone was still engaged in care, and either not on ART or not yet suppressed) or dropout was 14.6 months (95% CI: 13.3 to 15.9) in the Weibull model. The duration of viral suppression, as measured by the time from the first undetectable to the first detectable VL test was 36.6 months (95% CI: 35.6 to 37.6). The estimated probability that an individual with diagnosed HIV drops out of the HIV CC before being linked to care was 0.079 (95% CI: 0.074 to 0.083) for the Weibull. Of those linked to care, the estimated probability of dropping out before being engaged in care was 0.056 (95% CI: 0.052 to 0.060). Of those engaged in care, the estimated probability an individual drops out before achieving an initial viral suppression was 0.094 (95% CI: 0.078 to 0.11) for the Weibull. In all cases, the Weibull model provided a significantly better fit to the data than the simpler exponential model (see Table 1; all likelihood ratio χ2 tests are significant at P < 0.0001).
To date, scholarship on the continuum of care has focused on reporting proportions of persons who drop out at each stage of the pathway that leads from case detection to successful viral suppression. The queueing model presented in this article aims to enrich our understanding of patient experience by estimating how much time individuals—both those who drop out and those who progress—can expect to spend in a given stage of the pathway.
The traditional cross-sectional description of the continuum of care suggests at which stage there are barriers in providing care and treatment for HIV-infected individuals. The queueing model estimated herein provides more insights in terms of the difficulties of being in a given stage as regards the probability of achieving viral suppression. In fact, this model offers a way to identify the weakest link in the continuum of care and where an emphasis should be placed in developing interventions to improve treatment and prevention outcomes. The basic formula for the expected number of individuals in a given stage in the continuum shown in Figure 1B contains the term (1 − pj), which is the complement of the probability of dropout after stage j; in other words (1 − pj) is the probability of progression to the next stage. In the most basic terms, it is where this probability is the smallest that efforts would be best directed, where flow through the continuum is most constricted. In this instance, using the data from CDC and NA-ACCORD, the model suggests that the drop out while being in care is the highest, with 9% (Weibull) leaving the continuum at this point, but the time in this stage is also the most protracted, with it taking 14.6 months (Weibull) to transit out and achieve a suppressed VL.
This model implies that speeding progression through (ie, shortening stage occupancy times) and reducing the probability of dropout from each stage are complementary strategies to improve treatment and prevention outcomes in HIV. Speeding progress through the continuum and reducing the probability of dropout are 2 different, though related, operational tasks. The first task is efforts to accelerate progression toward the suppressed stage (ie, encouraging left-to-right flow along the continuum as represented in Fig. 1A). Examples might include novel efforts to identify infected but undiagnosed individuals and get them into care or initiating ART immediately upon diagnosis. The second task involves efforts to reduce loss to follow-up. Relevant interventions might include the use of patient navigators, peer counseling, directed youth case management, buprenorphine or methadone treatment for opioid-dependent patients, supporting emergency medication coverage, treatment education, transportation, housing assistance, and support groups for patients.16–18 To develop an intervention most relevant to the results presented here, one would need to know more about what is delaying diagnosis and viral suppression and what leads patients to drop out of care in these final stages of the continuum.
However, maximizing the probability of progression to the next stage in real-world settings may require larger expenditures. To understand how to allocate resources most efficiently to best improve patient outcomes would require understanding the costs of increasing the probability of progression and equivalently reducing the dropout probability as well as the effectiveness of interventions designed for these purposes for each stage. Although few interventions have been described in terms of their per-patient costs and effectiveness, there are a limited number of health economic evaluations of interventions particularly in the later stage of the continuum of care.19 New studies have examined the economic impact of a larger set of interventions, but on their impact on infections averted, not on the stage-specific transitions or dropout probabilities along the continuum.20 Thus, it is difficult to provide a quantitative analysis of resources needed to improve outcomes and further research is needed to provide the necessary estimates for the parameters.
Our model has other clinical implications. For instance, although the dropout rate and transition time from a second CD4 or VL test to a suppressed one are of the greatest magnitude when compared with the other stages, the average time from diagnosis to an initial assessment of a patient's immunological and virological status by a CD4 or VL test is approximately 3 months in the United States. Other research has demonstrated that about 20%–25% of new diagnoses in the United States are infections at advanced disease with less than 200 CD4+ T-lymphocytes/mm3 or an opportunistic infection.14 In this setting, even relatively short delays in linkage to care have heightened health risks for patients who are already severely immunocompromised, a disproportionate impact on new infections, and are associated with increased mortality for patients.8,21,22 Finally, in the Weibull model, the combined time during which patients know their HIV serostatus but are not virally suppressed (ie, from diagnosis to undetectable VL test) is close to 2 years (21.3 months) and the combined probability of dropout is 22.9%. This indicates that many HIV+ patients may be in contact with the health care system, but “stuck” in it, with delays that present considerable risks to them and their sexual partners and with almost a quarter of them dropping out of the system while ostentibly in care.
Our model is the first representation of the treatment continuum using a queueing model, but it is a basic one. One weakness of our model is that it does not account for people exiting the continuum during the period of observation and returning to it in a subsequent time period, which has been called a side door into care.23 To build a more complex model, longitudinal data on CD4 and VL tests for individual patients are needed and may soon be available from the sources we have used (ie, as HIV surveillance data including CD4 and VL test results become available for more years). One of the goals of this research is to provide a tool to guide decision making with the data that are easily available to local officials. Even if our model fails to capture the complicated trajectories of patients entering, exiting, and entering the continuum of care on numerous occasions, the results we show here can be thought of as a lower bound estimate for the expected number of patients who achieve viral suppression. That is, because we are making the assumption that patients, once they leave the continuum, are not returning to it, our results represent a worst-case scenario.
Our model also does not capture important heterogeneity in patient behavior or demographic characteristics. For example, it does not reflect what would happen if there were 2 classes of individuals with separate hazards, such as one high-risk group that became unsuppressed early on and another low-risk group that had consistent viral suppression over the long term nor does it depict the trajectories for specific populations, such as young men-who-have-sex-with-men, people of color, or people who use drugs, which would provide a more specific picture of the bottlenecks in the continuum. However, our goal in this article was to model mean passage times through the continuum and including analyses of mixture distributions for waiting times is beyond the scope of this article.
Our model also assumes that incidence is relatively stable.1 However, incidence is not stable among certain populations in the United States, and is increasing in young men-who-have-sex-with men and geographical areas such as in the American South, although more recent research has suggested decreases in new HIV diagnoses overall.24–27 In these situations, a more complicated model can be developed in which the rate of new infections is a function of time.
Understanding the HIV CC is a vital part of ensuring optimal care for persons living with HIV and reducing HIV transmission from those who are not virally suppressed.8 The 3 threats to successful suppression on ART, “late diagnosis, sluggish linkage to care, and fleeting retention” are all temporal phenomena that are compromising patient health and efforts to control the HIV epidemic in the United States, where up to 70% of people living with HIV do not yet have their virus under control.1,28 Our model deepens our knowledge of how the continuum operates across time, but there is more work to do to understand how to best intervene to improve patient outcomes, particularly among different demographic groups, which may have different trajectories through the continuum. Although the diagnosis of bottlenecks (ie, long-stage occupancy times before viral suppression) in the HIV continuum has been a focus of research including ours, there is a need for economic analyses to clarify the costs and effectiveness of interventions targeting the HIV CC to efficiently allocate resources. However, the insights offered by our model have policy implications that can be helpful to clinicians and program managers now by describing where patients get stuck in the systems of care and where they are most likely to leave the system altogether.
NA-ACCORD Collaborating Cohorts and Representatives:
Adult AIDS Clinical Trials Group Longitudinal Linked Randomized Trials: Constance A. Benson and Ronald J. Bosch. AIDS Link to the IntraVenous Experience: Gregory D. Kirk. Fenway Health HIV Cohort: Stephen Boswell, Kenneth H. Mayer, and Chris Grasso. HAART Observational Medical Evaluation and Research: Robert S. Hogg, P. Richard Harrigan, Julio S. G. Montaner, Angela Cescon, and Tareq Ahmed. HIV Outpatient Study: Kate Buchacz and John T. Brooks. HIV Research Network: Kelly A. Gebo and Richard D. Moore. Johns Hopkins HIV Clinical Cohort: Richard D. Moore. John T. Carey Special Immunology Unit Patient Care and Research Database, Case Western Reserve University: Benigno Rodriguez. Kaiser Permanente Mid-Atlantic States: Michael A. Horberg. Kaiser Permanente Northern California: Michael J. Silverberg. Longitudinal Study of Ocular Complications of AIDS: Jennifer E. Thorne. Multicenter Hemophilia Cohort Study–II: James J. Goedert. Multicenter AIDS Cohort Study: Lisa P. Jacobson and Gypsyamber D'Souza. Montreal Chest Institute Immunodeficiency Service Cohort: Marina B. Klein. Ontario HIV Treatment Network Cohort Study: Sean B. Rourke, Ann N. Burchell, and Anita R. Rachlis. Retrovirus Research Center, Bayamon Puerto Rico: Robert F. Hunter-Mellado and Angel M. Mayor. Southern Alberta Clinic Cohort: M. John Gill. Study of the Consequences of the Protease Inhibitor Era: Steven G. Deeks and Jeffrey N. Martin. Study to Understand the Natural History of HIV/AIDS in the Era of Effective Therapy: Pragna Patel and John T. Brooks. University of Alabama at Birmingham 1917 Clinic Cohort: Michael S. Saag, Michael J. Mugavero, and James Willig. University of North Carolina at Chapel Hill HIV Clinic Cohort: Joseph J. Eron and Sonia Napravnik. University of Washington HIV Cohort: Mari M. Kitahata, Heidi M. Crane, and Daniel R. Drozd. Vanderbilt Comprehensive Care Clinic HIV Cohort: Timothy R. Sterling, David Haas, Peter Rebeiro, Sally Bebawy, and Megan Turner. Veterans Aging Cohort Study: Amy C. Justice, Robert Dubrow, and David Fiellin. Women's Interagency HIV Study: Stephen J. Gange and Kathryn Anastos.
NA-ACCORD Study Administration:
Executive Committee: Richard D. Moore, Michael S. Saag, Stephen J. Gange, Mari M. Kitahata, Keri N. Althoff, Rosemary G. McKaig, Amy C. Justice, and Aimee M. Freeman. Administrative Core: Richard D. Moore, Aimee M. Freeman, and Carol Lent. Data Management Core: Mari M. Kitahata, Stephen E. Van Rompaey, Heidi M. Crane, Daniel R. Drozd, Liz Morton, Justin McReynolds, and William B. Lober. Epidemiology and Biostatistics Core: Stephen J. Gange, Keri N. Althoff, Alison G. Abraham, Bryan Lau, Jinbing Zhang, Jerry Jing, Elizabeth Golub, Sharada Modur, Cherise Wong, Brenna Hogan, Weiqun Tong, Bin Liu, and Bin You.
1. Bradley H, Hall HI, Wolitski RJ, et al. Vital signs: HIV diagnosis, care, and treatment among persons living with HIV–United States, 2011. MMWR Morb Mortal Wkly Rep. 2014;63:1113–1117.
2. Mugavero MJ, Amico KR, Horn T, et al. The state of engagement in HIV care in the United States: from cascade to continuum to control. Clin Infect Dis. 2013;57:1164–1171.
3. Monitoring selected national HIV prevention and care objectives by using HIV surveillance data—United States and 6 US dependent areas—2010. HIV Surveill Suppl Rep. 2012;14–15.
4. Horberg MA, Hurley LB, Klein DB, et al. The HIV care cascade measured over time and by age, sex, and race in a large national integrated care system. AIDS Patient Care STDS. 2015;29:582–590.
5. Lesko CR, Sampson LA, Miller WC, et al. Measuring the HIV care continuum using public health surveillance data in the United States. J Acquir Immune Defic Syndr. 2015;70:489–494.
6. Rebeiro PF, Althoff KN, Lau B, et al. Laboratory measures as proxies for primary care encounters: implications for quantifying clinical retention among HIV-infected adults in North America. Am J Epidemiol. 2015;182:952–960.
7. Gardner EM, McLees MP, Steiner JF, et al. The spectrum of engagement in HIV care and its relevance to test-and-treat strategies for prevention of HIV infection. Clin Infect Dis. 2011;52:793–800.
8. Skarbinski J, Rosenberg E, Paz-Bailey G, et al. Human immunodeficiency virus transmission at each step of the care continuum in the United States. JAMA Intern Med. 2015;175:588–596.
9. Gill MJ, Krentz HB. Unappreciated epidemiology: the churn effect in a regional HIV care programme. Int J STD AIDS. 2009;20:540–544.
10. Miller WC, Lesko CR, Powers KA. The HIV care cascade: simple concept, complex realization. Sex Transm Dis. 2014;41:41–42.
11. Little JD. A proof for the queuing formula: L = λ W. Oper Res. 1961;9:383–387.
12. Freeman J, Hutchison GB. Prevalence, incidence and duration. Am J Epidemiol. 1980;112:707–723.
13. Karon JM, Song R, Brookmeyer R, et al. Estimating HIV incidence in the United States from HIV/AIDS surveillance data and biomarker HIV test results. Stat Med. 2008;27:4617–4633.
14. Hall HI, Song R, Szwarcwald CL, et al. Brief Report: time from infection with the human immunodeficiency virus to diagnosis, United States. J Acquir Immune Defic Syndr. 2015;69:248–251.
15. Cox C. Delta method. In: Encyclopedia of Biostatistics: John Wiley & Sons, Ltd; 2005. Available at: http://onlinelibrary.wiley.com/doi/10.1002/0470011815.b2a15029/abstract
. Accessed November 4, 2015.
16. Shah M, Risher K, Berry SA, et al. The epidemiologic and economic impact of improving HIV testing, linkage, and retention in care in the United States. Clin Infect Dis. 2016;62:220–229.
17. Burns DN, DeGruttola V, Pilcher CD, et al. Toward an endgame: finding and engaging people unaware of their HIV-1 infection in treatment and prevention. AIDS Res Hum Retroviruses. 2014;30:217–224.
18. Pilcher C, Hatano H, Dasgupta A, et al. Providing same day, observed ART to newly diagnosed HIV+ outpatients is associated with improved virologic suppression. 2015. Available at: pag.ias2015.org
. Accessed December 1, 2016.
19. Nosyk B, Krebs E, Eyawo O, et al. Cost-effectiveness analysis along the continuum of HIV care: how can we optimize the effect of HIV treatment as prevention programs? Curr HIV/AIDS Rep. 2014;11:468–478.
20. Jain KM, Maulsby C, Brantley M, et al. Cost and cost threshold analyses for 12 innovative US HIV linkage and retention in care programs. AIDS Care. 2016;28:1199–1204.
21. Crowe SM, Carlin JB, Stewart KI, et al. Predictive value of CD4 lymphocyte numbers for the development of opportunistic infections and malignancies in HIV-infected persons. J Acquir Immune Defic Syndr. 1991;4:770–776.
22. Hanna DB, Pfeiffer MR, Torian LV, et al. Concurrent HIV/AIDS diagnosis increases the risk of short-term HIV-related death among persons newly diagnosed with AIDS, 2002–2005. AIDS Patient Care STDS. 2008;22:17–28.
23. Hallett TB, Eaton JW. A side door into care cascade for HIV-infected patients? J Acquir Immune Defic Syndr. 2013;63:S228–S232.
24. Beyrer C, Sullivan P, Sanchez J, et al. The increase in global HIV epidemics in MSM. AIDS. 2013;27:2665–2678.
25. Reif S, Geonnotti KL, Whetten K. HIV infection and AIDS in the Deep South. Am J Public Health. 2006;96:970–973.
26. Johnson A, Hall H, Hu X, et al. Trends in diagnoses of HIV infection in the United States, 2002–2011. JAMA. 2014;312:432–434.
27. Frieden TR, Foti KE, Mermin J. Applying public health principles to the HIV epidemic—how are we doing? N Engl J Med. 2015;373:2281–2287.
28. Mascolini M. The three biggest HIV problems in the United States: late testing, late care, and early dropout. Res Initiat Treat Action. 2011;16:1–73.