Background: As one way of assessing the impact of Avahan, the India AIDS Initiative of the Bill & Melinda Gates Foundation, we examined the association between HIV prevention program indicators and changes in HIV prevalence among female sex workers (FSWs) between 2005 and 2009.
Methods: We conducted a secondary data analysis from 2 large cross-sectional surveys (2005–2006 and 2008–2009) across 24 districts in south India (n = 11,000 per round). A random-effect multilevel logistic regression analysis was performed using HIV as the outcome, with individual independent variables (from both surveys) at level 1 and district-level FSW-specific program indicators and contextual variables at level 2. Program indicators included their 2006 value, the difference in their values between 2008 and 2006, and the interaction between this difference and study round.
Results: HIV prevalence among FSWs decreased from 17.0% to 14.2% (P < 0.001). This decline varied significantly (P = 0.006) across levels of difference in program coverage (% of FSWs contacted by the program in a given year). Odds ratios comparing HIV prevalence between rounds changed with the level of increase in coverage and were statistically significant with coverage increase ≥ quartile (Q) 1: odds ratio, 0.85 at Q1; 0.78 at Q2; 0.66 at Q3; and 0.51 at Q4.
Conclusions: These findings suggest that increased program coverage was associated with declining HIV prevalence among FSWs covered by the Avahan program. The triangulation of our results with those from other approaches used in evaluating Avahan suggests a major impact of this intervention on the HIV epidemic in southern India.
A multilevel analysis of 2 surveys (2005, 2009) among female sex workers in India shows that increased prevention program coverage between surveys was associated with a decrease in HIV prevalence.
From the *Centre de recherche du CHU de Québec, Québec, Canada; †Département de médecine sociale et préventive, Université Laval, Québec, Canada; ‡CHARME-India II Project, Bangalore, India; §Department of Epidemiology, National Institute of Mental Health and Neurosciences, Bangalore, India; ¶Karnataka Health Promotion Trust, Bangalore, India; ∥St John’s Research Institute, Bangalore, India; **National AIDS Research Institute, Pune, India; ††FHI 360, Washington, DC; ‡‡Département de mathématiques et statistique, Université Laval, Québec, Canada; and §§Department of Community Health Sciences, University of Manitoba, Winnipeg, Canada
Acknowledgments: The authors thank all the field data collection teams and the women who agreed to participate in the surveys. Without them, this study would not have been possible. We also thank Tinku Thomas for her contribution to the data analysis. This research was funded by the Bill & Melinda Gates Foundation. The views expressed herein are those of the authors and do not necessarily reflect the official policy or position of the Bill & Melinda Gates Foundation. There is no conflict of interest.
This study was presented, in part, at the STI & AIDS World Congress; Vienna; July 14–17, 2013.
Correspondence: Michel Alary, MD, PhD, CHU de Québec, Hôpital du Saint-Sacrement, 1050 Chemin Ste-Foy, Québec, QC, Canada G1S 4L8. E-mail: firstname.lastname@example.org.
Received for publication January 22, 2014, and accepted April 9, 2014.
Supplemental digital content is available for this article. Direct URL citations appear in the printed text, and links to the digital files are provided in the HTML text of this article on the journal’s Web site (http://www.stdjournal.com).
This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License, where it is permissible to download and share the work provided it is properly cited. The work cannot be changed in any way or used commercially.
Avahan, the India AIDS Initiative of the Bill & Melinda Gates Foundation, is a comprehensive HIV prevention program targeting the most at-risk populations in the states of India most affected by the HIV epidemic (Andhra Pradesh, Karnataka, Maharashtra, and Tamil Nadu in the south of the country, and Manipur and Nagaland in the northeast). It was initially implemented through a network of nongovernmental organizations (NGOs) and has progressively been transferred to government agencies and community-based organizations since 2008.
Because cluster randomized designs have major limitations for evaluating complex large-scale interventions,1,2 the initial impact evaluation plan for Avahan included serial cross-sectional studies in the high-risk populations, based on which sophisticated mathematical models were developed to estimate program impact in those populations, and in the general population.1,3 The use of this modeling approach has been complicated by the lack of adequate baseline data,4 but recently, published results using this approach suggest a major impact of Avahan on the HIV epidemic in Karnataka5,6 and in the 4 South India states mentioned above.7 A purely statistical approach based on HIV surveillance data among pregnant women was also used to estimate the overall Avahan impact in the 6 Avahan states.8 Although suggesting a positive impact of the intervention in the general population, this study has the limitation of not taking into account the nature of the Avahan intervention, including its various components, and does not allow for the analysis of the actual mechanism leading to the impact.9
We examined changes over time occurring in HIV prevalence among female sex workers (FSWs), the largest risk population in the program, between 2 large surveys carried out in 2005 to 2006 and 2008 to 2009, in 24 districts of the 4 southern states of India covered by Avahan, where the HIV epidemic is predominantly heterosexual and mainly driven by sex work.10,11 As indicators related to program coverage and implementation have shown very sharp increases between baseline and 2008,12 we considered the impact of these increases on the changes in HIV prevalence between surveys. Given the heterogeneity of the HIV epidemic in India,13 it is important to also consider the influence of broader contextual factors that may have an impact on the HIV epidemic in high-risk groups. We therefore carried out a multilevel statistical analysis of the individual, contextual and program factors impacting on HIV prevalence among FSWs, and on the changes in the prevalence levels between the 2 survey rounds.
The design and study procedures of the cross-sectional studies, known as integrated behavioral and biological assessments (IBBAs), have been described in detail elsewhere14,15 and are summarized in the Supplementary Online Material Methods section, http://links.lww.com/OLQ/A86, as are the main components of the Avahan intervention.
The common set of program indicators for all districts covered by Avahan has been described extensively elsewhere.12 For the purpose of the present analysis, we used data collected by the NGOs implementing the intervention in each district along with complementary information to estimate: (1) program coverage (proportion of FSWs contacted by the program at least once in a given year), (2) the proportion of FSWs contacted monthly, and (3) the proportion of condom requirement met in a given year (number of condoms distributed in a given year divided by the estimated number of commercial sexual acts by all FSWs in the same year). Details on the methods used to derive these estimates are provided in the Supplementary Online Material Methods section, http://links.lww.com/OLQ/A86. The 3 indicators were computed for years 2006 to 2008 because the information was complete for all districts only for that period (the program started being handed over to the government in 2008). In the statistical models, we used the 2006 values of the indicators and the difference between the 2008 and 2006 values.
We considered a total of 53 district-level contextual variables for inclusion in the multilevel statistical model (see complete list in the Supplementary Online Material Table, http://links.lww.com/OLQ/A87).
The study and its consent procedures were approved by the ethics committees of all institutions that were involved in the data collection for this study (see Supplementary Online Material Methods section for more details on ethical considerations http://links.lww.com/OLQ/A86).
We assessed differences in personal characteristics between participants who were tested for HIV and those who were not, and between participants in round 1 and those in round 2, using the χ2 test. We compared HIV prevalence between the study rounds for each of the 24 IBBA districts. We then built multilevel (FSW personal characteristics at level 1 and district-level contextual and program variables at level 2) logistic regression models with HIV prevalence as the outcome, using the round 1 and round 2 merged data set. Study round was considered as the main independent variable in our analyses because the difference in HIV prevalence between the rounds was our central interest. We also preselected a certain number of the individual variables from the questionnaire for inclusion as independent variables in the model because they could be confounders of the differences observed between rounds. This was done based on variables previously identified to be associated with HIV in the first IBBA round14 and of a priori knowledge from the literature (see the Supplementary Online Table for the complete list of individual variables considered). We entered all of these variables into a multilevel logistic regression model with a random intercept for the districts and a random coefficient for round because the difference in HIV prevalence varied widely between districts. We then removed sequentially from this model all the individual variables with P > 0.05, as long as they were not confounding the other associations, to arrive at a model with individual variables only.
We preselected the contextual variables for addition to the models above based on linear regression models with the aggregate HIV prevalence rate in each district as the dependent variable and the contextual variables as the independent variables. Those with a P value less than 0.05 in these models were then added to the previous multilevel models. Baseline HIV prevalence among FSWs in each district was also included in the model as an additional district-specific variable. The removal of nonsignificant variables at this stage led to the basic model with individual and district-level contextual variables.
To the basic model, we then added the 3 pairs of district-level program variables (2006 value and difference between 2008 and 2006), along with the interaction terms between the 2008 to 2006 difference and the round. We kept in the model only the program variables corresponding to a significant interaction (P < 0.05) with the round. Finally, because we were interested in factors that could impact the differences in the outcomes observed between the IBBA rounds, we examined one-by-one the interaction terms between the round and each of the other individual and district-level contextual factors included in the first multilevel model described above. We kept the statistical interactions that reached P < 0.05 in these models. This led to the final model, with assessment of the intervention impact, through the interaction terms between the study round and the 2008 to 2006 differences in program variables, and inclusion of other factors having a multiplicative statistical interaction with the round. All analyses described above were carried out using STATA IC 11.1 for Windows (StataCorp LP, College Station, TX).
Among the 14,601 women approached in round 1, 11,690 (80.1%) answered the questionnaire. Among the latter, 10,806 were tested for HIV (92.4%), 10,716 (91.7%) for syphilis, and 10,674 (91.3%) for gonorrhea and chlamydia (NG/CT). The overall participation rate was slightly lower in 2008: 15,682 women were approached, of whom 11,486 (73.2%) answered the questionnaire; however, among the participants, 10,901 (95.0%) were tested for HIV, 10,806 (94.1%) for syphilis and 10,880 (94.8%) for NG/CT. No data were available to compare participants with nonparticipants. However, Table 1 shows the comparison between participants who were tested for HIV and those who were interviewed only. There were significant differences for most variables examined. This is, however, largely due to the very large sample sizes of these surveys. In addition, the proportions among all participants were almost identical to those among those tested for HIV (see the “Total” columns in Table 1).
Table 2 shows the comparison between various characteristics of participating FSWs between rounds 1 and 2. The differences were significant for most variables examined. However, this was mostly for behavior or infections that were targeted by the Avahan program, such as condom use, violence, NG/CT, and syphilis prevalence. For the other significant variables, the actual differences in the distribution of their values between rounds were mostly small, with the statistical significance often due to the very large sample sizes of these surveys.
HIV prevalence declined significantly from 17.0% to 14.2% (P < 0.001) from 2005–2006 to 2008–2009 (Table 3). This decline was significant in 2 of the 4 states and 10 of the 24 districts. There was an increase in HIV prevalence in 4 districts, but it was statistically significant in only 1. Table 3 also shows the variation in program coverage and condom requirement met between the study rounds. There was a significant correlation between changes in HIV prevalence between 2006 and 2008 and changes in coverage (Spearman r = −0.410, P = 0.048), whereas such an association was borderline significant when considering condom requirement met (Spearman r = −0.398, P = 0.054). The 2 latter program indicators were also highly correlated together (Spearman r = 0.647, P = 0.006). The difference in the proportion of FSWs contacted on a monthly basis between 2006 and 2008 was not significantly correlated with the changes in HIV prevalence (Spearman correlation coefficient = −0.1992, P = 0.351) or with the changes in the other program indicators (data not shown).
The left columns of Table 4 show the results of the multilevel model without program variables and interaction terms. The adjusted odds ratio (AOR) comparing HIV prevalence in round 2 with that in round 1 was 0.76, with a narrow 95% confidence interval (95% CI) of 0.67 to 0.85. A number of demographic and behavioral variables were associated with HIV (Table 4). Surprisingly, women reporting consistent condom use with clients and carrying condoms with them had a significantly higher HIV prevalence. The only significant contextual variable among those examined was mean age at marriage of girls, with an approximately 8% lower HIV prevalence for each year of increase in this district-level variable. As expected, baseline HIV prevalence was also strongly associated with overall HIV prevalence. The random coefficient for the round had a variance significantly higher than zero, reflecting the high level of heterogeneity in the changes in HIV prevalence across districts. The variance of the random intercept, although much lower than in the null model, was also significantly different from zero (Table 4).
The right columns of Table 4 show that there was a significant negative interaction between the round and changes in program coverage between 2006 and 2008. The interaction terms between the round and changes in other program variables were not statistically significant and thus not kept in the model. Both baseline HIV prevalence and having a regular nonpaying partner also had significant multiplicative interactions with survey round. The only variable not involved in the interaction terms that did not remain significant compared with the previous model was mean age at marriage of girls at the district level. The variance of the random coefficient for the round, though significantly different from zero, was lower than that in the previous model, whereas the variance of the random intercept was now close to null in this model (Table 4).
Table 5 shows the decreases in HIV prevalence for the various categories of variables shown to have an interaction with the study round from the results presented in Table 4. The decrease in HIV prevalence was not as strong among women with a main nonpaying partner compared with those without, although the latter had a higher overall HIV prevalence. The decrease in HIV prevalence was not significant in districts with very low baseline HIV prevalence and significant for higher values starting at about the first quartile of this variable. Finally, there was a stronger decline in HIV prevalence in districts with a larger increase in program coverage between 2006 and 2008 (Table 5). The decrease in HIV prevalence was not significant when coverage was higher in 2006 than in 2008.
This multilevel analysis shows significant declines in HIV prevalence among FSWs in southern India between 2005 and 2009 that are strongly associated with increases in Avahan program coverage, thus suggesting a positive impact of the FSW intervention component of this intervention where implemented in a way ensuring sufficient increase in program coverage up until 2008. Indeed, larger increases in program coverage at the district level led to larger declines in HIV prevalence, with no significant decrease in districts occurring without an increase in coverage, and a reduction of approximately 50% in HIV prevalence in the districts with the highest increases in coverage.
This analysis controlled for a number of individual and contextual factors that could have potentially confounded this association, as well as for baseline HIV prevalence at the district level and its interaction with the round, thus taking into account the fact that decreases in prevalence were more likely to occur in districts with higher baseline values. The use of a random coefficient for the round took into account the wide variability in the changes in HIV prevalence between districts.
It was difficult to fully address the impact of the program indicator on condom requirement met because of the high correlation between its 2006 to 2008 district-level variation and that of program coverage. However, the borderline significant correlation between increases in condom requirement met and decreases in HIV prevalence at the district-level suggests that this indicator is also part of the mechanism leading to impact. Finally, it is possible that the actual coverage of the program is more important in terms of impact than the frequency of the contacts with the target population, as long as some (unknown) threshold is reached for the latter.
The associations that we found between HIV prevalence and the individual variables considered in the analysis are largely similar to what was found in an analysis of round 1 data.14 That condom use and condom carriage were both associated with a higher HIV prevalence may be due to reverse causation, with FSWs having acquired HIV before being reached by the interventions and starting to use condoms once they learned more about HIV, especially when they discovered their serological status. A similar phenomenon was observed in studies of the general population in southern India.13,16 Among the contextual district-level variables considered, only mean age at marriage of girls was significantly associated with HIV in the basic model. Interestingly, this factor was also associated with HIV prevalence among pregnant women attending antenatal care clinics in the same IBBA districts.17 However, in the model with program variables, mean age at marriage was not a significant predictor of HIV. Careful examination of the data showed that it was the introduction of the interaction between baseline HIV prevalence and the round that was mainly confounding this association (data not shown).
The results of this study constitute a significant addition to the overall picture of the Avahan impact evaluation. Whereas it has been shown that the implementation of the program was highly successful,12 that favorable time trends in intermediate outcomes (e.g., condom use and prevalence of curable sexually transmitted infections) occurred after implementation,18–20 that condom use was positively associated21 and sexually transmitted infection prevalence negatively associated22 with exposure to the intervention, and that the program seemingly had an impact on HIV prevalence at the general population level,8,23 the evidence for an impact on HIV prevalence among FSWs has so far been limited to time trends observed19,20 and mathematical modeling studies5–7 based on these trends. This is the first study showing a direct relationship between program exposure assessed through routine program monitoring and decrease in HIV prevalence in one of the vulnerable populations targeted by the intervention.
However, there are a number of limitations to this study. First, there was no randomization of the intervention and the assessment of the impact relies only on serial observational data. The decision not to use a randomized design for this evaluation was taken right at the start for reasons that have been summarized in previous publications.1,3 The limitations of community-randomized trials for “real-world” evaluations have since that time been acknowledged more widely.2 Furthermore, we were able to demonstrate an association between the level of intervention coverage and decreases in HIV prevalence at the district level, thus reaching a level of plausibility in the attribution of the impact on HIV prevalence to Avahan as per the framework proposed by Habicht et al.24
Second, we do not know the characteristics of the women who declined participation in the surveys and the proportion of refusals increased between the 2 rounds. It is impossible to assess the impact of refusals on the observed trends because no information is available on the women who did not participate. In addition, there were significant differences between women who provided biological samples and those who only accepted to be interviewed. However, for most variables, these differences were of small magnitude, given the very large sample sizes, or went in the same direction in both survey rounds. Moreover, the distribution of the variables considered in Table 1 among all participants was almost identical to that among those tested for HIV, because the proportion of FSWs not providing a sample among the participants was low in both rounds. Thus, important biases resulting from these differences when comparing HIV prevalence in both rounds are unlikely. Similar observations are relevant to the comparison of the characteristics of the participants between the rounds (Table 2): apart for the changes expected because of the intervention, the absolute differences were mostly small, although often statistically significant because of the very large sample sizes.
Third, given the potential of antiretroviral therapy (ART) to decrease HIV transmission,25 the increase in ART coverage between the study rounds could have been involved in the decrease in HIV prevalence we observed, whereas it could not been directly assessed because information on ART use by HIV-infected women was not collected in the IBBA surveys. This favorable impact of ART on HIV prevalence is, however, unlikely in our study. Indeed, out of an estimated 2.6 million HIV-infected people in India, only 6845 received ART in 2005, whereas coverage increased to 140,654 people on treatment (approximately 5% of all infected people) in 2008 and to 223,223 (approximately 9% of all infected people) in 2009.26 Antiretroviral therapy coverage thus remained relatively low until 2008 to 2009, by which time IBBA surveys among FSWs were completed in all districts. In addition, as ART improves survival, its expansion could have first led to an increase in HIV prevalence, despite a reduction in new HIV cases, as was recently observed in a highly affected community in South Africa.27 Consequently, if the increase in ART coverage between the study rounds had any impact on HIV prevalence trends during this period, it would likely have been to artificially mask a downward trend.
Finally, the first survey was carried out after more than 1 year of intervention in most districts, and the level of intervention coverage had already reached relatively high levels at that time; this could have led to an underestimation of the decrease of HIV prevalence between the study rounds and of the association between increases in program indicators and declines in HIV prevalence.
In conclusion, this study strongly suggests that the Avahan intervention, where appropriately implemented, had a favorable impact on HIV prevalence among FSWs in the 4 southern states of India covered by the intervention. The triangulation of our results with those from other approaches used in the Avahan evaluation5–8,23 suggests a major overall impact of this program on the HIV epidemic in southern India. Interventions targeting most at-risk populations, such as FSWs, should be scaled up in all countries where specific vulnerable populations contribute significantly to the spread of HIV.
1. Chandrasekaran P, Dallabetta G, Loo V, et al. Evaluation design for large-scale HIV prevention programmes: The case of Avahan, the India AIDS initiative. AIDS 2008; 22 (suppl 5): S1–S15.
2. Laga M, Rugg D, Peersman G, et al. Evaluating HIV prevention effectiveness: The perfect as the enemy of the good. AIDS 2012; 26: 779–783.
3. Boily MC, Lowndes CM, Vickerman P, et al. Evaluating large-scale HIV prevention interventions: Study design for an integrated mathematical modelling approach. Sex Transm Infect 2007; 83: 582–589.
4. Lowndes CM, Alary M, Verma S, et al. Assessment of intervention outcome in the absence of baseline data: ‘Reconstruction’ of condom use time trends using retrospective analysis of survey data. Sex Transm Infect 2010; 86 (suppl 1): i49–i55.
5. Boily MC, Pickles M, Lowndes CM, et al. Positive impact of a large-scale HIV prevention programme among female sex workers and clients in South India. AIDS 2013; 27: 1449–1460.
6. Pickles M, Foss AM, Vickerman P, et al. Interim modelling analysis to validate reported increases in condom use and assess HIV infections averted among female sex workers and clients in southern India following a targeted HIV prevention programme. Sex Transm Infect 2010; 86 (suppl 1): i33–i43.
7. Pickles M, Boily MC, Vickerman P, et al. Assessment of the population-level effectiveness of the Avahan HIV-prevention programme in South India: A preplanned, causal-pathway–based modelling analysis. Lancet Global Health 2013. http://dx.doi.org/10.1016/S2214-109X(13)70083-4
8. Ng M, Gakidou E, Levin-Rector A, et al. Assessment of population-level effect of Avahan, an HIV-prevention initiative in India. Lancet 2011; 378: 1643–1652.
9. Boerma T, de Zoysa I. Beyond accountability: Learning from large-scale evaluations. Lancet 2011; 378: 1610–1612.
10. Alary M, Jayachandran AA, Lowndes CM, et al. Ecological analysis of the association between high-risk population parameters and HIV prevalence among pregnant women enrolled in sentinel surveillance in four Southern India states. Sex Transm Infect 2010; 86 (suppl 1): i10–i16.
11. Vickerman P, Foss AM, Pickles M, et al. To what extent is the HIV epidemic in southern India driven by commercial sex? A modelling analysis. AIDS 2010; 24: 2563–2572.
12. Verma R, Shekhar A, Khobragade S, et al. Scale-up and coverage of Avahan: A large-scale HIV-prevention programme among female sex workers and men who have sex with men in four Indian states. Sex Transm Infect 2010; 86 (suppl 1): i76–i82.
13. Banandur P, Rajaram SP, Mahagaonkar SB, et al. Heterogeneity of the HIV epidemic in the general population of Karnataka state, south India. BMC Public Health 2011; 11 (suppl 6): S13.
14. Ramesh BM, Moses S, Washington R, et al. Determinants of HIV prevalence among female sex workers in four south Indian states: Analysis of cross-sectional surveys in twenty-three districts. AIDS 2008; 22 (suppl 5): S35–S44.
15. Saidel T, Adhikary R, Mainkar M, et al. Baseline integrated behavioural and biological assessment among most at-risk populations in six high-prevalence states of India: Design and implementation challenges. AIDS 2008; 22 (suppl 5): S17–S34.
16. Munro HL, Pradeep BS, Jayachandran AA, et al. Prevalence and determinants of HIV and sexually transmitted infections in a general population-based sample in Mysore district, Karnataka state, southern India. AIDS 2008; 22 (suppl 5): S117–S125.
17. Thamattoor UK, Thomas T, Banandur P, et al. Multi-level analysis of the predictors of HIV prevalence among pregnant women enrolled in sentinel surveillance in four southern India states. Sex Transm Infect 2011; 87 (suppl 1): A182.
18. Mainkar MM, Pardeshi DB, Dale J, et al. Targeted interventions of the Avahan program and their association with intermediate outcomes among female sex workers in Maharashtra, India. BMC Public Health 2011; 11 (suppl 6): S2.
19. Ramesh BM, Beattie TS, Shajy I, et al. Changes in risk behaviours and prevalence of sexually transmitted infections following HIV preventive interventions among female sex workers in five districts in Karnataka state, south India. Sex Transm Infect 2010; 86 (suppl 1): i17–i24.
20. Reza-Paul S, Beattie T, Syed HU, et al. Declines in risk behaviour and sexually transmitted infection prevalence following a community-led HIV preventive intervention among female sex workers in Mysore, India. AIDS 2008; 22 (suppl 5): S91–S100.
21. Deering KN, Boily MC, Lowndes CM, et al. A dose-response relationship between exposure to a large-scale HIV preventive intervention and consistent condom use with different sexual partners of female sex workers in southern India. BMC Public Health 2011; 11 (suppl 6): S8.
22. Yadav D, Ramanathan S, Goswami P, et al. Role of community group exposure in reducing sexually transmitted infection–related risk among female sex workers in India. PLoS One 2013; 8: e78361.
23. Banandur P, Mahajan U, Potty RS, et al. Population-level impact of Avahan in Karnataka state, south India using multilevel statistical modelling techniques. J Acquir Immune Defic Syndr 2013; 62: 239–245.
24. Habicht JP, Victora CG, Vaughan JP. Evaluation designs for adequacy, plausibility and probability of public health programme performance and impact. Int J Epidemiol 1999; 28: 10–18.
25. Cohen MS, Chen YQ, McCauley M, et al. Prevention of HIV-1 infection with early antiretroviral therapy. N Engl J Med 2011; 365: 493–505.
27. Zaidi J, Grapsa E, Tanser F, et al. Dramatic increases in HIV prevalence after scale-up of antiretroviral treatment: A longitudinal population-based HIV surveillance study in rural kwazulu-natal. AIDS 2013; 27:(Epub ahead of print) DOI:10.1097/QAD.0b013e328362e832.