Evaluation of the Performance of OraQuick Rapid HIV-1/2 Test Among Decedents in Kisumu, Kenya : JAIDS Journal of Acquired Immune Deficiency Syndromes

Secondary Logo

Journal Logo

Implementation Science

Evaluation of the Performance of OraQuick Rapid HIV-1/2 Test Among Decedents in Kisumu, Kenya

Opollo, Valarie PhDa; Nyakeriga, Emmanuel MScb; Kingwara, Leonard MScc; Sila, Alex BScb; Oguta, Macxine BSca; Oyaro, Boaz BSca; Onyango, Dickens MBChBd,e,f; Mboya, Frankline O. MScg; Waruru, Anthony PhDg; Musingila, Paul BScg; Mwangome, Mary MBChBb; Nyagah, Lilly M. MBChBc; Ngugi, Catherine MBChBc; Sava, Solomon MBChBc; Waruiru, Wanjiru MBChBb; Young, Peter W. MBChBg; Junghae, Muthoni PhDg

Author Information
JAIDS Journal of Acquired Immune Deficiency Syndromes 89(3):p 282-287, March 1, 2022. | DOI: 10.1097/QAI.0000000000002857

Abstract

INTRODUCTION

The annual number of global deaths from AIDS-related illnesses among people living with HIV has declined from a peak of 1.7 (1.3–2.4) million in 2004 to 770,000 (570,000–1,100,000) in 2018.1 Estimates from the 2018 AIDS survey in Kenya indicate a HIV prevalence of 4.9%,2 in the same year, approximately 25,000 people died from AIDS-related illnesses. Although this is still high, the death rate has declined steadily from 64,000 in 2010.3 Studies conducted among decedents in Kisumu and Nairobi, Kenya have shown a HIV prevalence of 28.5% and 20.9%, respectively.4,5 Population-level all-cause and cause-specific death rates are an important indicator of local disease epidemiology6,7 and can be used for monitoring trends in population health status.8,9 However, such reliable data are scarce, thus limiting efforts for health policy formulation, planning, monitoring, and evaluation in documenting the country's progress towards the Sustainable Development Goals. Creating simple, routine ascertainment of HIV status among all deaths in a given jurisdiction would allow for more direct monitoring of mortality patterns in the HIV-infected population and mathematical modelling for estimation of HIV incidence.

Methods for mortality surveillance in limited resource settings include conducting full or verbal autopsies (VAs) or testing for HIV from blood drawn from decedents. Verbal autopsy is a tool for retrospectively interviewing families/caregivers of the deceased to understand the circumstances that have led to death.10 VAs, in particular, have significantly contributed to the understanding of mortality in resource-limited settings but have limitations, especially for diagnosing illnesses with non-specific symptoms including HIV.11 Testing for HIV involving collection of blood through trans-thoracic needle biopsies or intravenous methods have been used previously and found to be feasible.4,12 However, in some populations, blood collection is not well accepted for religious or cultural reasons.13 Additionally, using blood samples for HIV testing can be logistically challenging because of factors such as safety during collection and handling during transportation to testing point. Samples collected using noninvasive techniques such as oral fluids14,15 provide a viable alternative. In the past 2 decades, oral fluid was introduced as an additional sample type to plasma, dried blood spots (DBSs), and serum for HIV antibody-based assays,14,16 and one that is preferred over blood-based testing.17,18 Oral fluid rapid HIV assays have only been validated among living persons.

With the possibility of using this sample type for HIV-related mortality surveillance, we set out to evaluate the performance of OraQuick Rapid HIV-1/2 test kit among decedents. The assay performance was evaluated in both preembalmed and postembalmed specimens to determine if the embalming process would interfere with the kit functionality. The specificity and sensitivity of the OraQuick Rapid HIV-1/2 antibody test on the oral fluids from decedents was compared with the results obtained from matched whole blood specimen using the national HIV testing algorithm.19 These findings will be used to inform HIV-associated mortality surveillance systems, policy, planning, monitoring, and evaluation in the country.

METHODS

Study Setting, Participants, and Sample Size

This substudy was part of a larger cross-sectional HIV surveillance study carried out between April 16, 2019 and July 12, 2019, among decedents admitted to the Jaramogi Oginga Odinga Teaching and Referral Hospital mortuary,20 Kisumu County, in the Nyanza region of western Kenya. This mortuary has the largest volume of bodies admitted in Kisumu County and is colocated on the same campus as the Kenya Medical Research Institute's (KEMRI) Clinical Research Center (CRC) laboratory where all study samples were tested. Informed consent was waived by the ethical review committees. The decedents admitted in the mortuary were either hospital deaths or brought in dead that is occurring outside of a health facility. Police cases that required a postmortem for legal reasons were also included. We excluded decedents who at the time of sample collection were dead for more than 48 hours, were already preserved, whose condition was too deteriorated, or had blood in the oral cavity. The eligibility criteria are shown in Figure 1.

F1
FIGURE 1.:
Flow chart of enrolment to OraQuick substudy.

We set out to validate a simple, minimally invasive procedure for testing HIV status in decedents that could potentially be rolled out widely in settings with a significant burden of HIV to determine the rate of HIV among decedents. We evaluated the performance of OraQuick Rapid HIV-1/2 test kit among matched preembalmed and postembalmed decedents admitted at the Jaramogi Oginga Odinga Teaching and Referral Hospital mortuary. For this substudy, sampling relied on the decedents from the larger study and sample size calculation was based on Clinical and Laboratory Standards Institute guidelines21 for validation of qualitative tests that requires testing of a minimum 120 samples. The sample size was increased by 10% to account for potential losses; specifically, the need to carry out testing on oral fluids within a stipulated time frame of 30 minutes after sample collection. After convenience sampling and availability of matched preembalmed and postembalmed samples, a total of 132 decedents were used.

Sample Collection and Processing

Nonclotted cardiac blood (approximately 6 or 2 /4 mL for infants) was collected from unembalmed decedents through percutaneous transthoracic aspiration using a 12-cm needle, into a sterile Ethylenediaminetetraacetic acid blood collection tubes (Becton, Dickinson and Company, Franklin Lakes, NJ). Blood samples were stored at 2–8°C after collection and transported in a cooler box with ice packs to KEMRI CRC laboratory within 4 hours of collection.

Upon verification of specimen quality against a predefined acceptance criteria in the laboratory, the blood samples were used to test for HIV-1/2 antibodies as described below. DBS samples20 were prepared from the remaining blood and stored at −20°C in case additional testing was required to resolve inconclusive results.

The OraQuick Rapid HIV-1/2 test kit was used to collect preembalming and postembalming oral fluid samples from descedants that had a blood specimen collected according to the inclusion criteria. Postembalming samples were taken within an hour of embalming. Briefly, the swab was placed above the teeth against the outer gum and gently swabbed around the outer gums, both upper and lower, 1 time around while ensuring that the roof of the mouth or the inside of the cheek or tongue was not swabbed.

Sample Testing

Oral samples were tested immediately by trained morticians at the mortuary per manufacturer's instructions.22 Blood samples were tested at KEMRI CRC for HIV antibodies per the Kenya national HIV testing algorithm. Briefly, third-generation Determine HIV-1/HIV-2 (Abbott Diagnostic Division, Hoofddorp, the Netherlands) was used as the screening assay and First Response (PMC Medical Pty. Ltd) as the confirmatory assay. Serial HIV testing was used; samples that were nonreactive on the screening assay were reported as negative, whereas those that were reactive on the screening assay were retested using the confirmatory assay. If the results were concordant on both tests, then the results were reported as positive. Specimens with discrepant results on both tests were retested again, serially, using the screening and confirmatory tests. Samples reactive on both were considered positive. If the results were still discordant, they were then considered inconclusive, and a qualitative DNA PCR (Abbott RealTime HIV-1 assay) was performed on a DBS sample to confirm HIV status.

Data Analysis

Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), false detection rate (FDR), false omission rate (FOR), and their corresponding 95% confidence intervals (CIs) were calculated to evaluate the performance of OraQuick Rapid HIV-1/2 test on preembalming and postembalming oral fluid samples. We also performed a receiver operating characteristic (ROC) curve analysis of sensitivity against 1 − specificity and the area under the curve (AUC) to measure accuracy of the OraQuick Rapid HIV-1/2 test. The Kenya national algorithm for HIV diagnosis on blood was considered as the gold standard. Data were analyzed in STATA Version 14 (STATA Corporation, College Station, TX).

Ethical Considerations

The study was approved by KEMRI's Science and Ethical Review Unit (KEMRI/RES/7/3/1), JOOTRH ethics committee (ERC.IB/VOL.1/615), CDC Center for Global Health, Associate Director for Science (2018-256), and UCSF IRB (230355).

RESULTS

Demographic Characteristics of the Decedents

Results on overview of the decedents and HIV status is presented elsewhere.5 From April 1, 2019, to July 31, 2019, a total of 697 decedents were admitted into JOOTRH, out of which 132 decedents met the inclusion criteria for this substudy (Figure 1). The participants' demographics are shown in Table 1. Of the 132 decedents enrolled, 57 (43%) were female with a median age of 46 years (interquartile range [IQR] 18 months to 105 years) (Table 1).

TABLE 1. - Demographic Characteristics of the Enrolled Decedents With Matched Preembalming and Postembalming Oral Sample
Sex Total
Female Male
Age category (years):
 18 months to 9 years 6 5 11 (8%)
 10–14 0 4 4 (3%)
 15–24 2 6 8 (6%)
 25–34 8 14 22 (17%)
 35–44 5 14 19 (14%)
 45–54 4 10 14 (11%)
 55–64 10 3 13 (10%)
 65–74 9 10 19 (14%)
 75+ 13 9 22 (17%)
Decedent class:
 Hospital deaths 38 33 71 (54%)
 Brought in dead 19 42 61 (46%)
 Total 57 (43%) 75 (57%) 132 (100%)

Performance of the OraQuick Rapid HIV-1/2 Test at Preembalming

Gold standard results were based on final HIV result on preembalmed whole blood samples. Twenty-seven of the 132 blood samples (20.5%; 95% CI: 13.9% to 28.4%) tested using the gold standard were positive. The OraQuick Rapid HIV-1/2 detected a total of 28 positives (21.2%) using preembalmed oral fluid samples, of which 25 were true positives and 3 were false positives compared with the gold standard. The sensitivity and PPV was 92.6% (95% CI: 75.7% to 99.1%) and 89.3% (95% CI: 71.8% to 97.7%), respectively. Compared with the gold standard that detected 105 negative samples, OraQuick Rapid HIV-1/2 detected 102 HIV-negative samples from preembalmed decedents. Two samples were false negatives, giving a specificity of 97.1% (95% CI: 91.9% to 99.4%) and NPV of 98.1% (95% CI: 93.2% to 99.8%), respectively (Table 2). The AUC of the ROC curve for OraQuick Rapid HIV-1/2 test kit to distinguish between the positive and negative results on an oral fluid sample collected before embalming of the body was 94.9% (95% CI: 89.6% to 100%).

TABLE 2. - Performance of OraQuick Rapid HIV-1/2 Against the Gold Standard on Preembalmed and Postembalmed Samples
True Positive True Negative False Negative False Positive Sensitivity (95% CI) Specificity (95% CI) PPV (95% CI) NPV (95% CI) AUC (95% CI)
Preembalming OraQuick results 25 102 2 3 92.6% (75.7–99.1) 97.1% (91.9–99.4) 89.3% (71.8%–97.7%) 98.1% (93.2%–99.8%) 94.9% (89.6%–100%)
Post-embalming OraQuick results 25 100 2 5 92.6% (75.7–99.1) 95.2% (89.3–98.4) 83.3% (65.3–94.4) 98.0% (93.1–99.8) 93.9% (88.5%–99.4%)

Performance of the OraQuick Rapid HIV-1/2 Test at Postembalming

Of the 132 postembalmed samples tested, OraQuick Rapid HIV-1/2 detected 30 positives (22.7%) using postembalmed oral fluid samples, of which 25 were true positives and 5 were false positives compared with the gold standard. The sensitivity and PPV were 92.6% (95% CI: 75.7% to 99.1%) and 83.3% (95% CI: 65.3% to 94.4%), respectively (Table 2). Compared with the gold standard that detected 105 negative samples, OraQuick Rapid HIV-1/2 test detected 105 negative samples from the postembalmed samples. Two samples were false negative, giving a specificity of 95.2% (95% CI: 89.2% to 98.4%) and NPV of 98.0% (95% CI: 93.1% to 99.8%), respectively (Table 2). The AUC of the ROC curve for OraQuick Rapid HIV-1/2 test kit to distinguish between the positive and negative results on an oral fluid sample postembalming was reported to be 93.9% (95% CI: 88.5% to 99.4%).

DISCUSSION

To our knowledge, this is the first study to present findings on HIV testing using OraQuick Rapid HIV-1/2 test on preembalmed and postembalmed decedents. OraQuick Rapid HIV-1/2 test using oral swabs showed a sensitivity (92.6%) among decedents, similar to those observed among living subjects that found an average sensitivity of 93% among living subjects.13,23 The specificity was higher when the sample was collected preembalming (97.1%) compared with postembalming (95.2%). There were more false positives detected in the postembalmed samples; however, the difference was not statistically significant. It is unclear why this is the case, although in vitro studies have shown that cell fixatives, including formaldehyde, a compound of embalming fluids, can reveal antigenic sites that had been formerly masked.24 Additionally,25 the fixation process can also lead to nonspecific binding of antibodies. The postembalming samples were collected soon after the embalming was complete. This study did not evaluate the effect of time on embalming on the assay performance. Moreover, based on the high AUC values in our study and other studies, the OraQuick Rapid HIV-1/2 test kit is able to discriminate the true state of subjects preembalming and postembalming with reasonable accuracy.26,27

Our findings show that oral fluid may be a suitable sample for HIV testing in decedents for mortality surveillance. Testing for HIV in decedents using blood is complex: (1) it is an invasive procedure; (2) requires training of the mortuary staff on sample collection; (3) multiple attempts may be required for successful blood draw; (4) sharps waste originating from blood collection requires additional safety disposal procedures; (5) sample transport to the testing laboratory may be required; and f) there are concerns related to consent, culture, and religion.28 In comparison, HIV testing using oral specimen samples is minimally invasive, requires minimal training, sample collection and testing are performed using the same device, and testing can be done in a mortuary setting with minimal training. Additionally, findings from several studies have shown that oral fluids have a lower HIV transmission risk compared with blood.14,16–18,29 Considering all factors above, including the costs attached to each factor, implementing oral testing may be a preferred option compared with blood-based testing in mortuary settings for surveillance purposes.

OraQuick Rapid HIV-1/2 is a 1-test assay compared with the national Kenya HIV testing algorithm, which is a 2-test blood sample assay requiring confirmation of the initial result. This makes it simple for implementation in a mortuary setting as long as training is done and the manufacturer's instructions are followed. However, based on evidence from previous studies that false-negative and false-positive test results occur with oral rapid tests,30–34 there is need for continuous and thorough quality assurance measures during implementation of oral fluids HIV rapid testing. In a mortuary setting, the test results may be used for prevalence estimation and not individual diagnosis.

Having demonstrated the feasibility of using OraQuick Rapid HIV-1/2 test for HIV prevalence estimation among decedents, it may be considered for implementation in future HIV-associated mortality surveillance activities in the country. With these findings, a guidance document on mortuary and hospital-based surveillance of HIV-associated mortality in countries with high prevalence of HIV infection, including Kenya, may be developed. This study had a few limitations. First, the study was conducted in the western part of Kenya in Kisumu which has a higher HIV prevalence rate (17.5%)35 than most of other regions in Kenya. Additionally, this study showed a high HIV prevalence among the samples tested, 4 times higher than the national prevalence of 4.9% and almost similar to the HIV prevalence in Kisumu County; a similar study also showed a high HIV prevalence rate among the same population.4 The positive and NPVs of diagnostic tests are affected by the prevalence of the disease, and therefore, as prevalence increases, PPV increases and NPV decreases. Thus, although the performance of OraQuick (sensitivity and specificity) in this study is presumably generalizable, the NPV and PPV may not be generalizable. Second, testing of oral fluids using OraQuick was conducted in a mortuary setting after fulfilling study-specific requirements. Mortuary settings outside of a study protocol may not offer the same stringent measures to ensure accuracy of test results. Proper training and adherence to the manufacturers' instruction on testing procedures may resolve this if the test is conducted in a setting outside the laboratory. With the use of oral fluid, unlike whole blood, serum, or plasma specimen for rapid HIV antibody testing, there is no stored sample that is available in case of need for repeat or confirmatory testing. Finally, the CIs in our study are wide because of the limited sample size; therefore, any conclusions drawn from our findings need to be interpreted with caution.

Although widespread access to ART has reduced HIV-related mortality in high-income countries,36,37 decedents showed a high HIV prevalence in this study. Availability of HIV mortality data can be used in the evaluation of ART impact and related programs in strengthening the health care systems and HIV care. This study showed that it is feasible to collect oral swabs from decedents and test for HIV antibodies using OraQuick Rapid HIV-1/2, with resulting relative high sensitivity and specificity. For mortuary-based HIV surveillance in particular, OraQuick Rapid HIV-1/2 can be used for HIV-associated mortality surveillance systems. Additional studies evaluating the performance of the OraQuick Rapid HIV-1/2 test among decedents in differing HIV transmission settings would help to inform on the application of this technique to the wider decedents population.

ACKNOWLEDGMENTS

The authors would like to acknowledge the study team of the Mortuary surveillance study, and all various implementing institutions, partners, and stakeholders that made this study successful and all those who made contributions in writing and reviewing this article. This article has been published with permission from the Director KEMRI.

REFERENCES

1. UNAIDS. UNAIDS DATA, 2008: UNAIDS; 2019. Available at: https://www.unaids.org/sites/default/files/media_asset/2019-UNAIDS-data_en.pdf.
2. National AIDS and STI Control Programme (NASCOP). Preliminary KENPHIA 2018 Report. Nairobi: NASCOP; 2020.
3. AIDSInfo. Global data on HIV Epidemiology and Response. UNICEF Kenya Country Office Annual Report 2019; Available at: https://www.unicef.org/media/90381/file/Kenya-2019-COAR.pdf.
4. Ali H, Catherine K, Muthoni L, et al. Evaluation of an HIV-related mortuary surveillance system—Nairobi, Kenya, two sites. MMWR Surveill Summ.. 20152018;67:1–12.
5. Onyango DO, van der Sande MAB, Musingila P, et al. High HIV prevalence among decedents received by two high-volume mortuaries in Kisumu, western Kenya, 2019. PLoS One. 2021;16:e0253516.
6. Bowden S, Braker K, Checchi F, et al. Implementation and utilisation of community-based mortality surveillance: a case study from Chad. Confl Health. 2012;6:11.
7. Groenewald P, Bradshaw D, Daniels J, et al. Local-level mortality surveillance in resource-limited settings: a case study of Cape Town highlights disparities in health. Bull World Health Organ. 2010;88:444–451.
8. Checchi FRL. Interpreting and using mortality data in humanitarian emergencies: a primer for non-epidemiologists. Vol 52. London, United Kingdom: Overseas Development Institute; 2005.
9. Thieren M. Health information systems in humanitarian emergencies. Bull World Health Organ. 2005;83:584–589.
10. WHO. Verbal Autopsy Standards: Ascertaining and Attributing Causes of Deaths. The WHO Verbal Autopsy Instrument. Geneva, Switzerland: World Health Organization; 2012.
11. Soofi SB, Ariff S, Khan U, et al. Diagnostic accuracy of WHO verbal autopsy tool for ascertaining causes of neonatal deaths in the urban setting of Pakistan: a hospital-based prospective study. BMC Pediatr. 2015;15:144.
12. Nyagah LM, Young PW, Kim AA, et al. HIV-related deaths in Nairobi, Kenya: results from a HIV mortuary surveillance study. J Acquir Immune Defic Syndrom (1999). 2019;81:18–23.
13. Nkenfou CN, Kembou JE, Temgoua ES, et al. Evaluation of OraQuick(R) HIV-1/2 as oral rapid test. Afr J Infect Dis. 2013;7:27–30.
14. Delaney KP, Branson BM, Uniyal A, et al. Performance of an oral fluid rapid HIV-1/2 test: experience from four CDC studies. AIDS. 2006;20:1655–1660.
15. Sangaré KA, Koffi AR, Coulibaly IM, et al. [Could saliva be used to detect HIV seroconversion?. Sante (Montrouge, France). 1997;7:303–307.
16. Pant Pai N, Joshi R, Dogra S, et al. Evaluation of diagnostic accuracy, feasibility and client preference for rapid oral fluid-based diagnosis of HIV infection in rural India. PLoS One. 2007;2:e367.
17. Nkenfou CN, Kembou JT, Djikeng A, et al. An evaluation of human immunodeficiency virus oral screening test awareness and preferences in the West region of Cameroon. J Infect Public Health. 2015;8:254–259.
18. Schwandt M, Nicolle E, Dunn S. Preferences for rapid point-of-care HIV testing in primary care. J Int Assoc Physicians AIDS Care (Chic). 2012;11:157–163.
19. NASCOP MoH. Guidelines for HIV Testing Services in Kenya. Nairobi, Kenya; 2015.
20. NASCOP. Mortuary and Hospital-Based Surveillance of HIV-Associated Mortality in Kisumu County: Final Report. Nairobi; 2020.
21. Clinical and Laboratory Standards Institute (CLSI). User Protocol for Evaluation of Qualitative Test Performance 2008. Second: Available at: https://clsi.org/about/blog/nucleic-acid-testing-validation-and-verification/.
22. Orasure technologies. OraQuick ADVANCE® rapid HIV-1/2 antibody test package insert. Available at: https://www.orasure.com/products-infectious/products-infectious-oraquick.asp.
23. Zelin J, Garrett N, Saunders J, et al. An evaluation of the performance of OraQuick ADVANCE Rapid HIV-1/2 Test in a high-risk population attending genitourinary medicine clinics in East London, UK. Int J STD AIDS. 2008;19:665–667.
24. Pudney J, Anderson D. Effects of fixation and paraffin embedding on the immunohistological detection of cell-associated HIV-1 by different monoclonal antibodies. J Histochem Cytochem. 1995;43:857–862.
25. Li L. Immunocytochemistry: Theory and Practice. Boca Raton. FL: CRC Press; 1988.
26. Kumar R, Indrayan A. Receiver operating characteristic (ROC) curve for medical researchers. Indian Pediatr. 2011;48:277–287.
27. Lalkhen AG, McCluskey A. Clinical tests: sensitivity and specificity. Continuing Edu Anaesth Crit Care Pain. 2008;8:221–223.
28. De Cock KM, Zielinski-Gutiérrez E, Lucas SB. Learning from the dead. New Engl J Med. 2019;381:1889–1891.
29. Greby SFB, Royalty J, Fanning M, et al. Use of simple oral fluid HIV-tests in CDC-funded facilities. Program and Abstracts of the. XIV International Conference on AIDS 2002.
30. Facente SN, Dowling T, Vittinghoff E, et al. False positive rate of rapid oral fluid HIV tests increases as kits near expiration date. PLoS One. 2009;4:e8217.
31. Jaspard M, Le Moal G, Saberan-Roncato M, et al. Finger-stick whole blood HIV-1/-2 home-use tests are more sensitive than oral fluid-based in-home HIV tests. PLoS One. 2014;9:e101148.
32. O'Connell RJ, Merritt TM, Malia JA, et al. Performance of the OraQuick rapid antibody test for diagnosis of human immunodeficiency virus type 1 infection in patients with various levels of exposure to highly active antiretroviral therapy. J Clin Microbiol. 2003;41:2153–2155.
33. Pant Pai N, Balram B, Shivkumar S, et al. Head-to-head comparison of accuracy of a rapid point-of-care HIV test with oral versus whole-blood specimens: a systematic review and meta-analysis. Lancet Infect Dis. 2012;12:373–380.
34. Pavie J, Rachline A, Loze B, et al. Sensitivity of five rapid HIV tests on oral fluid or finger-stick whole blood: a real-time comparison in a healthcare setting. PLoS One. 2010;5:e11581.
35. NASCOP. Preliminary KENPHIA 2018 Report. Nairobi; 2020.
36. Danforth K, Granich R, Wiedeman D, et al. Global mortality and morbidity of HIV/AIDS. In: rd, Holmes KK, Bertozzi S, et al, eds. Major Infectious Diseases. Washington, DC; 2017.
37. Group TAS, Danel C, Moh R, et al. A trial of early antiretrovirals and isoniazid preventive therapy in Africa. N Engl J Med. 2015;373:808–822.
Keywords:

OraQuick; HIV; rapid testing; minimally invasive HIV testing; HIV mortality surveillance

Copyright © 2021 The Author(s). Published by Wolters Kluwer Health, Inc.