Objective: To determine the sensitivity and specificity of tests for hepatitis B surface antigen (HbsAg), hepatitis C virus (HCV), and syphilis conducted by laboratories of 3 blood collection organizations in a rural area of China.
Methods: From October to December 2003, 1068 samples were collected from blood donors presenting to the 3 collection centers. All samples were tested twice using 2 different test kits for HBsAg, HCV, and syphilis. An aliquot was sent to the China National Center for Clinical Laboratories to confirm the local test results. Sensitivities and specificities of the 3 local blood centers/banks were calculated using the results of the National Center for Clinical Laboratories as the gold standard.
Results: The sensitivity of the 3 blood collection center/banks ranged from 0% to 63.2% for HBsAg. For HCV, the sensitivity was 0%, and for syphilis, ranged from 0% to 85.7%. There were no HBsAg positives in one of the blood center/banks, and no syphilis positives in the other. Thus, sensitivity could not be measured for these tests in these 2 facilities. Combining all 3 tests, the overall sensitivity was 55.6%. The specificity was 100%.
Conclusions: The sensitivity of the local laboratories was inadequate and could cause possible infection for an unacceptable number of blood recipients. Action needs to be taken to improve the quality of testing to ensure the safety of the rural blood supply.
From the *Division of Health Education and Behavioral Intervention, National Center for AIDS/STD Control and Prevention, Chinese Center for Disease Control and Prevention, Beijing, China; †School of Public Health, University of California at Los Angeles, Los Angeles, CA; ‡School of Medicine, University of California at Los Angeles, Los Angeles, CA; §The Cleveland Clinic, Cleveland, OH; and ∥Division of AIDS, Hunan Center for Disease Control and Prevention, Changsha, Hunan Province, China.
Supported by the US National Institute of Health Fogarty International Center training grant D43 TW000013.
Correspondence to: Roger Detels, MD, MS, Professor of Epidemiology, School of Public Health, University of California, Los Angeles, 630 South Charles Young Drive, 71-269 CHS, Los Angeles, CA 90095-1772 (e-mail: firstname.lastname@example.org).
Blood transfusions, although potentially life saving, carry significant risk to the recipients, including transmission of infectious diseases such as HIV, hepatitis B virus (HBV), hepatitis C virus (HCV), and syphilis. The epidemics of HIV and sexually transmitted diseases (STDs) have rapidly increased in China,1-5 HIV contaminated the plasma collection and supply in the 1990s.6-10 Until recently, very few at-risk persons have been tested for HIV, and routine testing for HIV is often not done in rural areas.11 The rapid rise in HIV and sexually transmitted diseases (STDs) has not been paralleled by an equivalent rise in HIV testing rates, which remain low.12-17 Excluding contaminated blood from the blood supply by means of accurate and reliable testing is therefore a critical step in ensuring the safety of blood particularly in rural areas.
In urban areas of China, good laboratory facilities are available, and there is a high enough demand for blood to sustain high quality laboratories. In rural areas, however, the safety of the blood supply is threatened by limited ability to sustain sophisticated laboratories with adequate quality management processes.13-17 In a rural area of Hebei, China, retesting of 5344 “safe” blood specimens collected by a city blood center showed false negative rates of 0.112% and 0.131% for HBV and HCV, respectively.12 To assess the situation, we compared test results for 3 infectious diseases from laboratories in the rural blood banks in another rural area of China with those from a reference laboratory.
SUBJECTS AND METHODS
One city-level blood center and 2 county-level blood banks, 1 in proximity to the county site and 1 remote, were selected for study. Blood collection organizations are authorized by the Department of Health. The city blood center serves a population of 4.6 million and collects about 25,000 units of blood annually; county blood bank A serves 950,000 persons and collects about 4000 units annually; and blood bank B serves 430,000 persons and collects approximately 2000 units annually. Donors included individual volunteers, groups of volunteers, and paid donors.
All donors presenting to the 3 collection sites from October through December 2003 were asked to participate in the study. If a donor consented, an additional 10 mL of blood was collected for supplementary testing. The study was approved by the institutional review boards of the University of California, Los Angeles, and the Chinese Academy of Preventive Medicine.
All samples were tested for HCV, HBV, and syphilis, in duplicate using 2 different test kits for each agent according to the routine procedures of the 3 blood collection organizations (Table 1). All tests were done by certified laboratory technicians. All testing procedures including results reading followed the instructions in the user manuals provided by test kit manufacturers. All test kits were licensed and manufactured domestically (in China). A positive sample or suspicious positive on either test was considered to be infected. An aliquot of each sample was transported to the China National Center for Clinical Laboratories (NCCL) for confirmation. NCCL is the only agency appointed by the Chinese Ministry of Health and the “Chinese Blood Bank Regulations” that is authorized to make a final confirmatory laboratory test result. Serology tests for hepatitis B surface antigen (HbsAg), HCV, and syphilis were performed at the NCCL, using 3 different test kits (1 imported, 2 domestic; Table 1) for initial screening. Imported confirmatory tests were used to confirm all positive or suspicious samples in the screening tests (Table 1). All tests by NCCL were performed by senior technicians and in accordance with manufacturer's instructions.
The study was reviewed and approved by the Institutional Review Board at the University of California at Los Angeles and the Institute Review Board at the National Center for AIDS/STD Control and Prevention, Chinese Center for Disease Control and Prevention.
Samples were collected from 1068 donors. The city blood center collected 650 samples, county blood bank A collected 200 samples, and county blood bank B collected 218 samples. The refusal rates were 5%-10% in the city blood center, 0.5% in county blood bank A, and 1.4% in county blood bank B. Table 2 presents the demographic characteristics of the donors at the 3 centers. Donors at the city blood bank were younger than those at the county blood banks. Table 3 compares test results for the 3 rural blood collection organizations and NCCL, and Table 4 presents the sensitivity and specificity of the tests performed by the 3 local centers, using the NCCL test results as the gold standard.
Hepatitis B Surface Antigen
All 12 HBsAg positives identified by the city blood center reported positive (Table 2). However, 7 of the reported negatives were actually positive according to the NCCL laboratory; the sensitivity was therefore 63.2% (Table 3). In county blood bank A, there were no HBsAg-positive samples; therefore, sensitivity could not be evaluated. In county blood bank B, 2 of the positive samples repeated positive, but there were 2 false-negative tests; thus, the sensitivity was only 50% (Table 4). The specificity in the city blood center and the 2 county blood banks was 100%.
Hepatitis C Virus
The city blood center failed to identify the single positive sample identified by the NCCL laboratory. County blood bank A had no HCV-positive samples, and county blood bank B failed to identify the 2 positive samples. The specificity in the city blood center and the 2 county blood banks was 100%.
The city blood center identified 6 of 7 positive samples; thus, sensitivity was 85.7%. County blood bank A missed all 3 positive samples (sensitivity = 0%), and county blood bank B had no positive samples. The specificity was 100% in all 3 facilities.
Composite Sensitivity and Specificity
Among the 650 samples from the city blood center, 27 were confirmed as positive, 9 of which had not been detected, rendering a sensitivity of 66.7% (Table 5). The specificity was 100%.
Among the 200 samples from county blood bank A, 3 were confirmed as positive, all of which were undetected (sensitivity = 0%). There were no false-positive samples; therefore, specificity was 100%.
Among the 218 samples from county blood bank B, 6 were confirmed as positive, among which 4 had not been detected (sensitivity = 33.3%). The specificity was 100%.
The composite sensitivity was 55.6% (only 20 of the 36 tests positive at the NCCL were identified by the local laboratories), and the specificity was 100%. Overall, 14 of every 1000 blood units (1.4%) labeled by the city blood center as pathogen-free would be expected to be contaminated with 1 of these 3 agents, as would 15 of 1000 (1.5%) from county blood bank A and 19 of 1000 (1.9%) from county blood bank B.
Exclusion of infectious donations from the blood supply is primarily dependent on accurate and reliable testing for transfusion-transmitted pathogens. Our study was designed to detect differences in donor test results between 3 identified blood centers and the laboratory designated as the authoritative laboratory for donor test confirmation by the Chinese Ministry of Health. Using the NCCLs as the standard for testing, our study reveals that there were serious problems with detecting HBsAg, HCV antibodies, and syphilis antibodies in the city blood center and in the 2 county-level blood banks. Retesting the city blood center samples identified the highest proportion of contaminated samples, 66.7%, which means that they would have labeled almost one-third of the infected blood units as pathogen-free. County blood bank B would have labeled two-thirds of the contaminated units as pathogen-free, and county blood bank A, all of the contaminated units as pathogen-free. Because the prevalence of pathogens was low in the study populations, the calculation of the sensitivities was unstable, and the confidence limits for sensitivity and specificity were wide in some instances.
Accuracy and reliability of test results are a function of the sensitivity and specificity of test kits, quality of specimen, competency of testing personnel, and adherence to good laboratory practices. Our study was not designed to identify which of these factors was responsible for the discrepant results. We cannot say whether the apparently low sensitivity in the rural laboratories was due to the poor quality of test kits themselves, or due to test procedures by the laboratory technicians, or both. It is also possible, but less likely, that the results of the NCCLs, which we used as the “gold standard”, were incorrect.
Our results do indicate that reliability of donor infectious disease screening performed at the 3 collection centers we studied is uncertain and that there is a need to assess to what degree this may be true throughout similar rural communities. In China, urban blood collection centers are generally staffed with trained laboratory professionals and are expected to have quality assurance measures in place. However, it is hard to recruit highly trained professionals to work in the rural areas, and quality assurance may be an unfamiliar concept.
As the prevalence of transfusion-transmitted disease increases in the population, the threat to the blood supply increases. Measures to standardize and improve donor infectious disease screening are urgently needed. These measures should include validation of test kits, better training, implementation of standardized quality control and quality assurance procedures, and periodic recertification of laboratory technicians. Most of these recommendations are already included in the official blood collection regulations18-21 but are not uniformly enforced, especially in rural areas.
The authors thank Professor Hongbo Zhang from Anhui Medical University and Dr. Guodong Mi from China CDC/NCAIDS; Drs. Jianmei He, Biyun Qin and Jun Zheng from Hunan CDC; and the collaborative research team staff from Changde City Center for Disease Control and Prevention, Changde City Blood Center, and 2 local county blood banks for their participation in the baseline survey. The authors also thank Dr. Jinming Li and his staff for performing laboratory tests at the NCCL in Beijing, and Wendy Aft for editing assistance.
1. Abrams HK. The resurgence of sexually transmitted disease in China. J Public Health Policy
2. Beyrer C. Hidden epidemic of sexually transmitted diseases in China: crisis and opportunity. JAMA
3 Lin CC, Gao X, Chen XS, et al. China's syphilis epidemic: a systematic review of seroprevalence studies. Sex Transm Dis
4. Wu Z, Rou KM, Cui HX. The HIV/AIDS epidemic in China: history, current strategies and future challenges. AIDS Educ Prev
. 2004;16(3 suppl A):7-17.
6. Wu Z, Rou K, Detels R. Prevalence of HIV infection among former commercial plasma donors in rural eastern China. Health Policy Plan
7. Volkow P, del Rio C. Paid donation and plasma trade: unrecognized forces that drive the AIDS epidemic in developing countries. Int J STD AIDS
8. Qian HZ, Yang ZM, Shi XM, et al. Hepatitis C virus infection in former commercial plasma/blood donors in rural Shanxi Province, China. The China Integrated Program for Research on AIDS. J Infect Dis
9. Zaller N, Nelson KE, Ness P, et al. Demographic characteristics and risks for transfusion-transmissible infection among blood donors in Xinjiang autonomous region, People's Republic of China. Transfusion
10. Ji GP, Detels R, Wu Z, et al. Correlates of HIV infection among former blood/plasma donors in rural China. AIDS
11. Wu Z, Sun XH, Sullivan S, et al. Public health. HIV testing in China. Science
12. Li BS, Tan P, Yang BC, et al. An analysis of the infectiousness of blood specimens in blood banks. Hebei Med J
13. Shan H, Wang JX, Ren FR, et al. Blood banking in China. Lancet
14. Lu YF, Yin P, Liu TY. Analysis on quality control of blood in blood banks in a five-year program in Hunan province. Chin J Epidemiol
15. Cohen J. An unsafe practice turned blood donors into victims. Science
16. Dodd RY. Plasma collection and donor safety in rural China. J Infect Dis
17. Shang G, Seed CR, Wang F, et al. Residual risk of transfusion-transmitted viral infections in Shenzhen, China, 2001 through 2004. Transfusion
18. Department of Health Services. Regulations on Clinical Use of Whole Blood and Blood Components in Medical Settings
. Beijing, China: Chinese Ministry of Health; January 5, 1999.
19. Department of Health Services. Clinical Technical Guidelines on Transfusion
. Beijing, China: Chinese Ministry of Health; June 2, 2000.
21. Department of Health Services. Principles for Designing Agencies for Blood Collection and Supply
. Beijing, China: Chinese Ministry of Health; December 16, 2005.