Comparative Evaluation and Measure of Accuracy of ELISAs, CLIAs, and ECLIAs for the Detection of HIV Infection among Blood Donors in China

Background Enzyme-linked immunosorbent assay (ELISA) is the only serological method approved for blood screening in China. Automated chemiluminescence immunoassay (CLIA) and electrochemiluminescence immunoassay (ECLIA) had been used in clinical laboratories but not applied to screen HIV among blood donors. This study aimed to evaluate the performance of ELISA, CLIA, and ECLIA, focusing on the feasibility of CLIA/ECLIA for blood screening. Method 1029 blood donations from 14 blood centers screened by ELISA were enrolled in the study. All plasma samples were tested by eight ELISA assays in 16 blood centers, followed by the detection of CLIA and ECLIA methods in the National Center for Clinical Laboratories (NCCL), further confirmed by nucleic acid testing (NAT) and Western blot (WB). Results Of 1029 samples, 136 were confirmed as HIV positive. CLIA and ECLIA assay had similar sensitivities with ELISAs but showed higher specificity (CLIA: 99.1%, 885/893; ECLIA: 99.0%, 884/893), concordance rate (CLIA: 99.2%, 1021/1029; ECLIA: 99.1%, 1020/1029), and positive predictive value (PPV) (CLIA: 94.4%, 136/144; ECLIA: 93.8%, 136/145) than most of ELISA kits (>5 ELISAs) (P < 0.05). Kappa values of CLIA (0.967) and ECLIA (0.963) were the highest among all the serologic assays. Among 451 samples with initial ELISA reactivity, 315 were negatives, of which 307 (97.5%) and 306 (97.1%) were detected as nonreactive by CLIA (8 nonspecific reactions) and ECLIA (9 nonspecific reactions), respectively. Conclusion Compared with ELISA, CLIA and ECLIA are more specific and accurate in detecting HIV antibody/antigen and can keep more nonspecifically reactive donors detected by ELISA. CLIA and ECLIA can be used for the improvement of serological blood screening strategy to avoid the unnecessary loss of blood donors.


Background
Ever since the first identification of HIV infectious case in Ruili City, Yunnan province, in 1985, HIV has spread numerically and geographically throughout China. According to the updated report, approximately 849,602 people are living with HIV and 262,442 individuals died of HIV-associated diseases in China [1]. e epidemic of HIV has been shifted from high risk population into the general population, including blood donors in China [2,3]. e prevalence of HIV among blood donors in China is about 10.33 in 100,000 between 2000 and 2009 [4]. erefore, HIV screening is essential to ensure the strict safety of blood supply.
At present, NAT and ELISA are routinely applied to screen HIV infection. ELISA is the only approved serological assay for HIV screening among blood donations in China. e assay detects the presence of a ligand (commonly a protein) in a liquid sample through a solid-phase enzyme immunoassay (EIA) using antibodies directed against the protein to be measured [5]. e amounts of HIV antigens or antibodies are measured by the intensity of color produced by reaction between conjugate and substrate. CLIA and ECLIA methods use recombinant HIV antigens or antibodies coated paramagnetic microparticles that bind to HIV antigens or antibodies in plasma labelled recombinant HIV antigens or antibodies coated particles as conjugate. Antibody or antigen concentration is determined by the emitted light of antigenantibody reaction and measured using light reader [6,7].
CLIA and ECLIA, including sample preprocessing system and result analysis system from the same manufacturers, are fully automated and self-contained platforms which minimize operator involvement and have good reproducibility and partly avoid the false positive/negative brought by operator factors [8][9][10]. However, even if using the same kit in automatic ELISA platform in different Chinese blood centers, the preprocessing system, incubation and washing system, and microplate reader could be completely different, due to the open system of ELISA devices. e assembled automatic ELISA system is hard to ensure the standardization of results between different blood centers. Hence, the suitability for ELISA is defined by different parameters and may be further affected by other factors which are based on open system. e diversity of the virus including the prevalence of groups and subtypes and circulating recombinant forms can influence the effectiveness of the diagnosis [11]. e current study aimed to compare the performance between eight ELISAs and CLIA/ECLIA and discuss whether CLIA/ECLIA can be used for blood screening in China.

HIV Confirmatory Algorithm and Study Design. From
March 2015 to September 2015, 1029 blood donations detected as HIV reactive using one or two ELISAs which were collected from 14 blood centers or blood banks and were screened for HIV. e number of blood donations was equal to the number of blood donors. All blood donations underwent HIV confirmatory algorithm: all the initial negative samples were performed NAT in the National Center for Clinical Laboratories (NCCL), and initial positives were tested by Western blot (WB) by local centers for disease control and prevention (CDC); the samples with indeterminate results of WB were further confirmed using WB and NAT in NCCL. en, all the samples were sent to 16 blood screening laboratories for ELISA evaluation using one or two of the eight assays with automation systems; furthermore, CLIA and ECLIA screening among all the blood donations were performed in NCCL (Table 1). e results of the same ELISA reagent used by different laboratories in the same sample were not shown. e final result of each ELISA assay among 1029 blood donations was determined by more than half the results of different blood centers using the same ELISA. e study route was shown in Figure 1.

Statistical
Analyses. SPSS 21.0 software was used for statistical analysis. Chi-square tests were performed on all the examined outcomes to compare sensitivity, specificity, concordance rate, positive predictive value (PPV), and negative predictive value (NPV) between CLIA, ECLIA, and ELISAs; P < 0.05 was considered statistically significant. Sensitivity was the proportion of true positives among donations with serologic reactivity; specificity was calculated using the number of true negatives divided by nonreactive results in serologic assays. Concordance rate (accuracy) will be performed and calculated through the percentage of true positives and negatives among 1029 blood donations. PPV and NPV are the proportions of positive and negative results in diagnostic tests that are true positive and true negative results, respectively.
As shown in Table 3, the sensitivity of CLIA or ECLIA had no significant difference with 8 ELISAs (P < 0.05), only two or three samples were missed by several ELISAs (not shown), but these samples were detected by CLIA, ECLIA, and NAT. e CLIA and ECLIA showed higher specificities and PPVs than most of ELISAs (Wantai, KHB, Bio-Rad, Wantai [4 th ], Murex [4 th ], Livzon [4 th ]), P < 0.05. Collectively, no significant differences found in sensitivity and NPV between 8 ELISAs and CLIA/ECLIA (P < 0.05); Kappa values of CLIA (0.967) and ECLIA (0.963) were the highest among all the serologic assays. However, ELISA evaluations in some laboratories (HN, JN, LN) showed lower sensitivities and NPVs than CLIA and ECLIA (P < 0.05). InTec and Livzon ELISAs had similar specificities/PPVs/concordance rates to CLIA and ECLIA (P < 0.05). However, among the five HIV blood screening laboratories using InTec, ELISA results in HLJ and LN showed lower specificities and concordance rates, in comparison to CLIA/ECLIA (P < 0.05). In addition, CLIA and ECLIA had higher PPV and concordance rate than InTec ELISAs tested by LN and CQ, respectively, P < 0.05. Besides, of 2 blood centers using Livzon, the ELISAs tested by HZ and ZH were less specific than CLIA/ECLIA, and ELISA screening in ZH had lower PPV than CLIA/ECLIA.

Discussion
ELISA is the only approved serological assay for HIV screening among blood donations in China. CLIA and ECLIA have been proved to be at least as specific and sensitive as common assays in serological detection of many infectious diseases [12][13][14][15] but not applied for HIV blood screening in China. CLIA and ECLIA have been used for routine screening among blood donors in the US [16], Australia [17], Sweden [18], and Italy [10] for many years. Hence, evaluation of ELISA, CLIA, and ECLIA among blood donations is critical for the development of HIV serological screening strategy. To date, this comparative study firstly investigated the performance of 8 ELISA kits (including all ELISA kits for HIV blood screening in China) for the detection of HIV and comparing CLIA, ECLIA, and 8 ELISAs among blood donors. e sources of study samples were comprehensive, including 14 blood screening laboratories. Additionally, less comparative evaluation measure of accuracy between CLIA, ECLIA, and ELISA among blood donors focused on the feasibility of CLIA/ECLIA for blood screening and the improvement of serological screening strategy in China.
Using one or two HIV ELISA kits followed with NAT were required by Chinese Blood Bank Technical Operation Procedure (2015 version) to screen HIV in blood banks. e majority of the samples that tested initial ELISA reactive for HIV were nonspecific reactivity in the present study. is phenomenon may be related to the low prevalence of HIV [19], apart from the factors of reagent and laboratories.
e previous study reported that most of donations were discarded and donors were deferred for nonspecific reactivity [20]. According to an official investigation report about clinical blood transfusion, the growth rate of blood supply is still lower than the rate of growing clinical demand for transfusion [21]. ECLIA (97.1%, 306/315) and CLIA (97.5%, 307/315) methods could reduce 97% nonspecific reactions produced by ELISAs (Table 2). Hence, CLIA and ECLIA can be used for blood screening to avoid unnecessary loss of blood donations and also can be used for blood reentry [22].
In the study, we observed a high agreement in HIV antigen/antibody screening between CLIA and ECLIA, similar to Italy's study [10]. Previous studies indicated CLIA with high sensitivity, specificity, and high degree of automation for HIV antibody-antigen testing can be used for the detection of HIV infection [15,23,24]. 4 th generation serological assays can detect HIV antigen and antibody, while 3 rd generation serological assays only detect HIV antibody. e results showed that the specificity, concordance rate, and PPV of 3 rd generation ELISA kits were higher than 4 th generation ELISA kits, possibly due to higher sensitivity and nonspecific reactivity of 4 th generation ELISA kits [25,26]. However, CLIA and ECLIA, as 4 th generation serological assays, are more specific and accurate to detect HIV antigen/ antibody among blood donations, compared with the most of ELISAs (3 rd and 4 th generation ELISA). Note that specificity of CLIA and ECLIA was significantly higher than most of the ELISA kits, which demonstrated that ELISA may lead to more loss of donations due to the nonspecific reactions.
Among eight ELISAs, only InTec and Livzon were not different from CLIA/ECLIA about specificity/PPV/concordance rate. Nevertheless, InTec ELISAs tested by HLJ, LN, and CQ and Livzon ELISAs tested by HZ and ZH had lower specificities, PPVs, and/or concordance rates than ECLIA and CLIA, suggesting that using the same ELISA reagent to test the same sample in different laboratories may produce different results. It indicated that the open system assay (ELISA) may lead to less than optimum results and the performance of the assay being evaluated is considered to be lower than it actually is, due to the requirement of high level of operator involvement and the overall performance of the assay itself [27,28]. e assembly automatic ELISA system may lead to bias of result in the same ELISA kit and the same sample between different laboratories. ELISA kits used in the blood centers can present a great variability depending on the supplier. For CLIA and ECLIA methods, there are few opportunities for error; the systems and assays can only be run as intended by the manufacturer, controlled by the system software.
In summary, significant differences in sensitivity, specificity, concordance rate, PPV, and NPV between some ELISAs and CLIA/ECLIA were found in several blood centers.
At present, all blood centers must use ELISA as serological assay for HIV blood screening; the performance of ELISA about sensitivity was decent for blood supply. Only two or three positive samples were missed by ELISAs, while none was missed by NAT. Consequently, HIV screening strategy in China can ensure the blood safety. e sensitivity of ELISA met the detection of HIV among blood donors, which is the primary factor of blood screening assay, but specificity and feasibility must also be considered, the balance point between sensitivity, specificity, and feasibility being determined by each transfusion service. CLIA and ECLIA had been used in clinical laboratories in China, with higher specificity and lower operator involvement than ELISA, but the higher cost of CLIA and ECLIA limited their application in blood centers. However,    the benefit of them for the health system must be taken into account, since their sensitivity and efficiency have been scientifically proven. After large-scale industrial production and policy support, the cost of CLIA/ECLIA will be under control. Furthermore, the parts of automatic ELISA system were different from ELISA manufacturers and blood centers, which were hard to standardize. In the future, CLIA or ECLIA may be approved by local authorities and used as a second confirmation step or routine screening for the detection of HIV infections among Chinese blood donors. If not all laboratories can use these techniques, centralized labs could perform the tests.

Conclusions
In summary, compared with ELISA, CLIA and ECLIA of full automation and closed system are more specific and accurate to detect HIV antibody/antigen among blood donations, which can keep a large number of blood donations with nonspecific ELISA reactions. e feasibility of CLIA and ECLIA is decent for blood screening, which may be approved as serological screening tool among blood donations to avoid the unnecessary loss of blood donors in China. e limitation of the research is that CLIA/ECLIA and ELISA cannot simultaneously be performed by blood centers, due to no CLIA and ECLIA platform in blood centers. Comprehensive and comparative study of HIV serological screening about ELISA, CLIA, and ECLIA (CLIA and ECLIA: Including Abbott, Roche, and domestic manufacturers) among blood donors in China is already in progress.

HIV:
Human immunodeficiency virus ELISA: Enzyme-linked immunosorbent assay CLIA: Chemiluminescence immunoassay ECLIA: Electrochemiluminescence immunoassay NCCL: National Center for Clinical Laboratories NAT: Nucleic acid testing WB: Western blot AIDS/ STD: Acquired immunodeficiency syndrome/sexually transmitted disease EIA: Enzyme immunoassay HBV: Hepatitis B virus HCV: Hepatitis C virus ALT: Alanine transaminase S/CO: Signal to cut-off values PPV: Positive predictive value NPV: Negative predictive value CDC: Center for Disease Control and Prevention NAT: Nucleic acid testing.

Data Availability
e data used to support this study are available from the corresponding author upon request.
Ethical Approval e institutional review board of the Beijing Hospital has approved the study. e methods in the study were in accordance with the guidelines of the Declaration of Helsinki.

Consent
Written informed consent was obtained from all subjects participating in this research.

Conflicts of Interest
e authors declare that they have no conflicts of interest.