Highly sensitive detection of the group A Rotavirus using Apolipoprotein H-coated ELISA plates compared to quantitative real-time PCR
- Cornelia Adlhoch†1Email author,
- Marco Kaiser†1, 2,
- Marina Hoehne3,
- Andreas Mas Marques3,
- Ilias Stefas4,
- Francisco Veas5 and
- Heinz Ellerbrok1
© Adlhoch et al; licensee BioMed Central Ltd. 2011
Received: 29 September 2010
Accepted: 10 February 2011
Published: 10 February 2011
The principle of a capture ELISA is binding of specific capture antibodies (polyclonal or monoclonal) to the surface of a suitable 96 well plate. These immobilized antibodies are capable of specifically binding a virus present in a clinical sample. Subsequently, the captured virus is detected using a specific detection antibody. The drawback of this method is that a capture ELISA can only function for a single virus captured by the primary antibody. Human Apolipoprotein H (ApoH) or β2-glycoprotein 1 is able to poly-specifically bind viral pathogens. Replacing specific capture antibodies by ApoH should allow poly-specific capture of different viruses that subsequently could be revealed using specific detection antibodies. Thus, using a single capture ELISA format different viruses could be analysed depending on the detection antibody that is applied. In order to demonstrate that this is a valid approach we show detection of group A rotaviruses from stool samples as a proof of principle for a new method of capture ELISA that should also be applicable to other viruses.
Stool samples of different circulating common human and potentially zoonotic group A rotavirus strains, which were pretested in commercial EIAs and genotyped by PCR, were tested in parallel in an ApoH-ELISA set-up and by quantitative real-time PCR (qPCR). Several control samples were included in the analysis. The ApoH-ELISA was suitable for the capture of rotavirus-particles and the detection down to 1,000 infectious units (TCID50/ml). Subsets of diagnostic samples of different G- and P-types were tested positive in the ApoH-ELISA in different dilutions. Compared to the qPCR results, the analysis showed high sensitivity, specificity and low cross-reactivity for the ApoH-ELISA, which was confirmed in receiver operating characteristics (ROC) analysis.
In this study the development of a highly sensitive and specific capture ELISA was demonstrated by combining a poly-specific ApoH capture step with specific detection antibodies using group A rotaviruses as an example.
Apolipoprotein H (ApoH) is a human plasma protein able to bind poly-specifically to viruses. Coated onto magnetic beads or ELISA plates, it enables capture and concentration of viruses contained in critical diagnostic samples [1–3]. Common capture assays use specific poly- or monoclonal antibodies for capture and detection of viral antigens. These approaches have limitations since for each virus both a specific capture and a specific detection antibody are needed. In contrast, ApoH binds complete viruses and antigens poly-specifically and therefore offers the chance to capture and detect a broad range of different viruses within one diagnostic sample.
Rotaviruses are responsible for the majority of acute gastroenteritis infections occurring in young children world wide . The genus Rotavirus belongs to the family of Reoviridae and, according to the antigenic and genetic variants of the VP6 region, can be divided into seven groups named A-G. The majority of human infections are caused by viruses of group A, which can further be differentiated into 23 G- and 32 P-types, respectively, by VP7 and VP4 antigens. The classification into sero- and genotype corresponds for G-types while it is inconsistent in the case of P-types [5, 6].
Altogether, 10 G- and 11 P-types have been found in human group A rotavirus (RV-A) infections, while mostly types G1P, G2P, G3P, G4P and G9P have been circulating in Europe in recent years . Additionally, in a few cases, reassortants of human strains, zoonotic strains and types such as G6, G8, G9, G10 and G12 were found . The WHO recommends the use of enzyme immunoassays for the diagnosis of rotavirus infections .
This study was initiated to investigate the feasibility and suitability of a poly-specific virus capture ApoH-ELISA combined with subsequent sensitive and specific RV-A detection. The ApoH-ELISA was compared to a commonly used quantitative real-time PCR (qPCR), to correctly discriminate positive from negative samples by the presence of genome equivalents (GE) and to avoid misclassification by false positive or negative results using other EIAs. The usefulness of this new method was assessed in order to show a general feasibility for the detection of common and rarely circulating RV-A directly from stool samples after ApoH-mediated binding to the cavity of a microtitre plate and specific detection by antibodies. The intention of this study was to demonstrate the proof of principle of a poly-specific capture step with subsequent highly specific and sensitive detection of a pathogen and to analyse the potential of this method for further approaches.
In the first pre-testing steps it was shown that RV-A particles were bound to an ApoH-coated ELISA plate as shown by subsequent RV-A-specific qPCR. A loss of viral nucleic acid after the binding step to ApoH-ELISA plates was indicated by higher values (2 CT) in the qPCR assay compared to directly prepared samples without ApoH-ELISA incubation.
Results of qPCR and ApoH-ELISA of samples and controls (undiluted, 1:10 or 1:100 dilution)
1:10 dilution in NaOAc-buffer (50 mM)
1:100 dilution in NaOAc-buffer (50 mM)
direct (qPCR) GE
direct (qPCR) GE
ELISA 1:10 OD
direct (qPCR) GE
ApoH-ELISA and qPCR analysis
This study was initiated together with the German Consultant Laboratory for Rotaviruses, using stored left-over samples from routine diagnostic which were pre-tested in commonly used EIAs and genotyped by PCR. The selection criteria for the stool samples were GE and genotype. Therefore, samples were included containing high and low GE of the most prevalent human strains circulating in Europe in recent years (G1P, G2P, G3P, G4P and G9P) as well as variants with low prevalence, G8P and G12P, representing potentially zoonotic strains (Table 1). These samples were tested in this study in ApoH-ELISA and qPCR in parallel. Samples were classified into positive or negative based on the presence of GE as analysed with a specific and sensitive qPCR assay to avoid potential misclassification (false negative or positive) by using other EIAs.
The stool samples were tested in three different dilutions (undiluted, 1:10 and 1:100) to investigate the influence of inhibiting factors potentially present in those samples that might affect the results of the ELISA. Three of the 15 samples (Table 1; nos 1, 5, 13) showed increasing OD values in the ApoH-ELISA for dilutions, indicating inhibiting factors in the undiluted sample. All stool samples previously tested positive in PCR and EIA assays were confirmed positive in the specific qPCR. All stool samples from the diagnostic pool were reactive in the new ApoH-ELISA with OD values above 0.5 except for sample no. 14. This sample showed low values at or below the threshold in all three dilutions, although the GE in the qPCR were comparable to other samples (e.g. no. 4), which resulted in high OD values in the ApoH-ELISA. Two samples were highly reactive with values above 3 even in the 1:100 dilutions (nos. 1 and 12).
A broad range of different stool samples with unknown viral status from human adults and infants was included as control. Stool samples from different animals as well as buffers and FCS were tested for cross-reactivity. Sample no. 19 unexpectedly turned out to be reactive in the ApoH-ELISA while qPCR showed very low GE. A similar result was obtained when the original source sample (Table 1; no. 20) was tested again. The sample was from a hospitalized Hepatitis A Virus-positive patient with diarrhoea. Furthermore stool sample no. 27 taken from a pig which was stalled for an animal experiment was reactive in the ApoH-ELISA and positive in the qPCR assays with 135 GE. The GP-typing of the isolate showed a human G4P origin. Sample no. 26 was negative in qPCR with relatively high OD values in the ApoH-ELISA. This sample originated from a second pig stalled close to the pig from which sample no. 27 originated, and it can be speculated that in this case viral antigen was present in the stool after oral up-take of contaminated faeces, without subsequent infection of the pig. Further control samples of different species (mouse, rat, etc.) and buffers (FCS, PBS) did not show any unspecific signals in the ApoH-ELISA in the absence of viral genomes. Positive controls from rotavirus cell culture supernatant showed corresponding values in both assays.
Receiver operating characteristic (ROC) analysis
Results of the ROC analysis for three separate dilution steps and the combined data set
upper limit (range)
lower limit (range)
0.360 (0.283, 0.653)
0.416 (0.19, 0.416)
0.424 (0.283, 0.489)
0.352 (3, 3)
0.328 (0.205, 0.328)
2.605 (3, 1.528)
0.174 (3, 1.642)
0.162 (0.067, 0.162)
3.000 (3, 0.383)
0.264 (0.283, 0.416)
0.236 (0.09, 0.416)
0.571 (0.283, 1.017)
Analysis of dependency genome equivalents vs. OD values
The analysis of dependency between GE and OD extinction values was run using Spearman's rank test . One test used only samples that had been tested positive in qPCR (qPCR = 1, n = 60) for comparison with the ELISA results. In the prediction test including only qPCR-positive samples Spearman's rho was 0.3113 (p = 0.016). Another test included all samples (n = 96) for the Spearman test, Spearman's rho was 0.7746 (p < 0.0001). This indicates that a correlation between GE and resulting OD in the ApoH-ELISA can be assumed, with a stronger correlation when using the whole data set also including negative samples.
The detection of different RV-A genotypes showed reliable results and good performance when using the newly established ApoH-ELISA. Even samples with very low GE in qPCR analysis were reactive. This might be due to a possibly higher amount of viral antigen in some stool samples compared to viral RNA. Since the time of sampling in the course of infection is unknown, no correlation could be drawn between antigen level or viral genomes and stage of infection. Surprisingly, one pig sample turned out to be positive for a human RV-A isolate. The fact that this was one of the pigs that were held for animal experiments and had daily contact to humans points to a possible human-to-pig infection route. Analysing the results of the three dilution steps per sample subjected to the ApoH-ELISA, all undiluted samples gave good results. However, increasing extinction values with increasing dilution steps in three samples indicated the presence of inhibiting factors that did not prevent detection of the infection but might result in underestimating the amount of antigen in the stool sample if applied undiluted only. A predictable correlation was shown between GE and OD values in the ELISA. This correlation was stronger when all samples, qPCR positive and negative, were included instead of analysing only qPCR positive samples.
Because it is common practice to use stool samples for the diagnosis of enteral viruses like rotavirus, we did not use any other material for the testing of the ApoH-ELISA, except cell culture supernatant during the prior establishment of the assay. The ApoH-ELISA showed a good sensitivity and specificity for the detection of common, rare and potentially zoonotic isolates of rotavirus, but the low number of stool samples used in this study is a limitation. As discussed by Philips et al., ELISA reactivity seems to be a good correlate of disease in RV-A infection, which is in line with the protocol of the WHO for surveillance of rotavirus-associated gastroenteritis . Because of the initial poly-specific capture step followed by antibody-dependent specific detection, this method could then be evaluated in future studies for the suitability in a differential diagnosis set-up for the simultaneous detection of other pathogens causing similar symptoms using just one capture ELISA plate. The parallel application of pathogen- or genotype-specific antibodies would allow then at the same time detection and discrimination on one plate and in one step. The aim of this study was to demonstrate the proof of principle and feasibility of the method. Therefore the rotavirus ApoH-ELISA requires an evaluation and validation with a quantitatively broader spectrum of clinically relevant stool samples before it can be used in routine diagnostics of rotaviruses. It will be necessary to analyse a higher number of samples with clinical data and it might be valuable to adopt other antibodies (mono- or polyclonal) for pathogen detection to further improve performance of the assay. It will also be worth to carefully evaluate the potential of multiplexing in one plate for simultaneous detection of different pathogens. Additionally the ApoH-ELISA will have to be compared to the "gold standard" EIAs (although the samples were all previously tested positive in standard EIAs used for routine diagnostic). Using rotavirus as a model, this study demonstrates the suitability of a new method for the specific and sensitive detection of viruses directly from stool samples by a poly-specific binding of antigen or complete virus to an ApoH-coated ELISA plate. The findings of the ApoH-ELISA are in accordance with a commonly used qPCR test system.
The application of ApoH-ELISA was shown to be practicable for the diagnostics of RV-A in stool samples, providing results comparable to a commonly used qPCR analysis.
A total of 15 human rotavirus-positive stool samples left over from routine diagnostic and obtained from the German Consultant Laboratory for Rotaviruses, were included (Table 1; nos. 1-15). These stool samples were pre-tested in commercially used EIAs and by broad-spectrum PCRs. The samples were additionally genotyped using a multiplex PCR for G- and P-type differentiation [14, 15]. Altogether 15 relevant isolates of different genotypes and with different viral loads were chosen. The analysed samples belonged to the most common human viruses circulating in Europe during recent years and were typed as G1P, G2P, G3P, G4P and G9P. Additionally, G8P and G12P strains representing potentially zoonotic isolates were included. Different human stool samples with unknown viral status for rotavirus from adults and infants (Table 1; nos. 19-22) were also included in the analysis.
Furthermore, stool samples from other animal species (mouse, rat, pig, wild boar) as well as buffer and foetal calf serum (FCS, Biochrom, Berlin, Germany) served as controls to test potential cross-reactivity and unspecific background signals.
A volume of approximately 100 μl/mg of each stool sample, virus supernatant or control sample was resuspended in 1 mL of NaOAc-buffer (50 mM). Solid particles were removed by centrifugation at 11,000 rpm for 2 min (Centrifuge 5417R, Eppendorf, Hamburg, Germany). The supernatant was removed and used undiluted, 1:10 and 1:100 diluted in NaOAc-buffer (50 mM). Altogether three samples (undiluted, 1:10, 1:100) of each original sample were used in the final analysis. One aliquot of each suspension (undiluted, 1:10, 1:100) was used for ApoH-ELISA detection, another for direct preparation and measurement of GE in a RV-A-specific qPCR.
For ApoH-ELISA analysis 100 μl of the suspension were given directly onto the ApoH-ELISA plate. The plate was then centrifuged for enhanced virus binding at 2,500 rpm for 15 min (Centrifuge Biofuge Stratos, Heraeus, Thermo Fisher Scientific, Waltham, MA, USA) before incubation of the plate for 1 h at 37°C in a CO2 cell incubator (CB150, Binder, Tuttlingen, Germany) in a humid atmosphere. The supernatant was then removed from the plate and discarded. The wells were washed at least three times with 200 μl washing buffer PBST (PBS with 0.1% Tween20 [Sigma-Aldrich, Hamburg, Germany]). A blocking step with 200 μl blocking buffer (PBST with 2% skimmed milk powder, Sigma-Aldrich) for 45 min at room temperature was introduced to reduce unspecific signals. The supernatant was then discarded and another washing step was performed using PBST. A polyclonal rabbit anti-rotavirus (human) antibody (DAKOCytomation, Hamburg, Germany) diluted 1:100 in blocking buffer was used in a volume of 100 μl as first antibody and was incubated on the plate for 1 h at room temperature. The antibody was then removed. After washing, 100 μl of the secondary antibody were applied for 1 h at room temperature (goat anti-rabbit POD H&L IgG 1:5000 diluted in blocking buffer, Dianova, Hamburg, Germany) followed by an additional washing step. Finally 100 μl of TMB (3,3',5,5'-Tetramethylbenzidine) diluted in substrate buffer (Bio-Rad, Munich, Germany) were added to each well of the plate. The reaction was stopped with 1 N H2SO4 after incubation for 20 min at room temperature in the dark. The plate was analysed in a plate reader (TECAN Infinite F200, Männedorf, Switzerland) at 450/620 nm and extinction values were calculated using Magellan™ Software (TECAN).
Quantitative real-time PCR
One aliquot of the respective dilution for each sample which was tested in the ApoH-ELISA was analysed in parallel by qPCR to determine the GE of RV-A. A volume of 100 μl of each sample was resuspended directly in 400 μl AVL lysis buffer (RNeasy viral RNA kit, Qiagen, Hilden, Germany) and incubated for 10 min at room temperature followed by RNA extraction according to the manufacturer's recommendations. Subsequently, a volume of 20.6 μl of the eluted RNA was reverse transcribed using the TaqMan® Reverse Transcription Reagents following the supplier's protocol (Applied Biosystems, Foster City, USA). RNA was incubated with 2 μl primer mix of random hexamers (R6)/specific RoA_25/26 primers (RoA_25 gCT TTT AAA AgT TCT gTT CCg Ag; RoA_26 CTC AAT gTg TAR TTg Agg TCg, TIB Molbiol, Berlin, Germany) for 30 sec at 93°C. The sample was snap-cooled on ice to 4°C before adding the reverse transcription mix containing 4 μl 10xbuffer, 8.8 μl MgCl2 (25 mM), 3.2 μl dNTP (25 mM), 0.8 μl RNase inhibitor and 0.6 μl reverse transcriptase. The reaction was run in a thermocycler (Mastercycler epgradient, Eppendorf) for 60 min at 42°C followed by 15 min at 72°C before cooling to 4°C and storage at -20°C.
The GE of rotavirus were determined by a qPCR assay, using 5' nuclease probes (TaqMan® probes) with primer combination RoA_25/26 and probe TM3 (RoA_TM3 probe YAK-CTT ITC CAT CTT TCC gCA CgC gCT--DB, TIB Molbiol), which was designed to detect all human and animal RV-A by binding within a conserved region of the NSP4 gene.
The Platinum® Taq DNA polymerase kit, MgCl2 and dNTPs by Invitrogen (Carlsbad, CA, USA) together with water (Molecular Biology Grade Eppendorf) were applied in this assay. qPCR reactions were performed in a final volume of 25 μl with 2.5 μl sample, 10xbuffer, 4 mM of MgCl2, dNTP 0.2 mM each, 0.3 μM of each primer, 0.1 μM of probe, ROX 0.1 μM and Platinum® Taq 0.5 IU. General reaction conditions for the real-time assay were 95°C for 15 min and 45 cycles with 95°C for 15 sec and 60°C for 35 sec. Reactions were run in an ABI GeneAmp® 7500 Detection System (Applied Biosystems). A plasmid pRoA containing the corresponding region of 75 nt from the isolate RV-A WA (ATCC VR-2018®) was established. Plasmid DNA was purified, concentration was determined and copy numbers were calculated. The plasmid was 10-fold serially diluted in water containing λ-DNA (1 ng/μl) from 106 to 10 copies and used as positive control as well as for quantification of viral genomes. For qPCR each sample was analysed in duplicate. Genome equivalents were determined using a standard curve; the mean and standard deviation were calculated. The detection limit was calculated to be 10 cDNA copies per reaction.
As internal sample control a c-myc qPCR assay with primer combination c-myc_F/R/TM (c-myc F: gCC AgA ggA ggA ACg AgC T; c-myc R: ggg CCT TTT CAT TgT TTT CCA; c-myc TM FAM-TgC CCT gCg TgA CCA gAT CC-BBQ; TIB Molbiol) and a quantified plasmid containing the target sequence of 83 nt were applied for all stool samples. The qPCR reaction conditions corresponded to the RV-A assay.
ApoH-ELISA - suitability testing
In advance, tests to analyse the general binding of rotavirus particles to ApoH-coated ELISA plates and optimization steps using different dilution buffers were performed. For the establishment of the method cell culture grown virus stock RV-A strain WA with a titre of 1.3 × 107 IU/mL TCID50[16, 17] was used. The virus suspension was 10-fold serially diluted from 10-1 to 10-8 in NaOAc-buffer (50 mM). One aliquot of each dilution step was used for the ApoH-ELISA assay, and another aliquot was analysed directly by qPCR for determination of GE in the sample. First, aliquots of the different sample dilutions were incubated on the ApoH-ELISA plate for 1 h at 37°C. Supernatant was removed, the plate was washed twice with 200 μl PBST and lysis of bound virus particles was performed directly on the plate using AVL lysis buffer (RNeasy viral RNA kit, Qiagen). After 10 min of incubation at room temperature samples underwent RNA extraction and cDNA synthesis and were stored for further analysis as described before. A corresponding aliquot was used directly for RNA extraction, cDNA synthesis and qPCR analysis.
Subsequently, analysis was performed using diluted cell culture supernatant and ApoH-ELISA to estimate the detection limit of the ELISA assay by using defined samples with known virus titre. Therefore the threshold of the OD values of the ApoH-ELISA can be correlated to the detection limit of infectious units (TCID50/ml) in the sample. Cell cultured virus was diluted 10-fold from 10-1 to 10-8 either in PBS, NaOAc- (50 mM) or Tris-buffer.
Receiver operating characteristic analysis
Receiver operating characteristic (ROC) analysis was used to determine a cut-off value (OD) for the newly established ApoH-ELISA [10, 18]. The commonly applied qPCR was used as reference test to indicate presence or absence of virus in the respective sample and to rule out misclassification of samples due to false-negative or -positive results by other EIA test. With the Youden Index (sensitivity+specificity-1 ) the optimal cut-off for each dilution step separately and for all samples as a whole was identified. The ROC analysis was performed using either the whole data set or the results of each dilution step separately. The area under the curve (AUC) was estimated for each of the three dilution steps separately and for the whole data set. The result of each analysis was compared to determine a difference in performance by using dilution steps. Positive and negative likelihood ratios (LR+ and LR-) were measured and the analysis was performed using STATA11 (StataCorp LP, College Station, TX, USA) and TG-ROC Excel-sheet .
Spearman test  was run using STATA11 (StataCorp LP) to analyze the correlation between GE in qPCR and corresponding OD values in ApoH-ELISA.
This work was funded by the EU (project USDEP, http://www.USDEP.eu, FP6-2005-LIFESCIHEALTH-7 - STREP- Contract Number: LSHB-CT-2006-037560). The authors thank Anna Löwa and Markus Ulrich for excellent technical support.
- Godoy P, Marsac D, Stefas E, Ferrer P, Tischler ND, Pino K, Ramdohr P, Vial P, Valenzuela PD, Ferres M, Veas F, Lopez-Lastra M: Andes virus antigens are shed in urine of patients with acute hantavirus cardiopulmonary syndrome. J Virol 2009, 83: 5046-5055. 10.1128/JVI.02409-08PubMed CentralView ArticlePubMedGoogle Scholar
- Stefas E, Rucheton M, Graafland H, Moynier M, Sompeyrac C, Bahraoui EM, Veas F: Human plasmatic apolipoprotein H binds human immunodeficiency virus type 1 and type 2 proteins. AIDS Res Hum Retroviruses 1997, 13: 97-104. 10.1089/aid.1997.13.97View ArticlePubMedGoogle Scholar
- Stefas I, Rucheton M, D'Angeac AD, Morel-Baccard C, Seigneurin JM, Zarski JP, Martin M, Cerutti M, Bossy JP, Misse D, Graafland H, Veas F: Hepatitis B virus Dane particles bind to human plasma apolipoprotein H. Hepatology 2001, 33: 207-217. 10.1053/jhep.2001.20531View ArticlePubMedGoogle Scholar
- Desselberger U, Iturriza-Gomara M, Gray JJ: Rotavirus epidemiology and surveillance. Novartis Found Symp 2001, 238: 125-147. discussion 147-152 full_textView ArticlePubMedGoogle Scholar
- Iturriza-Gomara M, Cubitt D, Steele D, Green J, Brown D, Kang G, Desselberger U, Gray J: Characterisation of rotavirus G9 strains isolated in the UK between 1995 and 1998. J Med Virol 2000, 61: 510-517. 10.1002/1096-9071(200008)61:4<510::AID-JMV15>3.0.CO;2-QView ArticlePubMedGoogle Scholar
- Iturriza-Gomara M, Isherwood B, Desselberger U, Gray J: Reassortment in vivo: driving force for diversity of human rotavirus strains isolated in the United Kingdom between 1995 and 1999. J Virol 2001, 75: 3696-3705. 10.1128/JVI.75.8.3696-3705.2001PubMed CentralView ArticlePubMedGoogle Scholar
- Iturriza-Gomara M, Dallman T, Banyai K, Bottiger B, Buesa J, Diedrich S, Fiore L, Johansen K, Korsun N, Kroneman A, Lappalainen M, Laszlo B, Maunula L, Matthinjnssens J, Midgley S, Mladenova Z, Poljsak-Prijatelj M, Pothier P, Ruggeri FM, Sanchez-Fauquier A, Schreier E, Steyer A, Sidaraviciute I, Tran AN, Usonis V, Van Ranst M, de Rougemont A, Gray J: Rotavirus surveillance in europe, 2005-2008: web-enabled reporting and real-time analysis of genotyping and epidemiological data. J Infect Dis 2009,200(Suppl 1):S215-221. 10.1086/605049View ArticlePubMedGoogle Scholar
- Iturriza-Gomara M, Anderton E, Kang G, Gallimore C, Phillips W, Desselberger U, Gray J: Evidence for genetic linkage between the gene segments encoding NSP4 and VP6 proteins in common and reassortant human rotavirus strains. J Clin Microbiol 2003, 41: 3566-3573. 10.1128/JCM.41.8.3566-3573.2003PubMed CentralView ArticlePubMedGoogle Scholar
- World_Health_Organization: Generic protocol for monitoring impact of rotavirus vaccination on gastroenteritis disease burden and viral strains. 2008.Google Scholar
- Greiner M, Pfeiffer D, Smith RD: Principles and practical application of the receiver-operating characteristic analysis for diagnostic tests. Prev Vet Med 2000, 45: 23-41. 10.1016/S0167-5877(00)00115-XView ArticlePubMedGoogle Scholar
- Greiner M: Two-graph receiver operating characteristic (TG-ROC): update version supports optimisation of cut-off values that minimise overall misclassification costs. J Immunol Methods 1996, 191: 93-94. 10.1016/0022-1759(96)00013-0View ArticlePubMedGoogle Scholar
- Spearman C: The proof and measurement of association between two things. By C. Spearman, 1904. Am J Psychol 1987, 100: 441-471. 10.2307/1422689View ArticlePubMedGoogle Scholar
- Phillips G, Lopman B, Tam CC, Iturriza-Gomara M, Brown D, Gray J: Diagnosing rotavirus A associated IID: Using ELISA to identify a cut-off for real time RT-PCR. J Clin Virol 2009, 44: 242-245. 10.1016/j.jcv.2008.12.001View ArticlePubMedGoogle Scholar
- Iturriza-Gomara M, Kang G, Gray J: Rotavirus genotyping: keeping up with an evolving population of human rotaviruses. J Clin Virol 2004, 31: 259-265. 10.1016/j.jcv.2004.04.009View ArticlePubMedGoogle Scholar
- Mas Marques A, Diedrich S, Huth C, Schreier E: Group A rotavirus genotypes in Germany during 2005/2006. Arch Virol 2007, 152: 1743-1749. 10.1007/s00705-007-0998-xView ArticlePubMedGoogle Scholar
- Spearman C: The method of right and wrong cases ("constant stimuli") without Gauss's formulae. Br J Psychol 1908, 2: 227-242.Google Scholar
- Kärber G: Beitrag zur kollektiven Behandlung pharmakologischer Reihenversuche. Arch Exp Pathol Pharmakol 1931, 162: 480-483.View ArticleGoogle Scholar
- Bewick V, Cheek L, Ball J: Statistics review 13: receiver operating characteristic curves. Crit Care 2004, 8: 508-512. 10.1186/cc3000PubMed CentralView ArticlePubMedGoogle Scholar
- Youden WJ: Index for rating diagnostic tests. Cancer 1950, 3: 32-35. 10.1002/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.