20 Jul 2011: (2011) Correction: More and Better Information to Tackle HIV Epidemics: Towards Improved HIV Incidence Assays. PLoS Med 8(7): 10.1371/annotation/0931760c-95fa-441c-a797-7b410a4c9326. doi: 10.1371/annotation/0931760c-95fa-441c-a797-7b410a4c9326 | View correction
Citation: Incidence Assay Critical Path Working Group (2011) More and Better Information to Tackle HIV Epidemics: Towards Improved HIV Incidence Assays. PLoS Med 8(6): e1001045. doi:10.1371/journal.pmed.1001045
Published: June 14, 2011
This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Funding: The article draws on some material originally written as a background reading document for a meeting sponsored by the Bill & Melinda Gates Foundation and the National Institutes of Health that was completed under a contract between Imperial College London and the Bill & Melinda Gates Foundation. Funding agency staff contributed comments to an early draft of the manuscript. However, the decision to publish was taken by the corresponding author.
Competing interests: The authors have declared that no competing interests exist. The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the US Centers for Disease Control and Prevention (CDC), The Bill & Melinda Gates Foundation, or the National Institutes of Health.
Abbreviations: CDC, US Centers for Disease Control and Prevention; FRR, false recent rate; NIH, US National Institutes of Health; UNAIDS, Joint United Nations Programme on HIV/AIDS; WHO, World Health Organization
Provenance: Not commissioned; externally peer reviewed.
¶ Membership of the Incidence Assay Critical Path Working Group is provided in the Acknowledgments. For correspondence: Dr. Timothy Hallett, firstname.lastname@example.org
- Investments in HIV prevention activities aiming to reduce incidence could be targeted more effectively and efficiently to successful programmes if a quick, easy, valid, and precise method of estimating incidence in populations were available.
- Laboratory methods for identifying recent infections have shown promise for this application, although their accuracy has been questioned, and progress and investment in this field has been challenged by technical and market-related issues.
- A number of activities are now underway to address these factors and several promising new technologies are anticipated in the next few years.
To stop the spread of any epidemic, it is essential to know where and among whom the infection is spreading and the impact of potential interventions. Thus, accurate information on the incidence rate of HIV—the rate of new infections in a population—could substantially strengthen and increase the efficiency of the response to the global HIV epidemic. A method to quickly and reliably estimate the incidence of HIV would have valuable applications in surveillance, programme planning, impact evaluation, and prevention trial planning, and could potentially provide an end point in community- or individual-based intervention trials (Box 1). Longitudinal cohorts (observing how many uninfected individual become infected in a set period of follow-up), mathematical models, and HIV prevalence (the proportion of individuals living with infection) measures, which have been used to estimate or approximate incidence in the past, have significant limitations for these applications ,. However, a laboratory assay (or algorithm of multiple assays) that can measure a well-characterised biomarker for the recentness of infection could be used in a single cross-sectional survey to measure HIV incidence. A “first generation” of assays of this type have been available for more than a decade – (recently reviewed by Murphy and Parry , Mastro et al. , and a WHO technical working group in Busch et al. ). However, because the estimates of incidence produced by them conflicted with other estimates and epidemiological information –, their accuracy has been questioned.
Box 1. Who Needs a Reliable HIV Incidence Assay?
Area: Impact evaluation
Function: To determine the impact of large-scale interventions on the rate of new infections.
Users: Implementers, donors/funders, researchers, advocates.
Function: To monitor transmission patterns, identify at-risk groups, and detect emerging trends in epidemic.
Users: Ministries of health, donors/funders, advocates.
Area: Programme and resource planning
Function: To optimally target interventions and to plan for future service requirements (e.g., treatment slots).
Users: Programme planners, ministries of health, advocates.
Function: To estimate pre-trial incidence to inform trial planning (required sample size, trial length, etc.), and as an end point in community-based effectiveness trials.
Users: Clinical trial/research, organizations, funders/donors, researchers.
Our goal is to ensure that in the future, when an estimate of HIV incidence in any population is needed, a standard, accurate, inexpensive, and easy-to-use kit can be purchased commercially just as easily as HIV tests can be acquired to estimate HIV prevalence. This would mean that HIV incidence estimation could become routine, permitting robust, up-to-date empirical information on the trajectory and focus of the epidemic and on the impact of scaled interventions, and, in combination with other epidemiological and programme implementation information ,, this would have the potential to directly influence the programmatic decisions of major implementers, funders, and donors. In September 2010, representatives from major stakeholder organizations met to review the issues and establish a strategy for achieving this goal. Major stakeholders with diverse perspectives were identified as key participants—these included the US President's Emergency Plan for AIDS Relief and the Global Fund (that need to measure impact of programmes), the Joint United Nations Programme on HIV/AIDS (UNAIDS) (tasked with tracking the course of the epidemics), the US Centers for Disease Control and Prevention (CDC) and World Health Organization (WHO) (that will produce normative guidance of the use of assays), the US National Institutes of Health (NIH) (where research on prevention intervention evaluation is reliant on incidence measurement, and which can support research into new technologies), and diagnostics manufacturers (many of which have not entered the market for incidence assays). In this article, we summarise their analysis and the strategy that was agreed upon (a fuller briefing document is provided in Text S1).
Current Status of Laboratory-Based Assays
The principle of a test for recent infection is to measure a biological target (“biomarker”) that is related to an early phase of HIV infection (e.g., antibody concentration, proportion, avidity, etc.). However, many such biomarkers are associated with a very large between-individual variation and this makes it difficult to characterise the fundamental test characteristics (Box 2). This variation can mean that a proportion of individuals with long-standing infection test as “recently” infected. The proportion of chronically infected individuals that are misclassified as recent—termed the false recent rate (FRR)—has been found to vary widely between populations; from 0.8% in south Vietnam  to 16% in Uganda (before additional screening using behavioural, immunologic, or virologic information) ,,,. This can be due to differences in HIV subtype, epidemic phases, different levels of total IgG in different populations, and the extent of antiretroviral treatment use ,,. Nevertheless, if the local and current FRR is known accurately, it can be factored into the results of the assay to obtain an unbiased incidence estimate ,–. However, because the measurement of the FRR is itself a substantial undertaking (since it requires finding a large and representative sample of individuals with HIV known not to have been infected recently), this has not often been done. In a review of 39 studies that measured HIV incidence using BED assays, most did not account for any misclassification , and among those studies that did assume a non-zero FRR, the values used were not measured in the local populations but instead were taken from previous studies in different populations . This leads to substantial errors in the absolute level of incidence estimated and the pattern with respect to time and age –,,–.
Box 2. Properties of an HIV Incidence Assay
Incidence Test Metrics
Incidence assays are used to estimate HIV incidence because they measure a well-characterised biomarker for the recentness of infection. In the ideal case, the assay works so that one result (“test-positive”) is returned for a period early in infection and at other times a different result (“test-negative”) is returned. The average time it takes for individuals to progress from the test-positive to the test-negative state is called the mean duration, (see Figure 2). Incidence can thus be estimated as , where is the number test-positive and is the number not infected, and this formula is similar to the classic epidemiological calculation, “Prevalence = Incidence×Duration” ,.
However, in practise, a subset of individuals in a population may not ever progress to the test-negative stage, and some individuals that had progressed to the test-negative state may later regress to the test-positive state. The proportion of chronically infected individuals with a test positive result in a particular population at a particular time can be measured (among a representative sample of infected individuals known not to have been infected recently) and is termed the false recent rate (FRR), (see Figure 2). Note that this parameter is not equivalent to the traditional definitions of test “specificity” or “negative predictive value”.
The updated statistical estimator that allows an unbiased estimate of HIV incidence using an imperfect test (i.e., an FRR greater than zero) is , where is the number of test-negative results . But this estimator only works if the test characteristics ( and ) are accurately and precisely measured for that particular population at that particular time (both these parameters can vary substantially between populations and over time ,,,). If the estimate for these calibration parameters is not accurate, there will be substantial bias in the estimate of incidence ,,; and if they are not precisely estimated, then incidence estimates will be uncertain even if the cross-sectional population survey is large. Critically, the mean duration and the FRR operate as a pair of parameters that jointly specify the test characteristics, so in any calculation, the way in which those parameters are evaluated must be the same.
For many applications of the first generation assays, these test characteristics have not been measured accurately for the population in which the test is being used, and this is the reason that published assay-derived estimates have been inaccurate  (see Figure 2).
Another issue is the large sample sizes required for precise incidence estimates using incidence assays. Sample sizes to record incidence are inevitably larger than those required to gain the same precision in estimates of prevalence because incident infections are approximately 10-fold less common than prevalent infections. But, with current incidence assays, the need for large sample sizes is compounded by both the necessity to account for the misclassification rate and the uncertainty in the characteristics of the assay itself. For instance, to reach an 80% chance of recording a statistically significant change if incidence was really reduced by half in South Africa would require two surveys each of 6,000 adults if FRR = 0%, but 15,000 adults per survey if FRR = 5% . In other settings with lower baseline incidence, or with more modest reductions in incidence, sample sizes would have to be even greater.
Encouragingly, a new generation of incidence assays that are based on different biomarkers is now in development –. In early tests, the FRR for one avidity assay  was as low as 1% . There are also promising preliminary data that algorithms (combinations of several assays) can generate very low FRR values (e.g., BED and a particular Bio-Rad avidity assay in specimens from the US has FRR = 0.8% ). This performance level, if reproduced in other populations (and it is not certain that they will), could be sufficient for reliable incidence estimates across populations in surveys of feasible sample sizes.
Challenges That Must Be Addressed
To plan the next steps, we have tried to identify the factors that have challenged progress in recent years. These include the following:
- There has been a need for guidance and support for developers of incidence assays. No normative agency or scientific body has developed performance standards that incidence assays must meet and, because incidence assays are for “population use” rather than individual diagnosis, traditional regulatory regimes used by the US Food and Drug Administration (and other regulatory agencies) to evaluate and approve diagnostic assays have not been automatically required. In the absence of guidance from a scientific body or normative agency, many assay developers have endeavoured to evaluate their candidate assays with any of the very few and not fully representative seroconversion panels (collections of samples taken frequently from newly infected individuals) that were readily accessible. The incompleteness of these evaluations makes it hard to identify the best assays, anticipate their performance at estimating incidence in real populations, or compare different assays. Development of assays by companies has been impeded because they typically only have access to the small subset of all possible specimens that have been collected and are available commercially.
- There has been a need for clear guidance for the users of incidence assays. Many assays are in use in surveillance systems in Europe, but there has been no guide as to the relative strengths of each approach , and for the most widely used assay (the BED), the CDC and UNAIDS had adopted different positions on whether or not it could be used routinely ,. The absence of a clear consensus from major public health agencies involved in HIV prevention has led users to apply assays inconsistently.
- There has been a lack of market incentive for manufacturers to invest in developing incidence assays. It has been estimated that the global demand for HIV incidence assays could be as high as several million over 5 years, but it could be as low as just a few hundred thousand . This relatively small and uncertain market size is a significant obstacle to investment. Another deterrent has been the apparent lack of consensus among public health agencies about assay performance requirements and under what circumstances an assay would be recommended.
Next Steps in the Critical Path
To tackle those challenges and move towards the goal of having a thoroughly validated incidence assay, we have charted the activities, milestones, and decisions that will be required in the coming years (Figure 1). This analysis suggests that the first validated assays (or algorithms) could be available for use by the end of 2013.
Figure 1. Key milestones and decision points in the critical path over the next 5 years.
Anticipated timing of major milestones (numbered diamonds with solid lines) and key decisions (red circles with dashed lines) over the next 5 years in the critical path.doi:10.1371/journal.pmed.1001045.g001
In the critical path, attention should first be devoted to understanding the target product profile. This is a list of technical specifications for the assay that meets the performance requirements of intended users (see Text S1). We propose that an assay with an FRR that can be measured accurately for the target population and is confidently not more than 2% and a mean duration of between 4 and 12 months, is a reasonable acceptable target. Other key properties include storage conditions, shelf life, and sample type.
Secondly, a repository of specimens will be established to aggregate material from a wide range of different populations (including seroconverter cohorts, repeat blood donors, and samples of individuals with longstanding infection), viral clades, sample types (including plasma, serum, and dried blood spot), and epidemic setting. This resource would be essential for a systematic evaluation and calibration of existing incidence assays and to support development of new assays. It would also provide insights into how an algorithm of incidence assays could be assembled to provide better results. Providing industry with access to the panels for early feasibility testing and evaluation would reduce one of the barriers to their greater involvement. The Health Protection Agency in the United Kingdom will now establish such a repository and it is anticipated that a significant number of samples will have been received by mid-2011 and that data on the characteristics of existing assays (and algorithms using them) will be available in mid-2012. At this point, it is hoped that there will be evidence of at least one assay meeting the target product profile.
Next, the assays must undergo validation—that is, their incidence estimates compared to other epidemiological information such as measurements of incidence from longitudinal cohorts. These validation studies should ideally take place in a range of communities (with different epidemic phase, clade, antiretroviral therapy use, and population type). This may be achieved in partnership with existing cohort studies that have archived specimens.
After validation, the normative guidelines on incidence assays, reflecting which assays have been fully evaluated and validated, will be updated and publicised regularly. This should include a standard method for analysing data from incidence assays and reporting results (including quantifying the uncertainty in incidence estimates).
From 2013, the priority would shift to supporting the scaled, quality-assured manufacture of the assay. This support may take the form of a purchase agreement, for which the purchase of the tests is guaranteed, reducing the risk for the supplier. Preliminary discussions on the feasibility and potential form of such agreements have now begun between manufacturers, donors, and funders.
In parallel, there should also be investment in the development of new biomarkers for improved assays in the medium to long term, and NIH has issued a program announcement (PA-10-212) for proposals with this aim. Examples of new possibilities for biomarkers include cytokine profiles and within-individual viral diversity measures, although it is too early to tell if a usable and reliable assay could be created to measure them.
Progress in recent years towards the use of a robust and well characterised incidence assay has been challenged by several factors but many of these can now be overcome. A new generation of incidence assays promises to be more accurate, but the appropriate adoption and implementation of these new tests requires close alignment of evaluation, validation, and commercialisation activities. We believe that if this is achieved, and the information is meaningfully triangulated with other epidemiological and programme implementation information ,, then the effectiveness and efficiency of our response to the HIV epidemic will be enhanced, and this will be to the benefit of all those that remain at risk of HIV infection.
Figure 2. Proportion of individuals “test positive” on the incidence assay versus time since infection.
The two main parameters (mean duration and FRR) are indicated under the simplifying assumption that individuals do not progress (this assumption is not made in the statistical equations but is made here only to simplify the graphic presentation).doi:10.1371/journal.pmed.1001045.g002
Full-length version of briefing paper.
The article draws on some material originally written as a background reading document for a meeting sponsored by the Bill & Melinda Gates Foundation and the US National Institutes of Health that was completed under a contract between Imperial College London and the Bill & Melinda Gates Foundation. However, the decision to publish was taken by the corresponding author. Members of the Incidence Assay Critical Path Working Group are Rifat Atun, Global Fund; Bernard Branson, Centers for Disease Control and Prevention; David Burns, National Institutes of Health; Jesus Maria Garcia Calleja, World Health Organization; Mike Busch, Blood Systems; Paul Constestable, Ortho-Clinical Diagnostics; Gina Dallabetta, Bill & Melinda Gates Foundation; Gonzalo Domingo, Program for Appropriate Technology in Health (PATH); Amb Eric Goosby, Office of the U.S. Global AIDS Coordinator; Patricia Garrett, SeraCare Life Sciences, Inc; Peter Ghys, UNAIDS; Michael Gilbreath, National Institutes of Health; Tim Hallett, Imperial College London; Gottfried Hirnschall, World Health Organization; Charles Holmes, Office of the U.S. Global AIDS Coordinator; John Kaldor, University of New South Wales; Andrea Kim, Centers for Disease Control and Prevention; Oliver Laeyendecker, Johns Hopkins University; Jonathan Mermin, Centers for Disease Control and Prevention; Tom McWalter, University of Witwatersrand; Ronald Mink, Sedia; Gary Murphy, Health Protection Agency; Maurine Murtagh, Clinton Foundation; Sherry M. (Michele) Owen, Centers for Disease Control and Prevention; Nancy Padian, Bill & Melinda Gates Foundation; Bharat Parekh, Centers for Disease Control and Prevention; Peter Piot, Imperial College London; Tom Quinn, Johns Hopkins University; Renee Ridzon, Bill & Melinda Gates Foundation; Bill Rodriguez, Bill & Melinda Gates Foundation; Christine Rousseau, Bill & Melinda Gates Foundation; Marco Schito, National Institutes of Health; Connie Sexton, Centers for Disease Control and Prevention; Usha Sharma, National Institutes of Health; Alex Welte, South African Centre for Epidemiological Modelling and Analysis; Amy Wong, Clinton Foundation.
Analyzed the data: All members of the working group. Contributed reagents/materials/analysis tools: All members of the working group. Wrote the first draft: TH AW BR PP CR MM. Contributed to the writing of the manuscript: All members of the working group. ICMJE criteria for authorship read and met: All members of the working group. Agree with the manuscript‚s results and conclusions: All members of the working group.
- 1. Hallett TB (2011) Estimating the HIV incidence rate – recent and future developments. Curr Opin HIV/AIDS 6: 102–107.
- 2. Brookmeyer R (2009) Should biomarker estimates of HIV incidence be adjusted? AIDS 23: 485–491.
- 3. Brookmeyer R, Quinn TC (1995) Estimation of current human immunodeficiency virus incidence rates from a cross-sectional survey using early diagnostic tests. Am J Epidemiol 141: 166–172.
- 4. Quinn TC, Brookmeyer R, Kline R, Shepherd M, Paranjape R, et al. (2000) Feasibility of pooling sera for HIV-1 viral RNA to diagnose acute primary HIV-1 infection and estimate HIV incidence. AIDS 14: 2751–2757.
- 5. Janssen RS, Satten GA, Stramer SL, Rawal BD, O'Brien TR, et al. (1998) New testing strategy to detect early HIV-1 infection for use in incidence estimates and for clinical and prevention purposes. JAMA 280: 42–48.
- 6. Murphy G, Parry JV (2008) Assays for the detection of recent infections with Human Immunodeficiency Virus Type 1. Eurosurveillance 13: 4–10.
- 7. Mastro TD, Kim A, Hallett TB, Rehle T, Welte A, et al. (2010) Estimating HIV Incidence in populations using tests for recent infection: issues, challenges and the way forward. Journal of HIV/AIDS Surveillance & Epidemiology 2: 7.
- 8. Busch MP, Pilcher CD, Mastro TD, Kaldor J, Vercauteren G, et al. (2010) Beyond detuning: 10 years of progress and new challenges in the development and application of assays for HIV incidence estimation. AIDS 24: 2763–2771.
- 9. Sakarovitch C, Rouet F, Murphy G, Minga AK, Alioum A, et al. (2007) Do tests devised to detect recent HIV-1 infection provide reliable estimates of incidence in Africa? J Acquir Immune Defic Syndr 45: 115–122.
- 10. Marinda ET, Hargrove J, Preiser W, Slabbert H, van Zyl G, et al. (2010) Significantly diminished long-term specificity of the BED capture enzyme immunoassay among patients with HIV-1 with very low CD4 counts and those on antiretroviral therapy. J Acquir Immune Defic Syndr 53: 496–499.
- 11. Guy R, Gold J, García Calleja JM, Kim AA, Parekh B, et al. (2009) Accuracy of serological assays for detection of recent infection with HIV and estimation of population incidence: a systematic review. Lancet Infect Dis 9: 747–759.
- 12. Bärnighausen T, Wallrauch C, Welte A, McWalter TA, Mbizana N, et al. (2008) HIV incidence in rural South Africa: comparison of estimates from longitudinal surveillance and cross-sectional cBED assay testing. PLoS ONE 3: e3640. doi:10.1371/journal.pone.0003640.
- 13. Hargrove JW, Humphrey JH, Mutasa K, Parekh BS, McDougal JS, et al. (2008) Improved HIV-1 incidence estimates using the BED capture enzyme immunoassay. AIDS 22: 511–518.
- 14. Karita E, Price M, Hunter E, Chomba E, Allen S, et al. (2007) Investigating the utility of the HIV-1 BED capture enzyme immunoassay using cross-sectional and longitudinal seroconverter specimens from Africa. AIDS 21: 403–408.
- 15. UNAIDS (2007) Practical guidelines for intensifying HIV prevention: towards universal access. Available: http://data.unaids.org/pub/Manual/2007/20070306_prevention_guidelines_towards_universal_access_en.pdf. Accessed 9 May 2011.
- 16. Wilson D, Halperin DT (2008) “Know your epidemic, know your response”: a useful approach, if we get it right. Lancet 372: 423–426.
- 17. Tuan N, Le L, Shah N, Kim A (2010) Validation study of HIV-1 incidence assays in Vietnam. The Second Asia Regional HIV Surveillance Meeting, Lessons Learned in Second Generation Surveillance: the Asia Experience. Ho Chi Minh City, Vietnam.
- 18. Kim AA, Hallett T, Stover J, Gouws E, Musinguzi J, et al. (2010) Estimates of HIV incidence among adults in Kenya and Uganda: a systematic comparison of multiple methods. 17th Conference on Retroviruses and Opportunistic Infections; 16–19 February 2010; San Francisco, California, United States of America.
- 19. Hallett TB, Ghys P, Bärnighausen T, Yan P, Garnett GP (2009) Errors in ‘BED’-derived estimates of HIV incidence will vary by place, time and age. PLoS ONE 4: e5720. doi:10.1371/journal.pone.0005720.
- 20. Hladik W, Olara D, Were W, Mermin J, Downing R (2007) The effect of antiretroviral treatment on the specificity of the serological BED HIV-1 incidence assay [abstract 998]. The 2007 HIV/AIDS Implementers' Meeting; 16–19 June 2007; Kigali, Rwanda.
- 21. McDougal JS, Parekh BS, Peterson ML, Branson BM, Dobbs T, et al. (2006) Comparison of HIV type 1 incidence observed during longitudinal follow-up with incidence estimated by cross-sectional analysis using the BED capture enzyme immunoassay. AIDS Res Hum Retroviruses 22: 945–952.
- 22. McWalter TA, Welte A (2010) Relating recent infection prevalence to incidence with a sub-population of assay non-progressors. J Math Biol 60: 687–710.
- 23. Welte A, McWalter TA, Laeyendecker O, Hallett TB (2010) Using tests for recent infection to estimate incidence: problems and prospects for HIV. Euro Surveill 15:
- 24. Bärnighausen T, McWalter TA, Rosner Z, Newell ML, Welte A (2010) HIV incidence estimation using the BED capture enzyme immunoassay: systematic review and sensitivity analysis. Epidemiology 21: 685–697.
- 25. Todd J, Lutalo T, Kaleebu P (2009) Estimating incidence of HIV infection in Uganda. JAMA 301: 159–160.
- 26. Hallett T, Garnett G (2009) Estimating incidence of HIV infection in Uganda. JAMA 301: 159.
- 27. Mermin J, Musinguzi J, Hladik W (2009) Estimating incidence of HIV infection in Uganda–reply. JAMA 301: 160-a–161.
- 28. Thomas HI, Wilson S, O'Toole CM, Lister CM, Saeed AM, et al. (1996) Differential maturation of avidity of IgG antibodies to gp41, p24 and p17 following infection with HIV-1. Clin Exp Immunol 103: 185–191.
- 29. Chawla A, Murphy G, Donnelly C, Booth CL, Johnson M, et al. (2007) Human immunodeficiency virus (HIV) antibody avidity testing to identify recent infection in newly diagnosed HIV type 1 (HIV-1)-seropositive persons infected with diverse HIV-1 subtypes. J Clin Microbiol 45: 415–420.
- 30. Suligoi B, Galli C, Massi M, Di Sora F, Sciandra M, et al. (2002) Precision and accuracy of a procedure for detecting recent human immunodeficiency virus infections by calculating the antibody avidity index by an automated immunoassay-based method. J Clin Microbiol 40: 4015–4020.
- 31. Wei X, Liu X, Dobbs T, Kuehl D, Nkengasong JN, et al. (2010) Development of two avidity-based assays to detect recent HIV type 1 seroconversion using a multisubtype gp41 recombinant protein. AIDS Res Hum Retroviruses 26: 61–71.
- 32. Masciotra S, Dobbs T, Candal D, Hanson D, Delaney K, et al. (2010) Antibody avidity-based assay for identifying recent HIV-1 infections based on Genetic Systems™ 1/2 Plus O EIA [abstract 937]. 17th Conference on Retroviruses and Opportunistic Infections; 16–19 February 2010; San Francisco, California, United States of America.
- 33. Laeyendecker O, Oliver A, Astemborski J, Owen SM, Kirk G, et al. (2010) Improved precision of cross-sectional HIV incidence testing using a multi-assay algorithm that includes BED and an avidity assay with modified assay cut-offs [abstract 935]. 17th Conference on Retroviruses and Opportunistic Infections; 16–19 February 2010; San Francisco, California, United States of America.
- 34. UNAIDS Reference Group on Estimates Modelling and Projections (2006) Statement on the use of the BED-assay for the estimation of HIV-1 incidence for surveillance or epidemic monitoring. Wkly Epidemiol Rec 81: 40–41.
- 35. Surveillance and Survey and the Laboratory Working Groups to the Office of the Global AIDS Coordinator (2006) Interim recommendations for the use of the BED capture enzyme immunoassay for incidence estimation and surveillance. Available: http://www.cdc.gov/nchstp/od/GAP/docs/surveillance/Interim%20Recommendations%20for%20the%20use%20of%20the%20BED%20capture%20enzyme%20immunoassay%20for%20incidence%20estimation%20and%20surveillance%20Approved%20November%2021%202006%20(2).pdf). Accessed 9 May 2011.
- 36. Family Health International (2009) Global landscape & market assessments.
- 37. Kassanjee R, Welte A, McWalter TA, Viljoen J, Barnighausen T, et al. (2009) Calibration of BED assay for use in incidence estimation. 5th IAS Conference on HIV Pathogenesis, Treatment and Prevention; Cape Town, South Africa.