Figures
Abstract
Background
Trials in macaque models play an essential role in the evaluation of biomedical interventions that aim to prevent HIV infection, such as vaccines, microbicides, and systemic chemoprophylaxis. These trials are usually conducted with very high virus challenge doses that result in infection with certainty. However, these high challenge doses do not realistically reflect the low probability of HIV transmission in humans, and thus may rule out preventive interventions that could protect against “real life” exposures. The belief that experiments involving realistically low challenge doses require large numbers of animals has so far prevented the development of alternatives to using high challenge doses.
Methods and Findings
Using statistical power analysis, we investigate how many animals would be needed to conduct preclinical trials using low virus challenge doses. We show that experimental designs in which animals are repeatedly challenged with low doses do not require unfeasibly large numbers of animals to assess vaccine or microbicide success.
Citation: Regoes RR, Longini IM Jr, Feinberg MB, Staprans SI (2005) Preclinical Assessment of HIV Vaccines and Microbicides by Repeated Low-Dose Virus Challenges. PLoS Med 2(8): e249. https://doi.org/10.1371/journal.pmed.0020249
Academic Editor: Marc Lipsitch, Harvard School of Public Health, United States of America
Received: April 11, 2005; Accepted: June 13, 2005; Published: July 19, 2005
Copyright: © 2005 Regoes et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: ID50, infectious dose at which 50% of the animals become infected
Introduction
Worldwide approximately 40 million people are infected with HIV, and more than 3 million people died of AIDS last year alone [1]. Unfortunately, numerous obstacles to providing effective antiretroviral treatment to the majority of infected individuals in resource-poor countries exist. The development of a vaccine or other preventive biomedical intervention therefore bears the greatest hope to curb the rampant HIV epidemic [2].
Research on HIV vaccines and prevention relies strongly on preclinical studies in macaque models for the identification and evaluation of potential vaccines or prophylactic treatment strategies [3]. Initially, the goal was to use animal trials to screen for preventive interventions that induce sterilizing immunity (i.e., protection against infection) since this would clearly be the most effective way to contain the AIDS pandemic. Unfortunately, most of the vaccine approaches assessed to date in animal studies have failed to induce sterilizing immunity [4–7], although some prophylactic approaches were found to reduce susceptibility to infection [8–12]. As a result of this shortcoming, vaccine candidates are at present primarily examined with regard to their effects on set point viremia, disease progression, and their general immunogenicity, rather than with regard to the degree of protection against infection they confer. However, the inference as to the degree of sterilizing immunity from the level of immunogenicity is limited by our lack of knowledge about the mechanisms of protection against infection as such [13].
The inability of most vaccine candidates to induce protection against infection in animal studies may be due, at least in part, to unintended consequences of the design of the animal trials, rather than to problems inherent in the vaccination approaches themselves. In most animal studies that seek to test the efficacy of a given preventive intervention, very high challenge doses are used, typically of approximately 10–100 times the infectious dose at which 50% of the animals become infected (ID50). The motivation for using such high challenge doses is mostly practical: the experimenter wants to ascertain infection success in unvaccinated/untreated animals, which can then be compared to the hopefully lower infection success in vaccinated/treated animals. There are, however, concerns with using high challenge doses. Firstly, the extremely high probability of infection in high-dose challenge studies conflicts with the low transmission rate of HIV per sex act [14–17]. Although it has been argued that transmission rates may be higher under some circumstances (such as during acute infection or when other infections of the genital tract are present) than the estimates obtained from discordant couple studies suggest (e.g., the recent study by Pilcher et al. [18]), transmission of HIV during one sex act surely does not occur with certainty. Secondly, protection against high-dose virus challenges may be more difficult to achieve because the use of high challenge doses makes stochastic extinctions that can play an important role in early control of the infection [19] very unlikely. Thus, standard high-dose challenge studies may rule out preventive intervention strategies that could protect against infections following “real life” exposures.
The problems of using high virus doses in animal studies can be illustrated by the discrepancy between the protection zidovudine (AZT) confers in animals and humans. Whereas macaques [20,21] and mice [22] were not protected from infection with high challenge doses by zidovudine (a relatively weak antiretroviral drug when used in monotherapy), clinical studies surprisingly showed that two-thirds of perinatal infections (i.e., mother-to-child transmissions during birth) can be prevented by zidovudine administration [23]. It is important to note that the use of zidovudine to prevent perinatal HIV infection is a biomedical intervention aiming to protect from infection, whereas zidovudine is most commonly used as a therapeutic agent after infection. This example suggests that there is a need for experimental designs that allow the assessment of the protection against infection with lower, and thus more realistic, challenge doses.
The belief that experiments involving realistically low challenge doses require unfeasibly large numbers of animals has prevented the development of low-dose challenge models. In this theoretical study, we show that, contrary to this widely held belief, low-dose challenge experiments can be designed such that they do not require large numbers of animals. Using statistical power analysis, we compare two experimental designs (see Figure 1): (i) a single low-dose challenge design in which each animal is challenged only once, and (ii) a repeated low-dose challenge design in which each animal is challenged until it is infected or a predetermined maximum number of challenges is reached. We find that the repeated low-dose challenge design does not require unfeasibly large numbers of animals.
Figure shows designs for single (A) and repeated (B) low-dose challenge designs. Small arrows denote challenges, and white and red symbols denote uninfected and infected animals, respectively.
In the following, we are going to discuss the case of assessing whether a vaccine candidate induces sterilizing immunity. All the considerations in this article, however, apply equally to other preventive interventions, such as microbicides.
Methods
To assess the quality of the single and the repeated low-dose challenge designs, we conducted a statistical power analysis. The statistical power of an experimental design is defined as the probability that an effective vaccine or treatment is correctly determined to be effective. This analysis consists of simulating the experiments, evaluating them, and then repeating this procedure thousands of times to estimate the statistical power of a given experimental design.
Simulation of Single Low-Dose Challenge Experiments
In our simulations of the single low-dose challenge experiments, we assume that we have n unvaccinated control animals and n vaccinated animals.
In the control group, we simulate single challenges of each animal with the ID50 by performing n Bernoulli trials with a probability of success of pc = 0.5. The probability of success corresponds to the probability with which an animal becomes infected after a single challenge. (By assuming the same probability pc for each animal, we ignore potential between-animal variation of the susceptibility to infection. This assumption will be relaxed below.) The results of these trials can be written as a vector xc, the entries of which were either zero (uninfected) or one (infected):
By summing over the elements of xc, we obtain the number of infected animals in the control group, ιc:
In the vaccinated group, we simulate single challenges with the ID50 similarly to the control group by performing Bernoulli trials. However, we assume that, because of vaccination, the probability of infection (or success) in the vaccinated group, pv, is lower than that in the control animals, pc. The relation of pv to the effect of the vaccine on the susceptibility of the host, VES, is given by:
The results of these Bernoulli trials can again be written as a vector xv, and summing the elements of xv we obtain the number of infected animals in the vaccinated group, ιv.
The outcome of the simulated experiment can then be summarized in a contingency table as shown in Table 1. On this contingency table, we perform a standard one-tailed Fisher's exact test [24] to assess whether the fraction of infected animals in the vaccinated group is significantly lower than that in the control group.
Simulation of Repeated Low-Dose Challenge Experiments
In our simulations of the repeated low-dose challenge experiments, we once more assume that we have n unvaccinated control animals and n vaccinated animals.
We again simulate challenges of each control animal with the ID50 by performing Bernoulli trials with a probability of success of pc = 0.5. Unlike in the simulations of the single low-dose challenge experiments, however, we now repeatedly challenge each animal until it is infected or until a maximum number of challenges, Cmax, has been performed. We assume that the probability of infection pc is independent of how often an animal has been challenged before. The results of these repeated Bernoulli trials can be written as two vectors, yc, which contains the number of challenges that have been performed on each animal:
and sc, which contains information on whether a given animal is uninfected (zero) or infected (one):
By summing over yc, we obtain the total number of challenges performed in the control group, ηc:
And, by summing over sc, we obtain the number of infected animals in the control group, ιc:
To simulate repeated low-dose challenges in the vaccinated group, we perform repeated Bernoulli trials with a probability of success pv. For a given vaccine efficacy VES,pv is determined by equation 3. Analogously to the control group, the results of these repeated Bernoulli trials can be written as two vectors, yv and sv, and summing the elements of these two vectors yields the total number of challenges performed in the vaccinated group, ηv, and, the number of infected animals in the vaccinated group, ιv.
As in the case of the single low-dose challenge design, the outcome of the simulated experiment can be summarized in a contingency table (Table 2). To assess whether the fraction of infected animals in the vaccinated group is significantly lower than that in the control group, we again perform a one-tailed Fisher's exact test [24]. In general, the number of challenges, ηc and ηv, is larger than the number of animals per group, n. This increase of numbers in the contingency table leads to increased statistical power of the repeated low-dose challenge design. To analyze the outcome of the simulated repeated low-dose challenge experiments, we chose to use Fisher's exact test rather than a more obvious Cox proportional hazards model because the latter depends on large sample asymptotics while we were interested in cases of small numbers of experimental animals.
Heterogeneity in Infection Probabilities
In our mml:mathematical description of challenge experiments, we have assumed that animals within each group have equal infection probabilities—pc and pv, for the control and vaccinated groups, respectively. To simulate potential animal-to-animal variation in susceptibility to infection, we relaxed this assumption and assigned individual infection probabilities to each animal.
The individual infection probabilities are drawn from a β-distribution, which is often used as a prior distribution for binomial proportions. The β-distribution has two shape parameters, α and β. Its probability density is given by
and its mean and variance are
We assume that μ = pc in the control group and μ = pv = (1 − VES)pc in the vaccinated group. Further, we assume that the coefficients of variation, CV = σ/μ, of the distributions in the two groups are equal. With these assumptions, we can rewrite the two shape parameters of the β-distribution, α and β, in terms of the infection probability, p, and the coefficient of variation, CV:
Hereby, p = pc for the control group and p = pv = (1 − VES)pc for the vaccinated group.
To incorporate potential heterogeneity in susceptibility into the virtual low-dose challenge experiments, we replaced the probability of success in the Bernoulli trials (see above) with the individual infection probabilities.
Power Analysis
To calculate the statistical power of the single and the repeated low-dose challenge designs, we performed 100,000 such simulated experiments for a given number, n, of animals per group. The statistical power can be estimated as the fraction of simulated experiments in which the vaccine is found to be significantly efficacious (significance level α = 0.05). We estimated the statistical power for the number of animals per group, n, ranging from one to 20, and for vaccine efficacies VES = 0.67, 0.8, and 0.9. The power analysis outlined above was implemented in the R Language of Statistical Computing [25]. An R-script that performs the power analysis presented here is provided as Protocol S1.
For large numbers of animals per group, n, the statistical power can be approximated using asymptotic theory. For the single low-dose challenge design the power is approximately (e.g., [26], p. 240):
Hereby, Φ denotes the cumulative normal distribution,
and zα is the standard normal deviate associated with the one-tailed probability α (the significance level). Furthermore, pc and pv denote the infection probabilities of animals in the control and vaccinated groups, respectively, and n the number of animals per group. The term 1/n in the numerator is the continuity correction [27,28].
For the repeated low-dose challenge design, the number of challenges is not the same as the number of animals, n, but is a random variable. The number of challenges for each individual is geometrically distributed with a maximum of Cmax. The expected number of challenges in the control group, , and the vaccinated group, are
and
Substituting the expected number of challenges for the actual number, we can approximate the statistical power of the repeated low-dose challenge design as
Hereby, γ = (1/〈ηc〉 + 1/〈ηv〉)/2 is the continuity correction. For Cmax = 1, equation 17 reduces to equation 13. Because the approximation in equation 17 involves the substitution of a random variable with its expectation, it is less accurate than the approximation for the power of the single low-dose challenge design in equation 13. The R-script provided as Protocol S1 also contains a function that calculates the statistical power using equation 17.
Results
Single Low-Dose Challenge Design Requires Large Numbers of Animals
How would we measure protection against infection in a low-dose challenge model? The most straight-forward design would involve a large number of hosts, some vaccinated and some unvaccinated. After challenge with a low dose, one would determine the fraction of infected hosts in vaccinated and unvaccinated groups, and assess whether there is a statistically significant difference in the fractions (see Figure 1A).
To assess how many animals would be required in a single low-dose challenge experiment, we performed a statistical power analysis (see Methods). The statistical power of an experimental design is defined as the probability that, in an experiment with an effective vaccine, the vaccine is correctly determined to be effective. Obviously the power depends on the efficacy of the vaccine (which is called the “effect size” in the context of power analysis) and the number of host animals used in the experiment. In the power analysis we performed, we assumed that we had equal numbers of unvaccinated and vaccinated animals, and that all animals within a group were equally susceptible to infection. Lastly, we assumed that the vaccine was “leaky” [29,30], i.e., that the susceptibility of vaccinated animals was by a constant factor lower than the susceptibility of the unvaccinated control animals.
In virtual experiments, we then challenged each (virtual) animal once with a challenge dose of one ID50, the dose at which on average 50% of the unvaccinated animals become infected after a single challenge. Using a one-sided Fisher's exact test, we tested whether the fraction of infected animals in the vaccinated group was significantly lower than in the control group. Performing 100,000 such virtual experiments for a given number n animals per group, we estimated the statistical power as the fraction of virtual experiments that yielded significant results (significance level α = 0.05).
The result of this power analysis is shown by the green curves in Figure 2. We calculated the power for vaccine efficacies of 67%, 80%, and 90%. We found that, even for the highest vaccine efficacy of 90%, the single low-dose challenge design required more than 20 animals per group to reach a statistical power of 95%. Thus, the single low-dose challenge design is not feasible, or at least not practical, to assess the efficacy of a vaccine or other preventive interventions in animals.
In our virtual experiments, we set the challenge dose equal to the ID50, and assumed that the vaccine efficacy was 67% (dotted lines), 80% (dashed lines), or 90% (solid lines). The graph shows the statistical power of the repeated low-dose challenge design (black lines) and the single low-dose challenge design (green lines) for a given number of animals per group as determined from 100,000 virtual experiments. If the vaccine is 90% effective, the statistical power of the repeated low-dose challenge design is higher than 95% with only five animals per group, as compared to only 15% for the single low-dose challenge design.
Repeated Low-Dose Challenge Design Does Not Require Large Numbers of Animals
We propose an alternative design involving repeated challenges of individual animals with low doses, which circumvents the disadvantage of the single low-dose challenge design that large numbers of host individuals are required. Repeated challenges effectively “recycle” host animals, thus increasing the statistical power of the experiment. In addition to increasing the statistical power of the experimental design, repeated challenges recapitulate much more realistically the circumstances of human exposure than single challenges. In this alternative design, the efficacy of a vaccine can be estimated by measuring the difference in the number of challenges needed to infect vaccinated versus unvaccinated hosts (see Figure 1B).
To show that this alternative design does not require unfeasibly large numbers of animals, we performed a statistical power analysis (see Methods). As for the single low-dose design, we assumed that we had equal numbers of unvaccinated and vaccinated animals, and that all animals within a group were equally susceptible to infection. We further made the important assumption that the susceptibility of an individual animal was independent of how often the animal was unsuccessfully challenged previously. This assumption is commonly adopted in statistical models that are used to estimate the transmission rate of HIV [14–17]. By making this assumption, we ignored that an unsuccessful challenge may induce some degree of immunity against subsequent challenges. We would like to emphasize, however, that this assumption is not crucial for our argument, unless the degree of induced immunity is very high. Lastly, we again assumed that the vaccine was leaky [29,30].
In virtual experiments, we then challenged the (virtual) animals repeatedly with a challenge dose of one ID50. We allowed for a maximum number of 20 challenges of each individual animal. Table 3 shows the outcome of one such virtual experiment. We analyzed the outcome of the virtual experiments with a one-tailed Fisher's exact test (see Methods). We again estimated the statistical power by performing 100,000 such virtual experiments for a given number n animals per group.
Figure 2 shows the statistical power of the repeated low-dose challenge design as a function of the number of animals per group for varying vaccine efficacies (black lines), and compares it to the statistical power of the single low-dose challenge design (green lines). The statistical power achieved with the repeated low-dose challenge design is generally higher than that achieved with the single low-dose challenge design. If the vaccine is 90% effective (VES = 0.9), i.e., it reduces the susceptibility by a factor of ten, the number of animals per group could be as low as five to achieve more than 95% statistical power. In contrast, in single low-dose challenge experiments with the same number of animals per group the statistical power is only 15%. Thus, repeated low-dose challenge experiments are expected to require far fewer animals than single low-dose challenge experiments.
How Often Should Virus Challenges Be Repeated?
To investigate how the maximum number of challenges affected the statistical power, we plotted the power against Cmax for trials involving six and 12 animals per group (Figure 3). We found that the power increases with Cmax, but for high Cmax the returns diminished considerably. The lower the number of animals per group, n, the higher the maximum number of challenges, Cmax, for which the power effectively saturated. Even for low numbers of animals per group, n, however, the maximum number of challenges, Cmax, needed to unfold the full potential of the repeated low-dose challenge design was in a feasible range.
For this plot we assumed trials with vaccine efficacies of VES = 0.67 (dotted line), VES = 0.8 (dashed line), and VES = 0.9 (solid line). In (A) we calculated the statistical power for six animals per group, n = 6, and in (B) for 12 animals per group, n = 12.
Impact of Animal-to-Animal Variation in Susceptibility
To study how potential heterogeneity in susceptibility affected the power of low-dose challenge trials, we simulated experiments in which each animal was assigned an individual infection probability (see Methods). In these simulations, the degree of heterogeneity was measured by the coefficient of variation, CV, of the susceptibility distributions. Figure 4A shows susceptibility distributions for three different values of CV.
(A) Susceptibility distributions for different levels of heterogeneity, measured by the coefficient of variation, CV, of the susceptibility distribution. The vaccine is assumed to be 80% effective, VES = 0.8.
(B) The statistical power depends on the coefficient of variation, CV, for the repeated low-dose challenge design (black lines) and the single low-dose challenge design (green lines). For these plots we assumed trials with six and 12 animals per group and vaccine efficacies of VES = 0.67 (dotted lines), VES = 0.8 (dashed lines), and VES = 0.9 (solid lines).
We extended our power analysis by considering the impact of the heterogeneity parameter CV on the statistical power (Figure 4B). We found that the statistical power of the single low-dose challenge design was almost unaffected by animal-to-animal variation in infection probability, whereas, for the repeated low-dose challenge design, the power decreased with increasing heterogeneity. Importantly, however, the power did not decrease linearly with heterogeneity: it was sufficiently stable in the range 0 < CV < 0.3 and dropped mainly for CV > 0.3. Thus, over a wide range of potential animal-to-animal variation in susceptibility, low-dose challenge designs are sufficiently powered, and the power of the repeated low-dose experiments is superior to that of single low-dose challenge experiments.
Discussion
Preclinical studies assessing the efficacy of potential vaccines, microbicides, or systemic chemoprophylaxis are usually conducted with very high virus challenge doses, which result in infection with certainty. Since these high challenge doses do not reflect the low probability of HIV transmission in humans, vaccines or prophylactic treatment strategies that are effective against “real life” exposures may go undetected in high-dose challenge experiments. For example, zidovudine was found to prevent a large fraction of perinatal HIV infections [23], even though studies in animal models, conducted with high challenge doses, could not establish any protection against infection by zidovudine [20–22].
In this paper, we investigated how efficacy trials of vaccines and preventive treatment could be conducted with low challenge doses in animal models. We showed that the repeated low-dose challenge design is expected to require far fewer experimental animals than commonly believed. It may therefore be feasible to conduct trials with low challenge doses, which more realistically simulate exposures of humans to HIV, allowing us to more directly and sensitively assess vaccine or treatment efficacy than with high-dose challenge experiments.
Owing to the concerns with high challenge doses, several research groups, including our own, have started to develop low-dose challenge models [31–34]. In these preliminary studies, infection could be achieved by challenging macaques intra-rectally [31], intra-vaginally [32,34], or orally [33].
Since adopting low-dose challenge approaches has far-reaching consequences for the design of efficacy trials of vaccines or preventive treatment in animal models, we would like to discuss how some important aspects of trial design, such as transient infections, the challenge schedule, the route of infection, and the phenotype and dose of the challenge strain, should be dealt with and could be optimized.
Using virus challenge doses that do not give rise to infection with certainty, one has to carefully define what one means by successful infection. This question is of particular importance in the repeated low-dose challenge design, because the efficacy of a preventive intervention is estimated on the basis of the number of challenges needed to infect an individual animal. Low-dose challenges have been observed to give rise to transiently detectable viremia [32–34]. Since transient infection is much more likely to lead to immunization [35], thus leading to lower probabilities of infection in subsequent challenges, we suggest considering transient viremia as successful infection and not to re-challenge animals that were transiently infected.
The time interval between challenges is also an essential parameter in the design of repeated low-dose challenge experiments. In the four ongoing repeated low-dose challenge studies [31–34], different approaches have been taken, with time intervals ranging from hours to a week. There may be logistical reasons for choosing short time intervals between challenges, but from a statistical standpoint, the time intervals should be large enough to allow the identification of the challenge that gives rise to infection. Otherwise, the statistical power of the experimental design will be suboptimal and a beneficial effect of the vaccine candidate may be missed.
In parallel to using more realistic, lower challenge doses, other crucial parameters of the experimental infection process, such as the route of transmission and the coreceptor usage of the challenge virus, should also be chosen to be as realistic as possible. Thus, we propose infecting intra-vaginally or intra-rectally in experiments that aim to assess a vaccine or prophylactic treatment against sexual transmission of HIV. Further, we suggest using challenge viruses that utilize CCR5 as coreceptor, such as for example SHIV-SF162P [36], rather than the standard strain SHIV89.6P, which has been found to use mainly CXCR4 [37,38]. These more realistic choices of the route of infection and coreceptor usage will permit the assessment of the efficacy of the preventive intervention in a setting that more accurately reflects HIV exposures of humans, and will enable us to carefully investigate the processes that give rise to infection.
The challenge dose in a low-dose challenge study is another parameter of crucial importance. Although the most realistic choice would be a challenge dose that gives rise to infection with a probability of approximately 0.0005–0.10 [14–17], such extremely low doses would require unfeasibly large numbers of repeated challenges per animal. Moreover, there is substantial variation in transmission rates due to differences in factors such as virus load or the presence of other infections of the genital tract [15–18], and theoretical studies suggest that preventing the transmission events that occur with higher probability would have a disproportionately large effect on controlling the epidemic [39]. To maximize their epidemiological relevance, low-dose challenge experiments should therefore involve challenge doses that reflect transmission probabilities at the upper end of the spectrum. As a compromise between the practicality of high doses and the sensitivity associated with realistically low doses, we propose the ID50. The ID50 can be estimated using well-established nonparametric methods like Spearman-Kärber [40] or single-parameter methods [41], and there is software available, such as a freely distributed package called ID50 developed by John Spouge (http://www.ncbi.nlm.nih.gov/CBBresearch/Spouge/Virology/, which allows an automated estimation of the ID50 from data generated in titration experiments.
The inability to detect sterilizing immunity in high-dose challenge experiments led to a shift of focus towards indirect effects of vaccine candidates on the pathogenicity of the infection and the infectiousness of the vaccinee. This shift of focus required the development of novel statistical models that allowed the estimation of these indirect effects [42,43]. Will the estimation of vaccine efficacy in repeated low-dose challenge studies also require the development of novel statistical techniques? The answer to this question depends on how much the realities of the infection process deviate from our idealized model. There are three potential deviations. First, we assumed in large parts of this study that the susceptibilities to infection were equal for all animals within each group. This is almost certainly not the case. Although we have shown that low-dose challenge experiments are sufficiently powered even if there is substantial animal-to-animal variation in susceptibility, we did not develop the statistical techniques that would allow the estimation of this variation. The extent of animal-to-animal variation in susceptibility can, in principle, be estimated, but this will probably require larger numbers of animals than the estimation of vaccine efficacy. Second, the vaccine may affect the susceptibility of individual animals differently. While we assumed in the present study that the vaccine is leaky, i.e., that the susceptibility is reduced by a constant factor in each animal, other modes of action of a vaccine are possible. In particular, some animals could be completely protected by vaccination, while others may remain completely susceptible. This mode of action is referred to as all-or-none [29,30]. Statistical methods based on maximum likelihood approaches exist that allow the determination of the mode of action of a given vaccine. However, these methods are based on large sample asymptotics, and exact methods will have to be developed to analyze the outcome of low-dose challenge experiments that involve small numbers of animals. Last, it will have to be determined whether the probability of infection changes with the number of challenges performed in a given animal, or, to put it differently, whether the animal has a “memory” of previous challenges. In our analysis, we assumed that the susceptibility of an animal did not change from challenge to challenge. If the probability of infection changes significantly with the number of challenges, however, the development of novel statistical models that take such changes into account will be necessary to adequately estimate vaccine efficacy.
In addition to the potential to assess the vaccine or microbicide efficacy more sensitively and in a more realistic setting, a low-dose challenge approach may enable us to answer questions that cannot even be asked in high-dose challenge models. Some of the most relevant of these questions relate to the effect of challenges that do not lead to infection. If a low-dose challenge does not give rise to infection, where was the virus blocked? Did the virus fail to establish an infection at all? Or did it replicate transiently, but was cleared by the host's immunity? And, very importantly, is an unsuccessfully challenged animal partially immunized against further challenges, or, alternatively, do unsuccessful challenges facilitate future infection by “seeding” animals with defective proviruses that may recombine with complementing viruses upon subsequent exposures [44]?
The answers to these questions would greatly enhance our understanding of HIV transmission and pathogenesis, and thus would provide further guidance toward an effective vaccine or microbicide. Furthermore, by assessing the protection against infection directly, we may be able to discern the specific types and levels of vaccine-induced cellular and humoral immune responses associated with sterilizing immunity [13]. This would provide important benchmarks by which to judge new vaccine candidates, and could also allow retrospective analysis of vaccine candidates evaluated earlier in high-dose challenge studies.
In conclusion, the repeated low-dose challenge approach may enable us to assess the potential efficacy of vaccines and prophylactic treatment strategies more realistically, and more sensitively than the standard high-dose challenge approach. The increased sensitivity may allow us to more rapidly identify interventions that significantly reduce the transmission of low-dose infections that characterize the natural spread of HIV.
Supporting Information
Protocol S1. R-Function for the Calculation of the Statistical Power of Low-Dose Challenge Experiments
https://doi.org/10.1371/journal.pmed.0020249.sd001
(8 KB TXT).
Acknowledgments
We thank Rustom Antia, Steven Self, Mark Tanaka, and Andrew Yates for discussion. RRR was supported by the Deutsche Forschungsgemeinschaft grant number Re 1618/1–2 and the National Institutes of Health (NIH) grant AI-49334. The support of the NIH National Institute of Allergy and Infectious Disease grant 1 R21 AI54260 is gratefully acknowledged. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Author Contributions
RRR performed the analysis. RRR, IML, MBF, and SIS designed the study and wrote the paper.
References
- 1.
Joint United Nations Programme on HIV/AIDS (2004 December) AIDS epidemic update 2004. Geneva: Joint United Nations Programme on HIV/AIDS. Available: http://www.unaids.org/wad2004/report.html. Accessed 24 June 2005.
- 2. Garber DA, Silvestri G, Feinberg MB (2004) Prospects for an AIDS vaccine: Three big questions, no easy answers. Lancet 4: 397–413.
- 3. Staprans SI, Feinberg MB (2004) The roles of nonhuman primates in the preclinical evaluation of candidate AIDS vaccines. Expert Rev Vaccines 3: S5–32.
- 4. Amara RR, Villinger F, Altman JD, Lydy SL, O'Neil SP (2001) Control of a mucosal challenge and prevention of AIDS by a multiprotein DNA/MVA vaccine. Science 292: 69–74.
- 5. Barouch DH, Santra S, Schmitz JE, Kuroda MJ, Fu TM, et al. (2000) Control of viremia and prevention of clinical AIDS in rhesus monkeys by cytokine-augmented DNA vaccination. Science 290: 486–492.
- 6. Rose NF, Marx PA, Luckay A, Nixon DF, Moretto WJ (2001) An effective AIDS vaccine based on live attenuated vesicular stomatitis virus recombinants. Cell 106: 539–549.
- 7. Shiver JW, Fu TM, Chen L, Casimiro DR, Davies ME (2002) Replication-incompetent adenoviral vaccine vector elicits effective anti-immunodeficiency-virus immunity. Nature 415: 331–335.
- 8. Lederman MM, Veazey RS, Offord R, Mosier DE, Dufour J (2004) Prevention of vaginal SHIV transmission in rhesus macaques through inhibition of CCR5. Science 306: 485–487.
- 9. Tsai CC, Emau P, Follis KE, Beck TW, Benveniste RE (1998) Effectiveness of postinoculation (r)-9-(2-phosphonylmethoxypropyl) adenine treatment for prevention of persistent simian immunodeficiency virus SIVmne infection depends critically on timing of initiation and duration of treatment. J Virol 72: 4265–4273.
- 10. Tsai CC, Follis KE, Sabo A, Beck TW, Grant RF (1995) Prevention of SIV infection in macaques by (R)-9-(2-phosphonylmethoxypropyl)adenine. Science 270: 1197–1199.
- 11. Veazey RS, Klasse PJ, Ketas TJ, Reeves JD, Piatak M (2003) Use of a small molecule CCR5 inhibitor in macaques to treat simian immunodeficiency virus infection or prevent simian-human immunodeficiency virus infection. J Exp Med 198: 1551–1562.
- 12. Veazey RS, Shattock RJ, Pope M, Kirijan JC, Jones J (2003) Prevention of virus transmission to macaque monkeys by a vaginally applied monoclonal antibody to HIV-1 gp120. Nat Med 9: 343–346.
- 13. Johnson RP (2002) Mechanisms of protection against simian immunodeficiency virus infection. Vaccine 20: 1985–1987.
- 14.
Brookmeyer R, Gail MH (1994) AIDS epidemiology: A quantitative approach. Oxford: Oxford University Press. 354 p.
- 15. Gray RH, Wawer MJ, Brookmeyer R, Sewankambo NK, Serwadda D (2001) Probability of HIV-1 transmission per coital act in monogamous, heterosexual, HIV-1-discordant couples in Rakai, Uganda. Lancet 357: 1149–1153.
- 16. Mastro TD, Kitayaporn D (1998) HIV type 1 transmission probabilities: Estimates from epidemiological studies. AIDS Res Hum Retroviruses 14: S223–S227.
- 17. Wawer MJ, Gray RH, Sewankambo NK, Serwadda D, Li X, et al. (2005) Rates of HIV-1 transmission per coital act, by stage of HIV-1 infection, in Rakai, Uganda. J Infect Dis 191: 1403–1409.
- 18. Pilcher CD, Tien HC, Eron JJ, Vernazza PL, Leu SY (2004) Brief but efficient: Acute HIV infection and the sexual transmission of HIV. J Infect Dis 189: 1785–1792.
- 19. Wick D, Self SG (2000) Early HIV infection in vivo: Branching-process model for studying timing of immune responses and drug therapy. Math Biosci 165: 115–134.
- 20. Fazely F, Haseltine WA, Rodger RF, Ruprecht RM (1991) Postexposure chemoprophylaxis with ZDV or ZDV combined with interferon-α—Failure after inoculating rhesus-monkeys with a high-dose of SIV retrovirology. J Acquir Immune Defic Syndr 4: 1093–1097.
- 21. Legrand R, Clayette P, Noack O, Vaslin B, Theodoro F (1994) An animal-model for antilentiviral therapy—Effect of zidovudine on viral load during acute infection after exposure of macaques to simian immunodeficiency virus. AIDS Res Hum Retroviruses 10: 1279–1287.
- 22. Ruprecht RM, Bronson R (1994) Chemoprevention of retroviral infection—Success is determined by virus inoculum strength and cellular-immunity. DNA Cell Biol 13: 59–66.
- 23. Mofenson LM (1997) Reducing the risk of perinatal HIV-1 transmission with zidovudine: Results and implications of AIDS Clinical Trials Group protocol 076. Acta Paediatr Suppl 421: 89–96.
- 24. Fisher RA (1935) The logic of inductive inference. J R Stat Soc A 98: 39–82.
- 25.
R Development Core Team (2005) The R project for statistical computing. Vienna: R Foundation for Statistical Computing. Available: http://www.R-project.org. Accessed 24 June 2005.
- 26.
Agresti A (1990) Categorical data analysis. New York: Wiley. 558 p.
- 27.
Fleiss JL (1981) Statistical methods for rates and proportions, 2nd ed. New York: Wiley. 321 p.
- 28. Newcombe RG (1998) Interval estimation for the difference between independent proportions: Comparison of eleven methods. Stat Med 17: 873–890.
- 29. Smith PG, Rodrigues LC, Fine PE (1984) Assessment of the protective efficacy of vaccines against common diseases using case-control and cohort studies. Int J Epidemiol 13: 87–93.
- 30. Halloran ME, Longini IM, Struchiner CJ (1999) Design and interpretation of vaccine field studies. Epidemiol Rev 21: 73–88.
- 31. McDermott AB, Mitchen J, Piaskowski S, De Souza I, Yant LJ (2004) Repeated low-dose mucosal simian immunodeficiency virus SIVmac239 challenge results in the same viral and immunological kinetics as high-dose challenge: A model for the evaluation of vaccine efficacy in nonhuman primates. J Virol 78: 3140–3144.
- 32. Otten RA, Adams DR, Kim CN, Jackson E, Pullium JK (2005) Multiple vaginal exposures to low doses of R5 simian-human immunodeficiency virus: Strategy to study HIV preclinical interventions in nonhuman primates. J Infect Dis 191: 164–173.
- 33. Van Rompay KK, Abel K, Lawson JR, Singh RP, Schmidt KA (2005) Attenuated poxvirus-based simian immunodeficiency virus (SIV) vaccines given in infancy partially protect infant and juvenile macaques against repeated oral challenge with virulent SIV. J Acquir Immune Defic Syndr 38: 124–134.
- 34. Ma ZM, Abel K, Rourke T, Wang Y, Miller CJ (2004) A period of transient viremia and occult infection precedes persistent viremia and antiviral immune responses during multiple low-dose intravaginal simian immunodeficiency virus inoculations. J Virol 78: 14048–14052.
- 35. McChesney MB, Collins JR, Lu D, Lu X, Torten J (1998) Occult systemic infection and persistent simian immunodeficiency virus (SIV)-specific CD4(+)-T-cell proliferative responses in rhesus macaques that were transiently viremic after intravaginal inoculation of SIV. J Virol 72: 10029–10035.
- 36. Harouse JM, Gettie A, Eshetu T, Tan RC, Bohm R (2001) Mucosal transmission and induction of simian AIDS by CCR5-specific simian/human immunodeficiency virus SHIV(SF162P3). J Virol 75: 1990–1995.
- 37. Zhang YJ, Lou B, Lal RB, Gettie A, Marx PA (2000) Use of inhibitors to evaluate coreceptor usage by simian and simian/human immunodeficiency viruses and human immunodeficiency virus type 2 in primary cells. J Virol 74: 6893–6910.
- 38. Feinberg MB, Moore JP (2002) AIDS vaccine models: Challenging challenge viruses. Nat Med 8: 207–210.
- 39. May RM, Anderson RM (1988) The transmission dynamics of human immunodeficiency virus (HIV). Philos Trans R Soc Lond B Biol Sci 321: 565–607.
- 40. Miller RG (1973) Nonparametric estimators of the mean tolerance in bioassay. Biometrika 60: 535–542.
- 41. Spouge JL (1992) Statistical-analysis of sparse infection data and its implications for retroviral treatment trials in primates. Proc Natl Acad Sci U S A 89: 7581–7585.
- 42. Longini IM, Hudgens MG, Halloran ME, Sagatelian K (1999) A Markov model for measuring vaccine efficacy for both susceptibility to infection and reduction in infectiousness for prophylactic HIV vaccines. Stat Med 18: 53–68.
- 43. Gilbert PB, DeGruttola VG, Hudgens MG, Self SG, Hammer SM (2003) What constitutes efficacy for a human immunodeficiency virus vaccine that ameliorates viremia: Issues involving surrogate end points in phase 3 trials. J Infect Dis 188: 179–193.
- 44. Kim EY, Busch M, Abel K, Fritts L, Bustamante P (2005) Retroviral recombination in vivo: Viral replication patterns and genetic structure of simian immunodeficiency virus (SIV) populations in rhesus macaques after simultaneous or sequential intravaginal inoculation with SIVmac239Δvpx/Δvpr and SIVmac239Δnef. J Virol 79: 4886–4895.
Patient Summary
Background
Before trials of medicines or vaccines are done in humans, most are tested in animals. There are many controversies about these animal trials, including whether they mimic the human disease accurately. In testing vaccines for HIV, animals are mostly given high doses of the virus, whereas in real life people are often repeatedly exposed to small amounts of the virus. No vaccine that has been tested against HIV prevents infection in animals. It is possible that some of this lack of success may be due to the design of the vaccine trials rather than the vaccine itself.
What Did the Authors Do?
They wanted to look at experimental designs that allowed assessment of protection against infection with lower, and thus more realistic, doses of virus. Previously, researchers had suggested that many animals would be needed for this type of study. The authors wanted to see whether this was correct. They developed a model to test how well single and multiple low-dose experiments performed. They did this by simulating the experiments with doses of virus, assessing the results, and then repeating this procedure 100,000 times to estimate how valid a given experimental design was.
Their modeling showed that by repeatedly giving animals low doses of virus, it was possible to use a smaller number of animals than was needed for trials with a single low dose.
What Do These Results Mean?
It may be possible to use these results to plan trials of vaccines in animals that mimic more closely the way that humans are exposed to HIV, and hence the results may be more reliable for human disease.
Where Can I Get More Information?
MedlinePlus has a great deal of information on HIV:
http://www.nlm.nih.gov/medlineplus/aids.html
The Body has information targeted to both patients and health professionals: