Retraction: Retraction: Batniji R, Bendavid E (2012) Does Development Assistance for Health Really Displace Government Health Spending? Reassessing the Evidence. PLoS Med 9(5): e1001214. doi:10.1371/journal.pmed.1001214
Retraction: Batniji R, Bendavid E (2012) Does Development Assistance for Health Really Displace Government Health Spending? Reassessing the Evidence. PLoS Med 9(5): e1001214. doi:10.1371/journal.pmed.1001214
The authors, Rajaie Batniji and Eran Bendavid, retract their PLoS Medicine essay (1) due to errors in statistical model choice and reporting. Batniji and Bendavid state: “On May 8, 2012, we published an essay that contained a reanalysis of data used by Lu et al. (2) to examine whether development assistance for health leads to displacement of public health spending by recipient governments. In the essay we indicated that we used a fixed effects linear regression, while in Table 4 we reported the results of an analysis using a linear regression without controlling for fixed effects. Upon discovery of this mistake, which resulted from a miscommunication between the authors, we immediately informed PLoS Medicine and moved to correct the record. Our essay concluded that the findings in the analysis by Lu et al. were strongly influenced by outliers and questionable data. However, when our analysis is done using a linear regression with fixed effects, the results show a similar effect size and significance level to that indicated in the original article by Lu et al. As a result of this error, we now believe the following statements in our essay lack justification:
1. “the association between DAH and displacement of government health expenditures is not robust after exclusion of a small subset of data.”
2. “The trends [in the analysis by Lu et al.] are driven by outliers…”
3. “While there does appear to be an association, it is too tenuous, too dependent on problematic model selection, and inconsistent.””
The PLoS Medicine editors agree with the need for the Retraction and accept the authors’ explanation of their error. During the editorial handling of the essay, the paper was reviewed twice by our statistician: once following peer review by content experts and revision by the authors, and again following a second author revision and before acceptance. We apologize to readers for any inconvenience caused by the publication of this article in the journal. We have invited short perspectives from Batniji and Bendavid and from Lu et al. to expand upon evidence for aid displacement in health.
1. Batniji R, Bendavid E (2012) Does Development Assistance for Health Really Displace Government Health Spending? Reassessing the Evidence. PLoS Med 9(5): e1001214. doi:10.1371/journal.pmed.1001214
2. Lu C, Schneider MT, Gubbins P, Leach-Kemon K, Jamison D, Murray CJL (2010) Public Financing of Health in Developing Countries: A Cross-National Systematic Analysis. Lancet 375: 1375-1387. (comment on this retraction)
Citation: Batniji R, Bendavid E (2012) Does Development Assistance for Health Really Displace Government Health Spending? Reassessing the Evidence. PLoS Med 9(5):
Published: May 8, 2012
Copyright: © 2012 Batniji, Bendavid. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: Funding from the Stanford University Freeman Spogli Institute's ‘Global Underdevelopment Action Fund’ supported this work. See http://fsi.stanford.edu/news/request_for_proposals_global_underdevelopment_action_fund_at_fsi_20100712. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: DAH, in development assistance for health; GDP, gross domestic product; GHE, health expenditure; IHME, Institute for Health Metrics and Evaluation; IMF, International Monetary Fund; WHO, World Health Organization
Provenance: Not commissioned; externally peer reviewed.
- At the core of the current aid debate is the question of whether development assistance for health provided to developing country governments increases health expenditures.
- It has recently been suggested that development assistance for health to governments leads to a displacement of government spending, reinforcing skepticism about health aid.
- Here we examine a database of public financing for health from 1995 to 2006 and demonstrate that prior conclusions drawn from these data are unstable and driven by outliers.
- While government spending may be displaced by development assistance for health in some settings, the evidence is not robust and is highly variable across countries. We recommend that current evidence about aid displacement cannot be used to guide policy.
Re-thinking Aid Displacement in the Health Sector
There has been considerable concern in the international development community about aid displacement in the health sector. That is, a concern that foreign aid to the health sector leads to a displacement or diversion of government funds from the health sector. Foreign aid, also known as development assistance, includes funding from international development agencies in donor countries, multilateral agencies like the World Bank and Global Fund, and private sources. The concern about displacement penetrates questions about the strings attached to aid, the monitoring of aid, and whether aid should be given to governments in the first place. A core question being asked is, does development assistance for health increase health spending? Or, do aid funds merely displace government funding for health?
Questioning the Argument That Health Aid Leads to Reduced Government Investment in Health
Concerns about aid displacement are as old as development assistance. As a leading World Bank economist famously said in 1947, “When the World Bank thinks it is financing an electric power station, it is really financing a brothel.”  More recently, experts commenting in the press have suggested, “When an aid official thinks he [sic] is helping a low-income African patient avoid charges at a health clinic, in reality, he is paying for a shopping trip to Paris for a government minister and his wife .” The concerns—and the cynicism— about foreign aid being displaced and diverted for less-than-noble purposes have been in place the last 60 years.
Some analysis has been done to assess the scale of aid displacement in different sectors and countries. In one analysis, World Bank economists examined aid to 18 African countries from 1971 to 1995, and found that for every US dollar of aid received, government spending increased by US$0.90 . That study also found that some aid intended for capital improvements, like the building of hospitals, went to operations and to the repayment of past loans. But across sectors and regions, the evidence for aid displacement is mixed. For example education aid was found to have no discernible effect on education spending worldwide; however, each US dollar in education aid in Africa led to nearly US$1.00 increase in education spending .
Country analyses have also identified great variation in the extent of displacement. One study showed that aid to India “merely substitutes for spending that the government would have undertaken anyway,” concluding that “funds freed by aid are spent on non-development activities .” In contrast, a study of aid to Vietnam's transportation sector found that aid stayed within that sector .
Recently, attention has turned to whether health aid increases government health spending. In 2009, Farag and colleagues found that from 1995 to 2006, each US dollar increase in development assistance for health (DAH) to low-income countries was associated with a US$0.14 decrease in government health spending . A subsequent analysis by Lu and colleagues made the case that for every additional US dollar of DAH from 1995 to 2006, government health expenditures from domestic sources fell by at least US$0.43 . This latter study is referenced frequently in conversations with decision-makers at aid agencies as a cautionary note about DAH. The analysis appears to have reinforced skepticism about health aid.
A closer look at the analysis by Lu and colleagues, using data made available in May 2011 , shows that the association between DAH and displacement of government health expenditures is not robust after exclusion of a small subset of data. The trends are driven by outliers, and country data cluster and follow widely divergent trends (Figure 1). The primary finding by Lu and colleagues, which we are challenging here, is the negative relationship between government health expenditure (GHE-S)/gross domestic product (GDP) and DAH-Gov/GDP. GHE-S/GDP is government health spending from domestic sources as a percentage of GDP for a country in each year from 1995 to 2006. DAH-gov/GDP is development assistance for health disbursed to government as a percentage of GDP for each country in each year from 1995 to 2006. Using Lu and colleagues' data on government health spending and Institute for Health Metrics and Evaluation (IHME) data on DAH , we replicated their results and found that the linear relationship between DAH and government health expenditure from domestic sources is lost when country-years in which World Health Organization (WHO) and International Monetary Fund (IMF) estimates differ by 10-fold or more are removed, when a small set of implausible data points are removed, and when restricting the sample to eliminate those countries that receive very little DAH as a percentage of GDP. In sum, any linear relationship that exists among the data is too tenuous to be a basis for policy.
Figure 1. Primary data scatter of the relationship between DAH and GHE-S in all countries.
Both DAH and GHE-S are presented here as a percentage of GDP, with GHE-S based on IMF data. Each point on the above plot represents a country-year observation used in the analysis. Data source: IHME .
Re-evaluating the Data: Inconsistencies and Omissions
Much debate surrounded the initial publication of the paper by Lu and colleagues, but those engaged in the correspondence acknowledged that they were challenging neither the overall findings nor the data ,. Since publication, the data's reliability and heterogeneity have been called into question: nearly half of the observations are missing for low-income countries , making a reliance on modeled estimates and imputation essential. As Lu and colleagues acknowledge, there is only a 65% correlation between the two main data sources, WHO and IMF. In 29 country-year observations, the ratio between WHO and IMF estimates is greater than 10 (Table 1). In addition to questionable data, Lu and colleagues leave out of the analysis 51 countries that IHME previously analyzed as recipients of DAH, including Russia and much of Eastern Europe, Iraq, Afghanistan, the occupied Palestinian territory, Somalia, and several small Island states (Box 1) .
Table 1. Observations where the ratio of WHO to IMF estimates of government health expenditure from domestic sources as a percentage of GDP (GHE-S/GDP) is greater than 10.doi:10.1371/journal.pmed.1001214.t001
Box 1. DAH-Receiving Countries Omitted from Study by Lu and Colleagues 
Bosnia and Herzegovina
Korea, Democratic People's Republic
Northern Mariana Islands
Palestinian Territory, occupied
Saint Kitts and Nevis
Saint Vincent and the Grenadines
Sao Tome and Principe
Turks and Caicos Islands
Wallis and Fortuna
Even if we accept the concerns about data consistency and accept the highly imputed data, the relationship between DAH and GHE-S is not stable to the exclusion of a few data points. We replicated the author's fixed effects model (Arellano-Bover/Blundell Bond model). We confirmed their main results, but we further explored the sensitivity of the results to the exclusion of questionable data. The associations failed significance testing at p = 0.05 when excluding the lowest 10% of GHE-S using the IMF data and the lowest 20% of the WHO data.
Given the concerns about Lu and colleagues' model choice, we repeated the analysis using an alternative statistical model to assess the robustness of the relationship between DAH and GHE-S. We used ordinary least squares regression with country fixed effects, clustered by country, for the main model estimation of the association between DAH and GHE-S. We avoided random effects estimation because the aid literature suggests that the differences in the manner in which countries handle aid funds are structural (“fixed”) and idiosyncratic, so an exchangeability assumption seemed inappropriate. Countries have different means of interacting with donors: some require donors to buy into and contribute toward a national plan (e.g., India), while others allow donors freedom to implement projects with few constraints (e.g., Tanzania) . Countries also have differences in national institutions that collect, disseminate, and report on foreign assistance. These fixed differences may be beneath the wide variation seen in country trends (Figure 2). Furthermore, donors take widely varying strategies toward liaising with government. For example, while World Bank funding largely goes through official government channels, the United States Government's President's Emergency Plan for AIDS Relief (PEPFAR) had largely bypassed recipient country budget-planning procedures in its effort to achieve a rapid scale-up of HIV/AIDS programs .
Figure 2. Widely divergent trends in the relationship between DAH and GHE-S in select countries.
Both DAH and GHE-S are presented here as a percentage of GDP, with GHE-S based on IMF data. In Rwanda, GHE-S is effectively zero, regardless of DAH. In Lesotho, GHE-S appears to rise with DAH (aid is associated with additional GHE-S). Eritrea exhibits erratic response, while Zambia generally follows the predictions of Lu and colleagues about decreasing government expenditure with increasing DAH. Data source: IHME .
We tested the sensitivity of the results to the exclusion of observations from years where recipient governments were calculated to spend less than 0.01% of GDP from domestic sources on health. In a country with a GDP per capita of US$1,000, this means that the government is spending less than US$0.10 of non-donor money on health per capita. The IHME data show that GHE-S is less than 0.01% of GDP in 47 (out of over 1,200) country-year observations using IMF data and in 8 country-year observations using WHO data (Table 2). The linear association between DAH and GHE-S as percentage of GDP is not significant after excluding these observations. According to IMF data, Rwanda has had such near-complete displacement every year from 1997 to 2006. Cambodia, Ethiopia, and Guinea-Bissau follow a very similar trend to Rwanda, all showing near-complete displacement every year. If real, such complete displacement suggests alternative national priorities, and donors could seek alternative approaches to aligning their priorities with those of the recipient government. If we exclude these observations where GHE-S is less than 0.01%, there is no longer a statistically significant linear relationship between GHE-S and DAH.
Table 2. Country-years in which GHE-S/GDP <0.0001 in IMF and WHO data.doi:10.1371/journal.pmed.1001214.t002
Furthermore, linear regressions examining the association between DAH and GHE-S as a percentage of GDP when DAH to government is greater than or equal to 0.5% of national GDP are not significant. That is, countries that receive a substantial amount of DAH show little evidence of displacement. Notably, just under half of DAH is given to countries receiving greater than or equal to 0.5% of GDP as DAH (Table 3). DAH to governments is not displaced when aid makes a large (greater than or equal to 0.5% of GDP) contribution to health spending. This calls into question the argument that governments displace aid because they are not able to absorb it. It appears that aid displacement trends, even if we accept all the flawed data, are driven by those countries that receive very small amounts of aid for health, as the relationship is absent if we look at country-years in which aid makes up 0.5% of GDP or greater (Table 4).
Table 3. Country-years in which DAH equals or exceeds 0.5% of GDP.doi:10.1371/journal.pmed.1001214.t003
Table 4. Summary of regressions, with GHE-S/GDP as dependent variable, DAH to governments/GDP as independent variable.doi:10.1371/journal.pmed.1001214.t004
The Current Evidence on Aid Displacement Cannot Guide Policy
First, even if displacement does exist, there is no evidence that it is a bad thing. A large-scale empirical analysis found no evidence that non-fungible sectoral aid (that is, aid earmarked or otherwise dedicated to its intended purposes) works better than fungible aid, when “better” is understood as economic growth, spending in pro-poor sectors, or reductions in infant mortality . In Vietnam's health sector, Wagstaff found that project-level outcomes are not harmed by displacement of government funding, suggesting that governments aim to shift spending to support projects where additional investments provide the greatest improvements . Furthermore, as a recent analysis of health financing in Honduras, Rwanda, and Thailand showed that these countries increased their domestic spending from domestic sources in response to increases in donor funding, a finding based on close examination of country-spending that is at sharp odds with the cross-country conclusions . This study also found that donors were likely to shift funds in the face of increasing resources from the Global Fund. This finding raises the possibility that some of the measured “displacement” is exogenous; that is, countries are shifting resources in response to anticipated, promised, or real changes in DAH. Aid displacement may be a reasonable approach for governments to improve the societal benefits of resource allocation decisions when development assistance is volatile or threatened. Even if we accept Lu and colleagues finding that DAH to NGOs undergoes less displacement (and thus, increases government health expenditure), this likely reflects the fact that NGOs are less likely to be burdened by the risks of aid volatility; and, since NGO salaries tend to be higher, they may drive up public sector health wages and in turn government expenditures (see Text S1 for an analysis of the vulnerability of this finding).
Given the concerns raised over data plausibility and completeness, conclusions about the mean relationship between DAH and government health spending should be called into question. While there does appear to be an association, it is too tenuous, too dependent on problematic model selection, and inconsistent (even among individual countries) to be used for policy or resource-allocation decisions. We show that there is no significant aid displacement when government health expenditures from domestic sources exceed 0.01% of GDP, and no evidence of aid displacement when DAH exceeds 0.5% of GDP (Table 4).
No statistical model can adequately compensate for systematically wrong and missing data. While Lu and colleagues have gathered the best available data, and have been fully transparent in sharing their datasets and methods, the reality is that we still lack a sufficient accounting of public financing on health to make any conclusions on overall trends. Of course, some displacement of aid from the health sector may occur. It would be rational for governments seeking to improve the distribution of limited national resources, and seeking to avoid interruptions in health service provision with annual fluctuations in aid to avoid a rapid rise in health sector spending. However, our findings should relieve donors of the need to make unrealistic demands on recipient governments, and of the pressure to divert resources to NGOs. While in some settings aid likely is displaced from the health sector, we call into question the assertions that donor health funds are being systematically displaced and misused.
Statistical supplement: aid displacement.
Wrote the first draft of the manuscript: RB. Contributed to the writing of the manuscript: RB EB. ICMJE criteria for authorship read and met: RB EB. Agree with manuscript results and conclusions: RB EB.
Devarajan S, Rajkumar AS, Swaroop V (1999) What does aid to Africa finance? Washington (D.C.): World Bank.
Cheng M (2010 April 10) Health aid made some countries cut budgets. The Guardian.
Swaroop V, Jha S, Rajkumar AS (2000) Fiscal effects of foreign aid in a federal system of governance The case of India. J Public Econ 77: 307–330.
Van de Walle D, Mu R (2007) Fungibility and the flypaper effect of project aid: micro-evidence for Vietnam. J Dev Econ 84: 667–685.
Farag M, Nandakumar A, Wallack SS, Gaumer G, Hodkin D (2009) Does funding from donors displace government spending for health in developing countries? Health Affair 28: 1045–1055.
Lu C, Schneider MT, Gubbins P, Leach-Kemon K, Jamison D, et al. (2010) Public financing of health in developing countries: a cross-national systematic analysis. Lancet 375: 1375–1387.
Institute for Health Metrics and Evaluation (IHME) (2010) Public financing of health (developing country) estimates 1995–2006. Seattle (Washington): Institute for Health Metrics and Evaluation (IHME).
Institute for Health Metrics and Evaluation (IHME) (2010) Development assistance for health database 1990–2008. Seattle (Washington): Institute for Health Metrics and Evaluation (IHME).
Ooms G, Decoster K, Miti K, Rens S, Van Leemput L, et al. (2010) Crowding out: are relations between international health aid and government health funding too complex to be captured in averages only? Lancet 375: 1403–1405.
Sridhar D, Woods N (2010) Are there simple conclusions on how to channel health funding? Lancet 375: 1326–1328.
Stuckler D, Basu S, McKee M (2011) International Monetary Fund and aid displacement. Int J Health Serv 41: 67–76.
Ravishankar N, Gubbins P, Cooley RJ, Leach-Kemon K, Michaud CM, et al. (2009) Financing of global health: tracking development assistance for health from 1990 to 2007. Lancet 373: 2113–2124.
GEG (2008) Preliminary report of a high-level working group, 11–13 May 2008. Oxford: Global Economic Governance Programme.
Sridhar D, Batniji R (2008) Misfinancing global health: a case for transparency in disbursements and decision making. Lancet 372: 1185–1191.
Pettersson J (2007) Foreign sectoral aid fungibility, growth and poverty reduction. Journal of International Development 19: 1074–1098.
Wagstaff A (2011) Fungibility and the impact of development assistance: evidence from Vietnam's health sector. J Dev Econ 94: 62–73.
Garg CC, Evans DB, Dmytraczenko T, Izazola-Licea J-A, Tangcharoensathien V, et al. (2012) Study raises questions about measurement of ‘additionality,’ or maintaining domestic health spending amid foreign donations. Health Affair 31: 417–425.