Low haemoglobin concentration has been associated with adverse prognosis in patients with angina and myocardial infarction (MI), but the strength and shape of the association and the presence of any threshold has not been precisely evaluated.
Methods and findings
A retrospective cohort study was carried out using the UK General Practice Research Database. 20,131 people with a new diagnosis of stable angina and no previous acute coronary syndrome, and 14,171 people with first MI who survived for at least 7 days were followed up for a mean of 3.2 years. Using semi-parametric Cox regression and multiple adjustment, there was evidence of threshold haemoglobin values below which mortality increased in a graded continuous fashion. For men with MI, the threshold value was 13.5 g/dl (95% confidence interval [CI] 13.2–13.9); the 29.5% of patients with haemoglobin below this threshold had an associated hazard ratio for mortality of 2.00 (95% CI 1.76–2.29) compared to those with haemoglobin values in the lowest risk range. Women tended to have lower threshold haemoglobin values (e.g, for MI 12.8 g/dl; 95% CI 12.1–13.5) but the shape and strength of association did not differ between the genders, nor between patients with angina and MI. We did a systematic review and meta-analysis that identified ten previously published studies, reporting a total of only 1,127 endpoints, but none evaluated thresholds of risk.
There is an association between low haemoglobin concentration and increased mortality. A large proportion of patients with coronary disease have haemoglobin concentrations below the thresholds of risk defined here. Intervention trials would clarify whether increasing the haemoglobin concentration reduces mortality.
Please see later in the article for the Editors' Summary
Citation: Shah AD, Nicholas O, Timmis AD, Feder G, Abrams KR, et al. (2011) Threshold Haemoglobin Levels and the Prognosis of Stable Coronary Disease: Two New Cohorts and a Systematic Review and Meta-Analysis. PLoS Med 8(5): e1000439. doi:10.1371/journal.pmed.1000439
Academic Editor: Anushka Patel, The George Institute for International Health, Australia
Received: July 1, 2010; Accepted: April 19, 2011; Published: May 31, 2011
Copyright: © 2011 Shah et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study is based on data from the Full Feature General Practice Research Database obtained under a Medical Research Council license from the UK Medicines and Healthcare Products Regulatory Agency (http://www.mrc.ac.uk/). This study was supported by grants from the UK National Institute for Health Research (RP-PG-0407-10314; http://www.nihr.ac.uk/) and the Wellcome Trust (086091/Z/08/Z; http://www.wellcome.ac.uk/). ADH is supported by a British Heart Foundation Senior Research Fellowship (FS05/125; http://www.bhf.org.uk/). KRA is partly funded by the UK National Institute for Health Research as a Senior Investigator (NF-SI-0508-10061). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. The interpretation and conclusions contained in this study are those of the authors alone.
Competing interests: The authors declare no competing interests.
Abbreviations: ACS, acute coronary syndrome; BP, blood pressure; CI, confidence interval; eGFR, estimated glomerular filtration rate; GPRD, General Practice Research Database; HR, hazard ratio; MCV, mean corpuscular volume; MI, myocardial infarction
Coronary artery disease is the main cause of death in high-income countries and the second most common cause of death in middle- and low-income countries, accounting for 16.3%, 13.9%, and 9.4% of all deaths, respectively, in 2004. Many risks factors, such as high blood pressure and high blood cholesterol level, are known to be associated with coronary artery disease, and prevention and treatment of such factors remains one of the key strategies in the management of coronary artery disease. Recent studies have suggested that low hemoglobin may be associated with mortality in patients with coronary artery disease. Therefore, using blood hemoglobin level as a prognostic biomarker for patients with stable coronary artery disease may be of potential benefit especially as measurement of hemoglobin is almost universal in such patients and there are available interventions that effectively increase hemoglobin concentration.
Why was This Study Done?
Much more needs to be understood about the relationship between low hemoglobin and coronary artery disease before hemoglobin levels can potentially be used as a clinical prognostic biomarker. Previous studies have been limited in their ability to describe the shape of this relationship—which means that it is uncertain whether there is a “best” hemoglobin threshold or a continuous graded relationship from “good” to “bad”—to assess gender differences, and to compare patients with angina or who have experienced previous myocardial infarction. In order to inform these knowledge gaps, the researchers conducted a retrospective analysis of patients from a prospective observational cohort as well as a systematic review and meta-analysis (statistical analysis) of previous studies.
What Did the Researchers Do and Find?
The researchers conducted a systematic review and meta-analysis of previous studies and found ten relevant studies, but none evaluated thresholds of risk, only linear relationships.
The researchers carried out a new study using the UK's General Practice Research Database—a national research tool that uses anonymized electronic clinical records of a representative sample of the UK population, with details of consultations, diagnoses, referrals, prescriptions, and test results—as the basis for their analysis. They identified and collected information from two cohorts of patients: those with new onset stable angina and no previous acute coronary syndrome; and those with a first myocardial infarction (heart attack). For these patients, the researchers also looked at all values of routinely recorded blood parameters (including hemoglobin) and information on established cardiovascular risk factors, such as smoking. The researchers followed up patients using death of any cause as a primary endpoint and put this data into a statistical model to identify upper and lower thresholds of an optimal hemoglobin range beyond which mortality risk increased.
The researchers found that there was a threshold hemoglobin value below which mortality continuously increased in a graded manner. For men with myocardial infarction, the threshold value was 13.5 g/dl: 29.5% of patients had hemoglobin below this threshold and had a hazard ratio for mortality of 2.00 compared to those with hemoglobin values in the lowest risk range. Women had a lower threshold hemoglobin value than men: 12.8 g/dl for women with myocardial infarction, but the shape and strength of association did not differ between the genders, or between patients with angina and myocardial infarction.
What Do These Findings Mean?
These findings suggest that there are thresholds of hemoglobin that are associated with increased risk of mortality in patients with angina or myocardial infarction. A substantial proportion of patients (15%–30%) have a hemoglobin level that places them at markedly higher risk of death compared to patients with lowest risk hemoglobin levels and importantly, these thresholds are higher than clinicians might anticipate—and are remarkably similar to World Health Organization anemia thresholds of 12 g/dl for women and 13 g/dl for men. Despite the limitations of these observational findings, this study supports the rationale for conducting future randomized controlled trials to assess whether hemoglobin levels are causal and whether clinicians should intervene to increase hemoglobin levels, for example by oral iron supplementation.
Please access these Web sites via the online version of this summary at http://dx.doi.org/10.1371/journal.pmed.1000439.
- Wikipedia provides information about hemoglobin (note that Wikipedia is a free online encyclopedia that anyone can edit; available in several languages)
- The World Health Organization provides an overview of the global prevalence of coronary artery disease, a factsheet on the top ten causes of death, as well as information on anemia
Haemoglobin is a potentially useful prognostic biomarker among patients with stable coronary artery disease because of the pathological role of myocardial hypoxia in subsequent acute coronary events , and the existence of interventions to increase haemoglobin concentration –. Measurement of haemoglobin is nearly universal in such patients, further underscoring the relevance of understanding its impact on prognosis. While previous studies suggest that low haemoglobin is associated with mortality in patients with coronary artery disease ,, they have been limited in their ability to describe the shape of the relationship, to assess gender differences, and to compare patients with angina or prior myocardial infarction (MI). Furthermore there are concerns that the prognostic biomarker literature may be subject to reporting and other biases . Thus several questions, relevant to clinical practice and the design of future trials, remain unanswered.
First, at what concentration of haemoglobin does risk increase; is there a threshold or is it a continuous graded relationship? This question is important in order to define optimal haemoglobin levels. While some studies have reported a continuous relationship between haemoglobin and prognosis among patients with coronary disease, others have reported a J-shaped relationship ,. No previous study has sought to evaluate whether and where there is a threshold. Second, how strong is the relationship in population-based samples, when accounting for coexisting conditions? This question is important in order to estimate excess attributable risks from nonoptimal haemoglobin concentrations. Third, how does the association between haemoglobin concentration and mortality differ between women and men, in whom haemoglobin homeostasis is known to differ? Fourth, do effects differ between patients with a history of angina only, and those with a history of MI? Many patients develop reduced left ventricular function after MI  and might be more sensitive to low haemoglobin concentration. Conversely, low haemoglobin may unmask symptoms of angina and bring patients to medical attention earlier, potentially reducing the apparent effect of low haemoglobin on mortality.
We evaluated prior knowledge on this topic by means of a systematic review and meta-analysis, and sought to extend this knowledge and address the above questions by carrying out a retrospective cohort study using the General Practice Research Database (GPRD).
The GPRD Division of the Medicines and Healthcare products Regulatory Agency has been granted Multi-Centre Research Ethics committee approval for all observational studies using GPRD data.
Over 95% of UK citizens are registered with a general practitioner and receive primary health care free at the point of use. The GPRD contains anonymised electronic clinical records of over 4 million such patients with details of consultations, diagnoses, referrals, prescriptions, and test results. Its use is supported by numerous validation studies on a wide range of diseases  and it has been shown to have accurate recording of MI .
Among GPRD patients aged 35 to 90, we defined two study populations on the basis of coded diagnoses between 2001–2006: firstly, patients with new onset stable angina and no previous acute coronary syndrome (ACS), and secondly, patients with a first MI. The date of the earliest stable angina or MI diagnosis for each patient was designated the “index date.” General practitioners routinely code medical diagnoses using the “Read” clinical terminology ; our codes are listed in Tables S1 (stable angina) and S2 (MI).
For the stable angina population, we included patients with a code for angioplasty or coronary artery bypass but not angina only if they had evidence of previous angina symptoms (e.g., a code for chest pain or a nitrate prescription; the date of the earliest such entry was taken as the index date). We excluded patients with ACS within 7 d after the index date because their initial presentation may have been unstable rather than stable angina. Further details are given in Text S1 (Additional Methods), Figure S1 (flowchart), and Text S2 (STROBE checklist).
From both populations we excluded patients who died within 7 d of the index date, patients with other cardiac conditions prior to the index date (myocarditis, endocarditis, pericarditis, valve disease, or congenital cardiac abnormalities), and patients who were pregnant less than 3 mo before the index date.
Risk Factors and Blood Parameters
We extracted all values of routinely recorded blood parameters (total cholesterol, haemoglobin, mean corpuscular volume [MCV], creatinine) for each patient, along with information on established cardiovascular risk factors (smoking, systolic blood pressure [BP], diabetes, and family history). For continuous variables, if values were recorded before and after the index date, we calculated a weighted average by linear interpolation to estimate the value at the index date. If only a single value was recorded, or all values were either before or after the index date, we used the single value nearest the index date.
Recording rates for established cardiovascular risk factors are high because they are included in the National Health Service (NHS) Quality and Outcomes Framework, which includes incentive payments for high quality management of chronic conditions . GPRD smoking data has been validated against a population survey .
We estimated the glomerular filtration rate (eGFR) from serum creatinine using the four-variable Modification of Diet in Renal Disease (MDRD) formula, one of the methods recommended by international guidelines .
Our adjusted analyses incorporated the Charlson comorbidity index, a numerical score based on 19 groups of medical conditions, which correlates well with mortality . We regarded a comorbidity as being present if a Read code for the condition occurred prior to the index date (within the previous 5 y for cancers). The Charlson index incorporates the following cardiovascular comorbidities: congestive cardiac failure, MI, stroke, and peripheral vascular disease. The “MI” criterion was ignored for the purposes of this study, as patients in the stable angina cohort would not have had a previous MI, and patients in the MI cohort would all have an index MI. We dealt with age as a separate variable and not as part of the Charlson index, to ensure consistency across analyses with different levels of adjustment.
Follow-up and Endpoints
We limited follow-up to the time when the patient was registered and data from the practice fulfilled GPRD standards of data completeness. We excluded patients who were not registered with the practice for a minimum of 3 mo before and 3 mo after the index date (unless they died within that time). The primary endpoint was death from any cause, identified by a Read code denoting death or transfer out reason of “Death.” We investigated nonfatal strokes and ACS as secondary endpoints (“nonfatal” was defined as survival for more than 7 d after the event). We chose to investigate these diagnoses as secondary endpoints because they cause significant morbidity and share many common risk factors with angina and MI.
Our statistical model aimed to identify upper and lower thresholds of an optimal haemoglobin range beyond which mortality risk increased (Figure 1A, Haemoglobin threshold model). Similar types of models have been used in other studies exploring prognosis and biomarkers (e.g., glycated haemoglobin, Selvin et al. ). In Text S1 and Figure S3, our model is reported fully, following recent recommendations .
Figure 1. Adjusted HRs for death for patients with stable angina or MI, by haemoglobin concentration.
(A) Legend and diagram for haemoglobin threshold model; (B) HRs for death by gender and coronary diagnosis (new onset stable angina or first MI), adjusted for age, eGFR, systolic BP, total cholesterol, family history, diabetes, smoking, and comorbidity (Charlson index). The black squares denote HRs from the stratified haemoglobin model (with 95% CIs).doi:10.1371/journal.pmed.1000439.g001
In order to minimise bias arising from variable selection on statistical grounds , we decided a priori to include in our model only variables known to be relevant based on previous literature. We included age, systolic BP, total cholesterol, eGFR, and the Charlson comorbidity index as continuous variables with a log-linear risk profile; and smoking, gender, diabetes, and family history of coronary disease as binary variables. We used a semi-parametric Cox model with proportional hazards for all variables except haemoglobin, and tested the proportional hazards assumption by examining Schoenfeld residuals . We analysed stable angina and MI patients separately, with no risk coefficients shared between the two analyses.
We also report hazard ratios (HRs) from a stratified model, similar to the approach of Sabatine et al. , in order to verify that our model was not distorted by any assumptions of its shape. For each gender, we stratified patients into groups at 1 g/dl intervals of haemoglobin, and used the interval with most people as the reference interval. We performed analyses using R Version 2.9.2 , Matlab (The Mathworks), and custom software in C++ (source code in Texts S4 and S5).
Systematic Review and Meta-analysis
We searched MEDLINE and EMBASE for prospective studies in which blood biomarkers were measured in patients with stable angina or at least 2 wk post ACS, and a relative risk for mortality or coronary events by haemoglobin concentration was reported with a p-value or confidence interval (CI). Our search results included studies focusing on biomarkers other than haemoglobin, but that reported a relative risk for haemoglobin in the results. Our search strategy, including a complete list of keywords, has been published as part of a systematic review of biomarkers in patients awaiting coronary revascularisation  and is also described in Text S1 (Additional Methods) and Figure S4 (MOOSE flow diagram). We excluded studies with less than 1 y of follow-up, but did not exclude studies based on methodological standards, sample size, or language. Two reviewers independently abstracted data from eligible articles, with disagreements resolved by consensus, or rarely by adjudication by a third reviewer.
We used the outcome of all-cause mortality, if available, for the meta-analysis. Since no studies evaluated thresholds, the only summary relative risk that could be obtained was linear. We converted the HR for each study to the equivalent risk for 1 g/dl lower haemoglobin, and calculated a summary relative risk using the random-effects method of DerSimonion and Laird , implemented in the “rmeta” package for R . We weighted studies inversely by the log standard error of the relative risk. For studies which used an anaemia cutoff ,, we divided the log relative risk by the difference in mean haemoglobin between the two groups. For the study by Reinecke et al., which used quintiles , we derived a linear relative risk by linear regression of the quintile-specific HRs on mean haemoglobin per quintile. We evaluated a similar model for our own cohort, with haemoglobin as a continuous linear variable, for comparison with the results of the meta-analysis. See Text S1 (Additional Methods) and Text S3 (MOOSE checklist) for more details.
The number of eligible stable angina patients was 25,824 and the number of MI patients was 19,443. Women were more likely than men to have haemoglobin measured (88.3% versus 83.5%, p<0.001), but there was only a slight difference in the percentage of patients with any missing covariate data (23.0% for women and 25.1% for men, p<0.001). After excluding these patients, the final number of patients analysed was 20,131 for the stable angina population and 14,171 for MI. Of these, 861 patients developed MI after initially presenting with stable angina and were included in both cohorts, but with different index dates. The mean haemoglobin concentration was 13.0 g/dl in women and 14.2 g/dl in men (p<0.001).
Table 1 summarises the baseline characteristics for the angina patients (Table S3 for MI patients). Patients with lower haemoglobin tended to be older (p<0.001 for linear trend) and were more likely to have diabetes (p<0.001), renal impairment (p<0.001), and cancer (p<0.001). They also had lower MCV (p<0.001) and were more likely to be taking iron supplements (p<0.001) and nitrates (p<0.001). Among patients with MI and women with stable angina, those with higher haemoglobin were more likely to smoke (p<0.001), but there was no significant relationship for men with stable angina.
Table 1. Baseline characteristics of patients with new onset stable angina, by gender and haemoglobin category.doi:10.1371/journal.pmed.1000439.t001
Of the patients who were taking iron supplements, 47.8% had a laboratory record of iron status, 11.7% had microcytic red blood cells (MCV<80 fl), and 22.9% were iron deficient (ferritin <25 µg/l, transferrin saturation <16% or soluble transferrin receptor >2.5 mg/l).
Absolute Risks and Kaplan-Meier Curves
In patients with stable angina and haemoglobin less than 11 g/dl, the age adjusted mortality rate was 5.3% per year for women, compared to 9.8% for men. However for patients with stable angina and haemoglobin over 15 g/dl, the corresponding rates were 2.7% for women and 2.0% for men. The adjusted Kaplan-Meier curves show that lower haemoglobin was associated with a greater risk of death in both genders over 4 y of follow-up (Figures 2 and S2).
Figure 2. Kaplan-Meier curves for patients with stable angina.
Unadjusted and multiply adjusted Kaplan-Meier curves showing the probability of death in men and women with new onset stable angina according to haemoglobin level. Adjustment was done by stratification on linear predictors from a Cox model, which included age, eGFR, systolic BP, total cholesterol, family history, diabetes, smoking, and comorbidity (Charlson index), but not sex or haemoglobin.doi:10.1371/journal.pmed.1000439.g002
Thresholds, Shape, and Strength of Association
There was a dose-dependent increase in mortality with decreasing haemoglobin below the optimal haemoglobin range in both genders and both study populations. For stable angina patients, the lower threshold was 11.9 g/dl (95% CI 11.5–13.5) for women and 13.1 (95% CI 13.0–13.4) for men. For the MI population the lower threshold was 12.8 (95% CI 12.1–13.5) for women and 13.5 (95% CI 13.2–13.9) for men (Table 2). Of men with MI, 29.5% had haemoglobin below the lower threshold and these patients had an adjusted HR for mortality of 2.00 (95% CI 1.76–2.29) compared to those with haemoglobin concentration in the lowest risk range. Mortality was higher at both extremes of haemoglobin concentration compared to the central range (Figure 1B), but there were very few patients with haemoglobin above the upper threshold, so there is less evidence for a dose-dependent effect at high haemoglobin levels.
Table 2. Upper and lower threshold haemoglobin concentrations (with 95% CIs), and excess population risk of mortality attributable to low or high haemoglobin levels.doi:10.1371/journal.pmed.1000439.t002
These findings were corroborated by the stratified haemoglobin model. For stable angina patients, the adjusted HR of death for women with haemoglobin 11–12 g/dl (compared to the reference group with haemoglobin 13–14) was 1.69; 95% CI 1.30–2.20 (Figure 1B). For men with Hb 12–13 g/dl (compared to 13–14) the HR was 1.74 (95% CI 1.39–2.17). Among MI patients, the corresponding HRs were 1.80 (95% CI 1.43–2.26) for women and 1.95 (95% CI 1.61–2.37) for men (Figure 1B; Table S4).
We defined the population attributable risk for low (or high) haemoglobin as the amount that the total modelled mortality risk for the entire cohort would change if all patients were assumed to have an optimal haemoglobin concentration. Among stable angina patients, the population risk attributable to low haemoglobin was 16% (95% CI 10–23%) for women and 24% (95% CI 19–29%) for men. For MI patients the corresponding risk was 28% (95% CI 20–37%) for women and 31% (95% CI 25–37%) for men (Table 2). The excess risk attributable to low haemoglobin was greater for MI patients compared to stable angina (ratio 1.44, 95% CI 1.10–1.88).
After standardising for differing baseline haemoglobin between the genders, the shape of the haemoglobin-prognosis relationship was similar in men and women.
Subgroup Analysis, Secondary Endpoints, and Mean Corpuscular Volume
In Table S5 we show that men and women in the highest MCV quintile (MCV greater than 95 fl) had a slightly increased risk of death compared to the middle quintile (HR 1.40 for women and 1.49 for men with stable angina; similar results for MI). Most of these patients had MCV values in the upper part of the “normal” range, as only 3.1% of stable angina patients and 3.5% of MI patients had red blood cells whose size exceeded the conventional threshold for macrocytosis (MCV>100 fl). Less than 1% of patients in the cohort had both macrocytosis and anaemia.
Subgroup analysis showed a similar association of low haemoglobin with mortality among patients with and without other comorbidities (Tables S6 and S7). There was no significant association between haemoglobin and risk of stroke. A post hoc analysis that included white cell count, congestive cardiac failure, and high density lipoprotein (HDL) cholesterol as additional independent variables yielded similar results to the main analysis.
Systematic Review and Meta-analysis
We identified ten eligible studies ,,– that reported the relationship between haemoglobin and outcomes (1,127 events) in patients with stable coronary disease (Figure 3). None of these studies investigated evidence for the existence, or position, of any threshold haemoglobin value. According to a linear haemoglobin risk profile (a misleading model of the data), the summary relative risk from the meta-analysis was 1.29 (95% CI 1.20–1.38) for 1 g/dl lower haemoglobin. For comparison, the HR of death for 1 g/dl lower haemoglobin in our study was 1.18 (95% CI 1.14–1.21) for angina patients and 1.15 (95% CI 1.13–1.18) for MI patients.
Figure 3. Systematic review and meta-analysis.
Systematic review and meta-analysis of studies investigating the relationship between haemoglobin concentration and prognosis in patients with stable coronary disease. Legend: aCI not reported in paper; standard error estimated from p-value. bReported by quintiles with fourth quintile as reference group; linear conversion by linear interpolation of relative risks across quintiles. cCardiovascular deaths and ACSs (all-cause mortality not reported in this study). dDerived from anaemia cutoff; HR 5.73 (95% CI 1.49–22.1) for anaemia (n = 14, mean haemoglobin = 11.0) versus nonanaemia (n = 129, mean haemoglobin = 14.4). eDerived from anaemia cutoff; HR 6.46 (95% CI 1.73–24.2) for anaemia (n = 71, mean haemoglobin = 11.2) versus nonanaemia (n = 239, mean haemoglobin = 14.0). fWe did not calculate risks from a linear model because it over-simplifies the shape of the relationship. gTotal number of patients is less than the sum of the individual cohort sizes because 861 patients were included in both angina and MI cohorts.doi:10.1371/journal.pmed.1000439.g003
Although the Egger test for publication bias was nonsignificant (p = 0.38) , there was significant heterogeneity between the studies (Cochran's Q = 17.96, p = 0.036).
Summary of Main Findings
The new cohorts of patients with stable coronary disease reported here are substantially larger (3,174 deaths) than the combined previous literature (1,127 events), allowing reliable estimation for the first time of thresholds of haemoglobin concentration for excess risk. Our study demonstrates that thresholds exist (i.e., the risk is not linear, as has been presented in seven previous studies). Furthermore, the thresholds are higher than clinicians might anticipate, and thus a substantial proportion of patients (15%–30%) have a haemoglobin level that places them at markedly higher risk of death compared to patients with lowest risk haemoglobin levels. Our findings were consistent in women and men, among patients with angina alone, and those with a history of MI. Our results also suggest that the risk attributable to low haemoglobin was greater in patients with previous MI compared to those with stable angina, and the optimal (lowest risk) range of haemoglobin was narrower for patients with MI. Based on our attributable risk calculation, the association between haemoglobin and mortality might contribute to about a quarter of deaths after MI.
Our lower haemoglobin thresholds accord closely with the World Health Organisation (WHO) anaemia thresholds of 12 g/dl for women and 13 g/dl for men; this is noteworthy for two reasons. First, the WHO thresholds were defined to facilitate the detection of nutritional iron deficiency, and were not derived in relation to prognostic studies in any population ,. Second, prognostic associations often do not correlate with biomarker thresholds used to define other conditions. In the case of diabetes, there is increased risk with mildly elevated blood sugar levels that do not fulfil the criteria for diabetes , whereas for chronic kidney disease, risk increases only with moderate to severe renal impairment .
Like previous studies ,, we did find some evidence that a high haemoglobin is also associated with poor prognosis, giving a J-shaped relationship. However, there were few patients with high haemoglobin and they contributed little to the overall population risk (Table 2).
The shape of the haemoglobin-prognosis relationship was similar in men and women, after adjusting for the higher baseline haemoglobin in men. Men have a physiologically higher haemoglobin concentration than women, because of an erythropoietin-independent effect of testosterone in stimulating erythrocyte production . Anti-androgenic treatments can cause anaemia  and testosterone treatment can increase haemoglobin . However, it is unclear why women tolerate a low haemoglobin better than men.
Stable Angina and Myocardial Infarction Compared
According to our model, the excess risk associated with low haemoglobin was greater for patients with MI than for those with stable angina (Table 2). If there is a causal relationship between low haemoglobin and worse prognosis, a possible mechanism is that the reduction in tissue oxygen delivery may lead to a persistent increase in cardiac output and left ventricular hypertrophy, further exacerbating myocardial ischaemia . It is possible that these consequences are worse in patients who have already suffered a MI.
Our prognostic cohort analysis has strengths compared to previous studies—size and statistical power, longitudinal recording of comorbidities, more complete adjustment for a priori confounders, direct derivation of clinical thresholds, and population base—but important limitations. First, and most important, as our study was observational we cannot conclude a causal relationship between haemoglobin concentration and mortality. It is possible that there was residual confounding, and the effect on mortality was due to the cause of the haemoglobin concentration, rather than the haemoglobin concentration itself. Our model included the Charlson comorbidity index to encode the presence of heart failure and other common chronic diseases, but it did not take into account the severity of the coronary artery disease or other medical conditions. Patients with more severe coronary disease or comorbidities may have lower haemoglobin, as is the case with chronic heart failure . Hypoxia due to heart failure causes vasoconstriction of the afferent arterioles of the kidney, with consequent reduction in renal perfusion, activation of the renin–angiotensin–aldosterone system and production of antidiuretic hormone, causing plasma volume expansion and haemodilution. Erythropoietin secretion is reduced because of renal hypoxia, causing a further reduction in haemoglobin concentration, which exacerbates cardiac failure ,. This vicious circle of anaemia, heart failure, and chronic kidney disease has been called the “cardio renal anemia syndrome” . However, significant confounding from comorbidity in our study is unlikely because we obtained similar results from the subset of patients without comorbidities, and from those who survived at least 1 y after the index date.
Second, bias might arise because of missing data and variable time intervals between measurement and disease onset. However in about half of patients we used an interpolated haemoglobin value (using at least one value before and one after the index date) and found similar results to the entire cohort.
Third, information on cause of death was not available. However, previous studies have shown that coronary disease is the most common cause of death among the patients studied , so any effect observed on mortality is likely to be due to coronary death.
Fourth, although the electronic recording of coronary disease diagnoses in primary care is reasonably accurate and complete ,, the diagnosis of angina is less reliable than that of MI, and we were unable to further characterise either diagnosis in terms of angiographic results, electrocardiographic findings, or markers of myocardial necrosis.
Fifth, a shortcoming of our statistical model is that we only included variables considered to be relevant on the basis of prior knowledge. We did not consider interaction terms or nonlinear effects except for haemoglobin, with the result that our model may have been incompletely adjusted and may have missed some effect-modifying relationships. However, we did specifically investigate the most important interaction (haemoglobin and gender), and our approach had the advantage of being less susceptible to bias than variable selection and elimination on purely statistical grounds .
Sixth, we did not classify the cause of anaemia in all patients in our cohort, nor did we collect data on blood transfusions. Blood transfusions are recorded incompletely in the GPRD because they always occur in hospital but are rarely the primary reason for admission. However, we feel that these omissions would not have influenced or main results, because the majority of anaemic patients in our study had a haemoglobin level that was only slightly lower than the average, and may not have been “diagnosed” as anaemic in the sense that clinicians may not have considered the haemoglobin level as unremarkable.
Contribution of Systematic Review and Meta-analysis
The systematic review clarifies the limitations of previous studies; none had previously estimated the haemoglobin threshold values, or had assessed men and women, or angina and MI separately. There was significant heterogeneity between the studies, because they included populations with differing baseline risks and were analysed with varying levels of adjustment for other risk factors. In order to combine the relative risks we had to assume a log-linear relationship between haemoglobin and prognosis, and assume a normal distribution for haemoglobin levels in the population. Given the relatively small number of studies in the meta-analysis, it was not worthwhile to attempt a subgroup analysis or meta-regression.
As a crude summary measure of effect, ignoring the thresholds, the summary result from the meta-analysis (HR 1.52 per standard deviation [SD] haemoglobin) was somewhat larger than that from our cohort analysis (1.31). This finding likely reflects our more extensive adjustment for potential confounders. However, the relationship between haemoglobin and mortality that we observed was strong, comparable to that for low density lipoprotein cholesterol (1.38 per SD)  and fibrinogen (1.24 per SD) .
Clinical and Research Implications
Our findings provide observational evidence that contributes to the rationale for randomised controlled trials to evaluate management strategies aimed at increasing haemoglobin among suitable patients with stable coronary disease. Such experimental evidence would address whether clinicians should intervene, and whether haemoglobin levels are causal. These studies may include a trial of oral iron supplementation, or a more aggressive approach involving intravenous iron and erythropoiesis-stimulating agents. Outcome measures may include clinical events such as mortality and MI, as well as quality of life measures. We are not aware of any such trials that have been reported or are currently registered.
Clinical practice guidelines for the management of angina state that anaemia should be corrected , but do not specify investigations, interventions, or the target haemoglobin concentration. 94% of our patients had normocytic red blood cells (MCV 80–100 fl), and the extent to which causes of anaemia in such patients should be investigated is not known. Although our study shows that mild anaemia is associated with increased mortality, randomised trials using erythropoietin in other conditions have shown that complete correction of anaemia is not beneficial. In trials among patients with chronic kidney disease, a target haemoglobin above 13 g/dl has been associated with higher mortality (Correction of Hemoglobin and Outcomes in Renal Insufficiency [CHOIR])  and a higher rate of stroke  than treatment to a lower haemoglobin target, and an increased risk of stroke compared to placebo (Trial to Reduce Cardiovascular Events With Aranesp Therapy [TREAT]) . We found no relationship between haemoglobin and nonfatal stroke, but the overall number of strokes was small. In congestive cardiac failure, a meta-analysis of seven randomised controlled trials showed a reduction in hospitalisation with treatment of anaemia (relative risk 0.59, 95% CI 0.41–0.86), but no significant effect on mortality . The ongoing phase III placebo-controlled trial of darbopoeitin alfa in congestive cardiac failure (Reduction of Events with Darbepoetin alfa in Heart Failure [RED-HF]) is aiming for a target haemoglobin of 13 g/dl and is due to complete in 2012 .
Irrespective of a possible causal, reversible relationship between haemoglobin concentration and mortality, further research is warranted to assess what incremental prognostic value haemoglobin might offer in risk stratifying patients with stable coronary disease.
There are threshold levels of haemoglobin below which women and men with stable coronary disease are at increased risk of death. However our study is observational and cannot be used to infer a causal relationship. Outcome trials of strategies to increase haemoglobin levels would be able to answer the question as to whether increasing haemoglobin among such patients is beneficial.
Flowchart showing selection of the two cohorts of patients: new onset stable angina and first MI.
(0.10 MB DOC)
Kaplan-Meier curves for patients with MI. Unadjusted and multiply adjusted Kaplan-Meier curves showing the probability of death in men and women with new onset stable angina according to haemoglobin level. Adjustment was done by stratification on linear predictors from a Cox model that included age, eGFR, systolic BP, total cholesterol, family history, diabetes, smoking, and comorbidity (Charlson index), but not sex or haemoglobin.
(0.14 MB TIF)
Schematic diagram of haemoglobin threshold model.
(0.26 MB TIF)
MOOSE flowchart showing selection of studies for meta-analysis.
(0.05 MB PDF)
Read and Oxford Medical Information System (OXMIS) codes used in general practice records for the diagnosis of stable angina.
(0.20 MB DOC)
Read and Oxford Medical Information System (OXMIS) codes used in general practice records for the diagnosis of MI.
(0.08 MB DOC)
Baseline characteristics of patients with first MI, by gender and haemoglobin category.
(0.06 MB DOC)
Multiply adjusted HRs for mortality by haemoglobin concentration using haemoglobin threshold model and stratified haemoglobin model. HRs were adjusted for age, eGFR, systolic BP, total cholesterol, family history, diabetes, smoking, and comorbidity (Charlson index). Significance level for stratified haemoglobin model: ***, p<0.001; **, p<0.01; *, p<0.05.
(0.08 MB DOC)
Adjusted HRs for mortality according to MCV. HRs were adjusted for haemoglobin, age, eGFR, systolic BP, total cholesterol, family history, diabetes, smoking, and Charlson index of comorbidity. Significance level: ***, p<0.001; **, p<0.01; *, p<0.05.
(0.03 MB DOC)
Secondary outcomes and subgroup analysis for stable angina patients, using stratified haemoglobin model. Haemoglobin categories ≥15 g/dl were combined for women, and <10 g/dl were combined for men. †HRs were adjusted for age, eGFR, systolic BP, total cholesterol, family history, diabetes, smoking, and comorbidity (Charlson index). Significance level: ***, p<0.001; **, p<0.01; *, p<0.05. ‡HRs were additionally adjusted for high density lipoprotein (HDL) cholesterol, congestive cardiac failure prior to index date, and total white blood cell count; 2,603 patients were omitted because of missing data.
(0.04 MB DOC)
Secondary outcomes and subgroup analysis for MI patients, using stratified haemoglobin model. Haemoglobin categories ≥15 g/dl were combined for women, and <10 g/dl were combined for men. †HRs were adjusted for age, eGFR, systolic BP, total cholesterol, family history, diabetes, smoking, and comorbidity (Charlson index). Significance level: ***, p<0.001; **, p<0.01; *, p<0.05. ‡HRs were additionally adjusted for high density lipoprotein (HDL) cholesterol, congestive cardiac failure prior to index date and total white blood cell count; 2007 patients were omitted because of missing data.
(0.04 MB DOC)
Additional methods. Patient selection: stable angina population; Patient selection: MI population; Statistical analysis: haemoglobin threshold model; Subgroup analysis and mean corpuscular volume; Systematic review; Meta-analysis.
(0.05 MB DOC)
(0.09 MB PDF)
(0.06 MB PDF)
C++ code for haemoglobin threshold model.
(0.02 MB TXT)
R code for stratified haemoglobin model.
(0.01 MB TXT)
We acknowledge the CArdiovascular disease research using LInked Bespoke studies and Electronic Records (CALIBER, http://www.caliberresearch.org.uk/) programme of University College London for supporting this work. CALIBER is funded by the Wellcome Trust and the National Institute of Health Research. We acknowledge the use of University College London's Legion High Performance Computing Facility, and associated support services, in the completion of this work. We would like to thank Martin Shipley for his helpful advice and Natalie Fitzpatrick and Jacqueline Damant for their work on the systematic review.
ICMJE criteria for authorship read and met: ADS ON ADT GF KRA RC ADH HH. Agree with the manuscript's results and conclusions: ADS ON ADT GF KRA RC ADH HH. Designed the experiments/the study: ADS ADT GF RC HH. Analyzed the data: ADS ON ADT RC. Collected data/did experiments for the study: RC. Wrote the first draft of the paper: ADS. Contributed to the writing of the paper: ADS ON ADT GF KRA RC ADH HH. Developed the fractional polynomials with thresholds model and implemented the MCMC: ON. Advised on statistical analysis of data and subsequent interpretation: KRA. Co-applicant on the grant which partially funded the work: ADH. Supervised study, secured external grant funding: HH.
- 1. Weiss G, Goodnough LT (2005) Anemia of chronic disease. N Engl J Med 352: 1011–1023. doi: 10.1056/NEJMra041809
- 2. Abrams J (2005) Clinical practice. Chronic stable angina. N Engl J Med 352: 2524–2533. doi: 10.1056/NEJMcp042317
- 3. van der Meer P, Groenveld H, Januzzi JL, van Veldhuisen D (2009) Erythropoietin treatment in patients with chronic heart failure: a meta-analysis. Heart 95: 1309–1314. doi: 10.1136/hrt.2008.161091
- 4. Pfeffer MA, Burdmann EA, Chen CY, Cooper ME, de Zeeuw D, et al. (2009) A trial of darbepoetin alfa in type 2 diabetes and chronic kidney disease. N Engl J Med 361: 2019–2032. doi: 10.1056/NEJMoa0907845
- 5. Singh AK, Szczech L, Tang KL, Barnhart H, Sapp S, et al. (2006) Correction of anemia with epoetin alfa in chronic kidney disease. N Engl J Med 355: 2085–2098. doi: 10.1056/NEJMoa065485
- 6. Sabatine MS, Morrow DA, Giugliano RP, Burton PB, Murphy SA, et al. (2005) Association of hemoglobin levels with clinical outcomes in acute coronary syndromes. Circulation 111: 2042–2049. doi: 10.1161/01.CIR.0000162477.70955.5F
- 7. Arant CB, Wessel TR, Olson MB, Bairey Merz CN, Sopko G, et al. (2004) Hemoglobin level is an independent predictor for adverse cardiovascular outcomes in women undergoing evaluation for chest pain: results from the National Heart, Lung, and Blood Institute Women's Ischemia Syndrome Evaluation Study. J Am Coll Cardiol 43: 2009–2014. doi: 10.1016/j.jacc.2004.01.038
- 8. Hemingway H, Riley RD, Altman DG (2009) Ten steps towards improving prognosis research. BMJ 339: b4184. doi: 10.1136/bmj.b4184
- 9. Reinecke H, Trey T, Wellmann J, Heidrich J, Fobker M, et al. (2003) Haemoglobin-related mortality in patients undergoing percutaneous coronary interventions. Eur Heart J 24: 2142–2150. doi: 10.1016/j.ehj.2003.09.008
- 10. Ennezat PV, Lamblin N, Mouquet F, Tricot O, Quandalle P, et al. (2008) The effect of ageing on cardiac remodelling and hospitalization for heart failure after an inaugural anterior myocardial infarction. Eur Heart J 29: 1992–1999. doi: 10.1093/eurheartj/ehn267
- 11. Herrett E, Thomas SL, Schoonen WM, Smeeth L, Hall AJ (2010) Validation and validity of diagnoses in the General Practice Research Database: a systematic review. Br J Clin Pharmacol 69: 4–14. doi: 10.1111/j.1365-2125.2009.03537.x
- 12. Hammad TA, McAdams MA, Feight A, Iyasu S, Dal Pan G (2008) Determining the predictive value of Read/OXMIS codes to identify incident acute myocardial infarction in the General Practice Research Database. Pharmacoepidemiol Drug Saf 17: 1197–1201. doi: 10.1002/pds.1672
- 13. NHS Information Authority (2009) The clinical terms version 3 (The Read Codes). Available: http://www.connectingforhealth.nhs.uk/systemsandservices/data/readcodes/index_html. Accessed 22 April 2010.
- 14. NHS Information Centre (2007) The quality and outcomes framework. Available: http://www.ic.nhs.uk/statistics-and-data-collections/audits-and-performance/the-quality-and-outcomes-framework. Accessed 22 April 2010.
- 15. Lewis JD, Brensinger C (2004) Agreement between GPRD smoking data: a survey of general practitioners and a population-based survey. Pharmacoepidemiol Drug Saf 13: 437–441. doi: 10.1002/pds.902
- 16. National Kidney Foundation (2002) K/DOQI clinical practice guidelines for chronic kidney disease: evaluation, classification, and stratification. Am J Kidney Dis 39: S1–S266.
- 17. Sundararajan V, Henderson T, Perry C, Muggivan A, Quan H, et al. (2004) New ICD-10 version of the Charlson Comorbidity Index predicted in-hospital mortality. J Clin Epidemiol 57: 1288–1294. doi: 10.1016/j.jclinepi.2004.03.012
- 18. Selvin E, Steffes MW, Zhu H, Matsushita K, Wagenknecht L, et al. (2010) Glycated hemoglobin, diabetes, and cardiovascular risk in nondiabetic adults. N Engl J Med 362: 800–811. doi: 10.1056/NEJMoa0908359
- 19. Sung L, Hayden J, Greenberg ML, Koren G, Feldman BM, et al. (2005) Seven items were identified for inclusion when reporting a Bayesian analysis of a clinical study. J Clin Epidemiol 58: 261–268. doi: 10.1016/j.jclinepi.2004.08.010
- 20. Robins JM, Greenland S (1986) The role of model selection in causal inference from nonexperimental data. Am J Epidemiol 123: 392–402.
- 21. Grambsch P, Therneau T (1994) Proportional hazards tests and diagnostics based on weighted residuals. Biometrika 81: 515–5. doi: 10.2307/2337123
- 22. R Development Core Team (2009) R: a language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. 3-900051-07-0: Available: http://www.R-project.org. ISBN.
- 23. Hemingway H, Henriksson M, Chen R, Damant J, Fitzpatrick N, et al. (2010) The effectiveness and cost effectiveness of biomarkers for the prioritisation of patients awaiting coronary revascularisation: a systematic review and decision model. Health Technol Assess 14:
- 24. DerSimonian R, Laird N (1986) Meta-analysis in clinical trials. Control Clin Trials 7: 177–188. doi: 10.1016/0197-2456(86)90046-2
- 25. Lumley T (2009) The rmeta package: meta-analysis. Available: http://CRAN.R-project.org/package=rmeta. Accessed 22 April 2010.
- 26. Lipsic E, Asselbergs FW, van der Meer P, Tio RA, Voors AA, et al. (2005) Anaemia predicts cardiovascular events in patients with stable coronary artery disease. Neth Heart J 13: 254.
- 27. da Silveira AD, Ribeiro RA, Rossini AP, Stella SF, Ritta HA, et al. (2008) Association of anemia with clinical outcomes in stable coronary artery disease. Coron Artery Dis 19: 21–26. doi: 10.1097/MCA.0b013e3282f27c0a
- 28. Fathi RB, Gurm HS, Chew DP, Gupta R, Bhatt DL, et al. (2005) The interaction of vascular inflammation and chronic kidney disease for the prediction of long-term death after percutaneous coronary intervention. Am Heart J 150: 1190–1197. doi: 10.1016/j.ahj.2005.01.031
- 29. Rajagopal V, Gurm HS, Bhatt DL, Lincoff AM, Tcheng JE, et al. (2004) Relation of an elevated white blood cell count after percutaneous coronary intervention to long-term mortality. Am J Cardiol 94: 190–192. doi: 10.1016/j.amjcard.2004.03.060
- 30. Duffy BK, Gurm HS, Rajagopal V, Gupta R, Ellis SG, et al. (2006) Usefulness of an elevated neutrophil to lymphocyte ratio in predicting long-term mortality after percutaneous coronary intervention. Am J Cardiol 97: 993–996. doi: 10.1016/j.amjcard.2005.10.034
- 31. Exaire JE, Butman SM, Ebrahimi R, Kleiman NS, Harrington RA, et al. (2006) Provisional glycoprotein IIb/IIIa blockade in a randomized investigation of bivalirudin versus heparin plus planned glycoprotein IIb/IIIa inhibition during percutaneous coronary intervention: predictors and outcome in the Randomized Evaluation in Percutaneous coronary intervention Linking Angiomax to Reduced Clinical Events (REPLACE)-2 trial. Am Heart J 152: 157–163. doi: 10.1016/j.ahj.2005.09.004
- 32. Burr ML, Holliday RM, Fehily AM, Whitehead P (1992) Haematological prognostic indices after myocardial infarction: evidence from the diet and reinfarction trial (DART). Eur Heart J 13: 166–170.
- 33. Muzzarelli S, Pfisterer M (2006) Anemia as independent predictor of major events in elderly patients with chronic angina. Am Heart J 152: 991–996. doi: 10.1016/j.ahj.2006.06.014
- 34. Egger M, Smith GD, Schneider M, Minder C (1997) Bias in meta-analysis detected by a simple, graphical test. BMJ 315: 629–634. doi: 10.1136/bmj.315.7109.629
- 35. Kilpatrick GS, Hardisty RM (1961) The prevalence of anaemia in the community. a survey of a random sample of the population. Br Med J 1: 778–782. doi: 10.1136/bmj.1.5228.778
- 36. World Health Organisation (1968) Nutritional anaemias. Report of a WHO scientific group. World Health Organ Tech Rep Ser 405: 5–37.
- 37. Stranders I, Diamant M, van Gelder RE, Spruijt HJ, Twisk JWR, et al. (2004) Admission blood glucose level as risk indicator of death after myocardial infarction in patients with and without diabetes mellitus. Arch Intern Med 164: 982–988. doi: 10.1001/archinte.164.9.982
- 38. Di Angelantonio E, Danesh J, Eiriksdottir G, Gudnason V (2007) Renal function and risk of coronary heart disease in general populations: new prospective study and systematic review. PLoS Med 4: e270. doi:10.1371/journal.pmed.0040270.
- 39. Gagnon DR, Zhang TJ, Brand FN, Kannel W (1994) Hematocrit and the risk of cardiovascular disease–the Framingham study: a 34-year follow-up. Am Heart J 127: 674–682. doi: 10.1016/0002-8703(94)90679-3
- 40. Danesh J, Collins R, Peto R, Lowe G (2000) Haematocrit, viscosity, erythrocyte sedimentation rate: meta-analyses of prospective studies of coronary heart disease. Eur Heart J 21: 515–520. doi: 10.1053/euhj.1999.1699
- 41. Ferrucci L, Maggio M, Bandinelli S, Basaria S, Lauretani F, et al. (2006) Low testosterone levels and the risk of anemia in older men and women. Arch Intern Med 166: 1380–1388. doi: 10.1001/archinte.166.13.1380
- 42. Curtis KK, Pruthi RK, Fonseca R, Gornet M (2007) Transfusion-dependent anemia after initiation of androgen deprivation therapy for metastatic prostate cancer. Urology 70: 811. doi: 10.1016/j.urology.2007.07.030
- 43. Coviello AD, Kaplan B, Lakshman KM, Chen T, Singh AB, et al. (2008) Effects of graded doses of testosterone on erythropoiesis in healthy young and older men. J Clin Endocrinol Metab 93: 914–919. doi: 10.1210/jc.2007-1692
- 44. Metivier F, Marchais SJ, Guerin AP, Pannier B, London G (2000) Pathophysiology of anaemia: focus on the heart and blood vessels. Nephrol Dial Transplant 15: Suppl 314–18. doi: 10.1093/oxfordjournals.ndt.a027970
- 45. Ezekowitz JA, McAlister FA, Armstrong PW (2003) Anemia is common in heart failure and is associated with poor outcomes: insights from a cohort of 12 065 patients with new-onset heart failure. Circulation 107: 223–225. doi: 10.1161/01.CIR.0000052622.51963.FC
- 46. Tang YD, Katz SD (2006) Anemia in chronic heart failure: prevalence, etiology, clinical correlates, and treatment options. Circulation 113: 2454–2461. doi: 10.1161/CIRCULATIONAHA.105.583666
- 47. Geisler B (2010) Treating anemia in heart failure patients: a review of erythropoiesis-stimulating agents. Expert Opin Biol Ther 10: 1209–1216. doi: 10.1517/14712598.2010.500282
- 48. Silverberg DS, Wexler D, Iaina A, Steinbruch S, Wollman Y, et al. (2006) Anemia, chronic renal disease and congestive heart failure–the cardio renal anemia syndrome: the need for cooperation between cardiologists and nephrologists. Int Urol Nephrol 38: 295–310. doi: 10.1007/s11255-006-0064-8
- 49. Meal AG, Pringle M, Hammersley V (2000) Time changes in new cases of ischaemic heart disease in general practice. Fam Pract 17: 394–400. doi: 10.1093/fampra/17.5.394
- 50. Angelantonio ED, Sarwar N, Perry P, Kaptoge S, et al. Emerging Risk Factors Collaboration (2009) Major lipids, apolipoproteins, and risk of vascular disease. JAMA 302: 1993–2000. doi: 10.1001/jama.2009.1619
- 51. Fox K, Garcia MA, Ardissino D, Buszman P, Camici PG, et al. (2006) Guidelines on the management of stable angina pectoris: executive summary: The Task Force on the Management of Stable Angina Pectoris of the European Society of Cardiology. Eur Heart J 27: 1341–1381. doi: 10.1093/eurheartj/ehl001
- 52. Parfrey PS, Foley RN, Wittreich BH, Sullivan DJ, Zagari MJ, et al. (2005) Double-blind comparison of full and partial anemia correction in incident hemodialysis patients without symptomatic heart disease. J Am Soc Nephrol 16: 2180–2189. doi: 10.1681/ASN.2004121039
- 53. van Veldhuisen DJ, McMurray JJ (2007) Are erythropoietin stimulating proteins safe and efficacious in heart failure? Why we need an adequately powered randomised outcome trial. Eur J Heart Fail 9: 110–112. doi: 10.1016/j.ejheart.2007.01.004