Skip to main content
Advertisement
  • Loading metrics

Circulating Mitochondrial DNA in Patients in the ICU as a Marker of Mortality: Derivation and Validation

  • Kiichi Nakahira ,

    Contributed equally to this work with: Kiichi Nakahira, Sun-Young Kyung

    Affiliations Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America, Department of Medicine, Weill Cornell Medical College, New York, New York, United States of America

  • Sun-Young Kyung ,

    Contributed equally to this work with: Kiichi Nakahira, Sun-Young Kyung

    Affiliations Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America, Department of Internal Medicine, Gachon University Gil Hospital, Incheon, South Korea

  • Angela J. Rogers,

    Affiliations Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America, Channing Division of Network Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America, Division of Pulmonary and Critical Care Medicine, Department of Medicine, Stanford University, Stanford, California, United States of America

  • Lee Gazourian,

    Affiliation Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America

  • Sojung Youn,

    Affiliation Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America

  • Anthony F. Massaro,

    Affiliation Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America

  • Carolina Quintana,

    Affiliation Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America

  • Juan C. Osorio,

    Affiliation Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America

  • Zhaoxi Wang,

    Affiliation Department of Environmental Health, Harvard School of Public Health, Boston, Massachusetts, United States of America

  • Yang Zhao,

    Affiliation Department of Environmental Health, Harvard School of Public Health, Boston, Massachusetts, United States of America

  • Laurie A. Lawler,

    Affiliation Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America

  • Jason D. Christie,

    Affiliation Division of Pulmonary, Allergy and Critical Care Medicine, Department of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, United States of America

  • Nuala J. Meyer,

    Affiliation Division of Pulmonary, Allergy and Critical Care Medicine, Department of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, United States of America

  • Finnian R. Mc. Causland,

    Affiliation Renal Division, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, United States of America

  • Sushrut S. Waikar,

    Affiliation Renal Division, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, United States of America

  • Aaron B. Waxman,

    Affiliation Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America

  • Raymond T. Chung,

    Affiliation Division of Gastroenterology, Department of Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, United States of America

  • Raphael Bueno,

    Affiliation Division of Thoracic Surgery, Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, United States of America

  • Ivan O. Rosas,

    Affiliation Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America

  • Laura E. Fredenburgh,

    Affiliation Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America

  • Rebecca M. Baron,

    Affiliation Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America

  • David C. Christiani,

    Affiliations Department of Environmental Health, Harvard School of Public Health, Boston, Massachusetts, United States of America, Pulmonary and Critical Care Unit, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, United States of America

  • Gary M. Hunninghake ,

    Joint senior author on this work with: Gary M. Hunninghake, Augustine M. K. Choi.

    Affiliation Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America

  •  [ ... ],
  • Augustine M. K. Choi

    amc2056@med.cornell.edu

    Joint senior author on this work with: Gary M. Hunninghake, Augustine M. K. Choi.

    Affiliations Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America, Department of Medicine, Weill Cornell Medical College, New York, New York, United States of America, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, South Korea

  • [ view all ]
  • [ view less ]

Abstract

Background

Mitochondrial DNA (mtDNA) is a critical activator of inflammation and the innate immune system. However, mtDNA level has not been tested for its role as a biomarker in the intensive care unit (ICU). We hypothesized that circulating cell-free mtDNA levels would be associated with mortality and improve risk prediction in ICU patients.

Methods and Findings

Analyses of mtDNA levels were performed on blood samples obtained from two prospective observational cohort studies of ICU patients (the Brigham and Women's Hospital Registry of Critical Illness [BWH RoCI, n = 200] and Molecular Epidemiology of Acute Respiratory Distress Syndrome [ME ARDS, n = 243]). mtDNA levels in plasma were assessed by measuring the copy number of the NADH dehydrogenase 1 gene using quantitative real-time PCR. Medical ICU patients with an elevated mtDNA level (≥3,200 copies/µl plasma) had increased odds of dying within 28 d of ICU admission in both the BWH RoCI (odds ratio [OR] 7.5, 95% CI 3.6–15.8, p = 1×10−7) and ME ARDS (OR 8.4, 95% CI 2.9–24.2, p = 9×10−5) cohorts, while no evidence for association was noted in non-medical ICU patients. The addition of an elevated mtDNA level improved the net reclassification index (NRI) of 28-d mortality among medical ICU patients when added to clinical models in both the BWH RoCI (NRI 79%, standard error 14%, p<1×10−4) and ME ARDS (NRI 55%, standard error 20%, p = 0.007) cohorts. In the BWH RoCI cohort, those with an elevated mtDNA level had an increased risk of death, even in analyses limited to patients with sepsis or acute respiratory distress syndrome. Study limitations include the lack of data elucidating the concise pathological roles of mtDNA in the patients, and the limited numbers of measurements for some of biomarkers.

Conclusions

Increased mtDNA levels are associated with ICU mortality, and inclusion of mtDNA level improves risk prediction in medical ICU patients. Our data suggest that mtDNA could serve as a viable plasma biomarker in medical ICU patients.

Please see later in the article for the Editors' Summary

Editors' Summary

Background

Intensive care units (ICUs, also known as critical care units) are specialist hospital wards that provide care for people with life-threatening injuries and illnesses. In the US alone, more than 5 million people are admitted to ICUs every year. Different types of ICUs treat different types of problems. Medical ICUs treat patients who, for example, have been poisoned or who have a serious infection such as sepsis (blood poisoning) or severe pneumonia (inflammation of the lungs); trauma ICUs treat patients who have sustained a major injury; cardiac ICUs treat patients who have heart problems; and surgical ICUs treat complications arising from operations. Patients admitted to ICUs require constant medical attention and support from a team of specially trained nurses and physicians to prevent organ injury and to keep their bodies functioning. Monitors, intravenous tubes (to supply essential fluids, nutrients, and drugs), breathing machines, catheters (to drain urine), and other equipment also help to keep ICU patients alive.

Why Was This Study Done?

Although many patients admitted to ICUs recover, others do not. ICU specialists use scoring systems (algorithms) based on clinical signs and physiological measurements to predict their patients' likely outcomes. For example, the APACHE II scoring system uses information on heart and breathing rates, temperature, levels of salts in the blood, and other signs and physiological measurements collected during the first 24 hours in the ICU to predict the patient's risk of death. Existing scoring systems are not perfect, however, and “biomarkers” (molecules in bodily fluids that provide information about a disease state) are needed to improve risk prediction for ICU patients. Here, the researchers investigate whether levels of circulating cell-free mitochondrial DNA (mtDNA) are associated with ICU deaths and whether these levels can be used as a biomarker to improve risk prediction in ICU patients. Mitochondria are cellular structures that produce energy. Levels of mtDNA in the plasma (the liquid part of blood) increase in response to trauma and infection. Moreover, mtDNA activates molecular processes that lead to inflammation and organ injury.

What Did the Researchers Do and Find?

The researchers measured mtDNA levels in the plasma of patients enrolled in two prospective observational cohort studies that monitored the outcomes of ICU patients. In the Brigham and Women's Hospital Registry of Critical Illness study, blood was taken from 200 patients within 24 hours of admission into the hospital's medical ICU. In the Molecular Epidemiology of Acute Respiratory Distress Syndrome study (acute respiratory distress syndrome is a life-threatening inflammatory reaction to lung damage or infection), blood was taken from 243 patients within 48 hours of admission into medical and non-medical ICUs at two other US hospitals. Patients admitted to medical ICUs with a raised mtDNA level (3,200 or more copies of a specific mitochondrial gene per microliter of plasma) had a 7- to 8-fold increased risk of dying within 28 days of admission compared to patients with mtDNA levels of less than 3,200 copies/µl plasma. There was no evidence of an association between raised mtDNA levels and death among patients admitted to non-medical ICUs. The addition of an elevated mtDNA level to a clinical model for risk prediction that included the APACHE II score and biomarkers that are already used to predict ICU outcomes improved the net reclassification index (an indicator of the improvement in risk prediction algorithms offered by new biomarkers) of 28-day mortality among medical ICU patients in both studies.

What Do These Findings Mean?

These findings indicate that raised mtDNA plasma levels are associated with death in medical ICUs and show that, among patients in medical ICUs, measurement of mtDNA plasma levels can improve the prediction of the risk of death from the APACHE II scoring system, even when commonly measured biomarkers are taken into account. These findings do not indicate whether circulating cell-free mtDNA increased because of the underlying severity of illness or whether mtDNA actively contributes to the disease process in medical ICU patients. Moreover, they do not provide any evidence that raised mtDNA levels are associated with an increased risk of death among non-medical (mainly surgical) ICU patients. These findings need to be confirmed in additional patients, but given the relative ease and rapidity of mtDNA measurement, the determination of circulating cell-free mtDNA levels could be a valuable addition to the assessment of patients admitted to medical ICUs.

Additional Information

Please access these websites via the online version of this summary at http://dx.doi.org/10.1371/journal.pmed.1001577.

Introduction

Multidimensional scoring systems based on commonly measured clinical and physiologic parameters help to improve the prognostication of patients admitted to intensive care units (ICUs) [1]. Despite the improvement in prognostication there is a need to develop biomarkers that can help clinicians to further improve risk prediction for patients in the ICU [2]. While many biomarkers (>170) have been evaluated in various ICU subpopulations, few have been tested in large populations, or add substantially to the predictive value of multidimensional scoring systems [1]. Only a small number of biomarkers reflecting the severity of critical illness are commonly measured in clinical practice (e.g., lactate and procalcitonin) [3],[4]. Accumulating evidence suggests that cellular mitochondrial DNA (mtDNA) levels are decreased [5],[6] and circulating cell-free mtDNA levels are increased in response to stimuli such as trauma [7] and microbial infection [8][10]. Moreover, mtDNA acts as a damage-associated molecular pattern [11] that can drive molecular processes, leading to inflammatory responses and organ injuries [7],[10],[12],[13]. Based on these findings we hypothesized that circulating cell-free mtDNA levels would be associated with mortality and would improve risk prediction in ICU patients. The objective of this study was to test whether measuring circulating cell-free mtDNA is useful as a biomarker in the ICU. To our knowledge this is the first study to provide replicated evidence that plasma mtDNA levels both are associated with mortality and improve risk prediction in the field of critical care illness.

Methods

The protocols for patient recruitment and data collection for the two patient cohorts, the Brigham and Women's Hospital Registry of Critical Illness (BWH RoCI, primary patient cohort) and the Molecular Epidemiology of Acute Respiratory Distress Syndrome (ME ARDS, replication cohort), have been described previously [14][16] and are discussed in detail in Text S1 in Supporting Information S1. In brief, from 24 July 2008 to 14 June 2011, 200 patients were prospectively recruited into the BWH RoCI study from the Brigham and Women's Hospital medical intensive care unit (MICU), for whom clinical phenotype data, including mortality, and blood plasma samples were subsequently collected. Acute kidney injury was defined as a ≥0.5 mg/dl increase in serum creatinine [17]. Presence of respiratory, heart, and liver failure were defined by admitting physician report. For replication, we selected 243 patients from the ME ARDS study, which recruited patients from ICUs at Massachusetts General Hospital from 10 November 2002 to 16 June 2010 and at Beth Israel Deaconess Medical Center from 1 February 2007 to 24 April 2010, for whom both 28-d mortality data and a blood plasma sample had been collected. In addition to baseline demographic data, assessments of sepsis and acute respiratory distress syndrome (ARDS) were performed, and Acute Physiology and Chronic Health Evaluation (APACHE) II scores were measured [18][20]. 28-d mortality [21] (in both cohorts) and in-hospital mortality (in the BWH RoCI cohort) were ascertained from patient medical records, and long-term mortality was assessed in the BWH RoCI cohort by linking the cohort to the US Social Security Administration's Death Master File [22]. Written informed consent and institutional review board approval were obtained.

Preparation and Quantification of Plasma DNA

In the BWH RoCI study, blood samples were drawn and transferred into blood collection tubes within 24 h of study inclusion, and processed within 2 h after venipuncture [14]. In the ME ARDS study, blood samples were drawn and transferred into blood collection tubes within 48 h after the establishment of a diagnosis [23].

DNA isolation from plasma.

Plasma used in this study (from both RoCI and ME ARDS) was collected in EDTA-coated blood collection tubes. The plasma samples were stored at −80°C. DNA was isolated from plasma using the DNeasy Blood and Tissue Kit (#69504; Qiagen), according to the manufacture's manual [12]. Samples were thawed on ice and were then mixed briefly by vortex. The 100 µl of plasma was mixed with 100 µl of PBS, followed by brief vortex. The diluted plasma was centrifuged at 700g at 4°C for 5 min, and the supernatant (190 µl) was carefully saved by avoiding touching any pellets and the bottom of the tubes with pipette tips. The obtained supernatant was further centrifuged at 18,000g at 4°C for 15 min, and the resulting supernatant (170 µl) was carefully saved. Contamination of cells, cell debris, or pellets into supernatant might lead to a significant change of the results. The obtained supernatant was processed for DNA isolation. In brief, we incubated plasma samples with lysis buffer (included in the kit) and proteinase K at 56°C for 15 min. At the final step of DNA isolation, DNA was eluted in 200 µl of elution buffer (included in the kit). For the quantitative real-time polymerase chain reaction (qPCR) assay, the DNA solution was further diluted 10 times with nuclease-free deionized, distilled H2O.

Primers and qPCR.

DNA level in diluted samples was measured by SYBR Green dye-based qPCR assay using a PRISM 7300 sequence detection system (Applied Biosystems). The primer sequences were as follows: human NADH dehydrogenase 1 gene (mtDNA): forward 5′-ATACCCATGGCCAACCTCCT-3′, reverse 5′-GGGCCTTTGCGTAGTTGTAT-3′ [7],[24]; human β-globin (nuclear DNA): forward 5′-GTGCACCTGACTCCTGAGGAGA-3′, reverse 5′-CCTTGATACCAACCTGCCCAG-3′ [25]; bacterial 16S ribosomal RNA: forward 5′- CGTCAGCTCGTGTTGTGAAA-3′, reverse 5′-GGCAGTCTCCTTGAGTTCC-3′ [7]. Plasmid DNA with complementary DNA sequences for human mtDNA was obtained from ORIGENE (SC101172), and plasmid DNA with complementary DNA sequences for human nuclear DNA was obtained from Sino Biological. Concentrations were converted to copy number using the formula; mol/gram×molecules/mol = molecules/gram, via a DNA copy number calculator (http://cels.uri.edu/gsc/cndna.html; University of Rhode Island Genomics and Sequencing Center) [26],[27]. DNA solutions were diluted in 10-fold serial dilutions and used as standards.

The thermal profile for detecting mtDNA was carried out as follows: an initiation step for 2 min at 50°C is followed by a first denaturation step for 10 min at 95°C and a further step consisting of 40 cycles for 15 s at 95°C and for 1 min at 60°C. A representative standard curve, dissociation curve, and amplification plot are shown in Figure 1.

thumbnail
Figure 1. Representative standard curve, amplification plot, and dissociation curve, and amplification plot from the patients' samples.

(A) NADH dehydrogenase 1 complementary DNA was serially (1∶10) diluted to prepare a series of calibrators (mtDNA standard) with known DNA copy number. The assay was linear over the range (8.48–848000 copies) of DNA copy numbers (R2 = 0.997866). (B) The amplification plot (ΔRn versus cycle [log] view) shows no irregular amplification for the standard diluents (848,000, 84,800, 8,480, 848, 84.8, 8.48). (C) The dissociation curve shows a single melting temperature of the specific products generated with standard template. Also, there is no melting temperature observed in the no-template control wells (blank). These dissociation curves indicate that the reactions are free of primer-dimer or any other spurious products. (D) Similar amplification plots were observed after qPCR using patients' samples. The amplification curves generated from human samples were paralleled with the curves from standards and were in the range of amplification plots for standard diluents.

https://doi.org/10.1371/journal.pmed.1001577.g001

All samples were analyzed in duplicate, and a no-template control was included in every analysis. mtDNA levels in all of the plasma analyses were expressed in copies per microliter of plasma based on the following calculation [28]:(1)where c is the concentration of DNA in plasma (copies/microliter plasma); Q is the quantity (copies) of DNA determined by the sequence detector in a PCR; VDNA is the total volume of plasma DNA solution obtained after extraction, typically 200 µl per extraction; VPCR is the volume of plasma DNA solution used for PCR, typically 5 µl of ten times diluted plasma DNA solution; and Vext is the volume of plasma extracted, typically 50–100 µl.

The specificity of mtDNA primers was examined using bacterial DNA (Text S2 in Supporting Information S1; Figure S1) and by BLAST search (Text S3 and Tables S1 and S2 in Supporting Information S1).

Procalcitonin Measurement

Plasma level of procalcitonin was measured using the Procalcitonin Human ELISA (Enzyme-Linked Immunosorbent Assay) Kit (ab100630; Abcam).

Statistical Analysis

mtDNA level was assessed as both a continuous and a binary variable, where indicated. Because mtDNA levels were non-normally distributed, continuous levels from the BWH RoCI cohort were assessed after log10 transformation and dichotomized using visual inspection and iterative methods (using c-statistics) [29] to select the level of mtDNA that maximized the area under the curve for the prediction of 28-d mortality (mtDNA ≥3,200 copies/µl versus <3,200 copies/µl). This level was then replicated in the ME ARDS cohort. Survival was assessed as both a binary and a time-dependent variable. Bivariate analyses were conducted with Fisher's exact tests (for categorical variables) and Wilcoxon rank-sum tests (for continuous variables). Both bivariate and multivariate logistic regression models were used in association analyses. Survival analyses were performed using log-rank and Cox-proportional hazards models.

To assess the value of mtDNA level in risk prediction, we compared bivariate and multivariate models with and without mtDNA level using the net reclassification improvement approach [30] (using risk categories in increments of 10% from 0% to 100%). In contrast to c-statistics, the net reclassification index (NRI) may have unique value in assessing the ability of a biomarker to improve risk prediction when groups can be split up into risk strata. All analyses were performed using Statistical Analysis Software version 9.2 (SAS Institute). Analyses comparing c-statistics and net reclassification were performed using rocplus [31]. p<0.05 was considered statistically significant.

Results

Baseline Characteristics

Baseline characteristics of ICU patients included in the BWH RoCI (n = 200) and the ME ARDS (n = 243) cohorts are presented in Table 1. While the BWH RoCI cohort was entirely composed of MICU patients, the ME ARDS cohort included patients from different ICU types. Patients in both studies were more likely to be white, to be female, and to carry a diagnosis of sepsis; however, these covariates were even more prevalent among patients in the ME ARDS cohort. A diagnosis of ARDS was more common in ME ARDS patients than in BWH RoCI patients. Age, APACHE II scores, and mtDNA levels were similar in both studies. Of note, only one patient in either study (in ME ARDS) received activated protein C during their stay in the ICU.

The additional analysis of patient characteristics is shown in Text S4 in Supporting Information S1.

Of the 200 patients in the BWH RoCI study, 60 (30%) died within 28 d of MICU admission, and 51 (25%) died in the hospital. The median follow-up time for the group that died in the hospital was 5 d (interquartile range 1–54 d). In the ME ARDS study, 40 patients (16%) died within 28 d of ICU admission. In the ME ARDS study, the rate of death among MICU patients (i.e., medical or cardiac ICU patients, n = 31 deaths, 20%) differed from that among non-MICU patients (i.e., surgical, trauma, or neurological ICU patients, n = 9 deaths, 10%, p = 0.03 for the difference). A majority of plasma samples were drawn within 4 d of ICU admission in both the BWH RoCI (n = 186, 93%) and the ME ARDS (n = 194, 90%, data missing on 34 patients) studies.

mtDNA Level and Mortality

BWH RoCI.

In the BWH RoCI cohort, mtDNA level was higher in ICU patients who died within 28 d of MICU admission than in those who did not (median 9,504 copies/µl versus 1,927 copies/µl, p = 2×10−8; Figure 2A), as well as in patients with diagnoses commonly associated with mortality in the ICU such as sepsis (Figure 2B) and ARDS (Figure 2C). For each log10-unit increase in mtDNA level, patients had an increased odds of dying within 28-d of MICU admission (odds ratio [OR] 1.9, 95% CI 1.5–2.4, p = 2×10−7). Patients with an mtDNA level ≥3,200 copies/µl had an increased odds of dying within 28 d of MICU admission (Table 2) and an increased odds of dying in the hospital (OR 8.4, 95% CI 3.7–19.2, p = 4×10−7). Of those who died within 28 d of MICU admission, 80% (n = 48 of 60) had an mtDNA level ≥3,200 copies/µl compared to 38% (n = 53 or 140) of those who did not die. In the BWH RoCI cohort, the odds of dying within 28 d of MICU admission was higher among those with an mtDNA level ≥3,200 copies/µl when the level was obtained <48 h after ICU admission (n = 52, OR 23.0, 95% CI 4.4–120.0, p = 2×10−4) compared to those with an mtDNA level ≥3,200 copies/µl that was obtained ≥48 h after ICU admission (n = 148, OR 4.4, 95% CI 1.9–9.8, p = 4×10−4); however, this difference was of borderline statistical significance (mtDNA by ICU status interaction p = 0.08). The additional analysis of nuclear DNA level and mtDNA level in different patient groups in the BWH RoCI study is shown in Texts S5 and S6 in Supporting Information S1.

thumbnail
Figure 2. Cell-free mtDNA level in the plasma of ICU patients.

Boxplots comparing measures of cell-free mtDNA level (mtDNA [NADH dehydrogenase 1] expressed as copy number/µl of plasma) in the plasma of (A) patients who died within 28 d after ICU admission (red) versus those who survived (gray), (B) patients with (green) versus without (gray) sepsis, and (C) patients with (blue) versus without (gray) ARDS in the BWH RoCI (left) and ME ARDS (right) cohorts. mtDNA copy number in the plasma is presented as median value (black line), interquartile range (box), and 5th and 95th percentiles (whiskers). p-Values are noted in the figure for each cohort.

https://doi.org/10.1371/journal.pmed.1001577.g002

thumbnail
Table 2. Bivariate and multivariate analyses of association between elevated mtDNA levels and 28-d MICU mortality.

https://doi.org/10.1371/journal.pmed.1001577.t002

There was no evidence in the BWH RoCI cohort that the association between mtDNA level and MICU mortality was attenuated in models adjusted for clinical covariates, including APACHE II score, sepsis, or ARDS (Table 2). There was no statistical evidence that any of these variables significantly modified the effect of mtDNA level on mortality.

While an elevated mtDNA level was associated with acute kidney injury (OR 3.2, 95% CI 1.7–6.3, p = 4×10−4), the need for mechanical ventilation (OR 2.7, 95% CI 1.5–4.8, p = 7×10−4), the use of vasopressors (OR 3.6, 95% CI 1.9–6.6, p = 6×10−5), and an underlying diagnosis of cancer (OR 1.8, 95% CI 1.0–3.1, p = 0.05), there was no significant association of elevated mtDNA with physician report of either liver failure (p = 0.65) or heart failure (p = 0.45). The association between an elevated mtDNA level and 28-d mortality remained significant in the BWH RoCI cohort even after adjustment for additional variables including use of vasopressors, need for mechanical ventilation, cancer, acute kidney injury, or admitting physician impression of either heart or liver failure (OR 9.5, 95% CI 3.5–25.6, p = 3×10−5; see Table S3 in Supporting Information S1).

Binary classification analysis for elevated mtDNA levels and 28-d MICU mortality are shown in Table 3.

thumbnail
Table 3. Elevated mtDNA levels and 28-d MICU mortality by group.

https://doi.org/10.1371/journal.pmed.1001577.t003

Of the 200 patients from the BWH RoCI cohort, we were able to obtain simultaneous measurements of procalcitonin in 146 (73%) and lactate in 106 (53%) patients. To determine whether the association between mtDNA and 28-d mortality could be explained by measures of procalcitonin or lactate, we tested each of these biomarkers for association with mortality and then assessed whether adjusting for either procalcitonin or lactate attenuates the association between mtDNA and mortality. All three biomarkers were significantly associated with 28-d mortality (Table 4). mtDNA level remained significantly associated with 28-d mortality even after adjusting for either procalcitonin or lactate. In contrast, the associations between procalcitonin and lactate and mortality were attenuated in models additionally adjusting for mtDNA level (Table 4).

thumbnail
Table 4. Peripheral blood biomarkers and 28-d ICU mortality.

https://doi.org/10.1371/journal.pmed.1001577.t004

Of the 200 BWH RoCI patients, 96 (48%) remained in the ICU for 7 d and had a repeat measurement of mtDNA. Mortality level was lowest among patients with mtDNA levels <3,200/µl copies at both their initial blood draw and day 7 (0% mortality), highest in those with levels ≥3,200/µl copies at both visits (39% mortality), and intermediate for those with an elevated mtDNA level at only one of the two time points (∼12% mortality; see Table 5).

thumbnail
Table 5. Repeated measures of mtDNA and 28-d mortality in the BWH RoCI cohort.

https://doi.org/10.1371/journal.pmed.1001577.t005

Follow-up data were available on the patients in the BWH RoCI study for periods ranging from 1 d to 3.5 y after admission to the ICU. 54% (n = 108) of the cohort died during follow-up. Patients who had an mtDNA level ≥3,200 copies/µl had an increased risk of death (hazard ratio 2.4, 95% CI 1.6–3.6, p<1×10−4; see Figure 3). There was no evidence that the effect of mtDNA level on the risk of death was attenuated in adjusted models (Text S7 in Supporting Information S1). mtDNA level was associated with an increased risk of death even in analyses limited to patients with sepsis (after adjusting for age, gender, race/ethnicity, and APACHE II score, an mtDNA level ≥3,200 copies/µl was associated with an increase in the risk of death, hazard ratio 3.0, 95% CI 1.5–6.3, p = 0.003) or ARDS (after adjusting for age, gender, race/ethnicity, and APACHE II score, an mtDNA level ≥3,200 copies/µl was associated with a 2.3-fold increase in the risk of death, hazard ratio 2.3, 95% CI 1.5–3.5, p = 2×10−4).

thumbnail
Figure 3. Survival of BWH RoCI MICU patients stratified by mtDNA level.

Kaplan-Meier estimates of survival for patients who had plasma mtDNA levels ≥3,200 copies/µl (n = 101) and <3,200 copies/µl (n = 99) in the BWH MICU. The middle black line indicates the Kaplan-Meier survival curve for patients who had mtDNA <3,200 copies/µl, with 95% confidence intervals (outer black lines and gray shading). The middle red line indicates the Kaplan-Meier survival curve for patients who had mtDNA ≥3,200 copies/µl, with 95% confidence intervals (outer red lines and pink shading). Survival in patients with mtDNA ≥3,200 copies/µl was significantly lower than in patients with mtDNA <3,200 copies/µl (p-value noted in the figure).

https://doi.org/10.1371/journal.pmed.1001577.g003

ME ARDS.

Comparable to our findings in the BWH RoCI cohort, mtDNA levels were higher in ME ARDS patients who died within 28 d of ICU admission (median 7,457 copies/µl) than in patients who did not (median 2,846 copies/µl, p = 5×10−6; Figure 2A), and were higher in patients with sepsis (Figure 2B) or ARDS (Figure 2C) than in patients without these conditions. Also similarly to the BWH RoCI cohort, for each log10-unit increase in mtDNA level, patients had an increased odds of dying within 28-d of ICU admission (OR 1.6, 95% CI 1.2–2.0, p = 9×10−4), those with an mtDNA level ≥3,200 copies/µl had an increased odds of dying within 28 d of ICU admission (Table 2), and there was no evidence that the association between mtDNA level and ICU mortality was attenuated in models adjusted for covariates (Table 2).

In contrast to the BWH RoCI study, the ME ARDS study included ICU patients from non-medical ICUs (i.e., surgical, trauma, and neurological ICUs). In stratified analyses, the association between an elevated mtDNA level and 28-d mortality was limited to MICU patients. Importantly, there was no evidence for an association between mtDNA level and 28-d mortality in non-MICU patients (mtDNA by ICU status interaction 0.03; see Table 2).

mtDNA Level and 28-d Mortality Reclassification and Prediction

BWH RoCI.

To further assess the importance of mtDNA as an ICU biomarker, we tested the ability of mtDNA level to improve reclassification of patients in the BWH RoCI cohort. The inclusion of mtDNA level ≥3,200 copies/µl resulted in a 79% improvement in net reclassification when added to a clinical model (including age, gender, race/ethnicity, APACHE II score, and sepsis; see Table 4). The improvement in net reclassification remained significant, albeit attenuated, when mtDNA level was added to clinical models including known ICU biomarkers (e.g., procalcitonin or lactate; see Table 4). While measurement of lactate levels improved the reclassification of patients when added to a clinical model, measurement of procalcitonin did not (Table 4). In contrast, measurement of lactate did not improve reclassification when added to a clinical model that included mtDNA level (NRI 4%, standard error [SE] 14%, p = 0.80). Similarly, in the BWH RoCI cohort there was evidence that an mtDNA level of ≥3,200 copies/µl improved 28-d mortality prediction when added to a model with clinical variables using c-statistics (the c-statistic was 0.76, 95% CI 0.68–0.83, for a model including age, gender, race/ethnicity, APACHE II score, and sepsis, which improved to 0.83, 95% CI 0.77–0.90, with the inclusion of mtDNA level, p<0.001 for the comparison) (Figure 4A).

thumbnail
Figure 4. Receiver operating characteristic curves, mtDNA, and death in ICU patients.

Comparisons of receiver operating characteristic (ROC) curves for a clinical model (including age, gender, race/ethnicity, APACHE II score, and sepsis) (solid lines) and a clinical model with an mtDNA level ≥3,200 copies/µl (dashed lines) to predict 28-d mortality in ICUs. (A) The area under the curve was 0.76 for a clinical model and was 0.83 for a clinical model with an mtDNA level ≥3,200 copies/µl in the BWH RoCI cohort. (B) The area under the curve was 0.85 for a clinical model and was 0.86 for a clinical model with an mtDNA level ≥3,200 copies/µl in the ME ARDS cohort when all patients were included. (C) The area under the curve was 0.87 for a clinical model and was 0.89 for a clinical model with an mtDNA level ≥3,200 copies/µl in the subpopulation of ME ARDS MICU patients.

https://doi.org/10.1371/journal.pmed.1001577.g004

ME ARDS.

Similar to our findings in the BWH RoCI cohort, the addition of an elevated mtDNA level improved net reclassification of ICU patients when added to a clinical model in the ME ARDS cohort (Table 4). The improvement in net reclassification in the ME ARDS cohort was due to the improvement in reclassifying MICU patients (Table 4), as no significant improvement was noted in non-MICU patients (NRI 4%, SE 16%, p = 0.82). Similarly, there was evidence that an mtDNA level of ≥3,200 copies/µl improved 28-d mortality prediction when added to a model with clinical variables using c-statistics (the c-statistic was 0.85, 95% CI 0.79–0.92, for a model including age, gender, and APACHE II score, which improved to 0.86, 95% CI 0.80–0.92, with the inclusion of mtDNA level, p = 0.02 for the comparison) in the ME ARDS cohort (Figure 4B), although improvement in prediction was limited to MICU patients (the c-statistic was 0.87, 95% CI 0.81–0.93, for a model including age, gender, and APACHE II score, which improved to 0.89, 95% CI 0.83–0.94, with the inclusion of mtDNA level, p = 0.008 for the comparison) (Figure 4C), as no significant improvement was noted in non-MICU patients (the c-statistic was 0.82 regardless of the inclusion of mtDNA level, p = 0.97 for the comparison).

Additional analyses combining both cohorts are presented in Text S8 and Table S4 in Supporting Information S1.

Discussion

Elevated levels of circulating cell-free mtDNA are associated with ICU mortality, particularly among MICU patients, from multiple cohorts. We demonstrate that mtDNA can improve risk prediction beyond commonly measured biomarkers, such as lactate, and combined measures of baseline characteristics and underlying physiology (e.g., APACHE II score) among MICU patients. In the BWH RoCI cohort, based primarily on the strength of the association between elevated mtDNA level and 28-day mortality, elevated mtDNA levels predicted an increased risk of death that persisted over up to 3.5 y of follow-up.

Based on the data we present in this study, it is not possible to determine whether the observed increased circulating cell-free mtDNA levels were increased as the result of the severity of illness alone, or whether mtDNA actively contributes to disease pathogenesis in MICU patients [32][34]. Recent observations [12] show that mtDNA contributes to activation of inflammasome, a large multimolecular complex that controls the proteolytic enzyme caspase-1 [33],[34]. Inflammasome activation is exclusively responsible for caspase-1-mediated IL-1β and IL-18 maturation and secretion in immune cells [33],[34], and circulating IL-1β and IL-18 levels are known to be increased in critically ill patients with both sepsis and ARDS [1],[14],[35]. These findings, in conjunction with the findings presented in here, suggest that circulating mtDNA could serve as a marker of death and, independently, may represent an important pathogenic determinant that contributes to an exaggerated systemic inflammatory response [36].

Our data are consistent with prior studies demonstrating that circulating cell-free mtDNA levels are elevated in critically ill subpopulations including adults with community-acquired bacterial meningitis [8], trauma [7], or sepsis in the emergency room [37], and further implicates the mitochondria, both in terms of genotyping (mtDNA haplogroups) [38] and now cell-free mtDNA plasma measurement, as an important factor predicting survival. In addition, our study demonstrates, to our knowledge for the first time, that elevated mtDNA levels may be particularly important in improving risk prediction in the MICU.

In addition to the evidence that elevated mtDNA levels are associated with sepsis, ARDS, and mortality, an important and unique aspect of our study is that we provide replicated evidence that mtDNA level improves risk prediction in MICU patients. Metrics of association and prediction should not be confused, as only the latter suggest that a finding may have clinical applicability as a test for an individual patient [39]. Although we present statistical evidence that mtDNA level improves our ability to predict death among MICU patients using both c-statistics and reclassification methods, it is important to note that some studies suggest that reclassification methods are more sensitive than c-statistics when comparing the magnitude of predictive improvement [30],[40].

Our study has a number of important limitations. First, although we demonstrate that an elevated mtDNA measurement is associated with ICU mortality among MICU patients from multiple cohorts, there was no evidence for a similar association among non-medical (predominantly surgical) ICU patients. Although we cannot definitively determine the reasons behind these differences within the context of this study, we can't rule out that subtle differences in the timing of sample collection could have influenced the associations within these two groups. In addition, these findings suggest that mtDNA could be released from cells or tissue as the result of surgery, and in this situation an elevated mtDNA level may be unlikely to be associated with an increased risk of mortality. Of note, although some studies demonstrate that patients who meet criteria for systemic inflammatory response syndrome (SIRS) have worse outcomes [41], this does not appear to hold among surgical ICU patients, where the presence of systemic inflammatory response syndrome is very common [42]. Second, some of the comparisons between biomarkers in the BWH RoCI study are limited because of missing data (e.g., lactate measurements). Third, although our assessments of repeated measures of mtDNA suggest that the trajectory of this measurement may be of clinical importance, we urge caution in interpreting these results, as our findings also demonstrate that the probability of being alive to have had mtDNA remeasured was also dependent on the initial mtDNA level. These findings support the idea that future studies of mtDNA in MICU patients could benefit from repeated measurements, including those prior to ICU presentation. Fourth, although fungemia was rare in both the BWH RoCI and ME ARDS cohorts (Text S4 in Supporting Information S1), it is worth noting that fungi have mtDNA that may cross-react with human mtDNA primers [10],[43]. Finally, it is important to note that our analyses reflect that the mtDNA level adds to, rather than replaces, information gleaned from commonly measured physiologic parameters and biomarkers.

In conclusion, we show that mtDNA level in plasma is associated with mortality in MICU patients. Elevated mtDNA level adds to mortality risk prediction in the ICU, and represents an advance over currently used ICU biomarkers and the APACHE score. Given the relative ease and rapidity (the entire process currently takes <6 h) of mtDNA measurement, circulating cell-free mtDNA could be a valuable addition to assessment of MICU patients, and points the way to the possibility of new diagnostic and/or therapeutic approaches for patients with critical illness.

Supporting Information

Supporting Information S1.

mtDNA levels and mortality in patients in the ICU.

https://doi.org/10.1371/journal.pmed.1001577.s001

(DOCX)

Figure S1.

Plot of the threshold cycle (Ct) against the input DNA concentration of the samples after the qPCR using bacterial DNA. DNA isolated from Escherichia coli (Gram negative bacteria), Enterococcus faecalis (Gram positive bacteria), and Clostridium difficile (anaerobic bacteria) were subject to qPCR analysis using primers for human mtDNA primers or bacterial 16S ribosomal RNA (bacterial 16S). While bacterial 16S primers amplified DNA from each of our bacterial samples, human mtDNA primers were not able to amplify DNA from any bacterial sample.

https://doi.org/10.1371/journal.pmed.1001577.s002

(TIF)

Acknowledgments

We thank Emeka Ifedigbo for providing technical assistance for the sample analysis.

Author Contributions

Conceived and designed the experiments: KN SK GH AC. Performed the experiments: KN SK SY LG CQ. Analyzed the data: GH KN SK LG AR ZW YZ CQ RMB DC AC. Contributed reagents/materials/analysis tools: LG AM CQ JO ZW YZ LL JC NM FM SW AW RC RB IR MICU Registry LF RMB DC GH AC. Wrote the first draft of the manuscript: KN SK GH AC. Contributed to the writing of the manuscript: KN SK GH AC AR LG LF RMB ZW YZ DC. ICMJE criteria for authorship read and met: KN SK AR LG SY AM CQ JO ZW YZ LL JC NM FM SW AW RC RB IR MICU Registry LF RMB DC GH AC. Agree with manuscript results and conclusions: KN SK AR LG SY AM CQ JO ZW YZ LL JC NM FM SW AW RC RB IR MICU Registry LF RMB DC GH AC. Enrolled patients: LG AM CQ JO LL JC NM FM SW AW RC RB IR MICU Registry LF RMB DC AC.

References

  1. 1. Pierrakos C, Vincent JL (2010) Sepsis biomarkers: a review. Crit Care 14: R15.
  2. 2. Schetz MR, Van den Berghe G (2005) Do we have reliable biochemical markers to predict the outcome of critical illness? Int J Artif Organs 28: 1197–1210.
  3. 3. Aduen J, Bernstein WK, Khastgir T, Miller J, Kerzner R, et al. (1994) The use and clinical importance of a substrate-specific electrode for rapid determination of blood lactate concentrations. JAMA 272: 1678–1685.
  4. 4. Christ-Crain M, Jaccard-Stolz D, Bingisser R, Gencay MM, Huber PR, et al. (2004) Effect of procalcitonin-guided treatment on antibiotic use and outcome in lower respiratory tract infections: cluster-randomised, single-blinded intervention trial. Lancet 363: 600–607.
  5. 5. Pyle A, Burn DJ, Gordon C, Swan C, Chinnery PF, et al. (2010) Fall in circulating mononuclear cell mitochondrial DNA content in human sepsis. Intensive Care Med 36: 956–962.
  6. 6. Suliman HB, Welty-Wolf KE, Carraway MS, Schwartz DA, Hollingsworth JW, et al. (2005) Toll-like receptor 4 mediates mitochondrial DNA damage and biogenic responses after heat-inactivated E. coli. FASEB J 19: 1531–1533.
  7. 7. Zhang Q, Raoof M, Chen Y, Sumi Y, Sursal T, et al. (2010) Circulating mitochondrial DAMPs cause inflammatory responses to injury. Nature 464: 104–107.
  8. 8. Lu CH, Chang WN, Tsai NW, Chuang YC, Huang CR, et al. (2010) The value of serial plasma nuclear and mitochondrial DNA levels in adult community-acquired bacterial meningitis. QJM 103: 169–175.
  9. 9. Cossarizza A, Pinti M, Nasi M, Gibellini L, Manzini S, et al. (2011) Increased plasma levels of extracellular mitochondrial DNA during HIV infection: a new role for mitochondrial damage-associated molecular patterns during inflammation. Mitochondrion 11: 750–755.
  10. 10. Sursal T, Stearns-Kurosawa DJ, Itagaki K, Oh SY, Sun S, et al. (2013) Plasma bacterial and mitochondrial DNA distinguish bacterial sepsis from sterile systemic inflammatory response syndrome and quantify inflammatory tissue injury in nonhuman primates. Shock 39: 55–62.
  11. 11. Krysko DV, Agostinis P, Krysko O, Garg AD, Bachert C, et al. (2011) Emerging role of damage-associated molecular patterns derived from mitochondria in inflammation. Trends Immunol 32: 157–164.
  12. 12. Nakahira K, Haspel JA, Rathinam VA, Lee SJ, Dolinay T, et al. (2011) Autophagy proteins regulate innate immune responses by inhibiting the release of mitochondrial DNA mediated by the NALP3 inflammasome. Nat Immunol 12: 222–230.
  13. 13. Collins LV, Hajizadeh S, Holme E, Jonsson IM, Tarkowski A (2004) Endogenously oxidized mitochondrial DNA induces in vivo and in vitro inflammatory responses. J Leukoc Biol 75: 995–1000.
  14. 14. Dolinay T, Kim YS, Howrylak J, Hunninghake GM, An CH, et al. (2012) Inflammasome-regulated cytokines are critical mediators of acute lung injury. Am J Respir Crit Care Med 185: 1225–1234.
  15. 15. Gong MN, Sai Y, Zhou W, Thompson BT, Xu LL, et al. (2003) Genotyping patients with recent blood transfusions. Epidemiology 14: 744–747.
  16. 16. Sheu CC, Gong MN, Zhai R, Chen F, Bajwa EK, et al. (2010) Clinical characteristics and outcomes of sepsis-related vs non-sepsis-related ARDS. Chest 138: 559–567.
  17. 17. Clermont G, Acker CG, Angus DC, Sirio CA, Pinsky MR, et al. (2002) Renal failure in the ICU: comparison of the impact of acute renal failure and end-stage renal disease on ICU outcomes. Kidney Int 62: 986–996.
  18. 18. Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, et al. (2003) 2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. Crit Care Med 31: 1250–1256.
  19. 19. Bernard GR, Artigas A, Brigham KL, Carlet J, Falke K, et al. (1994) The American-European Consensus Conference on ARDS. Definitions, mechanisms, relevant outcomes, and clinical trial coordination. Am J Respir Crit Care Med 149: 818–824.
  20. 20. Knaus WA, Draper EA, Wagner DP, Zimmerman JE (1985) APACHE II: a severity of disease classification system. Crit Care Med 13: 818–829.
  21. 21. Abraham E, Laterre PF, Garg R, Levy H, Talwar D, et al. (2005) Drotrecogin alfa (activated) for adults with severe sepsis and a low risk of death. N Engl J Med 353: 1332–1341.
  22. 22. Hill ME, Rosenwaike I (2001) The Social Security Administration's Death Master File: the completeness of death reporting at older ages. Soc Secur Bull 64: 45–51.
  23. 23. Bajwa EK, Khan UA, Januzzi JL, Gong MN, Thompson BT, et al. (2009) Plasma C-reactive protein levels are associated with improved outcome in ARDS. Chest 136: 471–480.
  24. 24. McGill MR, Sharpe MR, Williams CD, Taha M, Curry SC, et al. (2012) The mechanism underlying acetaminophen-induced hepatotoxicity in humans and mice involves mitochondrial damage and nuclear DNA fragmentation. J Clin Invest 122: 1574–1583.
  25. 25. Moreira VG, Prieto B, Rodriguez JS, Alvarez FV (2010) Usefulness of cell-free plasma DNA, procalcitonin and C-reactive protein as markers of infection in febrile patients. Ann Clin Biochem 47: 253–258.
  26. 26. Nga TV, Karkey A, Dongol S, Thuy HN, Dunstan S, et al. (2010) The sensitivity of real-time PCR amplification targeting invasive Salmonella serovars in biological specimens. BMC Infect Dis 10: 125.
  27. 27. Zozaya-Hinchliffe M, Martin DH, Ferris MJ (2008) Prevalence and abundance of uncultivated Megasphaera-like bacteria in the human vaginal environment. Appl Environ Microbiol 74: 1656–1659.
  28. 28. Chiu RW, Chan LY, Lam NY, Tsui NB, Ng EK, et al. (2003) Quantitative analysis of circulating mitochondrial DNA in plasma. Clin Chem 49: 719–726.
  29. 29. Hosmer DW, Taber S, Lemeshow S (1991) The importance of assessing the fit of logistic regression models: a case study. Am J Public Health 81: 1630–1635.
  30. 30. Cook NR (2007) Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 115: 928–935.
  31. 31. May Clinic Division of Biomedical Statistics and Informatics (2013) Locally written SAS macros. Available: http://www.mayo.edu/research/departments-divisions/department-health-sciences-research/division-biomedical-statistics-informatics/software/locally-written-sas-macros. Accessed 23 August13.
  32. 32. van der Vaart M, Pretorius PJ (2008) Circulating DNA. Its origin and fluctuation. Ann N Y Acad Sci 1137: 18–26.
  33. 33. Davis BK, Wen H, Ting JP (2011) The inflammasome NLRs in immunity, inflammation, and associated diseases. Annu Rev Immunol 29: 707–735.
  34. 34. Henao-Mejia J, Elinav E, Strowig T, Flavell RA (2012) Inflammasomes: far beyond inflammation. Nat Immunol 13: 321–324.
  35. 35. Makabe H, Kojika M, Takahashi G, Matsumoto N, Shibata S, et al. (2012) Interleukin-18 levels reflect the long-term prognosis of acute lung injury and acute respiratory distress syndrome. J Anesth 26: 658–663.
  36. 36. Escames G, Lopez LC, Garcia JA, Garcia-Corzo L, Ortiz F, et al. (2012) Mitochondrial DNA and inflammatory diseases. Hum Genet 131: 161–173.
  37. 37. Kung CT, Hsiao SY, Tsai TC, Su CM, Chang WN, et al. (2012) Plasma nuclear and mitochondrial DNA levels as predictors of outcome in severe sepsis patients in the emergency room. J Transl Med 10: 130.
  38. 38. Baudouin SV, Saunders D, Tiangyou W, Elson JL, Poynter J, et al. (2005) Mitochondrial DNA and survival after sepsis: a prospective study. Lancet 366: 2118–2121.
  39. 39. Kraft P, Wacholder S, Cornelis MC, Hu FB, Hayes RB, et al. (2009) Beyond odds ratios—communicating disease risk based on genetic profiles. Nat Rev Genet 10: 264–269.
  40. 40. Kathiresan S, Melander O, Anevski D, Guiducci C, Burtt NP, et al. (2008) Polymorphisms associated with cholesterol and risk of cardiovascular events. N Engl J Med 358: 1240–1249.
  41. 41. Rangel-Frausto MS, Pittet D, Costigan M, Hwang T, Davis CS, et al. (1995) The natural history of the systemic inflammatory response syndrome (SIRS). A prospective study. JAMA 273: 117–123.
  42. 42. Pittet D, Rangel-Frausto S, Li N, Tarara D, Costigan M, et al. (1995) Systemic inflammatory response syndrome, sepsis, severe sepsis and septic shock: incidence, morbidities and outcomes in surgical ICU patients. Intensive Care Med 21: 302–309.
  43. 43. Dowler WM, Shaw PD, Gottlieb D (1963) Terminal oxidation in cell-free extracts of fungii. J Bacteriol 86: 9–17.