ABSTRACT

OBJECTIVE: To evaluate the use of the EuroSCORE as a predictor of postoperative morbidity after cardiac surgery.
METHODS: We retrospectively analyzed the charts of 900 patients operated on and admitted to the intensive care unit postoperatively at the Royal Portuguese Hospital of Recife. We included all patients with complete medical records, excluding those who died during surgery, underwent transplantation or correction of congenital heart disease. We evaluated the development of respiratory infection, cerebrovascular accident, and dialysis-dependent renal failure, and the EuroSCORE was compared in terms of the three complications using the Mann-Whitney test. The calibration model for predicting the morbidities being studied was evaluated using the test set of Homer-Lemeshow goodness. The accuracy of the model was assessed using the area under the ROC curve (AUROC).
RESULTS: The model showed good calibration in predicting respiratory infection, acute renal failure and stroke (P=0.285, P=0.789, P=0.45, respectively), with good accuracy for respiratory infection (AUROC=0.710 and P<0.001) and dialysis-dependent renal failure (AUROC=0.834 and P<0.001), but no accuracy to predict stroke (AUROC=0.519). The high-risk patients were more likely to develop respiratory infection (OR=9.05, P<0.001) and dialysis-dependent renal failure (OR=39.6, P<0.001). The probability of developing respiratory infection and dialysis-dependent renal failure was less than 10% with EuroSCORE up to 7 and more than 70% with EuroSCORE greater than 15.
CONCLUSION: EuroSCORE proved to be a good predictor of major postoperative morbidity in cardiac surgery: respiratory and dialysis-dependent renal failure.

RESUMO

OBJETIVO: Avaliar o uso do EuroSCORE como preditor de morbidade no pós-operatório de cirurgia cardíaca.
MÉTODOS: Foram analisados, retrospectivamente, os prontuários de 900 pacientes operados no Real Hospital Português do Recife e admitidos na unidade de terapia intensiva pós-operatória. Foram incluídos todos os pacientes com prontuários completos, sendo excluídos aqueles que foram a óbito no transoperatório, submetidos a transplante ou a correção de cardiopatia congênita. Foi avaliado o desenvolvimento de infecção respiratória, acidente vascular cerebral e insuficiência renal dialítica, sendo o EuroSCORE comparado em relação às três complicações, usando-se o teste de Mann-Whitney. A calibração do modelo para predição das morbidades estudadas foi avaliado com o teste de ajuste de bondade de Homer-Lemeshow. A acurácia do modelo foi avaliada utilizando-se a área sob a curva ROC (ASROC).
RESULTADOS: O modelo apresentou boa calibração na predição de infecção respiratória, insuficiência renal dialítica e acidente vascular cerebral (P=0,285; P=0,789; P=0,45, respectivamente), tendo boa acurácia para infecção respiratória (ASROC=0,710 e P<0,001) e insuficiência renal dialítica (ASROC=0,834 e P<0,001) e sem acurácia para acidente vascular cerebral (ASROC=0,519). Os pacientes de alto risco apresentaram maior chance de desenvolver infecção respiratória (OR=9,05; P<0,001) e insuficiência renal dialítica (OR=39,6; P<0,001). A probabilidade de desenvolver infecção respiratória e insuficiência renal dialítica foi de menos de 10% com EuroSCORE até 7 e de mais de 70% com EuroSCORE maior que 15.
CONCLUSÃO: O EuroSCORE mostrou-se um bom preditor das principais morbidades pós-operatórias em cirurgia cardíaca: infecção respiratória e insuficiência renal dialítica.

INTRODUCTION

Risk stratification has become more relevant in cardiac surgery practice with the use of specific scores, which are important tools to measure risk, analyze quality of care, and evaluate costs [1,2]. Thus, several scores have been developed and applied to predict mortality in cardiac surgery [3,4]. Calculating surgical risk, i.e., death, is relatively simple since the response variable "death" is an obvious excluding variable. However, studying causes of death is often a lot more complex as there are multiple variables, making it difficult to develop specific scores to predict mortality. In addition, the relationship between the development of a complication and death does not always hold true; nonetheless, it can prolong hospital stay and change patients' quality of life [5].

In cardiac surgery, when the following three major events are present, there is greater risk of death: onset of respiratory tract infection (RTI), preoperative cerebrovascular accident (CVA), and dialysis-dependent renal failure (DDRF) [6-9]. Besides being associated with higher mortality rates, those events are the leading cause of readmission to the intensive care unit, increasing hospital costs [10].

Even though it is known that those adverse events can definitely contribute to unfavorable results in cardiac surgeries, there are no specific scores derived from major studies capable of predicting the chances of developing such complications and, hence, capable of predicting morbidity.

This study sets out to evaluate the EuroSCORE as a predictor of morbidity, since it is simple and practical, has a reduced number of variables, and is widely used throughout the world, having been validated several times, including in our midst, with good results [11,12].

METHODS

This cross-sectional observational study was developed at the Thoracic Surgery Recovery Unit of the Royal Portuguese Hospital of Recife. Medical records of 900 out of 1036 patients operated on from July 1, 2008 to July 30, 2009 were analyzed. Patients with complete medical records were included in the study and patients who died during surgery or who had undergone either cardiac transplant or correction of congenital heart disease were excluded. Data was collected from electronic medical records and inserted into an Excel spreadsheet containing all the variables included in the study. A specific calculator was used to obtain the EuroSCORE, classifying patients into the following three risk groups, according to additive score values: high, medium, and low. Variables studied were EuroSCORE values, death, and development of RTI, DDRF or CVA, the occurrence of the latter being considered in the period between surgery and hospital discharge. RTI was diagnosed according to clinical and radiological criteria, and it was confirmed by quantitative culture of tracheal aspirate containing colony counts above one million. Patients who developed the need to have compulsory renal replacement therapy after surgery were considered as having DDRF. Patients with CVA should have their diagnosis confirmed by recent findings of brain damage as evidenced by non-contrast computed tomography scan performed 72 hours after suspicion of the event. Continuous variables were expressed as means and/or medians and standard deviation. Categorical variables were expressed as their relative and absolute frequencies.

The non-parametric Mann-Whitney test was applied to compare EuroSCORE in terms of death, CVA, RTI, and DDRF. Calibration of EuroSCORE was measured by the Hosmer-Lemeshow goodness of fit test for logistic regression models, in which response was hospital mortality or morbidities (CVA, RTI, and DDRF) and the independent variable was EuroSCORE. Accuracy was assessed by the area under the ROC curve (receiver operating characteristic curve), built based on sensitivity (correct prediction of death) and 1 – specificity (correct prediction of survival), which were calculated for every score value studied. The relationship between the risk groups classified by the score and the development of the aforementioned complications was measured by chi-square and Fischer's exact test, as indicated. P-values of P<0.05 were considered statistically significant to reject the null hypothesis. The Statistical Package for the Social Sciences 16.0 (SPSS) was the software used for analysis.

The project was approved by the Ethics Committee of the Royal Portuguese Hospital of Recife.

RESULTS

The sample studied consisted of 900 patients, with a mean age of 57.6 ± 13.9 years, ranging from 11 to 86 years old, and 518 (57.6%) being male. Mean EuroSCORE was 2.76 ± 2.27.

Most patients had undergone isolated coronary artery bypass grafting (67%), followed by isolated valve surgery (26%), and coronary artery bypass grafting associated with another cardiac surgery (4%) (Figure 1).

Population distribution in the high, medium, and low EuroSCORE risk groups was 12.1%, 38.4%, and 49.4%, respectively.

Prevalence of complications was 4.8% and sample mortality was 4.1%. In addition, EuroSCORE values were higher among patients who died. Mortality in the group with complications was significantly higher than in the group without complications (Table 1).

Analysis of the predictive ability of EuroSCORE for morbidities

Respiratory tract infection

A comparison of score values revealed higher values for patients who developed RTI than those who did not, as shown in Table 2.

The predictive model for RTI showed good calibration, as presented in Table 3, and good accuracy, determined by analysis of the area under the ROC curve (Figure 2).

The area under the ROC curve was 0.710 (CL 95%, 0.600 – 0.821), with P-value<0.001. Results obtained show that EuroSCORE was good in discriminating between patients with and without RTI (Figure 3).

Dialysis-dependent renal failure

Just like RTI, higher EuroSCORE values were found among patients who developed DDRF than in those who did not develop DDRF, as shown in Table 4 and Figure 4.

The predictive model for DDRF showed good calibration, as presented in Table 5, and excellent accuracy, determined by analysis of the area under the ROC curve (Figure 2).

The area under the ROC curve was 0.834 (CL 95%, 0.738 – 0.930), with P-value<0.001. Results show that EuroSCORE was good in discriminating between patients with and without DDRF (Figure 5).

Cerebrovascular accident

With regard to occurrence of CVA, there was no difference in EuroSCORE values between patients who developed this complication and those who did not (P=0.484; Mann-Whitney test). In terms of the predictive model for this morbidity, despite good calibration (P=0.45), it was not accurate to discriminate between patients who did and did not develop CVA in the postoperative period (area under the ROC curve = 0.519), as shown in Figure 3.

Analysis of the relationship between the risk group and the chance of developing postoperative complications

It was observed that patients in the high-risk group, according to EuroSCORE values, had greater chances of developing RTI (OR: 9.05) and DDRF (OR: 39.96), as presented in Tables 6 and 7. However, the same association could not be said of the occurrence of CVA.

Cut-off points for greater specificity and sensitivity for prediction of RTI and DDRF are listed in Table 8.

The probability of developing RTI and DDRF based on EuroSCORE was determined, varying from less than 10% to more than 70% (Tables 9 and 10).

DISCUSSION

The use of risk scores in surgical practice is a valid strategy, not only to measure risk but also to analyze and compare results. Risk scores are related to factors inherent to the model itself, the population for which they were developed, and the characteristics of the population in which they will be applied. As a result, the majority of scores show conflicting results in the prediction of risks. In addition, the large number of variables of a score also reduces its effectiveness when applied to distinct populations [13,14]. On the other hand, scores that are validated in diverse populations, such as the EuroSCORE, tend to show better results.

The prevalence of complications (RTI, DDRF, and CVA) was similar to what has been described in the literature. Likewise, general mortality in the sample studied was also similar to previous results, drawing attention to the high mortality rate, an important fact that indicates the importance of both early identification of patients at risk for developing those complications and aggressive intervention to reverse this situation [8,15,16].

Even though the prevalence of complications was similar to what has been described in the literature, the use of strict diagnostic criteria to characterize complications may have left patients who had only clinical diagnoses out of the RTI and CVA groups, which could lead to underdiagnosis of those complications.

By using the score to predict RTI, it was observed that patients with higher EuroSCORE values had greater chances of developing a complication, which could be considered an obvious outcome, but the score tool now presents numeric data. The model showed good calibration to that end, especially in patients with medium to high EuroSCORE values. The same findings were obtained when predicting the development of DDRF, with higher values (P=0.789).

In terms of discriminating power, assessed by the area under the ROC curve, the model was also deemed adequate, with predicting values for RTI and DDRF of 0.710 and 0.834, respectively, both statistically significant. In practice, these data translates into good ability to discriminate which patients will definitely develop complications among those with chances of developing them.

Similar to the model calibration, the values for predictive ability were significant for both RTI and DDRF. However, the results of the DDRF group were more robust, probably because of better characterization of the patients belonging to that group, and since diagnostic criteria is exclusive, i.e., whether or not the patient developed DDRF, there are no confounding variables in the diagnosis of the complication.

The opposite was observed when the score was used to predict CVA. The score was not successful, showing neither effective calibration nor effective predictive ability, probably due to the diagnostic method used: the computed tomography. Even though computed tomography was performed 72 hours after suspected clinical diagnosis, the scan might not show ischemic lesions and nuclear magnetic resonance is more accurate. However, due to the characteristics of the patients, such as hemodynamic instability at the time of the exam, the decision was made not to perform a longer exam that could put the patient at risk.

Finally, it is interesting to observe the exponential growth in the chance of developing RTI and DDRF as the EuroSCORE values increase, with sensitivity and specificity cut-off points starting at score 3.5. In patients with EuroSCORE values above this cut-off point, it allows for the possibility of implementing protective measures, directing human and material resources, and defining the best surgical strategy so that the occurrence of complications with potential mortality can be reduced.

The results and validations of the EuroSCORE II were published during this study [17-19]; however, we decided to continue using EuroSCORE I because of it has numerous validations, including in our midst, it is easy to use, and it is widely known to all professionals involved in the care of patients undergoing cardiac surgery, such as intensivists, surgeons, and cardiologists.

The publication of studies showing the lack of superiority of EuroSCORE II over EuroSCORE I [19,20] supports the decision to use EuroSCORE I and emphasizes the need for constant recalibration of risk scores, especially when used in populations other than the ones they were developed for.

CONCLUSION

EuroSCORE proved to be a good predictor for major postoperative morbidities in cardiac surgery (RTI and DDRF). However, in this study, it could not predict the development of CVA. The chances of developing RTI and DDRF increase as additive EuroSCORE values increase, making it possible to identify high-risk patients and to start implementing preventive measures and early intervention.

REFERENCES

1. Granton J, Cheng D. Risk stratification models for cardiac surgery. Semin Cardiothorac Vasc Anesth. 2008;12(3):167-74. [MedLine]

19. Noyez L, Kievit PC, van Swieten HA, de Boer MJ. Cardiac operative risk evaluation: The EuroSCORE II, does it make a real difference? Neth Heart J. 2012;20(12):494-8. [MedLine]

2. Litmathe J, Kurt M, Feindt P, Gams E, Boeken U. Predictors and outcome of ICU readmission after cardiac surgery. Thorac Cardiovasc Surg. 2009;57(7):391-4. [MedLine]

3. Geissler HJ, Hölzl P, Marohl S, Kuhn-RégnieR F, Mehlhorn U, Südkamp M, et al. Risk stratification in heart surgery: comparison of six score systems. Eur J Cardiothorac Surg. 2000;17(4):400-6. [MedLine]

4. Nashef SA, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R. European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardiothorac Surg. 1999;16(1):9-13. [MedLine]

5. Shroyer AL, Coombs LP, Peterson ED, Eiken MC, DeLong ER, Chen A, et al; Society of Thoracic Surgeons. The Society of Thoracic Surgeons: 30-day operative mortality and morbidity risk models. Ann Thorac Surg. 2003;75(6):1856-64.

6. Hobson CE, Yavas S, Segal MS, Schold JD, Tribble CG, Layon AJ, et al. Acute kidney injury is associated with increased long-term mortality after cardiothoracic surgery. Circulation. 2009;119(18):2444-53. [MedLine]

7. Ngaage DL, Cowen ME, Griffin S, Guvendik L, Cale AR. Early neurological complications after coronary artery bypass grafting and valve surgery in octogenarians. Eur J Cardiothorac Surg. 2008;33(4):653-9. [MedLine]

8. Riera M, Ibañez J, Herrero J, Ignacio Sáez De Ibarra J, Enríquez F, Campillo C, et al. Respiratory tract infections after cardiac surgery: impact on hospital morbidity and mortality. J Cardiovasc Surg (Torino). 2010;51(6):907-14. [MedLine]

9. Carrascal Y, Guerrero AL. Neurological damage related to cardiac surgery: pathophysiology, diagnostic tools and prevention strategies. Using actual knowledge for planning the future. Neurologist. 2010;16(3):152-64. [MedLine]

10. Litmathe J, Kurt M, Feindt P, Gams E, Boeken U. Predictors and outcome of ICU readmission after cardiac surgery. Thorac Cardiovasc Surg. 2009;57(7):391-4. [MedLine]

11. Moraes F, Duarte C, Cardoso E, Tenório E, Pereira V, Lampreia D, et al. Avaliação do EuroSCORE, como preditor de mortalidade em cirurgia de revascularização miocárdica no Instituto do Coração de Pernambuco. Rev Bras Cir Cardiovasc. 2006;21(1):29-34.

12. Andrade ING, Moraes Neto FR, Oliveira JPSP, Silva ITC, Andrade TG, Moraes CRR. Avaliação do EuroSCORE como preditor de mortalidade em cirurgia cardíaca valvar no Instituto do Coração de Pernambuco. Rev Bras Cir Cardiovasc. 2010;25(1):11-8. [MedLine] View article

13. Geissler HJ, Hölzl P, Marohl S, Kuhn-Régnier F, Mehlhorn U, Südkamp M, et al. Risk stratification in heart surgery: comparison of six score systems. Eur J Cardiothorac Surg. 2000;17(4):400-6. [MedLine]

14. Ivanov J, Borger MA, Rao V, David TE. The Toronto Risk Score for adverse events following cardiac surgery. Can J Cardiol. 2006;22(3):221-7. [MedLine]

15. Hobson CE, Yavas S, Segal MS, Schold JD, Tribble CG, Layon AJ, et al. Acute kidney injury is associated with increased long-term mortality after cardiothoracic surgery. Circulation. 2009;119(18):2444-53. [MedLine]

16. Guaragna JCVC, Bolsi DC, Jaeger CP, Melchior R, Petracco JB, Facchi LM, et al. Preditores de disfunção neurológica maior após cirurgia de revascularização miocárdica isolada. Rev Bras Cir Cardiovasc. 2006;21(2):173-9. View article

17. Nashef SA, Roques F, Sharples LD, Nilsson J, Smith C, Goldstone AR, et al. EuroSCORE II. Eur J Cardiothorac Surg. 2012;41(4):734-44.

18. Carnero-Alcázar M, Silva Guisasola JA, Reguillo Lacruz FJ, Maroto Castellanos LC, Cobiella Carnicer J, Villagrán Medinilla E, et al. Validation of EuroSCORE II on a single-centre 3800 patient cohort. Interact Cardiovasc Thorac Surg. 2013;16(3):293-300. [MedLine]

19. Noyez L, Kievit PC, van Swieten HA, de Boer MJ Cardiac operative risk evaluation: The EuroSCORE II, does it make a real difference? Neth Heart J. 2012;20(12):494-8. [MedLine]

20. Poullis M, Fabri B, Pullan M, Chalmers J. Sampling time error in EuroSCORE II. Interact Cardiovasc Thorac Surg. 2012;14(5):640-1. [MedLine]

No financial support.

Authors' roles & responsibilities

INGA: Main author

FRMN: Coordination of data collection, data and bibliographic referencesorganization

TGA: Tabulation and organization of data, partial drafting of the final text

Article receive on Thursday, May 16, 2013