Prognostic value of GRACE score for in-hospital and 6 months outcomes after non-ST elevation acute coronary syndrome
The Egyptian Heart Journal volume 73, Article number: 22 (2021)
The aim of this study was to determine the predictive value of the Global Registry of Acute Coronary Events (GRACE) score for predicting in-hospital and 6 months mortality after non-ST elevation acute coronary syndrome (NSTE-ACS).
In this observational study, 300 patients with NSTE-ACS of age more than 30 years were included; 16 patients died during the hospital stay (5.3%). Of 284 patients at 6 months assessment, 10 patients died (3.5%), 240 survived (84.5%), and 34 were lost to follow-up (12%) respectively. In high risk category, 10.5% of the patients died within hospital stay and 11.8% died within 6 months (p = 0.001 and p = 0.013). In univariate analysis, gender, diabetes mellitus, family history, smoking, and GRACE score were significantly associated with in-hospital mortality whereas age, obesity, dyslipidemia, and GRACE were significantly associated with 6 months mortality. After adjustment, diabetes mellitus, family history, and GRACE score remained significantly associated with in-hospital mortality (p ≤ 0.05) and age remained significantly associated with 6 months mortality.
GRACE risk score has good predictive value for the prediction of in-hospital mortality and 6 months mortality among patients with NSTE-ACS.
Acute coronary syndrome (ACS) is a syndrome caused by decreased blood flow in the coronary arteries. The clinical characteristics of ACS, including ST segment elevation of myocardial infarction (STEMI), non-STEMI, and unstable angina, is known to be widespread causes for disability and mortality . Life-saving therapies for ACS patients are strongly dependent on early and prompt identification of signs and symptoms, whereas atypical appearance of ACS symptoms may lead to delayed diagnosis, delayed care, less evidence-based approaches, and increased morbidity and mortality .
Accurate stratification of risk factors and diagnostic evaluation are of the highest significance not just for primary prevention but even for the prevention of repeated coronary ischemia or infarction attacks . For patients with confirmed ACS diagnosis, various scoring systems may be used in order to differentiate patients in the coronary care unit that benefit more from the treatments. The risk scores such as the thrombolysis in myocardial infarction (TIMI), platelet glycoprotein IIb/IIIa in unstable angina: receptor suppression using integrilin (PURSUIT), fast revascularization in instability in coronary disease (FRISC), and Global Registry of Acute Coronary Events (GRACE) are well validated in this regard. But none of the scoring systems were used to identify the ACS in the emergency room . A huge number of patients with chest pain due to factors other than ACS were not assessed in these studies. Currently, there is actually no evidence based risk stratification and guidelines for these patients .
There are many risk scores for ACS risk stratification . GRACE [The Global Registry of Acute Coronary Events] score is one of the score that was developed to identify patients in the coronary care unit or emergency department at the greatest risk of adverse events after ACS. It has been observed that the odds of in-hospital mortality have increased significantly with increase in GRACE score . The GRACE score was validated in various databases and c-statistics of the GRACE score was estimated to be 0.83 in the original database . The parameters of the GRACE score (range 2 to 372) are heart rate, age, systolic blood pressure, cardiac arrest, Killip class, ST segment deviation, serum creatinine, and cardiac biomarker status .
In Pakistan, coronary diseases have been the leading causes of morbidity and mortality . The goal of the current research is therefore to evaluate the predictive importance of the GRACE score for predicting in-hospital and 6-month non-ST acute coronary syndrome (NSTE-ACS) mortality.
It was an observational study conducted at the department of a tertiary care cardiac center of Karachi, Pakistan, from August 2019 to August 2020. Sample size was estimated by using OpenEpi online sample size calculator; using 95% confidence level, 5.6% margin of error, and statistics for GRACE score ≥ 217 for predicting in-hospital mortality as 39.7% . Sample size for the study was 294 ≈ 300 patients. Patients with NSTE-ACS of age more than 30 years of either gender were included in the study. Patients with prior history of cardiac-related surgery or intervention and ST elevation myocardial infarction and patients who refuse to give consent were excluded from the study.
The study was conducted after the approval of ethical review committee of the institution. Verbal informed consent was obtained from all the eligible participants. Data regarding baseline characteristics, positive family history, smoking status, hypertension, diabetes mellitus, and obesity were collected from all the eligible participants on pre-designed questionnaire. GRACE score was calculated based on age, heart rate, systolic blood pressure, Killip class, cardiac arrest, ST segment deviation, serum creatinine, and initial cardiac biomarker status . The tertiles of risk categories used were as follows: for in-hospital mortality, low risk for GRACE score ≤ 108, intermediate risk for GRACE score between 109 and 140, and high risk for GRACE score ≥ 141. All patients were managed as per the institutional protocol and guidelines. Patients were followed for 6 months (telephonic follow-up) and study outcomes [i.e., mortality (in-hospital and 6 months mortality] were recorded.
Data analysis was done using SPSS version 25. Mean and SD were computed for numeric variables. Frequency and percentage were computed for categorical variables. Fisher exact test was applied to compare risk categories with in-hospital and 6 months mortality. Receiver operating characteristic (ROC) curves were used to determine the predictive accuracy of the GRACE scores regarding in-hospital and 6 months mortality. Prediction was deemed significant when the area under the ROC curve (AUC) was statistically different from 0.5. Univariate logistic regression was performed to identify the significant predictors of in-hospital and 6 months mortality. Variables which were significant in univariate analysis at 20% level of significance were moved to single multivariate model. A p value ≤ 0.05 was considered as statistically significant.
The mean age of the study subjects was estimated as 58.04 ± 10.70 years (range 32–95 years). Most of the patients were males (76.7%) and 23.3% were females. Hypertension was the most frequent risk factor (84.7%), followed by diabetes (42.3%). Only 9% of the patients were obese and 27.3% were smokers. Out of 300 patients, 11% had positive family history of coronary artery disease in first degree relative.
The mean GRACE score was 120.19 ± 33.17 (range 44–233). Most of the patients had low risk (n = 119, 39.7%), followed by moderate risk (n = 105, 35%) and high risk (n = 76, 25.3%). Of 300 patients, 16 patients died during the hospital stay (5.3%). Of 284 patients at 6 months assessment, 10 patients died (3.5%), 240 survived (84.5%), and 34 were lost to follow-up (12%) respectively. In high risk category, 10.5% of the patients died within hospital stay and 11.8% died within 6 months (p = 0.001 and p = 0.013) (Table 1).
Figure 1a shows the receiver operating characteristic [ROC] for GRACE score for the prediction of in-hospital mortality [AUC = 0.80, 95% CI 0.71–0.89; p = 0.001]. The best cutoff point for GRACE score derived from ROC is 190.5 ≈ 120 which gives sensitivity of 93.8% and specificity of 53.2%. Figure 1b shows the receiver operating characteristic [ROC] for GRACE score for the prediction of 6 months mortality [AUC = 0.792, 95% CI 0.619–0.964; p = 0.002]. The best cutoff point for GRACE score derived from ROC is 130.5 ≈ 131 which gives sensitivity of 80% and specificity of 70.8%.
In univariate analysis, gender, diabetes mellitus, family history, smoking, and GRACE score were significantly associated with in-hospital mortality. Variables which were significant in univariate analysis at p ≤ 0.20 were moved into multivariate analysis. After adjustment, diabetes mellitus, family history, and GRACE score remained significantly associated with in-hospital mortality (p ≤ 0.05) (Table 2).
In univariate analysis, age, obesity, dyslipidemia, and GRACE were significantly associated with 6 months mortality. Variables which were significant in univariate analysis at p ≤ 0.20 were moved into multivariate analysis. After adjustment, only age remained significantly associated with 6 months mortality (p ≤ 0.05) (Table 3).
The GRACE score is globally recommended for the risk stratification of hospitalized patients with NSTE-ACS, so that they can obtain evidence-based care according to their risk group for potential ischemic incidents in future [3, 8, 9]. Large GRACE registry of patients with ACS used GRACE risk score for the prediction of myocardial infraction or death within hospital stay or at 6 months . Although multiple researches have tested the validity of the GRACE score for different groups and different health outcomes and have demonstrated that failure to obey the NSTEMI recommendations will contribute to excess mortality rates, there is no randomized trial to examine if the regular usage of the GRACE score improves NSTE-ACS care and prevents subsequent coronary incidents [11, 12].
In the present study, majority of patients were classified into low risk category followed by intermediate and high risk category. A similar study conducted by Shaikh MK et al. in 2014 found most of the patients were in the high risk group (36%) whereas 35% were in the intermediate risk category and 29% were in the low risk category . Clinically significant finding in the present study showed that GRACE score has good accuracy for predication against optimal cutoff of in-hospital mortality (AUC = 0.80, sensitivity = 93.8% and specificity = 53.2%) and 6 months mortality (AUC = 0.792, sensitivity = 80% and specificity = 70.8%) in patients with NSTE-ACS. Further, our findings showed that in-hospital and 6 months mortality was significantly higher in the high risk category as compared to the moderate risk category whereas no in-hospital mortality was observed in the low risk group and one patient died at 6 months in the low risk category, while Shaikh MK et al. also found similar results and found good discrimination value for GRACE score (AUC = 0.80) and in their study 8.4% of the patients in high risk group died during the hospital stay . Abu-Assi et al. conducted study at Spain in 2010 found 61.2% of the patients admitted in hospital for NSTEMI. Furthermore, GRACE score had excellent discrimination accuracy (AUC = 0.86) for prediction of 6 months mortality . In another study by Thalib L et al. in 6 Arabian Gulf countries for NSTE-ACS found good discrimination value for 6 months GRACE score as AUC = 70.7% for prediction of 1-year mortality . Similarly, Bradshaw et al. also observed good discrimination capacity of GRACE score with c-statistics as 0.80 . In another study by Elbarouni et al., it was observed that the GRACE score is an accurate and powerful tool for the prediction of adverse events across the wide range of ACS patients in Canada .
In the current study, after adjustment in the multivariate model, the risk of in-hospital mortality was significantly higher in females, patients with diabetes, and patients who had family history of coronary artery diseases and GRACE score was significant independent predictor of in-hospital mortality, while 6-month mortality was associated with increased age. A similar study by Abu-Assi et al. showed 6-month GRACE risk score was an independent risk factor of 30-day events . A study by Granger et al. found in the multivariate model that in-hospital mortality was higher among patients with diabetes and hypertension; additionally, GRACE risk score was an independent risk for in-hospital mortality , whereas in another study, after adjustment for age, risk of in-hospital mortality inflated by 3.5% every year of age. Additionally the odds of in-hospital mortality were higher in females as compared, while ACS patients with diabetes had worse outcomes .
The current study’s few drawbacks are that it was a single-center study based on a smaller sample size and the findings lack generalizability for non-tertiary care hospitals and distinct communities. Another drawback of any risk stratification is that it does not inherently accurately estimate the risk of individual person, although it differentiates well between different risk groups. In order to improve the adequacy of the results, prospective multi-center studies of a greater sample size should be carried out.
GRACE risk score has good predictive value for the prediction of in-hospital mortality and 6 months mortality among patients with NSTE-ACS. Hence, it is useful to include the GRACE scoring for ACS care reports. It might help in contributing to the assessment of therapy outcomes and care of patient.
Availability of data and materials
Data and material will be available upon request.
Acute coronary syndrome
Non-ST elevation acute coronary syndrome
Global Registry of Acute Coronary Events
Thrombolysis in myocardial infarction
Receiver operating characteristic
Area under the curve
Basit H, Malik A, Huecker MR (2020) Non ST segment elevation myocardial infarction. [Updated 2020 Oct 15]. In: StatPearls [Internet]. StatPearls Publishing, Treasure Island Available from: https://www.ncbi.nlm.nih.gov/books/NBK513228/
Zègre-Hemsey JK, Burke LA, DeVon HA (2018) Patient-reported symptoms improve prediction of acute coronary syndrome in the emergency department. Res Nurs Health 41(5):459–468
Amsterdam EA, Wenger NK, Brindis RG, Casey DE Jr, Ganiats TG, Holmes DR Jr, Jaffe AS, Jneid H, Kelly RF, Kontos MC, Levine GN, Liebson PR, Mukherjee D, Peterson ED, Sabatine MS, Smalling RW, Zieman SJ (2014) AHA/ACC guideline for the management of patients with non-ST-elevation acute coronary syndromes: executive summary: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. Circulation 130(25):2354–2394
Backus BE, Six AJ, Kelder JH, Gibler WB, Moll FL, Doevendans PA (2011) Risk scores for patients with chest pain: evaluation in the emergency department. Curr Cardiol Rev 7(1):2–8
Khalill R, Han L, Jing C, Quan H (2009) The use of risk scores for stratification of non-ST elevation acute coronary syndrome patients. Exp Clin Cardiol 14(2):e25–e30
Liaquat A, Javed Q (2018) Current trends of cardiovascular risk determinants in Pakistan. Cureus 10(10):e3409
Prabhudesai AR, Srilakshmi MA, Santosh MJ, Shetty GG, Varghese K, Patil CB, Iyengar SS (2012) Validation of the GRACE score for prognosis in Indian patients with acute coronary syndromes. Indian Heart J 64(3):263–269
Everett CC, Fox KA, Reynolds C, Fernandez C, Sharples L, Stocken DD, Carruthers K, Hemingway H, Yan AT, Goodman SG, Brieger D, Chew DP, Gale CP (2019) Evaluation of the impact of the GRACE risk score on the management and outcome of patients hospitalised with non-ST elevation acute coronary syndrome in the UK: protocol of the UKGRIS cluster-randomised registry-based trial. BMJ Open 9(9):e032165
Hall M, Bebb OJ, Dondo TB, Yan AT, Goodman SG, Bueno H, Chew DP, Brieger D, Batin PD, Farkouh ME, Hemingway H, Timmis A, Fox KAA, Gale CP (2018) Guideline-indicated treatments and diagnostics, GRACE risk score, and survival for non-ST elevation myocardial infarction. Eur Heart J 39(42):3798–3806
Simms AD, Reynolds S, Pieper K, Baxter PD, Cattle BA, Batin PD, Wilson JI, Deanfield JE, West RM, Fox KA, Hall AS, Gale CP (2013) Evaluation of the NICE mini-GRACE risk scores for acute myocardial infarction using the Myocardial Ischaemia National Audit Project (MINAP) 2003-2009: National Institute for Cardiovascular Outcomes Research (NICOR). Heart 99(1):35–40
Dondo TB, Hall M, Timmis AD, Gilthorpe MS, Alabas OA, Batin PD, Deanfield JE, Hemingway H, Gale CP (2017) Excess mortality and guideline-indicated care following non-ST-elevation myocardial infarction. Eur Heart J Acute Cardiovasc Care 6(5):412–420
Than MP, Flaws DF, Cullen L, Deely JM (2013) Cardiac risk stratification scoring systems for suspected acute coronary syndromes in the emergency department. Curr Emerg Hosp Med Rep 1(1):53–63
Shaikh MK, Hanif B, Shaikh K, Khan W, Parkash J (2014) Validation of Grace Risk Score in predicting in-hospital mortality in patients with non ST-elevation myocardial infarction and unstable angina. J Pak Med Assoc 64(7):807–811
Abu-Assi E, García-Acuña JM, Peña-Gil C, González-Juanatey JR (2010) Validation of the GRACE risk score for predicting death within 6 months of follow-up in a contemporary cohort of patients with acute coronary syndrome. Rev Esp Cardiol 63(6):640–648
Thalib L, Furuya-Kanamori L, AlHabib KF, Alfaleh HF, AlShamiri MQ, Amin H, Al Suwaidi J, Sulaiman K, Almahmeed W, Alsheikh-Ali AA, Al-Motarreb A, Doi SA (2017) Validation of the 6-month GRACE score in predicting 1-year mortality of patients with acute coronary syndrome admitted to the Arabian Gulf hospitals. Angiology 68(3):251–256
Bradshaw PJ, Ko DT, Newman AM, Donovan LR, Tu JV (2006) Validity of the GRACE (Global Registry of Acute Coronary Events) acute coronary syndrome prediction model for six month post-discharge death in an independent data set. Heart 92(7):905–909
Elbarouni B, Goodman SG, Yan RT, Welsh RC, Kornder JM, Deyoung JP, Wong GC, Rose B, Grondin FR, Gallo R, Tan M, Casanova A, Eagle KA, Yan AT (2009) Validation of the Global Registry of Acute Coronary Event (GRACE) risk score for in-hospital mortality in patients with acute coronary syndrome in Canada. Am Heart J 158(3):392–399
Granger CB, Goldberg RJ, Dabbous O, Pieper KS, Eagle KA, Cannon CP, Van de Werf F, Avezum Á, Goodman SG, Flather MD, Fox KAA, Investigators ftGRoACE (2003) Predictors of hospital mortality in the global registry of acute coronary events. Arch Intern Med 163(19):2345–2353
Shehab A, Al-Dabbagh B, Almahmeed W, Bustani N, Agrawal A, Yusufali A, Wassef A, Alnaeemi A, Alsheikh-Ali AA (2012) Characteristics, management, and in-hospital outcomes of diabetic patients with acute coronary syndrome in the United Arab Emirates. Sci World J 2012:698597
The authors wish to acknowledge the support of the staff members of the Clinical Research Department of the National Institute of Cardiovascular Diseases (NICVD) Karachi, Pakistan.
None to declare
Ethics approval and consent to participate
This study was approval by the ethical review committee of the National Institute of Cardiovascular Diseases (NICVD), Karachi (ERC-43/2019). Verbal informed consent was obtained from all the patients regarding their participation in the study and publication of data while maintaining confidentiality and anonymity. Due to observational nature of the study, ERC waived the written consent.
Consent for publication
All authors have no conflict of interest to disclose.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Kumar, D., Ashok, A., Saghir, T. et al. Prognostic value of GRACE score for in-hospital and 6 months outcomes after non-ST elevation acute coronary syndrome. Egypt Heart J 73, 22 (2021). https://doi.org/10.1186/s43044-021-00146-9