Skip to main content
  • Original Article
  • Open access
  • Published:

The effectiveness of coronary computed tomography angiography and functional testing for the diagnosis of obstructive coronary artery disease: results from the individual patient data Collaborative Meta-Analysis of Cardiac CT (COME-CCT)

Abstract

Aim

To determine the effectiveness of functional stress testing and computed tomography angiography (CTA) for diagnosis of obstructive coronary artery disease (CAD).

Methods and results

Two-thousand nine-hundred twenty symptomatic stable chest pain patients were included in the international Collaborative Meta-Analysis of Cardiac CT consortium to compare CTA with exercise electrocardiography (exercise-ECG) and single-photon emission computed tomography (SPECT) for diagnosis of CAD defined as ≥ 50% diameter stenosis by invasive coronary angiography (ICA) as reference standard. Generalised linear mixed models were used for calculating the diagnostic accuracy of each diagnostic test including non-diagnostic results as dependent variables in a logistic regression model with random intercepts and slopes. Covariates were the reference standard ICA, the type of diagnostic method, and their interactions. CTA showed significantly better diagnostic performance (p < 0.0001) with a sensitivity of 94.6% (95% CI 92.7–96) and a specificity of 76.3% (72.2–80) compared to exercise-ECG with 54.9% (47.9–61.7) and 60.9% (53.4–66.3), SPECT with 72.9% (65–79.6) and 44.9% (36.8–53.4), respectively. The positive predictive value of CTA was ≥ 50% in patients with a clinical pretest probability of 10% or more while this was the case for ECG and SPECT at pretest probabilities of ≥ 40 and 28%. CTA reliably excluded obstructive CAD with a post-test probability of below 15% in patients with a pretest probability of up to 74%.

Conclusion

In patients with stable chest pain, CTA is more effective than functional testing for the diagnosis as well as for reliable exclusion of obstructive CAD. CTA should become widely adopted in patients with intermediate pretest probability.

Systematic review registration

PROSPERO Database for Systematic Reviews—CRD42012002780.

Critical relevance statement

In symptomatic stable chest pain patients, coronary CTA is more effective than functional testing for diagnosis and reliable exclusion of obstructive CAD in intermediate pretest probability of CAD.

Key Points

  • Coronary computed tomography angiography showed significantly better diagnostic performance (p < 0.0001) for diagnosis of coronary artery disease compared to exercise-ECG and SPECT.

  • The positive predictive value of coronary computed tomography angiography was ≥ 50% in patients with a clinical pretest probability of at least 10%, for ECG ≥ 40%, and for SPECT 28%.

  • Coronary computed tomography angiography reliably excluded obstructive coronary artery disease with a post-test probability of below 15% in patients with a pretest probability of up to 74%.

Graphical Abstract

Introduction

Coronary computed tomography angiography (CTA) is increasingly used to diagnose coronary artery disease (CAD). Indeed, clinical guideline 95 of the National Institute for Health and Care Excellence with chest pain of recent onset recommends CTA as the first diagnostic test in all patients with possible angina [1]. Functional stress testing, including exercise electrocardiography (exercise-ECG) or single-photon emission computed tomography (SPECT), is recommended in uncertainty about whether chest pain is caused by myocardial ischaemia in patients with known CAD. In contrast, the recent ESC guideline on chronic coronary syndrome (CCS) recommends coronary CTA as the first-line diagnostic imaging test with a low pretest probability for CCS, whereas functional cardiac imaging is recommended in patients having a high pretest probability for CCS [2]. The ISCHEMIA trial showed that an invasive interventional strategy was not superior to a conservative strategy in patients with stable chest pain and test-based ischaemia [3].

Results of the SCOT-HEART trial showed a significant reduction of fatal and non-fatal myocardial infarction by CTA compared with diagnostic standard of care in patients with recent onset stable chest pain [4]. However, there is a lack of large diagnostic comparison studies of CTA for coronary stenosis evaluation with functional stress testing for ischaemia evaluation for the detection of obstructive CAD. Previous investigations have suggested that coronary CT may have higher sensitivity and specificity than functional stress testing for the detection of anatomically defined CAD with invasive coronary angiography (ICA) as the reference standard [5,6,7]. Within the Collaborative Meta-Analysis of Cardiac CT (COME-CCT) [8] of patients with symptomatic stable chest pain, we compared the effectiveness of functional stress testing using exercise-ECG or SPECT with CTA for diagnosis of CAD using ICA as the reference standard. Further, the association of non-invasive diagnostic tests and pretest probability was assessed for evaluation of the ability to exclude obstructive CAD.

Methods

Patients

Seven-thousand eight-hundred thirteen patients with stable chest pain and suspected CAD were included in the COME-CCT Consortium with a clinical indication for ICA, who were also prospectively enrolled to undergo cardiac CT. The study protocol of the COME-CCT collaborators was previously published including detailed information on search strategy, inclusion, and exclusion criteria for this individual patient data (IPD) data meta-analysis [8]. Patients with stents or bypasses, unstable angina, and non-diagnostic were excluded as well as patients with incomplete information for pretest probability calculation. Data was available on the per-patient level. The study was prospectively registered in the PROSPERO Database for Systematic Reviews (CRD42012002780). Obstructive CAD was defined as at least diameter stenosis of ≥ 50% by ICA with 81% of patients receiving quantitative coronary analysis (QCA). Specifically important for the present subgroup analysis, studies were excluded if datasets did not include results on either exercise-ECG or SPECT for at least 5% of the patients. All participants gave written informed consent to participate in the local studies, which were approved by the local ethics committees of the participating centres. For quality assessment and comparability, an additional questionnaire regarding exercise-ECG and SPECT was sent to all participating sites. For this subanalysis, for those studies eligible for inclusion, patients with data on functional testing were included, but studies with < 5% of patients receiving functional testing with regard to the site cohort were excluded from further analysis to avoid inclusion bias.

Statistical analysis

Raw datasets were merged in an Excel spreadsheet and exported as comma-separated values for statistical analysis using “R” [9]. Continuous data are reported as mean (standard deviation (SD)) and categorical variables as percentages (absolute numbers). Diagnostic accuracy of all tests using obstructive CAD defined by ICA as the reference standard was modelled using generalised linear mixed models (GLMM), i.e. multivariable logistic regression model with a study-specific random intercept to take heterogeneity between studies into account [10] by extending the method suggested by Coughlin et al with random effects, which provides a one-step approach for a diagnostic IPD meta-analysis [11]. The current model is a univariate logistic regression model extended by incorporating a random effect for the study and a random slope for ICA results, respectively, which is equivalent to a bivariate generalised linear mixed model [12]. Based on this model using the test result as the dependent variable, mean logit sensitivity and specificity, the estimates of the between-study variability in logit sensitivity and specificity, and the covariance between them were estimated. These estimates quantify heterogeneity between studies and patients within studies and investigate the effect of covariates such as type of diagnostic procedure. Covariates were: the reference standard ICA and the type of non-invasive diagnostic method and their interactions. Post-test probabilities (positive (PPVs) and negative predictive values (NPVs)) of the respective diagnostic procedures for the presence of CAD as a function of the pretest probability of CAD were analysed by a generalised linear mixed model as described above. In a similar way, models were applied when studies with a high risk of bias were analysed in a sensitivity analysis. In another analysis, we compared the diagnostic accuracy of CT in the 2920 patients from studies with functional tests performed with 2412 patients who were included in studies in which no functional tests were performed (Fig. 1) applying the covariate test performed (yes/no). Using an intention-to-diagnose approach, we implemented the worst-case scenario in which non-diagnostic CTA results were considered false positive if ICA was negative and false negative if ICA was positive [13]. Clinical pretest probability was calculated using a validated prediction tool, which was an updated version of the Diamond and Forrester model [14, 15]. Clinical pretest probability was estimated based on patient age, gender, and clinical presentation. We also performed a statistical prediction for a new cohort following the ideas presented by Skrondal and Rabe-Hasketh [16].

Fig. 1
figure 1

Flow chart for study selection. Part of the study flow referring to the COME-CCT main analysis paper as published by Haase et al [70]. In this subanalysis of the international COME-CCT Consortium, only patients with functional testing data were included, and studies for pooled analysis were only available if at least 5% of the patients of each of the 31 included studies received functional testing in order to avoid inclusion bias

Diagnostic performance was evaluated using a complete case analysis (basic generalised linear model) while the role of potential covariates was investigated using multiple imputations of missing data in patients who did not undergo functional test results in the original studies as a sensitivity analysis. Statistical analysis was performed with “R” (R-package lme4) [17]. For the reduction of missing data bias, multiple imputation was performed. Post-test probabilities were obtained with STATA 14 (packages GLLAMM, GLLAPRED). Cross-hair plots which show a scatter plot per-study sensitivity and false-positive rate with corresponding confidence intervals were produced with the R package mada [18, 19].

Results

Study characteristics

Pooled data on the per-patient level from 31 eligible studies with data from 2920 patients from 21 sites in 16 countries for analysis (Fig. 1) [5,6,7, 20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46]. Results of consensus reviewer judgments of the methodological quality of included studies regarding risk of bias and applicability can be found in the Appendix (Figs. 1 and 2). The risk of bias was high in eight studies and high applicability concerns were not present [7, 25, 30, 33, 37, 40, 41, 45]. Included participant data varied in size from 3 to 243 participants (mean (SD) of 91.2 (53.9)); 67% were male (Table 1). All patients included underwent clinically indicated ICA, (81% with QCA) as the reference standard for detection of obstructive CAD.

Fig. 2
figure 2

Analysis of diagnostic performance for CTA, Exercise-ECG, SPECT. The lines represent the positive and negative predictive values of CAD after a positive (solid lines) or negative (dashed lines) diagnostic test result for obstructive (obstructive) coronary artery disease defined as a patient with at least 50% coronary diameter stenosis. CTA was significantly more accurate than exercise-ECG and SPECT. Predictive values including 95% confidence intervals for all three tests are provided in Appendix Figs. 35

Table 1 Patient characteristics

Imaging test characteristics

Fifty-three percent of the patients had an additional exercise-ECG (1540/2920), 37% had no functional test (1066/2920) and 18% had an additional SPECT (532/2920). Approximately 7% of patients underwent all three non-invasive tests and ICA (218/2920). The study population had a high number of cardiovascular risk factors, with a cumulative of 0.2 (0.4) risk factors per patient (Table 1) while the average pretest probability was 47.9% (22.2%). The prevalence of obstructive CAD in the 31 eligible studies varied between 22 and 90% (Appendix Table 8) depending on the type of patients included as well as local patient selection for ICA and conduct of functional testing (Appendix Tables 5 and 6).

Effectiveness of CTA and functional testing for the diagnosis of obstructive CAD: individual-patient data analysis

For CTA, the sensitivity of 2072 patients with CT and functional test results in comparison to ICA as the reference standard in a generalised linear model was 94.6% (95% CI (92.7–96) and specificity was 76% (72.2–80) Table 2). The sensitivity of exercise-ECG was 54.9% (47.9–61.7) and specificity was 60.9% (55.2–66.3) while the sensitivity of SPECT was 72.9% (65–79.6) and specificity was 44.9% (36.7–54.4). Table 2 additionally shows all characteristics in 10%-steps of pretest probability. The sensitivity and specificity of CTA and functional stress testing differed significantly (p < 0.0001 for all, see Table 3). Excluding the eight studies with a high risk of bias Appendix Table 2) [7, 25, 30, 33, 37, 40, 41, 45] in a sensitivity analysis, results remained similar for all three tests (Fig. 3 and Appendix Table 11). When comparing the diagnostic accuracy of CTA in the 2920 patients included from 31 studies with functional tests performed with the 2412 patients who were included in studies without functional tests performed we found no differences indicating no relevant selection bias (Appendix Table 12).

Table 2 Diagnostic accuracy of CTA, exercise-ECG, and SPEC
Table 3 Overall statistical model without additional covariates
Fig. 3
figure 3

Similar diagnostic performance of CTA, Exercise-ECG, and SPECT after excluding studies with risk of bias. Similar diagnostic performance as shown in Fig. 2 after including all individual-patient data, is found in this analysis in which studies with a high risk of bias [7, 28, 33, 36, 40, 43, 44, 48] were excluded and only studies with low risk of bias were included (details on the risk of bias assessment is shown in Appendix Table 2)

There was better diagnostic differentiation using CTA compared with both exercise-ECG and SPECT (Fig. 2). Reliably excluding CAD with an NPV of 85% was possible in case of a negative CTA in patients presenting a pretest probability of up to 74% whereas negative exercise-ECG and SPECT excluded CAD only up to pretest probabilities of 7% and 11%, respectively (Fig. 2), with variability between studies (Table 3). Gender comparison showed similar results of women and men of CTA and functional tests in women and men (Appendix Tables 7, 9, 10).

Effectiveness of CTA and functional testing for the diagnosis of obstructive CAD: study-level analysis

On the study level, the sensitivity and specificity of CT, exercise-ECG, and SPECT are reported in Fig. 4. At a pretest probability of 10%, the positive predictive value (PPV) of CTA was 50.9% (95% CI 40.9–60.2) while the PPV of exercise-ECG was 19.1% (95% CI 12.8%–27.5%) and that of SPECT was 32.2 (95% CI 22.5–45.2). At a pretest probability of 74%, the NPV of CTA was 85.2% (95% CI 78.0–90.4) while the NPV of exercise-ECG was 41.9% (95% CI 32.5–0.50.6) and that of SPECT was 34.8% (95% CI 24.6–49.0).

Fig. 4
figure 4

Cross-hair comparison of CTA, Exercise-ECG, SPECT of per-study sensitivity, and false-positive rate. The lines represent 95% confidence intervals for sensitivity and false-positive rate based on the per-study data for CT, exercise-ECG, and SPECT. The per-study forest plots for all three tests and the results of all individual studies are also shown in Appendix Figs. 58

Multiple imputation analysis and covariates

Results of the multiple imputation analysis based on all 2920 patients (Appendix Table 7) revealed a significant influence of the covariates Agatston Score, heart rate, and chest pain on the specificity of CTA and functional test results with CTA outperforming SPECT and ECG in terms of sensitivity and specificity. Patients with an increased heart rate and higher Agatston Score with lower specificity using all diagnostic tests. The type of chest pain mainly influenced the specificity of all (functional and anatomical) diagnostic tests, which were best in patients with typical angina pectoris. Higher heart rates led to lower sensitivity of all tests. Models investigating test-specific effects of the covariates failed to converge so that only the overall influence of these covariates is reported.

Discussion

In this pooled analysis of patient-level data, we show that both the sensitivity, as well as specificity of coronary CTA, are higher than that of exercise-ECG and SPECT for the diagnostic assessment of CAD using ICA as the reference standard. The findings are not applicable to the detection of myocardial ischaemia, which was not included in the COME-CCT protocol. Across a wide range of clinical pretest probabilities, the diagnostic performance of CTA was better than that of functional stress testing. Results were consistent across populations from 21 different sites in 16 countries suggesting that the benefit of CTA is generalisable, and that CTA should be more widely adopted in patients with suspected CAD based on stable chest pain. This adds clear evidence to previous small studies that indicated CTA might outperform functional testing for the diagnosis of obstructive CAD [5,6,7]. Thus, CTA may provide a more solid basis for diagnostic and treatment decision-making. However, the broad inclusion for instance of all patients with atypical or typical angina pectoris might require revision as we have shown that reliably excluding obstructive CAD by CTA (NPV of at least 85%) works best up to a clinical pretest probability of 74%. Confirming obstructive CAD based on a positive CTA yields post-test probabilities of > 75% above clinical pretest probabilities of 39% which should be considered in the decision-making.

Comparison with previous studies

In a per-study-level meta-analysis of randomised trials, CTA compared with functional stress testing was associated with a reduced incidence of myocardial infarction [47]. This further supports the conclusions from the present IPD meta-analysis of diagnostic accuracy studies. In a network meta-analysis comparing CTA, SPECT, PET, and MRI on the per-study (not per-patient) level with ICA or fractional flow reserve (FFR) it was demonstrated that each diagnostic modality has its own optimal performance pretest probability [48]. For the choice between stress testing and coronary CTA, the ESC guideline recommends considering whether patients are suitable and if local expertise in one or the other diagnostic test is present. Nowadays local expertise is commonly present for both stress testing and CTA, while our study shows that if local expertise is available, coronary CTA should be considered as the primary test for the exclusion of obstructive CAD. Our results may help in choosing the most appropriate non-invasive test before proceeding to ICA potentially resulting in an increase of the reportedly lower diagnostic yield of invasive angiography [49]. Importantly, the ISCHEMIA trial suggests that an ischaemia detection strategy with subsequent invasive interventions may not result in improved outcomes [3]. The COME-CCT consortium used (quantitative) coronary angiography as the reference standard for the direct visualisation of coronary obstructions [8]. Considering the low uptake of invasive FFR worldwide [50], the pragmatic reference standard used in COME-CCT reflects clinical practice at the time of data collection.

In line with our results, previous results indicate that CT reduces false-positive rates compared with functional testing [51]. In contrast, compared to most previous publications, exercise-ECG and SPECT performed worse in the present study, while past meta-analyses and current guidelines report 61%–68% sensitivity and 70%–77% specificity for exercise-ECG and 73%–91% sensitivity and 48%-90% specificity for SPECT our analysis reveals a much lower diagnostic performance for the two tests, likely due to the selected population [52,53,54,55,56,57,58,59]. In the prospective multicentre PICTURE trial directly comparing SPECT and CTA with ICA with 50% lumen reduction for CAD detection as the reference standard, sensitivity was 92.0 versus 54.5% for CTA and SPECT, respectively, while specificity was 87.0% versus 78.3%. Applying a 70% lumen reduction threshold for the definition of significant CAD, CTA, and SPECT yielded similar results (sensitivity 92.6% versus 59.3% and specificity 88.9% versus 81.5%) [60]. In contrast, the COME-CCT protocol prespecified 50% coronary stenosis as the definition of obstructive CAD [8] similar to almost all studies available at the time of planning this IPD analysis [49]. Moreover, using a cut-off of 50% was assumed to not miss obstructive disease as defined [61]. Importantly, we found no evidence of selection bias in our cohort when comparing the diagnostic accuracy of CTA in the patients with and without available information on functional testing. Moreover, CTA as a non-invasive anatomical test holds an advantage regarding the evaluation of further imaging criteria, such as coronary plaque analysis, which plays an important role in further risk stratification and may be useful for the prediction of future cardiovascular events. Whereas functional tests have the advantage of functional and flow-relevant assessment of the coronary arteries.

Quality assurance and interpretation of results

To verify if exercise-ECG and SPECT were conducted according to quality standards, participating sites reported their protocols of functional tests (Appendix Tables 2 and 3). According to these data, all SPECT examinations and the majority of exercise-ECG examinations of CAD patients were done using standardised criteria [2, 52]. Thus, a likely reason for the lower diagnostic accuracy of functional stress testing compared with CTA is that these tests cannot directly visualise obstructive disease. However, in light of the ORBITA trial, a much more comprehensive strategy for the diagnosis of CAD that includes anatomic and functional criteria will be required to improve the selection of patients who benefit from the most aggressive treatment [53]. A second aspect, that may influence reported diagnostic accuracy, is verification bias [53]. The methodologically robust inclusion of all patients with functional testing and CT prior to the reference standard most likely reduced referral bias, which cannot be entirely avoided and has been reported to lead to erroneously high diagnostic sensitivity as shown by Ladapo and co-workers [54, 55]. The solid approach of comparing CT and functional testing with the reference standard ICA used in the current collaborative meta-analysis may thus explain especially the lower sensitivity for functional testing compared to reports that were influenced by referral bias. Moreover, the reference standard used for this comparison was also a morphological imaging test (invasive catheter angiography), similar to CT, which may also explain the low diagnostic accuracy of functional tests in this analysis. In addition to that evidence is missing whether functional tests using state-of-the-art technology provide better diagnostic accuracy as most of the mentioned studies were performed a SPECT generation ago. Magnetic resonance imaging, which has shown higher diagnostic accuracy than SPECT in the CE-MARC study [54], was only rarely done as cardiac stress in patients included in COME-CCT, thus intraindividual comparison was not performed. Our results are also supported by a recent study by Patel et al, demonstrating that performing CTA first leads to the highest diagnostic yield of ICA (70%) while using functional testing leads to a lower diagnostic yield (45%) [55]. Furthermore, functional stress tests have been shown not to improve discriminative ability [56]. With our results, we have also clearly shown the ability of CTA for the identification of patients with moderate-to-severe CAD. However, especially in this patient cohort these results do not necessarily prove or evaluate the possible reduction of unnecessary ICA, which should be addressed in future studies and analyses. In summary, the present work provides further evidence for the superior diagnostic accuracy of CTA compared to exercise-ECG and SPECT.

Moreover, the SCOT-HEART and the CRESCENT trial (Calcium imaging and selective CTA in comparison to functional testing for suspected CAD), both comparing CTA with functional cardiac tests, found a reduction in cardiac events for the CTA group after a median follow-up of 1.7 years or 1.2 years [4, 57, 58]. The improvement is likely due to the change in preventive therapy regimens through CTA, such as prescription of statins, aspirin and smoking cessation, especially in the large patient group with non-obstructive CAD [58]. Interestingly, a post-hoc analysis of the SCOT-HEART trial revealed an association of exercise-ECG with revascularisation procedures and future risk of adverse coronary events, but to a lower extent than CTA while CTA also offers information about undetected CAD and improves clinical decision-making [59].

Study limitations and strengths

Our meta-analysis had three major limitations. Fourteen studies including 1367 patients (47.8%) used CT scanners with less than 64 detector rows [5, 6, 24, 26, 30,31,32, 34, 35, 37, 39, 41,42,43, 45]. These studies contributed to the majority of the non-diagnostic test results, and because of the conservative approach that was used, this led to lower sensitivities and specificities for CTA. However, CTA still outperformed SPECT and exercise-ECG. Nowadays, the use of updated state-of-the-art technology with more than 64 detector-row CT scanners may increase diagnostic performance in general.

Assuming increased diagnostic accuracy, this would also most likely lead to improvement with less frequent non-diagnostic results and an overall reduction in radiation dose leading to more wider availability of CTA to further patients. Second, the use of obstructive CAD defined by the COME-CCT collaborators as the reference standard is not optimal for evaluating functional tests. The PACIFIC study demonstrated using FFR in ICA as a reference standard for detecting hemodynamically significant stenoses, CTA with a ≥ 50% lumen reduction as a cut-off for significant stenoses criterion performed worse than PET [62]. Yet, using obstructive CAD in ICA as the reference standard reflects clinical practice with a low adoption rate of below 10% of FFR during ICA [50]. The third limitation is the amount of missing data which was addressed by using multiple imputations for reduction of bias as described to be superior to complete case analysis even with large proportions of missing data [63, 64].

The major strength of this study is the IPD meta-analysis approach to diagnostic accuracy using GLMM, which has not been used before in comparing the diagnostic accuracy of CTA with SPECT and exercise-ECG and is generally rarely employed in diagnostic accuracy studies [65,66,67,68,69]. There was between-study heterogeneity for 1-specificity (intercept) and sensitivity. We assume that heterogeneity was most likely due to differences in the patient population. However, GLMM can account for some degree of heterogeneity when the study is introduced into the model as a random effect, as has been done in this IPD meta-analysis [65].

Conclusions

Coronary CTA improves the diagnostic assessment of patients with suspected obstructive CAD based on stable chest pain when compared with functional stress testing. Diagnostic benefits of CTA over cardiac stress testing are seen across a wide range of clinical pretest probabilities and CTA should become widely adopted in patients with intermediate pretest probability.

Data availability

The datasets used and/or analysed during the current study are available from the corresponding author upon reasonable request.

Abbreviations

CAD:

Coronary artery disease

CCS:

Chronic coronary syndrome

COME-CCT:

Collaborative Meta-Analysis of Cardiac CT

CTA:

Coronary computed tomography angiography

exercise-ECG:

Exercise electrocardiography

FFR:

Fractional flow reserve

ICA:

Invasive coronary angiography

IPD:

Individual patient data

NPV:

Negative predictive value

PPV:

Positive predictive value

QCA:

Quantitative coronary analysis

SD:

Standard deviation

SPECT:

Single-photon emission computed tomography

References

  1. Excellence NIfHaC (2016) Recent-onset chest pain of suspected cardiac origin: assessment and diagnosis. https://www.nice.org.uk/guidance/cg95. Accessed 16 Jan 2018

  2. Knuuti J, Wijns W, Saraste A et al (2020) 2019 ESC Guidelines for the diagnosis and management of chronic coronary syndromes. Eur Heart J 41:407–477

    Article  PubMed  Google Scholar 

  3. Maron DJ, Hochman JS, Reynolds HR et al (2020) Initial invasive or conservative strategy for stable coronary disease. N Engl J Med 382:1395–1407

    Article  PubMed  PubMed Central  Google Scholar 

  4. investigators S-H (2015) CT coronary angiography in patients with suspected angina due to coronary heart disease (SCOTHEART): an open-label, parallel-group, multicentre trial. Lancet 385:2383–2391

    Article  Google Scholar 

  5. Ovrehus KA, Jensen JK, Mickley HF et al (2010) Comparison of usefulness of exercise testing versus coronary computed tomographic angiography for evaluation of patients suspected of having coronary artery disease. Am J Cardiol 105:773–779

    Article  PubMed  Google Scholar 

  6. Pontone G, Andreini D, Ballerini G et al (2007) Diagnostic work-up of unselected patients with suspected coronary artery disease: complementary role of multidetector computed tomography, symptoms and electrocardiogram stress test. Coron Artery Dis 18:265–274

    Article  PubMed  Google Scholar 

  7. Sato A, Nozato T, Hikita H et al (2010) Incremental value of combining 64-slice computed tomography angiography with stress nuclear myocardial perfusion imaging to improve noninvasive detection of coronary artery disease. J Nucl Cardiol 17:19–26

    Article  PubMed  Google Scholar 

  8. Schuetz GM, Schlattmann P, Achenbach S et al (2013) Individual patient data meta-analysis for the clinical assessment of coronary computed tomography angiography: protocol of the Collaborative Meta-Analysis of Cardiac CT (CoMe-CCT). Syst Rev 2:13

    Article  PubMed  PubMed Central  Google Scholar 

  9. R Core Team (2016) R: A language and environment for statistical computing. R Foundation for Statistical Computing. Vienna, Austria. Available from: http://www.R-project.org/

  10. Brown H, Prescott R (2015) Applied mixed models in medicine. John Wiley & Sons, Ltd.

  11. Coughlin SS, Trock B, Criqui MH et al (1992) The logistic modeling of sensitivity, specificity, and predictive value of a diagnostic test. J Clin Epidemiol 45:1–7

    Article  CAS  PubMed  Google Scholar 

  12. Simmonds MC, Higgins JP (2016) A general framework for the use of logistic regression models in meta-analysis. Stat Methods Med Res 25:2858–2877

    Article  PubMed  Google Scholar 

  13. Schuetz GM, Schlattmann P, Dewey M (2012) Use of 3x2 tables with an intention to diagnose approach to assess clinical performance of diagnostic tests: meta-analytical evaluation of coronary CT angiography studies. BMJ 345:e6717

    Article  PubMed  PubMed Central  Google Scholar 

  14. Diamond GA, Forrester JS (1979) Analysis of probability as an aid in the clinical diagnosis of coronary-artery disease. N Engl J Med 300:1350–1358

    Article  CAS  PubMed  Google Scholar 

  15. Genders TS, Steyerberg EW, Alkadhi H et al (2011) A clinical prediction rule for the diagnosis of coronary artery disease: validation, updating, and extension. Eur Heart J 32:1316–1330

  16. Skrondal A, Rabe-Hesketh S (2009) Prediction in multilevel generalized linear models. J R Statist Soc A 2009:659–687

    Article  Google Scholar 

  17. Bates D, Maechler M, Bolker B, Walker S (2014) lme4: linear mixed-effects models using Eigen and S4. R package version 1.1-7. Available from: http://CRAN.R-roject.org/package=lme4

  18. Phillips B, Stewart LA, Sutton AJ (2010) Cross hairs’ plots for diagnostic meta-analysis. Res Synth Methods 1:308–315

    Article  PubMed  Google Scholar 

  19. Doebler P (2020) Meta-analysis of diagnostic accuracy with mada. https://cran.r-project.org/web/packages/mada/index.html. Accessed 21 Oct 2020

  20. Alkadhi H, Scheffel H, Desbiolles L et al (2008) Dual-source computed tomography coronary angiography: influence of obesity, calcium load, and heart rate on diagnostic accuracy. Eur Heart J 29:766–776

    Article  PubMed  Google Scholar 

  21. Alkadhi H, Stolzmann P, Desbiolles L et al (2010) Low-dose, 128-slice, dual-source CT coronary angiography: accuracy and radiation dose of the high-pitch and the step-and-shoot mode. Heart 96:933–938.

    Article  PubMed  Google Scholar 

  22. Andreini D, Pontone G, Bartorelli AL et al (2010) Comparison of the diagnostic performance of 64-slice computed tomography coronary angiography in diabetic and non-diabetic patients with suspected coronary artery disease. Cardiovasc Diabetol 9:80

    Article  PubMed  PubMed Central  Google Scholar 

  23. Andreini D, Pontone G, Bartorelli AL et al (2009) Sixty-four-slice multidetector computed tomography: an accurate imaging modality for the evaluation of coronary arteries in dilated cardiomyopathy of unknown etiology. Circ Cardiovasc Imaging 2:199–205

    Article  PubMed  Google Scholar 

  24. Andreini D, Pontone G, Pepi M et al (2007) Diagnostic accuracy of multidetector computed tomography coronary angiography in patients with dilated cardiomyopathy. J Am Coll Cardiol 49:2044–2050

    Article  PubMed  Google Scholar 

  25. Chen CC, Chen CC, Hsieh I-C et al (2011) The effect of calcium score on the diagnostic accuracy of coronary computed tomography angiography. Int J Cardiovasc Imaging 27:37–42

    Article  PubMed  Google Scholar 

  26. Dewey M, Teige F, Schnapauff D et al (2006) Noninvasive detection of coronary artery stenoses with multislice computed tomography or magnetic resonance imaging. Ann Intern Med 145:407–415

    Article  PubMed  Google Scholar 

  27. Dewey M, Zimmermann E, Deissenrieder F et al (2009) Noninvasive coronary angiography by 320-row computed tomography with lower radiation exposure and maintained diagnostic accuracy: comparison of results with cardiac catheterization in a head-to-head pilot investigation. Circulation 120:867–875

    Article  PubMed  Google Scholar 

  28. Ghostine S, Caussin C, Daoud B et al (2006) Non-invasive detection of coronary artery disease in patients with left bundle branch block using 64-slice computed tomography. J Am Coll Cardiol 48:1929–1934

    Article  PubMed  Google Scholar 

  29. Halvorsen B, Rødevand O, Hagen G et al (2008) [Angiography with 64-channel CT upon suspicion of stable coronary disease]. Tidsskr Nor Laegeforen 128:2172–2176

    PubMed  Google Scholar 

  30. Hamdan A, Asbach P, Wellnhofer E et al (2011) A prospective study for comparison of MR and CT imaging for detection of coronary artery stenosis. JACC Cardiovasc Imaging 4:50–61

    Article  PubMed  Google Scholar 

  31. Hausleiter J, Meyer T, Hadamitzky M et al (2007) Non-invasive coronary computed tomographic angiography for patients with suspected coronary artery disease: the Coronary Angiography by Computed Tomography with the Use of a Submillimeter resolution (CACTUS) trial. Eur Heart J 28:3034–3041

    Article  PubMed  Google Scholar 

  32. Jenkins SM, Johnston N, Hawkins NM et al (2011) Limited clinical utility of CT coronary angiography in a district hospital setting. QJM 104:49–57

    Article  CAS  PubMed  Google Scholar 

  33. Kajander S, Joutsiniemi E, Saraste M et al (2010) Cardiac positron emission tomography/computed tomography imaging accurately detects anatomically and functionally significant coronary artery disease. Circulation 122:603–613

    Article  CAS  PubMed  Google Scholar 

  34. Kefer J, Coche E, Legros G et al (2005) Head-to-head comparison of three-dimensional navigator-gated magnetic resonance imaging and 16-slice computed tomography to detect coronary artery stenosis in patients. J Am Coll Cardiol 46:92–100

    Article  PubMed  Google Scholar 

  35. Langer C, Peterschroder A, Franzke K et al (2009) Noninvasive coronary angiography focusing on calcification: multislice computed tomography compared with magnetic resonance imaging. J Comput Assist Tomogr 33:179–185

    Article  PubMed  Google Scholar 

  36. Leschka S, Scheffel H, Desbiolles L et al (2008) Combining dual-source computed tomography coronary angiography and calcium scoring: added value for the assessment of coronary artery disease. Heart 94:1154–1161

    Article  CAS  PubMed  Google Scholar 

  37. Martuscelli E, Romagnoli A, D’Eliseo A et al (2004) Accuracy of thin-slice computed tomography in the detection of coronary stenoses. Eur heart J 25:1043–1048

    Article  PubMed  Google Scholar 

  38. Meijboom WB, Meijs MF, Schuijf JD et al (2008) Diagnostic accuracy of 64-slice computed tomography coronary angiography: a prospective, multicenter, multivendor study. J Am Coll Cardiol 52:2135–2144

    Article  PubMed  Google Scholar 

  39. Mendoza-Rodríguez V, Llerena L, Llerena L et al (2009) Ischemic heart disease diagnosed by 64 slice computed tomography coronary angiography. Int J Cardiol 7 https://ispub.com/IJC/7/2/7595

  40. Pontone G, Andreini D, Bartorelli AL et al (2009) Diagnostic accuracy of coronary computed tomography angiography: a comparison between prospective and retrospective electrocardiogram triggering. J Am Coll Cardiol 54:346–355

    Article  PubMed  Google Scholar 

  41. Pontone G, Andreini D, Quaglia C et al (2007) Accuracy of multidetector spiral computed tomography in detecting significant coronary stenosis in patient populations with differing pre-test probabilities of disease. Clin Radiol 62:978–985

    Article  CAS  PubMed  Google Scholar 

  42. Pouleur A-C, De Waroux J-bLP, Kefer J et al (2007) Usefulness of 40-slice multidetector row computed tomography to detect coronary disease in patients prior to cardiac valve surgery. Eur Radiol 17:3199–3207.

    Article  PubMed  Google Scholar 

  43. Pouleur AC, le Polain de Waroux JB, Kefer J et al (2008) Direct comparison of whole-heart navigator-gated magnetic resonance coronary angiography and 40- and 64-slice multidetector row computed tomography to detect the coronary artery stenosis in patients scheduled for conventional coronary angiography. Circ Cardiovasc Imaging 1:114–121

    Article  PubMed  Google Scholar 

  44. Rixe J, Rolf A, Conradi G et al (2009) Detection of relevant coronary artery disease using dual-source computed tomography in a high probability patient series comparison with invasive angiography. Circ J 73:316–322

    Article  PubMed  Google Scholar 

  45. Shabestari AA, Abdi S, Akhlaghpoor S et al (2007) Diagnostic performance of 64-channel multislice computed tomography in assessment of significant coronary artery disease in symptomatic subjects. Am J Cardiol 99:1656–1661

    Article  PubMed  Google Scholar 

  46. Ugolini P, Pressacco J, Lespérance J et al (2009) Evaluation of coronary atheroma by 64-slice multidetector computed tomography: comparison with intravascular ultrasound and angiography. Can J Cardiol 25:641–647

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  47. Foy AJ, Dhruva SS, Peterson B et al (2017) Coronary computed tomography angiography vs functional stress testing for patients with suspected coronary artery disease: a systematic review and meta-analysis. JAMA Intern Med 177:1623–1631

    Article  PubMed  PubMed Central  Google Scholar 

  48. Knuuti J, Ballo H, Juarez-Orozco LE et al (2018) The performance of non-invasive tests to rule-in and rule-out significant coronary artery stenosis in patients with stable angina: a meta-analysis focused on post-test disease probability. Eur Heart J 39:3322–3330

    Article  PubMed  Google Scholar 

  49. Schuetz GM, Zacharopoulou NM, Schlattmann P et al (2010) Meta-analysis: noninvasive coronary angiography using computed tomography versus magnetic resonance imaging. Ann Intern Med 152:167–177

    Article  PubMed  Google Scholar 

  50. Gotberg M, Cook CM, Sen S et al (2017) The evolving future of instantaneous wave-free ratio and fractional flow reserve. J Am Coll Cardiol 70:1379–1402

    Article  PubMed  Google Scholar 

  51. Tandon V, Hall D, Yam Y et al (2012) Rates of downstream invasive coronary angiography and revascularization: computed tomographic coronary angiography vs. Tc-99m single photon emission computed tomography. Eur Heart J 33:776–782

    Article  CAS  PubMed  Google Scholar 

  52. Hill J, Timmis A (2002) Exercise tolerance testing. BMJ 324:1084–1087

    Article  PubMed  PubMed Central  Google Scholar 

  53. Al-Lamee R, Thompson D, Dehbi HM et al (2018) Percutaneous coronary intervention in stable angina (ORBITA): a double-blind, randomised controlled trial. Lancet 391:31–40

    Article  PubMed  Google Scholar 

  54. Greenwood JP, Maredia N, Younger JF et al (2012) Cardiovascular magnetic resonance and single-photon emission computed tomography for diagnosis of coronary heart disease (CE-MARC): a prospective trial. Lancet 379:453–460

    Article  PubMed  PubMed Central  Google Scholar 

  55. Patel MR, Dai D, Hernandez AF et al (2014) Prevalence and predictors of nonobstructive coronary artery disease identified with coronary angiography in contemporary clinical practice. Am Heart J 167:846–52 e2

    Article  PubMed  Google Scholar 

  56. Sorgaard M, Linde JJ, Kofoed KF et al (2016) Diagnostic value of the updated Diamond and Forrester Score to predict coronary artery disease in patients with acute-onset chest pain. Cardiology 133:10–17

    Article  PubMed  Google Scholar 

  57. Lubbers M, Dedic A, Coenen A et al (2016) Calcium imaging and selective computed tomography angiography in comparison to functional testing for suspected coronary artery disease: the multicentre, randomized CRESCENT trial. Eur Heart J 37:1232–1243

    Article  PubMed  Google Scholar 

  58. Williams MC, Hunter A, Shah ASV et al (2016) Use of coronary computed tomographic angiography to guide management of patients with coronary disease. J Am Coll Cardiol 67:1759–1768

    Article  PubMed  PubMed Central  Google Scholar 

  59. Singh T, Bing R, Dweck MR et al (2020) Exercise electrocardiography and computed tomography coronary angiography for patients with suspected stable angina pectoris: a post hoc analysis of the randomized SCOT-HEART trial. JAMA Cardiol 5:920–928

    Article  PubMed  Google Scholar 

  60. Budoff MJ, Li D, Kazerooni EA et al (2017) Diagnostic accuracy of noninvasive 64-row computed tomographic coronary angiography (CCTA) compared with myocardial perfusion imaging (MPI): the PICTURE study, a prospective multicenter trial. Acad Radiol 24:22–29

    Article  PubMed  Google Scholar 

  61. Dreyer RP, Tavella R, Curtis JP et al (2020) Myocardial infarction with non-obstructive coronary arteries as compared with myocardial infarction and obstructive coronary disease: outcomes in a Medicare population. Eur Heart J 41:870–878

    Article  PubMed  Google Scholar 

  62. Danad I, Raijmakers PG, Driessen RS et al (2017) Comparison of coronary CT angiography, SPECT, PET, and hybrid imaging for diagnosis of ischemic heart disease determined by fractional flow reserve. JAMA Cardiol 2:1100–1107.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Mukaka M, White SA, Terlouw DJ et al (2016) Is using multiple imputation better than complete case analysis for estimating a prevalence (risk) difference in randomized controlled trials when binary outcome observations are missing? Trials 17:341

    Article  PubMed  PubMed Central  Google Scholar 

  64. Lee JH, Huber JC Jr (2011) Multiple imputation with large proportions of missing data: How much is too much? United Kingdom Stata Users’ Group Meetings 2011. Stata Users Group

  65. Debray TP, Moons KG, van Valkenhoef G et al (2015) Get real in individual participant data (IPD) meta-analysis: a review of the methodology. Res Synth Methods 6:293–309

    Article  PubMed  PubMed Central  Google Scholar 

  66. Debray TP, Riley RD, Rovers MM et al (2015) Individual participant data (IPD) meta-analyses of diagnostic and prognostic modeling studies: guidance on their use. PLoS Med 12:e1001886

    Article  PubMed  PubMed Central  Google Scholar 

  67. Khan KS, Bachmann LM, ter Riet G et al (2003) Systematic reviews with individual patient data meta-analysis to evaluate diagnostic tests. Eur J Obstet Gynecol Reprod Biol 108:121–125

    Article  PubMed  Google Scholar 

  68. Simmonds MC, Higgins JP, Stewart LA et al (2005) Meta-analysis of individual patient data from randomized trials: a review of methods used in practice. Clin Trials 2:209–217

    Article  PubMed  Google Scholar 

  69. van Es N, van der Hulle T, van Es J et al (2016) Wells rule and d-dimer testing to rule out pulmonary embolism: a systematic review and individual-patient data meta-analysis. Ann Intern Med 165:253–261

    Article  PubMed  Google Scholar 

  70. Haase R, Schlattmann P, Gueret P et al (2019) Diagnosis of obstructive coronary artery disease using computed tomography angiography in patients with stable chest pain depending on clinical probability and in clinically important subgroups: metaanalysis of individual patient data. BMJ 365:l1945

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We want to thank all participating COME-CCT investigators.

Funding

The funding source of the COME-CCT collaboration is the German Federal Ministry of Education and Research (BMBF, 01KG1110) for meta-analyses as part of the joint programme ‘clinical trials’ of the BMBF and the German Research Foundation (DFG). BMBF and DFG had no role in the design, conduct, analysis, or reporting of this study. The corresponding author had full access to all the data. The steering committee had responsibility for the decision to submit for publication. Open Access funding enabled and organized by Projekt DEAL.

Author information

Authors and Affiliations

Authors

Contributions

P.S. and M.D. conceived the COME-CCT collaboration and this study. G.M.S., V.W., and R.H. performed data collection and quality assurance. P.S., V.W., K.B., T.G., R.H., and M.D. prepared the first draft of the report. P.S., K.B., and T.G. performed statistical analyses and drafted the figures. P.S., K.B., G.M.S., V.W., R.H., and M.D. participated in data analysis and interpretation. M.D. provided administrative support and is the coordinator of the COME-CCT collaboration. All authors participated in patient enrolment, critically reviewed the manuscript, and approved the final version.

Corresponding author

Correspondence to Marc Dewey.

Ethics declarations

Ethics approval and consent to participate

All participants gave written informed consent to participate in the local studies which were approved by the local ethics committees of the participating centres.

Competing interests

P.S. and M.D. had support from the joint programme of the German Research Foundation and the German Federal Ministry of Education and Research for the submitted work; P.S. has support from the German Research Foundation, grants from the European Union and grants from Bayer Pharma AG; V.W. reports grant support from the FP7 Program of the European Commission for the randomised multicenter DISCHARGE trial (603266-2, HEALTH-2012.2.4.-2). GMS reports grants from the German Federal Ministry of Education and Research (BMBF), during the conduct of the study; G.P. reports grants from General Electric and is on the speakers bureau for Medtronic and Bracco; J.H. is on the speakers bureau for Abbott Vascular and Edwards Life Sciences; B.G. reports that the Cliniques St Luc UCL holds a master research agreement with Philips Medical Systems; A.S. reports personal fees from General Electric and Toshiba; J.K. reports grants from CardiRad and personal fees from GE Healthcare; M.D. has received grant support from the FP7 Program of the European Commission for the randomised multicenter DISCHARGE trial (603266-2, HEALTH-2012.2.4.-2). He also received grant support from the German Research Foundation (DFG) in the Heisenberg Program (DE 1361/14-1), a graduate program on quantitative biomedical imaging (BIOQIC, GRK 2260/1), for fractal analysis of myocardial perfusion (DE 1361/18-1), the Priority Programme Radiomics for the investigation of coronary plaque and coronary flow (DE 1361/19-1 (428222922) and 20-1 (428223139) in SPP 2177/1). He also received funding from the Berlin University Alliance (GC_SC_PC 27) and from the Digital Health Accelerator of the Berlin Institute of Health. Prof. Dewey has received lecture fees from Canon, Guerbet. Prof. Dewey is the European Society of Radiology (ESR) Research Chair (2019–2022) and the opinions expressed in this article are the author’s own and do not represent the view of ESR. Per the guiding principles of ESR, the work as Research Chair is on a voluntary basis and only remuneration of travel expenses occurs. Prof. Dewey is also the editor of Cardiac CT, published by Springer Nature, and offers hands-on courses on CT imaging (www.ct-kurs.de). Institutional master research agreements exist with Siemens, General Electric, Philips, and Canon. The terms of these arrangements are managed by the legal department of Charité—Universitätsmedizin Berlin. Professor Dewey holds a joint patent with Florian Michallek on dynamic perfusion analysis using fractal analysis (PCT/EP2016/071551). K.K.B., T.G., D.A., H.A., E.Z., A.A.S., M.F.L.M., K.A.O., S.M.M.J., A.H., B.A.H., V.M.-R., J.R., Y.-L.W., C.L., S.L., E.M., S.G., J.-C.T., A.R.S., R.H. have nothing to disclose.

Consent for publication

Not applicable.

Additional information

Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schlattmann, P., Wieske, V., Bressem, K.K. et al. The effectiveness of coronary computed tomography angiography and functional testing for the diagnosis of obstructive coronary artery disease: results from the individual patient data Collaborative Meta-Analysis of Cardiac CT (COME-CCT). Insights Imaging 15, 208 (2024). https://doi.org/10.1186/s13244-024-01702-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13244-024-01702-y

Keywords