Skip to main content
Insights into Imaging
Download PDF

Mandatory adherence to diagnostic protocol increases the yield of CTPA for pulmonary embolism

Insights into Imaging volume 7, pages 727–734 (2016)Cite this article

Abstract

Objectives

To determine if mandatory adherence to a diagnostic protocol increases the rate of computed tomography pulmonary angiographies (CTPAs) positive for pulmonary embolism (PE)—the so-called diagnostic yield. Further, we aim to identify factors associated with this diagnostic yield.

Methods

We included all patients with suspected PE requiring CTPA from 9 January 2014 t0 3 June 2014. The requesting physicians were forced to follow diagnostic workup for PE by calculating a Wells score and, if necessary, determining D-dimer level. The percentage of positive CTPA scans was calculated and compared with our previous cohort (Walen et al. Insights Imaging 2014;5(2):231–236). Odds ratios were calculated as a measure of association between dichotomous variables and CTPA findings.

Results

Of 250 scans, 74 were positive (29.6 % [95 % CI, 24.3-35.5 %]) and 175 were negative (70 %). The percentage positive scans increased with 6.6 % and the percentage negative scans decreased with 3.1 %. This change was statistically significant (p = 0.001). Independent clinical predictors of diagnostic yield were previous deep venous thrombosis (DVT) (OR, 3.22; p = 0.013) and clinical signs of DVT (OR, 2.71; p = 0.012). Chronic obstructive pulmonary disease (COPD) was negatively associated with PE (OR, 0.33; p = 0.045).

Conclusions

This study shows that mandatory adherence to a diagnostic protocol increases the yield of CTPA for PE in our centre.

Main Messages

• Mandatory adherence to diagnostic protocol increases the yield of CTPA for PE

• Previous DVT and signs of DVT were associated with a higher yield

• No patients with a low Wells score and a low D-dimer had PE

Introduction

Computed tomography pulmonary angiography (CTPA) is widely used for confirming the diagnosis of pulmonary embolism (PE). With a sensitivity between 60 and 100 % and a specificity between 81 and 98 %, it has replaced pulmonary angiography as the diagnostic reference standard [1–4]. Although effective, CT scanning exposes patients to ionising radiation. Furthermore, administration of intravenous radiocontrast can lead to acute kidney injury, especially in high-risk patients. Therefore, first an assessment of clinical probability should be made to determine the likelihood of being able to confirm the diagnosis of PE by imaging. The most commonly used method to predict pre-test probability is using the Wells algorithm [5]. First, a Wells score should be calculated to determine the clinical probability. Secondly, either the Wells score is high (a score of more than four points) and a CTPA should be performed or, if the Wells score is low (four points or less), the D-dimer level should be assessed. Thirdly, a high D-dimer level (≥0.5 μg/mL) also dictates performing CTPA. This diagnostic management strategy was prospectively validated in a large Dutch cohort and has proved effective and safe [6]. However, implementation in daily practice seems to be difficult. A previous study conducted in our teaching hospital in The Netherlands showed poor documented adherence to diagnostic protocol [7]. As an example, Wells scores, which should be calculated for every patient suspected of PE, were only reported in 13 % of cases. We hypothesised that better protocol adherence would lead to a higher rate of CTPA positive for PE—the so-called diagnostic yield. Therefore, we conducted our current study, in which we aimed to improve diagnostic yield of CTPA by forcing doctors to write down their clinical observations, Wells score and D-dimer on the request form. Our further objective was to find clinical factors associated with diagnostic yield.

Materials and methods

In this prospective observational study, all patients with suspected PE requiring a CTPA scan in the period from 9 January 2014 to 3 June 2014 were included. Approval of the local ethics committee was received. All data were acquired using a Philips 256-slice Brilliance iCT or 128-slice Ingenuity CT scanner (Philips Healthcare, Best, The Netherlands). Peak voltage was 100 kV with an exposure of 250 mAs per slice. Slice thickness was 0.625 mm for both scanners. Tube rotation time was 0.5 for the 128-slice scanner and 0.4 for the 256-slice scanner with a pitch of 0.798 and 0.696, respectively. The scans were reconstructed with a soft tissue filter (filter B) containing a window width (WW) of 150 and a window level (WL) of 90. To display the pulmonary arteries, 60-75 mL intravenous contrast fluid (Optiray™ 350) was administered with a flow of 4.0–5.0 mL/s. The pulmonary arteries were scanned in the early arterial phase, triggered on the arrival of contrast fluid in the main pulmonary artery with a threshold of HU >150 to start the scan. We used iDose (variable levels) for iterative image reconstruction. Every CTPA scan was read double-blinded by two experienced radiologists with an expertise in chest imaging. When there was a difference in interpretation consensus was sought. When the quality of the scan was so low that it could not be stated whether there was a pulmonary embolism or not, a scan was called undiagnostic. As an intervention every physician in our hospital requesting a CTPA for pulmonary embolism was asked to document Wells-scores on the request form and—if available—to document D-dimer. Special templates of the request form with a pre-printed Wells scoring table were distributed among requesting physicians. When the required information was lacking on the request forms our diagnostic radiographers urged the requesting doctor to provide the necessary clinical data. However, no scans were refused. If a scan was nevertheless performed without the clinical data documented on the request form, the scores were retrospectively obtained. Electronic and paper medical files were searched for clinical characteristics and relevant medical history. We compared the patient data in our current study with patient data in our previous, 2011 cohort [7].

Data are summarised in tables and graphs. Categorical data are presented as n (%), and tested using the Fisher’s exact test. Confidence intervals were calculated for dichotomous variables [25]. Continuous data were tested for normality using the Shapiro-Wilk test, in addition with plots. Continuous and ordinal data are presented as median (1st–3rd quartile), and were tested using the Mann-Whitney U test. Univariate and multivariable logistic regression analysis was used for finding associates of CTPA-diagnosed pulmonary embolism. In addition, diagnostic indices were calculated and receiver operating characteristic (ROC) analysis was performed. Our present study was compared to our previous study by means of multivariable logistic regression analysis with ‘CTPA outcome’ as dependent variable, and ‘study’ with potential confounders as independent variables. All tests and confidence intervals were performed two-tailed, using alpha 5 % as significance level.

Results

Study population and CTPA scans

A total of 250 patients underwent CTPA scanning in our hospital. Of 250 scans, 74 were positive (29.6 % [95 % CI, 24.3-35.5 %]), 1 was undiagnostic (0.4 %) and 175 were negative (70 %). Tables 1 and 2 show patient characteristics and a subgroup comparison of patients with a positive versus a negative scan. In summary, age, history of deep venous thrombosis (DVT), signs of DVT, Wells score and D-dimer were significantly different between patients with a positive scan versus patients with a negative scan. Chronic obstructive pulmonary disease (COPD), Wells category and groundglass appearance were borderline significantly (p < 0.1) different between patients with a positive scan versus patients with a negative scan. Table 3 shows univariate and multivariable logistic regression analysis for associates of positive CTPA scan. In summary, history of DVT, signs of DVT, Wells score and Wells category were positively associated with CTPA-diagnosed pulmonary embolism; whereas COPD was negatively associated with CTPA-diagnosed pulmonary embolism. Both age and groundglass appearance were borderline (p < 0.1) positively associated with CTPA-diagnosed pulmonary embolism.

Table 1 Patient characteristics and subgroup comparison of patients with a positive CTPA versus a negative CTPA scan
Full size table
Table 2 Pulmonary embolism by Wells category and D-dimer category
Full size table
Table 3 Logistic regression analysis for associates of CTPA-diagnosed pulmonary embolism
Full size table

Diagnostic accuracy

Table 4 shows sensitivity and specificity of Wells category, D-dimer category, history of DVT and signs of DVT. In an attempt to improve diagnostic accuracy, several multivariable models were examined. Diagnostic accuracy of Wells score compared with the multivariable models is visualised using ROC analysis, as shown in Fig. 1.

Table 4 Diagnostic accuracy
Full size table
Fig. 1
figure 1

Diagnostic accuracy of Wells score and models

Full size image

Comparison with previous results

Table 5 shows the change in CTPA scan findings (raw data) compared to our previous study (Walen et al. [7]). The percentage of positive scans has increased with 6.6 %, the percentage of undiagnostic scans has decreased with 3.5 %, and the percentage of negative scans has decreased with 3.1 %. This change was statistically significant (p = 0.001). When ignoring undiagnostic scans, there was a borderline (p < 0.1) significant increase in positive scans (p = 0.070). We compared both study populations in order to find potential confounders. We looked at a difference in origin of patients (ER, hospital or outpatient) and compared the clinical variables that were associated with CTPA outcome in either the current multivariable analysis and/or the analysis of our first cohort, notably sex, age (positive), COPD (negative), cardiac history (negative) and dyspnoea (positive). A comparison of origins of patients revealed a significant difference (ER, 72 % vs 62 %; hospital, 22.5 % vs 34 %; outpatient clinic, 4.9 % vs 3.2 %) for the previous and the present study respectively (p < 0.001). A comparison of age revealed a significant difference (median 66 years vs 64 years) for the previous and the present study respectively (p = 0.022). A comparison of cardiac history revealed a significant difference of 26 % vs 8 % for the previous study and the present study respectively (p < 0.001). Logistic regression analysis with CTPA-outcome as dependent variable and study as independent variable, using the previous study as reference, revealed a borderline significant p value (0.062). Adjustment of study for origin improved this p value to 0.056. Adjustment of study for age improved this p value to p = 0.043. Adjustment of study for both origin and age improved this p value to 0.036. However, adjustment of study for cardiac history deteriorated this p value to p = 0.153. Adjustment of study for origin, age and cardiac history, resulted in a non-significant adjusted p value (0.113), with an adjusted odds ratio of 1.298 and 95% CI of 0.940–1.791]).

Table 5 Change in CTPA scan findings
Full size table

Discussion

There is ample evidence supporting the use of pre-test probability rules to help decide if a CTPA should be ordered in a patient in whom PE is suspected. Of these, the Wells score is arguably the most commonly used [5, 6]. However, numerous studies have shown that protocol adherence in clinical practice is poor [7–9]. The objective of this study was to investigate if we could increase diagnostic yield of CTPA for pulmonary embolism by influencing the behaviour of requesting physicians. As an intervention, we forced doctors to write down Wells scores and, if available, the D-dimer on the CTPA request form for all patients they suspected of PE. We used our 2011 cohort with a total diagnostic yield of 23.0 % as a reference standard. Of the 249 patients that were scanned 29.6 % had PE. This is relatively high in comparison with values reported in the literature (6.7–31 %) [10–15]. Another study in The Netherlands found a diagnostic yield of 19.1 % [16]. What’s more important, when directly compared with our 2011 cohort, the sole intervention of making doctors write down the relevant clinical data led to an increase in positive CT scans by 6.6 %. The overall percentage of isolated subsegmental pulmonary emboli was 4 % and was not different from our 2011 cohort. Seven patients (3 %) had a low Wells score and a low D-dimer level. None of these patients had a PE, thereby confirming the safety of the refraining from performing a CTPA in this group. Clinical characteristics of our cohort resemble existing data; dyspnoea and chest pain were the most common presenting symptoms, active malignancy and immobilisation were the most frequently found risk factors [17, 18]. In patients both with and without PE CTPA showed a high percentage of consolidation (respectively 18 % and 12 %) and atelectasis (18 % and 22 %). A previous study by Akram et al. [19] showed similar rates. A history of DVT and current signs of DVT were both significantly associated with a higher diagnostic yield of PE. This finding is consistently found in the literature [20–23] and accentuates the importance of including these risk factors when establishing the clinical probability of PE. Both variables are included in the Wells-score. The presence of COPD was associated with a lower diagnostic yield. The fact that COPD and PE share their cardinal symptom, dyspnoea, could be the explanation for this association. Unsurprisingly, both a high Wells score and a high D-dimer value were also associated with a higher diagnostic yield.

To our knowledge, this is the first study that shows that the diagnostic yield of CT scanning can be improved by influencing requesting behaviour. In 2007 Albrizio and Mizzi [24] published their study of a comparison of positive rates of CTPA before and after implementation of the Wells score in their diagnostic protocol. No significant difference was found. However, it was not clear if the new protocol was in fact adequately applied in clinical practice, making interpretation of the results difficult. Another study, conducted by Kanaan et al. [8], evaluated if an educational intervention had an effect on appropriateness rates and outcomes of CTPA. No difference was found, showing that it takes more to improve protocol adherence than a single educational intervention. A more recent study tried to improve utilisation and CTPA outcome by mandatory assignment of the Wells score to an electronic request form [9]. What was remarkable was that requesting physicians appeared to inflate Wells scores over time (in spite of the fact that no threshold score was required to perform a CTPA), leading to an increase in appropriate use of CTPA, but failing to improve the positive rate for PE. We did not observe this effect, which can explain why an increase in appropriate use of CTPA did increase the percentage of positive scans in our study. If our results can be reproduced in other studies it has direct implications for daily practice. It is a strong plea to first establish the clinical probability of a disease before progressing to imaging techniques.

Limitations

Our study has its limitations. With a total of 249 patients our current cohort is quite small. Further, we did not randomise between an intervention group and a control group, but compared our current cohort with historical control data, which can lead to bias. However, when we compared our two cohorts we used the raw data, and we statistically adjusted for pre-diagnostic differences between both study populations. There were no changes in clinical assessment of the patients between our current cohort and our previous one. Furthermore, because all CT scans were blinded and double read by the same qualified radiologists as in our previous cohort, difference in reader experience could not be the reason for the increase in the rate of positive scans. What did differ was the type of scanners used. In our current cohort we used 128- and 256-slice CT scanners, set to a maximum potential energy of 100 kV. In our 2011 cohort, 64-slice scanners with a 120 kV protocol were used. It is possible that because of an increase in diagnostic accuracy very small emboli were better visualised, but the percentage of isolated subsegmental emboli in both studies was low and equal (4 %). There was in fact a decrease in the number of non-diagnostic studies from 4 to 0.4 %. However, because all undiagnostic scans were of very poor quality in both cohorts (severe breathing artefacts or almost no radiocontrast in the pulmonary artery) it is less likely that the type of scanner used contributed much to this difference. Lastly, in the few cases a scan was made without a documented Wells score on the request form, the score was calculated in retrospect, which could lead to bias because the result of the scan (positive or negative for PE) was known by the investigator calculating the score.

Conclusions

Our study shows that the sole intervention of asking doctors to provide adequate and relevant clinical data seems to improve the diagnostic yield of CTPA for PE. These results should be further analysed in large prospective trials. Our data also confirm that it is absolutely safe to refrain from scanning patients with a low Wells score and a low D-dimer level as none of the scanned patients in this subgroup had CTPA-diagnosed PE.

References

  1. Eng J, Krishnan JA, Segal JB et al (2004) Accuracy of CT in the diagnosis of pulmonary embolism: a systematic literature review. AJR Am J Roentgenol 183:1819–1827

    Article  PubMed  Google Scholar 

  2. Stein PD, Fowler SE, Goodman LR et al (2006) Multidetector computed tomography for acute pulmonary embolism. N Engl J Med 354:2317–2327

    Article  CAS  PubMed  Google Scholar 

  3. Stein PD, Kayali F, Hull RD (2007) Spiral computed tomography for the diagnosis of acute pulmonary embolism. Thromb Haemost 98:713–720

    CAS  PubMed  Google Scholar 

  4. Remy-Jardin M, Pistolesi M, Goodman LR et al (2007) Management of suspected acute pulmonary embolism in the era of CT angiography: a statement from the Fleischner Society. Radiology 245:315–329

    Article  PubMed  Google Scholar 

  5. Wells PS, Anderson DR, Rodger M et al (2001) Excluding pulmonary embolism at the bedside without diagnostic imaging: Management of patients with suspected pulmonary embolism presenting to the emergency department by using a simple clinical model and d-dimer. Ann Intern Med 135:98–107

  6. Van Belle A, Büller HR, Huisman MV et al (2006) Effectiveness of managing suspected pulmonary embolism using an algorithm combining clinical probability, D-dimer testing, and computed tomography. JAMA 295:172

    Article  PubMed  Google Scholar 

  7. Walen S, Leijstra MA, Uil SM et al (2014) Diagnostic yield of CT thorax angiography in patients suspected of pulmonary embolism: independent predictors and protocol adherence. Insights Imaging 5:231–236

    Article  PubMed  PubMed Central  Google Scholar 

  8. Kanaan Y, Knoepp UD, Kelly AM (2013) The influence of education on appropriateness rates for CT pulmonary angiography in emergency department patients. Acad Radiol 20:1107–1114

    Article  PubMed  Google Scholar 

  9. Geeting GK, Beck M, Bruno MA et al (2016) Mandatory assignment of modified wells score before CT angiography for pulmonary embolism fails to improve utilization or percentage of positive cases. AJR Am J Roentgenol 207:1–8

    Article  Google Scholar 

  10. Hoo GW, Wu CC, Vazirani S, Li Z, Barack BM (2011) Does a clinical decision rule using D-dimer level improve the yield of pulmonary CT angiography? AJR Am J Roentgenol 196:1059–1064

    Article  PubMed  Google Scholar 

  11. Chin P, Hurrell M, McGregor D, Beckert L (2006) The role of CT pulmonary angiography in patients with suspected pulmonary embolism admitted to general medicine. N Z Med J 119:U2052

    PubMed  Google Scholar 

  12. David S, Beddy P, Babar J, Devaraj A (2011) Evolution of CT pulmonary angiography: Referral patterns and diagnostic yield in 2009 compared with 2006. Acta Radiol 53:39–43

    Article  PubMed  Google Scholar 

  13. Costantino MM, Randall G, Gosselin M, Brandt M, Spinning K, Vegas CD (2008) CT angiography in the evaluation of acute pulmonary embolus. AJR Am J Roentgenol 191:471–474

    Article  PubMed  Google Scholar 

  14. Donohoo JH, Mayo-Smith WW, Pezzullo JA, Egglin TK (2008) Utilization patterns and diagnostic yield of 3421 consecutive multidetector row computed tomography pulmonary angiograms in a busy emergency department. J Comput Assist Tomogr 32:421–425

    Article  PubMed  Google Scholar 

  15. Kiley CA, Lowry KJ, Mysliwiec V (2007) Examination of hospital referral practices for CT pulmonary angiography. J Hosp Med 2:253–257

    Article  PubMed  Google Scholar 

  16. De Bruin S, Van Langevelde K, Huisman MV, Cannegieter SC (2012) Verdenking longembolie: CT-rendement hangt af van patiëntenkenmerken en verwijzer. Ned Tijdschr Geneeskd 156:A4201

    PubMed  Google Scholar 

  17. Stein PD, Beemath A, Matta F et al (2007) Clinical characteristics of patients with acute pulmonary embolism: data from PIOPED II. Am J Med 120:871–879

    Article  PubMed  PubMed Central  Google Scholar 

  18. Casazza F, Becattini C, Bongarzoni A et al (2012) Clinical features and short term outcomes of patients with acute pulmonary embolism. The Italian Pulmonary Embolism Registry (IPER). Thromb Res 130:847–852

    Article  CAS  PubMed  Google Scholar 

  19. Akram AR, Cowell GW, Logan LJ et al (2009) Clinically suspected acute pulmonary embolism: a comparison of presentation, radiological features and outcome in patients with and without PE. QJM 102:407–414

    Article  CAS  PubMed  Google Scholar 

  20. Prandoni P, Lensing AW, Cogo A et al (1996) The long-term clinical course of acute deep venous thrombosis. Ann Intern Med 125:1

    Article  CAS  PubMed  Google Scholar 

  21. Eichinger S, Weltermann A, Minar E et al (2004) Symptomatic pulmonary embolism and the risk of recurrent venous thromboembolism. Arch Intern Med 164:92

    Article  PubMed  Google Scholar 

  22. Wells PS, Anderson DR, Rodger M, Ginsberg JS, Kearon C, Gent M et al (2000) Derivation of a simple clinical model to categorize patients’ probability of pulmonary embolism: increasing the model’s utility with the SimpliRED D-dimer. Thromb Haemost 83:416–420

    CAS  PubMed  Google Scholar 

  23. Le Gal G, Righini M, Roy PM et al (2006) Prediction of pulmonary embolism in the emergency department: the revised Geneva score. Ann Intern Med 144:165

    Article  PubMed  Google Scholar 

  24. Albrizio M, Mizzi A (2007) Rate of computed tomography pulmonary angiographies (CTPA) positive for pulmonary embolism and predictive scores. Radiol Med 112:982–987

    Article  CAS  PubMed  Google Scholar 

  25. Wilson EB (1927) Probable inference, the law of succession, and statistical inference. J Am Stat Assoc 22:209–212

Download references

Acknowledgments

To the best of our knowledge, no conflicts of interest, financial or other, exist.

Author information

Authors and Affiliations

  1. Department of Pulmonology, Isala, Dr. van Heesweg 2, 8025 AB, Zwolle, The Netherlands

    Stefan Walen & Jan Willem K. van den Berg

  2. Department of Radiology, Isala, Dr. van Heesweg 2, 8025 AB, Zwolle, The Netherlands

    Erwin de Boer, Corné A. J. van der Worp & Martijn F. Boomsma

  3. Clinical Epidemiologist, Isala, Dr. van Heesweg 2, 8025 AB, Zwolle, The Netherlands

    Mireille A. Edens

Authors
  1. Stefan Walen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Erwin de Boer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mireille A. Edens
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Corné A. J. van der Worp
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Martijn F. Boomsma
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jan Willem K. van den Berg
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stefan Walen.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Walen, S., de Boer, E., Edens, M.A. et al. Mandatory adherence to diagnostic protocol increases the yield of CTPA for pulmonary embolism. Insights Imaging 7, 727–734 (2016). https://doi.org/10.1007/s13244-016-0509-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13244-016-0509-2

Keywords