Skip to main content
  • Original Article
  • Open access
  • Published:

Characteristics and trends in publication of scientific papers presented at the European Congress of Radiology: a comparison between 2000 and 2010

Abstract

Objective

To determine journal publication rates of scientific papers presented orally at the European Congress of Radiology (ECR) 2010, with comparison of country data to ECR 2000.

Methods

All oral presentations from ECR 2010 were evaluated for publication between 2010 and 2014 using the MEDLINE database. Countries, collaborations, subspecialties, modalities and study design were ranked by publication percentage. Chi-square tests were used to compare publication percentages for each category of variables. Hazard ratios (HR) were calculated for each country relative to the host nation, Austria. ECR 2010 country statistics were compared with analogous data from ECR 2000.

Results

In total, 360/840 abstracts were subsequently published (43 %). The author’s country of origin (p = 0.02), subspecialty (p = 0.02) and study design (p = 0.001) were significantly associated with subsequent publication. Switzerland, the Netherlands, France and Germany were among the top six countries by publication percentage in 2000 and 2010. In 2010, Switzerland had the highest publication rate (62 %) and HR in comparison to Austria (HR 2.62 [1.31–5.25], p = 0.01). Three Asian nations increased relative publication rates over the 10-year period.

Conclusion

Several European nations consistently convert relatively high percentages of oral abstracts at ECR into publications, and the influence of Asian countries is increasing.

Main Messages

Certain European nations consistently publish high percentages of orally presented abstracts at ECR.

The influence of several Asian countries on ECR is increasing.

Country, subspecialty and study design are significantly associated with journal publication.

Authors collaborating internationally have the highest publication rates and mean impact factors.

Among all modalities, PET-CT, MRI and CT have the highest publication percentages.

Introduction

Research helps to improve patient care, and as such is a pillar of clinical governance [1]. Radiology is a rapidly progressing speciality due to improvements in technology and the advent of new techniques. Evaluating these developments is essential in ensuring best practice in diagnosis and treatment. Therefore, assessing the quality of radiology research is important.

Scientific meetings allow practitioners to present and exchange ideas relevant to their field [2]. Although a certain standard must be reached for studies to be accepted as conference abstracts, only the most informative and highest-quality studies reach full publication in peer-reviewed journals [3]. Thus, the proportion of abstracts presented at medical meetings that are subsequently published in peer-reviewed journals can be regarded as marker of the research quality of the meeting and its participants [2]. In addition, the impact factor of the journal is a surrogate measure of the scientific quality of the articles published therein. It has been known since the 1950s that fewer than half of the papers presented at medical conferences are published as full-text articles [2]. Whilst the publication of abstracts from certain specialty specific conferences, such as orthopaedics and urology, have been explored in the literature [48], there is a paucity of data relating to journal publication rates and impact factors in radiology.

The purpose of this study was to evaluate journal publication rates and impact factors of oral abstracts presented at the 2010 European Congress of Radiology (ECR), the largest annual European radiology meeting, and one of the most influential radiology meetings worldwide. We aimed to assess the influence of the authors’ nationality and collaborations, as well as radiological subspecialty, modality and study design, on subsequent publication rates and impact factors. Additionally, we wanted to investigate temporal changes in publication rates and impact factors between ECR 2000 and 2010 to assess the changing contribution to radiological research by different countries.

Materials and methods

All 840 oral abstracts presented at the 2010 ECR, as documented in the scientific sessions proceedings of the 22nd ECR, were retrospectively reviewed by three authors (WL, JW and AY) between September and December 2014. The following data were collected from each oral presentation: 1) country of first author, 2) level of author collaboration, 3) radiological subspecialty, 4) radiology modality, and 5) study design (prospective or retrospective). The MEDLINE database was searched by these authors to identify the oral abstracts from ECR that had been converted to full journal publications. Initial searches were performed with the first author’s name. If this failed to reveal a corresponding manuscript, further searches were performed with the other author names or appropriate keywords from the title. These search criteria were the same as those of an analogous study analysing publication rates from ECR 2000 [3], thus facilitating comparison. We replicated the follow-up period of 4 years, 9 months by selecting articles published between March 2010 (the month of ECR 2010) and December 2014. As in the previous study, only countries with ten or more publications were compared in the statistical analysis of country data. Only orally presented abstracts from ECR were included, and poster presentations were excluded. Authors were blinded to these statistics during data collection.

Any discrepancies were resolved by consensus with a fourth independent reviewer (JCLR).

The impact factor of each journal was obtained from the Science Citation Index on the Institute of Scientific Information (ISI) Web of Knowledge Journal Citation Reports [9] by a single independent author (MAR). The mean impact factor over the study period was calculated for each journal. These data were not available for the previous study.

Statistical analysis

Authors’ countries of origin were ranked on a composite endpoint scale of percentage of abstracts published overall. Hazard ratios (with 95 % confidence interval [CI]) and p values) were calculated for each country relative to the host country, Austria. The previous study compared relative data to Austria with likelihood ratios [3]. Mean impact factor and publication rates per physician per 1000 population for the submitting country were calculated using World Bank data for 2000 and 2010 [10]. The two-tailed Fisher’s exact test was used to determine significance between datasets. Publication percentages and mean impact factors were calculated for institutional collaboration type, radiology subspecialty, modality and study design. These categories were then ranked on a composite endpoint score of publication rate. Chi-square tests were used to evaluate these variables for significant associations in publication rates. Two-tailed Fisher’s exact tests were used to determine significance in publication rates between subgroups of collaboration types and study design. All analyses were carried out using STATA version 12 statistical software (StataCorp LP, College Station, TX, USA).

Results

At ECR 2010, there were 840 orally presented abstracts from 42 countries, of which 360 were subsequently published in the MEDLINE indexed full-text journal articles. This equates to a publication percentage of 43 %. There was no significant difference in publication percentage compared to ECR 2000 (ECR 2010: 360/840 vs. ECR 2000: 479/1020, p = 0.08). The mean IF for ECR 2010 publications was 3.35 (SD = 1.95); unfortunately, these data were not available for ECR 2000.

Country of origin

The publication rate of abstracts was significantly associated with country of origin (X2 = 61.73, p = 0.02). Switzerland, Netherlands, France and Germany were consistently in the top six countries by publication rate in both 2000 and 2010 (Table 1). Switzerland had the highest publication rate (62 %) at ECR 2010 and the leading hazard ratio (HR) in comparison to Austria, the host nation (HR 2.62 (1.31–5.25), p = 0.01). Germany had the highest number of publications per physician per 1000 population in 2010 (27) and 2000 (58). The Netherlands had the highest mean IF (5.2) in 2010. These data were not available for ECR 2000. The publication rates of several Asian countries increased between 2000 and 2010: Japan (from unranked to 4th), South Korea (unranked to 5th) and China (unranked to 10th).

Table 1 Publication rates of presentations at European Congress of Radiology 20001 and 2010 by author’s country of origin

Collaboration

Collaboration between institutions was not significantly associated with subsequent publication (X2 = 16, p = 0.067). Authors collaborating internationally had a higher publication percentage (51 % vs. 44 %) (p = 0.35) and higher mean impact factor (3.2 vs. 3.1) than authors collaborating nationally (Table 2). International collaboration between a European country and the USA or a ‘rest of world’ country had the highest publication rate (67 %) (Table 3). National collaboration between institutions in the USA had the highest percentage of articles in the top quartile (50 %) and the highest mean IF, at 5.1.

Table 2 Rates of conversion of orally presented abstracts into publications according to local, national or international collaboration
Table 3 Rates of conversion of orally presented abstracts into publications according to collaboration subtypes

Subspecialty

Subspecialty was significantly associated with journal publication (X2 = 29.9, p = 0.01). Five subspecialties had publication rates over 50 %: paediatrics (63 %), thoracic (58 %), oncology (53 %), genitourinary (51 %) and MSK (50 %) (Table 4). ‘Computer studies’ had the lowest publication rate, at 17 %. ‘Safety issues’ had the highest number of published articles in the top-quartile impact factor journals, at 83 %, and a mean impact factor of 4.6. Gastrointestinal studies had the highest number of presentations (137) and publications (52), although its conversion rate was lower than that of other subspecialties (38 %).

Table 4 Publication by subspecialty

Modality

There was no statistically significant association between modality and publication (X2 = 9.3, p = 0.23). PET-CT (48 %), MRI (47 %) and CT (43 %) had the highest publication rates (Table 5). Nuclear medicine (non-PET) had the lowest publication rate (25 %), although the one article that was published had the highest mean impact factor, with an IF of 6.2.

Table 5 Publication by modality

Study design

Study design was the variable most significantly associated with subsequent publication (X2 = 12.2, p = 0.002). The mean impact factors of prospective and retrospective studies were comparable (3.5 and 3, respectively) (Table 6). Prospective and retrospective studies had similar publication rates (49 % vs. 48 %, respectively) (p = 0.99); however, the percentage of abstracts published in the top-quartile impact factor journals was higher in prospective studies (29 %) than in retrospective studies (19 %) (p = 0.08).

Table 6 Publication by study design

Discussion

Our study reveals journal publication rates and journal impact factors of abstracts from an international radiology conference, according to author’s country of origin, over a significant length of time. Our results reveal that certain European nations consistently convert high proportions of abstracts into published manuscripts, whilst publication rates of several Asian countries (Japan, South Korea and China) have improved since 2000. We also demonstrate that the author’s country of origin, subspecialty, and study design are significantly associated with journal publication rates.

The 43 % publication rate in this study is in line with rates from non-radiological international medical conferences—for example, 21–47 % for urology conferences [46] and 34–50 % for orthopaedic meetings [7, 8]. Our data demonstrate marginally higher publication percentages than the limited data available from international radiology conferences (35–39 %) [1113].

Our study methodology is analogous to that of a study of publication rates from ECR in 2000 [2], permitting a direct assessment of the temporal trend in publication rates of oral abstracts presented at a major international radiology conference. There was a non-significant difference in conversion rates of abstracts into publications, demonstrating consistency.

Comparison of the 2000 and 2010 data reveals that certain European nations, including Switzerland, France, the Netherlands and Germany, consistently convert high proportions of abstracts into publications. Interestingly, these four nations do not have the most densely populated radiologist populations in Europe [14, 15]. Similarly, only Switzerland among these four nations is in the top ten European countries by MRI or CT scanners per capita in 2010 [16]. The continued academic success of these countries therefore likely relates to greater promotion and investment in academic radiology than other European countries rather than overall number of radiologists or scanning capacity.

Some Asian countries, including China, Korea and Japan, increased the total number of publications, publication rates and overall ranking against other, predominantly European countries over the decade. These developments have occurred during a period of significant global economic change, and indicate the increasing globalisation of radiology research. Interestingly, over a similar time period, several major radiology journals have identified an increasing contribution of articles from Asian institutions, particularly in Japan and South Korea [1720]. In contrast, decreases were observed in the USA and UK in both their absolute publication rate and ranking relative to other countries, which mirrors previous bibliometric studies [21], and may reflect the impact that an increasing clinical workload [2224] and limited funding [25] has on academic radiology in these countries.

It is perhaps not unexpected that international collaboration between institutions produce abstracts that are more likely to lead to publication and higher impact factors than national or local authorship coalitions. Collaboration optimises existing resources and pools the expertise of leading academics across institutions. ECR 2010 took place after picture archiving and communication systems (PACS) had become a mainstream system globally. Along with high-speed Internet facilitating data transfer, this has broken down barriers that once made international collaboration more difficult. European nations are individually small, with relatively fewer research institutions and less funding [2] compared to countries such as the USA. Therefore, it is unsurprising that collaborations between European countries and either the USA or another ‘rest of world’ country have the highest abstract conversion rates. National collaborations between US institutions had the highest number of articles published in journals with top-quartile impact factors and highest mean impact factors, suggesting that the USA produces high-quality research.

Our subspecialty data demonstrate several trends comparable to those of other literature. The ECR 2000 study and another study analysing ECR 2001 [3, 26] also demonstrated high publication rates of thoracic- (56 and 49 %, respectively) and breast (55 and 53 %, respectively)-centred radiology research. Paediatrics has significantly improved from these two studies, currently converting 63 % of abstracts into publications (41 and 37 % previously). The high proportion of abdominal radiology abstracts and publications from our data is also reflected in the literature—one study analysing modalities represented in Radiology over a 10-year period [20] demonstrated abdominal-centred radiology studies to be the most frequent (1219/6542, 18 %), almost twice the number of any other subspecialty.

Our modality data are in line with those of other studies in recent years with regard to MRI and CT being the most prevalent modalities in published radiology research. One study demonstrated that between 2001 and 2010, original articles on MRI and CT were by far the most frequent modalities in major radiology journals (30 and 27 %, respectively) [20]. A separate study analysing modalities from manuscripts published in AJR and Radiology in 2001 found that MRI was the major modality in 31 % and CT in 27 % of journals [18]. The high publication rate of PET-CT in our more recently acquired data highlights the emergence and significance of this modality in more recent years.

Whilst prospective and retrospective studies have similar rates of conversion into published manuscripts, our results suggest that high-impact-factor journals consider prospective studies more favourably. A study examining acceptance rates to a major European cardiology conference also found prospective non-randomised study design to be an independent predictor of acceptance [27].

Our study had limitations. Firstly, we determined publication status through a MEDLINE search. As MEDLINE focuses on English language journals, articles not published in English will be underrepresented [2, 28]. However, we consider the MEDLINE database as currently the largest available database of relevant medical and radiology abstracts. Additionally, MEDLINE acts as a further quality control measure, as a committee selects journals for inclusion on the basis of their scientific policy and quality.

The key surrogate marker of research quality in our observational study was the percentage of abstracts published in peer-reviewed journals. An important consideration, therefore, is that of publication bias, which is where studies with statistically significant results are more likely to be published, and published earlier, than studies with no significant difference between study populations [29, 30]. Our initial study population of all oral abstracts at ECR 2010 had already undergone peer review prior to acceptance into the conference, and was thus potentially subjected to publication bias. To effectively analyse publication bias in the context of our study, all accepted and rejected ECR abstracts would need to be included and analysed. A further key surrogate indicator for research quality in our study was the impact factors of the publishing journals, a marker of the average number of citations [31]. This is not without fault, and several variables may influence the number of citations, such as the language of the publishing journal and the domain concerned [32]. It is estimated that the top 20 % of abstracts generally receive 80 % of journal citations [33]. High-impact-factor journal publication thus does not directly translate into an article receiving a high number of citations. However, in our study, we considered impact factors as a suitable objective quality assessment with which to evaluate a large number of abstracts. Additionally, the use of a normalised indicator such as percentage of articles published in the top quartile of impact factors allowed better comparison [2].

We indexed publication rates to number of doctors per population to determine the countries with the highest publication capacity. A more useful comparison would have been indexing to the number of radiologists. However, the most recent available data on this are from 2006 [14], and we therefore felt that indexing publication rates to concentration of doctors overall for 2000 and 2010 was more reliable.

A potential bias in the assessment of collaboration is that the author’s affiliation in the ECR book of abstracts may not be a true representation of the country in which the majority of the project was performed. For example, authors move around during their residency and may submit an abstract with an affiliation to a former institution, whilst the work was performed at their current institution [2].

Finally, we compared data from two points in time: 2000 and 2010. It is possible that the trends identified may represent an anomaly rather than a linear progression. Further studies are needed from future ECR meetings to consolidate our findings, enabling insight into the leading global radiology researchers of the future.

Conclusion

Our study demonstrates interesting characteristics and trends in the publication of radiology research between ECR 2000 and ECR 2010. At ECR 2010, the author’s country of origin, subspecialty and study design were significantly associated with subsequent publication, whilst author collaboration and modality were not. Certain European nations consistently convert relatively high numbers of presented abstracts into published manuscripts, and an increase among certain Asian nations has occurred over the 10-year period.

References

  1. Scally G, Donaldson LJ (1998) Clinical governance and the drive for quality improvement in the new NHS in England. BMJ 317:61–65

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Miguel-Dasit A, Martí-Bonmatí L, Aleixandre R, Sanfeliu P, Bautista D (2006) Publication of material presented at radiologic meetings: authors’ country and international collaboration. Radiology 239(2):521–528

    Article  PubMed  Google Scholar 

  3. Miguel-Dasit A, Martí-Bonmatí L, Sanfeliu P, Aleixandre R (2006) Scientific papers presented at the European Congress of Radiology 2000: Publication rates and characteristics during the period 2000–2004. Eur Radiol 16(2):445–450

  4. Yoon PD, Chalasani V, Woo HH (2012) Conversion rates of abstracts presented at the Urological Society of Australia and New Zealand (USANZ) Annual Scientific Meeting into full-text journal articles. BJU Int 110(4):485–489

    Article  PubMed  Google Scholar 

  5. Autorino R, Quarto G, Di Lorenzo G, De Sio M, Damiano R (2007) Are abstracts presented at the EAU meeting followed by publication in peer-reviewed journals? A critical analysis. Eur Urol 51(3):833–840

    Article  PubMed  Google Scholar 

  6. Autorino R, Quarto G, Sio M et al (2006) Fate of abstracts presented at the World Congress of Endourology: are they followed by publication in peer-reviewed journals? J Endourol Endourol Soc 20(12):996–1001

    Article  Google Scholar 

  7. Bhandari M, Devereaux PJ, Guyatt GH et al (2002) An observational study of orthopaedic abstracts and subsequent full-text publications. J Bone Joint Surg 84-A(4):615–621

    PubMed  Google Scholar 

  8. Amirhamzeh D, Moor MA, Baldwin K, Hosalkar HS (2012) Publication rates of abstracts presented at Pediatric Orthopaedic Society of North America meetings between 2002 and 2006. J Pediatr Orthop 32(2):e6–e10

  9. Journal citation Reports. Site; https://jcr.incites.thomsonreuters.com. Accessed February 7, 2016

  10. World Health Organisation’s Global Health workforce statistics. Physicians (per 1000 people). The World Bank. http://data.worldbank.org/indicator/SH.MED.PHYS.ZS. Accessed 25 January, 2015

  11. Arrivé L, Boelle PY, Dono P, Lewin M, Monnier-Cholley L, Tubiana JM (2004) Subsequent publication of orally presented original studies within 5 years after 1995 RSNA Scientific Assembly. Radiology 232(1):101–106

    Article  PubMed  Google Scholar 

  12. Marx WF, Cloft HJ, Do HM, Kallmes DF (1999) The fate of neuroradiologic abstracts presented at national meetings in 1993: rate of subsequent publication in peer-reviewed, indexed journals. Am J Neuroradiol 20(6):1173–1177

    CAS  PubMed  Google Scholar 

  13. Bydder SA, Joseph DJ, Spry NA (2004) Publication rates of abstracts presented at annual scientific meetings: how does the Royal Australian and New Zealand College of Radiologists compare? Australas Radiol 48(1):25–8

    Article  PubMed  Google Scholar 

  14. Autier P, Ouakrim DA (2008) Determinants of the number of mammography units in 31 countries with significant mammography screening. Br J Cancer 99(7):1185–1190

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Investing in the Clinical Radiology Workforce – the Quality and Efficiency Case (2012) Royal College of Radiologists. Site; www.rcr.ac.uk/docs/radiology/pdf/RCR_CRWorkforce_June2012.pdf. Accessed 4.2.16

  16. OECD. Medical technologies: CT scanners and MRI units. Health at a Glance: Europe 2012, OECD Publishing. Site http://www.oecd-ilibrary.org/docserver/download/8112121ec031.pdf?expires=1454607538&id=id&accname=guest&checksum=07889A7FEDC78D21159D78F8482F11A8. Accessed 4.2.16

  17. Elster AD, Chen MY (1994) The internationalization of the American Journal of Roentgenology: 1980–1992. AJR 1994. Retrieved from http://www.mrw.interscience.wiley.com/cochrane/clcmr/articles/CMR-7494/frame.html

  18. Ozsunar Y, Unsal A, Akdilli A, Karaman C, Huisman TA, Sorensen AG (2001) Technology and archives in radiology research: a sampling analysis of articles published in the AJR and Radiology. AJR 177(6):1281–4

    Article  CAS  PubMed  Google Scholar 

  19. Chen M, Jenkins C, Elster A (2003) Internationalization of the American Journal of Roentgenology: 1980–2002. AJR 181(4):907–912

    Article  PubMed  Google Scholar 

  20. Lim KJ, Yoon DY, Yun EJ et al (2012) Characteristics and trends of radiology research: a survey of original articles published in AJR and Radiology between 2001 and 2010. Radiology 264(3):796–802

    Article  PubMed  Google Scholar 

  21. Ray CE Jr, Gupta R, Blackwell J (2006) Changes in the American interventional radiology literature: comparison over a 10-year time period. Cardiovasc Intervent Radiol 29(4):599–604

    Article  PubMed  Google Scholar 

  22. Toms AP (2008) The decline and fall of academic radiology. Clin Radiol 63(2):113–4

    Article  CAS  PubMed  Google Scholar 

  23. Lu Y, Arenson RL (2005) The academic radiologist’s clinical productivity: an update. Acad Radiol 12(9):1211–1223

    Article  PubMed  Google Scholar 

  24. Eschelman D, Sullivan K, Parker L, Levin D (2000) The relationship of clinical and academic productivity in a university hospital radiology department. AJR 174(1):27–31

    Article  CAS  PubMed  Google Scholar 

  25. Chow DS, Itagaki MW (2010) Interventional oncology research in the United States: slowing growth, limited focus, and a low level of funding. Radiology 257(2):410–7

    Article  PubMed  Google Scholar 

  26. Miguel-Dasit A, Martí-Bonmatí L, Sanfeliu-Montoro A, Aleixandre R, Valderrama JC (2005) Scientific papers presented at the European Congress of Radiology: a two-year comparison. Eur Radiol 17(5):1372–1376

    Article  Google Scholar 

  27. Winnik S, Raptis DA, Walker JH et al (2012) From abstract to impact in cardiovascular research: Factors predicting publication and citation. Eur Heart J 33(24):3034–3045

  28. Timmer A, Blum T, Lankisch PG (2001) Publication rates following pancreas meetings. Pancreas 23(2):212–215

    Article  CAS  PubMed  Google Scholar 

  29. Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR (1991) Publication bias in clinical research. Lancet 337(8746):867–872

    Article  CAS  PubMed  Google Scholar 

  30. Dubben HH, Beck-Bornholdt HP (2005) Systematic review of publication bias in studies on publication bias. BMJ 331:433–434

    Article  PubMed  PubMed Central  Google Scholar 

  31. Journal citation reports (2012) Site; http://admin-apps.webofknowledge.com/JCR/help/h_impfact.htm. Published 2012. Accessed January 25, 2016

  32. Ojasoo T, Maisonneuve H, Matillon Y (2002) Le facteur d’impact des revues, un indicateur bibliométrique à manier avec prudence. Presse Med 31:775–781

    PubMed  Google Scholar 

  33. Editage (2013) Why you should not use impact factor to evaluate research. Site; http://www.editage.com/insights/why-you-should-not-use-the-journal-impact-factor-to-evaluate-research. Accessed February 4, 2016

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Will Loughborough.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Loughborough, W., Dale, H., Wareham, J.H. et al. Characteristics and trends in publication of scientific papers presented at the European Congress of Radiology: a comparison between 2000 and 2010. Insights Imaging 7, 755–762 (2016). https://doi.org/10.1007/s13244-016-0511-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13244-016-0511-8

Keywords