- Original Article
- Open Access
- Published:
Workload of diagnostic radiologists in the foreseeable future based on recent scientific advances: growth expectations and role of artificial intelligence
Insights into Imaging volumeĀ 12, ArticleĀ number:Ā 88 (2021)
Abstract
Objective
To determine the anticipated contribution of recently published medical imaging literature, including artificial intelligence (AI), on the workload of diagnostic radiologists.
Methods
This study included a random sample of 440 medical imaging studies published in 2019. The direct contribution of each study to patient care and its effect on the workload of diagnostic radiologists (i.e., number of examinations performed per time unit) was assessed. Separate analyses were done for an academic tertiary care center and a non-academic general teaching hospital.
Results
In the academic tertiary care center setting, 65.0% (286/440) of studies could directly contribute to patient care, of which 48.3% (138/286) would increase workload, 46.2% (132/286) would not change workload, 4.5% (13/286) would decrease workload, and 1.0% (3/286) had an unclear effect on workload. In the non-academic general teaching hospital setting, 63.0% (277/240) of studies could directly contribute to patient care, of which 48.7% (135/277) would increase workload, 46.2% (128/277) would not change workload, 4.3% (12/277) would decrease workload, and 0.7% (2/277) had an unclear effect on workload. Studies with AI as primary research area were significantly associated with an increased workload (pā<ā0.001), with an odds ratio (OR) of 10.64 (95% confidence interval (CI) 3.25ā34.80) in the academic tertiary care center setting and an OR of 10.45 (95% CI 3.19ā34.21) in the non-academic general teaching hospital setting.
Conclusions
Recently published medical imaging studies often add value to radiological patient care. However, they likely increase the overall workload of diagnostic radiologists, and this particularly applies to AI studies.
Key points
-
In an academic tertiary care center, 65.0% of recently published medical imaging studies could directly contribute to patient care, of which 48.3% would increase and 4.5% would decrease workload.
-
In a non-academic general teaching hospital, 63.0% of recently published medical imaging studies could directly contribute to patient care, of which 48.7% would increase and 4.3% would decrease workload.
-
Recently published medical imaging studies with AI as primary research area are significantly associated with an increased workload.
Introduction
The workload of radiologists (i.e., theĀ product of theĀ number and complexityĀ of examinations performed per time unit) has increased considerably over the past decades. This is largely due to the growth in the number of cross-sectional imaging examinations (particularly CT and MRI), increased complexity of image interpretation because of the acquisition of larger datasets, and declining imaging reimbursements [1,2,3,4]. The latter forces radiology practices to increase productivity to maintain income levels, while limiting their financial possibilities to employ new staff. Consequently, the overall workload per radiologist has considerably increased over the past years. Not surprisingly, burnout is recognized as an increasingly important problem among radiologists [5, 6]. Work overload may also compromise the quality and safety of patient care that can be provided by radiologists [7,8,9].
There are many factors that influence the utilization of medical imaging [10]. Scientific evidence can be considered as perhaps the most important driver, because research-based advances shape the way how radiology practice is performed in the future. Currently, however, it is unclear how recently published literature contributes to the workload in the field of radiology. This information would be important to radiologists and other stakeholders (including healthcare systems and governmental bodies) who aim to maintain a radiology workforce that is sufficiently large to meet clinical demands at high standards.
Meanwhile, there are also voices that speculate that artificial intelligence (AI) is expected to speed up scan time, make more accurate diagnoses, and ease the workload of radiologists [11]. Although the speculation that AI will decrease workload has not yet been supported by evidence, it can already have an important impact on political and strategic decisions. Based on this speculation, policy makers may already decide not to increase or even to limit the number of residents that can be enrolled into radiology training programs, may limit financial resources to employ (new) radiologists, and may further cut reimbursements for imaging procedures. This may have detrimental effects that cannot be rapidly reversed when the workload of radiologists actually proves to keep on increasing. Interestingly, in a recent survey among European Society of Radiology (ESR) members, 74.7% (504/675) expected an impact of AI on total reporting workload, with 50.8% (256/504) of them expecting a reduced reporting workload and 49.2% (248/504) expecting the opposite scenario [12]. Since the effect of AI on future workload remains unclear, and associated practical consequences are very relevant, it is crucial to fill in this knowledge gap. It is hypothesized that most recent scientific evidence increases workload in radiology practice, while there is no net effect of AI on radiologistsā workload based on the recent ESR survey results [12].
The purpose of this study was therefore to determine the anticipated contribution of recently published medical imaging literature on the workload of diagnostic radiologists.
Materials and methods
Study design
This study used literature data and did not require ethical review board approval or patient consent. Studies that were published in any of the 20 highly ranked clinical imaging journals and 20 highly ranked general medicine and clinical specialty journals (according to impact factor in the Journal Citation reports [13], that are listed in Table 1, were considered for inclusion in this study. All studies that were published in these 40 clinical journals in 2019 were retrieved from PubMed/Medline using the search term that is displayed in Additional file 1: Appendix 1. Using the random number generator in Microsoft Excel (Microsoft Corporation), a random sample of 1,000 studies was drawn from the studies that were retrieved by the PubMed/Medline search. These 1,000 studies were reviewed for eligibility by consensus of two radiologists (T.C.K. & R.M.K.). Studies were included if they concerned diagnostic imaging studies. Only original studies, systematic reviews and meta-analyses, were included. Case reports, conference proceedings, editorials, errata, guidelines/society statements, studies dealing with interventional radiology, letters to the editor, meeting summaries, non-systematic reviews, and studies clearly not related to medical imaging, were excluded. Studies dealing with imaging procedures that are not performed by radiologists in the authorsā institutions, such as cardiac ultrasonography or endoscopic ultrasonography, were also excluded. Studies were excluded if clearly ineligible based on title and abstract; otherwise, the full text version was evaluated.
Study analysis
One radiologist affiliated to an academic tertiary care center ināthe north of the Netherlands (T.C.K., radiologist 1), and another radiologist affiliated to a non-academic general teaching hospital ināthe south of the Netherlands (R.M.K., radiologist 2), independently reviewed the full text of each included study. Radiologist 1 had 5Ā years of post-residency clinical radiology experience and radiologist 2 had 6Ā years of post-residency clinical radiology experience, and both radiologists had 15Ā years of experience in critically appraising scientific literature in radiology. The radiology departments in both institutions, which are among the largest in The Netherlands, are regularly audited by the Radiological Society of the Netherlands to fulfill quality standards of radiological care [14]. Both radiologists assessed whether the results of each individual study could directly contribute to patient care in their radiology practice (i.e., whether the results may be directly implemented in practice for the purpose of enhancing patient care). If this was the case, this contribution was then categorized as concerning:
-
(1)
a completely new imaging application in their radiology practice.
-
(2)
another type of imaging as an alternative for an existing imaging application in their radiology practice.
-
(3)
an elaboration of on an existing imaging application in their radiology practice.
For contributions in category (2), it was qualitatively determined if the acquisition, post-processing, and interpretation times of the alternative type of imaging would be shorter than, as long as, or longer than that of the existing imaging application, or whether this remained unclear. Similarly, for contributions in category (3), it was qualitatively determined if the acquisition, post-processing, and interpretation times of the existing imaging application would decrease, remain stable, increase, or whether this remained unclear. Note that acquisition time refers to the time required to obtain images of the human body with a certain imaging modality, post-processing time refers to the time required for the manipulation of medical images to derive additional qualitative or quantitative data [15], and interpretation time refers to the time required to analyze and interpret the acquired and post-processed imaging data. All studies in category (1) and any study in categories (2) or (3) with a net increase in acquisition, post-processing, and/or interpretation time were considered to increase workload. Any study in categories (2) or (3) with a net decrease in acquisition, post-processing, and/or interpretation time was considered to decrease workload. Any study in categories (2) or (3) without a net change in acquisition, post-processing, and/or interpretation time was considered to have no effect on workload. All other studies were considered to have an unclear impact on workload. Study examples are shown in Tables 2 and 3 [16,17,18,19,20,21,22,23,24,25,26].
Statistical analysis
Separate analyses were done for the previously mentioned academic tertiary care center and non-academic general teaching hospital settings. The proportions of studies that could directly contribute to patient care, and those concerning (1) a completely new imaging application, (2) another type of imaging as an alternative for an existing imaging application, and (3) an elaboration of on an existing imaging application were calculated. Subsequently, the proportions of studies that would increase workload, decrease workload, have no effect on workload, and with an unclear impact on workload were calculated. Logistic regression analyses were performed to determine the association of increased workload with a studyās primary research area (AI, breast, cardiac, chest, computed tomography, contrast media, emergency, experimental, gastrointestinalāabdominal, headāneck, magnetic resonance, multisystem, musculoskeletal, neuroradiology, nuclear medicine, oncology, pediatric, ultrasonography, urogenital, or vascular) and impact factor of the journal in which the study was published (according to the 2019 Journal Citation reports (13)). Studies that would increase workload were coded as ā1ā and studies that would not change or decrease workload were calculated as ā0ā for this purpose. The largest category was used as reference for the variable āstudyās research area.ā p values less than 0.05 were considered statistically significant. Statistical analyses were executed using MedCalc version 17.2 Software (MedCalc).
Results
Eligible studies
Of the 1000 studies that were evaluated, 560 studies were excluded (Fig.Ā 1). Finally, 440 studies remained for inclusion (Additional file 1: Appendix 2).
Academic tertiary care center setting
65.9% (286/440) of studies could directly contribute to patient care, of which 84.6% (242/286) concerned an elaboration of an existing imaging application, 11.2% (32/286) concerned a new imaging application, and 4.2% (12/286) concerned another type of imaging as an alternative for an existing imaging application. Of the 286 studies that could directly contribute to patient care, 48.3% (138/286) would increase workload, 46.2% (132/286) would not change workload, 4.5% (13/286) would decrease workload, and 1.0% (3/286) had an unclear effect on workload. Causes of increased workload are detailed in Fig.Ā 2. The main cause of increased workload was an increase in interpretation time of an existing imaging application (74.6%, 103/138), often combined with an increase in post-processing time and acquisition time. The second main cause of increased workload was the introduction of a completely new imaging application (23.2%, 32/138).
On univariate analysis, both AI as research area and a lower impact factor of the journal in which the study was published were significantly associated with an increased workload (Table 4). On multivariate analysis, only AI as primary research area remained significantly associated with an increased workload (pā<ā0.001), with an odds ratio (OR) of 10.64 (95% confidence interval (CI) 3.25ā34.80) (Table 4). Of 38 AI studies with a potential direct contribution to patient care, 33 (86.5%) would increase workload (of which 32 due to increased post-processing and interpretation time and 1 due to increased post-processing time), 3 (7.9%) would decrease workload, 1 (2.6%) would not change workload, and 1 (2.6%) had an unclear effect on workload.
Non-academic general teaching hospital setting
63.0% (277/440) of studies could directly contribute to patient care, of which 84.8% (235/277) concerned an elaboration of on an existing imaging application, 10.8% (30/277) concerned a new imaging application, and 4.3% (12/277) concerned another type of imaging as an alternative for an existing imaging application. Of the 277 studies that could directly contribute to patient care, 48.7% (135/277) would increase workload, 46.2% (128/277) would not change workload, 4.3% (12/277) would decrease workload, and for 0.7% (2/277) the effect on workload was unclear. Causes of increased workload are detailed in Fig.Ā 3. The main cause of increased workload was an increase in interpretation time of an existing imaging application (74.1%, 100/135), often combined with an increase in post-processing time and acquisition time. The second main cause of increased workload was the introduction of a completely new imaging application (22.2%, 30/135).
On both univariate and multivariate analyses, only AI as primary research area was significantly associated with an increased workload (pā<ā0.001), with a multivariate OR of 10.45 (95% CI 3.19ā34.21) (Table 5). Of 37 AI studies with a potential direct contribution to patient care, 32 (86.8%) would increase workload (of which 29 due to increased post-processing and interpretation time, 2 due to increased post-processing time, and 1 due to increased interpretation time), 3 (8.1%) would decrease workload, 1 (2.7%) would not change workload, and for 1 (2.7%) the effect on workload was unclear.
Discussion
The results of this study show thatā>ā60% of recent scientific evidence in the medical imaging field may be directly implemented in diagnostic radiology practice for the purpose of enhancing patient care. However, nearly 50% of these studies would increase workload, while less than 5% would decrease workload. Therefore, the projected overall workload of diagnostic radiologists is expected to rise. Increased workload was due to an increase in interpretation time of an existing imaging application in nearly 75% (often combined with an increase in post-processing time and acquisition time) and due to the introduction of a completely new imaging application in 20ā25%. Interestingly, studies with AI as primary research area were significantly associated with an increased workload;ā>ā86% of AI studies increased workload, of which the far majority due to an increase in both post-processing and interpretation time.
Over the past decades, the workload of radiologists has already risen considerably [1,2,3,4], with a concomitant increase in the number of studies reporting high rates of burnout among radiology staff [5, 6, 27]. Implementing recent scientific innovations and advances in knowledge in diagnostic radiology practice may benefit patient care, but, as demonstrated by the present study, further increases workload. Maintaining the same radiology workforce while increasing the intensity of work (i.e., number of procedures per time unit) and/or extending working hours has been a common phenomenon among radiology practices in the past years [28,29,30]. However, this strategy is not a sustainable solution considering the fact that medical imaging keeps on evolving at a rapid pace, which continuously adds to the net workload of radiologists. Without any intervention, the continuous addition of workload that aims to improve patient care will eventually turn into work overload that may jeopardize the quality and safety of patient care [7,8,9]. AI is regarded as a potential solution to increase efficiency and ease the workload of radiologists [11, 31]. However, the present study suggests that most current AI applications in medical imaging have the opposite effect, because they commonly require additional post-processing and interpretation time rather than being seamlessly integrated in the workflow and taking over tasks of the diagnostic radiologist. Therefore, we believe that there is currently no scientific basis for policy makers to use AI as a reason to refrain from expanding the radiology workforce or to cut reimbursements for imaging procedures. To reverse the (looming) shortage of radiologists [32, 33], it may be necessary to enroll more residents into radiology training programs, train and employ radiologist assistants [34], and/or increase financial resources to employ (new) radiology staff.
The present study had some limitations. First, the results only apply to the scientific literature published in 2019. Given the lack of previous studies on this topic, the current findings can be considered as a baseline measurement to which future developments can be compared. Second, because of the lack of quantitative data on workload in almost all studies that were included in our analysis, only a qualitative analysis could be done. Third, only the direct impact of each study on workload was assessed. However, scientific innovations and advances in knowledge may allow for more reliable and accurate diagnoses, which may theoretically decrease additional imaging examinations and associated workload. Fourth, besides interpretation time, acquisition and post-processing time were also regarded to have a potential impact on workload, although it can be argued that they may not be the primary tasks of a radiologist. However, the radiologist bears the final responsibility for these processes, and they contribute to the overall workload of a radiology practice. Fifth, the implementation of the findings of the studies that were included in our analysis was based on a theoretical scenario. Whether or not the findings of these studies will eventually be incorporated in guidelines and experience widespread clinical implementation remains unclear. Nevertheless, the results of the present study indicate that there is no reason to assume that workload for radiologists will stabilize let alone decrease. Sixth, our findings apply to both an academic tertiary care center and a non-academic general teaching hospital in the Netherlands, as independently assessed by two radiologists. The quality of healthcare in the Netherlands ranks among the best in Europe [35]. Therefore, the results of this study are likely also applicable to modern radiology departments in other developed countries. However, further research by more radiologists, in other institutions, and in other countries, is necessary to confirm the generalizability of our results.
Conclusions
In conclusion, recently published medical imaging studies often add value to radiological patient care. However, they likely increase the overall workload of diagnostic radiologists, and this particularly applies to AI studies.
Availability of data and materials
All data are available in the manuscript and attached appendices.
Abbreviations
- AI:
-
Artificial intelligence
- ESR:
-
European Society of Radiology
- OR:
-
Odds ratio
References
McDonald RJ, Schwartz KM, Eckel LJ et al (2015) The effects of changes in utilization and technological advancements of cross-sectional imaging on radiologist workload. Acad Radiol 22:1191ā1198
Smith-Bindman R, Kwan ML, Marlow EC et al (2019) Trends in use of medical imaging in US health care systems and in Ontario, Canada, 2000ā2016. JAMA 322:843ā856
Pola A, Corbella D, Righini A et al (2018) Computed tomography use in a large Italian region: trend analysis 2004ā2014 of emergency and outpatient CT examinations in children and adults. Eur Radiol 28:2308ā2318
Bruls RJM, Kwee RM (2020) Workload for radiologists during on-call hours: dramatic increase in the past 15 years. Insights Imaging 11:12
Harolds JA, Parikh JR, Bluth EI, Dutton SC, Recht MP (2016) Burnout of radiologists: frequency, risk factors, and remedies: a report of the ACR commission on human resources. J Am Coll Radiol 13:411ā416
Ganeshan D, Rosenkrantz AB, Bassett RL Jr, Williams L, Lenchik L, Yang W (2020) Burnout in academic radiologists in the United States. Acad Radiol 27:1274ā1281
Krupinski EA, Berbaum KS, Caldwell RT, Schartz KM, Kim J (2010) Long radiology workdays reduce detection and accommodation accuracy. J Am Coll Radiol 7:698ā704
Krupinski EA, Berbaum KS, Caldwell RT, Schartz KM, Madsen MT, Kramer DJ (2012) Do long radiology workdays affect nodule detection in dynamic CT interpretation? J Am Coll Radiol 9:191ā198
Lee CS, Nagy PG, Weaver SJ, Newman-Toker DE (2013) Cognitive and system factors contributing to diagnostic errors in radiology. AJR Am J Roentgenol 201:611ā617
Hendee WR, Becker GJ, Borgstede JP et al (2010) Addressing overutilization in medical imaging. Radiology 257:240ā245
Alexander A, Jiang A, Ferreira C, Zurkiya D (2020) An intelligent future for medical imaging: a market outlook on artificial intelligence for medical imaging. J Am Coll Radiol 17:165ā170
European Society of Radiology (ESR) (2019) Impact of artificial intelligence on radiology: a EuroAIM survey among members of the European Society of Radiology. Insights Imaging 10:105
2019 Journal Citation Reports (InCites). https://jcr.clarivate.com/. Published June 23, 2020. Accessed January 8, 2021.
Kwaliteitsvisitatie. https://www.radiologen.nl/kwaliteit/kwaliteitsvisitatie. Publishing date unknown. Accessed January 8, 2021.
Mezrich R, Juluru K, Nagy P (2011) Should post-processing be performed by the radiologist? J Digit Imaging 24:378ā381
Kronlage M, Knop KC, Schwarz D et al (2019) Amyotrophic lateral sclerosis versus multifocal motor neuropathy: utility of MR neurography. Radiology 292:149ā156
Tanabe N, Shima H, Sato S et al (2019) Direct evaluation of peripheral airways using ultra-high-resolution CT in chronic obstructive pulmonary disease. Eur J Radiol 120:108687
Tsuchiya J, Yamamoto M, Bae H et al (2019) Tumor identification of less aggressive or indolent lymphoma with whole-body 11C-acetate PET/CT. Clin Nucl Med 44:276ā281
Tagliafico AS, Cea M, Rossi F et al (2019) Differentiating diffuse from focal pattern on computed tomography in multiple myeloma: added value of a radiomics approach. Eur J Radiol 121:108739
Perlepe V, Michoux N, Heynen G, Vande Berg B (2019) Semi-quantitative CT assessment of fracture healing: How many and which CT reformats should be analyzed? Eur J Radiol 118:181ā186
Matsumoto Y, Higaki T, Masuda T et al (2019) Minimizing individual variations in arterial enhancement on coronary CT angiographs using ācontrast enhancement optimizerā: a prospective randomized single-center study. Eur Radiol 29:2998ā3005
Haddock B, Fan AP, Uhlrich SD et al (2019) Assessment of acute bone loading in humans using [18F]NaF PET/MRI. Eur J Nucl Med Mol Imaging 46:2452ā2463
An H, Ma X, Pan Z, Guo H, Lee EYP (2020) Qualitative and quantitative comparison of image quality between single-shot echo-planar and interleaved multi-shot echo-planar diffusion-weighted imaging in female pelvis. Eur Radiol 30:1876ā1884
Chen Y, Panda A, Pahwa S et al (2019) Three-dimensional MR fingerprinting for quantitative breast imaging. Radiology 290:33ā40
Miles A, Bhatnagar G, Halligan S et al (2019) Magnetic resonance enterography, small bowel ultrasound and colonoscopy to diagnose and stage Crohnās disease: patient acceptability and perceived burden. Eur Radiol 29:1083ā1093
Kasivisvanathan V, Ambrosi A, Giganti F et al (2019) A dedicated prostate MRI teaching course improves the ability of the urologist to interpret clinically significant prostate cancer on multiparametric MRI. Eur Urol 75:203ā204
Guenette JP, Smith SE (2017) Burnout: prevalence and associated factors among radiology residents in New England with comparison against United States resident physicians in other specialties. AJR Am J Roentgenol 209:136ā141
Meghea C, Sunshine JH (2007) Determinants of radiologistsā desired workloads. J Am Coll Radiol 4:166ā170
Hillman BJ (2007) Everyone is working harder. J Am Coll Radiol 4:143ā144
Rohatgi S, Hanna TN, Sliker CW, Abbott RM, Nicola R (2015) After-hours radiology: challenges and strategies for the radiologist. AJR Am J Roentgenol 205:956ā961
Hosny A, Parmar C, Quackenbush J, Schwartz LH, Aerts HJWL (2018) Artificial intelligence in radiology. Nat Rev Cancer 18:500ā510
Rimmer A (2017) Radiologist shortage leaves patient care at risk, warns royal college. BMJ 359:j4683
Nishie A, Kakihara D, Nojo T et al (2015) Current radiologist workload and the shortages in Japan: how many full-time radiologists are required? Jpn J Radiol 33:266ā272
Ludwig R, Ferrara TL (2008) What is your radiologist assistant student worth to you? J Am Coll Radiol 5:115ā118
Euro Health Consumer Index. https://healthpowerhouse.com/media/EHCI-2018/EHCI-2018-report.pdf. Published February 25, 2020. Accessed January 8, 2021.
Funding
None.
Author information
Authors and Affiliations
Contributions
TCK was involved in study concept, study design, data acquisition, data analysis and interpretation, statistical analysis, manuscript preparation, manuscript editing, and manuscript review. RMK helped in study concept, study design, data acquisition, data analysis and interpretation, statistical analysis, manuscript preparation, manuscript editing, and manuscript review. All authors have read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study used literature data and did not require ethical review board approval or patient consent.
Consent for publication
Not applicable.
Competing interests
None.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1
: Appendix 1. Search term used to retrieve studies from PubMed/Medline that were considered for inclusion. Appendix 2. Overview of 440 studies that remained after excluding 560 ineligible studies from the initial sample of 1000 studies.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Kwee, T.C., Kwee, R.M. Workload of diagnostic radiologists in the foreseeable future based on recent scientific advances: growth expectations and role of artificial intelligence. Insights Imaging 12, 88 (2021). https://doi.org/10.1186/s13244-021-01031-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13244-021-01031-4
Keywords
- Artificial intelligence
- Radiology
- Radiologists
- Research
- Workload