- Original Article
- Open Access
Promoting the use of the PRECISE score for prostate MRI during active surveillance: results from the ESOR Nicholas Gourtsoyiannis teaching fellowship
Insights into Imaging volume 13, Article number: 111 (2022)
The PRECISE criteria for serial multiparametric magnetic resonance imaging (MRI) of the prostate during active surveillance recommend the use of a dedicated scoring system (PRECISE score) to assess the likelihood of clinically significant radiological change. This pilot study assesses the effect of an interactive teaching course on prostate MRI during active surveillance in assessing radiological change in serial imaging.
Eleven radiology fellows and registrars with different experience in prostate MRI reading participated in a dedicated teaching course where they initially evaluated radiological change (based on their previous training in prostate MRI reading) independently in fifteen patients on active surveillance (baseline and follow-up scan), and then attended a lecture on the PRECISE score. The initial scans were reviewed for teaching purposes and afterwards the participants re-assessed the degree of radiological change in a new set of images (from fifteen different patients) applying the PRECISE score. Receiver operating characteristic analysis was performed. Confirmatory biopsies and PRECISE scores given in consensus by two radiologists (involved in the original draft of the PRECISE score) were the reference standard.
There was a significant improvement in the average area under the curve (AUC) for the assessment of radiological change from baseline (AUC: 0.60 [Confidence Intervals: 0.51–0.69] to post-teaching (AUC: 0.77 [0.70–0.84]). This was an improvement of 0.17 [0.016–0.28] (p = 0.004).
A dedicated teaching course on the use of the PRECISE score improves the accuracy in the assessment of radiological change in serial MRI of the prostate.
A teaching course improves the accuracy in the assessment of radiological change in serial prostate MRI.
Appropriate training should be delivered to radiologists to promote the use of the PRECISE score.
Interactive courses could be used to certify radiologists reporting prostate MRI during active surveillance.
Active surveillance has been increasingly adopted as a management option in patients with low and favourable intermediate risk prostate cancer and a life expectancy of more than 10 years .
There has been increasing interest in the use of multiparametric magnetic resonance imaging (MRI) during active surveillance, and this technique has now become common place in active surveillance candidates’ selection due to its high negative predictive value for clinically significant disease .
There is also strong evidence to support the use of prostate MRI in patients with an initial biopsy suitable for active surveillance, and to target any lesions seen on imaging, often in conjunction with a confirmatory systematic biopsy .
The Prostate Cancer Radiological Estimation of Change in Sequential Evaluation (PRECISE) recommendations  represents the first standardised scoring system to report the likelihood of radiological change in serial imaging during active surveillance. At present, there is limited literature on the application of the PRECISE score in a clinical setting  and there is no formal investigation on the impact of a dedicated training course for radiologists in the assessment of radiological change in serial imaging.
The importance of reader training and experience in prostate MRI is evident from the literature [6, 7] and several studies on prostate MRI have shown considerable interobserver variability, providing evidence that reader experience is crucial for accurate reporting [8,9,10].
The Nicholas Gourtsoyiannis Teaching Fellowship, established by the European School of Radiology (ESOR), is aimed at radiologists who wish to enhance their teaching and training skills by delivering lectures and undertaking interactive workshops. For the year 2021, the fellowship has been awarded to two separate projects on prostate MRI.
We report here the results from the first project, which focussed on teaching the application of the PRECISE score on serial prostate MRI during active surveillance .
Our hypothesis was that dedicated training in reading serial prostate MRI during active surveillance by using the PRECISE score would significantly improve readers with different levels of experience in determining the degree of radiological change over time.
Materials and methods
The PRECISE score consists of a 1-to-5 scale that includes repeated measurement of each lesion (if any), and attribution of a score for the likelihood of significant radiological change over time (Table 1). In detail, a PRECISE score of 1 or 2 means that there has been radiological regression, a PRECISE score of 3 entails that the MR findings are stable over time, while a PRECISE score of 4 or 5 refers to radiological progression. A dedicated reporting proforma (case report) should be used for each patient and for each MR scan, in order to collect the data in a systematic manner.
The 2021 fellowship recipient (F.G.) is a Consultant Radiologist highly experienced in prostate MRI (i.e., reporting more than 2500 prostate MR scans per year) who had been actively involved in the draft and publication of the original PRECISE consensus paper .
The first teaching fellowship took place at Sorbonne Université and Hôpital La Pitié-Salpêtrière in Paris (Fig. 1) between November 21 and November 28, 2021, in collaboration with one of the panellists (R.R.P.) who participated in the original PRECISE consensus meeting .
Setting and participants
Eleven participants from the Radiology Department of Hôpital La Pitié-Salpêtrière with different levels of experience in prostate MRI reporting were invited to participate in this project, provided that they were unaware of the PRECISE scoring system and how to use it. They were aware that patients had prostate cancer, but they were blinded to all other clinical and laboratory data, including biopsy results and the original MR reports.
Figure 2 shows the framework of each step of the teaching fellowship during the week.
Day 1 and Day 2: in the two weeks prior to the lecture, all participants were asked to go through the baseline and follow-up mpMRI scans of 15 patients independently and fill two scoring sheets (Figs. 3 and 4) that were specifically created for this project by the course director (F.G.). They were asked to draw up to three lesions and give a Prostate Imaging Reporting and Data System (PI-RADS) and/or Likert score together with the largest lesion diameter (mm) on the dominant sequence for the peripheral and transitional zone, as per PI-RADS v. 2.1 guidelines.  For the follow up scans the participants were also asked to evaluate the degree of radiological change (i.e., radiological regression, stability or progression) subjectively along with a narrative explanation on how radiological change was assessed. No further instructions or guidelines were given, and the participants relied only on their previous training in general radiology and prostate MRI reading. They were allowed to work at different speeds and spend as much time as they needed on the interpretation of the scans. All scoring sheets were returned before the lecture and the workshop (i.e., before the end of the ‘Day 2’ of the fellowship).
Day 3: all participants attended the lecture and the workshop on the third day of the fellowship, and they were encouraged to ask questions at the end of the talk to improve their understanding of the subject.
The lecture, whose title was: “MRI and active surveillance using the PRECISE recommendations: are we ready to take the next step?” consisted of two separate modules, which were held on the same day:
Module 1-Prostate MRI and active surveillance: recommendations from national/international guidelines and overview of the current available literature
Module 2-The PRECISE recommendations: standardising prostate MRI reporting during active surveillance
All participants attended the lecture (1 h), which was followed by a Q&A session (30 min) in which they were encouraged to ask questions to improve their understanding of the subject.
The workshop, whose title was: “The PRECISE recommendations: from theory to practice”, was carried out following the lecture and included hands-on training to familiarise the participants with the PRECISE scoring system. During the workshop, five different sets of scans that had been scored in the previous two weeks were reviewed and discussed collegially in light of the PRECISE recommendations. The participants were taught how to evaluate radiological change and assess the PRECISE score for each patient using the dedicated PRECISE case report form (Fig. 5).
Day 4 and Day 5: all participants were asked to evaluate a new set of images from 15 different patients (each of which included again a baseline and a follow-up scan) independently using the PRECISE case report form from the fourth day of the fellowship onwards and they were given up to two weeks after the lecture to return their scores. For this specific pilot study, it was agreed to collect only the largest diameter of each lesion on the dominant sequence, as this is allowed in the PRECISE recommendations .
The participants interpreted all the studies independently and at different times on dedicated picture archiving and communication system (PACS) stations.
Clinical cohort and reference standard
This study was supported by the Health Data Centre of the Assistance Publique-Hôpitaux de Paris and approved by the Ethical and Scientific Board (IRB00011591). Consent was waived as these images were acquired as part of standard clinical care.
All scans used for this project were part of a prospectively maintained database on prostate MRI at Hôpital La Pitié-Salpêtrière and were randomly selected by a research study assistant not involved in the study prior to the start of the teaching fellowship from a list of eligible patients who met the following active surveillance criteria: (i) biopsy-confirmed prostate cancer [i.e., Gleason score ≤ 3 + 4 and prostate-specific antigen (PSA) ≤ 20 ng/ml]; (ii) two serial prostate MR scans.
The timing of MRI during active surveillance was based on both baseline risk (i.e., presence of a visible lesion on baseline imaging) and PSA or PSA density changes during follow-up. All patients had confirmatory biopsies (systematic and targeted when necessary) using either a transrectal or transperineal approach.
The two radiologists (F.G. and R.R.P.)—who were the principal investigators of this study—re-evaluated the images and assessed the PRECISE score in consensus for each scan before the teaching fellowship, blinded to the histological results from the confirmatory biopsies. Their PRECISE scores along with the histopathological results from confirmatory biopsies were used as the reference standard for the evaluation of the participants’ performance before and after the course.
All scans were performed at Hôpital La Pitié-Salpêtrière according to international guidelines. [11, 12] Two different scanners were used: one 1.5 T (Magnetom Aera, Siemens) and one 3 T system (Magnetom Skyra, Siemens), with a pelvic phased-array coil. The protocol comprised multiplanar T2-weighted, diffusion-weighted (including calculated high b sequences: 1400 s/mm2 and 2500 s/mm2) and dynamically contrast-enhanced acquisitions. All patients received an enema prior to the study, and 1 mg of Glucagon was administered intramuscularly prior to the examination.
Continuous variables were summarised by medians and inter-quartile ranges.
The primary outcome was the change in the average area under the curve (AUC) for detection of radiological change (stratified by PRECISE 1-3 vs PRECISE 4-5) before and after teaching.
For the purpose of the analysis, the pre-teaching scores given in the dedicated scoring sheets (i.e., radiological regression/stability vs radiological progression) were dichotomised into PRECISE 1-3 vs PRECISE 4-5.
Receiver operating characteristic (ROC) curves were based on generalised linear mixed models with random effects on readers and cases. This approach generalises the Obuchowski-Rockette method and is described by Liu et al. [13, 14]
For each ROC curve and AUC value, 95% confidence intervals (CI) were computed by conditional bootstrap resampling (B = 50,000 samples).
Exact p values were computed by permutation methods to avoid any distributional assumption or asymptotic approximation and considered significant when < 0.05.
All statistical analyses were performed in R v. 4.1.3 (R Foundation for Statistical Computing, Vienna, Austria).
A total of 60 anonymised scans from 30 patients were included in this study.
All scans were of optimal diagnostic quality [i.e., Prostate Imaging Quality (PI-QUAL) score ≥ 4]  and had been performed between September 2011 and October 2021.
Table 2 shows baseline and follow-up characteristics of the cohorts included in the study.
Reference standard and PRECISE score
For each case (pre- and post-teaching), the results from confirmatory biopsy along with the PRECISE scores given by the two principal investigators before the course served as the reference standard.
There were 12/15 (80%) and 5/15 (33%) patients showing radiological progression (i.e. PRECISE score ≥ 4) in the pre- and post-teaching cohorts, respectively (Table 2).
Accuracy in assessing radiological progression
There was a significant improvement in the average AUC for the assessment of radiological change from baseline (AUC: 0.60 [CI: 0.51–0.69]) to post-teaching (AUC: 0.77 [0.70–0.84]), an improvement of 0.17 [0.016–0.28] (p = 0.004). The ROC curves presented in Fig. 6a summarise the average accuracy levels in determining radiological change (stratified by PRECISE 1-3 vs PRECISE 4-5) on prostate MRI during active surveillance before and after the teaching course.
Table 3 reports the AUC in the assessment of radiological change stratified by reader experience before and after teaching. Interestingly, a nearly significant difference (p = 0.054) was observed for beginners (i.e. those participants who had reported < 50 prostate MR scans before the course). The ROC curves shown in Fig. 6b and 6c are a visual representation of these findings.
This pilot study has shown that a dedicated teaching course on the use of the PRECISE score in serial MRI of the prostate during active surveillance is beneficial for radiologists with different levels of expertise.
We observed that the participants’ average accuracy in determining the degree of radiological change over time significantly increased after an interactive didactic lecture and a hands-on workshop.
It is recognised that experience and subspecialty training impact the diagnostic performance of prostate MRI, as experienced readers perform better than less experienced radiologists in the interpretation of the images .
The eleven readers who evaluated the degree of radiological change on serial prostate MRI had different levels of expertise, as reported in Table 3. It should be noted that it is difficult to express reader experience in prostate MRI, as pointed out in a recent consensus meeting .
In this pilot study, all participants were radiologists at different stages of their career, and we decided to use an arbitrary threshold of 50 prostate MR scans to differentiate between beginner and intermediate level, and a threshold of 100 scans to distinguish between intermediate and expert readers .
All participants achieved satisfactory accuracy levels and our overall goal has been successful.
A recent meta-analysis has shown that serial MRI of the prostate, not alone but in addition to other clinical factors and biomarkers, allow to reliably rule in and rule out prostate cancer progression.  In particular, it has been pointed out that the PRECISE score is currently the sole and most reliable tool to limit intrareader variability and standardise reporting of serial MRI of the prostate during active surveillance [5, 21].
In addition to this, prostate MRI may offer an opportunity to follow patients on active surveillance without the need of performing further biopsies in the absence of signs of radiological progression by means of the PRECISE score, although robust data from prospective studies are still needed before widespread adoption of MRI as a tool to replace repeat biopsies in this setting [5, 22].
It follows that dedicated teaching courses to disseminate the use of the PRECISE score represent a good opportunity for the widespread use of this scoring system, and we believe that the results of our pilot study are a first step in the right direction and should deserve confidence.
We acknowledge that there are some limitations in this pilot study. The first is the lack of patients showing radiological regression (i.e., PRECISE 1 and 2) in the post-teaching cohort. However, this was not chosen deliberately but it is rather the result of the randomisation process carried out by an independent research study assistant not involved in the study and with any sort of clinical background.
The second limitation is that all participants had already received (or were receiving at the time of the course) formal clinical training in Radiology, meaning that their skills in general MRI semiotics could have already been at an intermediate-to-high level. This, in addition to the small number of patients and scans included in this pilot study, might explain the reason why the AUC for the pre-course assessment was already higher than 0.6. Further studies on larger datasets with multiple serial scans (i.e., more than two) and including participants without training in MR reading (e.g., students in their final years of medical school or before starting proper training in Radiology) will be more informative.
In conclusion, although there is plenty of useful teaching material on prostate MRI for self-learning available online, the results from our pilot study reiterate the importance of dedicated hands-on training courses for the evaluation of radiological change on serial prostate MRI using the PRECISE score.
We believe that a combination of simultaneous lectures and practical workshops is a move in the right direction to train the radiological community, and we hope that our initial results from this teaching fellowship, along with those from the other experience,  could act as a source of inspiration for future applicants and represent fertile ground for further courses like this, not only related to prostate cancer imaging.
Availability of data and material
Further information is available from the corresponding author on reasonable request.
Area Under the Curve
Coronavirus disease 19
European School Of Radiology
Multiparametric Magnetic Resonance Imaging
Picture Archiving and Communication System
Prostate Imaging QUALity
Prostate Imaging Reporting And Data System
Prostate cancer Radiological Estimation of Change In Sequential Evaluation
Prostate Specific Antigen
Receiver Operating Characteristic
Bruinsma SM, Bangma CH, Carroll PR et al (2016) Active surveillance for prostate cancer: a narrative review of clinical guidelines. Nat Rev Urol 13(3):151–167
Schoots IG, Petrides N, Giganti F et al (2015) Magnetic resonance imaging in active surveillance of prostate cancer: a systematic review. Eur Urol 67(4):627–636
Schoots IG, Nieboer D, Giganti F, Moore CM, Bangma CH, Roobol MJ (2018) Is magnetic resonance imaging-targeted biopsy a useful addition to systematic confirmatory biopsy in men on active surveillance for low-risk prostate cancer. A systematic review and meta-analysis. BJU Int 122(6):946–958
Moore CM, Giganti F, Albertsen P et al (2017) Reporting magnetic resonance imaging in men on active surveillance for prostate cancer: the PRECISE recommendations—a report of a european school of oncology task force. Eur Urol 71(4):648–655
Rajwa P, Pradere B, Quhal F et al (2021) Reliability of serial prostate magnetic resonance imaging to detect prostate cancer progression during active surveillance: a systematic review and meta-analysis. Eur Urol 80(5):549–563
Akin O, Riedl CC, Ishill NM, Moskowitz CS, Zhang J, Hricak H (2010) Interactive dedicated training curriculum improves accuracy in the interpretation of MR imaging of prostate cancer. Eur Radiol 20:995–1002
Rosenkrantz AB, Ayoola A, Hoffman D et al (2017) The learning curve in prostate MRI Interpretation: self-directed learning versus continual reader feedback. AJR Am J Roentgenol 208(3):W92–W100
Greer MD, Shih JH, Lay N et al (2019) Interreader variability of prostate imaging reporting and data system version 2 in detecting and assessing prostate cancer lesions at prostate MRI. AJR Am J Roentgenol 212:1197–1205
Muller BG, Shih JH, Sankineni S et al (2015) Prostate cancer: interobserver agreement and accuracy with the revised prostate imaging reporting and data system at multiparametric MR imaging. Radiology 277(3):741–750
Brembilla G, Dellglio P, Stabile A et al (2020) Interreader variability in prostate MRI reporting using prostate imaging reporting and data system version 2.1. Eur Radiol 30(6):3383–3392
Turkbey B, Rosenkrantz AB, Haider MA et al (2019) Prostate imaging reporting and data system version 2.1: 2019 update of prostate imaging reporting and data system version 2. Eur Urol 76:340–351
Weinreb JC, Barentsz JO, Choyke PL et al (2016) PI-RADS prostate imaging—reporting and data system: 2015, version 2. Eur Urol 69(1):16–40
Obuchowski NA (1995) Multireader, multimodality receiver operating characteristic curve studies: hypothesis testing and sample size estimation using an analysis of variance approach with dependent observations. Acad Radiol 2:S22–S29
Liu W, Pantoja-Galicia N, Zhang B et al (2017) Generalized linear mixed models for multi-reader multi-case studies of diagnostic tests. Stat Methods Med Res 26:1373–1388
Giganti F, Allen C, Emberton M, Moore CM, Kasivisvanathan V (2020) Prostate imaging quality (PI-QUAL): a new quality control scoring system for multiparametric magnetic resonance imaging of the prostate from the PRECISION trial. Eur Urol Oncol 3(5):615–619
Futterer JJ, Engelbrecht MR, Huisman HJ et al (2005) Staging prostate cancer with dynamic contrast-enhanced endorectal MR imaging prior to radical prostatectomy: experienced versus less experienced readers. Radiology 237(2):541–549
Linver MN, Paster SB, Rosenberg RD, Key CR, Stidley CA, King WV (1992) Improvement in mammography interpretation skills in a community radiology practice after dedicated teaching courses: 2-year medical audit of 38,633 cases. Radiology 184(1):39–43
Kasivisvanathan V, Ambrosi A, Giganti F et al (2019) A dedicated prostate MRI teaching course improves the ability of the urologist to interpret clinically significant prostate cancer on multiparametric MRI. Eur Urol 75(1):203–204
De Rooij M, Israël B, Tummers M et al (2020) ESUR/ESUI consensus statements on multi-parametric MRI for the detection of clinically significant prostate cancer: quality requirements for image acquisition, interpretation and radiologists’ training. Eur Radiol 30(10):5404–5416
Kirkham AP, Haslam P, Keanie JY et al (2013) Prostate MRI: who, when, and how. Report from a UK consensus meeting. Clin Radiol 68(10):1016–1023
Giganti F, Kasivisvanathan V, Allen C, Moore CM (2021) The importance of being PRECISE in prostate magnetic resonance imaging and active surveillance. Eur Urol 79(4):560–563
Giganti F, Kirkham A, Allen C et al (2021) Update on multiparametric Prostate MRI during active surveillance: current and future trends and role of the PRECISE recommendations. AJR Am J Roentgenol 216(4):943–951
Giganti F, Cole AP, Fennessy FM et al (2022) Promoting the use of the PI-QUAL score for prostate MRI quality: results from the ESOR Nicholas Gourtsoyiannis teaching fellowship. Eur Radiol. https://doi.org/10.1007/s00330-022-08947-5
The Authors would like to thank Professor Valérie Vilgrain (ESOR Scientific / Educational Director), Ms. Brigitte Lindlbauer (ESOR Administrative Director), Mrs. Isabella Davicino (ESOR Scholarship/Fellowship Coordinator) and the whole ESOR team for their support.
This study has received funding by the European School of Radiology (ESOR) 2021 Nicholas Gourtsoyiannis teaching fellowship. The study has been endorsed by the UCL Cities Partnership Programme (London/Paris).
Ethics approval and consent to participate
Institutional Review Board approval was obtained (IRB00011591).
Consent for publication
Consent for publication was obtained.
FG has been the recipient of the 2021 ESOR Nicholas Gourtsoyiannis teaching fellowship. FG is a recipient of the 2020 Young Investigator Award (20YOUN15) funded by the Prostate Cancer Foundation / CRIS Cancer Foundation. This work has been endorsed by the UCL Cities Partnership Programme (London/Paris). VK is an Academic Clinical Lecturer funded by the UK National Institute for Health Research (NIHR). AK is supported by the UCLH/UCL Biomedical Research Centre. ME receives research support from the United kingdom’s National Institute of Health Research (NIHR) UCLH and UCL Biomedical Research Centre. CMM is supported by the UKNIHR, Movember, PCUK and the EAU Research Foundation. The remaining authors declare that they do not have any competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Giganti, F., Aupin, L., Thoumin, C. et al. Promoting the use of the PRECISE score for prostate MRI during active surveillance: results from the ESOR Nicholas Gourtsoyiannis teaching fellowship. Insights Imaging 13, 111 (2022). https://doi.org/10.1186/s13244-022-01252-1
- Urogenital neoplasms
- Prostatic neoplasms
- Magnetic resonance imaging