Skip to main content
Insights into Imaging
Download PDF
  • Original Article
  • Open access
  • Published:

Machine learning-based CT radiomics approach for predicting WHO/ISUP nuclear grade of clear cell renal cell carcinoma: an exploratory and comparative study

Insights into Imaging volume 12, Article number: 170 (2021) Cite this article

Abstract

Purpose

To investigate the predictive performance of machine learning-based CT radiomics for differentiating between low- and high-nuclear grade of clear cell renal cell carcinomas (CCRCCs).

Methods

This retrospective study enrolled 406 patients with pathologically confirmed low- and high-nuclear grade of CCRCCs according to the WHO/ISUP grading system, which were divided into the training and testing cohorts. Radiomics features were extracted from nephrographic-phase CT images using PyRadiomics. A support vector machine (SVM) combined with three feature selection algorithms such as least absolute shrinkage and selection operator (LASSO), recursive feature elimination (RFE), and ReliefF was performed to determine the most suitable classification model, respectively. Clinicoradiological, radiomics, and combined models were constructed using the radiological and clinical characteristics with significant differences between the groups, selected radiomics features, and a combination of both, respectively. Model performance was evaluated by receiver operating characteristic (ROC) curve, calibration curve, and decision curve analyses.

Results

SVM-ReliefF algorithm outperformed SVM-LASSO and SVM-RFE in distinguishing low- from high-grade CCRCCs. The combined model showed better prediction performance than the clinicoradiological and radiomics models (p < 0.05, DeLong test), which achieved the highest efficacy, with an area under the ROC curve (AUC) value of 0.887 (95% confidence interval [CI] 0.798–0.952), 0.859 (95% CI 0.748–0.935), and 0.828 (95% CI 0.731–0.929) in the training, validation, and testing cohorts, respectively. The calibration and decision curves also indicated the favorable performance of the combined model.

Conclusion

A combined model incorporating the radiomics features and clinicoradiological characteristics can better predict the WHO/ISUP nuclear grade of CCRCC preoperatively, thus providing effective and noninvasive assessment.

Key points

  • Nephrographic-phase CT radiomics is valuable in predicting the WHO/ISUP nuclear grade of CCRCC.

  • Machine learning can noninvasively predict the WHO/ISUP nuclear grade of CCRCC.

  • CT radiomics integrated with clinicoradiological parameters can facilitate differentiating between low- and high-grade CCRCCs with improved diagnostic efficacy.

Introduction

Renal cell carcinoma accounts for 5% and 3% of all diagnosed cancers in men and women, respectively, and clear cell renal cell carcinoma (CCRCC) represents the most common subtype (∼ 80%) [1,2,3]. With a relatively poor prognosis, there is great interest in the field for improving diagnostic accuracy in order to start antineoplastic protocols at the early stage of CCRCC [4], because its biological aggressiveness significantly affects the prognosis. The pathological nuclear grade is an independent prognostic factor for CCRCC [5, 6]. Although the four-tiered Fuhrman grading system (FGS) for the pathological classification of CCRCC is widely used before, the 2016 World Health Organization/International Society of Urological Pathology (WHO/ISUP) grading system has achieved widespread usage and has now replaced the FGS globally [7, 8]. This system can be simplified as two-tiered classification combining grade I and II as low-grade and grade III and IV as high-grade. Moreover, low-grade cancers are generally considered less aggressive than high-grade ones [9]. The two-tiered classification has been verified to predict cancer-specific mortality and guide clinical practice in the same way as four-tiered systems, while it can reduce inter-observer variability and promote clinical practice [10, 11].

Percutaneous biopsy is a common method that can identify the pathology of the lesions, but it may be controversial because of invasive operation and sampling bias and even result in the increased risk of complications [12, 13]. Moreover, tumor heterogeneity refers to the existence of different subpopulations of cells, which can show distinct genotypes and divergent biological behaviors in different parts of a tumor. Thus, a noninvasive approach that can provide more information of lesions without the spatial and temporal restriction in tissue sampling is urgently needed, because it is too hard to biopsy each part of an entire tumor [14].

Despite its status as a routine noninvasive method to detect CCRCC, the routine computed tomography (CT) has the limitative power to differentiate renal cancer histologic grade with high consistency and accuracy [15]. Since resecting radiographically suspicious CCRCC without a tissue diagnosis is recommended, and this may lead to overtreatment in patients with low-grade CCRCC [16, 17], an exploration of the noninvasively preoperative differentiating between low- and high-nuclear grade of CCRCCs is urgent. Radiomics analysis enables the measurement of repetitive texture patterns at the voxel or pixel levels of medical images that are beyond the identification of the naked eye [18,19,20]. Previous investigations have shown that CT-based radiomics analysis performed efficiently in differentiating between low- and high-grade CCRCCs [21,22,23,24]. It might be a promising noninvasive assessment for predicting the nuclear grade of CCRCC. To our knowledge, most studies only constructed machine learning (ML) models using radiomics features extracted from CT images rather than a comprehensive model combined with those and clinicoradiological information. Furthermore, no previous studies have evaluated the performance of nephrographic-phase (NP) CT radiomics analysis for predicting the nuclear grade of CCRCC. Therefore, this study aims to investigate if radiomics features extracted from NP CT images combined with clinicoradiological characteristics may have potential in preoperatively differentiating the WHO/ISUP nuclear grade of CCRCC.

Materials and methods

Patient cohort

This retrospective study was approved by the Institutional Review Board of the First Affiliated Hospital of Chongqing Medical University, and the requirement for the acquisition of informed consent from patients was waived. The initial query yielded a target population of 808 patients with pathologically confirmed CCRCC who underwent partial or radical nephrectomy between January 2013 and October 2020 in our institution. Finally, a total of 406 patients with 330 low-grade and 76 high-grade CCRCCs were included in this study based on the following exclusion criteria: (1) pathology grade that was not classified according to the WHO/ISUP grading system (n = 243); (2) absence of NP CT images (n = 117); (3) images with poor definition or severe artifacts (n = 31); (4) a history of radiotherapy or chemotherapy before surgery (n = 10); and (5) radiomics features could not be extracted due to an undersized tumor volume (n = 1). The flowchart of this study is presented in Fig. 1. Moreover, the synthetic minority oversampling technique was used to increase the cases of high-grade CCRCC by oversampling for data balance [25].

Fig. 1
figure 1

Flowchart of the procedures for this study (CCRCC clear cell renal cell carcinoma, CT computed tomography, ROI region of interest)

Full size image

Nuclear grade and clinical characteristics

Two independent histopathological specialists re-evaluated each CCRCC sample regarding nuclear grade based on the criteria of the 2016 WHO/ISUP classification [8]. Discordant reports were resolved by a third senior histopathologist. We exhibit four hematoxylin–eosin staining slides with different magnifications from four patients with WHO/ISUP grading I–IV CCRCCs (Additional file 1: Figure S1). Data on the clinical characteristics that were presumed potentially grading-correlated (age, sex, body mass index [BMI], smoking history, hypertension history, diabetes history, tumor location, resection surgical procedure, etc.) and were extracted from the electronic medical record system of our institution.

CT acquisition

All patients underwent a routine preoperative abdominal CT scan performed on a GE Discovery 750 HD (GE Healthcare, Milwaukee, WI) multidetector scanner. The parameters for CT imaging were as follows: tube voltage, 120–140 kV; tube current, 220–300 mAs; detector collimation, 0.625×64 mm; matrix, 512 × 512; slice thickness, 5 mm. All patients were injected with nonionic intravenous contrast agent, via the antecubital vein with mechanical power injector, according to their weight (1 mL/kg body weight, with a maximum of 150 mL). Phase and delay time were as follows: Phase 1, unenhanced; Phase 2, postcontrast corticomedullary phase (CMP): 25–28 s after contrast agent was administrated; Phase 3, postcontrast nephrographic phase (NP): 65–70 s after contrast agent was administrated; and Phase 4, postcontrast excretory phase [26].

Image analysis

The semantic annotations of CT images and the corresponding diagnostic criteria were as follows: (a) tumor size, defined as the maximum diameter on transverse images; (b) intratumoral necrosis, defined as the non-enhanced fluid region of the tumor, which was greater than 50% of the tumor [27]; (c) cystic degeneration, defined as target lesion showing uniform water density and signal intensity, but no enhancement on enhancement examination [28]; (d) intratumoral calcification, interpreted as obvious dense shadows in the parenchyma that were speckled, lined, or shell-shaped; (e) violation of the renal capsule, interpreted as abnormal lesion violating the margin of the renal capsule; (f) intratumoral angiogenesis, defined as vascular enhancement observed in the parenchyma of the cortical stage tumor [27, 29]; (g) venous invasion, interpreted as radiological characteristics of tumor thrombosis in the renal vein and inferior vena cava [27]; (h) perinephric metastasis, defined as perinephric invasion phenomenon on CT images; and (i) distant metastasis, considered as metastasis in the lung, liver, bone, brain, or other organs via the blood or lymphatics. In our study, two radiologists with 10 or more years of experience in renal imaging who were blinded to histopathological results independently identified and evaluated these characteristics. Any discrepancy was resolved by reaching a consensus via discussion, and the results agreed on were used for further analysis.

Tumor segmentation

All CT images were downloaded in DICOM format from the pictured archiving and communication system (Carestream, Canada) at their original dimensions and resolution and loaded into ITK-SNAP software version 3.8 [30]. A radiologist with ≥ 10 years of experience in abdominal imaging who was blinded to the pathological results (reader 1) meticulously manually delineated the regions of interest (ROIs) in a slice-by-slice manner (Fig. 2). To evaluate the reproducibility of radiomics features, ROI-based radiomics features of 30 randomly selected patients (from the whole study cohort) were re-extracted by reader 1 and another radiologist with 15 years of experience (reader 2). Thereafter, the intraclass correlation coefficient (ICC) values of both intra- and inter-observer agreement analyses were calculated to evaluate consistency and reproducibility in terms of feature extraction, where features with ICC values > 0.80 were included in the subsequent analysis. Inter-observer variation refers to the discrepancy between the results obtained by two or more observers performing the same ROI detection. Intra-observer variation refers to the discrepancy in the measurements of one observer when performing an experiment more than once.

Fig. 2
figure 2

Examples of manually delineated regions of interest (ROIs) on NP images. a, b The delineation of ROI on two patients with low-grade CCRCC. c, d The delineation of ROI on two patients with high-grade CCRCC

Full size image

Radiomics feature extraction

All images were preprocessed before radiomics feature extraction as follows: first, the images and ROIs were resampled to an isotropic voxel size of 1 × 1 × 1 mm3 using B-spline interpolation; second, we focused on the chosen region and divided by standard deviation to normalize the images; third, the gray level of the image was discretized by a fixed bin width of 25 in the histogram. An open-source PyRadiomics library [31] was employed to extract radiomics features, which were divided into the following three subgroups: (1) descriptors of the size and shape of the ROI, such as the volume and maximum surface, compactness, and sphericity of the tumor; (2) first-order statistics features, such as the mean, median, maximum, and minimum values, that described the distribution of voxel intensities within tumor; and (3) second- and higher-order statistics features (texture features) that reflected changes in the gray levels of image space and were used to measure the inter-relationships between voxel distributions within tumor. Gray-level co-occurrence matrix, gray-level run-length matrix, gray-level size-zone matrix, and gray-level dependence matrix were included in these features.

Prediction model construction

The following three models were built to predict the WHO/ISUP grade in this study: clinicoradiological, radiomics, and combined models. To construct the clinicoradiological model, univariate regression was first used to analyze radiological and clinical characteristics, such as sex, age, and intratumoral necrosis. Significant variables were further selected for the multivariate regression model. Finally, variables with p value < 0.05 were adopted. The radiomics-based ML model was constructed using a support vector machine (SVM). To obtain the top of prediction performance, different feature selection algorithms such as least absolute shrinkage and selection operator (LASSO), recursive feature elimination (RFE), and ReliefF were employed to select suitable radiomics features, and those features from different feature selection algorithms were fed into SVM for the prediction performance comparison, respectively. The combined model was constructed and analyzed using the SVM by gathering the selected radiological and clinical characteristics as well as radiomics features. All of these procedures were implemented using the scikit-learn library in Python (version 3.6).

Model evaluation

Performance metrics, including sensitivity, specificity, accuracy, positive predictive value (PPV), negative predictive value (NPV), and area under the receiver operating characteristic (ROC) curve (AUC), were used to evaluate the performance of the three prediction models. The DeLong test was performed as a nonparametric approach for the comparison of ROC curves in AUC values. In the testing cohort, calibration curve analysis was used to assess the similarity between the predicted and observed outcomes of the model, accompanied by the Hosmer–Lemeshow test. Furthermore, decision curve analysis (DCA) was conducted to demonstrate the clinical net benefit of the model. The net reclassification index (NRI) was used to evaluate the prediction ability of the model in clinical utility. To minimize perturbation problems in feature selection and to examine the reproducibility of experimental results [32], we randomly assigned the patients to a training or testing cohort 10 times. Categorizing the original dataset into different cohorts was stratified and shuffled to ensure a similar CCRCC nuclear grade distribution across the datasets. Overall, 30% of the data were taken as an independent testing cohort, whereas the rest were taken as the training and validation cohorts for the model via fivefold cross-validation. Stratification into the training cohort was automatically performed without user intervention to avoid selection bias. Subsequently, the model was reconstructed and verified repeatedly.

Statistical analysis

Categorical variables are expressed as counts (n) and percentages (%), whereas continuous variables are presented as mean values ± standard deviations or as medians with interquartile ranges. Differences in characteristics across the three datasets were analyzed using one-way analysis of variance or the Kruskal–Wallis test for normally or non-normally distributed continuous variables, followed by a post hoc test, as appropriate. Student’s t test or the Wilcoxon test was used for the comparison of continuous variables between groups. Categorical variables were subjected to the Chi-square test or Fisher’s exact test. The inter-observer agreement of CT findings for low- and high-grade CCRCCs between two radiologists was evaluated using kappa statistics. A forward stepwise regression was used to refine the regression model according to the Akaike information criterion. To correct for multiple comparisons, we adjusted the p values by false discovery rate correction using the Benjamini–Hochberg method [33]. All statistical analyses were performed using R software version 3.5.2 (http://www.rproject.org) with “pROC”, “rms”, and “DecisionCurve” packages. A two-tailed p value of < 0.05 was considered statistically significant.

Results

Clinicoradiological characteristics between the low- and high-grade groups

Out of 406 patients enrolled in this study, 240 were male and 166 were female, with an average age of 57.48 ± 12.10 years (range 16–83 years). The baseline clinical characteristics of patients are summarized in Table 1. In the patient cohort, 330 patients were diagnosed with low-grade CCRCC, whereas the rest were diagnosed with high-grade CCRCC. The majority of patients with high-grade tumors (n = 56, 73.7%) underwent radical nephrectomy, whereas most patients with low-grade tumors preferred partial nephrectomy (n = 192, 58.2%, p < 0.001). High-grade and low-grade cohorts significantly differed with respect to tumor size (5.82 ± 2.85 cm vs. 4.21 ± 2.02 cm; range: 0.8–14.6 cm, p < 0.001), hematuria symptoms (p = 0.023), distant metastasis (p = 0.035), intratumoral necrosis (p < 0.001), calcification (p < 0.001), violation of the renal capsule (p < 0.001), angiogenesis (p < 0.001), venous invasion (p < 0.001), and perinephric metastasis (p < 0.001).

Table 1 Clinical and radiological characteristics of patients involved in this research
Full size table

Clinicoradiological characteristics among the training, validation, and testing cohorts

Table 2 shows the differences in clinicoradiological features between patients with low- and high-grade CCRCCs in the training, validation, and testing cohorts. Clinicoradiological characteristics of those are summarized in Table 3. Except for violation of the renal capsule (P < 0.001), no significant differences in either clinical or radiological features were identified between the different cohorts.

Table 2 Comparison of demographic and radiological characteristics between high- and low-grade CCRCCs
Full size table
Table 3 Clinical and radiological characteristics between three cohorts
Full size table

Clinicoradiological model construction

Kappa analysis indicated that the inter-observer agreement of CT findings for low- and high-grade CCRCCs between the two radiologists were highly consistent, yielding kappa values of 0.779–0.923 (Table 4). Based on the results of univariate analysis, indicators such as tumor size, hematuria symptoms, intratumoral necrosis, calcification, violation of the renal capsule, angiogenesis, venous invasion, and perinephric metastasis showed significantly different between high- and low-grade groups were included in the multivariate analysis (Table 4). As a result, tumor necrosis (odds ratio [OR] = 2.745, 95% confidence interval [CI] 1.424–5.292, p = 0.003), tumor calcification (OR = 4.293, 95% CI 1.629–11.314, p = 0.003), and angiogenesis (OR = 3.805, 95% CI 1.741–8.313, p = 0.001) were presumed to be independent factors of high-grade level and thus acted as clinical features in the clinicoradiological model construction.

Table 4 Risk factors for WHO/ISUP nuclear grade of CCRCC according to univariate and multivariate analysis
Full size table

Radiomics feature extraction and radiomics model construction

A total of 972 features of NP CT images were extracted from the ROIs using the PyRadiomics package, and those with ICC values > 0.8 on both intra- and inter-observer agreement analyses were retained. A dimensionality reduction was conducted, and 16 features were finally selected to build the radiomics model. The selected features are shown in Fig. 3. The classifiers such as SVM-LASSO, SVM-RFE, and SVM-ReliefF were utilized  for model construction. Their ability to distinguish low- from high-grade CCRCCs is summarized in Table 5. In testing cohort, SVM-ReliefF yielded an AUC value of 0.787 (95% CI 0.710–0.892), whereas the AUC values of SVM-RFE and SVM-LASSO were 0.761 (95% CI 0.648–0.893) and 0.754 (95% CI 0.652–0.889). With an accuracy of 0.734 (95% CI 0.616–0.827), a sensitivity of 0.822 (95% CI 0.737–0.919), and a specificity of 0.765 (95% CI 0.634–892), SVM-ReliefF turned into the best performer among the three classifiers. A comparison of the AUCs of the three algorithms in each data set is displayed in Fig. 4.

Fig. 3
figure 3

Diagram of the feature selection result. The bar plot represents the weight of each feature in the support vector machine

Full size image
Table 5 Predictive performance of three classifiers: SVM-LASSO, SVM-RFE, and SVM-ReliefF
Full size table
Fig. 4
figure 4

Predictive performance of three machine learning algorithms: SVM-LASSO, SVM-RFE, and SVM-ReliefF. a Receiver operating characteristic (ROC) curve analysis for the training cohort. b ROC curve analysis for the validation cohort. c ROC curve analysis for the testing cohort

Full size image

Comparison of the performance among clinicoradiological, radiomics, and combined models

As the optimum algorithm of the three classifiers, SVM-ReliefF was chosen to predict WHO/ISUP nuclear grade of CCRCC by analyzing features contained in clinicoradiological, radiomics, and combined models. AUC, sensitivity, specificity, PPV, and NPV were calculated to assess the prediction performance of models. As exhibited in Fig. 5a–c, compared with the clinicoradiological and radiomics models, the combined model showed the best predictive efficacy in distinguishing low- from high-grade CCRCCs with the highest AUC values in training, validation, and testing cohorts (p < 0.05, DeLong test). The AUC values of the combined model were 0.887 (95% CI 0.798–0.952) and 0.859 (95% CI 0.748–0.935) in the training and validation cohorts, which were higher than those of the radiomics model with AUC values of 0.860 (95% CI 0.759–0.963) and 0.824 (95% CI 0.736–0.915), while the clinicoradiological model demonstrated the worst performance with AUC values of 0.752 (95% CI 0.649–0.870) and 0.703 (95% CI 0.592–0.844) respectively. In the testing cohort, the combined model yielded an AUC value of 0.828 (95% CI 0.731–0.929) (radiomics model: 0.787 [95% CI 0.710–0.892]; clinicoradiological model: 0.637 [95% CI 0.511–0.769]), with an accuracy of 0.816 (95% CI 0.742–0.925), a sensitivity of 0.856 (95% CI 0.778–0.916) and a specificity of 0.780 (95% CI 0.695–0.857), which showed the best prediction performance in differentiating the WHO/ISUP nuclear grade. The detailed predictive performance of the three models are summarized in Table 6, and the confusion matrices of the combined model in the testing cohort for the random splitting process of 10-times runs are shown in Additional file 1: Figure S2.

Fig. 5
figure 5

Predictive performance of SVM-ReliefF classifier in clinicoradiological, radiomics, and combined models. a Receiver operating characteristic (ROC) curve analysis for the training cohort. b ROC curve analysis for the validation cohort. c ROC curve analysis for the testing cohort

Full size image
Table 6 Predictive performance of combined model, radiomics model, and clinicoradiological model
Full size table

Clinical usefulness

The calibration curves of these three models for predicting low- and high-nuclear grade in CCRCC are shown in Fig. 6a. The calibration curve for the combined model demonstrated good agreement between observations and predictions in the testing cohort, accompanied by the Hosmer–Lemeshow test (p = 0.487, Fig. 6a) and followed by the radiomics model (p = 0.321, Fig. 6a). However, there were differences between observations and predictions for the clinicoradiological model in the testing cohort (p = 0.04, Fig. 6a). DCA indicated a higher net benefit for the combined model in distinguishing low- from high-grade CCRCCs than the other models (Fig. 6b). The threshold probability was within the range of 0.15–0.98. In the testing cohort, both the combined and radiomics models achieved better discrimination performance than the clinicoradiological model (p = 0.010 and 0.021, NRI test). Additionally, the discrimination ability of the combined model was also superior to that of the radiomics model (p = 0.038, NRI test).

Fig. 6
figure 6

a Calibration curve and (b) decision curve analysis of the combined model, radiomics model, and clinicoradiological model in the testing cohort

Full size image

Discussion

In this study, we utilized NP CT based radiomics features combined with clinicoradiological characteristics to build three models such as the clinicoradiological, radiomics and combined models for distinguishing between low-and high-grade CCRCCs. The results demonstrated that NP CT based radiomics was valuable in predicting the WHO/ISUP nuclear grade of CCRCC, and associating the radiomics features with clinicoradiological characteristics could improve the predictive performance, compared with clinicoradiological and radiomics models alone. The combined model exhibited the best predictive performance and clinical usefulness with satisfactory reproducibility and reliability.

Although percutaneous biopsy is the routine way to identify the preoperative pathology grade, it is an invasive approach, and patients may suffer from sampling bias and the risk of complications [12, 13]. Some emerging imaging technologies such as dual-energy spectral CT, intravoxel incoherent motion imaging and diffusion kurtosis imaging could provide valuable information on the assessment of pathological grading of CCRCC [34, 35]. As a recommended noninvasive detection technology for CCRCC, CT may provide to improve the accuracy of percutaneous biopsy. CT radiomics as a burgeoning technique, is able to quantify tumor heterogeneity by the spatial arrangement of imaging voxels with signal intensity variations and detect the imperceptible differences of the intensity distribution in medical images, thus noninvasively predicting pathological grade of tumor with outstanding performance [36,37,38]. Recently, the WHO/ISUP grading system has taken the place of the former Fuhrman grading system and received acceptance in current clinical practice [39]. There are only a few published papers that have studied the application of CT radiomics to predicting the WHO/ISUP nuclear grade of CCRCC [40,41,42,43]. However, no previous studies used radiomics features extracted from NP CT images combined with clinicoradiological characteristics to develop the prediction model.

Most previous studies constructed ML models only based on CT radiomics features, which ignored the importance of traditional clinical and radiological information [26, 41, 44]. In our study, some parameters with clinical and radiological information that have the potential to be risk factors in the WHO/ISUP nuclear grade of CCRCC determined by multivariate regression model were fed into ML model, and the radiomics features combined with the clinicoradiological characteristics showed a better performance for the discrimination of CCRCC grades. Our result is in concordance with the results of previous studies [22, 40, 42, 45,46,47], and this is reinforced by the results of previous studies on the association between clinicoradiological characteristics and the nuclear grade of CCRCC [22, 48]. Xu et al. [49] observed that coagulative necrosis often occurs in the CT images of patients with high-grade CCRCC. In addition, our study also found intratumoral necrosis, calcification, angiogenesis, and perinephric metastasis could be risk factors of the pathological grading of CCRCC. The previously mentioned studies have shown the potential of quantitative CT features in preoperatively predicting the WHO/ISUP nuclear grade of CCRCC, but their sample sizes were relatively small. Our study with a larger sample size would provide support for verification of the reproducibility of CT radiomics in the application of predicting WHO/ISUP nuclear grade of CCRCC using an independent testing cohort. Furthermore, we firstly demonstrated that the radiomics features from only NP CT images could obtain a preferable predictive performance in distinguishing low- from high-grade CCRCCs.

The preoperative noninvasive knowledge of CCRCC grades may contribute the clinical managements and impact clinical decisions. The new WHO/ISUP grading system is a prognostic factor for CCRCC whose grades were strongly related to patient outcomes and tumor biological behavior [50]. If low-grade CCRCC can be identified preoperatively, the treatment may be different, and the patients with low-grade CCRCC may be candidates for less invasive procedures, such as radiofrequency ablation and nephron-saving surgery, whereas radical interventions are strongly recommended in patients with high-grade CCRCC [11]. Moreover, partial nephrectomy can preserve partial renal function, thus reducing rates of infection, overall mortality and the incidence of cardiovascular disease [51]. In the clinical management, patients with low-grade CCRCC are less likely to suffer from paraneoplastic syndrome and distant metastasis, so accurately preoperative prediction of CCRCC grades may reduce unnecessary examinations, such as positron emission tomography-computed tomography and radionuclide imaging, decreasing the economic burden and incidence of complications resulting from the usage of contrast agent. Considering the latest update of the European Association of Urology Guidelines on renal cell carcinoma [7], patients with suspicious CCRCC are strongly recommended to use multiphasic contrast-enhanced CT imaging of the abdomen for diagnostic assessment and staging of renal tumors. Therefore, medical images can become a valuable source of information, and radiomics may be used as a noninvasive method for characterizing and classifying lesions. Compared with percutaneous biopsy, the radiomics has the advantages of noninvasion, easy-to-repeat operation and no complications. Our result indicates that combining NP CT based radiomics and clinicoradiological characteristics would provide good predictive performance in distinguishing between patients with low- and high-grade CCRCCs. This could provide a reference for clinicians to choose a suitable treatment strategy. However, further larger prospective or prospective studies with multi-centric data are necessary to validate the performance of our proposed combined model in the future. A good performance does not always imply a clinically applicable and reliable model [52], and however, we found that most previous studies did not evaluate the clinical utility of their models [21, 22]. In our study, we used calibration curve and decision curve analyses to evaluate the discrimination performance of the three predictive models, which showed the combined model has higher clinical usefulness with a good agreement between observations and predictions and a preferable discrimination performance, thus indicating practical value.

This study has several limitations. First, although 406 subjects with all-sided data were included, this retrospective study was conducted in a single institution, which may inevitably result in selection bias and make it less generalizable to other institutions. Therefore, further studies should enroll the larger simple sizes from different centers and scanners to improve the generalization of the prediction model. Moreover, only single-phase CT images were used in this study, and comparison with other phases should be considered. Second, an automatic segmentation algorithm should be developed to replace the manually sketching of ROI to increase the stability of prediction model. Third, although we have performed calibration statistics and decision curve analyses on the prediction models and revealed that the combined model had the best discrimination ability, the clinical application should be further validated using larger prospective or prospective studies with multi-centric data. Fourth, CCRCC is a subtype of malignant renal tumor. Despite its high occurrence, other renal cancer subtypes could have similar radiological features, and therefore, should be evaluated in future studies.

In conclusion, we demonstrated that NP CT images could become a valuable source of information, and radiomics analysis of those may be used as a potentially noninvasive method for distinguishing low- from high-grade CCRCCs. The ML model associating the radiomics features with clinicoradiological characteristics could improve the predictive performance for WHO/ISUP nuclear grade of CCRCC, which may be a promising and feasible way to assist in the clinical managements and therapeutic decisions.

Availability of data and materials

The original contributions presented in the study are included in the article.

Abbreviations

AUC:

Area under the ROC curve

BMI:

Body mass index

CCRCC:

Clear cell renal cell carcinoma

CMP:

Corticomedullary phase

CT:

Computed tomography

DCA:

Decision curve analysis

FGS:

Fuhrman grading system

ICC:

Intraclass correlation coefficient

LASSO:

Least absolute shrinkage and selection operator

ML:

Machine learning

NP:

Nephrographic phase

NPV:

Negative predictive value

NRI:

Net reclassification index

PACS:

Pictured archiving and communication system

PPV:

Positive predictive value

RFE:

Recursive feature elimination

ROC:

Receiver operating characteristic

ROI:

Region of interest

SVM:

Support vector machine

WHO/ISUP:

World Health Organization/International Society of Urological Pathology

References

  1. Escudier B, Porta C, Schmidinger M et al (2019) Renal cell carcinoma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol 30:706–720

    CAS  PubMed  Google Scholar 

  2. Capitanio U, Bensalah K, Bex A et al (2019) Epidemiology of renal cell carcinoma. Eur Urol 75:74–84

    PubMed  Google Scholar 

  3. Turajlic S, Swanton C, Boshoff C (2018) Kidney cancer: the next decade. J Exp Med 215:2477–2479

    CAS  PubMed  PubMed Central  Google Scholar 

  4. Hsieh J, Purdue M, Signoretti S et al (2017) Renal cell carcinoma. Nat Rev Dis Primers 3:17009

    PubMed  PubMed Central  Google Scholar 

  5. Minardi D, Lucarini G, Mazzucchelli R et al (2005) Prognostic role of Fuhrman grade and vascular endothelial growth factor in pT1a clear cell carcinoma in partial nephrectomy specimens. J Urol 174:1208–1212

    CAS  PubMed  Google Scholar 

  6. Ljungberg B, Bensalah K, Canfield S et al (2015) EAU guidelines on renal cell carcinoma: 2014 update. Eur Urol 67:913–924

    PubMed  Google Scholar 

  7. Ljungberg B, Albiges L, Abu-Ghanem Y et al (2019) European association of urology guidelines on renal cell carcinoma: the 2019 update. Eur Urol 75:799–810

    PubMed  Google Scholar 

  8. Moch H, Cubilla A, Humphrey P, Reuter V, Ulbright T (2016) The 2016 WHO classification of tumours of the urinary system and male genital organs-part A: renal, penile, and testicular tumours. Eur Urol 70:93–105

    PubMed  Google Scholar 

  9. Delahunt B, Cheville J, Martignoni G et al (2013) The International Society of Urological Pathology (ISUP) grading system for renal cell carcinoma and other prognostic parameters. Am J Surg Pathol 37:1490–1504

    PubMed  Google Scholar 

  10. Kuthi L, Jenei A, Hajdu A et al (2017) Prognostic factors for renal cell carcinoma subtypes diagnosed according to the 2016 WHO renal tumor classification: a study involving 928 patients. Pathol Oncol Res POR 23:689–698

    PubMed  Google Scholar 

  11. Bhatt J, Finelli A (2014) Landmarks in the diagnosis and treatment of renal cell carcinoma. Nat Rev Urol 11:517–525

    PubMed  Google Scholar 

  12. Ficarra V, Martignoni G, Maffei N et al (2005) Original and reviewed nuclear grading according to the Fuhrman system: a multivariate analysis of 388 patients with conventional renal cell carcinoma. Cancer 103:68–75

    PubMed  Google Scholar 

  13. Marconi L, Dabestani S, Lam T et al (2016) Systematic review and meta-analysis of diagnostic accuracy of percutaneous renal tumour biopsy. Eur Urol 69:660–673

    PubMed  Google Scholar 

  14. Kutikov A, Smaldone M, Uzzo R, Haifler M, Bratslavsky G, Leibovich B (2016) Renal mass biopsy: always, sometimes, or never? Eur Urol 70:403–406

    PubMed  Google Scholar 

  15. Kang S, Huang W, Pandharipande P, Chandarana H (2014) Solid renal masses: what the numbers tell us. AJR Am J Roentgenol 202:1196–1206

    PubMed  PubMed Central  Google Scholar 

  16. Campbell S, Novick A, Belldegrun A et al (2009) Guideline for management of the clinical T1 renal mass. J Urol 182:1271–1279

    PubMed  Google Scholar 

  17. Ljungberg B, Cowan N, Hanbury D et al (2010) EAU guidelines on renal cell carcinoma: the 2010 update. Eur Urol 58:398–406

    PubMed  Google Scholar 

  18. Erickson B, Korfiatis P, Akkus Z, Kline T (2017) Machine learning for medical imaging. Radiographics 37:505–515

    PubMed  Google Scholar 

  19. Lubner M, Smith A, Sandrasegaran K, Sahani D, Pickhardt P (2017) CT texture analysis: definitions, applications, biologic correlates, and challenges. Radiographics 37:1483–1503

    PubMed  Google Scholar 

  20. van Timmeren J, Cester D, Tanadini-Lang S, Alkadhi H, Baessler B (2020) Radiomics in medical imaging-"how-to" guide and critical reflection. Insights Imaging 11:91

    PubMed  PubMed Central  Google Scholar 

  21. Cui E, Li Z, Ma C et al (2020) Predicting the ISUP grade of clear cell renal cell carcinoma with multiparametric MR and multiphase CT radiomics. Eur Radiol 30:2912–2921

    PubMed  Google Scholar 

  22. Zhou H, Mao H, Dong D et al (2020) Development and external validation of radiomics approach for nuclear grading in clear cell renal cell carcinoma. Ann Surg Oncol 27:4057–4065

    PubMed  Google Scholar 

  23. Kocak B, Durmaz E, Ates E, Kaya O, Kilickesmez O (2019) Unenhanced CT texture analysis of clear cell renal cell carcinomas: a machine learning-based study for predicting histopathologic nuclear grade. AJR Am J Roentgenol. https://doi.org/10.2214/ajr.18.20742:W1-W8

    Article  PubMed  Google Scholar 

  24. Shu J, Tang Y, Cui J et al (2018) Clear cell renal cell carcinoma: CT-based radiomics features for the prediction of Fuhrman grade. Eur J Radiol 109:8–12

    PubMed  Google Scholar 

  25. Blagus R, Lusa L (2013) SMOTE for high-dimensional class-imbalanced data. BMC Bioinform 14:106

    Google Scholar 

  26. Lai S, Sun L, Wu J et al (2021) Multiphase contrast-enhanced CT-based machine learning models to predict the Fuhrman nuclear grade of clear cell renal cell carcinoma. Cancer Manag Res 13:999–1008

    PubMed  PubMed Central  Google Scholar 

  27. Jiang Y, Li W, Huang C et al (2020) A computed tomography-based radiomics nomogram to preoperatively predict tumor necrosis in patients with clear cell renal cell carcinoma. Front Oncol 10:592

    PubMed  PubMed Central  Google Scholar 

  28. Yan J, Chan J, Osman H et al (2021) Bosniak classification version 2019: validation and comparison to original classification in pathologically confirmed cystic masses. Eur Radiol. https://doi.org/10.1007/s00330-021-08006-5

    Article  PubMed  PubMed Central  Google Scholar 

  29. Meng X, Shu J, Xia Y, Yang R (2020) A CT-based radiomics approach for the differential diagnosis of sarcomatoid and clear cell renal cell carcinoma. Biomed Res Int 2020:7103647

    PubMed  PubMed Central  Google Scholar 

  30. Yushkevich P, Piven J, Hazlett H et al (2006) User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 31:1116–1128

    PubMed  Google Scholar 

  31. van Griethuysen J, Fedorov A, Parmar C et al (2017) Computational radiomics system to decode the radiographic phenotype. Can Res 77:e104–e107

    Google Scholar 

  32. Kocak B, Kus E, Kilickesmez O (2021) How to read and review papers on machine learning and artificial intelligence in radiology: a survival guide to key methodological concepts. Eur Radiol 31:1819–1830

    PubMed  Google Scholar 

  33. Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B (Methodol) 57:289–300

    Google Scholar 

  34. Marcon J, Graser A, Horst D et al (2020) Papillary vs clear cell renal cell carcinoma. Differentiation and grading by iodine concentration using DECT-correlation with microvascular density. Eur Radiol 30:1–10

    CAS  PubMed  Google Scholar 

  35. Ye J, Xu Q, Wang S, Zheng J, Dou W (2020) Quantitative evaluation of intravoxel incoherent motion and diffusion kurtosis imaging in assessment of pathological grade of clear cell renal cell carcinoma. Acad Radiol 27:e176–e182

    PubMed  Google Scholar 

  36. Bi W, Hosny A, Schabath M et al (2019) Artificial intelligence in cancer imaging: clinical challenges and applications. CA Cancer J Clin 69:127–157

    PubMed  PubMed Central  Google Scholar 

  37. Lambin P, Leijenaar R, Deist T et al (2017) Radiomics: the bridge between medical imaging and personalized Medicine (Baltimore). Nat Rev Clin Oncol 14:749–762

    PubMed  Google Scholar 

  38. Liu Z, Wang S, Dong D et al (2019) The applications of radiomics in precision diagnosis and treatment of oncology: opportunities and challenges. Theranostics 9:1303–1322

    PubMed  PubMed Central  Google Scholar 

  39. Warren A, Harrison D (2018) WHO/ISUP classification, grading and pathological staging of renal cell carcinoma: standards and controversies. World J Urol 36:1913–1926

    PubMed  PubMed Central  Google Scholar 

  40. Zheng Z, Chen Z, Xie Y, Zhong Q, Xie W (2021) Development and validation of a CT-based nomogram for preoperative prediction of clear cell renal cell carcinoma grades. Eur Radiol 31:6078–6086

    PubMed  Google Scholar 

  41. Wang R, Hu Z, Shen X et al (2021) Computed tomography-based radiomics model for predicting the WHO/ISUP grade of clear cell renal cell carcinoma preoperatively: a multicenter study. Front Oncol 11:543854

    PubMed  PubMed Central  Google Scholar 

  42. Yi X, Xiao Q, Zeng F et al (2020) Computed tomography radiomics for predicting pathological grade of renal cell carcinoma. Front Oncol 10:570396

    PubMed  Google Scholar 

  43. Ding J, Xing Z, Jiang Z et al (2018) CT-based radiomic model predicts high grade of clear cell renal cell carcinoma. Eur J Radiol 103:51–56

    PubMed  Google Scholar 

  44. Moldovanu C, Boca B, Lebovici A et al (2020) Preoperative predicting the WHO/ISUP nuclear grade of clear cell renal cell carcinoma by computed tomography-based radiomics features. J Pers Med 11:613668

    Google Scholar 

  45. Han D, Yu Y, Yu N et al (2020) Prediction models for clear cell renal cell carcinoma ISUP/WHO grade: comparison between CT radiomics and conventional contrast-enhanced CT. Br J Radiol 93:20200131

    PubMed  PubMed Central  Google Scholar 

  46. He X, Zhang H, Zhang T, Han F, Song B (2019) Predictive models composed by radiomic features extracted from multi-detector computed tomography images for predicting low- and high- grade clear cell renal cell carcinoma: a STARD-compliant article. Medicine 98:e13957

    PubMed  PubMed Central  Google Scholar 

  47. Yan L, Chai N, Bao Y, Ge Y, Cheng Q (2020) Enhanced computed tomography-based radiomics signature combined with clinical features in evaluating nuclear grading of renal clear cell carcinoma. J Comput Assist Tomogr 44:730–736

    PubMed  Google Scholar 

  48. Li Q, Liu Y, Dong D et al (2020) Multiparametric MRI radiomic model for preoperative predicting WHO/ISUP nuclear grade of clear cell renal cell carcinoma. J Magn Reson Imaging 52:1557–1566

    CAS  PubMed  Google Scholar 

  49. Xu K, Liu L, Li W et al (2020) CT-based radiomics signature for preoperative prediction of coagulative necrosis in clear cell renal cell carcinoma. Korean J Radiol 21:670–683

    PubMed  PubMed Central  Google Scholar 

  50. Frank I, Blute M, Cheville J, Lohse C, Weaver A, Zincke H (2002) An outcome prediction model for patients with clear cell renal cell carcinoma treated with radical nephrectomy based on tumor stage, size, grade and necrosis: the SSIGN score. J Urol 168:2395–2400

    PubMed  Google Scholar 

  51. Motzer R, Jonasch E, Agarwal N et al (2017) Kidney cancer, version 2.2017, NCCN clinical practice guidelines in oncology. J Natl Compr Cancer Netw 15:804–834

    Google Scholar 

  52. Kocak B, Kaya O, Erdim C, Kus E, Kilickesmez O (2020) Artificial intelligence in renal mass characterization: a systematic review of methodologic items related to modeling, performance evaluation, clinical utility, and transparency. AJR Am J Roentgenol 215:1113–1122

    PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge all clinicians and technicians of radiology department, urology department and pathology department in our institution, that provided us professional advice and guidance.

Funding

The project was funded by the Chongqing Municipal Health Committee Foundation Project (CQYC2020020318).

Author information

Author notes

  1. Yingjie Xv and Fajin Lv have contributed equally to this work

Authors and Affiliations

  1. Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, No. 1 Youyi Road, Chongqing, 400016, Yuzhong, China

    Yingjie Xv, Fajin Lv, Haoming Guo & Yineng Zheng

  2. Department of Urology, The First Affiliated Hospital of Chongqing Medical University, No. 1 Youyi Road, Chongqing, 400016, Yuzhong, China

    Yingjie Xv, Xiang Zhou, Hao Tan & Mingzhao Xiao

Authors
  1. Yingjie Xv
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fajin Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Haoming Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiang Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hao Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Mingzhao Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Yineng Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

MX, YZ and FL conceived the project. YX and YZ analyzed the data and wrote the paper. YX, XZ and HT collected the data. YZ, YX, FL and MX revised this paper. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Mingzhao Xiao or Yineng Zheng.

Ethics declarations

Ethics approval and consent to participate

This retrospective study was approved by the Institutional Review Board of the First Affiliated Hospital of Chongqing Medical University, and the requirement for patient informed consent was waived.

Consent for publication

No personal data or any identifiable statement beyond images are used in the manuscript.

Competing interests

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1

. Supplementary figures.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xv, Y., Lv, F., Guo, H. et al. Machine learning-based CT radiomics approach for predicting WHO/ISUP nuclear grade of clear cell renal cell carcinoma: an exploratory and comparative study. Insights Imaging 12, 170 (2021). https://doi.org/10.1186/s13244-021-01107-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13244-021-01107-1

Keywords