Skip to main content
Insights into Imaging
Download PDF
  • Original Article
  • Open access
  • Published:

T2-weighted MRI-based radiomics for discriminating between benign and borderline epithelial ovarian tumors: a multicenter study

Insights into Imaging volume 13, Article number: 130 (2022) Cite this article

Abstract

Background

Preoperative differentiation between benign and borderline epithelial ovarian tumors (EOTs) is challenging and can significantly impact clinical decision making. The purpose was to investigate whether radiomics based on T2-weighted MRI can discriminate between benign and borderline EOTs preoperatively.

Methods

A total of 417 patients (309, 78, and 30 samples in the training and internal and external validation sets) with pathologically proven benign and borderline EOTs were included in this multicenter study. In total, 1130 radiomics features were extracted from manually delineated tumor volumes of interest on images. The following three different models were constructed and evaluated: radiomics features only (radiomics model); clinical and radiological characteristics only (clinic-radiological model); and a combination of them all (combined model). The diagnostic performances of models were assessed using receiver operating characteristic (ROC) analysis, and area under the ROC curves (AUCs) were compared using the DeLong test.

Results

The best machine learning algorithm to distinguish borderline from benign EOTs was the logistic regression. The combined model achieved the best performance in discriminating between benign and borderline EOTs, with an AUC of 0.86 ± 0.07. The radiomics model showed a moderate AUC of 0.82 ± 0.07, outperforming the clinic-radiological model (AUC of 0.79 ± 0.06). In the external validation set, the combined model performed significantly better than the clinic-radiological model (AUCs of 0.86 vs. 0.63, p = 0.021 [DeLong test]).

Conclusions

Radiomics, based on T2-weighted MRI, can provide critical diagnostic information for discriminating between benign and borderline EOTs, thus having the potential to aid personalized treatment options.

Key points

  • T2-weighted MRI-based radiomics could preoperatively discriminate benign and borderline EOTs.

  • Radiomics combined with clinical/radiological characteristics help differentiate benign and borderline EOTs.

  • Different machine learning algorithms had different diagnostic performances.

Background

Borderline epithelial ovarian tumors (EOTs) have been classified as a separate category and account for approximately 10% to 20% of all EOTs [1, 2]. The peak incidence of borderline EOTs was at the age of 55–59 years, with a rate of approximately 4.5–7.3/10,0000 [3, 4]. The median age at diagnosis for borderline EOTs was around 50 years, and more than a third of cases occurred in women younger than 40 years of age [3,4,5]. One study showed that patients with borderline EOTs were mostly asymptomatic or had only abdominal pain or menstrual abnormalities, and borderline EOTs are closer to benign ones than to malignant ones [6]. Pathologically, borderline EOTs have no destructive stromal invasion [7]. However, borderline EOTs are considered as precursor lesions to ovarian cancer of the corresponding histologic type [8]. Misdiagnosing borderline EOTs as benign lesions may result in some patients choosing nonsurgical treatment, such as ultrasound follow-up, which carries a risk of resulting in borderline EOTs malignant transformation or spread [9]. Although conservative fertility surgery is recommended for both benign and borderline EOTs, gynecologists require a more objective and reliable preoperative evaluation for the latter to weigh the stakes between tumor recurrence and fertility preservation [10, 11]. Hence, there is a need for accurate preoperative differentiation between borderline and benign EOTs.

Ultrasound is the first-line choice for ovarian tumor diagnosis, but its sensitivity for the diagnosis of borderline EOTs was only 0.660 [12]. Magnetic resonance imaging (MRI) has been demonstrated to be superior to ultrasound for assessing complex ovarian lesions [13]. The advent of the ovarian-adnexal reporting data system (O-RADS) MRI score has improved the diagnostic accuracy of ovarian neoplasms [14]. Nevertheless, studies have shown that differentiating borderline from benign EOTs on conventional MRI remains a nontrivial challenge for radiologists due to the complexity of the tumor morphology and the similarity of the MRI signs [15, 16]. For example, Park et al. reported that there is no significant difference between borderline and benign EOTs in the number and size of separations on conventional MRI [17]. Upon considering the limitations of conventional MRI in differentiating borderline EOTs from benign EOTs, there is a clear need for new methods to aid the diagnosis.

Radiomics has emerged as a powerful tool in oncology research. This method can convert routine medical images into quantitative features, thus reflecting valuable information that cannot be identified by the naked eye [18, 19]. To date, MRI-based radiomics methods have been shown to assist radiologists in differentiating between type Ι and type ΙΙ epithelial ovarian cancers [20] and classifying benign and malignant ovarian tumors [21, 22]. A phantom study demonstrated that T2-weighted (T2W) images have advantages in radiomics because interobserver reproducibility was better for radiomics features derived from T1-weighted images (intraclass correlation coefficient [ICC] ≥ 0.75) than from T1-weighted images (ICC = 0.60–0.71) [23]. Previous studies have focused on the differentiation between malignant and borderline EOTs [24, 25]. However, to our knowledge, the potential role of T2W MRI-based radiomics in differentiating between benign and borderline EOTs has not been established.

Therefore, the primary aim of this retrospective multicenter study was to evaluate T2W MRI-based radiomics in preoperatively distinguishing between benign and borderline EOTs.

Methods

Patients

This retrospective multicenter study was approved by the institutional review boards, and the written informed consent was waived for this study. A review of clinical databases and the picture archiving and communication system was performed to retrospectively enroll consecutive patients from July 2013 to July 2021 at Center I, from January 2016 to June 2021 at Center II, and from January 2017 to January 2018 at Center III. The center information is shown in the Additional file 1 (Section 1). The inclusion criteria were as follows: (1) pathologically confirmed benign or borderline EOTs; (2) MRI scanning performed within at least 2 weeks before surgery. Patients were excluded based on the following criteria: (1) receiving any treatment before MRI examination and biopsy, including chemotherapy or radiotherapy; (2) lack of T2W sequences; (3) poor-quality MR images due to artifacts; (4) the tumor could not be fully displayed because of insufficient volume or too large of a tumor volume. In total, 417 patients (154 from Center I, 233 from Center II, and 30 from Center III) were enrolled in the study. Patients from Center I and Center II were stratified into the training and internal validation sets at a ratio of 8:2. Data from Center III were reserved for external validation set to evaluate the generalizability of the created models to data from separate institutions. The clinical characteristics of all patients, including age, menopausal status, parity, abdominal symptoms, carbohydrate antigen 125 (CA125), and human epididymis protein 4 (HE4), were obtained from patients’ electronic medical records. The details of the recruitment process are shown in Fig. 1.

Fig. 1
figure 1

Patient recruitment and workflow of radiomics analysis

Full size image

Image acquisition and tumor segmentation

Patients scanned on various 1.5 T or 3.0 T units with phased-array coils were all included in this study. Fat-suppressed (FS) T2W images were used in this study. The scanners and imaging parameters of FS T2W are summarized in the Supplementary Materials (Additional file 1: Table S1).

Tumor volumes of interest (VOIs) containing both the cystic and solid components were manually delineated slice-by-slice on FS T2W images by using ITK-SNAP software (v. 3.8.0, http://www.itksnap.org) [26]. Only the one with the largest maximum diameter on axial images was selected for segmentation if the tumor was multifocal in nature. Two examples of VOIs segmentation are shown in Fig. 2. Radiologist A, who had 10 years of experience in pelvic MRI diagnosis, first segmented the VOIs for all subjects. To evaluate the interobserver reproducibility, the VOIs of 30 patients randomly chosen from the training set were segmented by another radiologist (Radiologist B) who had 5 years of experience in pelvic MRI diagnosis. To assess the intraobserver reproducibility, Radiologist A repeated the segmentation procedure for all patients after one month. The interobserver and intraobserver reproducibility of VOIs was evaluated by ICCs, and ICCs > 0.80 are considered robust and reproducible [27]. The first segmentation of Radiologist A was used to create models. Referring to one previous study [28], the two radiologists who performed VOIs delineation also independently assessed the following conventional MRI characteristics: (1) ascites, which was classified as none, mild (limited to the Douglas pouch), moderate (limited to the pelvic cavity), or massive (beyond the pelvic cavity); (2) margin, which was classified as well-defined or ill-defined; (3) the number of loculi, which was classified as mild (< 3) or multilocular ( ≥ 3); (4) signal intensity (SI) of the solid component on FS T2W images (compared with adjacent external myometrium), which was classified as none, low, high, or mixed; (5) SI of the cystic component on FS T2W images (compared with urinary bladder), which was classified as low, moderate, or high; and (6) the maximum diameter. Disagreements between the two radiologists were rereviewed in consensus. Some examples referred to the evaluation of signal intensity are shown in Supplementary Materials (Additional file 1: Figs. S1 and S2). The two radiologists were blinded to the histopathologic results and clinical information of the tumors when reviewing MRI images.

Fig. 2
figure 2

Two representative examples of volumes of interest (VOIs) segmentation of benign and borderline EOTs in axial fat-suppressed T2-weighted images. a–c A 50-year-old woman with a right benign mucinous cystadenoma; d–f a 60-year-old woman with a left borderline mucinous cystadenoma; a, d the original images; b, e the VOIs of ovarian masses showing in red; c, f 3D renderings of the VOIs

Full size image

Feature extraction

Before radiomics processing, normalization was used to transform arbitrary gray intensity values into a standardized intensity range; all T2W images and masks were then isotopically resampled to 3 × 3 × 3 mm3 by using B-spline interpolation. A total of 1130 radiomics features were extracted from VOIs by using the PyRadiomics package (http://www.radiomics.io/pyradiomics.html) [29] in Python. Most radiomics features follow the image biomarker standardization initiative (IBSI) [30]. The custom settings and detailed information on radiomics features are included in Additional file 1 (Section 2).

Feature postprocessing

ComBat harmonization was performed on the radiomics features, which is desirable before building models, as it reduces the bias caused by different scanners (Additional file 1 [Section 3]) [31,32,33]. Radiomics features after ComBat harmonization were standardized by Z-score normalization (removing the mean and scaling to unit variance). Furthermore, we applied the synthetic minority oversampling technique (SMOTE) in the training set to reduce the bias of the sample imbalance [34]. Finally, features with ICCs < 0.8 were excluded.

Feature selection

Radiomics features had high dimensionality; thus, several feature selection steps were used. The Mann–Whitney U test was first performed to select statistically significant features between benign and borderline EOTs in the training set. Second, the importance weight of each feature was calculated by using Random Forest (RF) algorithm, and the correlation coefficient between every two features was calculated by Spearman correlation analysis. For any pair of features with correlation coefficients > 0.90, the one with the lowest importance weight was removed from the training data. Finally, the Least Absolute Shrinkage and Selection Operator (LASSO) algorithm was used to solve the multicollinearity problem, by selecting diagnosis-related features with only nonzero coefficients. More information on feature selection is shown in Additional file 1 (Section 4 and Additional file 1: Fig. S3).

Models building and evaluation

We used four different machine learning algorithms to construct radiomics models, including logistic regression (LR), support vector machine (SVM), RF, and Naive Bayes (NB). The best machine learning algorithm was selected by analyzing the fitting and generalization performance. We applied the learning curve to assess the trend of the training and cross-validation scores with the increase in sample size. If both the validation and training scores converge to a stable value, the model is considered not to benefit from additional training data. Furthermore, the learning curve can be used for comparison among multiple models. The higher the training and cross-validation scores, the better the fitting performance; the smaller the gap between the training and cross-validation score, the better the generalizability.

Next, we incorporated the clinical and conventional MRI characteristics that were statistically significant after univariate analysis into the radiomics model (combined model) to explore whether this can further improve the performance. These clinical and conventional MRI characteristics were also fed into a separate model (clinic-radiological model). Multiclass variables in this study were one-hot encoded before model building. To increase the comparability of the models, we selected the same machine learning algorithm as the one used in the best radiomics model. The outcomes of these three models were comprehensively compared to explore the optimal model with the best diagnostic efficiency.

The area under the ROC curve (AUC) was used as the main indicator for model evaluation and comparison. The sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and accuracy were also calculated. Overfitting means that the model cannot fit well on datasets other than the training data, which is an indication of the model's poor generalizability. To reduce overfitting, all models were constructed with tenfold cross-validation. The diagnostic performance of the models was evaluated by using these indicators averaged over the tenfold cross-validation iterations. The generalizability was assessed by analyzing the AUC of each model in the internal and external validation sets.

Statistical analysis

All statistical analyses and graphic production were performed using SPSS (v. 25; IBM), R (v. 4.11), and Python (v. 3.8.5). Normally distributed continuous variables are summarized as the means (± standard deviation), and non-normally distributed continuous variables are summarized as the medians (interquartile ranges). Continuous variables were analyzed by the Mann–Whitney U tests or independent sample t tests, and categorical variables were assessed by the Chi-square test or the Fisher’s exact tests. The DeLong test was used to compare the AUCs. A two-tailed p value of < 0.05 was considered significantly different.

Results

Patients

A total of 417 patients (mean age, 45.70 years; range, 11–95 years) with benign or borderline EOTs were recruited in this study. There were 309, 78, and 30 samples in the training set, internal validation set, and external validation set, respectively. No significant differences were seen in terms of age (p = 0.740), menopausal status (p = 0.581), parity (p = 0.219), abdominal symptoms (p = 0.362), CA125 (p = 0.118), HE4 (p = 1.000), and final diagnosis (p = 0.549) among these three datasets (Table 1). Comparing the benign and borderline lesion groups, two clinical characteristics (CA125 and HE4) and five radiological characteristics (ascites, maximum tumor diameter, tumor margins, SI of cystic component on FS T2W, and SI of solid component on FS T2W) were significantly different (p < 0.05) in the training set (Table 2). Other detailed information on the clinical and radiological characteristics of the enrolled patients is summarized in Tables 1 and 2, and Supplementary Materials (Additional file 1: Table S2).

Table 1 Clinical characteristics of training and validation sets
Full size table
Table 2 Clinical and radiological characteristics for benign and borderline EOTs in training set
Full size table

Models building and evaluation

According to the learning curves, the training scores of logistic regression and SVM models were around 0.8 and cross-validation scores were greater than 0.75 (Fig. 3a, b), which was superior to the Naive Bayes model (the training and cross-validation scores were all < 0.7, Fig. 3d). The gap between the training and cross-validation scores was lower in the logistic regression and SVM models (< 0.05) than that in the Random Forest model (> 0.10, Fig. 3c). According to the ROC curves, the LR model and SVM model had similar AUCs in the training set (AUC of 0.82 ± 0.07 and 0.82 ± 0.08, respectively). However, the LR model outperformed the SVM model in both the internal validation set (AUC of 0.73 vs. 0.71) and the external validation set (AUC of 0.79 vs. 0.74) (Fig. 3e, f). The RF model had an AUC of 0.83 ± 0.06 in the training set, but its AUC was only 0.44 in the external validation (Fig. 3g). The NB model had lowest AUCs in the training set (0.75 ± 0.08), internal validation set (0.59), and external validation set (0.44) (Fig. 3h). Therefore, the radiomics model constructed by the LR algorithm was optimal.

Fig. 3
figure 3

a–d The learning curves for four different radiomics models. The red and green curves represent the trend of the score with the increase in sample size in training and cross-validation data, respectively. The training and cross-validation scores of the logistic regression (LR) and SVM models were higher than those of the Naive Bayes (NB) model. The gap between the training and cross-validation scores of the LR or SVM models was smaller than that of the Random Forest (RF) model. e–h The receiver operating characteristic curves for four different radiomics models. Each light-colored curve represents each of the tenfold cross-validations (fold 0 to 9), and the dark blue curve represents their mean; the red and green curves represent internal and external validation sets, respectively. The LR model and SVM model had similar AUCs in the training set, but the LR model outperformed the SVM model in both the internal validation set and the external validation set. The RF model had the highest AUC in the training set but had low AUC in the external validation. The NB model had the lowest AUCs in all sets

Full size image

After tenfold cross-validation, the combined model exhibited best diagnostic efficiency, with the AUC of 0.86 ± 0.07, specificity of 0.76 ± 0.11,sensitivity of 0.82 ± 0.13, PPV of 0.82 ± 0.11, and NPV of 0.78 ± 0.08 (Fig. 4a, Table 3). The radiomics model achieved a moderate AUC of 0.82 ± 0.07, which was still better than the performance of the clinical model (AUC of 0.79 ± 0.06). The ROC curves of the tenfold cross-validation and confusion matrix results of each model are presented in the Supplementary Materials (Additional file 1: Fig. S4–S6). There was no significant difference in AUCs among the three models in the internal validation set (Table 4). However, in the external validation set, the AUC value of the combined model was significantly better than that of the clinic-radiological model (0.86 vs. 0.63, p = 0.021 [DeLong test]). The comparison of diagnostic performance of the models in the validation sets is shown in Fig. 4b, c, and Table 4.

Fig. 4
figure 4

a Mean receiver operating characteristic (ROC) curves for the radiomics model, clinic-radiological model, and combined model over the tenfold cross-validation iterations. b ROC curves in the internal validation set. c ROC curves in the external validation set

Full size image
Table 3 Diagnostic performances of different models after tenfold cross-validation iterations
Full size table
Table 4 Comparison of models in internal and external validation sets
Full size table

Discussion

In this multicenter study, we investigated the feasibility of T2W MRI-based radiomics in differentiating between borderline and benign EOTs. After incorporating radiomics features, clinical, and conventional radiological characteristics, the combined model constructed by the LR algorithm had the best diagnostic performance in distinguishing borderline EOTs from benign EOTs. Generalizability was effectively demonstrated by showing consistently encouraging performance of the model when evaluated on the internal and external validation set.

Previous studies have shown that MRI-based radiomics can classify benign and malignant ovarian tumors with high AUCs of around 0.90 [16, 21]. However, one limitation shared in these mentioned studies is the inclusion of borderline EOTs in the category of ovarian malignancies. Within the clinical scenario, borderline EOTs should be regarded as a separate category since their treatment differs from both benign and malignant EOTs [10, 11, 35]. Additionally, since the number of patients with borderline EOTs recruited in studies is often small, the diagnostic performance of the radiomics model may not obviously change, even if many borderline EOTs are misdiagnosed as benign. For comparison, we not only focused on borderline EOTs but also applied the SMOTE algorithm to oversample the minority class (borderline EOTs) to reduce the adverse effect caused by sample imbalance [34].

Compared with one prior study, where a radiomics model based on the dynamic contrast-enhanced (DCE)-MRI can achieve good performance in diagnosing ovarian tumors, with the AUC of more than 0.86 [22], we used T2W MRI to construct models and obtained similar encouraging diagnostic performance in differentiating between benign and borderline EOTs. Although radiomics using non-contrast MRI has been less well studied in ovarian tumors, this approach has shown promising results in the diagnosis of liver and breast tumors [36, 37]. Recently, one study showed that radiomics based on the FS T2W images could help clinicians differentiate borderline EOTs from malignancies (accuracy of 0.99 from the three-dimensional model) [38]. Similar to the mentioned study, we only applied FS T2W images for modeling, thus providing additional evidence for the application of T2W MRI-based radiomics in borderline EOTs.

Early diagnosis of borderline EOTs is crucial for clinical decision making because patients with borderline EOTs required stricter preoperative evaluation and postoperative follow-up. If a precise preoperative diagnosis is achievable, restaging surgery can be avoided. However, there is currently no easy and reliable means of screening. O-RADS MRI recommended morphological sequences (T2, T1 with and without fat suppression, and T1 after gadolinium injection) and functional sequences (perfusion and diffusion‐weighted sequences) for every patient [14]. However, high costs, motion artifacts, and too long scanning time restrict its widespread application in screening. Our results showed that the model constructed by the T2W sequence alone could effectively differentiate between benign and borderline EOTs preoperatively, thus providing a new idea for screening high-risk women with ovarian tumors.

In this study, we also compared the performance of the combined model with that of the clinic-radiological model. The diagnostic performance in the combined model was superior to that in the clinic-radiological model, especially when evaluated on the external validation set. Therefore, the combination of radiomics features and clinical and conventional radiological characteristics may have the potential to improve the diagnostic performance and generalizability of the model. The combined model in our study achieved better performance than that of the model combining ultrasound and clinical features in a recent study (AUC of 0.86 vs. 0.825) [39]. Additionally, in clinical application, misdiagnosis of borderline ovarian tumors should be avoided because it will lead to the risk of recurrence and deterioration, thus requiring the model to have high sensitivity. Compared with the model with a sensitivity of < 0.75 [39], the combined model in our study had an increased sensitivity of 0.82, indicating that it may have the potential to address this need for the detection of borderline EOTs.

There are several novelties and strengths in the methods of this study. First, as suggested in the Radiomics Quality Score (RQS) [19], we recruited patients from multiple centers and performed internal and external validation, which contributes to the robustness of our results. Second, one of the main limitations of most radiomics studies is the homogeneity of the data, which adversely impacts the generalization of results. To overcome this deficiency, our study included data from seven MRI scanners regardless of manufacturer, protocol, and field strength, and the ComBat harmonization algorithm minimized the bias caused by different MRI scanners. This algorithm has been confirmed not only to reduce the batch effects caused by different imaging protocols [32, 33] but also to partially improve the predictive performance of the radiomics model [40]. Furthermore, different machine learning algorithms may perform differently on the same data since they have disparate mathematical principles. Therefore, we used four different machine learning algorithms for modeling and compared the differences in the algorithms’ fitting effect and generalization performance. This increased the reliability of our results by reducing the bias caused by choosing a single machine learning algorithm.

Nevertheless, there are several limitations of this study. First, the amount of data in the external validation set used in this study was small. This is due to the difficulty of medical image acquisition and our desire to approximate the actual data distribution with as large a training sample as possible. Second, potential selection bias may exist in this study because of the retrospective study design. Thus, prospective multicenter validation of a large sample size is needed in our further study. Third, this study did not compare the performance between T2W and other sequences. Therefore, further study is required to evaluate the performance of radiomics based on multiparametric MRI.

Conclusion

In conclusion, the radiomics based on T2W MRI had the potential to differentiate between benign and borderline EOTs effectively. Our findings could offer potential guidance for preoperative clinical decision making and merit further evaluations and development for future clinical applications.

Availability of data and materials

The datasets generated and/or analyzed during the current study are not publicly available because the subjects did not provide written consent for their data to be publicly shared.

Abbreviations

CA125:

Carbohydrate antigen 125

DCE:

Dynamic contrast-enhanced

EOT:

Epithelial ovarian tumor

FIGO:

International Federation of Gynecology and Obstetrics

FS:

Fat-suppressed

HE4:

Human epididymis protein 4

IBSI:

Image biomarker standardization initiative

ICC:

Intraclass correlation coefficient

LASSO:

Least Absolute Shrinkage and Selection Operator

LR:

Logistic regression

NB:

Naive Bayes

RF:

Random Forest

RQS:

Radiomics Quality Score

SI:

Signal intensity

SMOTE:

Synthetic minority oversampling technique

SVM:

Support vector machine

T2W:

T2-weighted

VOI:

Volume of interest

References

  1. Skirnisdottir I, Garmo H, Wilander E, Holmberg L (2008) Borderline ovarian tumors in Sweden 1960–2005: trends in incidence and age at diagnosis compared to ovarian cancer. Int J Cancer 123:1897–1901

    Article  CAS  Google Scholar 

  2. Lenhard MS, Mitterer S, Kumper C et al (2009) Long-term follow-up after ovarian borderline tumor: relapse and survival in a large patient cohort. Eur J Obstet Gynecol Reprod Biol 145:189–194

    Article  Google Scholar 

  3. Huchon C, Bourdel N, Abdel Wahab C et al (2021) Borderline ovarian tumors: French guidelines from the CNGOF. Part 1. Epidemiology, biopathology, imaging and biomarkers. J Gynecol Obstet Hum Reprod 50:101965

    Article  Google Scholar 

  4. Schuurman MS, Timmermans M, van Gorp T et al (2019) Trends in incidence, treatment and survival of borderline ovarian tumors in the Netherlands: a nationwide analysis. Acta Oncol 58:983–989

    Article  Google Scholar 

  5. Maramai M, Barra F, Menada MV et al (2020) Borderline ovarian tumours: management in the era of fertility-sparing surgery. Ecancermedicalscience 14:1031

    Article  Google Scholar 

  6. Messalli EM, Grauso F, Balbi G, Napolitano A, Seguino E, Torella M (2013) Borderline ovarian tumors: features and controversial aspects. Eur J Obstet Gynecol Reprod Biol 167:86–89

    Article  Google Scholar 

  7. Prat J (2017) Pathology of borderline and invasive cancers. Best Pract Res Clin Obstet Gynaecol 41:15–30

    Article  Google Scholar 

  8. Hannibal CG, Frederiksen K, Vang R, Kurman RJ, Kjaer SK (2020) Risk of specific types of ovarian cancer after borderline ovarian tumors in Denmark: a nationwide study. Int J Cancer 147:990–995

    Article  CAS  Google Scholar 

  9. Morice P, Uzan C, Fauvet R, Gouy S, Duvillard P, Darai E (2012) Borderline ovarian tumour: pathological diagnostic dilemma and risk factors for invasive or lethal recurrence. Lancet Oncol 13:e103–e115

    Article  Google Scholar 

  10. Shih KK, Zhou Q, Huh J et al (2011) Risk factors for recurrence of ovarian borderline tumors. Gynecol Oncol 120:480–484

    Article  CAS  Google Scholar 

  11. du Bois A, Trillsch F, Mahner S, Heitz F, Harter P (2016) Management of borderline ovarian tumors. Ann Oncol 27(Suppl 1):i20–i22

    Article  Google Scholar 

  12. Otify M, Laios A, Elshamy T, D’Angelo A, Amso NN (2020) A systematic review and meta-analysis of the use of ultrasound to diagnose borderline ovarian tumours. Eur J Obstet Gynecol Reprod Biol 244:120–127

    Article  CAS  Google Scholar 

  13. Thomassin-Naggara I, Aubert E, Rockall A et al (2013) Adnexal masses: development and preliminary validation of an MR imaging scoring system. Radiology 267:432–443

    Article  Google Scholar 

  14. Thomassin-Naggara I, Poncelet E, Jalaguier-Coudray A et al (2020) Ovarian-adnexal reporting data system magnetic resonance imaging (O-RADS MRI) score for risk stratification of sonographically indeterminate adnexal masses. JAMA Netw Open 3:e1919896

    Article  Google Scholar 

  15. Flicek KT, VanBuren W, Dudiak K et al (2021) Borderline epithelial ovarian tumors: what the radiologist should know. Abdom Radiol (NY) 46:2350–2366

    Article  CAS  Google Scholar 

  16. Zhang H, Mao Y, Chen X et al (2019) Magnetic resonance imaging radiomics in categorizing ovarian masses and predicting clinical outcome: a preliminary study. Eur Radiol 29:3358–3371

    Article  Google Scholar 

  17. Park SY, Oh YT, Jung DC (2016) Differentiation between borderline and benign ovarian tumors: combined analysis of MRI with tumor markers for large cystic masses (>/=5 cm). Acta Radiol 57:633–639

    Article  Google Scholar 

  18. Gillies RJ, Kinahan PE, Hricak H (2016) Radiomics: images are more than pictures, they are data. Radiology 278:563–577

    Article  Google Scholar 

  19. Lambin P, Leijenaar RTH, Deist TM et al (2017) Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol 14:749–762

    Article  Google Scholar 

  20. Jian J, Li Y, Pickhardt PJ et al (2021) MR image-based radiomics to differentiate type Iota and type IotaIota epithelial ovarian cancers. Eur Radiol 31:403–410

    Article  Google Scholar 

  21. Wang R, Cai Y, Lee IK et al (2021) Evaluation of a convolutional neural network for ovarian tumor differentiation based on magnetic resonance imaging. Eur Radiol 31:4960–4971

    Article  Google Scholar 

  22. Song XL, Ren JL, Zhao D, Wang L, Ren H, Niu J (2021) Radiomics derived from dynamic contrast-enhanced MRI pharmacokinetic protocol features: the value of precision diagnosis ovarian neoplasms. Eur Radiol 31:368–378

    Article  CAS  Google Scholar 

  23. Baessler B, Weiss K, Pinto Dos Santos D (2019) Robustness and reproducibility of radiomics in magnetic resonance imaging: a phantom study. Invest Radiol 54:221–228

    Article  Google Scholar 

  24. Li Y, Jian J, Pickhardt PJ et al (2020) MRI-based machine learning for differentiating borderline from malignant epithelial ovarian tumors: a multicenter study. J Magn Reson Imaging 52:897–904

    Article  Google Scholar 

  25. Jian J, Li Y, Xia W et al (2021) MRI-based multiple instance convolutional neural network for increased accuracy in the differentiation of borderline and malignant epithelial ovarian tumors. J Magn Reson Imaging. https://doi.org/10.1002/jmri.28008

    Article  PubMed  Google Scholar 

  26. Yushkevich PA, Piven J, Hazlett HC et al (2006) User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 31:1116–1128

    Article  Google Scholar 

  27. Xue C, Yuan J, Lo GG et al (2021) Radiomics feature reliability assessed by intraclass correlation coefficient: a systematic review. Quant Imaging Med Surg 11:4431–4460

    Article  Google Scholar 

  28. Li YA, Qiang JW, Ma FH, Li HM, Zhao SH (2018) MRI features and score for differentiating borderline from malignant epithelial ovarian tumors. Eur J Radiol 98:136–142

    Article  CAS  Google Scholar 

  29. van Griethuysen JJM, Fedorov A, Parmar C et al (2017) Computational radiomics system to decode the radiographic phenotype. Cancer Res 77:e104–e107

    Article  Google Scholar 

  30. Zwanenburg A, Vallieres M, Abdalah MA et al (2020) The image biomarker standardization initiative: standardized quantitative radiomics for high-throughput image-based phenotyping. Radiology 295:328–338

    Article  Google Scholar 

  31. Orlhac F, Lecler A, Savatovski J et al (2021) How can we combat multicenter variability in MR radiomics? Validation of a correction procedure. Eur Radiol 31:2272–2280

    Article  Google Scholar 

  32. Orlhac F, Frouin F, Nioche C, Ayache N, Buvat I (2019) Validation of a method to compensate multicenter effects affecting CT radiomics. Radiology 291:53–59

    Article  Google Scholar 

  33. Orlhac F, Boughdad S, Philippe C et al (2018) A Postreconstruction harmonization method for multicenter radiomic studies in PET. J Nucl Med 59:1321–1328

    Article  CAS  Google Scholar 

  34. Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP (2002) SMOTE: synthetic minority over-sampling technique. J Artif Intell Res 16:321–357

    Article  Google Scholar 

  35. Armstrong DK, Alvarez RD, Bakkum-Gamez JN et al (2021) Ovarian cancer, version 2.2020, NCCN clinical practice guidelines in oncology. J Natl Compr Canc Netw 19:191–226

    Article  CAS  Google Scholar 

  36. Santucci D, Faiella E, Cordelli E et al (2021) The impact of tumor edema on T2-Weighted 3T-MRI invasive breast cancer histological characterization: a pilot radiomics study. Cancers 13:4635

    Article  CAS  Google Scholar 

  37. Wu M, Tan H, Gao F et al (2019) Predicting the grade of hepatocellular carcinoma based on non-contrast-enhanced MRI radiomics signature. Eur Radiol 29:2802–2811

    Article  Google Scholar 

  38. Liu X, Wang T, Zhang G et al (2022) Two-dimensional and three-dimensional T2 weighted imaging-based radiomic signatures for the preoperative discrimination of ovarian borderline tumors and malignant tumors. J Ovarian Res 15:22

    Article  Google Scholar 

  39. Zhang S, Yu S, Hou W et al (2019) Diagnostic extended usefulness of RMI: comparison of four risk of malignancy index in preoperative differentiation of borderline ovarian tumors and benign ovarian tumors. J Ovarian Res 12:87

    Article  Google Scholar 

  40. Peeken JC, Spraker MB, Knebel C et al (2019) Tumor grading of soft tissue sarcomas using MRI-based radiomics. EBioMedicine 48:332–340

    Article  CAS  Google Scholar 

Download references

Acknowledgements

The authors thank AJE (https://www.aje.com/) for English language editing.

Funding

This work was supported by The Research Project of Gusu School of Nanjing Medical University (GSKY20210227).

Author information

Author notes

  1. Mingxiang Wei and Yu Zhang contributed equally to this work

Authors and Affiliations

  1. Department of Radiology, The Affiliated Suzhou Hospital of Nanjing Medical University, Suzhou, Jiangsu, China

    Mingxiang Wei, Shuangqing Chen & Hong Wang

  2. Gusu School, Nanjing Medical University, Suzhou, Jiangsu, China

    Mingxiang Wei, Shuangqing Chen & Hong Wang

  3. Department of Radiology, Dushu Lake Hospital Affiliated to Soochow University, Suzhou, Jiangsu, China

    Yu Zhang & Haimin Xu

  4. Department of Radiology, The Affiliated Huaian No. 1 People’s Hospital of Nanjing Medical University, Huaian, Jiangsu, China

    Genji Bai & Cong Ding

  5. Department of Radiology, The First Affiliated Hospital of Soochow University, Suzhou, Jiangsu, China

    Yao Dai

Authors
  1. Mingxiang Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yu Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Genji Bai
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Cong Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Haimin Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yao Dai
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Shuangqing Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Hong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

SC, HW helped in conceptualization and study design. MW and YZ analyzed and interpreted the data. GB, CD, HX, and YD acquired the data. MW and YZ drafted the manuscript. All authors helped in manuscript revisions and final manuscript approval.

Corresponding authors

Correspondence to Shuangqing Chen or Hong Wang.

Ethics declarations

Ethics approval and consent to participate

The study protocol was approved by the Ethics Committee of the Affiliated Suzhou Hospital of Nanjing Medical University, the Affiliated Huaian No. 1 People's Hospital of Nanjing Medical University, and the First Affiliated Hospital of Soochow University (YX-2021-001-01). Patient consent was waived by the institutional review board due to the retrospective and anonymized nature of the data analysis.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

 Supplementary materials on centers information, radiomics features, ComBat harmonization, feature selection, additional tables, and additional figures.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wei, M., Zhang, Y., Bai, G. et al. T2-weighted MRI-based radiomics for discriminating between benign and borderline epithelial ovarian tumors: a multicenter study. Insights Imaging 13, 130 (2022). https://doi.org/10.1186/s13244-022-01264-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13244-022-01264-x

Keywords