- Educational Review
- Open Access
Clinical applications of artificial intelligence and radiomics in neuro-oncology imaging
Insights into Imaging volume 12, Article number: 152 (2021)
This article is a comprehensive review of the basic background, technique, and clinical applications of artificial intelligence (AI) and radiomics in the field of neuro-oncology. A variety of AI and radiomics utilized conventional and advanced techniques to differentiate brain tumors from non-neoplastic lesions such as inflammatory and demyelinating brain lesions. It is used in the diagnosis of gliomas and discrimination of gliomas from lymphomas and metastasis. Also, semiautomated and automated tumor segmentation has been developed for radiotherapy planning and follow-up. It has a role in the grading, prediction of treatment response, and prognosis of gliomas. Radiogenomics allowed the connection of the imaging phenotype of the tumor to its molecular environment. In addition, AI is applied for the assessment of extra-axial brain tumors and pediatric tumors with high performance in tumor detection, classification, and stratification of patient’s prognoses.
AI methods utilized conventional and advanced techniques to differentiate brain tumors from non-neoplastic lesions.
AI used in the diagnosis of gliomas and discrimination of gliomas from lymphomas and metastasis.
AI has a role in the grading, prediction of treatment response, and prognosis of gliomas.
Radiogenomics allowed the connection of the imaging phenotype of the tumor to its molecular environment.
AI is applied for the assessment of extra-axial brain tumors and pediatric tumors.
Introduction and background
The World Health Organization (WHO) has provided an update of brain tumor classification in 2016 incorporating genetic information. Discrimination between different types of brain tumors is problematic at imaging. Accurate diagnosis is crucial for planning of treatment to improve patient’s outcome, helpful in the grading of tumors and response after therapy [1,2,3,4,5,6,7]. Brain tumor biopsy is considered the gold standard for diagnosis. However, it carries the risk of procedure-related complications in about 6% of cases [2, 3, 8, 9].
Methods of examination
Conventional MR imaging relies particularly on overall tumor morphology, composition, location, mass effect, and multiplicity. Some limitations remain as challenges such as the differentiation of brain tumors from simulating lesions, tumor characterization and grading, and the discrimination of recurrent tumors from tissue necrosis. Advanced MR imaging including diffusion, diffusion tensor imaging (DTI), perfusion MR techniques as arterial spin labeling (ASL), dynamic susceptibility contrast (DSC), dynamic contrast-enhanced imaging (DCE), and MR spectroscopy technique are quantitative biomarkers used to determine tumor morphology and function [10,11,12,13,14]. The emerging Artificial Intelligence (AI) methods have shown significant progress in the field of radiological-based medical imaging applications. The basic concept of AI refers to any method that allows human intelligence to be imitated by computers [2, 4]. Machine learning (ML) is a subset of AI techniques that utilize algorithms that evolve as new data are introduced. Deep learning (DL) is a subclass of ML-based on neural networks, applying a large number of layers, and allowing more complex classification processes [1,2,3,4,5].
Both radiology and computing have advanced to the point that Artificial Intelligence (AI) can be applied to radiology problems: radiology has gone digital, with all data stored in radiology information system picture archives and communication system archives; AI has evolved to the point where automated image processing is possible. Increased computing capacity, data storage with low cost, and faster rates of transferring data have all contributed to this growth. In recent years, this has culminated in a large rise in publications on AI in radiology, regarding a vast variety of potential applications including identification, segmentation, classification, and outcome prediction.
This article addresses the fundamentals, existing workflow, and methods used in AI-based radiological applications in the medical field. Additionally, we aim to review the clinical applications of AI in brain tumors.
Artificial intelligence (AI)
Artificial Intelligence (AI) refers to the computation ability to perform tasks that are similar to those performed by humans in order to highly utilize unique inputs generating outputs with high added value. Medical imaging is actually one of the most exciting applications of AI right now. Radiologists can make great use of computers with routine detection and diagnosis tasks. The aim of encouraging the use of Computer-Aided Diagnostic (CAD) systems using the state-of-the-art AI techniques was to assist radiologists in the detection and analysis of potential lesions which in turn enables distinguishing between lesions, reducing errors, and increasing radiological efficiency. As a result, there have been continuous and incremental efforts to enhance AI's diagnostic efficiency to be promoted for everyday clinical practice . The invention of artificial neural networks (ANN) in the middle of the last century and their subsequent evolution, which introduced the principles of computational learning models, ML, and DL, is largely responsible for the growth of AI.
Machine learning (ML)
Applications of ML necessitate a collection of pathological data as input that the machine will use for self-training, and such data should always provide the desired output to be expected. Whether the input was previously labeled by human experts or whether the computer performed direct data extraction using a variety of computational methods identifies two types of ML; supervised or unsupervised . The optimal ML model must include the features that are most important to the outcome (local features) as well as the most generic ones (global features) with the ability of generalization for new unseen inputs.
Deep learning (DL)
Deep learning (DL) allows more complex classification processes as well as automatic dimensionality reduction through a hierarchical feature extraction criterion. Using convolutional neural networks (CNN) and the inclusion of multiple neural layers between input and output, enhance the robustness of DL and provide the ability to replicate the human brain processes in the training phase. DL is a hot subject of research that has practically exploded in recent years. By combining ML/DL image processing with clinical and, where appropriate, pathological/histological data, the ability to relate fundamental diagnostic patterns and features of radiological scans (with different modalities) to a particular pathological and histological subtyping has created a new field in research developing which is Radiomics .
Radiomics is a new translational field in which a range of attributes, such as geometry, strength, and texture, are determined from radiological images to allow for capturing different imaging patterns. These patterns could be used for tumor subtyping, grading, and staging. In addition, Radiomics is usually used in systems in multiple variations for prediction, prognosis, monitoring, and treatment response assessment . There are two main types of radiomics: feature-based and deep learning-based radiomics. Unlike these clinical evaluations affected by the human reader, the results are more stable, accurate, and reproducible. Thanks to the ability of radiomics features to be calculated using multiple mathematical algorithms (feature-based) or created statistically from ML-based complex computational models during the training phases (deep learning-based) in an automatic process. Figure 1 shows the general framework for radiomics.
Feature-based radiomics works by extracting a set of numerical features from a segmented region/volume of interest (ROI/VOI for 2D/3D). Then, feature selection algorithms evaluate a subset of specific features to prevent overfitting and create robust prediction models. Feature-based radiomics does not necessitate large datasets because the measured features are specified separately from the data in a typically short computation time. Additionally, since these mathematically represented features are established, a biological comparison can be interpreted. However, most of the extracted features are characterized by their complex numerical nature, making the direct interrelation between these numerical features and physiological context difficult, if not impossible, to be achieved by human perception. The following is a list of the most important processing phases in the feature-based radiomics process .
Image pre-processing Generating quantitative features be in a good shape of repeatability and generalizability from radiological images is the primary aim of radiomics. Several common pre-processing steps must be undertaken in order to accomplish this objective, namely corrections of MRI field inhomogeneities, noise reduction, spatial resampling, spatial smoothing, and intensity normalization. The pre-processing of a Glioma tumor is shown in Fig. 2.
Tumor segmentation Precise segmentation is an essential step toward an accurate radiomics analysis. The manual segmentation of lesions, which involves areas of contrast enhancement, necrosis, and surroundings detection, is a subjective and time-consuming process. To address this, many machine learning algorithms, such as DL-based approaches, are currently being implemented and tested for automatic tumor localization and segmentation. While these methods can now be used to help with tumor segmentation, their efficacy must be demonstrated before they can be used in clinical practice. Figure 3 shows the steps of manual segmentation on a Glioma tumor in two different imaging modalities (CE-MRI at Early Phase and T2-MRI Flair).
Feature extraction Medical images may be used to obtain a number of quantitative characteristics, the majority of which represent tumor heterogeneity. Despite the fact that tons of features can be extracted with different mathematical meanings, features are typically grouped into four subgroups, namely shape characteristics , first-order statistics (histogram-based) features , second-order statistics (textural) features , and higher-order statistics features . Differences between features extracted from two Gliomas with different grades (high-grade HGG and low-grade LGG) are shown in Fig. 4.
Feature selection The extracted quantitative features may not be equally significant. The majority of the features are prone to redundancy, strong correlation and ambiguity which might lead to data overfitting and extreme increment in image noise sensitivity in the dependent predictive models. Running feature selection before learning phases is one way to reduce the chance of these issues. Feature selection strategies take into account the relationship between the features and the class labels, resulting in selecting features regarding their contribution to the classification issue. In other words, these techniques select the features that contribute the most to distinguishing between the classes. In radiomics, the three popular methods are filter methods (univariate methods), wrapper methods (multivariate methods), and embedded approaches .
Model generation and evaluation Depending on the purpose of the analysis, many ML-based algorithms can be used to produce predictive models. The Cox proportional hazards model in the case of examined survival data, neural networks, support vector machines (SVM), decision trees (e.g., random forests), linear regression, and logistic regression are the most common algorithms in radiomics. In supervised ML tasks, the used dataset is often divided into training and validation using stratified splitting to ensure that the training and validation datasets roughly maintain the same samples distribution as the classes distribution in the entire data collection. Following the training and validation steps, the model should preferably be applied to a new unseen testing dataset which reflect the data that the model will experience in clinical practice [21,22,23].
Deep learning-based radiomics
Various network architectures or stacks of linear and nonlinear functions, like convolutional neural networks (CNNs) or auto-encoders, are used in deep learning-based radiomics to find the most important/critical characteristics from the radiological images. Without any prior description or collection of features, single-layer neural networks cascaded system is included in the learning process of structures in radiological-based data that are important for classification . This cascading process helps to generate/reduce features gradually to obtain the most dominant/important features. Finally, the previously generated features can be processed further by the network for analysis and classification, or they can exit the network and go through the model generation process using different classifiers such as decision trees, regression models, or support vector machines, similar to the feature-based radiomics method. Techniques like regularization and dropout, fraction are used to prevent overfitting. Deep learning-based radiomics require larger datasets than feature-based radiomics because of the high correlation between the input data and the extracted features, which prevents its applicability in multiple fields of research where the availability of the dataset is restricted such as neuro-oncological research. Transfer learning, on the other hand, is a technique for circumventing this constrain by using pre-trained neural networks that are used for training over a separate, but closely related purpose, for example, a neural network trained with imaging data for automated glioma segmentation may be used for segmenting brain metastases . The amount of data needed to produce reliable performance, as well as the computational demand, is reduced by leveraging the network’s prior knowledge.
The aim of work is to review the clinical applications of AI in brain tumors.
Clinical applications of AI in brain tumors
Table 1 shows the clinical applications of AI in brain tumors.
Radiomics of gliomas
Grading of glioma is classified by the WHO into low grade (I and II) and high grade (III and IV). Glioblastoma multiform (GBM) is a grade IV tumor and is the most common primary brain tumor [25,26,27,28,29,30]. Distinguishing glioma from non-neoplastic lesions is of utmost importance in the clinical practice as each entity has its different strategy of treatment and prognosis. Determination of glioma grade before therapy is crucial for the optimization of treatment strategy, prediction of therapeutic response, prognosis, and survival [29,30,31,32,33,34].
Differentiation of neoplastic from non-neoplastic lesions
High-grade gliomas versus tumefactive demyelinating diseases
Tumefactive multiple sclerosis lesions (MS) with atypical features can mimic high-grade gliomas on conventional MR imaging . A study used dynamic texture parameter analysis (DTPA) and extracted features from the first pass of contrast phase of DSC-enhanced perfusion maps and differentiated glioblastomas from tumefactive MS .
Glioma versus inflammation
Sometimes, MR diagnostic dilemma exists in differentiating atypical cases of inflammation and glioma due to similar radiological features, subjective evaluation, and lack of quantitative indicators [37, 38]. A novel study tried to differentiate between inflammation and grade-II glioma using LASSO algorithms to select features and based on non-contrast imaging features. The study achieved promising results with (AUC) of 0.988 in the primary cohort, and 0.950 in the validation cohort, but the small sample size and retrospective design of the study limit its potential usefulness in differentiating inflammation from glioma .
Grading of gliomas
Several studies discussed the radiomics for glioma grading. A study extracted a large set of radiomics features from routine brain MRI and then used a random forest classifier that yielded a high AUC of 0.92 for evaluation of glioma grade after fivefold cross-validation .
Low-grade versus high-grade gliomas
A study investigated the role of radiomics in differentiating grade II from grade III and IV; they extracted the radiomics features from conventional, diffusion, and perfusion ASL MRI. An SVM classifier was used and the study showed a high AUC of 0.97and an accuracy of 98%. They concluded also that post-contrast T1 (T1C) is the best single sequence to be compared with multiparametric textural analysis . Another study investigated the conventional and advanced multiparametric MRI (DTI, perfusion, and MR spectroscopy) to derive features to differentiate between low- and high-grade gliomas. Three different SVM classifiers were applied, and the highest performance was achieved with 96% accuracy and an AUC of 0.96. This study was limited mainly by the small patients sample size leading to bias in conducting data analysis, also genomic features would be used to assess their utility .
Grade II versus grade III gliomas
A study investigated MR textural features derived from DCE MRI in differentiating grade II from grade III gliomas and grade III from grade IV and reported that AUC obtained from entropy textural features was 0.885 and from the inverse different moment (IDM) was 0.901 . Another study extracted radiomics features from conventional MRI and perfusion-weighted imaging using the SVM classifier to differentiate between grade II and III and yielded low classification errors of about 3.7% .
The WHO 2016 classification update of gliomas comprises genetic information for diagnosis. Specific genetic alterations are substantially linked with tumorigenesis. The molecular genotype of the tumor, as well as its histopathology, significantly affects survival. Radiogenomics is an emerging field that refers to the relationship between imaging phenotypes and gene expression patterns, this might allow improved diagnosis, decision-making, and predicting patient outcomes [27, 45, 46]. Important prognostic glioma biomarkers include isocitrate dehydrogenase (IDH), chromosome arms 1p/19q-codeletion, methylguanine-DNA methyltransferase status (MGMT). Combined immunohistochemistry with genome sequencing is a standard method for distinguishing glioma mutations [46, 47]. Table 2 shows radiogenomic features of the most important glioma biomarkers.
Isocitrate dehydrogenase (IDH) is an enzyme of Krebs cycle, which converts isocitrate to a-ketoglutarate (aKG). Currently, glioma is classified into subtypes based on IDH mutations (IDH 1 and IDH 2) genotype. The mutant type is IDH positive, while the wild-type glioma is IDH negative . Accumulation of alpha-ketoglutarate from isocitrate occurs in wild type, but with IDH mutations, the isocitrate becomes 2-hydroxyglutarate, an oncometabolite that is absent in wild type. Accumulation of 2-hydroxyglutarate can be detected by MR spectroscopy at 7 T with high specificity, but it is not available in most centers which limit its utility .
IDH mutant gliomas are associated with improved survival as they demonstrate lower regional cerebral blood flow and volume on perfusion studies, also higher apparent diffusion coefficient (ADC) values on DW-MRI. Predominantly hypoenhancing diffuse gliomas are IDH mutants and comprise about 80% lower-grade gliomas and 10% GBM with better survival. On the other hand, predominantly enhancing gliomas are IDH wild type and comprise 90% of GBM with worse survival .
Conventional MRI features that differentiate IDH mutant from IDH wild type includes indistinct margins, T2 hyperintensity of tumor regions but hypointense in FLAIR images (T2-FLAIR mismatch). A retrospective study with a limited sample size applied CNNs to the conventional MR features, showed an accuracy of 92% and demonstrated that IDH wild-type tumors have more infiltrative margins . A more recent study has correlated multiparametric imaging features with glioma IDH mutations using 3D-CNN trained with 94 patients of IDH mutation, and 120 wild-type gliomas have shown greater success achieving 98% sensitivity, 97% specificity, with an AUC of 99% .
Another important prognostic molecular marker is the methylation of O-6-methylguanine-DNA-methyltransferase (MGMT). The MGMT is an enzyme of DNA repair. Methylation of MGMT deactivates a gene, mediates DNA damage, and dealkylates DNA. This mutation occurs approximately in 33–57% of patients with diffuse glioma. Patients with this mutation have a better prognosis and respond better to alkylating agents (temozolomide chemotherapy) [45, 49]. Several studies have correlated multimodal MRI (T1, T2, FLAIR, and T1C) with glioma MGMT mutation status. Their predictive accuracies ranged from 61 to 80% on cohort ranged from 82 to 193 patients [52,53,54]. Another study added perfusion MRI to the multimodal MRI and demonstrated important features for identifying MGMT as increased relative CBV in T1C and a higher ratio of contrast-enhancing tumor to complete tumor volume . A radiogenomic study performed with 2D–3D hybrid CNNs achieved 83% accuracy in the prediction of MGMT promoter .
About 30% of low-grade gliomas have 1p19q codeletion of the chromosome arm. 1p19q codeletion is not present in glioblastoma. The presence of 1p19q codeletion with IDH mutant gliomas defines oligodendroglioma. While, the 1p19q non-co deleted tumors are classified as astrocytomas with or without IDH1/2 mutation and have more “circumscribed” margins and display the (T2-FLAIR mismatch) pattern [25, 32, 49]. A study used an SVM classifier, and based on conventional MRI; it allowed classification of IDH mutation and 1p19q codeletion status with 88% and 96% accuracy, respectively . Another study applied CNNs to conventional imaging features and found that increased enhancement, infiltrative margins, and left frontal lobe predilection are associated with 1p19q codeletion with 93% accuracy. Applying CNN helped in automatic lesion and pattern recognition, although an insufficient number of samples to train a reliable model still of technical concern .
Epidermal growth factor receptor
EGFR is a tyrosine kinase receptor that governs normal epithelial cell growth. The mutations of EGFR are found in about 40% of glioblastomas but are seldom present in lower-grade gliomas. The splice variant III (EGFRvIII) is the most common EGFR mutation in glioblastoma and is found in 31% of patients . Prediction of EGFR has been performed in several radiomic studies using SVM classifiers with approximately 80–85% accuracy in defining EGFRvIII mutation in glioblastoma which exhibits more aggressive features and deep peritumoral infiltration [57, 58]. Another study based on complex multiparametric MRI features has shown increased neovascularity, cell density, and preferential location in the frontal and parietal regions .
Transcriptomic delineation of glioblastomas (GBMs)
Transcriptomic profiling is a technique used to characterize glioma heterogeneity. It identifies the tumors into four molecular subtypes; classical, mesenchymal, proneural, and neural . A study that applied SVM and based on conventional MRI sequences showed 71% accuracy in delineating the four subtypes .
Other genotypes Multiple other less commonly associated mutations in gliomas such as Vascular endothelial growth factor, Platelet-derived growth factor (PDGF), PTEN (Phosphatase and tensin homolog), Cyclin-dependent kinase inhibitor (CDKN2A), Proliferating cell nuclear antigen (PCNA) TERT promoters, and TP53 have also been reported .
Radiogenomics of oligodendroglioma
The presence of 1p19q codeletion with IDH1/2-mutant gliomas defines oligodendroglioma and is associated with “poorly circumscribed” margins, slight frontal lobe predilection, heterogeneous T1 and T2 signals, and lower ADC values. Oligodendroglioma and astrocytoma have mutations in IDH with TERT promoter and are preferentially located in the medial frontal cortex region. The radiomic features showed high accuracy in discriminating IDH1/2-mutant, IDH1/2-mutant with TERT promoter mutation, and IDH wild type .
Malignant tumors have a characteristic growth patterns and tissue changes. Tumor components comprise compartments or “segments” like the solid enhancing portion, necrotic core, non-enhancing tumor, and perifocal edema. Contouring of these segments is essential in the planning of radiotherapy for measuring the gross tumor volume and the clinical target volume, as well as after tumor resection for imaging follow-up [28, 32]. Manual 3-D segmentation methods are time-consuming and subjective. With the advance in computational capabilities, numerous algorithms have been developed and used in semiautomated and automated segmentation methods for brain gliomas [28, 62]. Machine learning has emerged with fast and reliable brain tumor segmentation methods, based on voxel-level classification tasks which differentiate each given voxel whether it belongs to normal brain tissue, glioma, or edema, and extract those features. Currently, segmentation tools are based on DL using CNNs and classifier methods such as SVM and random forests [31, 32, 63]. Recently, CNNs have achieved outstanding performance with about 90% accuracy in voxel labeling .
Infiltration and extent of brain tumors
Differentiation between tumor infiltration and edema is crucial for pre-surgical planning and safety margin consideration, and it is usually difficult by conventional MRI. Machine learning methods provide a roadmap for evaluating tumor infiltration on preoperative imaging. Features extraction from FLAIR and ADC maps using voxel-wise logistic regression model is able to predict areas of tumor infiltration or future tumor recurrence sufficiently [49, 65]. Some studies used an SVM classifier to register areas of tumor recurrence to preoperative MRI, and based on their features on conventional and advanced MRI, they yielded predictive peritumoral marginal infiltration maps with 90% accuracy [57, 66]. Another study developed an approach to register biopsy sites to preoperative imaging using a CNN method. They used multimodal MRI measures at biopsy sites and applied a network on a cell density counting method to the pathology images. This approach assessed the relationship between cell density and degree of enhancement and generated non-invasive maps of cell density to identify infiltrative tissue margins .
Currently, poor overall prognostication of tumors is based on independent risk factors like histological grade and clinical models comprising elder age more than 60 years, male gender, functional status of the patient (preoperative Karnofsky scores), partial resection of the advanced tumor, and surgery without chemo-radiotherapy. In addition, molecular markers are important for the diagnosis and prognosis of brain tumors [25, 49]. Previous studies had applied different imaging modalities depending on measuring the maximal dimensions, the volume of enhancing lesion, and white matter tract infiltration. They showed higher predictiveness than clinical models [68,69,70].
With the advent of AI algorithms, several studies derived radiomics features for predicting the overall survival (OS) of gliomas. A study extracted radiomics features from conventional and advanced MRI metrics including tumor volume, angiogenesis, peritumoral infiltration, and cell density. They used the SVM model to predict the OS of gliomas and classified it into low, medium, and high survival; they achieved 80% accuracy in training and prospective replication cohorts . Another study investigated the effectiveness of two-stage multi-channel 3D deep learning applications on the OS of 68 high-grade glioma patients. The first stage used 3D-CNNs to automatically extract imaging features from multimodal preoperative MRI, DTI, and resting-state functional MRI (rs-fMRI). The second stage added the clinical features including the patient’s age, sex, histological grade, location, and size of the tumor. The deep learning imaging features along with the clinical tumor features were fed into an SVM classifier and achieved 90.66% accuracy in the prediction of long versus short-term OS in high-grade glioma .
Pseudo-progression is defined as an increase in enhancement and/or T2/FLAIR signal abnormality on MRI within 12 weeks after radiotherapy or combined radiotherapy and chemotherapy with spontaneous resolution or stabilization without change in management. Pseudo-progression occurs in 15–50% of patients with gliomas particularly MGMT methylated and IDH mutant tumors undergoing standard therapy. On the other hand, antiangiogenic drugs may induce pseudo-response which means the striking reduction in enhancement due to changing the blood–brain barrier with no or little change in the progression of infiltrating portion [73, 74].
The differentiation of PSP from true progression (TP) is difficult on MRI despite its importance on patient management. Artificial intelligence methods are trying to solve the diagnostic dilemma. A study used conventional MRI, DWI, and PWI for differentiating PSP from TP in 61 glioblastoma patients within 3 months after radio-chemotherapy and surgical resection. The selection of imaging features was done by LASSO logistic regression model. They confirmed that the multiparametric radiomics model had better performance (AUC = 0.90) than any other single parameter. This model should be verified in a multicenter setting independently and prospectively to become a useful tool in the differentiation of PSP from TP . Another study performed on 78 glioma patients, using the hybrid deep and machine learning CNN-LSTM (long short-term memory) method and comprised clinical and imaging features extracted from post-contrast MRI, showed AUC of 0.83 to classify PSP from TP .
Residual/recurrent tumor versus post-treatment changes
One of the most challenging decisions in the treatment planning of gliomas is the differentiation between tumor recurrence and post-treatment changes. The standard combined treatment of glioma by radiotherapy and chemotherapy usually leads to radiation necrosis which commonly occurs within two years after treatment of glioma. Conventional MRI usually has limited ability in differentiating radiation necrosis from tumor recurrence . Currently, the application of artificial intelligence has been used to classify radiation necrosis and glioma recurrence using either handcrafted radiomics features or deep features alone but they did not fully characterize tumor heterogeneity [78, 79]. A novel study incorporated handcrafted features with deep features on multimodality MRI and constructed logistic regression models. The best model achieved the highest AUC of 0.99, sensitivity of 0.99, and specificity of 0.97 in the validation set with improved performance in the characterization of tumor heterogeneity and classification of radiation necrosis and recurrence .
Radiomics of non-gliomas
The ability to discriminate glioblastomas from solitary brain metastasis is still challenging, particularly when using conventional MR, due to their similar MR imaging features. Although advanced MRI techniques such as DTI, MR spectroscopy, and perfusion studies have shown important differences between glioblastoma and solitary metastasis, they are not widely used in clinical practice [81,82,83].
Differentiation of glioblastomas from solitary brain metastasis
Currently, a few recent studies used different artificial intelligence techniques to differentiate both entities. A study based on post-contrast 3D T1W gradient-echo sequence radiomics, and data classification using SVM, showed an accuracy of 85% and an AUC of 0.96 . A study based on contrast-enhanced images used multiple feature selection and classification methods like SVM and LASSO. This study constructed radiomics classifiers that showed favorable accuracy and AUC performance of 0.90. Moreover, the clinical performance of the best classifiers was better than expert neuroradiologists . Another study based on DTI metrics (Fractional anisotropy and ADC) and used MR texture analysis showed significantly higher heterogeneity of the peritumoral edema of glioblastoma and metastasis due to its infiltrative nature. This study was limited by its retrospective nature, manual ROI drawing, and absence of histological verification of tumor infiltration .
Classification of the subtypes of brain metastasis
Classification of the subtypes of brain metastasis was achieved also by radiomics using SVM classifier with high performance, AUC was 0.83, 0.81 for lung and breast metastases, respectively . Another study used quantitative MRI features to discriminate between metastatic subtypes. The selected classifier reached AUCs ranging from 0.64 for non-small lung cancer and 0.82 for breast cancer .
Primary central nervous system lymphoma
Differentiation of PCNS from glioma
Primary central nervous system lymphoma (PCNSL) and glioblastoma have very similar conventional MRI visual features that may fail to solve the problem of differentiating both entities. Yet, both are having different management. Therefore, an early and accurate diagnosis is highly important to improve the prognosis. Generally, PCNSL is treated with chemotherapy and whole-brain radiotherapy, whereas patients with glioblastomas commonly undergo gross surgical resection followed by chemo-radiotherapy [87, 88].
Several studies based on extracted MRI features and ADC parameters have reviewed the performance of different ML algorithms as SVM classifier, random forest analysis, or decision tree ML algorithms in the differentiation between PCNSL and gliomas. They showed predicting high-accuracy results up to 96.8% and AUC up to 0.99 . Another study selected the extracted (DTPA) from the first pass of contrast phase of DSC-enhanced perfusion maps and differentiated glioblastomas from PCNSLs .
Differentiation of HB from brain metastasis
Hemangioblastomas and metastasis are the most common cerebellar masses in adults. Discrimination between the two diseases is important as HBs are benign tumors of vascular origin having good survival rate than brain metastasis. Therefore, their therapeutic approaches and prognosis are quite different . The role of machine learning algorithms in differentiating the two entities is still not established. A recent study performed on a large cohort of intra-axial posterior fossa tumors applied different machine learning algorithms like the random forest, CNN, SVM, and others. The study was based on extracted structural MRI features and ADC histogram analysis. The decision tree model with terminal nodes classified the most common tumor pathologies with 90% accuracy. While random forest models classified the most common 5 tumors including HB and posterior fossa metastasis with an AUC of 0.961 in training datasets, and 0.873 in validation sets .
Radiomics of extra-axial brain tumors
Meningiomas are the most frequent extra-axial central nervous system tumors. The majority are benign lesions (> 80%) and classified as (WHO grade I), atypical type is < 15% (WHO grade II), and malignant type is < 5% (WHO grade III). Differentiation between histological grades is crucial before treatment decisions. Meningiomas may exhibit intratumoral heterogeneity with variable degrees of vascularity, necrosis, infiltration, and rarely transformation from low to high grade. Conventional MRI remains the standard imaging modality for provisional diagnosis and follow-ups of meningiomas despite lacking the ability to determine the biological behavior and recurrence potential of the tumor [91, 92]. Advanced MRI techniques like DWI and PWI have been applied previously in the diagnosis and grading of meningiomas but with overlapping results .
Several studies have introduced machine learning as a radiological tool to improve diagnostic accuracy, prognosis, subtypes, and grading of meningiomas.
Grading of meningiomas
Multiple studies have investigated the use of conventional radiomic features as tumor morphology, texture, histogram, and deep learning radiomics to distinguish between low- and high-grade meningioma [94, 95].
Radiomic analysis has shown successful discrimination between meningothelial, fibrous, and transitional meningiomas with achieved accuracy of the validation model as 94.2% .
Prognosis of meningiomas
An important morphological radiomic feature in the prognosis of meningiomas is the sphericity, previous studies demonstrated that high-grade meningioma tends to be less spherical than low-grade meningioma and is associated with local recurrence and less favorable OS [95, 97].
Regarding the prediction of relapse, a study applied a binary tree model based on extracted radiomic features from T2WI, T1C, and ADC metrics to predict recurrence of skull base meningiomas, the study yielded 90% accuracy .
Prediction of brain invasion in meningiomas
A study has shown successful preoperative prediction of brain invasion in meningiomas, they applied SVM models derived from T2WI, and T1C images and achieved an AUC of 0.819. The addition of clinical features yielded better predictive performance with an AUC of 0.857 .
Differentiation of meningioma from craniopharyngioma
A recent study has constructed a binary logistic regression model to distinguish craniopharyngiomas and meningiomas; they achieved an AUC of 0.776 .
Differentiation of meningioma from hemagioperictyoma
Solitary fibrous tumor/hemangiopericytoma(SFT/HPC) is a rare tumor of vascular origin that became one entity in 2016 WHO classification. Malignant SFT/HPC is WHO grade II and III with aggressive behavior with high rates of recurrence and metastasis . In MRI, SFT/HPC may mimic angiomatous meningioma which is often benign. Consequently, their treatment strategy is largely different, and proper preoperative assessment is crucial [101, 102].
The application of ML has exhibited a promising ability in the differentiation of angiomatous meningiomas from SFT/HPC; a study used SVM models based on textural features derived from T2WI, FLAIR, T1C, and DWI to test their usefulness in differentiating the two tumor entities found that the T1C-based classifier (AUC = 0.90) had significantly better performance than other classifiers .
Pituitary adenoma is the most common sellar region tumor. Resection through the trans-nasal trans-sphenoidal approach is the preferred technique for macroadenomas as well as functioning tumors. Preoperative assessment by MRI is mandatory to assess tumor morphology, extension, and behavior like invasion of the cavernous sinus. Also, MRI helps in differentiating pituitary adenoma from craniopharyngioma which often shares the same clinical presentation. Proper MRI assessment guides the surgical plan either gross tumor resection or resection followed by neo-adjuvant radiotherapy for adenomas with cavernous sinus invasion. Therefore, an accurate predictive model selecting the most informative radiomic features will be helpful in surgical decision-making [103, 104].
Prediction of cavernous sinus invasion
A study aimed to predict cavernous sinus invasion by pituitary adenomas; selected features were based on T1C and T2WI using an SVM classifier with an AUC of 0.826 for the test set .
Differentiation between pituitary adenoma and craniopharyngioma
A study extracted the qualitative MRI features and texture features from preoperative MRI based on T1C and T2WI to test the difference between pituitary adenoma and craniopharyngioma and demonstrated a significant difference between the tumor entities .
Prediction of pituitary macroadenomas ki-67 proliferation index
In 2017, the WHO introduced the definition of “high-risk” adenomas that show aggressive behavior and the unpredictable outcome, these tumors are characterized by rapid growth, radiological invasion, and high Ki-67 proliferation marker. A study demonstrated the effectiveness of ML to preoperatively predict the pituitary macroadenomas ki-67 proliferation index class; they extracted features from T2WI from 89 patients, and a k-nearest neighbors (k-NN) classifier was applied to predict macroadenoma high or low proliferation index and achieved 91.67% accuracy in patient’s classification .
Vestibular schwannoma treatment options differ according to the tumor size. Surgical resection is preferred for large tumors, whereas radiosurgery is usually recommended for small- and medium-sized schwannomas. Gamma knife radiosurgery (GKRS) is effective and safe radiosurgery for controlling tumor growth. Accurate tumor delineation is mandatory before GKRS to identify tumor location, measure tumor volume and detect the tumor response [106, 107].
Prediction of prognosis
A study constructed a two-level machine learning model that achieved an accuracy of 85% in the prediction of pseudo-progression after GKRS. This study was based on five radiomic features and showed an inhomogeneous hypointensity pattern of contrast enhancement and variation in T2-weighted intensity . Another study used a series of multiparametric MRI before radiosurgery to capture areas of tumor inhomogeneous intensity like solid enhancing part and cystic part, they proposed an end-to-end DL segmentation scheme and further compared it with the manual segmentation method, with an exceeding accuracy of the AI model to 99% in determining the tumor progression, pseudo-progression, and regression following radiosurgery .
Radiomics of pediatric brain tumors
Post fossa tumors
Among pediatric brain tumors, posterior fossa tumors are the most common solid tumors. The most common pediatric posterior fossa subtypes include medulloblastoma, pilocytic astrocytoma, and ependymoma. Differentiation between the subtypes is crucial as each tumor has different management and prognosis . Accurate preoperative diagnosis is required to tailor surgery and drug therapy. Conventional MRI is the key imaging tool for the qualitative assessment of pediatric tumors. Yet, definite tumor histopathological classification is done by biopsy. At present, radiomics and DL methods are developing non-invasive tumor classification models for predicting pediatric posterior fossa tumors [109,110,111].
A retrospective study that included 288 children with posterior fossa tumors (medulloblastoma, pilocytic astrocytoma, and ependymoma) applied the tree-based automatic pipeline optimization model and extracted the radiomics features from T1C, T2WI, and ADC maps. The automatic radiomics model achieved an AUC of 0.91 and an accuracy of 0.83. Moreover, the tree-based automatic pipeline optimization model achieved significantly higher accuracy when compared with standard manual optimization by a qualitative machine learning expert (0.83 vs. 0.54, p = 0.001) for binary classification . Another study investigated a large cohort of 617 children with posterior fossa tumors including pontine diffuse midline glioma, medulloblastoma, pilocytic astrocytoma, and ependymoma, and the study constructed a 2D deep learning architecture model and used T2WI as input for tumor extraction. The performance of the deep learning model was compared with that of four radiologists and yielded an AUC of 0.99 in the accuracy of tumor detection and accuracy of 92% in tumor classification. Despite high accuracy, this study was limited by model overfitting due to the increased number of input data from T1 + C, ADC, and T2. Also, there was a lower scan resolution of ADC images when compared to T1 and T2 images .
Table 3 shows the radiogenomic features of the important biomarkers of pediatric brain tumors.
Medulloblastoma is the most common pediatric brain tumor. It was classically thought that medulloblastoma has a single tumor entity. Currently, according to the WHO classification of CNS tumors, four molecular subgroups have been recognized, they are named sonic hedgehog (SHH), wingless-type, group 3, and group 4, each subgroup has its different therapy and prognosis. A favorable outcome is seen with WNT-pathway-activated tumors, and patients have a nearly 90% 5-year survival rate, but patients with group 3 tumors have less than 50% overall survival. Definite tumor subtyping is done with tissue sampling obtained from surgical resection or a single biopsy. However, these are invasive techniques and limited by extensive cost as well [113, 114]. Artificial intelligence is an emerging technology that aims to link imaging features with the tumor molecular subtype [114, 115].
A study included 109 pediatric patients with medulloblastoma applied two predictive test models; a double tenfold cross-validation model and a 3-dataset cross-validation model. Patients underwent molecular analysis from tissue sampling, and the four distinct subgroups were identified. Image data were extracted from T1WI, T1C, and T2WI. The best performance is achieved with the double tenfold cross-validation model for the prediction of SHH, group 3, and group 4 tumors with combined use of T1WI- and T2WI, AUC was 0.79, 0.70, and 0.83, respectively .
Pediatric low-grade gliomas (pLGGs) account for approximately 40% of childhood central nervous system tumors and comprise a heterogeneous form of tumors according to the WHO classification, as grades I or II. PLGGs include juvenile pilocytic astrocytoma (JPA), ganglioglioma, dysembryoplastic neuroepithelial tumor, pleomorphic xanthoastrocytoma, and diffuse low-grade glioma. The standard treatment is surgical excision when possible, but when total resection is not possible, multiple recurrences may occur, and the 10-year progression-free survival is less than 50% .
Common alterations occur in the mitogen-activated protein kinase pathway, either fusions or mutations in the B-Raf proto-oncogene, serine/threonine kinase (BRAF) gene, and they have named the BRAF fusion and BRAF V600E point mutation (p.V600E). Recently, it was known that patient prognosis differed in pLGGs according to the molecular alteration. A favorable outcome is seen in patients with BRAF fusion and neurofibromatosis type 1, while those with the BRAF V600E show a high risk of progression and transformation [117, 118].
A recent study investigated a radiomics model to predict BRAF fusion and BRAF V600E mutation. The study included 115 patients with low-grade glioma. Radiomics features were extracted from tumor segmentation and based on FLAIR MRI. The predictive model was tested using a random forest approach for all available tumor types. BRAF status was predicted with an AUC of 0.75 (SD, 0.12) and (95% confidence interval 0.62–0.89) for the internal validation cohort through a fourfold cross-validation scheme, and AUC for the external validation was 0.85. Age and tumor location were significant predictors of BRAF status, while sex was not a significant predictor .
Diffuse midline gliomas (DMG)
Pediatric diffuse midline gliomas are an aggressive heterogeneous group of brainstem tumors and account for 10% of childhood cancer-related deaths. Previously, these tumors were named diffuse intrinsic pontine gliomas (DIPG). Diffuse tumor location limits its surgical resection. Radiotherapy has been considered the standard palliative treatment. Conventional and advanced MRIs play a major role in the diagnosis and evaluation of tumor therapy response; however, they have no value in predicting patients’ survival . Molecular biomarkers such as H3 K27M mutation status are helpful as tumor histopathology in diagnosing tumors. H3 K27M mutation is an independent predictor of overall survival and is described in midline structures like the thalamus, brainstem, and spinal cord. Patients carrying H3 K27M mutation have a shorter median survival time than patients who have wild-type H3 K27M. Midline gliomas with H3 K27M mutation exhibit different imaging features [121, 122]. Radiomics is a non-invasive method connecting the quantitative features from imaging, such as computed tomography and MRI to the molecular status of the tumors. A study tested the MR textural analysis to predict the OS of pediatric DMG. The study used commercially available TexRAD research software, images extracted from T2 WI and ADC maps. The best predictor stratified the patients into poor and good prognostic groups; the more homogeneous texture is related to the worse prognosis. The median survival was 7.5 months for poor prognosis and 17.5 months for a good prognosis .
Another study used the automated machine learning method and included 40 patients with H3 K27M mutations and 60 wild-type patients. Radiomics features were extracted from FLAIR images; the Tree-based Pipeline Optimization Tool (TPOT) was applied to select radiomics features. The model achieved an AUC of 0.903 in the test cohort providing high performance in the prediction of H3 K27M status .
Merits and challenges
The deployment of AI in the field of neuro-oncology imaging has many merits. First, it is a fully automated system merged with the radiological workflow for image analysis, quantification, and segmentation that shortens the time consumed in tedious and repetitive tasks, with subsequent improved productivity and efficiency of the clinical workflow for better and quicker diagnosis and decision-making. Second, it could help in image registration with the ability to compare numerous images to track and monitor treatment in real-time. Third, AI can connect patient data such as molecular biomarkers with the non-invasive prediction of neoplasm type or grade and generation of prognostic or predictive models for patient stratification and outcome [3, 8, 49].
Despite of good and promising results, there is still some discrepancy between results in research studies and limited applications in the clinical practice caused by some obstacles. First, the system must be fully integrated well into the radiologist’s workflow. Second, manual segmentation is time-consuming; therefore, application of the semiautomated or fully automated segmentation method is helpful. Third, limited information obtained from previous publications in translating tools and sharing the methodology of this system hinders generalizability .
Some important challenges are needed to be considered when building a robust radiologic model including; the generalizability of AI models as most models are built from limited data that is assuming to be representative of all other data in the future for different institutions . One of the premier challenges that developers face is the availability of sufficient data to overcome measurement errors, most annotated data are stored within the hospital systems, sharing of these data among institutions will improve the generalizability . Another crucial challenge is an inter-scanner variability; radio-phenotypic characterization is based on the type of MRI machine, field strength, homogeneity, and acquisition parameters. Harmonizing radiomics can help avoiding the inter-scanner variability by focusing on the radiomics discriminative features and make it reproducible .
Most research studies are deficient in validation of their generated models; this hampers the applicability of AI methods . The performance of each model is task-dependent and dataset-dependent. The American College of Radiology Data Science Institute is concerned with standardization and benchmarking of standard use cases that can help in annotation tools and datasets . Another important challenge is the lack of genomic ground truth data which means more tissue biopsy to better prediction and characterization of MRI .
We concluded that AI is a promising tool that combines clinical, radiomics, and molecular markers essential to improve patient’s outcome with differentiation of brain tumors from simulating lesions, characterization, and grading of brain tumors, pre-and post-treatment assessment, and discrimination of tumor recurrence from post-treatment changes. However, many encounter challenges that need much work to be done to deploy AI into daily practice to enhance radiologists’ accuracy and efficiency.
Availability of data and materials
Data and material are available from the corresponding author upon request.
Primary Central Nervous System Lymphoma
Kaka H, Zhang E, Khan N (2021) artificial intelligence and deep learning in neuroradiology: exploring the new frontier. Can Assoc Radiol J 72:35–44
Aneja S, Chang E, Omuro A (2019) Applications of artificial intelligence in neuro-oncology. Curr Opin Neurol 32:850–856
Zaharchuk G, Gong E, Wintermark M, Rubin D, Langlotz CP (2018) Deep learning in neuroradiology. AJNR Am J Neuroradiol 39:1776–1784
Duong MT, Rauschecker AM, Mohan S (2020) Diverse applications of artificial intelligence in neuroradiology. Neuroimaging Clin N Am 30:505–516
Muthukrishnan N, Maleki F, Ovens K, Reinhold C, Forghani B, Forghani R (2020) Brief history of artificial intelligence. Neuroimaging Clin N Am 30:393–399
Bodalal Z, Trebeschi S, Beets-Tan R (2018) Radiomics: a critical step towards integrated healthcare. Insights Imaging 9:911–914
Pinker K, Shitano F, Sala E et al (2018) Background, current role, and potential applications of radiogenomics. J Magn Reson Imaging 47:604–620
Lohmann P, Galldiks N, Kocher M et al (2020) Radiomics in neuro-oncology: basics, workflow, and applications. Methods S1046–2023(19):30317–30322
Sarkiss CA, Germano IM (2019) Machine learning in neuro-oncology: can data analysis from 5,346 patients change decision making paradigms? World Neurosurg 6:66
Razek AAKA (2018) MR imaging of neoplastic and non-neoplastic lesions of the brain and spine in neurofibromatosis type I. Neurol Sci 39:821–827
Abdel Razek AAK, Talaat M, El-Serougy L, Gaballa G, Abdelsalam M (2019) Clinical applications of arterial spin labeling in brain tumors. J Comput Assist Tomogr 43:525–532
Abdelrasoul AA, Elsebaie NA, Gamaleldin OA, Khalifa MH, Razek AAKA (2019) Imaging of brain infarctions: beyond the usual territories. J Comput Assist Tomogr 43:443–451
Razek AAKA, Taman SE, El Regal ME, Megahed A, Elzeny S, El Tantawi N (2020) Diffusion tensor imaging of microstructural changes in the gray and white matter in patients with Crigler–Najjar syndrome type I. J Comput Assist Tomogr 44:393–398
Razek AA, Abdalla A, Gaber NA et al (2013) Proton MR Spectroscopy of the brain in children with neuronopathic Gaucher’s disease. Eur Radiol 23:3005–3011
Nagoev ZV, Sundukov ZA, Pshenokova IA, Denisenko VA (2020) Architecture of CAD for distributed artificial intelligence based on self-organizing neuro-cognitive architectures. News Kabardin–Balkar Sci Center RAS 2:40–47
Rao MS, Reddy BE (2021) Parametric analysis of texture classification using modified weighted probabilistic neural network (MWPNN). Modern approaches in machine learning and cognitive science: a walkthrough: latest trends in AI, vol 2. Springer, p 459
Aerts HJWL (2016) The potential of radiomic-based phenotyping in precision medicine: a review. JAMA Oncol 2:1636–1642
Rizzo S, Botta F, Raimondi S et al (2018) Radiomics: the facts and the challenges of image analysis. Eur Radiol Exp 2:36
Lambin P, Leijenaar RTH, Deist TM et al (2017) Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol 14:749–762
Hosny A, Parmar C, Quackenbush J, Schwartz LH, Aerts HJWL (2018) Artificial intelligence in radiology. Nat Rev Cancer 18:500–510
Zhou M, Scott J, Chaudhury B et al (2018) Radiomics in brain tumor: image assessment, quantitative feature descriptors, and machine-learning approaches. AJNR Am J Neuroradiol 39:208–216
Zhang Y, Oikonomou A, Wong A, Haider MA, Khalvati F (2017) Radiomics-based prognosis analysis for non-small cell lung cancer. Sci Rep 7:46349
Cha YJ, Jang WI, Kim MS et al (2018) Prediction of response to stereotactic radiosurgery for brain metastases using convolutional neural networks. Anticancer Res 38:5437–5445
Ueda D, Shimazaki A, Miki Y (2019) Technical and clinical overview of deep learning in radiology. Jpn J Radiol 37:15–33
Zlochower A, Chow DS, Chang P, Khatri D, Boockvar JA, Filippi CG (2020) Deep learning AI applications in the imaging of glioma. Top Magn Reson Imaging 29:115–121
Chow DS, Khatri D, Chang PD, Zlochower A, Boockvar JA, Filippi CG (2020) Updates on deep learning and glioma: use of convolutional neural networks to image glioma heterogeneity. Neuroimaging Clin N Am 30:493–503
Gore S, Chougule T, Jagtap J, Saini J, Ingalhalikar M (2020) A review of radiomics and deep predictive modeling in glioma characterization. Acad Radiol 10:66
Lotan E, Jain R, Razavian N, Fatterpekar GM, Lui YW (2019) State of the art: machine learning applications in glioma imaging. AJR Am J Roentgenol 212:26–37
Jin W, Fatehi M, Abhishek K, Mallya M, Toyota B, Hamarneh G (2020) Artificial intelligence in glioma imaging: challenges and advances. J Neural Eng 17:021002
Booth TC, Williams M, Luis A, Cardoso J, Ashkan K, Shuaib H (2020) Machine learning and glioma imaging biomarkers. Clin Radiol 75:20–32
Shaver MM, Kohanteb PA, Chiou C et al (2019) Optimizing neuro-oncology imaging: a review of deep learning approaches for glioma imaging. Cancers 11:829
Kocher M, Ruge MI, Galldiks N, Lohmann P (2020) Applications of radiomics and machine learning for radiotherapy of malignant brain tumors. Strahlenther Onkol 196:856–867
Bonm AV, Ritterbusch R, Throckmorton P, Graber JJ (2020) Clinical imaging for diagnostic challenges in the management of gliomas: a review. J Neuroimaging 30:139–145
El-Serougy L, Abdel Razek AA, Ezzat A, Eldawoody H, El-Morsy A (2016) Assessment of diffusion tensor imaging metrics in differentiating low-grade from high-grade gliomas. Neuroradiol J 29:400–407
Razek AAKA, Elsebaie NA (2020) Imaging of fulminant demyelinating disorders of the central nervous system. J Comput Assist Tomogr 44:248–254
Verma RK, Wiest R, Locher C et al (2017) Differentiating enhancing multiple sclerosis lesions, glioblastoma, and lymphoma with Dynamic texture Parameters Analysis (DTPA): a feasibility study. Med Phys 44:4000–4008
Zoccarato M, Valeggia S, Zuliani L et al (2019) Conventional brain MRI features distinguishing limbic encephalitis from mesial temporal glioma. Neuroradiology 61:853–860
Hiremath SB, Muraleedharan A, Kumar S et al (2017) Combining diffusion tensor metrics and DSC perfusion imaging: Can it improve the diagnostic accuracy in differentiating tumefactive demyelination from high-grade glioma? AJNR Am J Neuroradiol 38:685–690
Han Y, Yang Y, Shi ZS et al (2021) Distinguishing brain inflammation from grade II glioma in population without contrast enhancement: a radiomics analysis based on conventional MRI. Eur J Radiol 134:109467
Cho HH, Lee SH, Kim J, Park H (2018) Classification of the glioma grading using radiomics analysis. PeerJ 6:5982
Tian Q, Yan LF, Zhang X et al (2018) Radiomics strategy for glioma grading using texture features from multiparametric MRI. J Magn Reson Imaging 48:1518–1528
Vamvakas A, Williams SC, Theodorou K et al (2019) Imaging biomarker analysis of advanced multiparametric MRI for glioma grading. Phys Med 60:188–198
Xie T, Chen X, Fang J et al (2018) Textural features of dynamic contrast-enhanced MRI derived model-free and model-based parameter maps in glioma grading. J Magn Reson Imaging 47:1099–1111
Sengupta A, Ramaniharan AK, Gupta RK, Agarwal S, Singh A (2019) Glioma grading using a machine-learning framework based on optimized features obtained from T1 perfusion MRI and volumes of tumor components. J Magn Reson Imaging 50:1295–1306
Seow P, Wong JHD, Ahmad-Annuar A, Mahajan A, Abdullah NA, Ramli N (2018) Quantitative magnetic resonance imaging and radiogenomic biomarkers for glioma characterisation: a systematic review. Br J Radiol 91:20170930
Korfiatis P, Erickson B (2019) Deep learning can see the unseeable: predicting molecular markers from MRI of brain gliomas. Clin Radiol 74:367–373
Soni N, Priya S, Bathla G (2019) Texture analysis in cerebral gliomas: a review of the literature. AJNR Am J Neuroradiol 40:928–934
Verma G, Mohan S, Nasrallah MP et al (2016) Non-invasive detection of 2-hydroxyglutarate in IDH-mutated gliomas using two-dimensional localized correlation spectroscopy (2D L-COSY) at 7 Tesla. J Transl Med 14:274
Rudie JD, Rauschecker AM, Bryan RN, Davatzikos C, Mohan S (2019) Emerging applications of artificial intelligence in neuro-oncology. Radiology 290:607–618
Chang P, Grinband J, Weinberg BD et al (2018) Deep-learning convolutional neural networks accurately classify genetic mutations in gliomas. AJNR Am J Neuroradiol 39:1201–1207
Bangalore Yogananda CG, Shah BR, Vejdani-Jahromi M et al (2020) A novel fully automated MRI-based deep-learning method for classification of IDH mutation status in brain gliomas. Neuro Oncol 22:402–411
Kickingereder P, Bonekamp D, Nowosielski M et al (2016) Radiogenomics of glioblastoma: machine learning-based classification of molecular characteristics by using multiparametric and multiregional MR imaging features. Radiology 281:907–918
Hajianfar G, Shiri I, Maleki H et al (2019) Noninvasive O6 methylguanine-DNA methyltransferase status prediction in glioblastoma multiforme cancer using magnetic resonance imaging radiomics features: univariate and multivariate radiogenomics analysis. World Neurosurg 132:e140–e161
Li ZC, Bai H, Sun Q et al (2018) multiregional radiomics features from multiparametric MRI for prediction of MGMT methylation status in glioblastoma multiforme: a multicentre study. Eur Radiol 28:3640–3650
Lu CF, Hsu FT, Hsieh KL et al (2018) Machine learning-based radiomics for molecular subtyping of gliomas. Clin Cancer Res 24:4429–4436
Akkus Z, Ali I, Sedlář J et al (2017) Predicting deletion of chromosomal arms 1p/19q in low-grade gliomas from MR images using machine intelligence. J Digit Imaging 30:469–476
Rathore S, Akbari H, Rozycki M et al (2018) Radiomic MRI signature reveals three distinct subtypes of glioblastoma with different clinical and molecular characteristics, offering prognostic value beyond IDH1. Sci Rep 8:5087
Li Y, Liu X, Xu K et al (2018) MRI features can predict EGFR expression in lower grade gliomas: a voxel-based radiomic analysis. Eur Radiol 28:356–362
Akbari H, Bakas S, Pisapia JM et al (2018) In vivo evaluation of EGFRvIII mutation in primary glioblastoma patients via complex multiparametric MRI signature. Neuro Oncol 20:1068–1079
Rathore S, Akbari H, Bakas S et al (2019) Multivariate analysis of preoperative magnetic resonance imaging reveals transcriptomic classification of de novo glioblastoma patients. Front Comput Neurosci 13:81
Bisdas S, Shen H, Thust S et al (2018) Texture analysis- and support vector machine-assisted diffusional kurtosis imaging may allow in vivo gliomas grading and IDH-mutation status prediction: a preliminary study. Sci Rep 8:6108
Menze BH, Jakab A, Bauer S et al (2015) The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans Med Imaging 34:1993–2024
Havaei M, Davy A, Warde-Farley D et al (2017) Brain tumor segmentation with deep neural networks. Med Image Anal 35:18–31
Kickingereder P, Isensee F, Tursunova I et al (2019) Automated quantitative tumour response assessment of MRI in neuro-oncology with artificial neural networks: a multicentre. Lancet Oncol 20:728–740
Chang PD, Chow DS, Yang PH, Filippi CG, Lignelli A (2017) Predicting glioblastoma recurrence by early changes in the apparent diffusion coefficient value and signal intensity on FLAIR images. AJR Am J Roentgenol 208:57–65
Akbari H, Macyszyn L, Da X et al (2016) Imaging surrogates of infiltration obtained via multiparametric imaging pattern analysis predict subsequent location of recurrence of glioblastoma. Neurosurgery 78:572–580
Chang PD, Malone HR, Bowden SG et al (2017) A multiparametric model for mapping cellularity in glioblastoma using radiographically localized biopsies. AJNR Am J Neuroradiol 38:890–898
Abdel Razek AAK, El-Serougy L, Ezzat A, Eldawoody H, El-Morsy A (2020) Interobserver agreement of white matter tract involvement in gliomas with diffusion tensor tractography. J Neurol Surg A Cent Eur Neurosurg 81:233–237
Gutman DA, Cooper LA, Hwang SN et al (2013) MR imaging predictors of molecular profile and survival: multi-institutional study of the TCGA glioblastoma data set. Radiology 267:560–569
Zinn PO, Sathyan P, Mahajan B et al (2012) A novel volume-age-KPS (VAK) glioblastoma classification identifies a prognostic cognate MicroRNA-gene signature. PLoS One 7:e41522
Macyszyn L, Akbari H, Pisapia JM et al (2016) Imaging patterns predict patient survival and molecular subtype in glioblastoma via machine learning techniques. Neuro Oncol 18:417–425
Nie D, Lu J, Zhang H et al (2019) Multi-channel 3D deep feature learning for survival time prediction of brain tumor patients using multi-modal neuroimages. Sci Rep 9:1103
Galldiks N, Kocher M, Langen KJ (2017) Pseudoprogression after glioma therapy: an update. Expert Rev Neurother 17:1109–1115
Tipping M, Eickhoff J, Ian RH (2017) Clinical outcomes in recurrent glioblastoma with bevacizumab therapy: an analysis of the literature. J Clin Neurosci 44:101–106
Kim JY, Park JE, Jo Y et al (2019) Incorporating diffusion-and perfusion-weighted MRI into a radiomics model improves diagnostic performance for pseudoprogression in glioblastoma patients. Neuro Oncol 21:404–414
Jang BS, Jeon SH, Kim IH, Kim IA (2018) Prediction of pseudoprogression versus progression using machine learning algorithm in glioblastoma. Sci Rep 8:12516
Razek AAKA, El-Serougy L, Abdelsalam M, Gaballa G, Talaat M (2018) Differentiation of residual/recurrent gliomas from postradiation necrosis with arterial spin labeling and diffusion tensor magnetic resonance imaging-derived metrics. Neuroradiology 60:169–177
Lao J, Chen Y, Li ZC et al (2017) A deep learning-based radiomics model for prediction of survival in glioblastoma multiforme. Sci Rep 7:10353
Antropova N, Huynh BQ, Giger ML (2017) A deep feature fusion methodology for breast cancer diagnosis demonstrated on three imaging modality datasets. Med Phys 44:5162–5171
Zhang Q, Cao J, Zhang J et al (2019) Differentiation of recurrence from radiation necrosis in gliomas based on the radiomics of combinational features and multimodality MRI images. Comput Math Methods Med 2019:2893043
Abdel Razek AAK, Talaat M, El-Serougy L, Abdelsalam M, Gaballa G (2019) Differentiating glioblastomas from solitary brain metastases using arterial spin labeling perfusion- and diffusion tensor imaging-derived metrics. World Neurosurg 127:e593–e598
El-serougy LG, Abdel Razek AA, Mousa A, Eldowoudy H, El-morsy A (2015) Differentiation between the high-grade glioma and metastatic brain tumor using DTI metrics. Egypt J Radiol Nucl Med 46:1099–1104
Artzi M, Bressler I, Ben BD (2019) Differentiation between glioblastoma, brain metastasis and subtypes using radiomics analysis. J Magn Reson Imaging 50:519–528
Qian Z, Li Y, Wang Y et al (2019) Differentiation of glioblastoma from solitary brain metastases using radiomic machine-learning classifiers. Cancer Lett 451:128–135
Skogen K, Schulz A, Helseth E, Ganeshan B, Dormagen JB, Server A (2019) Texture analysis on diffusion tensor imaging: discriminating glioblastoma from single brain metastasis. Acta Radiol 60:356–366
Kniep HC, Madesta F, Schneider T et al (2019) Radiomics of brain MRI: utility in prediction of metastatic tumor type. Radiology 290:479–487
Abdel Razek AAK, El-Serougy L, Abdelsalam M, Gaballa G, Talaat M (2019) Differentiation of primary central nervous system lymphoma from glioblastoma: quantitative analysis using arterial spin labeling and diffusion tensor imaging. World Neurosurg 123:e303–e309
Nguyen AV, Blears EE, Ross E, Lall RR, Ortega-Barnett J (2018) Machine learning applications for the differentiation of primary central nervous system lymphoma from glioblastoma on imaging: a systematic review and meta-analysis. Neurosurg Focus 45:E5
Cha J, Kim ST, Nam DH et al (2017) Differentiation of hemangioblastoma from metastatic brain tumor using dynamic contrast-enhanced MR imaging. Clin Neuroradiol 27:329–334
Payabvash S, Aboian M, Tihan T, Cha S (2020) Machine learning decision tree models for differentiation of posterior fossa tumors using diffusion histogram analysis and structural MRI findings. Front Oncol 10:71
Neromyliotis E, Kalamatianos T, Paschalis A et al (2020) Machine learning in meningioma MRI: past to present. A narrative review. J Magn Reson Imaging. https://doi.org/10.1002/jmri.27378
Gu H, Zhang X, di Russo P, Zhao X, Xu T (2020) The current state of radiomics for meningiomas: promises and challenges. Front Oncol. 10:567736
Svolos P, Kousi E, Kapsalaki E et al (2014) The role of diffusion and perfusion weighted imaging in the differential diagnosis of cerebral tumors: a review and future perspectives. Cancer Imaging 14:20
Zhu Y, Man C, Gong L et al (2019) A deep learning radiomics model for preoperative grading in meningioma. Eur J Radiol 116:128–134
Park YW, Oh J, You SC et al (2019) Radiomics and machine learning may accurately predict the grade and histological subtype in meningiomas using conventional and diffusion tensor imaging. Eur Radiol 29:4068–4076
Niu L, Zhou X, Duan C et al (2019) Differentiation researches on the meningioma subtypes by radiomics from contrast-enhanced magnetic resonance imaging: a preliminary study. World Neurosurg 126:e646–e652
Morin O, Chen WC, Nassiri F et al (2019) Integrated models incorporating radiologic and radiomic features predict meningioma grade, local failure, and overall survival. Neurooncol Adv 1:1vdz011
Zhang Y, Chen JH, Chen TY et al (2019) Radiomics approach for prediction of recurrence in skull base meningiomas. Neuroradiology 61:1355–1364
Zhang J, Yao K, Liu P et al (2020) A radiomics model for preoperative prediction of brain invasion in meningioma non-invasively based on MRI: a multicentre study. EBioMedicine 58:102933
Tian Z, Chen C, Zhang Y et al (2020) Radiomic analysis of craniopharyngioma and meningioma in the sellar/parasellar area with MR images features and texture features: a feasible study. Contrast Media Mol Imaging 2020:4837156
He W, Xiao X, Li X et al (2019) Whole-tumor histogram analysis of apparent diffusion coefficient in differentiating intracranial solitary fibrous tumor/hemangiopericytoma from angiomatous meningioma. Eur J Radiol 112:186–191
Li X, Lu Y, Xiong J et al (2019) Presurgical differentiation between malignant haemangiopericytoma and angiomatous meningioma by a radiomics approach based on texture analysis. J Neuroradiol 46:281–287
Niu J, Zhang S, Ma S et al (2019) Preoperative prediction of cavernous sinus invasion by pituitary adenomas using a radiomics method based on magnetic resonance images. Eur Radiol 29:1625–1634
Zhang Y, Chen C, Tian Z, Xu J (2020) Discrimination between pituitary adenoma and craniopharyngioma using MRI-based image features and texture features. Jpn J Radiol 38:1125–1134
Ugga L, Cuocolo R, Solari D et al (2019) Prediction of high proliferative index in pituitary macroadenomas using MRI-based radiomics and machine learning. Neuroradiology 61:1365–1373
Lee WK, Wu CC, Lee CC et al (2020) Combining analysis of multi-parametric MR images into a convolutional neural network: precise target delineation for vestibular schwannoma treatment planning. Artif Intell Med 107:101911
Yang HC, Wu CC, Lee CC et al (2021) Prediction of pseudoprogression and long-term outcome of vestibular schwannoma after gamma knife radiosurgery based on preradiosurgical MR radiomics. Radiother Oncol 155:123–130
Lee CC, Lee WK, Wu CC et al (2021) Applying artificial intelligence to longitudinal imaging analysis of vestibular schwannoma following radiosurgery. Sci Rep 11:3106
Abdel Razek AAK, Elsebaie NA, Zamora C, Castillo M (2020) Imaging of neuronal and mixed glioneuronal tumors. J Comput Assist Tomogr 44:356–369
Fetit AE, Novak J, Rodriguez D et al (2018) Radiomics in pediatric neuro-oncology: a multicentre study on MRI texture analysis. NMR Biomed 31(1):66
Quon JL, Bala W, Chen LC et al (2020) Deep learning for pediatric posterior fossa tumor detection and classification: a multi-institutional study. AJNR Am J Neuroradiol 41:1718–1725
Zhou H, Hu R, Tang O et al (2020) Automatic machine learning to differentiate pediatric posterior fossa tumors on routine MR imaging. AJNR Am J Neuroradiol 41:1279–1285
Ramaswamy V, Remke M, Bouffet E et al (2016) Risk stratification of childhood medulloblastoma in the molecular era: the current consensus. Acta Neuropathol 131:821–831
Archer TC, Mahoney EL, Pomeroy SL (2017) Medulloblastoma: molecular classification-based personal therapeutics. Neurotherapeutics 14:265–273
Iv M, Zhou M, Shpanskaya K et al (2019) MR Imaging-based radiomic signatures of distinct molecular subgroups of medulloblastoma. AJNR Am J Neuroradiol 40:154–161
Sturm D, Pfister SM, Jones DTW (2017) Pediatric gliomas: current concepts on diagnosis, biology, and clinical management. J Clin Oncol 35:2370–2377
AlRayahi J, Zapotocky M, Ramaswamy V et al (2018) Pediatric brain tumor genetics: what radiologists need to know. Radiographics 38:2102–2122
Lassaletta A, Zapotocky M, Mistry M et al (2017) therapeutic and prognostic implications of BRAF V600E in pediatric low-grade gliomas. J Clin Oncol 35:2934–2941
Wagner MW, Hainc N, Khalvati F et al (2021) Radiomics of pediatric low-grade gliomas: toward a pretherapeutic differentiation of BRAF-mutated and BRAF-fused tumors. AJNR Am J Neuroradiol. https://doi.org/10.3174/ajnr.A6998
Calmon R, Puget S, Varlet P et al (2017) Multimodal magnetic resonance imaging of treatment-induced changes to diffuse infiltrating pontine gliomas in children and correlation to patient progression-free survival. Int J Radiat Oncol Biol Phys 99:476–485
Su X, Chen N, Sun H et al (2020) Automated machine learning based on radiomics features predicts H3 K27M mutation in midline gliomas of the brain. Neuro Oncol 22:393–401
Pan CC, Liu J, Tang J et al (2019) A machine learning-based prediction model of H3K27M mutations in brainstem gliomas using conventional MRI and clinical features. Radiother Oncol 130:172–179
Szychot E, Youssef A, Ganeshan B et al (2020) Predicting outcome in childhood diffuse midline gliomas using magnetic resonance imaging based texture analysis. J Neuroradiol S0150–9861(20):30131
Choy G, Khalilzadeh O, Michalski M et al (2018) Current applications and future impact of machine learning in radiology. Radiology 288:318–328
Loken E, Gelman A (2017) Measurement error and the replication crisis. Science 355:584–585
Fortin JP, Cullen N, Sheline YI et al (2018) Harmonization of cortical thickness measurements across scanners and sites. Neuroimage 167:104–120
This work is granted to the soul of Professor Ahmed Abdel Khalek Abdel Razek who passed away in July 2021.
No funding was received.
Ethics approval and consent to participate
Consent for publication
The authors declare no competing interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Abdel Razek, A.A.K., Alksas, A., Shehata, M. et al. Clinical applications of artificial intelligence and radiomics in neuro-oncology imaging. Insights Imaging 12, 152 (2021). https://doi.org/10.1186/s13244-021-01102-6
- Artificial intelligence
- Machine learning
- Deep learning